WO2019041856A1 - Home appliance control method, system and terminal, and storage medium - Google Patents

Abstract

The present application discloses a home appliance control method, system and terminal, and a storage medium. The home appliance control method comprises: acquiring input information of a user; acquiring a home appliance under control and a control action from the input information when a user intention indicated by the input information is a control intention; determining whether the home appliance under control is unique; outputting a first prompt for selecting a home appliance under control if the home appliance under control is not unique; upon reception of first feedback information of the user, generating a first control instruction according to a home appliance under control indicated by the first feedback information and the control action; and finally controlling, according to the first control instruction, the home appliance under control indicated by the first feedback information, that is, the home appliance under control selected by the user performing the control action.

Description

 Home appliance control method, system, control terminal, and storage medium

Technical field

The present application relates to the field of artificial intelligence technologies, and in particular, to a home appliance control method, system, control terminal, and storage medium.

Background technique

With the development of Internet of Things appliances, more and more home appliances support voice control. Users can control air conditioners, refrigerators, lights and other appliances through voice. For example, when users say "open", they can be identified as " The air conditioner is turned "on" and the air conditioner is turned on.

However, if the air conditioner of the user's home is controlled by voice, a situation in which a plurality of home appliances are controlled by voice may occur, for example, when the user has a living room air conditioner, a master bedroom air conditioner, and a child room air conditioner, and the user only wants to open. When the living room is air-conditioned, if the user only says "turn on the air conditioner", the main bedroom air conditioner may also be turned on; and when the user wants to turn on all the air conditioners and only speaks the "turn on the air conditioner" command, it is possible that only the living room air conditioner is turned on.

Summary of the invention

The main purpose of the present application is to provide a home appliance control method based on voice recognition, which aims to improve the accuracy of home appliance control.

To achieve the above objective, the home appliance control method proposed by the present application includes the following steps:

Obtaining input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation;

Determining whether the controlled appliance is unique;

If not, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, generating a first control instruction according to the first feedback information and the control action;

Controlling the controlled appliance pointed by the first feedback information to perform the control action according to the first control instruction.

Further, before outputting the first prompt for selecting the controlled home appliance, the following steps are also performed:

Whether the output controls the prompts of all the controlled home appliances;

If not, outputting a first prompt for selecting the controlled appliance;

If yes, outputting a prompt for controlling all the controlled home appliances, and controlling the all controlled home appliances to perform the control action when receiving the second feedback information of the user or not receiving the feedback information within the first preset time period.

Further, after outputting a prompt for controlling all the controlled home appliances, the home appliance control method further includes:

After receiving the third feedback information of the user, outputting a second prompt for selecting the controlled home appliance, and after receiving the fourth feedback information of the user, generating a second control command according to the fourth feedback information and the control action ;

Controlling the controlled appliance pointed by the fourth feedback information to perform the control action according to the second control instruction.

Further, after controlling the controlled appliance to perform the control action according to the control instruction, the home appliance control method further includes:

A prompt to output the current attribute status of the controlled appliance.

Further, after outputting the prompt of the current attribute state of the controlled home appliance, the home appliance control method further includes:

Whether the output increases the prompts of other controlled home appliances;

If yes, after receiving the fifth feedback information of the user, generating a third control instruction according to the fifth feedback information and the control action, and controlling the controlled home appliance pointed by the fifth feedback information to perform the control action ;

If not, or when the feedback information is not received within the second preset time period, the other controlled home appliances are controlled to enter a standby state.

Further, when the controlled home appliance is unique, generating a fourth control instruction according to the controlled home appliance and the control action;

The fourth control command is sent to the unique controlled home appliance for the unique controlled appliance to perform the control action.

Further, after the controlled appliance performs the control action, the home appliance control method further includes:

The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action.

Further, the step of acquiring the input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention of the input information is the control class representation, specifically includes:

Determining the type of the input information, and identifying the input information as text information when the input information is non-text;

Configuring a preset keyword that points to the user's intent;

After performing syntax and/or semantic analysis processing on the text information, extracting a text segment that matches the preset keyword;

Determining a user's intention based on the text segment and determining a category of the user's intent;

When the user intends to represent the interaction class, output the interaction data in response to the user based on the user intention, and display the interaction data in the preset manner on the control terminal;

When the user intends to be a control class representation, the controlled home appliance and the control action in the text information are acquired.

Further, the interaction class representation includes a query, a play, and a chat. When the user intends to be an interaction class representation, the step of outputting the interaction data in response to the user based on the user intention includes:

When the user intends to represent the query class, outputting the query result required by the user;

When the user intends to represent the play class, playing the multimedia content required by the user, and displaying the play information corresponding to the multimedia content;

When the user intends to represent the chat class, the chat content is generated according to the interaction record with the user.

Further, the step of displaying the interaction data in a preset manner on the control terminal includes:

When the interaction data is a query result, the query result is processed into a voice, and/or a chart or a snapshot matching the query result is displayed on the control terminal;

When the interaction data is multimedia content, playing the multimedia content, and displaying list information and play information related to the multimedia content;

When the interaction data is chat content, the chat content is processed into a voice broadcast to the user.

Another object of the present application is to provide a control terminal including a memory, a processor, and a home appliance control program stored in the memory and running on the processor, the home appliance control program being the processor The steps of the home appliance control method as described above are implemented at the time of execution.

The application further provides a home appliance control system, the appliance control system comprising:

a control terminal as described above; and,

The controlled home appliance receives the control command of the control terminal and performs the control action according to the control command.

The present application also proposes a storage medium storing a home appliance control program that implements the steps of the home appliance control method as described above when executed by the processor.

The home appliance control method of the present application acquires the input information of the user, and when the user intention pointed by the input information is a control class representation, acquires the controlled home appliance and the control action in the input information, and determines the controlled home appliance. Whether it is unique, when the controlled home appliance is not unique, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, according to the controlled home appliance pointed to by the first feedback information and the The control action generates a first control command, and finally controls the controlled home appliance pointed by the first feedback information according to the first control command, that is, the controlled home appliance selected by the user performs the control action. The home appliance control method prompts the user to make a selection when the plurality of controlled home appliances can perform the control action, and generates a control instruction for the controlled home appliance selected by the user after the user makes the feedback information, so as to control the selected by the user. Controlling the home appliance to perform the control action in the input information, avoiding the simultaneous response of the plurality of controlled home appliances, resulting in inaccurate home appliance control, and improving the accuracy of home appliance control.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present application, and other drawings can be obtained according to the structures shown in the drawings without any creative work for those skilled in the art.

1 is a schematic structural diagram of hardware of an embodiment of a control terminal according to the present application;

2 is a flow chart of an embodiment of a home appliance control method according to the present application;

3 is a specific flowchart of an embodiment of step S10 in FIG. 2;

4 is a specific flowchart of an embodiment of step S15 in FIG. 3;

FIG. 5 is a specific flowchart of another embodiment of step S15 in FIG.

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings.

Detailed ways

It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

The terminal can be implemented in various forms. For example, the control terminal described in the present application may include home appliances such as an air conditioner, a television, a refrigerator, a washing machine, a water heater, an air purifier, a vacuum cleaner, and the like, and may also include, for example, a smart speaker, a mobile phone, a tablet, a laptop, a palm. Computer, personal digital assistant (Personal Digital Assistant, PDA), Portable Media Player (Portable Media) Player, PMP), navigation device, wearable device, smart bracelet, pedometer and other terminals.

In the following description, a home appliance terminal such as an air conditioner or a refrigerator will be described as an example, and those skilled in the art will understand that the configuration according to the embodiment of the present application can be applied in addition to the component particularly used for the purpose of movement. Other terminals such as smart speakers.

As shown in FIG. 1, FIG. 1 is a schematic structural diagram of hardware of an embodiment of a control terminal of the present application.

As shown in FIG. 1, the control terminal 100 may include a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection communication between these components. The user interface 1003 may include a display unit (Display), an input unit such as an interactive interface. In the present application, the control terminal 100 may interact with the user through a voice function during the running of the software, and perform parameter setting or debugging on the control terminal 100. The tester or setup personnel can use the user interface 1003 to input data information. The optional user interface 1003 can also include a standard wired interface and a wireless interface. The network interface 1004 can optionally include a standard wired interface, a wireless interface (such as a WI-FI interface). The memory 1005 may be a high speed RAM memory or a stable memory (non-volatile) Memory), such as disk storage. The memory 1005 can also optionally be a storage device independent of the aforementioned processor 1001.

Optionally, the control terminal 100 may further include a microphone, a speaker, a voice recognition system, a camera, and an RF (Radio). Frequency, RF) circuits, sensors, audio circuits, WiFi modules, and more. Among them, sensors such as light sensors, motion sensors, air quality sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display unit according to the brightness of the ambient light, and the proximity sensor may turn on the display unit when detecting that the person enters the control terminal 100 / or backlight. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the attitude of the mobile terminal (such as magnetometer attitude calibration). The vibration quality recognition function (such as tapping), etc.; as the environmental detection component, the air quality sensor may be a temperature sensor, a humidity sensor, a carbon dioxide sensor, and a PM2.5 sensor, and the air quality sensor in this embodiment is preferably PM2. 5 sensors, in order to detect the air quality of the environment in which the control terminal is located in real time; of course, the control terminal 100 can also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, and the like, and details are not described herein again.

It will be understood by those skilled in the art that the hardware structure shown in FIG. 1 does not constitute a limitation to the control terminal 100, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements.

The main solution of the embodiment of the present application is: obtaining the input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation, and determining the Whether the controlled home appliance is unique, and when the controlled home appliance is not unique, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, according to the controlled appliance pointed to by the first feedback information And generating, by the control action, a first control instruction, and finally controlling, according to the first control instruction, the controlled home appliance pointed by the first feedback information, that is, the controlled home appliance selected by the user to perform the control action.

The home appliance control method prompts the user to make a selection when the plurality of controlled home appliances can perform the control action, and generates a control instruction for the controlled home appliance selected by the user after the user makes the feedback information, so as to control the selected by the user. Controlling the home appliance to perform the control action in the user input information, avoiding the simultaneous response of the plurality of controlled home appliances, resulting in inaccurate home appliance control, and improving the accuracy of home appliance control.

As shown in FIG. 1, an operating system, a network communication module, and a home appliance control program may be included in the memory 1005 as a computer storage medium.

In the control terminal 100 shown in FIG. 1, the network interface 1004 is mainly used to connect to a background server or a big data cloud, and performs data communication with a background server or a big data cloud; the user interface 1003 is mainly used to connect a client (user end), The data communication with the client is performed; and the processor 1001 can be used to call the home appliance control program stored in the memory 1005 and perform the following operations:

Obtaining input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation;

Determining whether the controlled appliance is unique;

If not, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, generating a first control instruction according to the first feedback information and the control action;

Controlling the controlled appliance pointed by the first feedback information to perform the control action according to the first control instruction.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

Whether the output controls the prompts of all the controlled home appliances;

If not, outputting a first prompt for selecting the controlled appliance;

If yes, outputting a prompt for controlling all the controlled home appliances, and controlling the all controlled home appliances to perform the control action when receiving the second feedback information of the user or not receiving the feedback information within the first preset time period.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

After receiving the third feedback information of the user, outputting a second prompt for selecting the controlled home appliance, and after receiving the fourth feedback information of the user, generating a second control command according to the fourth feedback information and the control action ;

Controlling the controlled appliance pointed by the fourth feedback information to perform the control action according to the second control instruction.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

A prompt to output the current attribute status of the controlled appliance.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

Whether the output increases the prompts of other controlled home appliances;

If yes, after receiving the fifth feedback information of the user, generating a third control instruction according to the fifth feedback information and the control action, and controlling the controlled home appliance pointed by the fifth feedback information to perform the control action ;

If not, or when the feedback information is not received within the second preset time period, the other controlled home appliances are controlled to enter a standby state.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

And when the controlled home appliance is unique, generating a fourth control instruction according to the controlled home appliance and the control action;

The fourth control command is sent to the unique controlled home appliance for the unique controlled appliance to perform the control action.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

Determining the type of the input information, and identifying the input information as text information when the input information is non-text;

Configuring a preset keyword that points to the user's intent;

After performing syntax and/or semantic analysis processing on the text information, extracting a text segment that matches the preset keyword;

Determining a user's intention based on the text segment and determining a category of the user's intent;

When the user intends to represent the interaction class, output the interaction data in response to the user based on the user intention, and display the interaction data in the preset manner on the control terminal;

When the user intends to be a control class representation, the controlled home appliance and the control action in the text information are acquired.

Further, the interaction class representation includes query, play, and chat, and the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

When the user intends to represent the query class, outputting the query result required by the user;

When the user intends to represent the play class, playing the multimedia content required by the user, and displaying the play information corresponding to the multimedia content;

When the user intends to represent the chat class, the chat content is generated according to the interaction record with the user.

Further, the processor 1001 may also call the home appliance control program stored in the memory 1005 to perform the following operations:

When the interaction data is a query result, the query result is processed into a voice, and/or a chart or a snapshot matching the query result is displayed on the control terminal;

When the interaction data is multimedia content, playing the multimedia content, and displaying list information and play information related to the multimedia content;

When the interaction data is chat content, the chat content is processed into a voice broadcast to the user.

The present application further provides a home appliance control method. The prompts and feedbacks in the present application are voiced as an embodiment, but are not limited to voice prompting or feedback, and text prompts, vibration prompts, sound and light prompts, etc. are included in the present application. Within the scope of protection.

Referring to FIG. 2, FIG. 2 is a flowchart of an embodiment of a home appliance control method according to the present application.

In this embodiment, the home appliance control method includes the following steps:

S10: Acquire input information of the user, and acquire the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation;

S20: determining whether the controlled home appliance is unique;

If not, proceed to step S30;

S30: The output prompts whether to control all the controlled home appliances;

If not, proceed to step S31a;

S31a: outputting a first prompt for selecting a controlled home appliance;

S32a: After receiving the first feedback information of the user, generating a first control instruction according to the first feedback information and the control action;

S33a: Control, according to the first control instruction, the controlled home appliance pointed by the first feedback information to perform the control action.

In this embodiment, the home appliance control method is used for a control system composed of a plurality of home appliances and/or a plurality of home appliances, wherein any one of the home appliances can be used as a control terminal to collect a voice analog signal of the user, and the voice is used as the control terminal. The analog signal is converted into a voice digital signal and processed into a corresponding voice control command and sent to the controlled home appliance to perform a control action desired by the user. The control terminal may be a home appliance terminal such as an air conditioner or a refrigerator, or may be an intelligent gateway or a server. The terminal, in order to facilitate the acquisition of the user's voice signal, is also convenient for outputting a voice prompt to the user. The control terminals in the present application include a sound collecting device such as a microphone and a speaker, and a sound playing device.

When interacting with the control terminal, the user can input text, voice, picture, video, expression and other input information in the relevant interface of the control terminal, such as inputting text information on the interactive interface of the air conditioner, and inputting voice information by using the voice module of the air conditioner. Obtaining, by using an image capturing module of the air conditioner, information such as a picture, a video, or an expression of the user, and then acquiring a user intention based on the input information of the user, and according to the input information, the user intention may be divided into an interaction class and a control class, when When the user intends to represent the control class, acquire the controlled home appliance and the control action in the input information,

For example, when the user needs to control a certain home appliance in the room, the user can output a voice control command to the control terminal connected to each home appliance in the natural language, and the microphone of the control terminal picks up the voice analog signal including the voice control command. Converting the voice analog signal into a voice digital signal for processing by analog-to-digital conversion, such as converting the voice digital signal into text information or re-converting to a higher power voice analog signal output, processing the voice control command The purpose is to obtain the controlled home appliance in the voice control command and the control action that the user desires to perform the controlled home appliance, such as “control air conditioner opening”, “control air conditioner temperature adjustment to 17° C.”, etc., in other implementations. For example, before the user's voice control command is obtained, the wake-up operation of the control terminal may be set, for example, by training a preset voice command or a preset gesture action as a condition for waking up the control terminal, when the voice command and the user output the voice command Wake up the control terminal when the preset voice command matches Receiving a voice control instruction of the user, or when the gesture action made by the user matches the preset gesture action, waking up the control terminal, thereby saving power consumption of the control terminal, and preventing the control terminal from executing according to the non-human voice control instruction Some operations.

The main purpose of processing the user voice control command is to know the home appliance that the user wants to control and the control action that the user wants to control, and to prevent the indoor controlled appliance from being unique when the user controls the controlled home appliance. Simultaneously controlling the control of a plurality of controlled home appliances leads to an increase in energy consumption, or controlling the wrong controlled home appliance, causing the user's intention to be unsatisfied, and determining whether the controlled home appliance is unique. When the controlled appliance is not unique, further output is controlled. The voice prompts of all the controlled home appliances are obtained in order to obtain further confirmation from the user, thereby accurately controlling the home appliances that the user desires to control. For example, when there is a main bedroom air conditioner, a living room air conditioner, a kitchen air conditioner, and a refrigerator as a control terminal, when the refrigerator acquires a voice control command of the user to “turn on the air conditioner”, it is determined that the air conditioner existing in the room is not unique. At this time, the voice prompt of "whether or not all air conditioners are turned on" is output, and when the user does not agree to turn on all the air conditioners, the refrigerator as the control terminal further outputs a voice prompt of "selecting the air conditioner to be turned on".

After receiving the voice prompt, the user may select the main bedroom air conditioner, the living room air conditioner, or the kitchen air conditioner as the first feedback information to feed back to the control terminal, and receive the “main bedroom air conditioner” at the control terminal, After the first feedback information of "living room air conditioner" or "kitchen air conditioner", the "main bedroom air conditioner", "living room air conditioner", or "kitchen air conditioner" and the "open" control action in the voice control command In combination, it is processed into a first control command of "opening the main bedroom air conditioner", "opening the living room air conditioner", or "turning on the kitchen air conditioner".

After the first control command is generated, the first control command is sent to the corresponding controlled home appliance through a communication connection between the control terminal and other home appliances, and a different identification of the different controlled home appliances, such as The "opening the main bedroom air conditioner" is sent to the main bedroom air conditioner, the "opening the living room air conditioner" is sent to the living room air conditioner, or the "opening the kitchen air conditioner" is sent to the kitchen air conditioner, so that the corresponding air conditioner is according to the first A control command performs an "on" action.

In addition, when the user sends the first control command of “opening the living room air conditioner” to the living room air conditioner, the living room air conditioner is already in an open state, and at this time, the living room air conditioner will not execute the first control instruction, but will The information is fed back to the control terminal, and the control terminal outputs to the user a voice prompt that the control command is invalid and the living room air conditioner is turned on.

The home appliance control method of the embodiment obtains the input information of the user, and when the user intention pointed by the input information is a control class representation, acquires the controlled home appliance and the control action in the input information, and determines the controlled Whether the home appliance is unique, and when the controlled home appliance is not unique, outputting a first voice prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, according to the controlled home appliance pointed to by the first feedback information The control action generates a first control instruction, and finally controls the controlled home appliance pointed by the first feedback information according to the first control instruction, that is, the controlled home appliance selected by the user performs the control action. The home appliance control method may prompt the user to make a selection when the plurality of controlled home appliances can perform the control action, and generate a control instruction for the controlled home appliance selected by the user after the user makes the feedback information, so as to control the user selected The controlled home appliance performs the control action in the input information, thereby avoiding the inaccurate control caused by the simultaneous response of the plurality of controlled home appliances, and improving the accuracy of the home appliance control.

Further, referring to FIG. 2, based on the home appliance control method of the above embodiment, before performing step S31a, the following steps are further performed:

S30: The output prompts whether to control all the controlled home appliances;

If yes, proceed to step S31b;

S31b: outputting a prompt for controlling all the controlled home appliances;

S32b: Control all the controlled appliances to perform the control action when receiving the second feedback information of the user or not receiving the feedback information within the first preset time period.

In this embodiment, when the control terminal queries the localized local area network to scan or the cloud server address to find that the controlled home appliance is not unique, whether to output a voice prompt for controlling all the controlled home appliances, for example, output “whether or not all air conditioners are adjusted to 20° C.” The voice prompt, when the user agrees to the voice prompt, further outputs a voice prompt of “controlling all air conditioners to 20° C.” to obtain the final confirmation of the user, and after receiving the voice prompt, the user may make “confirmation” feedback information. When receiving the second feedback information of “confirmation”, the control terminal controls all the controlled appliances to perform the control action, such as controlling all the air conditioners to adjust to 20° C. In another embodiment, after the control terminal outputs the voice prompt of “control all air conditioners to 20° C.”, the user may not be able to make “confirmation” feedback information in time for some reason, and the user outputs “in the control terminal”. If the voice prompt of all air conditioners is adjusted to 20 °C, the voice prompt is agreed, so when the feedback information is not received within the first preset duration, the default user makes a "confirmation" feedback information, thereby controlling all When the air conditioner is adjusted to 20 ° C, the control terminal can open only one of the controlled home appliances according to the feedback information of the user when the user needs to open a plurality of controlled home appliances in the control voice command, thereby preventing the control from being inaccurate and avoiding The occurrence of control errors has improved the accuracy of home appliance control.

Further, referring to FIG. 2, based on the home appliance control method of the above embodiment, after performing step S31b, the home appliance control method further includes:

S33b: after receiving the third feedback information of the user, outputting a second prompt for selecting the controlled home appliance, and after receiving the fourth feedback information of the user, generating a second according to the fourth feedback information and the control action Control instruction;

S34b: Control, according to the second control instruction, the controlled home appliance pointed by the fourth feedback information to perform the control action.

In this embodiment, after the control terminal outputs a voice prompt for controlling all the controlled home appliances, the user can still make a “confirmation” feedback information according to actual needs, or make a “cancellation” feedback information; when the user makes a “cancel” After the third feedback information, the microphone of the control terminal picks up a voice command that the user does not agree to control all the controlled home appliances to perform the control action, and further outputs a second voice prompt for selecting the controlled home appliance for the third feedback information. Prompting the user to select the controlled home appliance that is desired to be controlled. For example, when the user disagrees with the voice prompt of “controlling all air conditioners to 20° C.”, the user makes a third feedback message of “cancel”, and the control terminal receives the first After the feedback information, the “air conditioner selected to 20°C” will be further output. At this time, the user can select the kitchen air conditioner to adjust to 20 °C according to the need, and then make the fourth feedback information of “kitchen air conditioner”, and the control terminal obtains the location. After the fourth feedback information is described, the “kitchen air conditioner” in the fourth feedback information and the voice control instruction Was adjusted to 20 ℃ "to control operation processing" kitchen deg.] C air conditioner 20 is adjusted to "a second control instruction.

After the second control command is generated, the second control command is sent to the corresponding communication connection between the control terminal and the kitchen air conditioner, and the difference between the kitchen air conditioner and the main bedroom air conditioner and the living room air conditioner. The kitchen air conditioner sends the "kitchen air conditioner to 20 ° C" to the kitchen air conditioner so that the kitchen air conditioner performs the temperature adjustment action according to the second control command.

In addition, when the user sends a second control command of "kitchen air conditioner to 20 ° C" to the kitchen air conditioner, the operating temperature of the kitchen air conditioner may be exactly 20 ° C. At this time, the kitchen air conditioner will not execute the second The control command feeds back the information to the control terminal, and the control terminal outputs to the user a voice prompt that the control command is invalid and the current temperature of the kitchen air conditioner is 20 °C.

Further, referring to FIG. 2, after the control device is controlled to perform the control action according to the control instruction, the home appliance control method further includes:

S40: A prompt for outputting the current attribute state of the controlled home appliance.

In this embodiment, after the control device in the controlled home appliance and the voice control command in the feedback information of the user generates the control device to which the control command feedback information is directed to perform the control action, in order to improve the control terminal and the user Inter-activity, also outputting a voice prompt of the current attribute state of the controlled home appliance, so that the user knows whether the controlled home appliance responds to the user's voice control command, for example, after the user makes the fourth feedback information of the "kitchen air conditioner", Controlling the "kitchen air conditioner" to be adjusted to 20 ° C based on the second control command generated by the "kitchen air conditioner" and the "tune to 20 ° C" control action in the voice control command, and operating temperature of the kitchen air conditioner After adjusting to 20 ° C, the current attribute state of the kitchen air conditioner, that is, "the operating temperature of the kitchen air conditioner is 20 ° C" is output as a voice prompt to the user, so that the user knows that the kitchen air conditioner responds to the user's voice control command.

Further, referring to FIG. 2, based on the home appliance control method of the above embodiment, after performing step S40, the home appliance control method further includes:

S50: Whether the output increases the prompt of other controlled home appliances;

If yes, proceed to step S51;

S51: After receiving the fifth feedback information of the user, generate a third control instruction according to the fifth feedback information and the control action, and control the controlled home appliance pointed by the fifth feedback information to perform the control action;

If no, or does not receive the feedback information within the second preset duration, step S52;

S52: Control the other controlled home appliances to enter a standby state.

In this embodiment, after the controlled appliance that generates the control instruction feedback information is executed according to the control action in the controlled home appliance and the voice control command in the feedback information of the user, the user may also need to control other Controlled home appliances, therefore, in order to increase the intelligence level of the home system composed of the control terminal and the controlled home appliance, and to improve the artificial intelligence of the control terminal, after outputting the voice prompt of the current attribute state of the controlled home appliance, whether the further output is increased or not The voice prompts of other controlled home appliances increase the user's choice and thus increase the interaction between the user and the control terminal. After the output increases the voice prompts of other controlled home appliances, the user can increase or not increase the feedback information of other controlled home appliances according to the voice prompt; when the user chooses to add other controlled home appliances, the output of the controlled home appliance to be increased is output. The fifth feedback information, as in the embodiment described above, after the user selects to adjust the kitchen air conditioner to 20 degrees, and further desires to control the main bedroom air conditioner to be adjusted to 20 ° C, after the control terminal outputs whether to increase the voice prompts of other controlled home appliances, And making a fifth feedback information of the “main bedroom air conditioner”, after the control terminal receives the fifth feedback information of the “main bedroom air conditioner”, according to the “main bedroom air conditioner” and the “adjusted to 20° C.” The control action generates a third control command, after the third control command is generated, a communication connection between the control terminal and the main bedroom air conditioner, and a difference mark between the main bedroom air conditioner and the kitchen air conditioner and the living room air conditioner, Sending the third control command to the corresponding main bedroom air conditioner, if the "main bedroom air conditioner is adjusted to 20 ° C" is sent to the main bedroom air conditioner, so that the main bedroom is empty Perform a temperature adjustment operation based on the third control instruction.

In addition, when the user sends the third control command of “main room air conditioner to 20 ° C” to the main bedroom air conditioner, the operating temperature of the main bedroom air conditioner may be exactly 20 ° C. At this time, the main bedroom air conditioner will not execute. The third control command feeds back the information to the control terminal, and the control terminal outputs to the user a voice prompt that the control command is invalid and the current temperature of the main bedroom air conditioner is 20 °C.

Further, after the control terminal further outputs whether to increase the voice prompt of other controlled home appliances, when the user chooses not to add other control home appliances, the other controlled home appliances may be controlled to enter the standby state when the other controlled home appliances are in the awake state. To save energy. In another embodiment, after the control terminal outputs the voice prompt of “whether or not to add other controlled home appliances”, the user may not be able to make feedback information in time for some reason, and the user outputs “whether to increase other controlled home appliances” in the control terminal. The voice prompt is output when the controlled home appliance has executed the voice control command, so when the feedback information is not received within the second preset time period, the default user makes a feedback message of “no increase”, and further Controlling the other controlled home appliances to enter a standby state, and avoiding that the user does not need to increase other controlled home appliances that can perform the control actions in the voice command, the control terminal opens other controlled home appliances according to the feedback information of the user, resulting in inaccurate control. It also avoids the occurrence of control errors and improves the accuracy of home appliance control.

Further, referring to FIG. 2, based on the home appliance control method of the above embodiment, after performing step S20, the home appliance control method further includes:

S21: When the controlled home appliance is unique, generating a fourth control instruction according to the controlled home appliance and the control action;

S22: Send the fourth control instruction to the only controlled home appliance, so that the only controlled appliance performs the control action.

In this embodiment, when determining whether the controlled home appliance is unique, when the local area network scan or the cloud server detects that the controlled home appliance is unique, for example, when the voice control instruction of “turning on the air purifier” is acquired, , based on the local area network scanning and the cloud server detection to determine the home system composed of the control terminal and the controlled home appliance, when there is only a single air purifier, according to the "air purifier" and the "open" in the voice control command to generate the fourth Controlling instructions, after the fourth control command is generated, by the communication connection between the control terminal and the air purifier, and the difference identifier between the air purifier and other controlled home appliances, the fourth control command Sended to the claimed air purifier so that the air purifier performs an "on" action in accordance with the fourth control command.

In addition, when the user sends the fourth control command of “opening the air purifier” to the air purifier, the air purifier is already in an open state, and at this time, the air purifier will not execute the fourth control command. Instead, the information is fed back to the control terminal, and the control terminal outputs to the user a voice prompt that the control command is invalid and the air purifier is turned on.

Further, after the controlled appliance performs the control action, the home appliance control method further includes:

The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action.

In this embodiment, when the user inputs "air conditioner At 18 ° C", based on the syntax and semantic analysis in natural language understanding, you can know that the user wants to control the air conditioner in the home appliance to 18 ° C, or adjust the temperature of the air conditioner to 18 ° C, so that the "air conditioner is adjusted to The 18°C” control command is sent to the corresponding air conditioner for execution. After the air conditioner adjusts the operating temperature to 18°C, the current snapshot information and the comparison value before and after the change of the control attribute are fed back to the control terminal. Such as the air conditioning refrigeration or heating temperature, operating mode, wind speed, sweep mode, running time and other information, and the air conditioner from the current cooling or heating temperature to 18 ° C before and after the comparison value, and the snapshot information processing For the two columns, the first column is the property name of the air conditioner, such as temperature, wind speed, mode, sweep mode, and the second category is attribute values, such as 18 ° C, 4 levels, cooling, up and down, and the air conditioner is The current temperature change value of 18 °C is marked with an arrow, the start end of the arrow indicates the current temperature, and the arrow pointing end indicates the temperature after the control; if the control command input by the user is switched from heating to manufacturing In the cold mode, the snapshot information should be represented as the attribute name: mode "heating → cooling", and color or bold processing.

Further, referring to FIG. 3, based on the home appliance control method of the above embodiment, step S10 specifically includes:

S11: determining a type of the input information, and identifying the input information as text information when the input information is non-text;

S12: configuring a preset keyword that points to the user's intention;

S13: After performing syntax and/or semantic analysis processing on the text information, extracting a text segment that matches the preset keyword;

S14: determining a user intention based on the text segment, and determining a category of the user intention;

S15: When the user intends to be an interaction class representation, output interaction data corresponding to the user based on the user intention, and display the interaction data in a preset manner on the control terminal;

S16: When the user intends to be a control class representation, acquire the controlled home appliance and the control action in the text information.

In this embodiment, when interacting with the control terminal, the user can input input information such as text, voice, picture, video, and expression on the relevant interface of the control terminal, such as inputting text information on the interactive interface of the air conditioner, and using the air conditioner. The voice module inputs voice information, and uses the image acquisition module of the air conditioner to obtain information such as a picture, a video, or an expression of the user, and then transmits the input information to the cloud server, and the cloud server performs natural language understanding on the text information input by the user. The syntax and semantic analysis process further needs to convert the non-text information into text information when the input information is non-text information, for example, when the input information is voice information, input the user by using a voice recognition technology The voice information is recognized as text information, and when the input information is image information, the acquired image information of the user is recognized as text information by using image recognition technology.

The recognition of user intent mainly relies on syntactic and semantic analysis in natural language. In other embodiments, it may be necessary to use sentiment analysis to make judgments. Natural language understanding is to train the model through text information to achieve the recognition of the user's meaning. Judging that the training model can rely on artificial intelligence to automatically analyze the user's meaning representation, while the training model relies on keywords, and by configuring preset keywords that point to different user intents, training different keywords to correspond to different user intentions. And after the input information input by the user is recognized as text information and processed by syntax and semantic analysis in natural language understanding, a text segment matching the preset keyword is extracted from the text information, and then the pointing is determined based on the text segment. User intent, and determine the category of the user's intent, such as from the chat category, encyclopedia, real-time weather query class, forecast weather query class, song list play class, song play class, home appliance control class and home appliance query according to keyword information Determining the control of matching the keyword in the class And then determine the user's intent categories.

Outputting the interaction data of the responding user or controlling the controlled instruction of the controlled home appliance based on the user's intention, determining the meaning representation of the user according to the obtained user input information, and classifying the meaning representation representing the user's intention based on the keyword and the semantics, and classifying For control and interaction, the interaction class means to include three categories of query, play, and chat, and then output response data of the responding user based on the user intent or control the controlled home appliance based on the user's intention. . The interaction data includes chat content, multimedia content for playing, and query results generated according to a query question of the user. For example, after receiving the voice control command of the "turn on the air conditioner" spoken by the user, the voice information is recognized as "opening the air conditioner" text information, and then the grammar and part of speech analysis is performed, "turning on the air conditioner "For an imperative sentence, a verb "open", a noun "air conditioner", it can be known that the controlled home appliance in the voice control command is "air conditioner", and the control action is "open".

Further, when the input information is voice information, the voice information is identified as text information by an acoustic model and a grammatical structure;

When the input information is image information, the image information is recognized as text information by image feature extraction.

In this embodiment, the recognition of the user's intention mainly depends on the syntax and semantic analysis in the natural language. In other embodiments, the sentiment analysis may be used, and the syntax and semantic analysis, and the sentiment analysis are based on the text. Therefore, when the user input information is non-text information, it needs to be recognized as text information. When collecting user input information, it can rely on various methods, such as the text input function of the terminal, the voice input function of the terminal or the home appliance, and the image input function of the terminal or the home appliance, and in order to save energy, the above functions are used. Before, the terminal or the home appliance may be in the standby state or the above functions are not turned on, so before using the above functions or obtaining input information such as text, voice, or image input by the user, the text input function of the control terminal needs to be woken up by the wake-up instruction. Or controlling the voice input function or the image input function of the terminal and the home appliance to acquire the input information input by the user through the control terminal or the home appliance; and the non-text information in the input information needs to be recognized as text information, for example, When the input information is voice information, the voice information input by the user is recognized as text information by the acoustic model and the grammatical structure in the voice recognition; when the input information is image information and is a single frame image, Extract the single frame image directly The image feature identifies the image feature as text information; when the input information is image information and is a multi-frame image, acquiring feature vectors in each frame image, and calculating image features in combination with feature vectors of the multi-frame image The action change trend is further inferred to indicate the meaning of the expression of the multi-frame image, and further recognizes it as text information.

Further, referring to FIG. 4, the interaction class representation includes a query, a play, and a chat, and the step S15a includes:

S151a: when the user intention is a query class representation, outputting a query result required by the user;

S152a: when the user intends to play the class representation, play the multimedia content required by the user, and display the play information corresponding to the multimedia content;

S153a: When the user intends to be a chat class representation, the chat content is generated according to the interaction record with the user.

In this embodiment, when the interaction data of the response user is output based on the user's intention, the user's meaning representation is determined according to the acquired user input information, and the interactive class meaning representation representing the user's intention is classified based on the keyword and the semantic, specifically Divided into three categories of query, play, and chat, and then generate corresponding interaction data according to each user intent based on the mapping relationship, for example, when the user intends to represent the query class, correspondingly generate a result or answer that matches the query content. For example, when the text information, the voice information, or the image information input by the user is determined to be a query-like meaning representation, the first keyword is obtained from the query content input by the user, and if the user wants to query the current weather, the control terminal automatically Get "weather" as the first keyword, and then search for "weather" related text content in the cloud big data based on "weather", such as current weather temperature, humidity, ultraviolet intensity, PM2.5, wind and other information, generate The result of the query; if the user wants to query the current state of the air conditioner, the control terminal will Obtain an "air-conditioner" as the first keyword, and then based on the current operating status information "air-conditioner" Search air conditioner in the local database, generate query results.

When the user intends to represent the play class, the multimedia content matching the play requirement is generated according to the play requirement, and the play information of the multimedia content, such as the play duration of the multimedia content, the play format, the play code rate, etc., are generated when the user When the input text information, voice information, or image information is determined to be a play-like meaning representation, the second keyword is obtained from the playback requirement input by the user, for example, the user wants to play Liang Jingru's "Fly". "away", the control terminal will automatically obtain "Liang Jingru" and "Fly away" as the second keyword, and then search in the local database or cloud big data with "Liang Jingru" and "Fly The multimedia content and its introductory information are generated, and the multimedia content and the playing information are generated, and the playing information includes information such as playing duration, audio encoding rate, sound quality, and song introduction.

When the user intends to represent the chat class, the corresponding chat content is generated based on the historical chat record or context semantics.

Further, referring to FIG. 5, based on the home appliance control method of the above embodiment, step S15b specifically includes:

S151b: when the interaction data is a query result, processing the query result into a voice, and/or a chart or a snapshot matching the query result is displayed on the control terminal;

S152b: when the interaction data is multimedia content, play the multimedia content, and display list information and play information related to the multimedia content;

S153b: When the interaction data is chat content, the chat content is processed into a voice broadcast to the user.

In this embodiment, when the interaction data of the response user is displayed in the control terminal according to the corresponding decision mode, according to the mapping relationship between the interaction data and the decision mode, each type of interaction data corresponds to a decision displayed on the control terminal. In a way, so that the user can easily know whether the previously issued interaction request has obtained feedback, and the artificial intelligence is added to the user to interact with the home appliance, the device, or the server to improve the user experience, for example, when the user inputs "weather", Based on the syntax and semantic analysis in natural language understanding, it can be known that the user wants to query the current real-time weather or future weather forecast information. In order to more accurately know the user's intention, in other embodiments, the real-time weather query or forecast can be fed back again. The feedback information of the weather query, when obtaining the user's selection operation, responds differently to the user's selection operation, and then outputs different interaction data in the control terminal; of course, the current real-time weather and the future forecast weather may also be directly directly Information generates interactive data feedback to the user At this time, the text description of the real-time weather information and/or the forecast weather information may be processed into a voice or a chart to be displayed to the control terminal for display by means of a corresponding decision manner, such as the current real-time weather information and/or the forecast weather information. The voice broadcast mode is played to the user and the picture or animation that reflects the weather condition is displayed on the control terminal at the same time. When the user queries the information of a certain home appliance, a snapshot of the attribute state of the home appliance is generated, and a snapshot including the home appliance attribute name and the attribute value information is pushed to the control terminal for display.

When the user inputs "playing ×××", based on the syntax and semantic analysis in natural language understanding, it can be known that the user wants to play the multimedia content of "×××", when the multimedia content pointed to by "×××" is unique, Directly pushing the link of the multimedia content or the multimedia content to the control terminal and playing, or controlling other multimedia playing devices to play the multimedia content; when the multimedia content pointed to by “×××” is not unique, generating the multimedia content playlist and pushing to the control a terminal and a first file in the playlist, the multimedia content playlist includes three columns, the first column is the name of the multimedia content, the second column is the author, and the third column is the play control button, when the user clicks the The multimedia content is automatically played when the control button is played.

When the user inputs the keyword information with the emotional tone, the user's chat intention can be known, and then the chat content is generated according to the contextual intelligence in the context, and displayed in the control terminal by voice or expression.

In addition, all the controlled home appliances in the present application may be the same type of home appliances, or may be different types of home appliances. Similarly, the feedback information provided by the user may be a choice among similar home appliances, or may be a selection among different types of home appliances. .

The application further proposes a home appliance control system.

In this embodiment, the appliance control system includes:

a control terminal as described above; and,

The controlled home appliance receives the control command of the control terminal and performs the control action according to the control command.

In the home appliance control system of the embodiment, the control terminal acquires input information of the user, and when the user intention pointed by the input information is a control class representation, acquires the controlled home appliance and the control action in the input information, and determines the Whether the controlled home appliance is unique, and when the controlled home appliance is not unique, the first voice prompt of the controlled home appliance is outputted through the voice playback device of the control terminal, such as a speaker, and the first feedback information of the user is received through the microphone. And generating a first control instruction according to the controlled home appliance pointed by the first feedback information and the control action, and finally sending the first control instruction to the controlled home appliance pointed by the first feedback information, that is, the user The selected controlled home appliance performs the control action according to the first control instruction after the controlled appliance receives the first control command of the control terminal. The home appliance control system prompts the user to make a selection when the plurality of controlled home appliances can perform the control action, and generates a control instruction for the controlled home appliance selected by the user after the user makes the feedback information, so as to control the user selected The controlled home appliance performs the control action in the input information, thereby avoiding the simultaneous response of the plurality of controlled home appliances, resulting in inaccurate home appliance control, and improving the accuracy of home appliance control.

In addition, the embodiment of the present application further provides a storage medium storing a home appliance control program, and the home appliance control program is executed by the processor to implement the steps of the home appliance control method as described above.

For the method implemented when the home appliance control program is executed, refer to various embodiments of the home appliance control method of the present application, and details are not described herein again.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, item, or system. An element defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in a process, method, article, or system that includes the element, without further limitation.

The serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM as described above). , a disk, an optical disk, including a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in the various embodiments of the present application.

The above is only a preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of this application.

Claims (18)

 A home appliance control method, wherein the home appliance control method comprises the following steps: Obtaining input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation; Determining whether the controlled appliance is unique; If not, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, generating a first control instruction according to the first feedback information and the control action; Controlling the controlled appliance pointed by the first feedback information to perform the control action according to the first control instruction. The home appliance control method according to claim 1, wherein after controlling the controlled appliance to perform the control action according to the control command, the home appliance control method further comprises: A prompt to output the current attribute status of the controlled appliance. The home appliance control method according to claim 1, wherein the following steps are further performed before outputting the first prompt for selecting the controlled home appliance: Whether the output controls the prompts of all the controlled home appliances; If not, outputting a first prompt for selecting the controlled appliance; If yes, outputting a prompt for controlling all the controlled home appliances, and controlling the all controlled home appliances to perform the control action when receiving the second feedback information of the user or not receiving the feedback information within the first preset time period. The home appliance control method according to claim 3, wherein after the controlled operation of the home appliance, the home appliance control method further comprises: The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action. The home appliance control method according to claim 3, wherein after the prompting of controlling all the controlled home appliances, the home appliance control method further comprises: After receiving the third feedback information of the user, outputting a second prompt for selecting the controlled home appliance, and after receiving the fourth feedback information of the user, generating a second control command according to the fourth feedback information and the control action ; Controlling the controlled appliance pointed by the fourth feedback information to perform the control action according to the second control instruction. The home appliance control method according to claim 5, wherein after the controlled operation of the home appliance, the home appliance control method further comprises: The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action. The home appliance control method according to claim 5, wherein after controlling the controlled appliance to perform the control action according to the control command, the home appliance control method further comprises: A prompt to output the current attribute status of the controlled appliance. The home appliance control method according to claim 7, wherein after the prompting of the current attribute state of the controlled home appliance is output, the home appliance control method further comprises: Whether the output increases the prompts of other controlled home appliances; If yes, after receiving the fifth feedback information of the user, generating a third control instruction according to the fifth feedback information and the control action, and controlling the controlled home appliance pointed by the fifth feedback information to perform the control action ; If not, or when the feedback information is not received within the second preset time period, the other controlled home appliances are controlled to enter a standby state. The home appliance control method according to claim 8, wherein after the controlled appliance performs the control action, the home appliance control method further comprises: The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action. The home appliance control method according to claim 1, wherein And when the controlled home appliance is unique, generating a fourth control instruction according to the controlled home appliance and the control action; The fourth control command is sent to the unique controlled home appliance for the unique controlled appliance to perform the control action. The home appliance control method according to claim 10, wherein after the controlled operation of the home appliance, the home appliance control method further comprises: The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action. The home appliance control method according to claim 1, wherein after the controlled operation of the home appliance, the home appliance control method further comprises: The attribute name and the attribute value fed back by the controlled appliance are displayed in a snapshot manner on the control terminal before and after the execution of the control action. The home appliance control method according to claim 1, wherein the acquiring input information of the user and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation Steps include: Determining the type of the input information, and identifying the input information as text information when the input information is non-text; Configuring a preset keyword that points to the user's intent; After performing syntax and/or semantic analysis processing on the text information, extracting a text segment that matches the preset keyword; Determining a user's intention based on the text segment and determining a category of the user's intent; When the user intends to represent the interaction class, output the interaction data in response to the user based on the user intention, and display the interaction data in the preset manner on the control terminal; When the user intends to be a control class representation, the controlled home appliance and the control action in the text information are acquired. The home appliance control method according to claim 13, wherein the interaction class representation includes query, play, and chat, and when the user intention is an interaction class representation, outputting response data of the response user based on the user intention Steps include: When the user intends to represent the query class, outputting the query result required by the user; When the user intends to represent the play class, playing the multimedia content required by the user, and displaying the play information corresponding to the multimedia content; When the user intends to represent the chat class, the chat content is generated according to the interaction record with the user. The home appliance control method according to claim 14, wherein the step of displaying the interaction data in a preset manner on the control terminal comprises: When the interaction data is a query result, the query result is processed into a voice, and/or a chart or a snapshot matching the query result is displayed on the control terminal; When the interaction data is multimedia content, playing the multimedia content, and displaying list information and play information related to the multimedia content; When the interaction data is chat content, the chat content is processed into a voice broadcast to the user. A control terminal, wherein the control terminal comprises a memory, a processor, and a home appliance control program stored in the memory and running on the processor, the home appliance control program being executed by the processor to implement the following steps: Obtaining input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation; Determining whether the controlled appliance is unique; If not, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, generating a first control instruction according to the first feedback information and the control action; Controlling the controlled appliance pointed by the first feedback information to perform the control action according to the first control instruction. A home appliance control system, wherein the home appliance control system comprises: Controlling the terminal, wherein the control terminal comprises a memory, a processor, and a home appliance control program stored in the memory and running on the processor, and the home appliance control program is executed by the processor to implement the following steps: Obtaining input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation; Determining whether the controlled appliance is unique; If not, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, generating a first control instruction according to the first feedback information and the control action; Controlling, by the first control instruction, the controlled home appliance pointed by the first feedback information to perform the control action; and The controlled home appliance receives the control command of the control terminal and performs the control action according to the control command. A storage medium, wherein the storage medium stores a home appliance control program, and when the home appliance control program is executed by the processor, the following steps are implemented: Obtaining input information of the user, and acquiring the controlled home appliance and the control action in the input information when the user intention pointed by the input information is a control class representation; Determining whether the controlled appliance is unique; If not, outputting a first prompt for selecting the controlled home appliance, and after receiving the first feedback information of the user, generating a first control instruction according to the first feedback information and the control action; Controlling the controlled appliance pointed by the first feedback information to perform the control action according to the first control instruction.