[go: up one dir, main page]

CN111756603B - Control method and device of intelligent home system, electronic equipment and readable medium - Google Patents

Control method and device of intelligent home system, electronic equipment and readable medium Download PDF

Info

Publication number
CN111756603B
CN111756603B CN201910236042.8A CN201910236042A CN111756603B CN 111756603 B CN111756603 B CN 111756603B CN 201910236042 A CN201910236042 A CN 201910236042A CN 111756603 B CN111756603 B CN 111756603B
Authority
CN
China
Prior art keywords
information
activity
parameter combination
activity information
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910236042.8A
Other languages
Chinese (zh)
Other versions
CN111756603A (en
Inventor
林仕平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
iFlytek Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
iFlytek Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by iFlytek Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical iFlytek Co Ltd
Priority to CN201910236042.8A priority Critical patent/CN111756603B/en
Publication of CN111756603A publication Critical patent/CN111756603A/en
Application granted granted Critical
Publication of CN111756603B publication Critical patent/CN111756603B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00Speaker identification or verification techniques
    • G10L17/22Interactive procedures; Man-machine interfaces
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The disclosure provides a control method, a control device, electronic equipment and a readable medium of an intelligent home system. The intelligent home system comprises a plurality of intelligent home devices, and the control method of the intelligent home system comprises the following steps: collecting voice information of a user; determining the voice characteristics of the voice information and the activity information of a first activity which needs to be executed by a user according to the voice information; acquiring a parameter combination matched with the activity information and the voice characteristics; and controlling at least two intelligent home devices in the plurality of intelligent home devices to work according to the parameter combination, and providing conditions for the user to execute the first activity, wherein the parameter combination comprises working parameters of the at least two intelligent home devices.

Description

Control method and device of intelligent home system, electronic equipment and readable medium
Technical Field
The disclosure relates to the technical field of internet, and more particularly, to a control method, a device, an electronic device and a readable medium of an intelligent home system.
Background
Along with the rapid development of internet technology, smart home becomes one of the main manifestations of internet of things under the influence of the internet.
In the process of implementing the present concept, the inventor finds that at least the following problems exist in the prior art: in order to enable a plurality of intelligent home devices in the system to work, a user is required to issue a plurality of instructions to respectively control the plurality of intelligent home devices, for example, when the user needs to take a shower, the user is required to issue instructions of opening a water heater, opening an exhaust fan and spraying a shower at least to control the water heater, the exhaust fan and the shower, which can certainly increase the complexity of interaction between the user and the intelligent home system, so that the efficiency of controlling the intelligent home system by the user is low, and therefore the user experience is reduced.
Disclosure of Invention
In view of the above, the present disclosure provides a control method, apparatus, electronic device, and readable medium for an intelligent home system capable of improving interaction efficiency.
One aspect of the present disclosure provides a control method of an intelligent home system, wherein the intelligent home system includes a plurality of intelligent home devices, the control method including: collecting voice information of a user; determining the voice characteristics of the voice information and the activity information of a first activity which needs to be executed by a user according to the voice information; acquiring a parameter combination matched with the activity information and the voice characteristics; and controlling at least two intelligent home devices in the plurality of intelligent home devices to work according to the parameter combination, and providing conditions for the user to execute the first activity, wherein the parameter combination comprises working parameters of the at least two intelligent home devices.
According to an embodiment of the present disclosure, after controlling at least two smart home devices of the plurality of smart home devices to operate and before the smart home system stops operating, the control method of the smart home system further includes: acquiring working parameters of a plurality of intelligent home devices in real time; and updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent home devices acquired in real time.
According to an embodiment of the present disclosure, before controlling at least two smart home devices of the plurality of smart home devices to operate, the control method of the smart home system further includes: acquiring environment information of an environment where an intelligent home system is located and/or historical behavior information of a user; according to the environment information and/or the historical behavior information of the user, adjusting the working parameters included in the parameter combination; and controlling at least two intelligent home devices in the plurality of intelligent home devices to work according to the adjusted parameter combination.
According to an embodiment of the disclosure, determining, according to the voice information, the voice characteristics of the voice information and the activity information of the first activity that the user needs to perform include: analyzing the voice information and determining the voice characteristics of the voice information; and determining a first activity which the user needs to execute and activity information of the first activity according to the voice characteristics.
According to an embodiment of the disclosure, the voice features include semantic features and voiceprint features, and the first activities and the activity information to be executed by the user are determined according to the semantic features; the obtaining the parameter combination matched with the activity information and the voice characteristics comprises the following steps: and acquiring a parameter combination matched with the activity information and the voiceprint characteristics.
According to an embodiment of the disclosure, the acquiring the parameter combination matched with the activity information and the voiceprint feature includes: under the condition that the voiceprint feature is a stored voiceprint feature and the activity information is stored activity information, acquiring a parameter combination matched with the activity information and the voiceprint feature; or in the case that the voiceprint feature is not a stored voiceprint feature: acquiring a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint characteristics; establishing and storing a matching relation of voiceprint characteristics, activity information and preset parameter combinations; or in the case where the voiceprint feature is a stored voiceprint feature and the activity information is not stored activity information: determining a parameter combination as a parameter combination matched with both the activity information and the voiceprint feature according to the acquired records of the parameter combinations matched with the voiceprint feature and the similar activity information of the activity information; and establishing and storing a matching relation of the voiceprint characteristics, the activity information and the determined parameter combination.
According to an embodiment of the present disclosure, the above parameter combination further includes a timing parameter for controlling operation of at least two smart home devices, and controlling operation of at least two smart home devices of the plurality of smart home devices according to the parameter combination includes: and controlling at least two intelligent household devices in the plurality of intelligent household devices to work according to the working parameters and the time sequence parameters.
Another aspect of the present disclosure provides a control device for an intelligent home system, where the intelligent home system includes a plurality of intelligent home devices, and the device includes an acquisition module, a determination module, a parameter combination acquisition module, and a control module. The acquisition module is used for acquiring voice information of a user; the determining module is used for determining the voice characteristics of the voice information and the activity information of the first activity which the user needs to execute according to the voice information; the parameter combination acquisition module is used for acquiring a parameter combination matched with the activity information and the voice characteristics; the control module is used for controlling at least two intelligent home devices in the plurality of intelligent home devices to work according to the parameter combination, and providing conditions for the user to execute the first activity, wherein the parameter combination comprises working parameters of the at least two intelligent home devices.
According to an embodiment of the disclosure, the control device of the smart home system further includes a working parameter acquisition module and a parameter combination update module. The working parameter acquisition module is used for acquiring working parameters of the plurality of intelligent household devices in real time after the control module controls at least two intelligent household devices in the plurality of intelligent household devices to work and before the intelligent household system stops working; the parameter combination updating module is used for updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent household devices acquired in real time.
According to an embodiment of the disclosure, the control device of the smart home system further includes a reference information acquisition module and an operating parameter adjustment module. The reference information acquisition module is used for acquiring environmental information of the environment where the intelligent home system is located and/or historical behavior information of a user before the control module controls at least two intelligent home devices in the plurality of intelligent home devices to work; the working parameter adjusting module is used for adjusting working parameters included in the parameter combination according to the environment information and/or the historical behavior information of the user; correspondingly, the control module is used for controlling at least two intelligent household devices in the plurality of intelligent household devices to work according to the adjusted parameter combination.
According to an embodiment of the present disclosure, the determination module includes an analysis sub-module activity and a determination sub-module. The analysis sub-module is used for analyzing the voice information and determining the voice characteristics of the voice information; and the activity determination sub-module is used for determining a first activity required to be executed by the user and activity information of the first activity according to the voice characteristics.
According to an embodiment of the present disclosure, the voice features include semantic features and voiceprint features, and the activity determination submodule determines a first activity and activity information to be executed by the user according to the semantic features; the parameter combination acquisition module is used for acquiring parameter combinations matched with the activity information and the voiceprint features.
According to an embodiment of the disclosure, the parameter combination obtaining module includes an obtaining sub-module, where the obtaining sub-module is configured to obtain a parameter combination matching the activity information and the voiceprint feature when the voiceprint feature is a stored voiceprint feature and the activity information is stored activity information.
According to an embodiment of the present disclosure, the above-mentioned parameter combination obtaining module further includes a first storage sub-module, where the obtaining sub-module is configured to obtain, as a parameter combination matched with the activity information and the voiceprint feature, a preset parameter combination matched with the activity information when the voiceprint feature is not a stored voiceprint feature; the first storage sub-module is used for establishing and storing the matching relation of the voiceprint characteristics, the activity information and the preset parameter combination.
According to an embodiment of the present disclosure, the parameter combination obtaining module further includes: and the second storage sub-module is used for determining a parameter combination as the parameter combination matched with the voice print feature and the voice print feature according to the acquired record of the parameter combination matched with the voice print feature and the similar activity information of the activity information under the condition that the voice print feature is the stored voice print feature and the activity information is not the stored activity information, and the second storage sub-module is used for establishing and storing the matching relation among the voice print feature, the activity information and the parameter combination determined by the acquisition sub-module.
According to an embodiment of the disclosure, the parameter combination further includes a time sequence parameter for controlling the operation of at least two smart home devices, and the control module is configured to control the operation of at least two smart home devices of the plurality of smart home devices according to the operation parameter and the time sequence parameter.
Another aspect of the present disclosure provides an electronic device, comprising: one or more processors; and the storage device is used for storing one or more programs, wherein the one or more programs are executed by the one or more processors, and the one or more processors are caused to execute the control method of the intelligent home system.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions that, when executed, are configured to implement a control method of a smart home system as described above.
Another aspect of the present disclosure provides a computer program comprising computer executable instructions which, when executed, are for implementing a control method of a smart home system as described above.
According to the embodiment of the disclosure, the defects that in the prior art, interaction logic between a user and an intelligent home system is complex and efficiency of controlling the intelligent home system is low can be at least partially overcome, and therefore simultaneous control over a plurality of intelligent home devices is achieved by acquiring parameter combinations corresponding to voice information and activity information of a first activity, and therefore interaction efficiency between the user and the intelligent home system is improved and user experience is improved.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments thereof with reference to the accompanying drawings in which:
fig. 1 schematically illustrates an application scenario of a control method, an apparatus, an electronic device, and a readable medium of an intelligent home system according to an embodiment of the disclosure;
Fig. 2 schematically illustrates a flowchart of a control method of the smart home system according to an embodiment of the present disclosure;
FIG. 3 schematically illustrates a flow chart of determining activity information for a first activity that a user needs to perform in accordance with an embodiment of the present disclosure;
FIG. 4 schematically illustrates a flow chart of acquiring parameter combinations in accordance with an embodiment of the present disclosure;
fig. 5 schematically illustrates a flow chart of part of the operation of a control method of a smart home system according to another embodiment of the present disclosure;
fig. 6 schematically illustrates a flow chart of part of the operation of a control method of a smart home system according to a further embodiment of the present disclosure;
fig. 7 schematically illustrates a block diagram of a control device of the smart home system according to an embodiment of the present disclosure;
fig. 8 schematically illustrates a block diagram of an electronic device adapted to perform a control method of an intelligent home system according to an embodiment of the disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is only exemplary and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.
Where expressions like at least one of "A, B and C, etc. are used, the expressions should generally be interpreted in accordance with the meaning as commonly understood by those skilled in the art (e.g.," a system having at least one of A, B and C "shall include, but not be limited to, a system having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a formulation similar to at least one of "A, B or C, etc." is used, in general such a formulation should be interpreted in accordance with the ordinary understanding of one skilled in the art (e.g. "a system with at least one of A, B or C" would include but not be limited to systems with a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
The embodiment of the disclosure provides a control method, a device, electronic equipment and a readable medium of an intelligent home system capable of improving interaction efficiency and user experience, wherein the control method of the intelligent home system comprises the following steps: collecting voice information of a user; determining the voice characteristics of the voice information and the activity information of a first activity which needs to be executed by a user according to the voice information; acquiring a parameter combination matched with the activity information and the voice characteristics; and controlling at least two intelligent home devices in the plurality of intelligent home devices to work according to the parameter combination, and providing conditions for the user to execute the first activity, wherein the parameter combination comprises working parameters of the at least two intelligent home devices.
Fig. 1 schematically illustrates an application scenario of a control method, an apparatus, an electronic device, and a readable medium of an intelligent home system according to an embodiment of the disclosure. It should be noted that fig. 1 is only an example of an application scenario where the embodiments of the present disclosure may be applied, so as to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments, or scenarios.
As shown in fig. 1, the application scenario 100 includes an intelligent home system 110, a cloud system 120, and a user 130.
The smart home system 110 includes a plurality of smart home devices, for example, the plurality of smart home devices may have at least one first smart device capable of interacting with the user 130 and interacting with the cloud system 120 or the server through the communication link, and the first smart device may also interact with other smart home devices to control the operation of the other smart home devices. According to embodiments of the present disclosure, a first smart device may not be included in a plurality of smart home devices that make up the smart home system, for example, and may be served as the first smart device by other electronic devices (e.g., routers, smart speakers, etc.) that are capable of interacting with the smart home system.
The plurality of smart home devices may be smart bathroom devices, and specifically may include, for example, smart shower 111, smart water heater 112, smart bathtub 113, smart bathroom heater 114, smart vanity mirror 115, smart toilet 116, and smart light fixture.
The plurality of intelligent household devices can also be intelligent kitchen ware devices, and specifically can comprise intelligent smoke exhaust ventilator, intelligent hot water kettle, intelligent gas hood, intelligent cabinet, intelligent dish washer, intelligent microwave oven, intelligent oven and the like.
The intelligent household devices can be other intelligent devices, such as intelligent electronic devices including intelligent televisions, intelligent set top boxes, intelligent sound boxes, intelligent refrigerators, intelligent air conditioners, intelligent curtains, intelligent washing machines, intelligent air purifiers, intelligent game machines, intelligent projectors and the like.
In the embodiment of the present disclosure, the technical solution of the present disclosure will be described in detail by taking an intelligent home system formed by a plurality of intelligent bathroom devices as an example, where, for example, the intelligent vanity mirror 115 may be used as a first intelligent device capable of interacting with the user 130 and the cloud system 120. It will be appreciated that the above-described configuration of the smart home system is merely an example to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto, for example, a smart home system may be further configured of a plurality of smart kitchen devices, so long as a plurality of smart home devices configuring the smart home system can cooperate to provide a condition for a user to perform a certain activity.
In the embodiment of the disclosure, the first intelligent device intelligent vanity mirror 115 may collect voice information of a user, process the voice information, and then determine the voice characteristics of the voice information and the activity information of the user that needs to perform an activity, so that according to the voice characteristics and the activity information, a parameter combination of the intelligent home system operation may be obtained through interaction with the cloud system 120, and each intelligent bathroom device may operate according to respective parameters in the parameter combination.
For example, when the user speaks a voice command of "magic mirror, i want to bath" to the intelligent vanity mirror 115, the intelligent vanity mirror 115 can determine that the activity information is "bath" according to the voice command, and determine that the current user is a female owner, then the intelligent vanity mirror 115 can obtain a parameter combination matched with the bath of the female owner through interaction with the cloud system 120, for example, "turn on bathroom heater, turn on exhaust fan, inject medium water into bathtub", and turn on bathroom heater and exhaust fan under the control of the intelligent vanity mirror 115 according to the parameter combination, and gradually inject water into bathtub until the water in bathtub is medium water. By the mode, the plurality of intelligent household devices can be opened only according to the instruction of 'I want to bath' of the user without the need of the user to speak control instructions of the bathroom heater, the exhaust fan and the bathtub, so that the user experience can be improved to a certain extent.
The first intelligent device may also store, for example, a parameter combination matched with the user and various voice commands of the user into the cloud system 120 through interaction with the user, so that when the user uses the device later, the matched parameter combination can be obtained from the cloud system 120 only according to the simple voice commands of the user, and the plurality of intelligent home devices are controlled to work according to the parameter combination. Alternatively, the cloud system 120 may further store a preset parameter combination, for example, so that the first smart device may call the first smart device when the user uses the smart home system for the first time.
It should be noted that, the control method of the smart home system provided by the embodiment of the present disclosure may be generally executed by any one smart home device in the smart home system. Accordingly, the control device of the smart home system provided by the embodiment of the disclosure may be generally disposed in any one of the smart home devices in the smart home system. The control method of the smart home system provided by the embodiment of the present disclosure may also be performed by other electronic devices that are different from the smart home devices in the smart home system 110 and are capable of communicating with the smart home system 110. Accordingly, the control device of the smart home system provided in the embodiment of the present disclosure may also be disposed in other electronic devices different from the smart home devices in the smart home system 110 and capable of communicating with the smart home system 110.
It is to be understood that the types and numbers of smart home systems 110 and cloud systems 120 in fig. 1 are merely illustrative, and that any type and number of smart home systems and cloud devices may be provided, as desired for implementation.
Fig. 2 schematically illustrates a flowchart of a control method of the smart home system according to an embodiment of the present disclosure, and fig. 3 schematically illustrates a flowchart of activity information determining a first activity that a user needs to perform according to an embodiment of the present disclosure.
According to embodiments of the disclosure, the smart home system may include a plurality of smart home devices, where the plurality of smart home devices may be connected together, for example, through an internet of things technology such as a wireless local area network, and specifically, may be connected through a wireless local area network provided by a wireless router, for example.
As shown in fig. 2, the control method of the smart home system includes operations S210-S240.
In operation S210, voice information of a user is collected.
The voice information of the user may be, for example, a voice instruction sent by the user within the collection range of the electronic device with the voice collection function, and the electronic device with the voice collection function may be, for example, the router for providing a wireless local area network, or any one of the multiple smart home devices or other electronic devices capable of communicating with the smart home system. The voice acquisition function can be realized by a sound acquisition device.
According to embodiments of the present disclosure, the collected voice information may specifically be, for example, a voice instruction issued by the user for characterizing an activity to be performed by the user, for example, voice information for characterizing the voice instruction "i want to bath", "i want to cook a dish", "i want to watch a movie", and the like.
In operation S220, according to the voice information, voice characteristics of the voice information and activity information of a first activity that the user needs to perform are determined.
According to the embodiment of the disclosure, the operation S220 may specifically be, for example, performing processing such as feature extraction and speech recognition on the speech information, determining a first activity that the user needs to perform and activity information of the first activity according to the speech recognition result, and finally converting the processing result and the determined result into information that can be recognized by the electronic device such as binary code or character sequence.
Specifically, as shown in fig. 3, the operation S220 may include an operation S221 to an operation S222.
In operation S221, the voice information is analyzed, and voice features of the voice information are determined.
The voice features of the voice information may specifically include, for example, voiceprint features, so as to determine the identity of the user who issues the voice instruction through the voiceprint features; the speech features may also include, for example, semantic features, which may be keyword features derived by speech recognition, or the like. The above operation S220 may specifically be, for example, analyzing and processing the voice information by using an existing voice recognition technology to obtain voice features. It will be appreciated that the above-described speech features and analysis methods are merely examples to facilitate an understanding of the present disclosure, and the present disclosure is not limited thereto.
In operation S222, a first activity that the user needs to perform and activity information of the first activity are determined according to the voice feature.
According to an embodiment of the present disclosure, the operation S222 may specifically be, for example, determining the first activity that the user needs to perform according to semantic features among the voice features extracted in operation S221. For example, when the semantic feature is a keyword feature, the operation may specifically query, according to the extracted keyword feature, a corresponding table of the keyword feature, the activity and the activity information pre-stored in the cloud system, to obtain a first activity corresponding to the keyword feature and activity information of the first activity.
According to an embodiment of the present disclosure, the operation S222 may further be, for example, using the extracted semantic features as an input of a pre-trained neural network, and outputting and obtaining a first activity that the user needs to execute and activity information of the first activity after processing the semantic features through the neural network, where the activity information is information identifiable by an electronic device corresponding to the first activity. It is to be understood that the specific implementation of operation S222 is merely an example to facilitate understanding of the disclosure, which is not limited by the present disclosure.
According to the embodiment of the disclosure, since the first activity and the activity information thereof are determined according to the semantic features, different activity information of the first activity can be determined according to the voice information corresponding to different instructions sent by the user. The parameter combination and the working states of at least two smart home devices acquired in the subsequent operations S230-S240 correspond to semantic features of the user, so that different parameter combinations can be acquired according to different voice information, and the final working state of the smart home system corresponds to the instruction of the user. Specifically, when the semantic feature is determined according to voice information of the user 'i want to shower', the determined first activity is shower, the acquired parameter combination can be working parameters of a shower head, a water heater and a bathroom heater, and the working state of the intelligent home system is that the shower head, the water heater and the bathroom heater work; when the semantic features are determined according to voice information of a user 'i want to bath', the determined first activity is bath, the acquired parameter combination can be working parameters of the water heater, the bathroom heater and the bathtub, and then the working state of the intelligent home system is that the water faucet of the water heater, the bathroom heater and the bathtub works.
It can be understood that the whole operation S220 may be implemented by a pre-trained neural network, for example, where the voice information collected in the operation S210 is used as an input of the neural network, and the voice characteristics of the voice information, the first activity that the user needs to execute, and the activity information of the first activity are obtained after processing the voice information through the neural network.
In operation S230, a parameter combination matching the activity information and the voice feature is acquired.
According to an embodiment of the disclosure, the operation S230 may be, for example, obtaining the matched parameter combination from the cloud system 120 according to the activity information and the voice feature.
In the case where the voice feature further includes a voiceprint feature, the above operation S230 may specifically be to obtain a parameter combination matching both the voiceprint feature and the activity information from the cloud system 120. The cloud system 120 may store the parameter combinations corresponding to different voiceprint features and activity information in different storage units, and uses the voiceprint features and the activity information as indexes of the storage units, so that operation S230 is: searching a storage unit with the voiceprint feature and the activity information determined in operation S220 as indexes from the cloud system 120, and after finding a corresponding storage unit, calling a parameter combination in the storage unit.
According to an embodiment of the disclosure, the parameter combination may include, for example, an operating parameter of at least two smart home devices, so as to be used as a reference when the smart home devices are in operation, where the operating parameter may include, for example, an operating power, a water temperature, a water amount, etc., and it may be understood that different types of operating parameters may be available for different smart home devices.
According to the embodiment of the disclosure, since the voiceprint features are in one-to-one correspondence with the users, the parameter combinations obtained according to the voiceprint features are also in one-to-one correspondence with the users, for example, when the voiceprint features are determined from the voice information of the female owner "i want to shower", the obtained parameter combinations may include the working parameters of the shower head, the exhaust fan and the bathroom heater, and when the voiceprint features are determined from the voice information of the male owner "i want to shower", the obtained parameter combinations may include only the working parameters of the shower head and the exhaust fan, so that when the intelligent home system works according to the parameter combinations, the technical effects of being in different working states according to the requirements of different users can be automatically realized, and thus the user experience is improved.
In operation S240, at least two smart home devices of the plurality of smart home devices are controlled to operate according to the parameter combination, providing conditions for the user to perform the first activity.
According to the embodiment of the disclosure, the operation specifically includes controlling at least two intelligent home devices to work according to respective working parameters according to working parameters of the at least two intelligent home devices included in the parameter combination.
According to an embodiment of the disclosure, the above operation may specifically be that after the electronic device that collects the voice information of the user obtains the parameter combination, an instruction corresponding to the working parameter is sent to at least two smart home devices according to working parameters of at least two smart home devices in the parameter combination, so that the at least two smart home devices work according to the instruction after receiving the instruction.
According to the method, for example, when a user sends out voice information of 'i want to bath', the first activity to be executed by the user can be determined to be bath, then the parameter combination of the intelligent bathroom equipment work can be automatically obtained, the bathroom heater and the exhaust fan are automatically opened according to the parameter combination, and water is injected into the bathtub.
According to the embodiment of the disclosure, the parameter combination may further include a time sequence parameter of the operation of the at least two smart home devices, specifically, for example, may include an initial operation time, an operation duration, and the like of the at least two smart home devices, and according to the parameter combination, the at least two smart home devices may be controlled to operate according to the operation parameter and the time sequence parameter.
For example, when a female owner sends a voice command "i want to shower", the acquired parameter combination can include working parameters and timing parameters of a wash basin, a shower head, a bathroom heater and an exhaust fan, for example, when the female owner is in a shower, the shower head, the bathroom heater and the exhaust fan are usually opened after the face is washed, the intelligent household devices are controlled to work according to the working parameters and the timing parameters, specifically, the working sequence can be that the faucet of the wash basin is opened first, and after one minute, the shower head, the bathroom heater and the exhaust fan are opened, so that the defect of water resource waste caused by the operation of the shower head when the female owner washes the face can be avoided. Namely, the embodiment of the disclosure can control at least two intelligent home devices to work according to a certain time sequence by acquiring the parameter combination including the time sequence parameter, so that the service provided by the intelligent home system to the user can be more in line with the user demand, the user experience is improved, and the resource waste can be reduced under a certain condition.
Fig. 4 schematically illustrates a flow chart of acquiring parameter combinations according to an embodiment of the disclosure.
In the case where the operation S220 with reference to fig. 2 includes the operations S221-S222 with reference to fig. 3, the process of acquiring the parameter combination in operation S230 may be specifically the operation process with reference to fig. 4 according to an embodiment of the present disclosure.
First, in operation S231, it is determined whether the voiceprint feature is a stored voiceprint feature.
In the case where the judgment result of operation S231 is yes, that is, the voiceprint feature is the stored voiceprint feature, judgment operation S232 is performed to judge whether the activity information is the stored activity information.
If the judgment result of the judgment operation S232 is yes, that is, if the voiceprint feature is a stored voiceprint feature and the activity information is a stored activity information, then operation S233 is executed, a parameter combination matching both the activity information and the voiceprint feature is obtained, and if the parameter combination matching both the activity information and the voiceprint feature is obtained in operation S230, then the parameter combination matching both the activity information and the voiceprint feature is obtained.
In the case where the judgment result of the judgment operation S232 is no, that is, the voiceprint feature is the stored voiceprint feature and the activity information is not the stored activity information, then operation S236-operation S237 are performed.
Specifically, in operation S236, a parameter combination is determined as a parameter combination matching both the activity information and the voiceprint feature based on the acquired record of the parameter combination matching the voiceprint feature and the similar activity information to the activity information; in operation S237, a matching relationship of the voiceprint features, the activity information, and the determined parameter combination is established and stored.
According to an embodiment of the present disclosure, for an intelligent home system composed of a plurality of intelligent bathroom apparatuses referring to fig. 1, considering that a user may perform an activity of showering, bathing, etc., a parameter combination corresponding to showering, bathing, etc., which is set by the user, may be stored in the cloud system 120, for example, without storing the parameter combination corresponding to bathing. However, when the voice information sent by the user is "i want to bath", the activity and the activity information determined according to the voice information are bath, and it can be determined that the similar activity information of the activity information is the activity information of shower and bath, then according to the obtained records of the parameter combinations corresponding to the voiceprint feature and shower and the parameter combinations corresponding to the voiceprint feature and bath stored in the cloud system 120, the parameter combination with the most obtained records is determined as the parameter combination matched with both the activity information and the voiceprint feature. It is to be understood that the parameter combination determined in the above operation S237 may also be, for example, a parameter combination of the latest acquired record, which is not limited in this disclosure, and the similar activity information of the determined activity information may be specifically activity information of other activities having the same purpose as the activity corresponding to the activity information, which is not described herein.
Meanwhile, in order to improve the efficiency of acquiring the parameter combination when the user sends out the voice information of 'I want to bathe' again, a matching relation can be established between the activity information and the voiceprint characteristic corresponding to 'I want to bathe' and the determined parameter combination, and the matching relation is stored, so that the matched parameter combination can be directly acquired when the voice information of 'I want to bathe' of the user is acquired again, and the parameter combination is determined without being required to be recorded according to the acquired parameter combination.
In the case where the judgment result of the judgment operation S231 is no, that is, the voiceprint feature is not the stored voiceprint feature, operations S234 to S235 are performed.
Specifically, in operation S234, a preset parameter combination matched with the activity information is obtained as a parameter combination matched with the activity information and the voiceprint feature; in operation S235, a matching relationship of the voiceprint feature, the activity information, and the preset parameter combination is established and stored.
For example, the cloud system 120 may pre-store a parameter combination corresponding to an activity that the user may want to execute, for example, may initialize an operating parameter of a shower head and a water heater that are parameter combinations corresponding to a shower activity of the user, and then, when the voice information "i want to shower" of the user a is received for the first time, the parameter combination corresponding to the voice information of the user a may be pre-stored, and it may be understood that, in operation S234, when a preset parameter combination is obtained according to the activity information, the activity information may be subjected to rough matching on the activity information, that is, the activity information matched by the parameter combination may also be activity information that is the same as or similar to the determined activity information, so, even if the pre-stored parameter combination includes the parameter combination corresponding to the shower, but does not include the parameter combination corresponding to the shower, the parameter combination corresponding to the shower may still be obtained, so that the smart home system starts to operate.
Meanwhile, in order to improve the accuracy of the acquired parameter combination when the user A sends out the voice information of 'I want to shower' again, a matching relation can be established between the activity information corresponding to 'I want to shower' and the voiceprint characteristics of the user A and the determined parameter combination, and the matching relation is stored, so that the matched parameter combination can be directly acquired when the voice information of 'I want to shower' of the user A is acquired again, and the preset parameter combination is not required to be acquired.
As can be seen from the foregoing, in the method for obtaining the parameter combinations according to the embodiments of the present disclosure, even if the parameter combinations matched with the voiceprint features and/or the voice features are not stored in the cloud system 120, the parameter combinations can still be determined, and the smart home system can work according to the parameter combinations, so that the user experience can be improved to a certain extent.
Fig. 5 schematically illustrates a flowchart of a portion of the operation of a control method of a smart home system according to another embodiment of the present disclosure.
The control method of the smart home system according to the embodiment of the present disclosure may further include, as shown in fig. 5, an operation S510-an operation S520 in addition to the operation S210-the operation S240 described with reference to fig. 2, the operation S510-the operation S520 being performed before the operation S240.
In operation S510, environmental information of an environment in which the smart home system is located and/or historical behavior information of the user is obtained.
The environmental information may include, for example, temperature, humidity, illumination brightness, etc. of an environment where the smart home system is located, and may also be weather temperature, humidity, etc. of a geographic location where the smart home system is located.
The historical behavior information of the user may include user behaviors collected by a plurality of smart home in the smart home system, for example, a time when the smart door detects that the recorded user opens and closes the door, a type of music played in a predetermined period of time recorded by the smart sound box (i.e. preference information of the user for listening to music), the number of times and time when the user recorded by the smart refrigerator takes cold drinks, or a record of a user switch air conditioner recorded by the smart air conditioner, etc. It will be appreciated that the above-described historical behavior information of the user is merely exemplary to facilitate understanding of the present disclosure, which is not limited thereto.
The operation S510 may specifically be performed by a sensor installed in the electronic device that collects the voice information of the user in operation S210, or may be obtained by the electronic device from the cloud system 120, or may be obtained by the electronic device from other smart home through a communication link. The present disclosure is not limited to the type and the acquisition manner of the environmental information. It is understood that this operation S510 may be performed, for example, simultaneously with operation S210, or may be performed before or after operation S210.
In operation S520, the operating parameters included in the parameter combination are adjusted according to the environmental information and/or the historical behavior information of the user.
Wherein the adjusted parameter combination may be the parameter combination acquired in operation S230, the operation S520 may be performed between operation S230 and operation S240.
According to the embodiment of the present disclosure, when the water temperature parameter of the water heater in the parameter combination acquired in operation S230 is 40 ℃, and the environment information acquired in operation S510 is that the temperature of the environment is 32 ℃, considering that the user' S current sense of heat is relatively hot, the water temperature parameter of the water heater in the parameter combination may be properly reduced; or, when the water temperature parameter of the water heater in the parameter combination acquired in operation S230 is 40 ℃, and the historical behavior information of the user acquired in operation S510 is that the user takes the cold drink more times in the predetermined period, in this case, considering that the user' S current sense of motion is hotter, the water temperature parameter of the water heater in the parameter combination can be properly reduced
Accordingly, referring to operation S240 in fig. 2 may specifically refer to operation S530 in fig. 5, at least two smart home devices of the plurality of smart home devices are controlled to operate according to the adjusted parameter combination, and specifically, the water temperature parameter of the water heater is reduced according to the environmental information, so that the water temperature of the water heater more meets the current requirement of the user for relieving summer heat.
In summary, according to the embodiment of the disclosure, the working parameters of the intelligent household equipment are adjusted according to the environmental information, so that the working state of the intelligent household equipment is more in line with the requirements of users, and the user experience is improved.
Fig. 6 schematically illustrates a flowchart of a portion of the operation of a control method of a smart home system according to yet another embodiment of the present disclosure.
The control method of the smart home system of the embodiment of the present disclosure may include, for example, operations S610 to S620 described with reference to fig. 6 in addition to operations S210 to S240 described with reference to fig. 2, and the operations S610 to S620 may be performed after the operation S240.
In operation S610, operating parameters of the plurality of smart home devices are acquired in real time.
According to the embodiment of the disclosure, the operation S610 may specifically be that a plurality of smart home devices send the working parameters thereof to the electronic device for collecting the voice information of the user in real time, so that the electronic device for collecting the voice information of the user can obtain the working parameters in real time. The operating parameters may be the same as or different from the operating parameters of each smart home device in the parameter combination.
In operation S620, according to the working parameters of the plurality of smart home devices acquired in real time, the parameter combination matched with the activity information and the voice features is updated.
According to the embodiment of the present disclosure, the operation S620 may specifically be that the electronic device that collects the voice information of the user updates the parameter combinations stored in the cloud system 120 according to the working parameters obtained in real time, so as to optimize the parameter combinations stored in the cloud system 120. For example, when the water temperature set by the water heater according to the operation parameters acquired in operation S230 is 35 ℃, but when the user feels that the water temperature is low during the shower in winter and the water temperature is adjusted to 40 ℃, the operation S620 can adjust the water temperature set by the operation parameters stored in the cloud system and matched with the voiceprint feature of the user and the activity information of the current execution activity to 40 ℃, and when the user needs to execute the same activity next time, the acquired operation parameters more meet the current time period requirement of the user.
In summary, it can be known that, in the embodiment of the disclosure, the working parameters can be updated in real time, so that the parameter combination matched with the activity information and the voice features better meets the requirements of the current stage of the user, and the user experience can be improved to a certain extent.
According to the embodiment of the disclosure, the method described with reference to fig. 2 to 6 may be applied to other intelligent home systems besides the intelligent home system formed by the intelligent bathroom equipment described with reference to fig. 1, for example, may also be applied to the intelligent home system formed by intelligent kitchen ware, and data acquired by the intelligent home system formed by different types of equipment may be stored in different cloud systems, so as to avoid occurrence of a situation that the acquired data is different from the current application scenario, and thus, accuracy of acquired parameter combination may be improved.
Fig. 7 schematically illustrates a block diagram of a control device of the smart home system according to an embodiment of the present disclosure.
As shown in fig. 7, a control device 700 of the smart home system according to an embodiment of the present disclosure includes an acquisition module 710, a determination module 720, a parameter combination acquisition module 730, and a control module 740.
The collection module 710 is configured to collect voice information of a user. The acquisition module 710 may be used, for example, to perform operation S210 described with reference to fig. 2, according to an embodiment of the present disclosure, which is not described herein.
The determining module 720 is configured to determine, according to the voice information, a voice feature of the voice information and activity information of a first activity that the user needs to perform. The determining module 720 may be used, for example, to perform operation S220 described with reference to fig. 2, which is not described herein.
The parameter combination obtaining module 730 is configured to obtain a parameter combination matched with the activity information and the voice feature, where the parameter combination includes working parameters of at least two smart home devices. The parameter combination obtaining module 730 may be used, for example, to perform operation S230 described with reference to fig. 2 according to an embodiment of the present disclosure, and will not be described herein.
The control module 740 is configured to control at least two smart home devices of the plurality of smart home devices to operate according to the parameter combination, and provide a condition for the user to execute the first activity. The control module 740 may be used, for example, to perform operation S240 described with reference to fig. 2, according to an embodiment of the present disclosure, which is not described herein.
According to an embodiment of the present disclosure, the above-mentioned parameter combination may further include a time sequence parameter for controlling the operation of at least two smart home devices, and the above-mentioned control module 740 is specifically configured to control the operation of at least two smart home devices of the plurality of smart home devices according to the time sequence parameter.
According to an embodiment of the present disclosure, as shown in fig. 7, the determination module 720 may include, for example, an analysis sub-module 721 and an activity determination sub-module 722. The analysis sub-module 721 is configured to analyze the voice information and determine a voice feature of the voice information; the activity determination sub-module 722 is configured to determine, according to the voice feature, a first activity that the user needs to perform and activity information thereof. The analysis sub-module 721 and the activity determination sub-module 722 may be used to perform operations S221 and S222 described with reference to fig. 3, respectively, and are not described herein.
According to an embodiment of the present disclosure, the voice features include semantic features and voiceprint features, and the activity determination sub-module 722 is specifically configured to determine, according to the semantic features, a first activity and activity information thereof that the user needs to perform. Accordingly, the parameter combination obtaining module 730 is configured to obtain a parameter combination matching the activity information and the voiceprint feature.
According to an embodiment of the disclosure, as shown in fig. 7, the parameter combination obtaining module 730 includes an obtaining sub-module 731, where the obtaining sub-module 731 is configured to obtain, when the voiceprint feature is a stored voiceprint feature and the activity information is stored activity information, a parameter combination matching the activity information and the voiceprint feature. The acquisition sub-module may be used, for example, to perform operation 233 described with reference to fig. 4, according to an embodiment of the disclosure, which is not described here again.
According to an embodiment of the disclosure, as shown in fig. 7, the parameter combination obtaining module 730 may further include a first storage sub-module 732, where the obtaining sub-module 731 is configured to obtain, when the voiceprint feature is not a stored voiceprint feature, a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint feature; the first storage sub-module 732 is configured to establish and store a matching relationship between the voiceprint feature, the activity information, and a preset parameter combination. The acquisition sub-module 731 and the first storage sub-module 732 may be used to perform operation S234 and operation S235 described with reference to fig. 4, respectively, for example, according to an embodiment of the present disclosure, and are not described herein.
According to an embodiment of the disclosure, as shown in fig. 7, the parameter combination obtaining module 730 may further include a second storage sub-module 733, where the obtaining sub-module 731 is configured to determine, when the voiceprint feature is a stored voiceprint feature and the activity information is not stored activity information, a parameter combination as a parameter combination matching both the activity information and the voiceprint feature according to an obtained record of a parameter combination matching the voiceprint feature and other activity information similar to the activity information; the second storage sub-module 733 is configured to establish and store a matching relationship between the voiceprint feature, the activity information, and the parameter combination determined by the obtaining sub-module 731. The acquisition sub-module 731 and the second storage sub-module 733 may be used to perform operation S236 and operation S237 described with reference to fig. 4, respectively, for example, according to an embodiment of the present disclosure, and are not described herein.
According to an embodiment of the disclosure, as shown in fig. 7, the control device 700 of the smart home system may further include a reference information obtaining module 750 and an operating parameter adjusting module 760, for example. The reference information obtaining module 750 is configured to obtain environmental information of an environment where the smart home system is located before the control module 740 controls at least two smart home devices of the plurality of smart home devices to work; the working parameter adjusting module 760 is configured to adjust working parameters included in the parameter combination according to the environmental information, and correspondingly, the control module 740 is configured to control at least two smart home devices of the plurality of smart home devices to work according to the adjusted parameter combination. According to an embodiment of the present disclosure, the reference information obtaining module 750, the operation parameter adjusting module 760, and the control module 740 may be used to perform operations S510-S530 described with reference to fig. 5, respectively, and are not described herein.
According to an embodiment of the disclosure, as shown in fig. 7, the control device 700 of the smart home system may further include an operation parameter obtaining module 770 and a parameter combination updating module 780, for example. The working parameter obtaining module 770 is configured to obtain working parameters of at least two smart home devices in the plurality of smart home devices in real time after the control module 740 controls the at least two smart home devices to work and before the smart home system stops working; the parameter combination updating module 780 is configured to update a parameter combination matched with the activity information and the voice feature according to the working parameters of the plurality of smart home devices acquired in real time. According to an embodiment of the present disclosure, the operation parameter acquiring module 770 and the parameter combination updating module 780 may be used to perform operation S610 and operation S620, respectively, described with reference to fig. 6, and are not described herein.
Any number of modules, sub-modules, units, sub-units, or at least some of the functionality of any number of the sub-units according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented as split into multiple modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system-on-chip, a system-on-substrate, a system-on-package, an Application Specific Integrated Circuit (ASIC), or in any other reasonable manner of hardware or firmware that integrates or encapsulates the circuit, or in any one of or a suitable combination of three of software, hardware, and firmware. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be at least partially implemented as computer program modules, which when executed, may perform the corresponding functions.
For example, any of the acquisition module 710, the determination module 720, the parameter combination acquisition module 730, the control module 740, the reference information acquisition module 750, the operating parameter adjustment module 760, the operating parameter acquisition module 770, the parameter combination update module 780, the analysis sub-module 721, the activity determination sub-module 722, the acquisition sub-module 731, the first storage sub-module 732, and the second storage sub-module 733 may be combined in one module to be implemented, or any of the modules may be split into a plurality of modules. Alternatively, at least some of the functionality of one or more of the modules may be combined with at least some of the functionality of other modules and implemented in one module. According to embodiments of the present disclosure, at least one of the acquisition module 710, the determination module 720, the parameter combination acquisition module 730, the control module 740, the reference information acquisition module 750, the operating parameter adjustment module 760, the operating parameter acquisition module 770, the parameter combination update module 780, the analysis sub-module 721, the activity determination sub-module 722, the acquisition sub-module 731, the first storage sub-module 732, and the second storage sub-module 733 may be implemented, at least in part, as hardware circuitry, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in hardware or firmware in any other reasonable manner of integrating or packaging circuitry, or in any one of or a suitable combination of any of the three implementations of software, hardware, and firmware. Alternatively, at least one of the acquisition module 710, the determination module 720, the parameter combination acquisition module 730, the control module 740, the reference information acquisition module 750, the operating parameter adjustment module 760, the operating parameter acquisition module 770, the parameter combination update module 780, the analysis sub-module 721, the activity determination sub-module 722, the acquisition sub-module 731, the first storage sub-module 732, and the second storage sub-module 733 may be at least partially implemented as a computer program module, which may perform the corresponding functions when being executed.
Fig. 8 schematically illustrates a block diagram of an electronic device adapted to perform a control method of an intelligent home system according to an embodiment of the disclosure. The electronic device shown in fig. 8 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 8, an electronic device 800 according to an embodiment of the present disclosure includes a processor 801 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. The processor 801 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or an associated chipset and/or special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. The processor 801 may also include on-board memory for caching purposes. The processor 801 may include a single processing unit or multiple processing units for performing the different actions of the method flows according to embodiments of the disclosure.
In the RAM 803, various programs and data required for the operation of the electronic device 800 are stored. The processor 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. The processor 801 performs various operations of the method flow according to the embodiments of the present disclosure by executing programs in the ROM 802 and/or the RAM 803. Note that the program may be stored in one or more memories other than the ROM 802 and the RAM 803. The processor 801 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to an embodiment of the present disclosure, the electronic device 800 may also include an input/output (I/O) interface 805, the input/output (I/O) interface 805 also being connected to the bus 804. The electronic device 800 may also include one or more of the following components connected to the I/O interface 805: an input portion 806 including a keyboard, mouse, etc.; an output portion 807 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and a speaker; a storage section 808 including a hard disk or the like; and a communication section 809 including a network interface card such as a LAN card, a modem, or the like. The communication section 809 performs communication processing via a network such as the internet. The drive 810 is also connected to the I/O interface 805 as needed. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as needed so that a computer program read out therefrom is mounted into the storage section 808 as needed.
According to embodiments of the present disclosure, the method flow according to embodiments of the present disclosure may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section 809, and/or installed from the removable media 811. The above-described functions defined in the system of the embodiments of the present disclosure are performed when the computer program is executed by the processor 801. The systems, devices, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the disclosure.
The present disclosure also provides a computer-readable storage medium that may be embodied in the apparatus/device/system described in the above embodiments; or may exist alone without being assembled into the apparatus/device/system. The computer-readable storage medium carries one or more programs which, when executed, implement methods in accordance with embodiments of the present disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example, but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, the computer-readable storage medium may include ROM 802 and/or RAM 803 and/or one or more memories other than ROM 802 and RAM 803 described above.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that the features recited in the various embodiments of the disclosure and/or in the claims may be provided in a variety of combinations and/or combinations, even if such combinations or combinations are not explicitly recited in the disclosure. In particular, the features recited in the various embodiments of the present disclosure and/or the claims may be variously combined and/or combined without departing from the spirit and teachings of the present disclosure. All such combinations and/or combinations fall within the scope of the present disclosure.
The embodiments of the present disclosure are described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the embodiments cannot be used advantageously in combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be made by those skilled in the art without departing from the scope of the disclosure, and such alternatives and modifications are intended to fall within the scope of the disclosure.

Claims (14)

1. A control method of an intelligent home system, the intelligent home system including a plurality of intelligent home devices, the method comprising:
collecting voice information of a user;
determining voice characteristics of the voice information and activity information of a first activity to be executed by the user according to the voice information, wherein the voice characteristics comprise semantic characteristics and voiceprint characteristics;
acquiring parameter combinations matched with the activity information and the voice characteristics; and
controlling at least two intelligent home devices in the plurality of intelligent home devices to work according to the parameter combination, and providing conditions for the user to execute the first activity;
The parameter combination comprises working parameters and time sequence parameters of the at least two different types of intelligent home equipment;
wherein the obtaining a combination of parameters matching the activity information and the speech features comprises:
in the case where the voiceprint feature is a stored voiceprint feature and the activity information is not stored activity information:
determining a parameter combination as a parameter combination matching both the activity information and the voiceprint feature from the acquired record of parameter combinations matching the voiceprint feature and similar activity information to the activity information; and
and establishing and storing a matching relation of the voiceprint characteristics, the activity information and the determined parameter combination.
2. The method of claim 1, wherein after controlling operation of at least two smart home devices of the plurality of smart home devices and before the smart home system ceases operation, the method further comprises:
acquiring working parameters of the plurality of intelligent home devices in real time; and
and updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent household devices acquired in real time.
3. The method of claim 1, wherein prior to controlling operation of at least two smart home devices of the plurality of smart home devices, the method further comprises:
acquiring environment information of an environment where the intelligent home system is located and/or historical behavior information of the user;
according to the environment information and/or the historical behavior information of the user, adjusting working parameters included in the parameter combination; and
and controlling at least two intelligent household devices in the plurality of intelligent household devices to work according to the adjusted parameter combination.
4. The method of claim 1, wherein determining, from the voice information, voice characteristics of the voice information and activity information of a first activity that the user needs to perform comprises:
analyzing the voice information and determining voice characteristics of the voice information; and
and determining a first activity which the user needs to execute and activity information of the first activity according to the voice characteristics.
5. The method according to claim 4, wherein:
the first activity which the user needs to execute and the activity information are determined according to the semantic features;
acquiring a parameter combination matched with the activity information and the voice feature comprises: and acquiring parameter combinations matched with the activity information and the voiceprint features.
6. The method of claim 5, wherein obtaining a combination of parameters matching the activity information and the voiceprint features comprises:
acquiring a parameter combination matched with the activity information and the voiceprint feature under the condition that the voiceprint feature is a stored voiceprint feature and the activity information is stored activity information; or alternatively
In the event that the voiceprint feature is not a stored voiceprint feature:
acquiring a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint feature; and
and establishing and storing a matching relation of the voiceprint characteristics, the activity information and the preset parameter combination.
7. A control apparatus for an intelligent home system, the intelligent home system including a plurality of intelligent home devices, the apparatus comprising:
the acquisition module is used for acquiring voice information of a user;
the determining module is used for determining voice characteristics of the voice information and activity information of a first activity which needs to be executed by the user according to the voice information, wherein the voice characteristics comprise semantic characteristics and voiceprint characteristics;
the parameter combination acquisition module is used for acquiring parameter combinations matched with the activity information and the voice characteristics; and
A control module for controlling at least two smart home devices of the plurality of smart home devices to work according to the parameter combination, providing conditions for the user to execute the first activity,
the parameter combination comprises working parameters and time sequence parameters of the at least two intelligent home devices;
the parameter combination acquisition module further comprises a second storage sub-module:
the acquiring submodule is used for determining a parameter combination as the parameter combination matched with the voice print characteristic and the voice print characteristic according to the acquired record of the parameter combination matched with the voice print characteristic and the similar activity information of the activity information under the condition that the voice print characteristic is the stored voice print characteristic and the activity information is not the stored activity information;
the second storage submodule is used for establishing and storing the matching relation of the voiceprint characteristics, the activity information and the parameter combination determined by the acquisition submodule.
8. The apparatus of claim 7, further comprising:
the working parameter acquisition module is used for acquiring working parameters of the plurality of intelligent household devices in real time after the control module controls at least two intelligent household devices in the plurality of intelligent household devices to work and before the intelligent household system stops working; and
And the parameter combination updating module is used for updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent household devices acquired in real time.
9. The apparatus of claim 7, further comprising:
the reference information acquisition module is used for acquiring environment information of the environment where the intelligent home system is located and/or historical behavior information of the user before the control module controls at least two intelligent home devices in the plurality of intelligent home devices to work;
the working parameter adjusting module is used for adjusting working parameters included in the parameter combination according to the environment information and/or the historical behavior information of the user; and
the control module is used for controlling at least two intelligent household devices in the plurality of intelligent household devices to work according to the adjusted parameter combination.
10. The apparatus of claim 7, wherein the means for determining comprises:
the analysis sub-module is used for analyzing the voice information and determining the voice characteristics of the voice information; and
and the activity determination submodule is used for determining a first activity which the user needs to execute and activity information of the first activity according to the voice characteristics.
11. The apparatus of claim 10, wherein:
the activity determination submodule determines a first activity which the user needs to execute and the activity information according to the semantic features;
the parameter combination acquisition module is used for acquiring parameter combinations matched with the activity information and the voiceprint features.
12. The apparatus of claim 11, wherein the parameter combination acquisition module comprises an acquisition sub-module, wherein:
the acquisition sub-module is used for acquiring parameter combinations matched with the activity information and the voiceprint features under the condition that the voiceprint features are stored voiceprint features and the activity information is stored activity information; or alternatively
The parameter combination acquisition module further comprises a first storage sub-module:
the acquiring submodule is used for acquiring a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint feature under the condition that the voiceprint feature is not the stored voiceprint feature;
the first storage sub-module is used for establishing and storing a matching relation of the voiceprint characteristics, the activity information and the preset parameter combination.
13. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, respectively, cause the one or more processors to perform the method of any of claims 1-6.
14. A computer readable medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method of any of claims 1-6.
CN201910236042.8A 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium Active CN111756603B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910236042.8A CN111756603B (en) 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910236042.8A CN111756603B (en) 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium

Publications (2)

Publication Number Publication Date
CN111756603A CN111756603A (en) 2020-10-09
CN111756603B true CN111756603B (en) 2023-05-26

Family

ID=72671605

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910236042.8A Active CN111756603B (en) 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium

Country Status (1)

Country Link
CN (1) CN111756603B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112783113B (en) * 2020-11-20 2022-08-16 青岛经济技术开发区海尔热水器有限公司 Household equipment control method and electronic equipment
CN113485147B (en) * 2021-08-03 2022-03-25 南京邮电大学 A smart home control method and system based on big data analysis
CN113851127A (en) * 2021-09-23 2021-12-28 惠达卫浴股份有限公司 Intelligent mirror voice control system and method
CN115470956A (en) * 2022-09-29 2022-12-13 中国银行股份有限公司 Telephone banking business reservation method, device, system and medium
CN116700025A (en) * 2023-05-19 2023-09-05 青岛海尔空调器有限总公司 Method, device and smart device for controlling smart device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108306797A (en) * 2018-01-30 2018-07-20 百度在线网络技术(北京)有限公司 Sound control intelligent household device, method, system, terminal and storage medium
WO2018149209A1 (en) * 2017-02-15 2018-08-23 腾讯科技(深圳)有限公司 Voice recognition method, electronic device, and computer storage medium

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106325085B (en) * 2015-06-26 2019-05-28 华平智慧科技(北京)有限公司 Function-oriented intelligent home control system and intelligent home system
CN105068460B (en) * 2015-07-30 2018-02-02 北京智网时代科技有限公司 A kind of intelligence control system
CN106549833B (en) * 2015-09-21 2020-01-21 阿里巴巴集团控股有限公司 Control method and device for intelligent household equipment
CN105867158A (en) * 2016-05-30 2016-08-17 北京百度网讯科技有限公司 Smart-home control method and device based on artificial intelligence and system
WO2018006373A1 (en) * 2016-07-07 2018-01-11 深圳狗尾草智能科技有限公司 Method and system for controlling household appliance on basis of intent recognition, and robot
CN106647311B (en) * 2017-01-16 2020-10-30 上海智臻智能网络科技股份有限公司 Intelligent central control system, equipment, server and intelligent equipment control method
CN108130683A (en) * 2017-12-21 2018-06-08 迪尔阿扣基金两合公司 A kind of household electrical appliance and the method for running household electrical appliance
CN108170034B (en) * 2017-12-29 2021-06-08 上海器魂智能科技有限公司 Intelligent device control method and device, computer device and storage medium
CN108062031A (en) * 2018-02-13 2018-05-22 宁夏煜隆科技有限公司 Intelligent home furnishing control method, device, system and electronic equipment
CN108717270A (en) * 2018-05-30 2018-10-30 珠海格力电器股份有限公司 Control method and device of intelligent equipment, storage medium and processor
CN109031965B (en) * 2018-07-19 2019-12-27 珠海格力电器股份有限公司 Intelligent device control method, device and computer-storable medium
CN109002022A (en) * 2018-08-16 2018-12-14 陕西卓居未来智能科技有限公司 A kind of cloud intelligent steward system and operating method based on interactive voice ability
CN109445352B (en) * 2018-12-10 2020-12-22 美的集团武汉制冷设备有限公司 Household appliance control method, household appliance and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018149209A1 (en) * 2017-02-15 2018-08-23 腾讯科技(深圳)有限公司 Voice recognition method, electronic device, and computer storage medium
CN108306797A (en) * 2018-01-30 2018-07-20 百度在线网络技术(北京)有限公司 Sound control intelligent household device, method, system, terminal and storage medium

Also Published As

Publication number Publication date
CN111756603A (en) 2020-10-09

Similar Documents

Publication Publication Date Title
CN111756603B (en) Control method and device of intelligent home system, electronic equipment and readable medium
JP7645209B2 (en) Equipment Control System
CN105493178B (en) voice server
CN111754997B (en) Control device and operation method thereof, and voice interaction device and operation method thereof
JP6991251B2 (en) Voice user interface shortcuts for assistant applications
CN107622652B (en) Voice control method for home appliance system and home appliance control system
CN107622767B (en) Voice control method for home appliance system and home appliance control system
CN109688036B (en) Control method and device of intelligent household appliance, intelligent household appliance and storage medium
CN110618613A (en) Linkage control method and device for intelligent equipment
CN114755931A (en) Control instruction prediction method and device, storage medium and electronic device
CN113852657B (en) Smart home local control method and system based on edge calculation
CN114120996A (en) Voice interaction method and device
CN106952645B (en) Voice instruction recognition method, voice instruction recognition device and air conditioner
CN110767225A (en) Voice interaction method, device and system
CN116364079A (en) Equipment control method, device, storage medium and electronic device
CN109346081A (en) Voice control method, device, equipment and storage medium
CN110620705A (en) Control terminal and control method of intelligent bathroom and electronic equipment
CN112436987A (en) Method and system for controlling terminal equipment switch
CN113744743B (en) Voice interaction method and device for washing machine
CN118152995A (en) An interactive method and system in vertical fields based on a large language model
CN106128458A (en) A kind of home voice control system based on speech recognition technology and method
CN111419130A (en) Control method and control device of dish-washing machine and dish-washing machine
CN119882468B (en) Control method and device of household equipment, electronic equipment and readable medium
CN116312518A (en) Voice command response method and device, storage medium and electronic device
KR20240049989A (en) Information processing method, processing system, and processing apparatus for a home appliance

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant