[go: up one dir, main page]

CN111756603A - Control method and device of intelligent household system, electronic equipment and readable medium - Google Patents

Control method and device of intelligent household system, electronic equipment and readable medium Download PDF

Info

Publication number
CN111756603A
CN111756603A CN201910236042.8A CN201910236042A CN111756603A CN 111756603 A CN111756603 A CN 111756603A CN 201910236042 A CN201910236042 A CN 201910236042A CN 111756603 A CN111756603 A CN 111756603A
Authority
CN
China
Prior art keywords
parameter combination
information
activity
activity information
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910236042.8A
Other languages
Chinese (zh)
Other versions
CN111756603B (en
Inventor
林仕平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
iFlytek Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
iFlytek Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by iFlytek Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical iFlytek Co Ltd
Priority to CN201910236042.8A priority Critical patent/CN111756603B/en
Publication of CN111756603A publication Critical patent/CN111756603A/en
Application granted granted Critical
Publication of CN111756603B publication Critical patent/CN111756603B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/282Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00Speaker identification or verification techniques
    • G10L17/22Interactive procedures; Man-machine interfaces
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The disclosure provides a control method and device of an intelligent home system, electronic equipment and a readable medium. The intelligent home system comprises a plurality of intelligent home devices, and the control method of the intelligent home system comprises the following steps: collecting voice information of a user; determining voice characteristics of the voice information and activity information of a first activity required to be executed by a user according to the voice information; acquiring a parameter combination matched with the activity information and the voice characteristics; and controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the parameter combination, and providing conditions for a user to execute a first activity, wherein the parameter combination comprises working parameters of the at least two pieces of intelligent household equipment.

Description

Control method and device of intelligent household system, electronic equipment and readable medium
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to a method and an apparatus for controlling an intelligent home system, an electronic device, and a readable medium.
Background
With the rapid development of internet technology, smart homes become one of the main embodiments of internet of things under the influence of the internet.
In implementing the present concept, the inventors found that there are at least the following problems in the prior art: the existing intelligent home system needs a user to issue a plurality of instructions in order to enable a plurality of intelligent home devices to work in the system, so as to control the plurality of intelligent home devices respectively, for example, when the user needs to take a shower, the user is at least required to send instructions of opening a water heater, opening an exhaust fan and opening a shower head, so as to realize the control of the water heater, the exhaust fan and the shower head, which undoubtedly increases the complexity of interaction between the user and the intelligent home system, so that the efficiency of controlling the intelligent home system by the user is low, and the user experience is reduced.
Disclosure of Invention
In view of this, the present disclosure provides a method and an apparatus for controlling an intelligent home system, an electronic device, and a readable medium, which can improve interaction efficiency.
One aspect of the present disclosure provides a control method for an intelligent home system, where the intelligent home system includes a plurality of intelligent home devices, and the control method includes: collecting voice information of a user; determining voice characteristics of the voice information and activity information of a first activity required to be executed by a user according to the voice information; acquiring a parameter combination matched with the activity information and the voice characteristics; and controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the parameter combination, and providing conditions for the user to execute the first activity, wherein the parameter combination comprises working parameters of the at least two pieces of intelligent household equipment.
According to an embodiment of the present disclosure, after controlling at least two smart home devices of the plurality of smart home devices to operate and before the smart home system stops operating, the method for controlling the smart home system further includes: acquiring working parameters of a plurality of intelligent household devices in real time; and updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent household equipment acquired in real time.
According to an embodiment of the present disclosure, before controlling at least two smart home devices of the plurality of smart home devices to operate, the method for controlling the smart home system further includes: acquiring environmental information of an environment where an intelligent home system is located and/or historical behavior information of a user; adjusting working parameters included in the parameter combination according to the environment information and/or the historical behavior information of the user; and controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the adjusted parameter combination.
According to an embodiment of the present disclosure, the determining, according to the voice information, the voice feature of the voice information and the activity information of the first activity that the user needs to perform includes: analyzing the voice information and determining the voice characteristics of the voice information; and determining a first activity required to be executed by the user and activity information of the first activity according to the voice characteristics.
According to the embodiment of the disclosure, the voice features comprise semantic features and voiceprint features, and a first activity and activity information which need to be executed by a user are determined according to the semantic features; the above-mentioned parameter combination that obtains and matches with activity information and speech characteristic includes: and acquiring a parameter combination matched with the activity information and the voiceprint characteristics.
According to an embodiment of the present disclosure, the acquiring of the parameter combination matched with the activity information and the voiceprint feature includes: acquiring a parameter combination matched with the activity information and the voiceprint characteristics under the condition that the voiceprint characteristics are stored voiceprint characteristics and the activity information is stored activity information; or in the case that the voiceprint feature is not a stored voiceprint feature: acquiring a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint characteristics; establishing and storing a matching relation between the voiceprint characteristics and the activity information and a preset parameter combination; or in the case that the voiceprint feature is a stored voiceprint feature and the activity information is not stored activity information: determining a parameter combination as a parameter combination matching both the activity information and the voiceprint feature according to the acquired record of the parameter combination matching the voiceprint feature and the similar activity information of the activity information; and establishing and storing a matching relation of the voiceprint characteristics, the activity information and the determined parameter combination.
According to the embodiment of the present disclosure, the above parameter combination further includes a timing parameter for controlling the work of at least two pieces of smart home devices, and according to the parameter combination, controlling the work of at least two pieces of smart home devices in the plurality of pieces of smart home devices includes: and controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the working parameters and the time sequence parameters.
Another aspect of the present disclosure provides a control apparatus for an intelligent home system, where the intelligent home system includes a plurality of intelligent home devices, and the apparatus includes an acquisition module, a determination module, a parameter combination acquisition module, and a control module. The acquisition module is used for acquiring voice information of a user; the determining module is used for determining the voice characteristics of the voice information and the activity information of a first activity which needs to be executed by a user according to the voice information; the parameter combination acquisition module is used for acquiring a parameter combination matched with the activity information and the voice characteristics; the control module is used for controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to parameter combinations and providing conditions for a user to execute the first activity, wherein the parameter combinations comprise working parameters of the at least two pieces of intelligent household equipment.
According to the embodiment of the disclosure, the control device of the smart home system further comprises a working parameter acquisition module and a parameter combination updating module. The working parameter acquisition module is used for acquiring the working parameters of the plurality of intelligent household devices in real time after the control module controls at least two intelligent household devices in the plurality of intelligent household devices to work and before the intelligent household system stops working; and the parameter combination updating module is used for updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent household equipment acquired in real time.
According to the embodiment of the disclosure, the control device of the intelligent home system further comprises a reference information acquisition module and a working parameter adjustment module. The reference information acquisition module is used for acquiring environmental information of an environment where the intelligent home system is located and/or historical behavior information of a user before the control module controls at least two pieces of intelligent home equipment in the plurality of pieces of intelligent home equipment to work; the working parameter adjusting module is used for adjusting working parameters included in the parameter combination according to the environment information and/or the historical behavior information of the user; correspondingly, the control module is used for controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the adjusted parameter combination.
According to an embodiment of the present disclosure, the determining module includes an analyzing submodule activity and a determining submodule. The analysis submodule is used for analyzing the voice information and determining the voice characteristics of the voice information; and the activity determining submodule is used for determining a first activity required to be executed by the user and activity information of the first activity according to the voice characteristics.
According to the embodiment of the disclosure, the voice features comprise semantic features and voiceprint features, and the activity determination submodule determines a first activity and activity information which need to be executed by a user according to the semantic features; the parameter combination acquisition module is used for acquiring a parameter combination matched with the activity information and the voiceprint characteristics.
According to an embodiment of the present disclosure, the parameter combination obtaining module includes a obtaining sub-module, and the obtaining sub-module is configured to obtain a parameter combination matching the activity information and the voiceprint feature when the voiceprint feature is the stored voiceprint feature and the activity information is the stored activity information.
According to an embodiment of the present disclosure, the parameter combination obtaining module further includes a first storage sub-module, where the obtaining sub-module is configured to obtain, when the voiceprint feature is not the stored voiceprint feature, a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint feature; the first storage submodule is used for establishing and storing the matching relation between the voiceprint characteristics and the preset parameter combination and the activity information.
According to an embodiment of the present disclosure, the parameter combination obtaining module further includes: and the second storage sub-module is used for establishing and storing the matching relation of the voiceprint characteristics, the activity information and the parameter combination determined by the acquisition sub-module.
According to the embodiment of the disclosure, the parameter combination further comprises a time sequence parameter for controlling at least two pieces of intelligent home equipment to work, and the control module is used for controlling at least two pieces of intelligent home equipment in the plurality of pieces of intelligent home equipment to work according to the working parameter and the time sequence parameter.
Another aspect of the present disclosure provides an electronic device including: one or more processors; and the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are enabled to execute the control method of the intelligent home system.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions for implementing the control method of the smart home system as described above when executed.
Another aspect of the present disclosure provides a computer program comprising computer executable instructions for implementing the control method of the smart home system as described above when executed.
According to the embodiment of the disclosure, the defects that in the prior art, the interaction logic between a user and an intelligent home system is complex and the efficiency of controlling the intelligent home system is low can be at least partially overcome, and therefore, by acquiring the parameter combination corresponding to the voice information and the activity information of the first activity, the simultaneous control of a plurality of intelligent home devices is realized, the interaction efficiency between the user and the intelligent home system is improved, and the user experience is improved.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
fig. 1 schematically illustrates an application scenario of a control method and apparatus of a smart home system, an electronic device and a readable medium according to an embodiment of the present disclosure;
fig. 2 schematically shows a flowchart of a control method of the smart home system according to an embodiment of the present disclosure;
FIG. 3 schematically shows a flow diagram of determining activity information for a first activity that a user needs to perform in accordance with an embodiment of the present disclosure;
FIG. 4 schematically illustrates a flow chart for obtaining a combination of parameters according to an embodiment of the disclosure;
fig. 5 is a flowchart schematically illustrating a part of operations of a control method of a smart home system according to another embodiment of the present disclosure;
fig. 6 schematically shows a flowchart of part of operations of a control method of a smart home system according to still another embodiment of the present disclosure;
fig. 7 schematically shows a block diagram of a control device of the smart home system according to an embodiment of the present disclosure;
fig. 8 schematically shows a block diagram of an electronic device adapted to perform a control method of a smart home system according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
The embodiment of the disclosure provides a control method and device of an intelligent home system, electronic equipment and a readable medium, which can improve interaction efficiency and user experience, wherein the control method of the intelligent home system comprises the following steps: collecting voice information of a user; determining voice characteristics of the voice information and activity information of a first activity required to be executed by a user according to the voice information; acquiring a parameter combination matched with the activity information and the voice characteristics; and controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the parameter combination, and providing conditions for a user to execute a first activity, wherein the parameter combination comprises working parameters of the at least two pieces of intelligent household equipment.
Fig. 1 schematically shows an application scenario of a control method and apparatus of an intelligent home system, an electronic device and a readable medium according to an embodiment of the disclosure. It should be noted that fig. 1 is only an example of an application scenario in which the embodiment of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiment of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the application scenario 100 includes a smart home system 110, a cloud system 120, and a user 130.
The smart home system 110 includes a plurality of smart home devices, for example, the plurality of smart home devices may include at least one first smart device that can interact with the user 130 and can interact with the cloud system 120 or the server through the communication link, and the first smart device may also interact with other smart home devices to control the operations of other smart home devices. According to the embodiment of the disclosure, for example, the plurality of smart home devices forming the smart home system may not include the first smart device, and other electronic devices (e.g., a router, a smart sound, etc.) capable of interacting with the smart home system serve as the first smart device.
The plurality of smart home devices may be smart bathroom devices, and may specifically include, for example, a smart shower 111, a smart water heater 112, a smart bathtub 113, a smart bathroom heater 114, a smart toilet 115, a smart toilet 116, a smart light fixture, and the like.
The intelligent household devices can also be intelligent kitchen ware devices, and specifically can comprise an intelligent range hood, an intelligent hot water kettle, an intelligent gas hood, an intelligent cabinet, an intelligent dish washer, an intelligent microwave oven, an intelligent oven and the like.
The plurality of intelligent household devices can also be other intelligent devices, such as intelligent televisions, intelligent set top boxes, intelligent sound boxes, intelligent refrigerators, intelligent air conditioners, intelligent curtains, intelligent washing machines, intelligent air purifiers, intelligent game machines, intelligent projectors and other intelligent electronic devices.
In the embodiment of the present disclosure, an intelligent home system composed of a plurality of intelligent sanitary devices is taken as an example to describe in detail the technical solution of the present disclosure, wherein, for example, the intelligent vanity mirror 115 may be used as a first intelligent device capable of interacting with the user 130 and the cloud system 120. It is to be understood that the above-mentioned smart home system is merely an example to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto, for example, a smart home system may also be configured by a plurality of smart kitchen devices, as long as the plurality of smart home devices configuring the smart home system can cooperate to provide a condition for a user to perform a certain activity.
In the embodiment of the disclosure, the first smart device smart vanity mirror 115 may collect voice information of the user, process the voice information, determine voice characteristics of the voice information and activity information of activities that the user needs to perform, acquire a parameter combination of smart home system work through interaction with the cloud system 120 according to the voice characteristics and the activity information, and each smart bathroom device may work according to respective parameters in the parameter combination.
For example, when the user speaks a voice instruction of "magic mirror and i want to take a bath" to the smart vanity mirror 115, the smart vanity mirror 115 may determine that the activity information is "take a bath" according to the voice instruction, and determine that the current user is the female owner, the smart vanity mirror 115 may acquire a parameter combination matched with the female owner to take a bath through interaction with the cloud system 120, for example, "turn on the bath heater, turn on the exhaust fan, inject a medium amount of water into the bathtub", and turn on the bath heater and the exhaust fan under the control of the smart vanity mirror 115 according to the parameter combination, and gradually inject water into the bathtub until the amount of water in the bathtub is the medium amount of water. Through this mode, then need not the user and say the control command to bathroom heater, exhaust fan and bathtub respectively, only need according to the instruction that "I want to bathe" of user, can open these a plurality of intelligent house equipment, consequently can improve user experience at a certain extent.
The first smart device may further store a parameter combination matched with the user and various voice instructions of the user into the cloud system 120 through interaction with the user, so that when the user uses the first smart device subsequently, the matched parameter combination can be obtained from the cloud system 120 only according to a simple voice instruction of the user, and the plurality of smart home devices are controlled to work according to the parameter combination. Alternatively, for example, a preset parameter combination may be stored in the cloud system 120, so that the first smart device can call the preset parameter combination when the user uses the smart home system for the first time.
It should be noted that the control method of the smart home system provided by the embodiment of the present disclosure may be generally executed by any smart home device in the smart home system. Accordingly, the control device of the smart home system provided by the embodiment of the present disclosure may be generally disposed in any smart home device in the smart home system. The control method of the smart home system provided by the embodiment of the present disclosure may also be executed by other electronic devices that are different from the smart home devices in the smart home system 110 and can communicate with the smart home system 110. Correspondingly, the control device of the smart home system provided in the embodiment of the present disclosure may also be disposed in other electronic devices that are different from the smart home devices in the smart home system 110 and can communicate with the smart home system 110.
It is understood that the types and numbers of the smart home systems 110 and the cloud systems 120 in fig. 1 are merely illustrative, and any type and number of smart home systems and cloud devices may be provided according to implementation requirements.
Fig. 2 schematically shows a flowchart of a control method of a smart home system according to an embodiment of the present disclosure, and fig. 3 schematically shows a flowchart of activity information determining a first activity that a user needs to perform according to an embodiment of the present disclosure.
According to the embodiment of the disclosure, the smart home system may include a plurality of smart home devices, and the plurality of smart home devices may be connected together through internet of things such as a wireless local area network, specifically, may be connected through a wireless local area network provided by a wireless router.
As shown in fig. 2, the control method of the smart home system includes operation S210-operation S240.
In operation S210, voice information of a user is collected.
The voice information of the user may be, for example, a voice instruction sent by the user within a collection range of an electronic device with a voice collection function, and the electronic device with the voice collection function may be, for example, the router providing the wireless local area network, or any one of the plurality of smart home devices or another electronic device capable of communicating with the smart home system. The voice collection function can be realized by a sound collector.
According to the embodiment of the present disclosure, the collected voice information may specifically be, for example, a voice instruction issued by the user to characterize the activity to be performed by the user, for example, the voice information may be used to characterize the voice instruction "i want to take a bath", "i want to cook, or" i want to watch a movie ", etc.
In operation S220, voice characteristics of the voice information and activity information of a first activity that the user needs to perform are determined according to the voice information.
According to an embodiment of the present disclosure, the operation S220 may specifically be, for example, first performing processing such as feature extraction and voice recognition on the voice information, then determining a first activity that needs to be performed by the user and activity information of the first activity according to a voice recognition result, and finally converting the processing result and the determined result into information that can be recognized by the electronic device, such as a binary code or a character sequence.
Specifically, as shown in fig. 3, the operation S220 may include operations S221-S222.
In operation S221, the voice information is analyzed, and a voice feature of the voice information is determined.
Specifically, the voice feature of the voice information may include a voiceprint feature, for example, so as to determine the identity of the user who issues the voice instruction through the voiceprint feature; the speech features may also include, for example, semantic features, which may be keyword features obtained through speech recognition, or the like. The operation S220 may specifically be, for example, analyzing the speech information by using an existing speech recognition technology to obtain the speech feature. It is to be understood that the above-described speech feature and analysis processing method are only examples to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto.
In operation S222, a first activity that the user needs to perform and activity information of the first activity are determined according to the voice feature.
According to an embodiment of the present disclosure, the operation S222 may specifically be, for example, determining a first activity that needs to be performed by the user according to semantic features in the speech features extracted in operation S221. For example, when the semantic features are keyword features, the operation may specifically query a correspondence table of keyword features, activities, and activity information prestored in the cloud system according to the extracted keyword features, so as to obtain a first activity corresponding to the keyword features and activity information of the first activity.
According to an embodiment of the present disclosure, the operation S222 may be, for example, to use the extracted semantic features as an input of a pre-trained neural network, and output the input through the neural network to obtain a first activity that needs to be performed by the user and activity information of the first activity, where the activity information is information that can be recognized by an electronic device corresponding to the first activity. It is to be understood that the specific implementation manner of the operation S222 is only an example to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto.
According to the embodiment of the disclosure, since the first activity and the activity information thereof are determined according to the semantic features, the activity information of different first activities can be determined and obtained according to the voice information corresponding to different instructions sent by the user. The parameter combination obtained in the subsequent operation S230-operation S240 and the working states of at least two pieces of smart home equipment correspond to semantic features of the user, so that different parameter combinations can be obtained according to different voice information, and the final working state of the smart home system corresponds to an instruction of the user. Specifically, under the condition that the semantic feature is determined according to the voice information of 'i want to shower' of the user, the determined first activity is showering, the obtained parameter combination can be working parameters of a shower head, a water heater and a bath heater, and the working state of the intelligent home system is that the shower head, the water heater and the bath heater work; and when the semantic feature is the situation determined according to the voice information of the user that the user wants to take a bath, the determined first activity is taking a bath, the obtained parameter combination can be the working parameters of the water heater, the bath heater and the bathtub, and the working state of the intelligent home system is the working of the water heater, the bath heater and the faucet of the bathtub.
It is understood that the above operation S220 may also be implemented by, for example, a pre-trained neural network, and the voice information collected in operation S210 is used as an input of the neural network, and the voice feature of the voice information, the first activity that the user needs to perform, and the activity information of the first activity are obtained after being processed by the neural network.
In operation S230, a parameter combination matching the activity information and the voice feature is acquired.
According to an embodiment of the present disclosure, the operation S230 may, for example, obtain the matched parameter combination from the cloud system 120 according to the activity information and the voice feature.
In the case that the voice features further include voiceprint features, the operation S230 may specifically be to obtain a parameter combination matching both the voiceprint features and the activity information from the cloud system 120. For example, the cloud system 120 may store parameter combinations corresponding to different voiceprint features and activity information in different storage units, and use the voiceprint features and the activity information as indexes of the storage units, and then operation S230 is: the storage unit indexed by the voiceprint feature and the activity information determined in operation S220 is searched from the cloud system 120, and after the corresponding storage unit is found, the parameter combination in the storage unit is called.
According to an embodiment of the present disclosure, the parameter combination may include, for example, operating parameters of at least two smart home devices, for use as a reference when the smart home devices operate, where the operating parameters may include, for example, operating power, water temperature, water amount, and the like, and it is understood that different types of operating parameters may be provided for different smart home devices.
According to the embodiment of the disclosure, since the voiceprint features are in one-to-one correspondence with the user, the parameter combination obtained according to the voiceprint features is also in one-to-one correspondence with the user, for example, when the voiceprint features are determined from the voice information of the female owner, "i want to shower", the obtained parameter combination may include the working parameters of the shower head, the exhaust fan, and the bathroom heater, and when the voiceprint features are determined from the voice information of the male owner, "i want to shower", the obtained parameter combination may only include the working parameters of the shower head and the exhaust fan, so that when the smart home system works according to the parameter combination, the technical effect that the smart home system is in different working states according to the requirements of different users can be automatically achieved, and therefore, the user experience is improved.
In operation S240, at least two smart home devices of the plurality of smart home devices are controlled to operate according to the parameter combination, so as to provide a condition for the user to execute the first activity.
According to the embodiment of the disclosure, the operation is specifically to control the at least two pieces of smart home equipment to work according to the respective working parameters according to the working parameters of the at least two pieces of smart home equipment included in the parameter combination.
According to the embodiment of the disclosure, the operation may specifically be that after the electronic device that collects the user voice information acquires the parameter combination, according to the working parameters of the at least two pieces of smart home equipment in the parameter combination, an instruction corresponding to the working parameters is sent to the at least two pieces of smart home equipment, so that the at least two pieces of smart home equipment work according to the instruction after receiving the instruction.
According to the method, for example, when a user sends out voice information that the user wants to take a bath, the first activity to be executed by the user can be determined to be the bath, then the parameter combination of the work of the intelligent bathroom equipment can be automatically obtained, the bathroom heater and the exhaust fan can be automatically opened according to the parameter combination, and water is injected into the bathtub.
According to the embodiment of the disclosure, the parameter combination may further include, for example, a timing parameter of the operation of the at least two pieces of smart home equipment, and specifically, for example, the start operating time, the operating duration, and the like of the at least two pieces of smart home equipment, and then, according to the parameter combination, the at least two pieces of smart home equipment may be controlled to operate according to the operating parameter and the timing parameter.
For example when giving voice command "I want to shower" by owner, the parameter combination who acquires can include the wash basin, the gondola water faucet, the bathroom heater, the working parameter and the time sequence parameter of exhaust fan, for example owner when taking a shower, can wash the face in the wash basin earlier usually, just open the gondola water faucet after washing the face, bathroom heater and exhaust fan, then control these smart home devices according to working parameter and time sequence parameter during operation, concrete work order can be the tap of opening the wash basin earlier, last a minute back, open gondola water faucet, bathroom heater and exhaust fan again, thereby can avoid when owner's face washing, the defect of the extravagant water resource that gondola water faucet work leads to. That is, according to the embodiment of the present disclosure, by obtaining the parameter combination including the timing parameter, at least two pieces of smart home equipment can be controlled to operate according to a certain timing, and therefore, the service provided by the smart home system to the user can better meet the user requirement, the user experience can be improved, and the resource waste can be reduced under a certain condition.
Fig. 4 schematically shows a flow chart for obtaining a combination of parameters according to an embodiment of the present disclosure.
According to an embodiment of the present disclosure, in a case that referring to operation S220 in fig. 2 includes referring to operations S221-S222 in fig. 3, the process of acquiring the parameter combination in operation S230 may specifically be referring to the operation process in fig. 4.
First, in operation S231, it is determined whether the voiceprint feature is a stored voiceprint feature.
In the case where the result of the determination in operation S231 is yes, that is, the voiceprint feature is the stored voiceprint feature, a determination operation S232 is performed to determine whether the activity information is the stored activity information.
If the result of the determination in operation S232 is yes, that is, the voiceprint feature is the stored voiceprint feature, and the activity information is the stored activity information, operation S233 is executed to obtain a parameter combination matching both the activity information and the voiceprint feature, and the parameter combination matching both the activity information and the voiceprint feature is obtained in operation S230.
In the case where the result of the determination in operation S232 is no, i.e., the voiceprint feature is the stored voiceprint feature and the activity information is not the stored activity information, then operations S236-S237 are performed.
Specifically, in operation S236, a parameter combination is determined as a parameter combination matching both the activity information and the voiceprint feature, based on the acquired record of parameter combinations matching the voiceprint feature and the similar activity information to the activity information; in operation S237, a matching relationship of the voiceprint feature, the activity information, and the determined parameter combination is established and stored.
According to an embodiment of the present disclosure, for a smart home system configured by referring to a plurality of smart bathroom devices in fig. 1, considering that the activities that the user may perform are showering, bathing, and the like, a parameter combination corresponding to showering and bathing set by the user may be stored in the cloud system 120, for example, but not stored. However, when the voice information sent by the user is "i want to take a bath", the activity and the activity information determined according to the voice information are taken a bath, and the similar activity information of the activity information can be determined to be the activity information of the shower and the bath, and then the parameter combination with the most acquired records is determined as the parameter combination matched with both the activity information and the voiceprint characteristics according to the acquired records of the parameter combination corresponding to the voiceprint characteristics and the shower and the parameter combination corresponding to the voiceprint characteristics and the bath stored in the cloud system 120. It is understood that, for example, the parameter combination determined in the operation S237 may also be a parameter combination which is obtained and recorded the latest, which is not limited in this disclosure, and the similar activity information of the determined activity information may specifically be activity information of other activities having the same purpose as the activity corresponding to the activity information, and is not described herein again.
Meanwhile, in order to improve the efficiency of acquiring the parameter combination when the user sends the voice information of 'i want to bath' again, the matching relationship can be established between the activity information and the voiceprint characteristics corresponding to 'i want to bath' and the determined parameter combination, and the matching relationship is stored, so that when the voice information of 'i want to bath' of the user is acquired again, the matched parameter combination can be directly acquired, and the parameter combination does not need to be determined according to the acquired record of the parameter combination.
In the case where the result of the determination in the determination operation S231 is no, that is, the voiceprint feature is not the stored voiceprint feature, operations S234 to S235 are performed.
Specifically, in operation S234, a preset parameter combination matched with the activity information is acquired as a parameter combination matched with the activity information and the voiceprint feature; in operation S235, a matching relationship of the voiceprint feature, the activity information, and a preset parameter combination is established and stored.
For example, parameter combinations corresponding to activities that the user may want to perform may be stored in the cloud system 120 in advance, for example, working parameters of a "shower head, water heater" parameter combination corresponding to the shower activity of the user may be initialized, and then, in a case where the voice message of the user a "i want to shower" is received for the first time, the parameter combination corresponding to the voice message of the user a may be obtained, it may be understood that, in operation S234, when the preset parameter set is obtained according to the activity information, rough matching may be performed on the activity information, that is, the activity information matched with the parameter combination may also be activity information that is the same as or similar to the determined activity information, so that, even if the parameter combination corresponding to the shower is included in the prestored parameter combination, but the parameter combination corresponding to the bath is not included, the parameter combination corresponding to the shower may still be obtained, so that the intelligent home system starts to work.
Meanwhile, in order to improve the accuracy of the acquired parameter combination when the user A sends the voice information of 'i want to shower' again, the matching relationship can be established between the activity information corresponding to 'i want to shower' and the voiceprint characteristics of the user A and the determined parameter combination, and is stored, so that when the voice information of 'i want to shower' of the user A is collected again, the matched parameter combination can be directly acquired without acquiring the preset parameter combination.
In summary, according to the method for acquiring the parameter combination in the embodiment of the present disclosure, even when the parameter combination matching the voiceprint feature and/or the voice feature is not stored in the cloud system 120, the parameter combination can still be determined, and the smart home system can work according to the parameter combination, so that the user experience can be improved to a certain extent.
Fig. 5 is a flowchart schematically illustrating a part of operations of a control method of a smart home system according to another embodiment of the present disclosure.
The control method of the smart home system according to the embodiment of the present disclosure, in addition to the operations S210 to S240 described with reference to fig. 2, as shown in fig. 5, may further include operations S510 to S520, where the operations S510 to S520 are performed before the operation S240.
In operation S510, environment information of an environment where the smart home system is located and/or historical behavior information of the user is obtained.
The environment information may include, for example, temperature, humidity, illumination brightness, and the like of an environment where the smart home system is located, and may also be weather temperature, humidity, and the like of a geographical location where the smart home system is located.
The historical behavior information of the user may include user behaviors collected by a plurality of smart homes in the smart home system, for example, the time for the user to open and close the door, which is recorded by the smart door, the type of music played within a predetermined time period, which is recorded by the smart speaker (i.e., favorite information of the user listening to music), the number of times and time for the user to take cold drinks, which are recorded by the smart refrigerator, or the record for the user to open and close the air conditioner, which is recorded by the smart air conditioner. It is to be understood that the above-mentioned historical behavior information of the user is only used as an example to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto.
The operation S510 may be specifically executed by a sensor installed in the electronic device that collects the voice information of the user in the operation S210, or may be acquired by the electronic device from the cloud system 120, or acquired by the electronic device from another smart home through a communication link. The present disclosure does not limit the type and the acquisition manner of the environmental information. It is understood that the operation S510 may be performed simultaneously with the operation S210, or may be performed before or after the operation S210, for example.
In operation S520, the operation parameters included in the parameter combination are adjusted according to the environment information and/or the historical behavior information of the user.
Where the adjusted parameter combination may be the parameter combination acquired in operation S230, operation S520 may be performed between operation S230 and operation S240.
According to the embodiment of the present disclosure, when the water temperature parameter of the water heater in the parameter combination obtained in operation S230 is 40 ℃, and the temperature of the environment where the environment information obtained in operation S510 is located is 32 ℃, considering that the current body of the user feels hot, the water temperature parameter of the water heater in the parameter combination may be appropriately reduced; or, when the water temperature parameter of the water heater in the parameter combination obtained in operation S230 is 40 ℃, and the historical behavior information of the user obtained in operation S510 is cold drinks taken by the user a large number of times within a predetermined time period, in this case, considering that the current body of the user is hot, the water temperature parameter of the water heater in the parameter combination can be appropriately reduced, and the like
Accordingly, referring to operation S240 in fig. 2, specifically referring to operation S530 in fig. 5, at least two smart home devices in the plurality of smart home devices are controlled to operate according to the adjusted parameter combination, and specifically, since the water temperature parameter of the water heater is reduced according to the environmental information, the water temperature of the water heater can better meet the requirement of the user that the user wants to relieve summer heat.
In summary, according to the embodiment of the present disclosure, the working parameters of the smart home devices are adjusted according to the environment information, so that the working state of the smart home devices can better meet the user requirements, and therefore, the user experience is improved.
Fig. 6 schematically shows a flowchart of part of operations of a control method of a smart home system according to still another embodiment of the present disclosure.
The control method of the smart home system according to the embodiment of the present disclosure may further include, for example, operations S610 to S620 described with reference to fig. 6, in addition to operations S210 to S240 described with reference to fig. 2, where the operations S610 to S620 may be executed after the operation S240.
In operation S610, the working parameters of the plurality of smart home devices are obtained in real time.
According to an embodiment of the present disclosure, in operation S610, for example, the plurality of smart home devices may send the working parameters to the electronic device that collects the voice information of the user in real time, so that the electronic device that collects the voice information of the user can obtain the working parameters in real time. The working parameters can be the same as or different from the working parameters of each intelligent household device in the parameter combination.
In operation S620, a parameter combination matched with the activity information and the voice feature is updated according to the working parameters of the plurality of smart home devices acquired in real time.
According to the embodiment of the present disclosure, in operation S620, specifically, the electronic device that collects the voice information of the user updates the parameter combination stored in the cloud system 120 according to the working parameter obtained in real time, so as to optimize the parameter combination stored in the cloud system 120. For example, when the water temperature set by the water heater according to the operation parameters acquired in operation S230 is 35 ℃, but the water temperature is increased to 40 ℃ when the user feels that the water temperature is low during the shower in winter, the water temperature set by the operation parameters, which are stored in the cloud system and are matched with the voiceprint characteristics of the user and the activity information of the currently executed activity, may be adjusted from 35 ℃ to 40 ℃ in operation S620, and the acquired operation parameters are the operation parameters that more meet the requirements of the user at the current time stage when the user needs to execute the same activity next time.
In summary, the embodiment of the present disclosure can update the working parameters in real time, so that the parameter combination matched with the activity information and the voice feature can better meet the requirements of the user at the current stage, and thus the user experience can be improved to a certain extent.
According to the embodiment of the present disclosure, the methods described with reference to fig. 2 to 6 may be applied to other smart home systems except the smart home system composed of the smart bathroom devices described with reference to fig. 1, for example, may also be applied to the smart home system composed of the smart kitchen ware, and data acquired by the smart home system composed of different types of devices may be stored in different cloud systems, so as to avoid the situation that the acquired data is different from the current application scenario, and thus, the accuracy of the acquired parameter combination may be improved.
Fig. 7 schematically shows a block diagram of a control device of a smart home system according to an embodiment of the present disclosure.
As shown in fig. 7, a control device 700 of the smart home system in the embodiment of the present disclosure includes an acquisition module 710, a determination module 720, a parameter combination acquisition module 730, and a control module 740.
The collecting module 710 is used for collecting voice information of a user. According to an embodiment of the present disclosure, the acquisition module 710 may be configured to perform operation S210 described with reference to fig. 2, for example, and is not described herein again.
The determining module 720 is configured to determine, according to the voice information, a voice feature of the voice information and activity information of a first activity that needs to be performed by the user. According to an embodiment of the present disclosure, the determining module 720 may be configured to perform operation S220 described with reference to fig. 2, for example, and is not described herein again.
The parameter combination obtaining module 730 is configured to obtain a parameter combination matched with the activity information and the voice feature, where the parameter combination includes working parameters of at least two pieces of smart home equipment. According to an embodiment of the present disclosure, the parameter combination obtaining module 730 may be configured to perform operation S230 described with reference to fig. 2, for example, and is not described herein again.
The control module 740 is configured to control at least two smart home devices of the plurality of smart home devices to work according to the parameter combination, so as to provide a condition for the user to execute the first activity. According to an embodiment of the present disclosure, the control module 740 may be configured to perform the operation S240 described with reference to fig. 2, for example, and is not described herein again.
According to an embodiment of the present disclosure, the parameter combination may further include a timing parameter for controlling at least two pieces of smart home equipment to work, and the control module 740 is specifically configured to control at least two pieces of smart home equipment of the plurality of smart home equipment to work according to the working parameter and the timing parameter.
According to an embodiment of the present disclosure, as shown in fig. 7, the determination module 720 may include, for example, an analysis submodule 721 and an activity determination submodule 722. The analysis submodule 721 is configured to analyze the voice information, and determine a voice feature of the voice information; the activity determining submodule 722 is configured to determine, according to the voice feature, a first activity that the user needs to perform and activity information thereof. According to an embodiment of the present disclosure, the analysis submodule 721 and the activity determination submodule 722 may be, for example, respectively configured to perform the operation S221 and the operation S222 described with reference to fig. 3, and are not described herein again.
According to an embodiment of the present disclosure, the voice feature includes a semantic feature and a voiceprint feature, and the activity determination submodule 722 is specifically configured to determine, according to the semantic feature, a first activity that needs to be performed by the user and activity information thereof. Accordingly, the parameter combination obtaining module 730 is configured to obtain a parameter combination matching the activity information and the voiceprint feature.
According to an embodiment of the present disclosure, as shown in fig. 7, the parameter combination obtaining module 730 includes a obtaining sub-module 731, where the obtaining sub-module 731 is configured to obtain a parameter combination matching the activity information and the voiceprint characteristics if the voiceprint characteristics are stored voiceprint characteristics and the activity information is stored activity information. According to an embodiment of the present disclosure, the obtaining submodule may be configured to perform operation 233 described with reference to fig. 4, for example, and is not described herein again.
According to an embodiment of the present disclosure, as shown in fig. 7, the parameter combination obtaining module 730 may further include a first storing sub-module 732, where the obtaining sub-module 731 is configured to, in a case that the voiceprint feature is not the stored voiceprint feature, obtain a preset parameter combination matching the activity information as a parameter combination matching the activity information and the voiceprint feature; the first storage sub-module 732 is configured to establish and store a matching relationship between the voiceprint feature and the activity information and a preset parameter combination. According to an embodiment of the present disclosure, the obtaining submodule 731 and the first storing submodule 732 may be, for example, configured to perform operation S234 and operation S235 described with reference to fig. 4, respectively, and are not described herein again.
According to the embodiment of the present disclosure, as shown in fig. 7, the parameter combination obtaining module 730 may further include a second storing sub-module 733, where the obtaining sub-module 731 is configured to determine, according to the obtained record of the parameter combination matching the voiceprint feature and other activity information similar to the activity information, one parameter combination as a parameter combination matching both the activity information and the voiceprint feature, in the case that the voiceprint feature is the stored voiceprint feature and the activity information is not the stored activity information; the second storage sub-module 733 is configured to establish and store a matching relationship between the voiceprint feature and the activity information and the parameter combination determined by the obtaining sub-module 731. According to an embodiment of the present disclosure, the obtaining sub-module 731 and the second storing sub-module 733 may be, for example, respectively configured to perform operation S236 and operation S237 described with reference to fig. 4, and are not described herein again.
According to an embodiment of the present disclosure, as shown in fig. 7, the control device 700 of the smart home system may further include a reference information obtaining module 750 and an operating parameter adjusting module 760, for example. The reference information obtaining module 750 is configured to obtain environment information of an environment where the smart home system is located before the control module 740 controls at least two smart home devices of the plurality of smart home devices to operate; the working parameter adjusting module 760 is configured to adjust working parameters included in the parameter combination according to the environment information, and correspondingly, the control module 740 is configured to control at least two smart home devices of the plurality of smart home devices to work according to the adjusted parameter combination. According to an embodiment of the present disclosure, the reference information obtaining module 750, the working parameter adjusting module 760, and the control module 740 may be, for example, respectively configured to perform operations S510 to S530 described with reference to fig. 5, which are not described herein again.
According to an embodiment of the present disclosure, as shown in fig. 7, the control device 700 of the smart home system may further include an operating parameter obtaining module 770 and a parameter combination updating module 780, for example. The working parameter obtaining module 770 is configured to obtain the working parameters of the plurality of smart home devices in real time after the control module 740 controls at least two smart home devices of the plurality of smart home devices to work and before the smart home system stops working; the parameter combination updating module 780 is configured to update a parameter combination matched with the activity information and the voice feature according to the working parameters of the multiple pieces of smart home equipment acquired in real time. According to an embodiment of the present disclosure, the working parameter obtaining module 770 and the parameter combination updating module 780 may be, for example, respectively configured to perform operation S610 and operation S620 described with reference to fig. 6, which are not described herein again.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
For example, any plurality of the acquisition module 710, the determination module 720, the parameter combination acquisition module 730, the control module 740, the reference information acquisition module 750, the working parameter adjustment module 760, the working parameter acquisition module 770, the parameter combination update module 780, the analysis sub-module 721, the activity determination sub-module 722, the acquisition sub-module 731, the first storage sub-module 732, and the second storage sub-module 733 may be combined and implemented in one module, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the acquisition module 710, the determination module 720, the parameter combination acquisition module 730, the control module 740, the reference information acquisition module 750, the operating parameter adjustment module 760, the operating parameter acquisition module 770, the parameter combination update module 780, the analysis sub-module 721, the activity determination sub-module 722, the acquisition sub-module 731, the first storage sub-module 732, and the second storage sub-module 733 may be implemented at least partially as a hardware circuit, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), systems on a chip, systems on a substrate, systems on a package, Application Specific Integrated Circuits (ASICs), or may be implemented in hardware or firmware in any other reasonable way of integrating or packaging circuits, or in any one of three implementations, software, hardware and firmware, or in any suitable combination of any of them. Alternatively, at least one of the acquisition module 710, the determination module 720, the parameter combination acquisition module 730, the control module 740, the reference information acquisition module 750, the operating parameter adjustment module 760, the operating parameter acquisition module 770, the parameter combination update module 780, the analysis sub-module 721, the activity determination sub-module 722, the acquisition sub-module 731, the first storage sub-module 732, and the second storage sub-module 733 may be implemented at least in part as a computer program module that, when executed, may perform corresponding functions.
Fig. 8 schematically shows a block diagram of an electronic device adapted to perform a control method of a smart home system according to an embodiment of the present disclosure. The electronic device shown in fig. 8 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 8, an electronic device 800 according to an embodiment of the present disclosure includes a processor 801 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage section 808 into a Random Access Memory (RAM) 803. The processor 801 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 801 may also include onboard memory for caching purposes. The processor 801 may include a single processing unit or multiple processing units for performing different actions of the method flows according to embodiments of the present disclosure.
In the RAM 803, various programs and data necessary for the operation of the electronic apparatus 800 are stored. The processor 801, the ROM802, and the RAM 803 are connected to each other by a bus 804. The processor 801 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM802 and/or RAM 803. Note that the programs may also be stored in one or more memories other than the ROM802 and RAM 803. The processor 801 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
Electronic device 800 may also include input/output (I/O) interface 805, input/output (I/O) interface 805 also connected to bus 804, according to an embodiment of the present disclosure. Electronic device 800 may also include one or more of the following components connected to I/O interface 805: an input portion 806 including a keyboard, a mouse, and the like; an output section 807 including a signal such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 808 including a hard disk and the like; and a communication section 809 including a network interface card such as a LAN card, a modem, or the like. The communication section 809 performs communication processing via a network such as the internet. A drive 810 is also connected to the I/O interface 805 as necessary. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 810 as necessary, so that a computer program read out therefrom is mounted on the storage section 808 as necessary.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 809 and/or installed from the removable medium 811. The computer program, when executed by the processor 801, performs the above-described functions defined in the system of the embodiments of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM802 and/or RAM 803 described above and/or one or more memories other than the ROM802 and RAM 803.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims (16)

1. A control method of an intelligent home system, wherein the intelligent home system comprises a plurality of intelligent home devices, and the method comprises the following steps:
collecting voice information of a user;
determining voice characteristics of the voice information and activity information of a first activity which needs to be executed by the user according to the voice information;
acquiring a parameter combination matched with the activity information and the voice characteristics; and
controlling at least two smart home devices of the plurality of smart home devices to work according to the parameter combination, providing conditions for the user to execute the first activity,
the parameter combination comprises working parameters of the at least two pieces of intelligent household equipment.
2. The method according to claim 1, wherein after controlling at least two of the plurality of smart home devices to operate and before the smart home system stops operating, the method further comprises:
acquiring working parameters of the plurality of intelligent household devices in real time; and
and updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent household equipment acquired in real time.
3. The method of claim 1, wherein prior to controlling at least two of the plurality of smart home devices to operate, the method further comprises:
acquiring environment information of an environment where the intelligent home system is located and/or historical behavior information of the user;
adjusting working parameters included in the parameter combination according to the environment information and/or the historical behavior information of the user; and
and controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the adjusted parameter combination.
4. The method of claim 1, wherein determining, from the voice information, voice characteristics of the voice information and activity information of a first activity that the user needs to perform comprises:
analyzing the voice information and determining the voice characteristics of the voice information; and
and determining a first activity required to be executed by the user and activity information of the first activity according to the voice characteristics.
5. The method of claim 4, wherein:
the voice features comprise semantic features and voiceprint features, and the first activity required to be executed by the user and the activity information are determined according to the semantic features;
the acquiring of the parameter combination matched with the activity information and the voice feature comprises: and acquiring a parameter combination matched with the activity information and the voiceprint characteristics.
6. The method of claim 5, wherein obtaining a combination of parameters matching the activity information and the voiceprint features comprises:
acquiring a parameter combination matched with the activity information and the voiceprint features under the condition that the voiceprint features are stored voiceprint features and the activity information is stored activity information; or
In the event that the voiceprint feature is not a stored voiceprint feature:
acquiring a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint characteristics; and
establishing and storing a matching relation between the voiceprint characteristics and the preset parameter combination and the activity information; or
In the event that the voiceprint feature is a stored voiceprint feature and the activity information is not stored activity information:
determining a parameter combination as a parameter combination matching both the activity information and the voiceprint feature according to the acquired record of the parameter combination matching both the voiceprint feature and the similar activity information of the activity information; and
and establishing and storing the matching relation between the voiceprint characteristics, the activity information and the determined parameter combination.
7. The method according to claim 1, wherein the parameter combination further includes a timing parameter for controlling the at least two smart home devices to operate, and controlling the at least two smart home devices of the plurality of smart home devices to operate according to the parameter combination includes:
and controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the working parameters and the time sequence parameters.
8. A control device of an intelligent home system, the intelligent home system comprises a plurality of intelligent home devices, the device comprises:
the acquisition module is used for acquiring voice information of a user;
the determining module is used for determining the voice characteristics of the voice information and the activity information of the first activity which needs to be executed by the user according to the voice information;
a parameter combination obtaining module for obtaining a parameter combination matched with the activity information and the voice characteristics; and
a control module, configured to control at least two smart home devices of the plurality of smart home devices to operate according to the parameter combination, and provide a condition for the user to execute the first activity,
the parameter combination comprises working parameters of the at least two pieces of intelligent household equipment.
9. The apparatus of claim 8, further comprising:
the working parameter acquiring module is used for acquiring the working parameters of the plurality of intelligent household devices in real time after the control module controls at least two intelligent household devices in the plurality of intelligent household devices to work and before the intelligent household system stops working; and
and the parameter combination updating module is used for updating the parameter combination matched with the activity information and the voice characteristics according to the working parameters of the intelligent household equipment acquired in real time.
10. The apparatus of claim 8, further comprising:
the reference information acquisition module is used for acquiring environmental information of an environment where the intelligent home system is located and/or historical behavior information of the user before the control module controls at least two pieces of intelligent home equipment in the plurality of pieces of intelligent home equipment to work;
the working parameter adjusting module is used for adjusting the working parameters included in the parameter combination according to the environment information and/or the historical behavior information of the user; and
the control module is used for controlling at least two pieces of intelligent household equipment in the plurality of pieces of intelligent household equipment to work according to the adjusted parameter combination.
11. The apparatus of claim 8, wherein the means for determining comprises:
the analysis submodule is used for analyzing the voice information and determining the voice characteristics of the voice information; and
and the activity determining submodule is used for determining the first activity required to be executed by the user and the activity information of the first activity according to the voice characteristics.
12. The apparatus of claim 11, wherein:
the voice features comprise semantic features and voiceprint features, and the activity determining submodule determines first activities required to be executed by the user and the activity information according to the semantic features;
the parameter combination acquisition module is used for acquiring a parameter combination matched with the activity information and the voiceprint characteristics.
13. The apparatus of claim 12, wherein the parameter combination acquisition module comprises an acquisition sub-module, wherein:
the obtaining sub-module is configured to obtain a parameter combination matching the activity information and the voiceprint feature when the voiceprint feature is a stored voiceprint feature and the activity information is stored activity information; or
The parameter combination obtaining module further comprises a first storage submodule:
the obtaining sub-module is used for obtaining a preset parameter combination matched with the activity information as a parameter combination matched with the activity information and the voiceprint characteristics under the condition that the voiceprint characteristics are not stored voiceprint characteristics;
the first storage submodule is used for establishing and storing a matching relation between the voiceprint characteristics and the preset parameter combination; or
The parameter combination obtaining module further comprises a second storage submodule:
the obtaining submodule is used for determining a parameter combination as a parameter combination matched with both the activity information and the voiceprint characteristics according to the obtained record of the parameter combination matched with the voiceprint characteristics and similar activity information of the activity information under the condition that the voiceprint characteristics are stored voiceprint characteristics and the activity information is not stored activity information;
and the second storage submodule is used for establishing and storing the matching relation between the voiceprint characteristics and the activity information and the parameter combination determined by the acquisition submodule.
14. The apparatus according to claim 8, wherein the parameter combination further includes a timing parameter for controlling the at least two pieces of smart home equipment to operate, and the control module is configured to control the at least two pieces of smart home equipment of the plurality of smart home equipment to operate according to the operating parameter and the timing parameter.
15. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, respectively, cause the one or more processors to perform the method of any of claims 1-7.
16. A computer readable medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 7.
CN201910236042.8A 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium Active CN111756603B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910236042.8A CN111756603B (en) 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910236042.8A CN111756603B (en) 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium

Publications (2)

Publication Number Publication Date
CN111756603A true CN111756603A (en) 2020-10-09
CN111756603B CN111756603B (en) 2023-05-26

Family

ID=72671605

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910236042.8A Active CN111756603B (en) 2019-03-26 2019-03-26 Control method and device of intelligent home system, electronic equipment and readable medium

Country Status (1)

Country Link
CN (1) CN111756603B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112783113A (en) * 2020-11-20 2021-05-11 青岛经济技术开发区海尔热水器有限公司 Household equipment control method and electronic equipment
CN113485147A (en) * 2021-08-03 2021-10-08 南京邮电大学 Intelligent home control method and system based on big data analysis
CN113851127A (en) * 2021-09-23 2021-12-28 惠达卫浴股份有限公司 Intelligent mirror voice control system and method
CN115470956A (en) * 2022-09-29 2022-12-13 中国银行股份有限公司 Telephone banking business reservation method, device, system and medium
CN116700025A (en) * 2023-05-19 2023-09-05 青岛海尔空调器有限总公司 Method, device and smart device for controlling smart device

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068460A (en) * 2015-07-30 2015-11-18 北京智网时代科技有限公司 Intelligent control system
CN105867158A (en) * 2016-05-30 2016-08-17 北京百度网讯科技有限公司 Smart-home control method and device based on artificial intelligence and system
CN106325085A (en) * 2015-06-26 2017-01-11 华平智慧科技(北京)有限公司 Function-oriented intelligent home control system and intelligent home system
CN106462124A (en) * 2016-07-07 2017-02-22 深圳狗尾草智能科技有限公司 Method, system and robot for identifying and controlling household appliances based on intention
CN106549833A (en) * 2015-09-21 2017-03-29 阿里巴巴集团控股有限公司 A kind of control method and device of intelligent home device
CN106647311A (en) * 2017-01-16 2017-05-10 上海智臻智能网络科技股份有限公司 Intelligent central control system and equipment, server and intelligent equipment control method
CN108062031A (en) * 2018-02-13 2018-05-22 宁夏煜隆科技有限公司 Intelligent home furnishing control method, device, system and electronic equipment
CN108130683A (en) * 2017-12-21 2018-06-08 迪尔阿扣基金两合公司 A kind of household electrical appliance and the method for running household electrical appliance
CN108170034A (en) * 2017-12-29 2018-06-15 上海器魂智能科技有限公司 Smart machine control method, device, computer equipment and storage medium
CN108306797A (en) * 2018-01-30 2018-07-20 百度在线网络技术(北京)有限公司 Sound control intelligent household device, method, system, terminal and storage medium
WO2018149209A1 (en) * 2017-02-15 2018-08-23 腾讯科技(深圳)有限公司 Voice recognition method, electronic device, and computer storage medium
CN108717270A (en) * 2018-05-30 2018-10-30 珠海格力电器股份有限公司 Control method and device of intelligent equipment, storage medium and processor
CN109002022A (en) * 2018-08-16 2018-12-14 陕西卓居未来智能科技有限公司 A kind of cloud intelligent steward system and operating method based on interactive voice ability
CN109031965A (en) * 2018-07-19 2018-12-18 珠海格力电器股份有限公司 Intelligent device control method, device and computer-storable medium
CN109445352A (en) * 2018-12-10 2019-03-08 美的集团武汉制冷设备有限公司 Appliances equipment control method, household appliance and storage medium

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106325085A (en) * 2015-06-26 2017-01-11 华平智慧科技(北京)有限公司 Function-oriented intelligent home control system and intelligent home system
CN105068460A (en) * 2015-07-30 2015-11-18 北京智网时代科技有限公司 Intelligent control system
CN106549833A (en) * 2015-09-21 2017-03-29 阿里巴巴集团控股有限公司 A kind of control method and device of intelligent home device
CN105867158A (en) * 2016-05-30 2016-08-17 北京百度网讯科技有限公司 Smart-home control method and device based on artificial intelligence and system
CN106462124A (en) * 2016-07-07 2017-02-22 深圳狗尾草智能科技有限公司 Method, system and robot for identifying and controlling household appliances based on intention
CN106647311A (en) * 2017-01-16 2017-05-10 上海智臻智能网络科技股份有限公司 Intelligent central control system and equipment, server and intelligent equipment control method
WO2018149209A1 (en) * 2017-02-15 2018-08-23 腾讯科技(深圳)有限公司 Voice recognition method, electronic device, and computer storage medium
CN108130683A (en) * 2017-12-21 2018-06-08 迪尔阿扣基金两合公司 A kind of household electrical appliance and the method for running household electrical appliance
CN108170034A (en) * 2017-12-29 2018-06-15 上海器魂智能科技有限公司 Smart machine control method, device, computer equipment and storage medium
CN108306797A (en) * 2018-01-30 2018-07-20 百度在线网络技术(北京)有限公司 Sound control intelligent household device, method, system, terminal and storage medium
CN108062031A (en) * 2018-02-13 2018-05-22 宁夏煜隆科技有限公司 Intelligent home furnishing control method, device, system and electronic equipment
CN108717270A (en) * 2018-05-30 2018-10-30 珠海格力电器股份有限公司 Control method and device of intelligent equipment, storage medium and processor
CN109031965A (en) * 2018-07-19 2018-12-18 珠海格力电器股份有限公司 Intelligent device control method, device and computer-storable medium
CN109002022A (en) * 2018-08-16 2018-12-14 陕西卓居未来智能科技有限公司 A kind of cloud intelligent steward system and operating method based on interactive voice ability
CN109445352A (en) * 2018-12-10 2019-03-08 美的集团武汉制冷设备有限公司 Appliances equipment control method, household appliance and storage medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112783113A (en) * 2020-11-20 2021-05-11 青岛经济技术开发区海尔热水器有限公司 Household equipment control method and electronic equipment
CN113485147A (en) * 2021-08-03 2021-10-08 南京邮电大学 Intelligent home control method and system based on big data analysis
CN113485147B (en) * 2021-08-03 2022-03-25 南京邮电大学 A smart home control method and system based on big data analysis
CN113851127A (en) * 2021-09-23 2021-12-28 惠达卫浴股份有限公司 Intelligent mirror voice control system and method
CN115470956A (en) * 2022-09-29 2022-12-13 中国银行股份有限公司 Telephone banking business reservation method, device, system and medium
CN116700025A (en) * 2023-05-19 2023-09-05 青岛海尔空调器有限总公司 Method, device and smart device for controlling smart device

Also Published As

Publication number Publication date
CN111756603B (en) 2023-05-26

Similar Documents

Publication Publication Date Title
CN111756603B (en) Control method and device of intelligent home system, electronic equipment and readable medium
CN105700389B (en) Intelligent home natural language control method
CN111754997B (en) Control device and operation method thereof, and voice interaction device and operation method thereof
CN107622767B (en) Voice control method for home appliance system and home appliance control system
CN110709785B (en) Device control system
CN105493178B (en) voice server
US12095587B2 (en) Home appliance control method, server, home appliance, and storage medium
CN110618613A (en) Linkage control method and device for intelligent equipment
CN109688036A (en) Control method and device of intelligent household appliance, intelligent household appliance and storage medium
US20160378424A1 (en) Control method, controller, and recording medium
WO2014110041A1 (en) Distributed speech recognition system
CN104538030A (en) Control system and method for controlling household appliances through voice
CN115482820A (en) Device control method and apparatus, storage medium, and electronic apparatus
CN114120996A (en) Voice interaction method and device
CN112102826A (en) System and method for controlling voice equipment multi-end awakening
CN115793481A (en) Device control method, device, electronic device and storage medium
CN111211953A (en) Intelligent home cloud service system based on natural language processing and Internet of things technology
CN114822530A (en) Intelligent device control method and device, electronic device and storage medium
CN109346081A (en) Voice control method, device, equipment and storage medium
CN110620705A (en) Control terminal and control method of intelligent bathroom and electronic equipment
CN113744743B (en) Voice interaction method and device for washing machine
CN114442493A (en) Bathing scene mode automatic setting method and intelligent radar
CN118152995A (en) An interactive method and system in vertical fields based on a large language model
CN106782541A (en) A kind of Design of Home Gateway method with speech identifying function
WO2020175293A1 (en) Apparatus control system, apparatus control method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant