CN112817665A - Equipment interaction method and device and storage medium - Google Patents

Abstract

The present disclosure relates to a device interaction method and device, and a storage medium. The method includes: acquiring a current task of a first identified device; determining a target task and an execution object of the target task based on the current task; and executing a preset action so that the execution object executes the target task. The embodiments of the present disclosure can enable different execution objects to perform target tasks according to changes in the current task, thereby realizing the interaction between the wearable electronic device and different execution objects, and making the interaction mode of the wearable electronic device more flexible.

Description

Device interaction method and device, and storage medium

technical field

The present disclosure relates to the field of Internet technologies, and in particular, to a device interaction method and device, and a storage medium.

Background technique

With the development of science and technology, the Internet of Things (IoT) can realize the interconnection of devices.

Wearable electronic devices can interact with artificial intelligence & Internet of Things (AIoT) devices. However, in the process of realizing the interconnection and intercommunication of devices, the control of functions between devices and the assignment of execution tasks often require manual control by users, which is not intelligent enough.

Therefore, finding an intelligent interconnection solution between wearable electronic devices and AIoT devices has become a current research hotspot.

SUMMARY OF THE INVENTION

In order to overcome the problems existing in the related art, the present disclosure provides a device interaction method and apparatus, and a storage medium.

According to a first aspect of the embodiments of the present disclosure, a device interaction method is provided, including:

Obtain the current task of the first identified device;

Based on the current task, determine a target task and an execution object of the target task;

A preset action is executed, so that the execution object executes the target task.

In some embodiments, the performing a preset action, so that the execution object performs the target task, includes:

When the execution object is the first identified device, sending a first instruction to make the first identified device execute the target task;

When the execution object is the wearable electronic device, controlling the wearable electronic device to execute the target task;

When the execution object is the second identified device, send a second instruction, so that the second identified device executes the target task;

Wherein, both the first identified device and the execution object have at least one of the same functions for executing the target task.

In some embodiments, the obtaining the current task of the first identified device includes:

determining the first identified device based on a first predetermined rule;

The current task of the first identified device is acquired based on a second predetermined rule.

In some embodiments, the determining of the first identified device based on a first predetermined rule includes one or more of the following:

determining the first identified device based on the communication connection relationship of the wearable electronic device;

determining the first recognized device based on the visual recognition of the wearable electronic device;

The first identified device is determined based on the sound wave signal recognition of the wearable electronic device.

In some embodiments, the determining the first recognized device based on the visual recognition of the wearable electronic device includes:

Recognize based on the computer vision recognition model of the wearable electronic device, and determine the first recognized device;

or,

The first recognized device is determined based on the wearable electronic device recognizing the visual two-dimensional code.

In some embodiments, the acquiring the current task of the first identified device based on a second predetermined rule includes one or more of the following:

Receive the current task sent by the first identified device based on the communication connection established between the first identified device and the wearable electronic device through a communication protocol;

obtaining the current task of the first recognized device based on the computer vision recognition model of the wearable electronic device;

Based on the public network connecting the wearable electronic device and the first identified device, the current task sent by the first identified device to the public network is received.

In some embodiments, determining a target task and an execution object of the target task based on the current task includes:

When the target task determined according to the current task is the task with the highest priority among the tasks performed by the wearable electronic device, the wearable electronic device is controlled to execute the target task.

According to a second aspect of the embodiments of the present disclosure, a device interaction apparatus is provided, which is applied to a wearable electronic device, and the apparatus includes:

a first acquisition module, configured to acquire the current task of the first identified device;

a first determining module, configured to determine a target task and an execution object of the target task based on the current task;

An execution module, configured to execute a preset action, so that the execution object executes the target task.

In some embodiments, the execution module is further configured to send a first instruction when the execution object is the first identified device, so that the first identified device executes the target task; When the execution object is the wearable electronic device, control the wearable electronic device to execute the target task; when the execution object is the second recognized device, send a second instruction to make the second The identified device executes the target task; wherein, the first identified device and the execution object both have at least one of the same functions for executing the target task.

In some embodiments, the first obtaining module includes:

a second determining module, configured to determine the first identified device based on a first predetermined rule;

The second obtaining module is configured to obtain the current task of the first identified device based on a second predetermined rule.

In some embodiments, the second determining module is further configured as one or more of the following:

a third determining module, configured to determine the first identified device based on the communication connection relationship of the wearable electronic device;

a fourth determination module, configured to determine the first recognized device based on the visual recognition of the wearable electronic device;

The fifth determination module is configured to determine the first recognized device based on the sound wave signal recognition of the wearable electronic device.

In some embodiments, the fourth determining module is configured to perform recognition based on a computer vision recognition model of the wearable electronic device, and determine the first recognized device; or, based on the wearable electronic device Identify the visual two-dimensional code to determine the first identified device.

In some embodiments, the second obtaining module is configured to one or more of the following: based on a communication connection established between the first identified device and the wearable electronic device through a communication protocol, receive the the current task sent by the first recognized device; based on the computer vision recognition model of the wearable electronic device, obtain the current task of the first recognized device; based on connecting the wearable electronic device and the public network of the first identified device, receiving the current task sent by the first identified device to the public network.

In some embodiments, the first determining module is further configured to control the wearable electronic device when the target task determined according to the current task is the task with the highest priority among the tasks performed by the wearable electronic device. The wearable electronic device performs the target task.

According to a third aspect of the embodiments of the present disclosure, there is provided a device interaction apparatus, the device interaction apparatus at least comprising: a processor and a memory for storing executable instructions that can be executed on the processor, wherein:

When the processor is configured to run the executable instructions, the executable instructions execute the steps in the device interaction method provided in the first aspect.

According to a fourth aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, where computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, the above-mentioned The device interaction method provided in the first aspect.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

In the embodiment of the present disclosure, the wearable electronic device obtains the current task of the first recognized device, determines the target task and the execution object of the target task based on the current task, and executes a preset action, so that the execution object executes the target task. In this way, the embodiments of the present disclosure can enable different execution objects to execute target tasks according to changes in the current task, thereby realizing the interaction between the wearable electronic device and different execution objects, and making the interaction mode of the wearable electronic device more flexible and efficient. Intelligent.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

FIG. 1 is a flowchart 1 of a device interaction method according to an embodiment of the present disclosure.

FIG. 2 is a second flowchart of a device interaction method according to an embodiment of the present disclosure.

FIG. 3 is a schematic diagram of determining a first identified device according to an embodiment of the present disclosure.

FIG. 4 is a schematic diagram of determining a current task according to an embodiment of the present disclosure.

Fig. 5 is a schematic diagram of device interaction according to an exemplary embodiment.

FIG. 6 is a first diagram of a device interaction apparatus according to an exemplary embodiment.

FIG. 7 is a second diagram of a device interaction apparatus according to an exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.

FIG. 1 is a flow chart 1 of a device interaction method shown in an embodiment of the present disclosure. As shown in FIG. 1 , the method applied to a wearable electronic device includes the following steps:

S101, obtaining the current task of the first identified device;

S102, based on the current task, determine a target task and an execution object of the target task;

S103. Execute a preset action, so that the execution object executes the target task.

In the embodiments of the present disclosure, the device interaction method is applicable to an interaction scenario between a wearable electronic device and an artificial intelligence & Internet of Things (Artificial Intelligence & Internet of Thing, AIoT) device. The wearable electronic device may include a head-mounted display device, such as an AR device, a VR device, an MR device, etc.; and may also include a wearable sports device, such as a smart watch or a smart bracelet. The AIOT device includes, but is not limited to, terminal devices and smart home appliances in the Internet of Things, such as mobile phones, routers, TVs, speakers, air conditioners, or rice cookers.

The above interaction scene between the wearable electronic device and the AIOT device may include: an interaction scene between AR glasses and a TV, an interaction scene between AR glasses and a speaker, or an interaction scene between AR glasses and a mobile phone. For example, AR glasses interact with the TV to display the video screen of the TV; AR glasses interact with the speaker to play the music output by the speaker; AR glasses interact with the mobile phone to perform photography.

In step S101, the first identified device is an electronic device identified by the wearable electronic device within the identification range. The first identified device may be any electronic device among AIOT devices. For example, the first identified device may include a TV, a speaker, an air conditioner, or a mobile phone, which is not limited in this embodiment of the present disclosure. The identification range may be determined according to different first identified devices. When the first recognized device is a head-mounted display device, the recognition range may be the field of view range or field of view of the head-mounted display device; when the first recognized device is a smart bracelet or a smart watch, the recognition range The identification range may be a range delimited by a predetermined distance as a radius, and may also be an emission range of an identification sensor such as a radar sensor or a laser sensor in a smart watch or smart bracelet, which is not limited in this embodiment of the present disclosure.

It should be noted that the current task may be understood as the operation being performed by the first identified device or the current running state of the first identified device. For example, when the first identified device is a TV, the current task of the TV may include playing animations, playing videos, or playing pictures; when the first identified device is an air conditioner, the current task of the air conditioner may include heating, The wind speed adjustment or the temperature adjustment is being performed, which is not limited by the embodiment of the present disclosure.

The above-mentioned acquisition of the current task of the first identified device may be understood as firstly identifying and obtaining the first identified device, and then acquiring the current task of the first identified device. For example, the AR glasses first recognize that the first recognized device is a speaker, and then recognize that the current task of the first recognized device is to play a children's song. For another example, the AR glasses first recognize that the first recognized device is an air conditioner, and then recognize that the current task of the air conditioner is in a heating state.

In step S102, the target task is determined according to the current task. In some embodiments, the target task may be the current task, that is, the execution object is the same as the execution task of the first identified device. For example, both the speaker and AR glasses are playing a children's song. For another example, both the TV and AR glasses are playing the same video.

In other embodiments, the target task may be determined according to the current task and the corresponding relationship between the current task and the preset target task. The corresponding relationship between the current task and the preset target task is stored in the wearable electronic device in advance. On the premise of obtaining the current task, the target task can be determined by searching for the corresponding relationship between the current task and the preset target task.

Wherein, the corresponding relationship may include: when the current task is a small-screen electronic device to perform a display-related operation, the corresponding target task is to let a large-screen electronic device perform a display-related operation; when the current task is an electronic device with limited operation (for example, operating When an electronic device with an interface smaller than a preset threshold) performs various control operations, the target task is to allow an electronic device that is easy to operate (eg, an electronic device with an operation interface greater than a preset threshold) to perform various control operations.

For example, the current task of a small-screen electronic device such as a mobile phone in an AIOT device is to play a video. According to the current task and the corresponding relationship, it can be determined that the large-screen electronic device plays a video. At this time, the execution object can be a TV or a computer, and the target task can be TV or computer to play video. In this way, the user's viewing experience can be improved by transferring the target task to the large-screen electronic device. For another example, the current task of an electronic device with limited operation in the AIOT device, such as a watch, is to take pictures. According to the current task and the corresponding relationship, it can be determined that an electronic device with convenient operation is required to control taking pictures. At this time, the execution object can be a mobile phone or a tablet computer. The target task may be to perform camera control. In this way, by transferring the target task to the mobile phone or tablet to control the photographing, the photographing control can be more convenient.

In other embodiments, the target task may be an associated task of the current task, and the associated task may be a task whose execution priority is higher than that of the current task, or may be a task running in the background or a task to be executed in the task list, The embodiments of the present disclosure are not limited. For example, the current task is the task of playing a video, and the associated task may be a telephony task with a higher priority than the task of playing a video.

In this embodiment of the present disclosure, the execution object may be the first identified device or the wearable electronic device, and may also be the second identified device other than the first identified device and the wearable electronic device. The second identified device may be capable of performing the target task. For example, both the second identification device and the first identified device have screens and can play videos; or, both the second identification device and the first identified device have speakers and can play music.

It should be noted that the execution object and the target task are determined according to the current task, that is, the target task and the execution object may change following the change of the current task. For example, when the current task is to play music, the target task and the execution object can be AR glasses to play music; when the current task is to play a video on a small screen, the target task and the execution object can be a large screen of a TV to play a video. Embodiments of the present disclosure No restrictions apply.

In the embodiment of the present disclosure, when the execution objects are different, the wearable electronic device can interact with the different execution objects. For example, when the execution object is the first recognized device, the wearable electronic device can interact with the first recognized device, so that the first recognized device performs the target task. When the execution object is the second recognized device, the wearable electronic device can interact with the first recognized device and the second recognized device respectively, so that the second recognized device performs the target task. That is, the wearable electronic device can interact with different identified devices, which improves the interaction flexibility of the wearable electronic device.

In step S103, after the wearable electronic device determines the target task and the execution object, the wearable electronic device can perform a preset action, so that the execution object executes the target task.

It should be noted that the preset action is associated with the execution object, and the execution object is different, and the preset action is different. When the execution object is the first recognized device or the second recognized device, the preset action can be the wearable electronic device sending the target task to the first recognized device or the second recognized device; when the execution object is the wearable electronic device When the wearable electronic device is used, the preset action can be the wearable electronic device to directly control itself to perform the target task.

That is, the wearable electronic device can control itself to perform the target task, and can also interact with the first recognized device or the second recognized device, so that the first recognized device or the second recognized device performs the target task.

In the embodiment of the present disclosure, the wearable electronic device obtains the current task of the first recognized device, determines the target task and the execution object of the target task based on the current task, and executes a preset action so that the execution object executes the target task. In this way, the embodiments of the present disclosure can enable different execution objects to execute target tasks according to changes in the current task, thereby realizing the interaction between the wearable electronic device and different execution objects, and making the interaction mode of the wearable electronic device more flexible and efficient. Intelligent.

In some embodiments, as shown in FIG. 2 , the execution of the preset action causes the execution object to execute the target task, including:

S103a, when the execution object is the first identified device, send a first instruction, so that the first identified device executes the target task;

S103b, when the execution object is the wearable electronic device, control the wearable electronic device to execute the target task;

S103c, when the execution object is the second identified device, send a second instruction, so that the second identified device executes the target task;

Wherein, both the first identified device and the execution object have at least one of the same functions for executing the target task.

In the embodiment of the present disclosure, the execution object has the function of executing the target task, so that the execution object can execute the target task. For example, the functions possessed by the execution object include: a video, picture, and voice playback function; a call function; a cross-screen assistance function;

In step S103a, when the execution object is the first identified device, a first instruction is sent, so that the first identified device executes the target task. Among them, the first instruction carries the information related to the target task, and the target task needs to be sent to the first recognized device. At this time, the wearable electronic device is used as the master device, the first recognized device is used as the slave device, and the master device will send the target task Passed to the slave device to cause the slave device to perform the target task.

For example, the first identified device is a TV, the wearable electronic device is AR glasses, the AR glasses are recording a video, and the current task of the TV is in a display state. According to the current task, it can be determined that the TV needs to display the recorded video. At this time, the TV as the execution object displays the video that the AR glasses are recording. For another example, the first identified device may also be a mobile phone or a monitoring device with a camera, and the wearable electronic device is AR glasses. The AR glasses send the target task to the mobile phone or a monitoring device with a camera through a first instruction, so that the mobile phone or The surveillance equipment is capable of playing video.

In step S103b, when the execution object is a wearable electronic device, the wearable electronic device is controlled to execute the target task. That is, when the wearable electronic device determines that the execution object is itself, it directly controls itself to perform the target task. At this time, the wearable electronic device is a slave device, so that the slave device performs the target task.

For example, the wearable electronic device is AR glasses. When the first electronic device is a mobile phone, and the target task determined according to the current task is the need for screen projection or video call relay, the AR glasses are used as executable objects to perform screen projection operation or video call operation. When the first electronic device is a sound box, and the target task determined according to the current task is to play music, the AR glasses are used as executable objects to perform the music playback operation; When the first electronic device is a TV, the target task determined according to the current task is to play music. When transferring pictures or playing videos, the AR glasses can be used as executable objects to perform the operations of playing pictures and playing videos.

In step S103c, when the execution object is the second identified device, a second instruction is sent, so that the second identified device executes the target task. Among them, the second instruction carries the information related to the target task, and the target task needs to be sent to the second identified device. At this time, the first identified device is the master device, the second identified device is the slave device, and the wearable electronic device is The intermediate transfer device, in this embodiment of the present disclosure, transmits the target task acquired from the first recognized device to the second recognized device through the wearable electronic device, so that the second recognized device performs the target task.

For example, the wearable electronic device is AR glasses. When the first recognized device is a small-screen laptop or mobile phone, the second recognized device is a large-screen TV, and the target task determined according to the current task is a video or picture relay, the large-screen The TV performs the operation of playing videos or pictures to obtain the best viewing experience; when the first recognized device is a mobile phone, the second recognized device is a computer, and the target task determined according to the current task is cross-screen assistance, the computer performs cross-screen assistance. screen assist operation; when the first recognized device is a mobile phone, the second recognized device is a speaker, and the target task determined according to the current task is audio, voice or video telephony relay, the speaker performs audio, voice or video telephony playback; when The first recognized device is a watch or a bracelet, and the second recognized device is a mobile phone. When the target task determined according to the current task is camera control, the mobile phone performs the camera control operation; when the first recognized device is a speaker, the second recognized device is a mobile phone. The device is a TV, and when the target task determined according to the current task is audio or video relay, the TV performs audio or video playback.

In this embodiment of the present disclosure, based on different execution objects, the wearable electronic device can act as a slave device to directly execute the target task after acquiring the target task; it can also act as a master device to interact with the first recognized device and transfer the target task to The first recognized device enables the first recognized device to perform the target task; it can also be used as an intermediate transfer device to transfer the target task obtained from the first recognized device to the second recognized device, so that the second recognized device performs the target task Task. In this way, the interactive manner of the wearable electronic device can be made more flexible.

In some embodiments, the obtaining the current task of the first identified device includes:

determining the first identified device based on a first predetermined rule;

The current task of the first identified device is acquired based on a second predetermined rule.

In the embodiment of the present disclosure, the first predetermined rule is a rule for the wearable electronic device to identify the first recognized device.

In some embodiments, the determining of the first identified device based on a first predetermined rule includes one or more of the following:

determining the first identified device based on the communication connection relationship of the wearable electronic device;

determining the first recognized device based on the visual recognition of the wearable electronic device;

The first recognized device is determined based on the auditory recognition of the wearable electronic device.

In the embodiment of the present disclosure, the communication connection relationship of the wearable electronic device includes: Bluetooth communication established between the wearable electronic device and the first identified device; or, the wearable electronic device established with the first identified device. Ultra-bandwidth communication; or, near field communication between the wearable electronic device and the first identified establishment, which is not limited in this embodiment of the present disclosure.

Wherein, the wearable electronic device may have an Ultra Wide Band (Ultra Wide Band, UWB) module, and may also communicate by means of a wifi module, a Bluetooth module, a laser module, an infrared module, and a zigbee. Correspondingly, the first identified device also has the above-mentioned various types of modules, so as to establish different communication connections with the wearable electronic device to determine the first identified device.

It should be noted that, after the communication connection is established, the wearable electronic device can directly determine the first identified device through the identity information sent by the first identified device. The identity information may be a device serial number, or may be a device SN number, a device identifier, or information related to device authentication.

In the embodiment of the present disclosure, determining the first recognized device based on the auditory recognition of the wearable electronic device includes: determining the first recognized device based on a sound wave signal output by the first recognized device received by the wearable electronic device or, based on identifying the auditory two-dimensional code on the first identified device, determining the first identified device.

Wherein, the sound wave signal may include a sound wave signal that can be heard by the human ear, and a sound wave signal that cannot be heard by the human ear, such as ultrasonic waves or infrasound waves.

It should be noted that, the wearable electronic device may implement the determination of the first identified device by using a millimeter wave module, an ultrasonic module or a radar module.

In the embodiment of the present disclosure, in the process of determining the first recognized device by visual recognition, the first recognized device may be determined by image acquisition or by recognizing a two-dimensional code. In some embodiments, the determining the first recognized device based on the visual recognition of the wearable electronic device includes: performing recognition based on a computer visual recognition model of the wearable electronic device, and determining the first recognized device. The first recognized device; or, based on the wearable electronic device recognizing the visual two-dimensional code, the first recognized device is determined.

It should be noted that the wearable electronic device can obtain the device information of the first identified device through a camera, a laser sensor or a radar sensor, and input the device information into a computer vision recognition model for identification to determine the first identified device; also The first identified device can be determined by recognizing the visual two-dimensional code on the first identified device. The visual two-dimensional code is formed by the fusion of the area of the background image and the area of the two-dimensional code body. For example, the visual two-dimensional code includes, but is not limited to, a light-on-dark two-dimensional code.

In the embodiment of the present disclosure, in the process of determining the first identified device, the first identified device may be determined by adopting various determination methods. As shown in FIG. 3 , the method for determining the first identified device includes: artificial intelligence vision, artificial intelligence hearing, ultra-bandwidth, bluetooth, ultrasonic waves, or light-on-dark QR code. In this embodiment of the present disclosure, one or two or more manners for determining the first identified device may be selected to determine the first identified device.

For example, the first identified device may be jointly determined based on the relationship of the Bluetooth connection of the wearable electronic device and artificial intelligence vision. For another example, the first identified device can be jointly determined based on the relationship between the ultra-bandwidth connection of the wearable electronic device and the two-dimensional code of the light on and off. In this way, by selecting multiple identification methods to jointly determine the first identified device, the accuracy of identification can be improved.

It should be noted that, in the process of determining the first identified device, the first identified device may also be determined by formulating an identification priority. For example, when the wearable electronic device establishes a communication connection with the first identified device, the first identified device may be determined based on the communication connection relationship of the wearable electronic device; when the wearable electronic device is connected to the first identified device When the first recognized device cannot establish a communication connection, the first recognized device may be determined based on visual recognition or auditory recognition of the wearable electronic device. In this way, the embodiment of the present disclosure can preferentially use a communication connection to determine the first identified device, which can improve the identification efficiency and identification accuracy of the first identified device.

In some embodiments, the acquiring the current task of the first identified device based on a second predetermined rule includes one or more of the following:

Receive the current task sent by the first identified device based on the communication connection established between the first identified device and the wearable electronic device through a communication protocol;

obtaining the current task of the first recognized device based on the computer vision recognition model of the wearable electronic device;

Based on the public network connecting the wearable electronic device and the first identified device, the current task sent by the first identified device to the public network is received.

In the embodiment of the present disclosure, the communication protocol includes a Bluetooth communication protocol, an ultra-wideband communication protocol, or a near field communication protocol, which is not limited in the embodiment of the present disclosure. After the communication connection is established, the wearable electronic device can directly receive the current task sent by the first identified device. For example, when the wearable electronic device is a smart bracelet or a smart watch, the first identified device can be determined through the communication connection established by the ultra-wideband UWB, and the information transmitted by the first identified device through the communication connection established by the ultra-wideband UWB can be obtained. current task. When the wearable electronic device is a smart bracelet or a smart watch, the wearable electronic device may include an ultra-wideband UWB positioning module, and through the pointing operation of the wearable electronic device, the first identified device is determined, and the first identified device is obtained. The current task of an identified device communicated through the UWB communication protocol or other communication protocol.

In the process of using the computer vision recognition model to obtain the current task, the image information of the first recognized device can be collected by using the camera on the wearable electronic device, and the image information can be input into the computer vision recognition model to obtain the first image information. The current task of the identified device. The image information includes, but is not limited to, the current task that is virtually displayed by the first recognized device on the surface of the first recognized device.

In the process of obtaining the current task by using the public network, the public network can establish a communication connection with the wearable electronic device and the first identified device respectively, and the wearable electronic device according to the embodiment of the present disclosure can indirectly obtain the current task through the public network. Task.

In the embodiment of the present disclosure, in the process of determining the current task, the current task may be jointly determined by adopting multiple determination methods. As shown in Figure 4, the current task determination method includes: public network, communication connection or visual recognition model. In this embodiment of the present disclosure, one or two or more manners for determining the first identified device may be selected to determine the first identified device.

For example, the current task can be jointly determined based on the relationship of the communication connection of the wearable electronic device and the computer vision recognition model. In this way, obtaining the current task through multiple determination methods can improve the recognition accuracy.

It should be noted that, in the process of determining the current task, the current task may also be determined by setting priorities. For example, when the wearable electronic device establishes a communication connection with the first identified device, the first identified device may receive the data sent by the first identified device based on the communication connection established between the first identified device and the wearable electronic device through a communication protocol. Current task; when the wearable electronic device cannot establish a communication connection with the first identified device, the current task may be determined based on the public network connecting the wearable electronic device and the first identified device. In this way, the embodiment of the present disclosure can preferentially use a communication connection to determine the first identified device, which can improve the identification efficiency and accuracy of the current task.

In some embodiments, determining a target task and an execution object of the target task based on the current task includes:

When the target task determined according to the current task is the task with the highest priority among the tasks performed by the wearable electronic device, the wearable electronic device is controlled to execute the target task.

In this embodiment of the present disclosure, the task with the highest priority may be set as required. The tasks with the highest priority among the tasks performed by the wearable electronic device include but are not limited to a phone task, a voice task, a video task, or an alarm task, which is not limited in this embodiment of the present disclosure. For example, when it is determined that the target task is an alarm task, the wearable electronic device can be controlled to directly give an alarm prompt, which can realize timely alarm and improve user experience. For another example, when the target task is a phone task, the wearable electronic device can be controlled to directly prompt a phone call, so that the phone can be answered in time and the user experience can be improved.

It should be noted that the tasks with the highest priority that need to be performed by the wearable electronic device corresponding to different devices are different. For example, for an air conditioner or a washing machine, the corresponding task with the highest priority is an alarm prompt; for a mobile phone, the corresponding task with the highest priority is a phone call or a voice prompt.

In some embodiments, the execution object is a wearable electronic device, and when the execution object is in an executable state and the priority of the execution task of the execution object is higher than the priority of the target task, the target task is transferred to the first recognized device Or the second identified device, so that the first identified device or the second identified device performs the target task.

In the embodiment of the present disclosure, the wearable electronic device will first execute tasks with different priorities in order of priority. That is, the wearable electronic device will perform the highest priority task first.

The above execution task may be a task being processed by the wearable electronic device, for example, the wearable electronic device is communicating on the phone or giving an alarm.

In the embodiment of the present disclosure, when it is determined that the priority of the execution task is higher than the priority of the target task, the target task is transferred to the first recognized device or the second recognized device. In this way, the target task can be processed and the task executed in time, which improves the user experience.

In order to better understand the above embodiments, take the wearable electronic device as AR glasses and the first recognized device as a mobile phone as an example, the examples of the embodiments of the present disclosure are as follows:

As shown in Figure 5, a Bluetooth communication connection is established between the AR glasses and the mobile phone. After the AR glasses and the mobile phone establish a communication connection, the mobile phone can send the identity information and the current task to the AR glasses through the Bluetooth communication connection; among them, the AR glasses can determine that the recognized device is a mobile phone according to the received identity information; After the mobile phone and the current task of the mobile phone are determined, the target task and the execution object of the target task can be determined based on the current task, and a preset action is performed, so that the execution object executes the target task. In this way, the AR glasses can make different execution objects perform the target task according to the changes of the current task, so as to realize the interaction between the AR glasses and different execution objects, and make the interaction mode of the AR glasses more flexible and intelligent.

FIG. 6 is a first diagram of a device interaction apparatus according to an exemplary embodiment. 6 , the device interaction apparatus includes a first acquisition module 1001, a first determination module 1002 and an execution module 1003, wherein,

The first obtaining module 1001 is configured to obtain the current task of the first identified device;

a first determining module 1002, configured to determine a target task and an execution object of the target task based on the current task;

The execution module 1003 is configured to execute a preset action, so that the execution object executes the target task.

In some embodiments, the execution module is further configured to send a first instruction when the execution object is the first identified device, so that the first identified device executes the target task; When the execution object is the wearable electronic device, control the wearable electronic device to execute the target task; when the execution object is the second recognized device, send a second instruction to make the second The identified device executes the target task; wherein, the first identified device and the execution object both have at least one of the same functions for executing the target task.

In some embodiments, the first obtaining module includes:

a second determining module, configured to determine the first identified device based on a first predetermined rule;

The second obtaining module is configured to obtain the current task of the first identified device based on a second predetermined rule.

In some embodiments, the second determining module is further configured as one or more of the following:

a third determining module, configured to determine the first identified device based on the communication connection relationship of the wearable electronic device;

a fourth determination module, configured to determine the first recognized device based on the visual recognition of the wearable electronic device;

The fifth determination module is configured to determine the first recognized device based on the sound wave signal recognition of the wearable electronic device.

In some embodiments, the fourth determining module is configured to perform recognition based on a computer vision recognition model of the wearable electronic device, and determine the first recognized device; or, based on the wearable electronic device Identify the visual two-dimensional code to determine the first identified device.

In some embodiments, the second obtaining module is configured to one or more of the following: based on a communication connection established between the first identified device and the wearable electronic device through a communication protocol, receive the the current task sent by the first recognized device; based on the computer vision recognition model of the wearable electronic device, obtain the current task of the first recognized device; based on connecting the wearable electronic device and the public network of the first identified device, receiving the current task sent by the first identified device to the public network.

In some embodiments, the first determining module is further configured to control the wearable electronic device when the target task determined according to the current task is the task with the highest priority among the tasks performed by the wearable electronic device. The wearable electronic device performs the target task.

Regarding the apparatus in the above-mentioned embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be described in detail here.

FIG. 7 is a second diagram of a device interaction apparatus according to an exemplary embodiment. For example, the apparatus may be a wearable electronic device, and the wearable electronic device includes: a smartphone, a smart bracelet, or AR glasses.

7, the apparatus may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and Communication component 816.

The processing component 802 generally controls the overall operation of the device, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

Memory 804 is configured to store various types of data to support operation of the device. Examples of such data include instructions for any application or method operating on the device, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power components 806 provide power to various components of the device. Power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to devices.

Multimedia component 808 includes screens that provide an output interface between the device and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the device is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and/or the rear-facing camera can receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

Audio component 810 is configured to output and/or input audio signals. For example, audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when the device is in operating modes, such as calling mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 804 or transmitted via communication component 816 . In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of the device. For example, the sensor assembly 814 can detect the on/off status of the device, the relative positioning of the components, such as the display and keypad of the device, the sensor assembly 814 can also detect the position change of the device or a component of the device, the user and the device Presence or absence of contact, device orientation or acceleration/deceleration and temperature changes of the device. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the apparatus and other devices. The device may access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, an apparatus may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gates An array (FPGA), controller, microcontroller, microprocessor, or other electronic component implementation for performing the above method.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as a memory 804 including instructions, executable by the processor 820 of the apparatus to perform the method described above. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a wearable electronic device, enabling the wearable electronic device to execute a device interaction method, the method comprising:

Obtain the current task of the first identified device;

Based on the current task, determine a target task and an execution object of the target task;

A preset action is executed, so that the execution object executes the target task.

Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or conventional techniques in the art not disclosed by this disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

It should be understood that the present invention is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from its scope. The scope of the present invention is limited only by the appended claims.

Claims (16)

1. A device interaction method is applied to a wearable electronic device, and comprises the following steps:

acquiring a current task of a first identified device;

determining a target task and an execution object of the target task based on the current task;

and executing a preset action to enable the execution object to execute the target task.

2. The method of claim 1, wherein the performing the preset action such that the execution object performs the target task comprises:

when the execution object is the first identified device, sending a first instruction to enable the first identified device to execute the target task;

when the execution object is the wearable electronic device, controlling the wearable electronic device to execute the target task;

when the execution object is a second identified device, sending a second instruction to enable the second identified device to execute the target task;

wherein the first identified device and the execution object both have at least one same function of executing the target task.

3. The method of claim 1 or 2, wherein the obtaining a current task of the first identified device comprises:

determining the first identified device based on a first predetermined rule;

based on a second predetermined rule, the current task of the first identified device is obtained.

4. The method of claim 3, wherein determining the first identified device based on a first predetermined rule comprises one or more of:

determining the first identified device based on a relationship of communication connections of the wearable electronic device;

determining the first identified device based on visual recognition of the wearable electronic device;

determining the first identified device based on auditory recognition of the wearable electronic device.

5. The method according to claim 4, wherein the determining the first identified device based on the visual identification of the wearable electronic device comprises:

identifying based on a computer vision identification model of the wearable electronic device, and determining the first identified device;

or,

and identifying the visual two-dimensional code based on the wearable electronic equipment, and determining the first identified equipment.

6. The method of claim 4, wherein the obtaining the current task of the first identified device based on a second predetermined rule comprises one or more of:

receiving the current task sent by the first identified device based on a communication connection established between the first identified device and the wearable electronic device through a communication protocol;

acquiring the current task of the first identified device based on a computer vision recognition model of the wearable electronic device;

receiving the current task sent by the first identified device to the public network based on the public network connecting the wearable electronic device and the first identified device.

7. The method of claim 1 or 2, wherein determining a target task and an execution object of the target task based on the current task comprises:

and when the target task determined according to the current task is a task with the highest priority in the tasks executed by the wearable electronic device, controlling the wearable electronic device to execute the target task.

8. A device interaction apparatus applied to a wearable electronic device, the apparatus comprising:

the first acquisition module is configured to acquire a current task of the first identified device;

a first determination module configured to determine a target task and an execution object of the target task based on the current task;

and the execution module is configured to execute a preset action so that the execution object executes the target task.

9. The apparatus of claim 8, wherein the execution module is further configured to send a first instruction to cause the first identified device to perform the target task when the execution object is the first identified device; when the execution object is the wearable electronic device, controlling the wearable electronic device to execute the target task; when the execution object is a second identified device, sending a second instruction to enable the second identified device to execute the target task; wherein the first identified device and the execution object both have at least one same function of executing the target task.

10. The apparatus of claim 8 or 9, wherein the first obtaining module comprises:

a second determination module configured to determine the first identified device based on a first predetermined rule;

a second obtaining module configured to obtain the current task of the first identified device based on a second predetermined rule.

11. The apparatus of claim 10, wherein the second determining module is further configured to one or more of:

a third determination module configured to determine the first identified device based on a relationship of a communication connection of the wearable electronic device;

a fourth determination module configured to determine the first identified device based on visual recognition of the wearable electronic device;

a fifth determination module configured to determine the first identified device based on a sound wave signal identification of the wearable electronic device.

12. The apparatus according to claim 11, wherein the fourth determining module is configured to determine the first recognized device based on recognition by a computer vision recognition model of the wearable electronic device; or, the first identified device is determined based on the wearable electronic device recognizing the visual two-dimensional code.

13. The apparatus of claim 10, wherein the second obtaining module is configured to one or more of: receiving the current task sent by the first identified device based on a communication connection established between the first identified device and the wearable electronic device through a communication protocol; acquiring the current task of the first identified device based on a computer vision recognition model of the wearable electronic device; receiving the current task sent by the first identified device to the public network based on the public network connecting the wearable electronic device and the first identified device.

14. The apparatus according to claim 8 or 9, wherein the first determining module is further configured to control the wearable electronic device to execute the target task when the target task determined according to the current task is a task with a highest priority in task execution of the wearable electronic device.

15. An apparatus for device interaction, the apparatus comprising at least: a processor and a memory for storing executable instructions operable on the processor, wherein:

the processor is configured to execute the executable instructions, and the executable instructions perform the steps of the device interaction method provided in any one of the preceding claims 1 to 7.

16. A non-transitory computer-readable storage medium having stored therein computer-executable instructions that, when executed by a processor, implement the device interaction method provided in any one of claims 1 to 7.

Images