[go: up one dir, main page]

WO2022030860A1 - Dispositif électronique pour la commande d'un dispositif électronique cible dans un environnement ido et procédé correspondant - Google Patents

Dispositif électronique pour la commande d'un dispositif électronique cible dans un environnement ido et procédé correspondant Download PDF

Info

Publication number
WO2022030860A1
WO2022030860A1 PCT/KR2021/009762 KR2021009762W WO2022030860A1 WO 2022030860 A1 WO2022030860 A1 WO 2022030860A1 KR 2021009762 W KR2021009762 W KR 2021009762W WO 2022030860 A1 WO2022030860 A1 WO 2022030860A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
target electronic
target
found
iot server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2021/009762
Other languages
English (en)
Korean (ko)
Inventor
이강수
송기섭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of WO2022030860A1 publication Critical patent/WO2022030860A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00—IoT characterised by the purpose of the information processing
    • G16Y40/30—Control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/75—Indicating network or usage conditions on the user display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W8/00—Network data management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W8/00—Network data management
    • H04W8/005—Discovery of network devices, e.g. terminals
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/90—Additional features
    • G08C2201/92—Universal remote control

Definitions

  • Various embodiments disclosed in this document relate to a technology for registering and controlling a target electronic device in an Internet of things (IoT) environment.
  • IoT Internet of things
  • IoT In the IoT environment, intelligent services that create new values in human life by collecting and analyzing data generated from connected objects can be provided.
  • IoT is a smart home, smart building, smart city, smart car or connected car, smart grid, health care, smart home appliance, or advanced medical service field through convergence and compounding between existing IT (information technology) technology and various industries. can be applied
  • a target electronic device (or may be referred to as a 'target device') included in the IoT environment may be controlled in various ways.
  • an infrared (IR) device such as an artificial intelligence (AI) speaker may control the target electronic device by transmitting an IR signal to the target electronic device.
  • the function of controlling the target electronic device through the IR device may be referred to as an 'IR control function'.
  • an IoT server or a cloud server managing the target electronic device may control the target electronic device by directly transmitting a command signal to the target electronic device.
  • the function of controlling the target electronic device through the IoT server may be referred to as a 'cloud control function'.
  • the IoT server may allocate a virtual ID (identifier) to a target electronic device registered in the IoT server.
  • the target electronic device may be registered in the IoT server as an IR controlee device that can be controlled by the IR control function or registered in the IoT server as a cloud controlee device that can be controlled by the cloud control function. Therefore, even if the same target electronic device, the IoT server may generate different IDs depending on the type of control function. When different IDs are generated in the same target electronic device, the IoT server may not recognize the corresponding target electronic device as the same device.
  • the IR signal may not receive a feedback signal from the target electronic device due to the nature of the protocol, and in the absence of the IR signal, a situation may occur in which the target electronic device cannot be controlled.
  • An electronic device includes at least one communication circuit, a display, a processor operatively connected to the at least one communication circuit and the display, and a memory operatively connected to the processor.
  • the processor receives a first user input requesting registration of an IR (infrared) controlled device
  • the IR controlled device means a device controlled by the IR device
  • a device that searches for a target electronic device using the at least one communication circuit identifies that the found target electronic device is a cloud control target device
  • the cloud control target device is controlled by an IoT server and may store instructions for outputting a first user interface (UI) indicating that the found target electronic device is the cloud control target device through the display.
  • UI user interface
  • the server included in the IoT environment includes a communication interface configured to communicate with an electronic device, a processor operatively connected to the communication interface, and a memory operatively connected to the processor,
  • the memory stores a database for a target electronic device registered as a cloud control target device in the server, and the processor performs a first request to register a target electronic device found by the electronic device as an IR control target device.
  • a registration request message is received from the electronic device, and the first registration request message includes information on at least one of a device type, a manufacturer, a model name, and a unique identifier (UID) of the searched target electronic device, and the first registration Based on the information included in the request message and the database stored in the memory, it is identified that the found target electronic device is a cloud control target device, and a first response message indicating that the found target electronic device is the cloud control target device is generated. It may be set to be transmitted to the electronic device.
  • UID unique identifier
  • the method of the electronic device includes the operation of receiving a first user input requesting registration of an IR control target device, the IR control target device means a device controlled by the IR device, An operation of searching for a target electronic device, an operation of identifying that the found target electronic device is a cloud control target device, the cloud control target device means a device controlled by an IoT server, and the searched target electronic device is the cloud control target device It may include outputting a first user interface indicating that it is a device.
  • the electronic device may guide the user to register the target electronic device, which the user wants to register as the IR control target device, as the cloud control target device.
  • the electronic device may recognize a device registered as an IR control target device and a device registered as a cloud control target device as the same device.
  • the electronic device may compensate for the shortcomings of the IR control function through the cloud control function.
  • FIG. 1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure
  • FIG 2 illustrates an IoT system according to various embodiments.
  • FIG. 3 illustrates an IoT system for controlling a target electronic device according to various embodiments.
  • FIG. 4 is a flowchart illustrating an operation of an electronic device for guiding registration of a target electronic device according to various embodiments of the present disclosure
  • FIG. 5 illustrates a user interface for guiding registration of a target electronic device according to various embodiments of the present disclosure
  • FIG. 6 is a flowchart illustrating an operation of an electronic device for registering a target electronic device according to various embodiments of the present disclosure
  • FIG. 7 is a signal flow diagram for identifying whether a target electronic device supports a cloud function, according to various embodiments of the present disclosure
  • FIG. 8 is a flowchart illustrating an operation of an electronic device for identifying whether a target electronic device is a control target device according to various embodiments of the present disclosure
  • FIG. 9 is a signal flow diagram for identifying whether a target electronic device is a control target device according to various embodiments of the present disclosure.
  • FIG. 10 is a signal flow diagram for registering a target electronic device as an IR control target device according to various embodiments of the present disclosure
  • FIG. 11 illustrates another example of a user interface for guiding registration of a target electronic device according to various embodiments of the present disclosure
  • FIG. 12 illustrates a user interface for controlling a target electronic device according to various embodiments of the present disclosure
  • FIG. 13 is a block diagram and a flowchart for controlling a target electronic device according to various embodiments of the present disclosure
  • FIG. 14 illustrates a signal flow diagram for processing a channel change command in accordance with various embodiments.
  • 15 is a flowchart illustrating an operation of an IoT server for processing a channel change command according to various embodiments of the present disclosure
  • FIG. 1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • a second network 199 e.g., a second network 199
  • the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178
  • may be omitted or one or more other components may be added to the electronic device 101 .
  • some of these components are integrated into one component (eg, display module 160 ). can be
  • the processor 120 for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • software eg, a program 140
  • the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 .
  • the volatile memory 132 may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor).
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123
  • the auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the co-processor 123 eg, an image signal processor or a communication processor
  • may be implemented as part of another functionally related component eg, the camera module 180 or the communication module 190. have.
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example.
  • the artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.
  • the memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ).
  • the data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto.
  • the memory 130 may include a volatile memory 132 or a non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 .
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output a sound signal to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • the receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.
  • the display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 .
  • the display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device.
  • the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.
  • the audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • an external electronic device eg, a sound output module 155
  • a sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card
  • the connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module).
  • GNSS global navigation satellite system
  • a corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a first network 198 eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)
  • a second network 199 eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a telecommunication network
  • the wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 .
  • the electronic device 101 may be identified or authenticated.
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR).
  • NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low-latency
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • a high frequency band eg, mmWave band
  • the wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna.
  • the wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ).
  • the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).
  • a peak data rate eg, 20 Gbps or more
  • loss coverage eg, 164 dB or less
  • U-plane latency for realizing URLLC
  • the antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern.
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC)
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • GPIO general purpose input and output
  • SPI serial peripheral interface
  • MIPI mobile industry processor interface
  • the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 may perform the function or service itself instead of executing the function or service itself.
  • one or more external electronic devices may be requested to perform at least a part of the function or the service.
  • One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 .
  • the electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an Internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks.
  • the external electronic device 104 or the server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • FIG. 2 shows an IoT system 200 . At least some of the components of FIG. 2 may be omitted, and components not shown may be further included.
  • the IoT system 200 includes a plurality of data networks 216 or 246 (eg, the first network 198 or the second network 199 of FIG. 1 ) connectable. including electronic devices.
  • the IoT system 200 includes a first IoT server 210 (eg, the server 108 of FIG. 1 ), a first node 220 , a voice assistance server 230 , It may include at least one of the second IoT server 240 (eg, the server 108 of FIG. 1 ), the second node 250 , or the devices 221,222,223,224,225,236,237,251,252,253.
  • the first IoT server 210 includes a communication interface 211 (eg, the interface 177 or communication module 190 of FIG. 1 ), a processor 212 (eg, the processor of FIG. 1 ) 120), or the storage unit 213 (eg, the memory 130 of FIG. 1).
  • the second IoT server 240 is a communication interface 241 (eg, the interface 177 or communication module 190 of FIG. 1 ), a processor 242 (eg, the processor 120 of FIG. 1 ), or storage It may include at least one of the units 243 (eg, the memory 130 of FIG. 1 ).
  • the voice assistant server 230 includes a communication interface 231 (eg, interface 177 or communication module 190 of FIG.
  • IoT server in this document, for example, based on a data network (eg, data network 216 or data network 246), a relay device (eg, the first node 220 or the second node ( 250)), or directly without a relay device, remotely control and/or monitor one or more devices (eg, devices 221,222,223,224,225,251,252,253).
  • a “device” herein means a sensor, home appliance, office electronic device, or A device for performing a process, the type is not limited.
  • a device that receives the control command and performs an operation corresponding to the control command may be referred to as a “target device” or a “target electronic device”.
  • the IoT server may be referred to as a central server in that it selects a target device from among a plurality of devices and provides a control command.
  • the first IoT server 210 may communicate with the devices 221 , 222 , and 223 through the data network 216 .
  • the data network 216 may refer to a network for long-distance communication, such as, for example, the Internet or a computer network (eg, LAN or WAN), or may include a cellular network.
  • the first IoT server 210 may be connected to the data network 216 through the communication interface 211 .
  • the communication interface 211 may include a communication device (or a communication module) for supporting communication of the data network 216 , and may be integrated into one component (eg, a single chip), or may include a plurality of separate components. It can be implemented with components (eg, a plurality of chips).
  • the first IoT server 210 may communicate with the devices 221 , 222 , and 223 through the first node 220 .
  • the first node 220 may receive data from the first IoT server 210 through the data network 216 and transmit the received data to at least some of the devices 221 , 222 , and 223 .
  • the first node 220 may receive data from at least some of the devices 221 , 222 , and 223 , and transmit the received data to the first IoT server 210 through the data network 216 .
  • the first node 220 may serve as a bridge between the data network 216 and the devices 221 , 222 , 223 .
  • the first node 220 is illustrated as one, but this is merely exemplary, and the number is not limited.
  • a “node” in this document may be an edge computing system, or may be a hub device.
  • the first node 220 may support wired and/or wireless communication of the data network 216 , and may also support wired and/or wireless communication with the devices 221 , 222 , and 223 .
  • the first node 220 is a short-range communication network such as at least one of Bluetooth, Wi-Fi, Wi-Fi direct, Z-wave, Zig-bee, Insteon, X10, or IrDA (infrared data association). Although it can be connected to the devices 221 , 222 , and 223 through the communication type, there is no limitation.
  • the first node 220 may be located (or located) within an environment, such as, for example, a home, an office, a factory, a building, an off-site branch, or other type of premises. Accordingly, the devices 221 , 222 , and 223 may be monitored and/or controlled by the service provided by the first IoT server 210 , and the devices 221 , 222 , and 223 may directly connect to the first IoT server 210 . It may not be required to have the capability of full network communication (eg Internet communication) for Devices 221 , 222 , 223 are shown as implemented as electronic devices within a home environment, such as, for example, light switches, proximity sensors, or temperature sensors, although this is illustrative and not restrictive.
  • full network communication eg Internet communication
  • the first IoT server 210 may support direct communication with the devices 224 and 225 .
  • direct communication may refer to communication not through a relay device such as the first node 220, for example, communication through a cellular communication network and/or a data network.
  • the first IoT server 210 may transmit a control command to at least some of the devices 221 , 222 , 223 , 224 and 225 .
  • the "control command” may mean data that causes a controllable device to perform a specified operation, and the specified operation is an operation performed by the device, including output of information, sensing of information, reporting of information, Alternatively, it may include management (eg, deletion, or creation) of information, and there is no limitation on the type.
  • the processor 212 generates a control command from an external (eg, at least some of the voice assistant server 230 , the second IoT server 240 , the external system 260 , or the devices 221 , 222 223 , 224 , 225 ). It is possible to obtain information (or a request) to perform the operation, and generate a control command based on the obtained information. Alternatively, the processor 212 may generate a control command based on a result of monitoring at least some of the devices 221 , 222 , 223 , 224 and 225 satisfying a specified condition. The processor 212 may control the communication interface 211 to transmit a control command to the target device.
  • an external eg, at least some of the voice assistant server 230 , the second IoT server 240 , the external system 260 , or the devices 221 , 222 223 , 224 , 225 . It is possible to obtain information (or a request) to perform the operation, and generate a control command based on the
  • the processor 212 , the processor 232 , or the processor 242 is a central processing unit (CPU), a digital signal processor (DSP), an application processor (AP), a communication processor (CP), or the like. It may be implemented as a combination of one or more of a general-purpose processor, a graphic processing unit (GPU), a graphics-only processor such as a vision processing unit (VPU), or an artificial intelligence-only processor such as a neural processing unit (NPU).
  • a general-purpose processor a graphic processing unit (GPU), a graphics-only processor such as a vision processing unit (VPU), or an artificial intelligence-only processor such as a neural processing unit (NPU).
  • GPU graphic processing unit
  • VPU vision processing unit
  • NPU neural processing unit
  • the processor 212 executes instructions stored in the memory 213 and is not limited as long as it is an arithmetic means capable of outputting the executed result.
  • the processor 212 may configure a web-based interface based on the API 214 or expose a resource managed by the first IoT server 210 to the outside. .
  • the web-based interface may support communication between the first IoT server 210 and an external web service, for example.
  • the processor 212 may, for example, allow an external system 260 to control and/or access the devices 221 , 222 , 223 .
  • External system 260 may be, for example, an independent system that is not associated with, or is not part of, system 200 .
  • the external system 260 may be, for example, an external server or a web site.
  • the processor 212 may expose an API endpoint (eg, a universal resource locator (URL)) based on the API 214 to the outside.
  • the first IoT server 210 may transmit a control command to a target device among the devices 221 , 222 , and 223 .
  • the description of the communication interface 241, the processor 242, and/or the storage unit 243 (eg, the API 244, and/or the database 245) of the second IoT server 240 Substantially the same as the description of the communication interface 211 , the processor 212 , and/or the storage 213 (eg, the API 214 , and/or the database 215 ) of the first IoT server 210 . can do.
  • the description of the second node 250 may be substantially the same as the description of the first node 220 .
  • the second IoT server 240 may transmit a control command to a target device among the devices 251,252 and 253 .
  • the first IoT server 210 and the second IoT server 240 may be operated by the same service provider in one embodiment, but may be operated by different service providers in another embodiment.
  • the voice assistant server 230 may transmit/receive data to and from the first IoT server 210 through the data network 216 .
  • the communication interface 231 communicates with the smart phone 236 (eg, the electronic device 101 of FIG. 1 ) or the AI speaker 237 through a data network (not shown) and/or a cellular network (not shown). can be done
  • the smart phone 236 or the AI speaker 237 may include a microphone, obtain a user voice, convert it into a voice signal, and transmit the voice signal to the voice assistant server 230 .
  • the processor 232 may receive a voice signal from the smart phone 236 or the AI speaker 237 through the communication interface 231 .
  • the processor 232 may process the received voice signal based on the stored model 234 .
  • the processor 232 may generate (or confirm) a control command using the processing result based on information stored in the database 235 .
  • the storage units 213 , 233 , and 243 may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory, etc.), RAM (random access memory), SRAM (static random access memory), ROM (read-only memory), EEPROM (electrically erasable programmable read-only memory), PROM (programmable read-only) memory), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of non-transitory storage medium, and the type is not limited.
  • a 'target electronic device' may include various electronic devices (eg, home appliances) that can be controlled in an IoT environment.
  • the IoT server 310 , the voice assistant server 320 , the electronic device 330 , and the AI speaker 340 are the first IoT server 210 (or the second IoT server) of FIG. 2 , respectively. 240)), the voice assistant server 230, the smart phone 236, and the AI speaker 237 may include the same or similar configuration, and may perform the same or similar functions as these.
  • the AI speaker 340 is an example of an IR device, and the IR device capable of transmitting an IR signal is not limited to the AI speaker 340 .
  • the memory of the IoT server 310 stores an account database (DB) 312 , a device DB 314 , and a program DB 316 .
  • the account DB 312 may include account information corresponding to at least one or more users using the IoT environment or account information corresponding to a user group.
  • the user account of the electronic device 330 and the user account of the AI speaker 340 included in the account DB 312 may be the same.
  • the device DB 314 may include information on at least one target electronic device (eg, the target electronic device 350 ) corresponding to the user account.
  • the device DB 314 may include a device type (eg, a TV, a refrigerator, a washing machine, a light, an air conditioner, or a fan) of the at least one target electronic device, and an area (eg, a living room) in which the at least one target electronic device is located. , room, bathroom, kitchen, or hallway), a manufacturer or brand of at least one target electronic device, a model name of at least one target electronic device, at least one target electronic device unique identifier (UID) and/or at least one may include at least one of information on a control function (eg, an IR control function or a cloud control function) supported by the target electronic device.
  • the program DB 316 may include information on content (or a broadcast program) output from the target electronic device 350 such as a TV.
  • the program DB 316 may include channel information, channel use history information, or a channel schedule.
  • the IoT server 310 may acquire a user command for controlling the target electronic device 350 based on various methods.
  • the IoT server 310 may obtain a user command through a user's voice input.
  • the AI speaker 340 may obtain a voice input from the user.
  • the AI speaker 340 may transmit the acquired voice input to the voice assistant server 320 .
  • 3 illustrates an example of acquiring a user's voice input through the AI speaker 340, although not shown, according to another embodiment, the electronic device 330 acquires a voice input and transmits the acquired voice input to a voice assistant server It can be transmitted to (320).
  • the voice assistant server 320 may analyze the user command corresponding to the voice input and transmit the analyzed user command to the IoT server 310 in operation 303 .
  • the IoT server 310 may obtain a user command through the user interface 304 provided by the electronic device 330 .
  • the electronic device 330 receives a user input for controlling the target electronic device 350 through the user interface 304 , and in operation 305 , transmits information corresponding to the received user input to the IoT server 310 . can be sent to
  • the IoT server 310 may control the target electronic device 350 based on various methods.
  • the control function for controlling the target electronic device 350 may include a cloud control function and an IR control function.
  • the IR control function allows an IR device such as the AI speaker 340 (eg, a device supporting an IR function or an IR protocol) to transmit an IR signal (or a signal based on the IR protocol) to the target electronic device 350 to target the target electronic device 350 . It may be referred to as a function of controlling the electronic device 350 .
  • the IoT server 310 may transmit a command signal corresponding to the user command to the AI speaker 340 .
  • the AI speaker 340 may transmit an IR signal corresponding to the received command signal to the target electronic device 350 .
  • the cloud control function may be referred to as a function in which the IoT server 309 directly transmits a control command signal to the target electronic device 350 to control the target electronic device 350 .
  • the IoT server 310 may directly transmit a command signal corresponding to a user command to the target electronic device 310 .
  • the cloud control function may be based, for example, on an open connectivity foundation (OCF) standard or based on a message queuing telemetry transfer (MQTT) protocol.
  • the electronic device 330 may obtain information on the device type (eg, TV), manufacturer (or brand), and/or model name of the IR control target device that the user wants to register through a user input.
  • the electronic device 330 may control the AI speaker 340 to transmit an IR signal including a specified command (eg, change channel) using a protocol based on the selected device type, manufacturer, and/or model name.
  • the electronic device 330 may request the AI speaker 340 to transmit an IR signal including a specified command through the IoT server 310 .
  • the electronic device 330 may use the AI speaker 340 through a short-range communication network (eg, the first network 198 of FIG.
  • the AI speaker 340 may receive a protocol based on the device type, manufacturer (or brand) and/or model name of the IR control target device from the IoT server 310 .
  • the target electronic device 350 may perform a specified command included in the IR signal received from the AI speaker 340 .
  • the user of the electronic device 330 may visually confirm that the target electronic device 350 normally performs the specified command.
  • the electronic device 330 may obtain a user input corresponding to a user's confirmation and request the IoT server 310 to register the target electronic device 350 .
  • the IoT server 310 allocates an identifier (ID) to the target electronic device 350 , and controls the target electronic device 350 based on the ID of the AI speaker 340 and the ID of the target electronic device 350 . can do.
  • ID identifier
  • the electronic device 330 does not use an IR signal through the AI speaker 340 but through data exchange with the IoT server 310 , the target electronic device 350 ) can be registered as a cloud control target device.
  • the electronic device 330 searches for the target electronic device 350 through the cloud control application or service, and sets the target electronic device 350 to the IoT server based on the account of the electronic device 330 or the user's account. 310) as a cloud control target device.
  • the target electronic device 350 Since the method of registering the cloud control target device and the IR control target device are different from each other, when the user wants to register the target electronic device 350 as the IR control target device, the target electronic device 350 performs the cloud control function. Even if it can support or is already registered in the IoT server 310 as a cloud control target device, the IoT server 310 performs the ID of the target electronic device 350 according to the cloud control function and the target electronic device 350 according to the IR control function. ) can be created differently. If the ID of the target electronic device 350 is generated differently, the IoT server 310 may not recognize the target electronic device 350 as a single device. In addition, since the target electronic device 350 cannot transmit a feedback signal for the IR signal due to the characteristics of the IR protocol, the electronic device 330 or the user of the electronic device 330 checks whether the target electronic device 350 operates normally. It may not be easy.
  • the electronic device 330 sets the target electronic device 350 to the cloud control target device. , or if it has already been registered in the IoT server 310 as a cloud control target device, it may guide the target electronic device 350 to be controlled as a cloud control target device.
  • the IoT server 310 controls the target electronic device 350 based on information stored in the device DB 314 and the program DB 316 , and an error occurs or additional information is required. In this case, feedback may be provided to the electronic device 330 .
  • the IoT server 310 performs the AI speaker 340 and/or the electronic device Feedback may be provided at 330 .
  • 4 to 5 describe an operation for guiding registration of a target electronic device according to various embodiments of the present disclosure.
  • 4 is a flowchart illustrating an operation of an electronic device for guiding registration of a target electronic device.
  • 5 illustrates a user interface for guiding registration of a target electronic device.
  • the operations illustrated in FIG. 4 may be performed by the electronic device 330 of FIG. 3 or by at least one component included in the electronic device 330 of FIG. 3 .
  • the processor of the electronic device eg, the processor 120 of FIG. 1
  • the electronic device may receive a first user input requesting registration of an IR control target device (eg, user input 511 of FIG. 5 ).
  • the electronic device receives a user input for requesting addition of an IR-controlled device on the first screen 501 output through a display (eg, at least a part of the display module 160 of FIG. 1 ).
  • (511) can be received.
  • the user executes an application for IR control in the electronic device and performs a device addition function to register at least a target electronic device (eg, the target electronic device 350 of FIG. 3 ) as an IR control target device.
  • action can be performed for
  • the application for IR control may be an application related to an external electronic device that generates an IR control signal (eg, the AI speaker 340 of FIG. 3 ).
  • the first user input may include an input multiple times.
  • the electronic device receives a user input for selecting at least one of the device type, manufacturer (or brand) and/or model name of the device the user wants to register. can be obtained additionally.
  • the electronic device displays a first list 512 indicating a plurality of device types on the second screen 502 , and one device type (eg: A user input 513 for selecting TV) may be received.
  • the electronic device displays a second list 514 indicating a plurality of brands corresponding to the selected device type on the third screen 503 , and in the second list 514 , one brand (eg, brand 1 ( A user input 515 for selecting Brand 1)) may be received.
  • the electronic device displays a screen including at least one model name based on a brand (eg, Brand 1) corresponding to the user input 515 , and one model name may receive an input from a user who selects .
  • the electronic device searches for a target electronic device (eg, the target electronic device 350 of FIG. 3 ) in response to the first user input.
  • the electronic device may search for a target electronic device corresponding to the device type and brand selected by the user inputs 513 and 515 .
  • the electronic device may search for a target electronic device based on a short-range communication protocol other than IR communication.
  • the short-range communication protocol may include, for example, a Bluetooth communication protocol.
  • the electronic device may identify that the found target electronic device is a cloud control target device. For example, the electronic device transmits registration information (eg, device type, manufacturer, and/or model name) of the found target electronic device to the IoT server (eg, the IoT server 310 of FIG. 3 ), and the searched target electronic device Information indicating whether the device is a cloud control target device may be received from the IoT server.
  • registration information eg, device type, manufacturer, and/or model name
  • the electronic device may output a first UI indicating that the found target electronic device is a cloud control target device.
  • the electronic device may output the first UI 516 on the fourth screen 504 .
  • the first UI 516 may include information notifying that the target electronic device selected to request registration of the IR control target device is an electronic device capable of operating as the cloud control target device.
  • the first UI 516 may include information on whether to register the selected target electronic device as an IR control target device or as a cloud control target device to request registration of the IR control target device. have.
  • the first UI 516 may display that the target electronic device selected to request registration of the IR control target device is registered as the cloud control target device.
  • the electronic device searches for a device selected by the device type, manufacturer (or brand), and/or model name by the user
  • the electronic device may be determined by the device type, manufacturer (or brand). ) and a model name, after searching for at least one target electronic device through a plurality of communication protocols, one target electronic device may be selected from among the at least one searched target electronic device according to a user input.
  • the electronic device After receiving the user input 511 requesting addition of the IR control target device, the electronic device obtains information on at least one target electronic device from the at least one target electronic device through a short-range communication protocol, Device types, manufacturers, and/or model names of at least one target electronic device may be identified based on the obtained information.
  • the electronic device activates at least one communication module (eg, the communication module 180 of FIG. 1 ) in response to receiving the user input 511 and searches for at least one target electronic device
  • a signal eg, a beacon signal
  • a response signal may be received from at least one target electronic device.
  • the electronic device outputs a list (eg, the first list 512 or the second list 514 ) indicating the device type and/or manufacturer of at least one target electronic device through the display, and selects one device from the output list.
  • User inputs 513 and 515 for selecting a type and/or brand may be received.
  • the electronic device may identify whether the target electronic device selected by the user input is a cloud control target device.
  • the electronic device transmits registration information (eg, at least one of device type, manufacturer, model name, and/or UID) of the target electronic device selected based on user inputs 513 and 515 to the IoT server (eg, IoT of FIG. 3 )
  • the information may be transmitted to the server 310 ) and information indicating whether the selected target electronic device is a cloud control target device may be received from the IoT server.
  • FIG. 6 is a flowchart illustrating an operation of an electronic device for registering a target electronic device according to various embodiments of the present disclosure; The operations illustrated in FIG. 6 may be performed by the electronic device 330 of FIG. 3 or by at least one component included in the electronic device 330 of FIG. 3 . The operations illustrated in FIG. 6 may be performed after operation 420 of FIG. 4 .
  • the electronic device may identify the device type of the found target electronic device (eg, the target electronic device 350 of FIG. 3 ).
  • information indicating the device type of the target electronic device may be obtained while the electronic device searches for the target electronic device.
  • the electronic device may receive a data packet indicating the device type of the target electronic device from the target electronic device.
  • the electronic device may acquire the device type of the target electronic device based on a user input for selecting the device type of the target electronic device (eg, user inputs 513 and 515 of FIG. 5 ).
  • the electronic device may perform subsequent operations only with respect to the target electronic device indicating the same device type as the device type (eg, TV) selected by the user.
  • the electronic device may identify whether the device to be registered by the user and the target electronic device found by the electronic device are the same by determining that the found target electronic device is a control target device.
  • An example for determining that the found target electronic device is a control target device will be described later with reference to FIGS. 8 to 9 .
  • the electronic device may receive information indicating that the found target electronic device is a device supporting a cloud control function from an IoT server (eg, the IoT server 310 of FIG. 3 ). For example, the electronic device transmits registration information (eg, at least one of device type, manufacturer, model name, and/or UID) of the found target electronic device to the IoT server, and the target electronic device found from the IoT server performs a cloud control function. Information indicating that it is a supported device may be received from the IoT server. As another example, the electronic device may receive information indicating that the found target electronic device is a device previously registered in the IoT server from the IoT server.
  • registration information eg, at least one of device type, manufacturer, model name, and/or UID
  • the electronic device may output a first UI (eg, the first UI 516 of FIG. 5 ) indicating that the found target electronic device is a device supporting the cloud control function. For example, it may indicate that the found target electronic device may operate as a cloud control target device or is registered as a cloud control target device.
  • a first UI eg, the first UI 516 of FIG. 5
  • the electronic device may identify whether a user input requesting to register the found target electronic device as an IR control target device is received.
  • the electronic device sets the searched target electronic device as an IR A procedure for registering as a control target device may be performed.
  • the electronic device selects the found target electronic device It can be registered as a cloud-controlled device. If the found target electronic device is already registered as the cloud control target device, the electronic device may end the procedure of registering the found target electronic device as the cloud control target device.
  • FIG. 7 is a signal flow diagram for identifying whether a target electronic device supports a cloud function, according to various embodiments of the present disclosure; The operations of FIG. 7 may be, for example, an example of operation 630 of FIG. 6 .
  • the electronic device 701 (eg, the electronic device 330 of FIG. 3 ) includes registration information on the found target electronic device (eg, the target electronic device 350 of FIG. 3 ). may transmit a first registration request message to the IoT server 702 (eg, the IoT server 310 of Fig. 3).
  • the registration information may include, for example, the device type, manufacturer (or brand) of the searched target electronic device, Information on at least one of a model name and/or UID may be included.
  • the IoT server 702 may identify whether the found target electronic device supports the cloud control function based on registration information included in the first registration request message. For example, the IoT server 702 detects a database (eg, the device DB 314 of FIG. 3 ) stored in the IoT server 702 , and thus the device type, manufacturer, and/or model name indicated by the registration information is cloud It can be identified whether the control function is supported. For another example, the IoT server 702 detects a database (eg, the device DB 314 of FIG. 3 ) stored in the IoT server 702 , thereby indicating the device type, manufacturer, model name and/or registration information indicated by the IoT server 702 . It may be identified whether a target electronic device matching at least one of UIDs is registered.
  • a database eg, the device DB 314 of FIG. 3
  • the IoT server 702 may transmit a first response message in response to the first registration request message.
  • the first response message may include, for example, information indicating that the device type, manufacturer, and/or model name of the found target electronic device supports the cloud control function.
  • the first response message may include information on whether the found target electronic device is registered as a cloud control target.
  • FIG. 8 to 9 illustrate an operation for identifying whether a target electronic device is a control target device, according to various embodiments.
  • FIG. 8 is a flowchart illustrating an operation of an electronic device for identifying whether a target electronic device is a control target device.
  • the operations shown in FIG. 8 may be performed by the electronic device 330 of FIG. 3 or by at least one component included in the electronic device 330 of FIG. 3 .
  • the operations illustrated in FIG. 8 may be an example of operation 620 of FIG. 6 .
  • the electronic device may request to transmit an IR signal to the target electronic device through an AI speaker (eg, the AI speaker 340 of FIG. 3 ).
  • the electronic device may request an AI speaker to transmit an IR signal to the target electronic device through the IoT server (eg, the IoT server 310 of FIG. 3 ).
  • the IR signal may include a specified command (eg, change channel).
  • operation 810 may be performed before the electronic device searches for a target electronic device.
  • operation 810 may be performed when a plurality of target electronic devices are found.
  • the electronic device may request a response signal from the target electronic device through a short-range communication protocol.
  • operation 820 may be performed together with operation 420 of FIG. 4 .
  • a signal transmitted to search for a target electronic device may include information requesting a response signal.
  • the electronic device may receive a response signal from the target electronic device. Since the target electronic device cannot transmit an IR signal, the electronic device may receive a response signal from the target electronic device through a short-range communication protocol.
  • the electronic device may identify whether the received response signal includes at least part of the same information as the IR signal transmitted in operation 810 . For example, the electronic device may identify whether the received response signal includes information about a specified command included in the IR signal.
  • the electronic device may determine that the target electronic device that has transmitted the response signal is the IR control target device. In other words, the electronic device may identify that the target electronic device including at least part of the same information as the IR signal among the target electronic devices found through the short-range communication protocol is the same as the IR control target device that the user wants to register.
  • the electronic device determines that the target electronic device that has transmitted the response signal is not the IR control target device.
  • 9 is a signal flow diagram for identifying whether a target electronic device is a control target device.
  • a first target electronic device 902 may refer to a device capable of supporting an IR control function (eg, the target electronic device 350 of FIG. 3 ).
  • the second target electronic device 903 may mean a device that cannot support a specified IR control function.
  • the first target electronic device 902 and the second target electronic device 903 may be different device types or may support different IR protocols.
  • the electronic device 901 may transmit a transmission command signal to the IR device 904 (eg, the AI speaker 340 of FIG. 3 ).
  • the transmit command signal may include information instructing the IR device 904 to transmit a command signal based on the IR protocol (eg, the IR signal of FIG. 8 ).
  • the IR device 904 may transmit a command signal (eg, the IR signal of FIG. 8 ) based on the IR protocol to the first target electronic device 902 .
  • the command signal may include, for example, a designated command (eg, change channel).
  • the IR device 904 may transmit the same signal as the command signal transmitted to the first target electronic device 902 to the second target electronic device 903 .
  • operations 910 and 915 may be performed as one operation.
  • the IR device 904 may transmit a specified command (eg, change a channel) in a specified direction (eg, one or more directions) a specified number of times (eg, one or more times).
  • the first target electronic device 902 may process the received IR signal.
  • the first target electronic device 902 may identify the specified command by processing the IR signal, and store at least a portion of the specified command for a specified time.
  • the second target electronic device 903 since the second target electronic device 903 does not support the IR protocol supported by the electronic device 901 , it may not be able to process the received IR signal (operation 922 ).
  • the electronic device 901 may transmit a response request signal to the found target electronic devices 902 and 903 .
  • the electronic device 901 may transmit a response request signal based on a short-range communication protocol (eg, Bluetooth) using a communication module (eg, the communication module 190 of FIG. 1 ).
  • the electronic device 901 may simultaneously perform operations 925 and 930 .
  • the electronic device 910 may broadcast a response request signal.
  • the first target electronic device 902 may transmit a pre-stored specified command to the electronic device 901 together with a response signal.
  • the response signal may be transmitted based on a short-range communication protocol.
  • the first target electronic device 902 may reduce unnecessary storage space consumption by deleting the specified command after transmitting the response signal.
  • the second target electronic device 903 may transmit a response signal to the electronic device 901 based on a short-range communication protocol. Since the second target electronic device 903 failed to process the received IR signal, the response signal transmitted from the second target electronic device 903 may not include a designated command for processing the IR signal (eg, For example, 'empty' or 'fail' information included).
  • the electronic device 901 is a device for registering the first target electronic device 902 as an IR control target device based on the received response signal and for registering the second target electronic device 903 as an IR control target device It can be determined that it is not a device.
  • 10 to 11 illustrate an operation for registering a target electronic device as an IR control target device according to various embodiments of the present disclosure.
  • FIG. 10 is a signal flow diagram for registering a target electronic device as an IR control target device. 11 illustrates a user interface for guiding registration of a target electronic device. The operations illustrated in FIG. 10 may be performed after operation 660 of FIG. 6 .
  • the electronic device 1001 (eg, the electronic device 330 of FIG. 3 ) transmits a second registration request message to the IoT server 1002 (eg, the IoT server 310 of FIG. 3 ).
  • the second registration request message may include information requesting to register a target electronic device (eg, the target electronic device 350 of FIG. 3 ) as an IR control target device.
  • the second registration request message may include information on at least one of a device type, a manufacturer, a brand, a model name, and/or a UID of the target electronic device.
  • the second registration request message may include information on an area in which the target electronic device is located.
  • a region may be, for example, a virtual space allocated in a home or office, such as a bedroom, a kitchen, a living room, or a bathroom.
  • the electronic device 1001 may register at least one virtual space in the IoT server 1002 and transmit information about the virtual space in which the target electronic device is located in the second registration request message.
  • the IoT server 1002 may identify whether a device having the same device type as the found target electronic device exists in the area including the location of the found target electronic device. For example, the IoT server 1002 may retrieve a database (eg, the device DB 314 or the account DB 312 of FIG. 3 ) in response to receiving the second registration request message. If a target electronic device (eg, a TV) located in a specific area (eg, living room) is already registered in the IoT server 1002 as a cloud control target device, the IoT server 1002 is the target indicated by the second registration request message. A device having the same area and device type as the electronic device may be identified as already existing.
  • a target electronic device eg, a TV
  • a specific area eg, living room
  • the IoT server 1002 registers the searched target electronic device as an IR control target device, and in operation 1035, the IoT server 1002 performs registration A message indicating completion may be transmitted to the electronic device 1001 .
  • the IoT server 1002 may transmit a second response message 1015 to the electronic device 1001 .
  • the second response message 1015 may include information indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located. For example, the existence of a device having the same device type as the found target electronic device in the same area as the area in which the searched target electronic device is located includes that the target electronic device is registered in the IoT server 1002 with the cloud control function can do.
  • the electronic device 1001 may output a second UI for guiding registration of the target electronic device based on the second response message received from the IoT server 1002 and receive a second user input.
  • the electronic device 1001 displays a second UI 1110 indicating that a device of the same type exists in the area of the searched (or selected) target electronic device on the fifth screen 1101 of the display. ) can be printed.
  • the electronic device 1001 sends a third registration request message to the IoT server (1002) can be transmitted.
  • the third registration request message may include, for example, information that is at least partially identical to that of the second registration request message.
  • the IoT server 1002 may determine a priority for a cloud control function and an IR control function among functions of the target electronic device. According to an embodiment, the IoT server 1002 may determine a priority based on at least one of a user's setting of the electronic device 1001 , a user's preference, or a use history. According to an embodiment, the priority of the IR control function may be set higher than the priority of the cloud control function. For example, the user may set the IR control function to be preferentially used as a method for controlling the function of the target electronic device registered as the cloud control function. When the priority is determined, the IoT server 1002 may register the found target electronic device as an IR control target device, and transmit a message indicating that registration of the IR control target device is completed in operation 1035 .
  • FIG. 12 illustrates a user interface for controlling a target electronic device according to various embodiments of the present disclosure
  • the target electronic device eg, the target electronic device 350 of FIG. 3
  • the electronic device eg, the electronic device 330 of FIG. 3
  • the target electronic device may enable the target electronic device to support the cloud control function.
  • the electronic device may output an application screen 1200 for controlling target electronic devices included in the IoT environment through the display.
  • the application screen 1200 may include graphic user interfaces (GUIs) 1201 , 1202 , 1203 , and 1204 indicating information on a plurality of target electronic devices.
  • GUIs graphic user interfaces
  • the electronic device displays a control screen of the target electronic device corresponding to the selected GUI (eg, 1210, 1220, 1230, or 1240) can provide
  • the GUIs 1201 , 1202 , 1203 , and 1204 included in the application screen 1200 may indicate control functions supported by the target electronic device.
  • the first GUI 1201 may indicate that the target electronic device (eg, a fan) supports an IR control function.
  • the second GUI 1202 may indicate that the target electronic device (eg, air conditioner) supports both an IR control function and a cloud control function (eg, OCF).
  • the application screen 1200 may further include a GUI 1205 for an IR device (eg, an AI speaker) to control the target electronic device through an IR control function.
  • an IR device eg, an AI speaker
  • the IoT server 310 is an IR device (eg, an AI speaker) can request to transmit a signal to control a target electronic device (eg, a fan) that supports only the IR control function.
  • the display of the electronic device may include a rollable or foldable display.
  • the electronic device may display a user interface (eg, the application screen 1200) differently based on a rollable or foldable state of the display. For example, in a state in which the display of the electronic device is rolled or folded (eg, the display area of the display is visually reduced when the user looks at it), the application screen including the GUIs 1201 , 1202 , 1203 , and 1204 . Only (1200) can be displayed.
  • the application screen 1200 including the GUIs 1201 , 1202 , 1203 , and 1204 .
  • control screens eg, 1210 , 1220 , 1230 , or 1240 .
  • 13 to 15 illustrate an operation for controlling a target electronic device according to various embodiments of the present disclosure.
  • 13 to 15 exemplify an operation of controlling a specified operation (eg, changing a channel) of the target electronic device 1304 (eg, TV) based on the cloud control function, but the device type of the target electronic device and the target electronic device Operations that may be performed are not limited to the example illustrated in FIG. 13 .
  • FIG. 13 shows a block diagram and a flowchart for controlling a target electronic device.
  • the AI speaker 1301 , the voice assistance server 1302 , the IoT server 1303 , and the target electronic device 1304 are the AI speaker 340 and the voice assistance server 320 of FIG. 3 , respectively.
  • the IoT server 310 , and the target electronic device 350 may perform the same or similar functions, and may include the same or similar configuration as these.
  • the voice assistance server 1302 and the IoT server 1303 may be configured as one server.
  • the voice assistance server 1302 may include a voice recognition module 1304 , a language understanding module 1305 , and a utterance processing module 1306 for each function.
  • the 'modules' included in the voice assistance server 1302 may include hardware or software.
  • the modules included in the voice assistance server 1302 may be a part of the model 234 stored in the storage 233 of FIG. 2 , or may be an instruction set executed by the processor 232 . .
  • the controller 1307, the communication interface 1309, the device DB 1308, and the program DB 1310 included in the IoT server 1303 are the processor 212, the communication interface 211 of FIG. The same or similar functions to the device DB 314 and the program DB 316 may be performed.
  • the AI speaker 1301 may receive a voice input (eg, 'play xxx program') from the user.
  • a voice input eg, 'play xxx program'
  • the AI speaker 340 may transmit the received voice input to the voice recognition module 1304 of the voice assistance server 1302 .
  • the voice recognition module 1304 may convert the received voice input into text data, and transmit the converted data to the language understanding module 1305 in operation 1325 .
  • the language understanding module 1305 may analyze a natural language corresponding to the voice input through the transmitted data, and transmit the analysis result to the function-specific speech processing module 1306 in operation 1330 .
  • the function-specific speech processing module 1306 may recognize a function intended by the natural language through pre-learned data. In operation 1335 , the function-specific speech processing module 1306 may transmit data indicated by the recognized user intention to the controller 1307 of the IoT server 1303 .
  • the controller 1307 may determine whether the user intent can be performed based on the received data. For example, the controller 1307 may determine whether the target electronic device 1304 indicated by the user intention exists, whether the target electronic device 1304 supports a cloud control function, or a channel corresponding to the user intention exists. . To determine whether the user intention can be performed, the controller 1307 may load data from the device DB 1308 in operation 1340 , and load data from the program DB 1310 in operation 1345 . An example of an operation of determining whether a user intention can be performed will be described later with reference to FIG. 15 . If it is determined that the user intention can be performed, the controller 1307 may transmit a command signal corresponding to the user intention to the communication interface 1309 in operation 1350 . In operation 1355 , the communication interface 1309 may transmit a command signal to the target electronic device 1304 . In one embodiment, the communication interface 1309 may transmit a command signal based on the OCF standard.
  • the IoT server 1303 determines whether the user intention corresponding to the voice input can be performed based on the database (eg, the device DB 1308 and the program DB 1310) stored in the IoT server 1402, so that the user intention is You can provide feedback if it cannot be done.
  • the database eg, the device DB 1308 and the program DB 1310 stored in the IoT server 1402, so that the user intention is You can provide feedback if it cannot be done.
  • a signal flow diagram for providing feedback is described below in FIG. 14 .
  • FIG. 14 shows a signal flow diagram for processing a channel change command.
  • the AI speaker 1401 in response to a user input (eg, voice input), in operation 1405 , the AI speaker 1401 (eg, the AI speaker 1301 of FIG. 13 ) sends a channel change command to the IoT server 1402 ( Example: It can be transmitted to the IoT server 1303 of FIG. 13 ).
  • the channel change command may be transmitted to the IoT server 1402 based on the method shown in FIG. 13 .
  • the channel change command is transmitted to an electronic device such as a smartphone (eg, 330 in FIG. 3 ) may be transmitted to the IoT server 1402 through
  • the electronic device receives a user's voice input requesting a channel change or receives a touch input through a GUI (eg, 1240 in FIG. 12 ), and sends a channel change command corresponding to the received input to the IoT server 1402 ) can be passed as
  • the electronic device may transmit the channel change command directly to the IoT server 1402 or through the AI speaker 1402 or a voice assistant server (eg, 320 in FIG. 3 ).
  • the IoT server 1402 may process the received command.
  • the IoT server 1402 may process a command based on the operation of the controller 1307 shown in FIG. 13 .
  • the IoT server 1402 may transmit a feedback message to the AI speaker 1401 .
  • the feedback message may indicate, for example, that the target electronic device does not exist, that the target electronic device cannot support a cloud control function, or that a channel corresponding to a user intention does not exist.
  • the feedback message may include, for example, voice feedback.
  • the IoT server 1402 may transmit a feedback message to the electronic device (eg, 330 of FIG. 3 ).
  • the IoT server 1402 may transmit a feedback message through the AI speaker 1402 or directly to the electronic device.
  • the feedback message transmitted to the electronic device may include at least one of voice, video, vibration, and LED.
  • FIG. 15 is a flowchart illustrating an operation of an IoT server for processing a channel change command. The operations shown in FIG. 15 may be performed by the IoT server 1303 of FIG. 13 or may be performed by the controller 1307 .
  • the IoT server may receive a channel change command.
  • the IoT server receives a channel change command based on a touch input from an electronic device (eg, the electronic device 330 of FIG. 3 ) or a voice assistance server (eg, the voice assistance server 320 of FIG. 3 ).
  • a channel change command based on a voice command may be received from the electronic device (eg, the electronic device 330 of FIG. 3 ) or an AI speaker (eg, the AI speaker 1301 of FIG. 13 ).
  • the IoT server may identify whether a target electronic device (eg, a TV) corresponding to the channel change command exists. For example, the IoT server may identify whether a device capable of performing a channel change command exists by detecting a device DB (eg, the device DB 1308 of FIG. 13 ). If the target electronic device corresponding to the channel change command does not exist, in operation 1535 , the IoT server may transmit a feedback message.
  • a target electronic device eg, a TV
  • the IoT server may transmit a feedback message.
  • the IoT server may identify whether the target electronic device supports the cloud control function. For example, the IoT server may identify whether the target electronic device supports the cloud control function by detecting the function of the target electronic device stored in the device DB. If the target electronic device does not support the cloud control function, the IoT server may transmit a feedback message in operation 1535 .
  • the IoT server may identify whether a channel corresponding to the command exists. For example, by detecting the program DB (eg, the program DB 1310 of FIG. 13 ), the IoT server may identify whether a channel on which a program (eg, an xxx program) intended by the user is being broadcast exists. If there is no channel corresponding to the command, in operation 1535 , the IoT server may transmit a feedback message.
  • the program DB eg, the program DB 1310 of FIG. 13
  • the IoT server may identify whether a channel on which a program (eg, an xxx program) intended by the user is being broadcast exists. If there is no channel corresponding to the command, in operation 1535 , the IoT server may transmit a feedback message.
  • the IoT server may select one channel from among a plurality of channel numbers corresponding to the command. For example, the IoT server may select a channel based on at least one of a user setting or a usage history. If there is only one channel corresponding to the command, the IoT server may not perform operation 1525 .
  • the IoT server may transmit a signal instructing to change to the selected channel to the target electronic device.
  • the IoT server may generate and transmit an IR signal for changing the channel of the target electronic device to the AI speaker.
  • the electronic device (eg, the electronic device 330 of FIG. 3 ) according to an embodiment includes at least one communication circuit (eg, the wireless communication module 192 of FIG. 1 ) and a display (eg, FIG. 1 ). of a display module 160), a processor operatively coupled to the at least one communication circuit and the display (eg, the processor 120 of FIG. 1), and a memory operatively coupled to the processor (eg, FIG. 1 memory 130), wherein, when executed, the processor receives a first user input requesting registration of an IR-controlled device, and the IR-controlled device is controlled by the IR device.
  • the processor receives a first user input requesting registration of an IR-controlled device, and the IR-controlled device is controlled by the IR device.
  • the cloud control target device means a device controlled by an IoT server (eg, the IoT server 310 of FIG. 3 ), and a first indicating that the found target electronic device is the cloud control target device
  • Instructions for outputting a user interface eg, the first UI 516 of FIG. 5 ) through the display may be stored.
  • the processor transmits a first registration request message including information on the device type and manufacturer of the found target electronic device to the IoT server, and the device type of the found target electronic device and receiving a first response message indicating that the manufacturer supports the cloud control function from the IoT server, and identifying the found target electronic device as the cloud control target device based on the received first response message have.
  • the instructions may cause the processor to search for the target electronic device based on a Bluetooth communication protocol, and receive a data packet from the target electronic device while searching for the target electronic device. .
  • the instructions receive, before the processor searches for the target electronic device, a second user input for selecting a device type of the target electronic device, and determines that the device type indicated by the data packet is the It is possible to identify whether the device type is the same as the device type selected by the second user input, and determine whether the found target electronic device is a control target device based on a command included in the data packet.
  • the instructions transmit, before the processor searches for the target electronic device, an IR signal including a specified command, and the command included in the data packet is included in the IR signal. It is possible to determine whether the found target electronic device is the control target device based on whether a specified command and at least a part thereof are identical to each other.
  • the instructions include, when the processor receives a third user input requesting to register the searched target electronic device as the IR control target device while the first UI is output, the searched target electronic device If a procedure for registering a device as the IR control target device is performed, and the third user input is not received while the first UI is output, the searched target electronic device can be registered as the cloud control target device have.
  • the instructions include information on a device type of the found target electronic device and a region in which the target electronic device is located in order for the processor to perform a procedure for registering the IR control target device
  • a second registration request message is transmitted to the IoT server, and a second response message indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located is transmitted to the IoT server and a second UI indicating that a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located (eg, the second UI 1110 of FIG. 11 ) may be output through the display.
  • the instructions include: receiving, by the processor, a fourth user input requesting registration of the found target electronic device, and requesting registration of the found target electronic device while the second UI is output
  • a third registration request message may be transmitted to the IoT server, and a message indicating that the found target electronic device is registered as the IR control target device may be received from the IoT server.
  • the instructions are configured by the processor in a graphical user interface (eg, GUIs 1201 , 1202 , 1203 of FIG. 12 , or 1204)) may be output through the display.
  • a graphical user interface eg, GUIs 1201 , 1202 , 1203 of FIG. 12 , or 1204
  • the electronic device further includes a microphone configured to receive a voice input
  • the instructions include: the processor obtains a voice input for requesting a channel change of the target electronic device through the microphone; A channel change command corresponding to the acquired voice input may be transmitted to the IoT server, and a feedback message for the channel change command may be received from the IoT server.
  • a server included in the IoT environment according to an embodiment disclosed in this document is a communication interface configured to communicate with an electronic device (eg, the electronic device 330 of FIG. 3 ).
  • an electronic device eg, the electronic device 330 of FIG. 3
  • a processor operatively coupled with the communication interface
  • a memory operatively coupled with the processor (eg, storage of FIG. 2 ) unit 213), wherein the memory stores a database for a target electronic device (eg, the target electronic device 350 of FIG.
  • a first registration request message for requesting registration of the target electronic device found by the electronic device as an IR control target device is received from the electronic device, and the first registration request message includes a device type and a manufacturer of the found target electronic device. , a model name and information on at least one of a unique identifier (UID), and based on the information included in the first registration request message and the database stored in the memory, identifying that the found target electronic device is a cloud control target device and a first response message indicating that the found target electronic device is the cloud control target device may be configured to be transmitted to the electronic device.
  • UID unique identifier
  • the processor after transmitting the first response message, receives a second registration request message requesting registration of the found target electronic device from the electronic device, and the second registration request message includes information on the device type, manufacturer, and location of the searched target electronic device, and an area in which the searched target electronic device is located based on information included in the second registration request message and a database stored in the memory It is identified that a device having the same device type as the found target electronic device exists in the same area as the detected target electronic device, and a device having the same device type as the found target electronic device exists in the same area as the area in which the searched target electronic device is located. It may be configured to transmit the indicated second response message to the electronic device.
  • the processor after transmitting the second response message, receives a third registration request message requesting registration of the found target electronic device from the electronic device, and Priority of the cloud control function and the IR control function may be determined among functions, and a message indicating that the found target electronic device is registered as the IR control target device may be configured to be transmitted to the electronic device.
  • the processor receives a channel change command for the target electronic device, and based on the received channel change command and a database stored in the memory, the target electronic device corresponding to the channel change command It may be configured to identify whether there exists, to identify whether a target electronic device corresponding to the channel change command supports the cloud control function, and to identify whether a channel corresponding to the channel change command exists.
  • the processor may be configured to be configured to be configured to be configured to be configured such that a target electronic device corresponding to the channel change command does not exist, a target electronic device corresponding to the channel change command does not support the cloud control function, or the channel change command If there is no channel corresponding to , it may be configured to transmit a feedback message.
  • the method of the electronic device includes an operation (eg, the electronic device 330 of FIG. 3 ) of receiving a first user input requesting registration of an IR control target device (eg, of FIG. 4 )
  • the IR control target device refers to a device controlled by an IR device, and searching for a target electronic device (eg, operation 420 in FIG. 4 ) is performed when the searched target electronic device is cloud-controlled
  • searching for a target electronic device eg, operation 420 in FIG. 4
  • searching for a target electronic device eg, operation 420 in FIG. 4
  • an operation of identifying a target device eg, operation 430 of FIG.
  • the cloud control target device refers to a device controlled by an IoT server, and a first indicating that the found target electronic device is the cloud control target device It may include an operation of outputting a user interface (eg, operation 440 of FIG. 4 ).
  • the identifying that the found target electronic device is the cloud control target device includes transmitting a first registration request message including information on the device type and manufacturer of the found target electronic device to the IoT server. operation (eg, operation 705 of FIG. 7 ), and an operation of receiving a first response message indicating that the device type and manufacturer of the found target electronic device support the cloud control function from the IoT server (eg, operation of FIG. 7 ) 715), and identifying that the found target electronic device is the cloud control target device based on the received first response message.
  • the searching for the target electronic device includes searching for the target electronic device based on a Bluetooth communication protocol and receiving a data packet from the target electronic device, Before searching for a device, transmitting an IR signal including a specified command (eg, operation 810 in FIG. 8 ), and the command included in the data packet is at least a portion of the specified command included in the IR signal
  • the method may further include an operation (eg, operation 840 of FIG. 8 ) of determining whether the found target electronic device is a control target device based on whether .
  • the method when receiving a second user input requesting registration of the found target electronic device as the IR control target device while the first UI is output, sets the searched target electronic device to the IR The method further comprising performing a procedure for registering as a control target device, wherein performing the procedure for registering the found target electronic device as the IR control target device includes: a device type of the found target electronic device and the target An operation of transmitting a second registration request message including information on an area in which the electronic device is located to the IoT server (eg, operation 1005 of FIG.
  • the searched target in the same area as the area in which the electronic device is located An operation of receiving a second response message indicating that a device having the same device type as that of the electronic device exists from the IoT server (eg, operation 1015 of FIG. 10 ), in the same area as the area in which the searched target electronic device is located Outputting a second UI indicating that a device having the same device type as the target electronic device exists, and receiving a third user input requesting registration of the found target electronic device while the second UI is output , an operation of transmitting a third registration request message requesting registration of the found target electronic device to the IoT server (eg, operation 1025 of FIG. 10 ), and indicating that the found target electronic device is registered as the IR control target device It may include an operation of receiving a message from the IoT server (eg, operation 1035 of FIG. 10 ).
  • the method may further include outputting a graphic user interface indicating that the registered target electronic device is the IR control target device and the cloud control target device.
  • the electronic device may have various types of devices.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a wearable device e.g., a smart bracelet
  • a home appliance device e.g., a home appliance
  • first, second, or first or second may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit.
  • a module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • one or more instructions stored in a storage medium may be implemented as software (eg, the program 140) including
  • a processor eg, processor 120
  • a device eg, electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term refers to the case where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.
  • a signal eg, electromagnetic wave
  • the method according to various embodiments disclosed in this document may be provided as included in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • the computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play StoreTM) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online.
  • a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.
  • each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have.
  • one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg, a module or a program
  • the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. .
  • operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Telephonic Communication Services (AREA)

Abstract

Dispositif électronique comprenant : au moins un circuit de communication ; un dispositif d'affichage ; un processeur connecté de manière fonctionnelle à l'au moins un circuit de communication et au dispositif d'affichage ; et une mémoire connectée fonctionnellement au processeur. La mémoire peut stocker des instructions permettant, pendant l'exécution, au processeur de : recevoir une première entrée d'utilisateur pour demander l'enregistrement d'un dispositif de commande IR, le dispositif de commande IR signifiant un dispositif commandé par un dispositif IR ; découvrir un dispositif électronique cible à l'aide de l'au moins un circuit de communication ; identifier le fait que le dispositif électronique cible découvert est un dispositif de commande en nuage, le dispositif de commande en nuage signifiant un dispositif commandé par un serveur IdO ; et délivrer, par l'intermédiaire du dispositif d'affichage, une première interface utilisateur indiquant que le dispositif électronique cible découvert est le dispositif de commande en nuage.
PCT/KR2021/009762 2020-08-04 2021-07-28 Dispositif électronique pour la commande d'un dispositif électronique cible dans un environnement ido et procédé correspondant Ceased WO2022030860A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2020-0097093 2020-08-04
KR1020200097093A KR102825988B1 (ko) 2020-08-04 2020-08-04 IoT 환경에서 타겟 전자 장치를 제어하기 위한 전자 장치 및 그에 관한 방법

Publications (1)

Publication Number Publication Date
WO2022030860A1 true WO2022030860A1 (fr) 2022-02-10

Family

ID=80118154

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/009762 Ceased WO2022030860A1 (fr) 2020-08-04 2021-07-28 Dispositif électronique pour la commande d'un dispositif électronique cible dans un environnement ido et procédé correspondant

Country Status (2)

Country Link
KR (1) KR102825988B1 (fr)
WO (1) WO2022030860A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20240022222A (ko) * 2022-08-11 2024-02-20 삼성전자주식회사 전자 장치 및 이의 제어 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070111449A (ko) * 2004-10-27 2007-11-21 슈페르나 리미티드 네트워크 장치 제어 시스템 및 방법
KR20160044068A (ko) * 2014-10-13 2016-04-25 한국과학기술원 IoT 장치를 제어하기 위한 방법 및 시스템
WO2016196947A1 (fr) * 2015-06-05 2016-12-08 Convida Wireless, Llc Procédé et appareil d'interfonctionnement de dispositifs et d'applications m2m et iot avec différentes couches de services
KR20190071383A (ko) * 2017-12-14 2019-06-24 삼성전자주식회사 등록 세션을 제어하기 위한 전자 장치 및 그의 동작 방법, 서버 및 그의 동작 방법
KR20190134922A (ko) * 2018-05-15 2019-12-05 삼성전자주식회사 허브를 통해 복수의 전자 장치를 서버에 연결시키는 방법 및 이를 수행하는 전자 장치

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101772653B1 (ko) * 2010-12-31 2017-08-29 삼성전자주식회사 제어 디바이스 및 방송수신장치 제어 방법
KR20150125526A (ko) * 2014-04-30 2015-11-09 삼성전자주식회사 클라우드 서버, 화상형성장치 및 인쇄 제어 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070111449A (ko) * 2004-10-27 2007-11-21 슈페르나 리미티드 네트워크 장치 제어 시스템 및 방법
KR20160044068A (ko) * 2014-10-13 2016-04-25 한국과학기술원 IoT 장치를 제어하기 위한 방법 및 시스템
WO2016196947A1 (fr) * 2015-06-05 2016-12-08 Convida Wireless, Llc Procédé et appareil d'interfonctionnement de dispositifs et d'applications m2m et iot avec différentes couches de services
KR20190071383A (ko) * 2017-12-14 2019-06-24 삼성전자주식회사 등록 세션을 제어하기 위한 전자 장치 및 그의 동작 방법, 서버 및 그의 동작 방법
KR20190134922A (ko) * 2018-05-15 2019-12-05 삼성전자주식회사 허브를 통해 복수의 전자 장치를 서버에 연결시키는 방법 및 이를 수행하는 전자 장치

Also Published As

Publication number Publication date
KR20220017057A (ko) 2022-02-11
KR102825988B1 (ko) 2025-06-26

Similar Documents

Publication Publication Date Title
WO2022154272A1 (fr) Dispositif iot et procédé d'intégration d'un dispositif iot dans un serveur
WO2022019682A1 (fr) Système et procédé de calcul de frontière
WO2022124829A1 (fr) Dispositif électronique de fourniture d'interaction basée sur voix d'utilisateur et son procédé
WO2023027377A1 (fr) Dispositif électronique et procédé pour fournir un service personnalisé sensible au contexte d'un utilisateur
WO2022030860A1 (fr) Dispositif électronique pour la commande d'un dispositif électronique cible dans un environnement ido et procédé correspondant
WO2022149763A1 (fr) Dispositif électronique permettant de gérer un dispositif électronique externe exécutant une fonction demandée et son procédé de fonctionnement
WO2022149797A1 (fr) Dispositif électronique basé sur la localisation pour commander une pluralité de dispositifs externes, procédé de fonctionnement correspondant, et support de stockage
WO2022191395A1 (fr) Appareil de traitement d'une instruction utilisateur et son procédé de fonctionnement
WO2022197088A1 (fr) Dispositif permettant de fournir un service ido et procédé associé
WO2023068507A1 (fr) Dispositif électronique permettant d'assurer une fonction rcs et son procédé de fonctionnement
WO2023054905A1 (fr) Procédé et dispositif électronique pour utiliser des données d'un dispositif électronique externe
WO2023101183A1 (fr) Dispositif électronique et procédé de fourniture de liste d'énoncés recommandés
WO2022270735A1 (fr) Dispositif électronique et procédé de sortie d'objet généré sur la base d'une distance entre un dispositif électronique et un dispositif cible
WO2022203374A1 (fr) Procédé pour fournir un service d'assistant vocal, et dispositif électronique pour le prendre en charge
WO2022191378A1 (fr) Dispositif électronique pour fournir un service et son procédé de fonctionnement
WO2022211245A1 (fr) Dispositif électronique et procédé de réalisation d'une tâche selon un état dynamique dans un dispositif électronique
WO2022215865A1 (fr) Dispositif électronique et procédé de partage d'informations de commande iot
WO2023219230A1 (fr) Dispositif électronique pour commander un appareil de l'internet des objets, et son procédé de fonctionnement
WO2024043492A1 (fr) Dispositif électronique de gestion de dispositif de l'internet des objets et son procédé de fonctionnement
WO2024076008A1 (fr) Dispositif électronique, procédé et support de stockage lisible par ordinateur non transitoire pour partager un fichier
WO2023043073A1 (fr) Dispositif électronique portable pour commander une pluralité de dispositifs de l'internet des objets, son procédé de fonctionnement, et support de stockage
WO2022098004A1 (fr) Dispositif électronique de transmission de données via une connexion de communication, et son procédé de fonctionnement
WO2023085822A1 (fr) Procédé de détermination d'emplacement de dispositif, et dispositif électronique de mise en œuvre dudit procédé
WO2025170361A1 (fr) Serveur pour la fourniture de services basés sur l'internet des objets, son procédé de fonctionnement et support de stockage
WO2024076142A1 (fr) Dispositif électronique et procédé de commande de connexion en nuage de dispositif électronique externe utilisé dans le dispositif électronique

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21853768

Country of ref document: EP

Kind code of ref document: A1