[go: up one dir, main page]

WO2009025499A1 - Système de télécommande mettant en œuvre une interface utilisateur, dispositif de télécommande, et procédé correspondant - Google Patents

Système de télécommande mettant en œuvre une interface utilisateur, dispositif de télécommande, et procédé correspondant Download PDF

Info

Publication number
WO2009025499A1
WO2009025499A1 PCT/KR2008/004851 KR2008004851W WO2009025499A1 WO 2009025499 A1 WO2009025499 A1 WO 2009025499A1 KR 2008004851 W KR2008004851 W KR 2008004851W WO 2009025499 A1 WO2009025499 A1 WO 2009025499A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
nvui
remote control
user interface
acquired
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2008/004851
Other languages
English (en)
Inventor
Woon-Tack Woo
Hyo-Seok Yoon
Hye-Jin Kim
Sang-Goog Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gwangju Institute of Science and Technology
Original Assignee
Gwangju Institute of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020070083562A external-priority patent/KR20090019266A/ko
Priority claimed from KR1020080012848A external-priority patent/KR101012458B1/ko
Application filed by Gwangju Institute of Science and Technology filed Critical Gwangju Institute of Science and Technology
Publication of WO2009025499A1 publication Critical patent/WO2009025499A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C19/00—Electric signal transmission systems
    • G08C19/16—Electric signal transmission systems in which transmission is by pulses
    • G08C19/28—Electric signal transmission systems in which transmission is by pulses using pulse code
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/20—Binding and programming of remote control devices
    • G08C2201/21—Programming remote control devices via third means
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface

Definitions

  • the present invention relates to a remote control system using a natural view user interface, a remote control device, and a method therefor.
  • the present invention relates to a remote control system using a natural view user interface that allows a user to intuitively control various information apparatuses by providing a user interface based on a natural view of an actual physical interface for various information apparatuses in a smart space including various information apparatuses while ensuring consistency of the user interface.
  • pervasive computing In a ubiquitous environment, another concept such as a concept called pervasive computing is ubiquitous created. A concept called pervasive computing is used as another concept for a ubiquitous environment. Pervasive computing means access computing equipment gradually increases due to the fusion of an advanced electronic technology, particularly, wireless technology and the Internet, and the core functions of a computer are widely applied to other types of apparatuses. That is, pervasive computing targets an environment in which numerous apparatuses connected to a network can access the network anytime and anywhere, and e-business can be performed.
  • the smart space including embedded computers, information apparatuses, a multi-modal sensor, and the like, represents an environment in which access to information and an aid of the computer are provided at a level without a precedent, thereby allowing persons to efficiently perform work.
  • a technology enabling remote control of various information apparatuses or electronic apparatuses is introduced due to the help of pervasive computing or creating of the smart space.
  • remote control of a television, a video recorder, a stereo, a kiosk, a telephone, an air conditioner, a microwave oven, other control devices and display devices are integrally performed by using an exclusive apparatus, a laptop computer, a personal digital assistant (PDA), a communication assistant apparatus, an apparatus for a handicapped person, and the like.
  • PDA personal digital assistant
  • a standardization operation for a universal remote console is carried out.
  • W3C XForms 1.0 established a user interface component called XML based XForms for standardized Web control and was modified by W3C recommendation in March 2006. Although the standard is limited to a user interface in a Web area and is used through a Web browser and a Web server, and thus it is difficult to apply the standard to various information apparatuses.
  • ANSFINCITS 389 defines a method of providing the user interface of the information apparatus by designating a device to be controlled, which is called a target and a controller called the Universal Remote Console (URC).
  • URC Universal Remote Console
  • ANSI/ INCITS 389 provides the user interface optionally configured other than the user interface of the known/actual information apparatus, compatibility and interoperability are not secured in consistently adopting the standard in the actual interface.
  • a first object of the present invention is to provide a remote control system using a natural view user interface that enables a user to control an information apparatus on the basis of a user interface, which is the same as an actual user interface of the information apparatus, a remote control device, and a method therefor.
  • a second object of the present invention is to provide a remote control system using a natural view user interface that allows a user to control information apparatuses by using the natural view user interface by discriminating the information apparatus on the basis of an external shape of an actual information apparatus, a remote control device, and a method therefor.
  • a third object of the present invention is to provide a remote control system using a personalized natural view user interface that provides a user with a natural view user interface acquainted with the user by determining whether or not the user has used the acquired natural view user interface, a remote control device, and a method therefor.
  • a remote control system for remotely controlling a target in a smart space including the target to be controlled; a target server storing a natural view user interface (NVUI) formed in accordance with the same image as a physical interface of the target; and a remote control console controlling the NVUI from the target server by acquiring the NVUI from the target server by detecting the target, and receiving information on the target server storing the ID of the target and the NVUI of the target from the target.
  • NVUI natural view user interface
  • the NVUI includes the same interface image as the physical interface of the target and a description file storing control information on the interface image.
  • the remote control console includes a target detection module that detects the target in the smart space and acquires the information thereof from the target; an NVUI output module that acquires the NVUI by accessing the target server on the basis of the information acquired from the target detection module and outputs the NVUI onto the display device; and an NVUI interaction module that transmits a control signal inputted by using the NVUI to the target.
  • the target includes a target informing module that inform the network so that the target accesses the remote control console; and a target control module that controls the target in accordance with the control signal received from the remote control console.
  • the remote control console further includes a target identity module for identifying the target to be controlled in order to select the target after detecting the target.
  • the remote control console further includes an NVUI mapping module that determines whether the acquired NVUI is a firstly used NVUI or an NVUI used in the past when the NVUI of the target is acquired and maps the acquired NVUI for a remote control of a specific target in the case when the acquired NVUI is the firstly used NVUI.
  • an NVUI mapping module that determines whether the acquired NVUI is a firstly used NVUI or an NVUI used in the past when the NVUI of the target is acquired and maps the acquired NVUI for a remote control of a specific target in the case when the acquired NVUI is the firstly used NVUI.
  • a remote control method of remotely controlling a target in a smart space including a target to be controlled and a remote control console for remotely the target, which includes the steps of: (a) allowing the remote control console to detect the target and acquire information on the target by the interaction between a target detection module of the remote control console and a target informing module of the target; (b) allowing the remote control console to acquire a natural view user interface (NVUI) for the target from a target server by accessing a target server on the basis of the target information; (c) allowing an NVUI output module of the remote control console to output the NVUI acquired from the target server to a display; and (d) allowing an NVUI interaction module of the remote control console to transmits a control signal on the basis of the control signal inputted into the NVUI of the remote control console.
  • NVUI natural view user interface
  • the NVUI created in accordance with an actual physical interface of the target is stored in the target server at the time of or after delivering the target.
  • the NVUI includes the same interface image as the physical interface of the target and a description file storing control information on the interface image.
  • the remote control method using a natural view user interface further includes the step of: as a process of identifying a specific target to be controlled, (al) identifying the specific target to be controlled by using a target identity module included in the remote control console, wherein the NVUI for the specific target is outputted to the remote control console in the target identity module.
  • the remote control method using a natural view user interface further includes the step of: (bl) determining whether the acquired NVUI is a first used NVUI or an NVUI used in the past and mapping the acquired NVUI for remotely controlling the specific target in the case when the acquired NVUI is the first used NVUI.
  • a method of mapping a natural view user interface (NVUI) for remotely controlling a target in a smart space including a target to be controlled and a remote control console for remotely controlling the target, which includes the steps of: (a) acquiring the NVUI formed in accordance with the same image as an actual physical interface of the target; (b) determining whether the acquired NVUI is a firstly used NVUI or an NVUI used in the past; and (c) mapping the acquired NVUI for remotely controlling a specific target in the case when the acquired NVUI is the firstly used NVUI.
  • NVUI natural view user interface
  • a remote control device for controlling a target in a smart space including: a target detection module that detects the target in the smart space and acquires information on the target from the target; an NVUI output module that acquires and outputs the an NVUI having the same shape as an actual physical interface of the target onto a display by accessing a target server on the basis of the information acquired by the target detection module; and an NVUI interaction module that transmits a control signal inputted by using the NVUI to the target.
  • the remote control device further includes a target identity module for identifying the target to be controlled for selecting the target after detecting the target.
  • the remote control device further includes an NVUI mapping module that determines whether the acquired NVUI is a firstly used NVUI or an NVUI used in the past when the NVUI of the target is acquired and maps the acquired NVUI for a remote control of a specific target in the case when the acquired NVUI is the firstly used NVUI.
  • an NVUI mapping module that determines whether the acquired NVUI is a firstly used NVUI or an NVUI used in the past when the NVUI of the target is acquired and maps the acquired NVUI for a remote control of a specific target in the case when the acquired NVUI is the firstly used NVUI.
  • the present invention is advantageous in that a user can intuitively control various information apparatuses, which are the targets, by controlling the target using a user interface based on an actual physical interface of the target serving as a control target.
  • the user detects the target using various methods, thus, the user can use the user interface by downloading the user interface for the target and particularly, the user can detect and recognize the target on the basis of an actual external shape of the target, whereby it is possible to maximize the convenience thereof.
  • FIG. 1 is a schematic block diagram of a remote control system using a natural view user interface according to a first exemplary embodiment of the present invention.
  • a remote control system 100 includes a natural view based remote control console 110, a target to be controlled, which is various information apparatuses, and a target server 140 that stores information on the target 120 and stores a user interface of the target 120, and a first communication network 150 connecting the remote control console 110 and the target server 140 and a second communication network 130 connecting the remote control console 110 and the target 120.
  • the user interface of the target 120 is prepared based on an actual interface of the target 120.
  • the user interface of the target 120 is called a natural View User Interface (NVUI).
  • the natural view user interface (hereinafter, referred to as the NVUI) is, in principle, prepared to have the same shapes as the actual interfaces of various information apparatuses.
  • the NVUI is manufactured at the time of or after delivering each target, that is, the information apparatus and is stored in the target server 140. Thereafter, a user detects the target 120 existing in a smart space by means of the remote control console 110 (may be called a natural View Console (NVC) by using a natural view).
  • NVC natural View Console
  • the remote control console 110 acquires information on the target 120 from the target 120 through the second communication network 130 and acquires the NVUI from the target server 140 in connection with the target server 140 through the first communication network 150.
  • the user may control the target 120 by using the NVUI in the remote control console 110.
  • the remote control console 110 is a terminal that detects the target 120, acquires the
  • the remote control console 110 may be a PDA, a UMPC, a notebook, a smart phone, a PMP, a cellular phone, and the like.
  • the remote control console 110 basically includes a target detection module 112, an NVUI output module 114, and an NVUI interaction module 116.
  • the target detection module 112 performs a function of detecting a service which is logical, but is not shown in addition to information apparatuses and equipment based on a physical device, which is distributed in an environment.
  • the target detection module 112 detects the target 120 by the interaction with a target informing module 122 of the target 120 and acquires the information on the target 120 from the target 120. For this, it is preferable that the target detection module 112 periodically detects the target 120 through the second communication network 130.
  • the target detection module 112 may use existing Web standards such as UPnP, Jini, and the like which are a service discovery protocol (SDP) or a protocol corresponding thereto. Meanwhile, the target detection module 112 uses the same protocol as the target 120.
  • SDP service discovery protocol
  • the target detection module 112 acquires a target ID, URL of the target server 140 storing the NVUI for the target 120, and the like from the target 120.
  • the NVUI output module 114 performs a function of outputting the NVUI to a display device of the remote control console 110 by analyzing a template of the NVUI after acquiring the NVUI by accessing the target server 140 through the first communication network 150 on the basis of the information which the target detection module 112 acquired from the target 120.
  • the NVUI interaction module 116 performs a function of controlling the target 120 by using the outputted NVUI.
  • the NVUI interaction module 116 transmits a command in accordance with the control command to the target 120 through the second communication network 130 by referring to a description file of the NVUI.
  • the target 120 means the information apparatus to be controlled.
  • the target 120 is a device having an activated network function.
  • the target 120 includes various ranges such as a TV, a refrigerator, a display device, a PC, and the like which are the information apparatuses and home appliances that are used in a daily life.
  • the target 120 includes the target informing module 122 and a target control module
  • the target 120 includes a physical interface that allows the user to physically input a control signal into the target 120.
  • the natural view user interface to be used in the remote control console 110 in correspondence with the physical interface of the target 120 is digitalized and is stored in the target server 140 as the NVUI.
  • the target informing module 122 takes charge of a process of informing the network of the target 120 so as to access the target through the user s remote control console 110.
  • the remote control console 110 performs a function of detecting the target 120.
  • the target informing module 122 periodically transmits its own information to allow the remote control console 110 to detect the information or the target informing module 122 may transmit its own information to the remote control console 110 in response to when the target informing module 122 detects a target detection signal from the remote control console 110.
  • An informing message transmitted from the target informing module 122 to the remote control console 110 may include information on unique information including a target ID of the target 120, a product name of the target 120, a manufacturer of the target 120, and the like.
  • the informing message includes URL information of the target server 140 storing the NVUI.
  • the target informing module 122 has functions similar as the service discovery protocol (SDP) that performs a function of detecting an apparatus mounted in a Bluetooth apparatus, which provides a desired service.
  • SDP service discovery protocol
  • the target control module 124 performs a function of controlling the operation of the target 120 on the basis of the target control command received from the remote control console 110.
  • the target control module 124 physically or logically controls the target 120 by mapping software and hardware which correspond to the command received from the remote control console 110. It is preferable that the target control module 124 secures extendibility by supporting the UPnP, and the like.
  • the target server 140 performs a function of storing the NVUI corresponding to the
  • a remote control server may acquire detailed attribute information relating to the target 120 and the NVUI of the target 120.
  • the remote control console 110 accesses the target server 140 on the basis of the target ID or the target server URL information acquired from the target 120 and the NVUI of the corresponding target 120.
  • the URL of the target server 140 may be common to all the targets 120, but the URL may be different for each target 120 in consideration of a fact that manufacturers of the targets 120 may be different from each other.
  • the first communication network 150 is a communication network for connecting the remote control console 110 with the target server 140.
  • the remote control console 110 accesses the target server 140 through the first communication network 150 on the basis of the target ID or/and the server URL acquired from the target 120 and acquires the NVUI from the target server 140. It is understood that the first communication network 150 includes wired Internet and wireless Internet.
  • the second communication network 130 is a communication network for connecting the remote control console 110 with the target 120, and follows a general Web standard.
  • the remote control console 110 transmits and receives a signal for detecting the target 120 to and from the target 120 through the second communication network 130, and transmits a signal for controlling the target 120 to the target 120.
  • the second communication network 130 is formed in a range shorter than the first communication network 150.
  • the second communication network 130 may be configured by a short- range wireless communication system such as Bluetooth or zigbee.
  • FIG. 2 is a diagram illustrating one example of an interface image of the NVUI.
  • the NVUI is composed of an interface image 200 and a description file displaying the command.
  • the interface image 200 of the NVUI has the same shape as an actual physical interface of the target 120. Therefore, the configuration and arrangement of buttons and control menus on the NVUI are formed in the same manner as the actual physical interface of the target 120.
  • the interface image 200 of the NVUI has a size of 300 x 500.
  • Control commands are expressed as coordinates on the image. For example, in case of a Copy button 202, a topleft coordinate of the Copy button 202 is set to (50,60) and a bottomright coordinate of the Copy button 202 is set to (115,95). Therefore, when the user clicks on the Copy button 202 by using the NVUI, a Copy command is executed.
  • the remote control console 110 may use the NVUI by adjusting the size of the NVUI depending on the size of the display.
  • the description file may be prepared by XML.
  • FIG. 3 is a diagram illustrating a state in which the Copy button is pressed in one example of the NVUI and
  • FIG. 4 is a diagram illustrating a description file for this.
  • FIG. 5 is a flowchart illustrating the operation method of a remote control system according to a first exemplary embodiment of the present invention.
  • the NVUI generated in accordance with the actual physical interface of the target 120 is stored in the target server 140 (S500).
  • the NVUI may already be generated at the time of delivering the target 120 and the manufacturer of the target 120 may generate the NVUI and store the target server 140 after delivering the target 120 at a user's request.
  • the remote control console 110 detects the target 120 in the second communication network 130 and acquires the information on the target 120 from the target 120 (S502).
  • the acquired information on the target 120 may include the ID of the target 120, the URL of the target server 140, a product name of the target 120, a model number, and the like.
  • the remote control console 110 accesses the target server 140 through the first communication network 150 and acquires the NVUI in accordance with the ID of the target 120 from the target server on the basis of the information on the target 120 (S504).
  • the acquired NVUI includes the same interface image and description file as the physical interface of the target 120.
  • the NVUI output module 114 of the remote control console 110 outputs the NVUI acquired from the target server 140 to the display of the remote control console 110 (S506). At this time, it is preferable that the NVUI output module 114 adjusts an image shape of the NVUI in accordance with the size of the display of the remote control console 110.
  • the NVUI interaction module 116 of the remote control console 110 creates the control command of the target 120 on the basis of the inputted control signal to transmit the control command to the target 120 through the second communication network 130 (S510).
  • the target control module 124 of the target 120 controls the function of the target
  • a remote control console 110 of a remote control system includes a target identity module identifying a target 120 to be controlled.
  • FIG. 6 is a schematic block diagram of a remote control system using a natural view user interface according to a second exemplary embodiment of the present invention.
  • the remote control console 110 of the remote control system according to the second exemplary embodiment of the present invention further includes a target identity module 600.
  • the target identity module 600 serves to identify a specific target 120 by allowing the remote control console 110 to face the specific target 120 in the case when a user intends to control the specific target 120.
  • the target identity module 600 may use a specific sensor such as an RFID tag, and the like, a marker, a logo of the target 120, or a natural view as a method of identifying the target 120.
  • the target identity module 600 should be equipped with a sensor reader 602 such as an RFID reader for reading the specific sensor such as the RIFD tag in case of using the sensor such as the RFID tag at the time of identifying the target 120 and should be equipped with a camera 604 in case of using the marker, the logo, or the natural view.
  • the target 120 has a sensor in accordance with the target ID and the target identity module 600 includes the sensor reader 602 such as the RFID reader.
  • the user may specify the target to be controlled by sensing the sensor of the target 120 by using the sensor reader 602 such as the RFID reader.
  • the sensor reader 602 such as the RFID reader.
  • the user cannot intuitively control the specific target 120.
  • FIG. 7 is a schematic view illustrating a process of detecting the target by using the marker in the remote control system according to the second exemplary embodiment of the present invention.
  • the target identity module 600 photographs the marker by using the camera 604 equipped therewith and the target identity module 600 detects the photographed marker. After the target identity module 600 determines the 3D position and orientation of the marker, the target identity module 600 identifies the marker. However, individual markers should be used for the targets 120, respectively, in case of using the marker.
  • the target 120 on the basis of the logo such as the manufacturer or model name of the target 120 without using a similar method as the marker or a separate marker for the target 120.
  • FIG. 8 is a schematic diagram illustrating a process of detecting the target by using the logo in the remote control system according to the second exemplary embodiment of the present invention.
  • FIG. 8 centering on an indicator (+) by using the camera provided in the remote control console 110 (b).
  • the target identity module 600 acquires the largest connected component centering on the indicator (+) (c).
  • the target identity module 600 identifies the logo in the same manner as the marker.
  • the user identifies the target 120 by the target's own characteristic on the basis of not the marker but the logo.
  • the target 120 is identified on the basis of a view for a basic shape of the target 120 without additional artificial manipulation such as attaching the marker to the target 120.
  • FIG. 9 is a diagram schematically illustrating a method of identifying the target by using a natural view (that is, an actual view) of the target in the remote control system according to the second exemplary embodiment of the present invention.
  • a feature in accordance with the natural view of each target 120 is stored in a feature database 900 in accordance with the ID of each target 120 (S902, S904, and S906).
  • the feature database 900 may be provided in the target server 140 or the feature database 900 may be provided in the remote control console 110 as the case may be.
  • the feature includes a point, a line, a figure, and the like serving as characteristics for distinguishing the targets 120 from each other.
  • the natural view acquired from the target 120 has a shape in which the 3D shape is reflected in two dimensional. Therefore, information on the feature of the target 120 stored in the feature database 900 needs to be stored in views acquired for the target 120 in various directions.
  • the feature in accordance with the natural view of the target 120 is already decided at the time of delivering the target 120, thus, the feature may be stored in the target server 140 in advance. Further, in some cases, the user acquires the natural view of the target 120 by using the camera 604 of the user's own remote control console 110, the target identity module 600 extracts the feature of the target 120 of the target identity module 600, and the user inputs the ID of the target 120 therewith, such that it is possible to construct its own feature database 900.
  • the user When the user intends to identify the target 120 which the user wants to control, the user first acquires the view of the target 120 by using the camera 604. At this time, preferably, it can be verified in which direction the camera 604 acquires the view of the target 120.
  • the target identity module 600 detects and describes the feature of the target 120 on the basis of the natural view of the target 120 (S908 and S910), and identifies the target 120 matched by comparing the features stored in the feature database 900 (S912). In this case, it is possible to identify the target 120 by judging similarity between information on the feature for the acquired natural view of the target 120 and information on the feature of the target 120 stored in the feature database 900 is larger than a threshold value.
  • the camera 604 may compare the feature information after reflecting and acquiring a 2D view from the 3D modeling information on the basis of the information on which direction of the camera 604 acquires the view of the target 120.
  • the NVUI output module 114 accesses the target server 140 on the basis of the URL information of the target server 140 secured in the target detection module 112 to acquire the NVUI for the target 120. Further, in some cases, the target server URL information, it is possible to select the NVUI for the target ID among the NVUIs already secured in the remote control console 110.
  • the NVUI output module 114 of the remote control console 110 outputs the NVUI in accordance with the ID of the target 120 to the remote control console 110.
  • the remote control console 110 has already acquired the information on the target 120 through the target detection module 112. Accordingly, if the target 120 is identified through the target identity module 600, the NVUI output module 114 may acquire the NVUI of the target 120 from the target server 140 through the first communication network 150 or detect the NVUI already downloaded to the remote control console 110 to output the NVUI to a display of the remote control console 110.
  • the user may control the target 120 by inputting a control command for the target
  • NVUI have been described. However, if the user may use the same interface for a plurality of products of the same type in the remote control using the NVUI, the user may control other information apparatuses in a familiar method. That is, if there is the NVUI which has been for the existing TV, the NVUI is used for the existing TV for other TVs, thus, the user needs not to adapt himself or herself to a new interface.
  • FIG. 10 is a schematic block diagram of a remote control system using a natural view user interface according to the third embodiment of the present invention.
  • the remote control system shown in FIG. 10 has the same components as the remote control system shown in FIG. 1 except for some components. Therefore, in describing the remote control system shown in FIG. 10, features different from those of the remote control system shown in FIG. 1 will mainly be described.
  • a remote control system 100 includes a natural view based remote control console 110, targets 120 which are various information apparatuses to be controlled, and a target server 140 storing information on the targets 120 and user interfaces for the targets 120. Further, the remote control system 100 includes a first communication network 150, for connecting the target server 140 with the remote control console 110 and a second communication network 130 for connecting the targets 120 with the remote control console 110.
  • the remote control console 110 includes a target detection module 112, an NVUI mapping module 1000, an NVUI output module 114, and an NVUI interaction module 116.
  • the NVUI mapping module 1000 which is a peculiar component performs an NVUI mapping function. Specifically, when an NVUI firstly used after being generated in the target server 140 by the target detection module 112 and the NVUI output module 114 or an NVUI provided from the existing other remote control console 110 is acquired, the NVUI mapping module 1000 performs the NVUI mapping function to use the NVUI.
  • the NVUI mapping module 1000 may take part in acquiring the NVUI on the basis of information such as the URL, and the like of the target server 140 acquired by the target detection module 112.
  • FIG. 11 is a conceptual diagram illustrating driving the NVUI mapping module in the remote control system using the natural view user interface according to the third embodiment of the present invention.
  • FIG. 12 is an exemplary diagram of the driving of the NVUI mapping module in the remote control system using the natural view user interface according to the third exemplary embodiment of the present invention.
  • the description will be made with reference to the two figures.
  • an NVUI mapping module 112 of the first remote control console 1100 maps the NVUI.
  • the NVUI mapping module 112 of the first remote control console 1100 provides a basic template.
  • a product, a homepage, on/off, channel next/previous, volume up/down, a menu, and the like may be used.
  • the NVUI mapping module 112 prepares XML for the NVUI. This uses a data structure of a table form. An example thereof is shown in FIG. 14. In a third step, the NVUI mapping module 112 completes the mapping of the NVUI by matching the same item.
  • NVUI mapping module 112 may provide the target server 140 with the XML prepared for use thereafter. Therefore, on the basis of the XML, another remote control console (a second remote control console 1110 shown in FIG. 11) may easily use the NVUI in the future.
  • the NVUI mapping module 112 has used the NVUI of the same type as the provided NVUI, the NVUI mapping module adopts the used NVUI instead of the provided NVUI.
  • the present invention is not limited thereto and the NVUI mapping module 112 may use the provided NVUI after mapping the provided NVUI.
  • FIG. 11 is provided with an NVUI used in the past from the target server 140, the NVUI mapping module 112 searches for the XML for the NVUI in order to use the NVUI used in the past.
  • the XML for the NVUI may be extracted through a search, but XML 1120 or 1130 stored from the target server 140 or another remote control console (the second remote control console 1110 shown in FIG. 11) may be provided. Thereafter, the NVUI mapping module 112 executes item matching by using the provided XML 1120 or 1130.
  • the NVUI mapping module 112 needs the XML for the NVUI in order to use the first used NVUI or the NVUI used in the past.
  • a remote control will be described as an actual example. Referring to FIGS. 11 and 12, a user should create or acquire the XML for the NVUI of the NVUI mapping module 112 in order to control TVs or air-conditioners of other brands by using a user's TV remote control 1200 of a specific brand.
  • the user may control the TVs 1210 of other brand (for example, SONY) or an air-conditioner 1220 which is another electronic apparatus by using the user's TV remote control 1200 (for example, SAMUSUNG).
  • a TV remote control 400 is exemplified by an arrow symbol in FIG. 12.
  • FIG. 13 is a flowchart illustrating the method of providing a personalization service of the remote control system according to the third exemplary embodiment of the present invention.
  • the remote control console 110 acquires the NVUI from the target server 140
  • the NVUI mapping module 1000 of the remote control console 110 determines whether the acquired NVUI is the firstly used NVUI or the NVUI used in the past (S 1310). If the acquired NVUI is the NVUI used in the past, the NVUI mapping module 1000 requests the XML for the NVUI of remote control modules or the target server 140 through communication networks 130 and 150. Thereafter, the NVUI mapping module 1000 executes the item matching by using the provided XML. The NVUI output module 114 and the NVUI interaction module 116 display the mapped NVUI (S 1320). Meanwhile, if the XML for the NVUI cannot be acquired, the NVUI mapping module 1000 may prepare a new XML for the NVUI.
  • the NVUI mapping module 1000 determines whether or not other NVUIs of the same service type has been used (S 1330). If other NVUIs of the same service type have been used, the NVUI mapping module 1000 allows the remote control console to select the NVUI used in the past (S 1340), but if other NVUIs of the same service type have not been used, the NVUI mapping module 1000 abandons the use of the acquired NVUI or prepares the XML for the acquired NVUI (S 1350).
  • the XML for the NVUI is not prepared by the NVUI mapping module 112, but may be prepared by other functional parts of the remote control console 110 or the target server 140. Thereafter, the NVUI output module 113 and the NVUI interaction module 114 of the remote control console 110 display the selected NVUI (S 1320).
  • an NVUI created in accordance with the actual physical interface of the target 120 is stored in the target server 140.
  • the NVUI may be already created at the time of delivering the target 120.
  • the manufacturer of the target 120 may store the NVUI in the target server 140 by delivering and creating the NVUI in accordance with a user's request.
  • the remote control console 110 detects the target 120 in the second communication network 130 by the interaction between the target detection module 112 of the remote control console 110 and the target informing module 122 of the target 120, and acquires the information on the target 120 from the target 120.
  • the acquired information on the target 120 may include URL of the target server 140, a product name and a model number of the target 120, and the like.
  • the remote control console 110 accesses the target server 140 through the first communication network 150 on the basis of the acquired information on the target and acquires the NVUI in accordance with the ID of the target 120 from the target server 140.
  • the acquired NVUI includes the same interface image and description file as the physical interface of the target 120.
  • the remote control console 110 determines whether the acquired NVUI is the first used NVUI or the NVUI used in the past. If the acquired NVUI is the firstly used NVUI, mapping of the NVUI is executed. The mapping is described with reference to FIG. 13.
  • the NVUI output module 114 of the remote control console 110 outputs the NVUI to the display of the remote control console 110. At this time, it is preferable that the NVUI output module 114 adjusts an image form of the NVUI in accordance with the size of the display of the remote control console 110.
  • the user inputs a control signal of the target 120 through the NVUI outputted to the remote control console 110.
  • the NVUI interaction module 116 of the remote control console 110 creates a control command of the target on the basis of the inputted control signal and transmits the control command to the target 120 through the second communication network 130.
  • a target control module 124 of the target 120 controls functions of the target 120 on the basis of the control command received from the NVUI interaction module 116 of the remote control console 110.
  • the remote control console 110 of the remote control system may further include a target identity module 600 identifying the target 120 to be controlled.
  • FIG. 1 is a schematic block diagram of a remote control system using a natural view user interface according to a first exemplary embodiment of the present invention.
  • FIG. 2 is a diagram illustrating an example of an interface image of the NVUI.
  • FIG. 3 is a diagram illustrating a state in which a Copy button is pressed in an example of the NVUI.
  • FIG. 4 is a diagram illustrating a description file for the NVUI in accordance with
  • FIG. 3 is a flowchart illustrating an operation method of a remote control system according to the first exemplary embodiment of the present invention.
  • FIG. 6 is a schematic block diagram of a remote control system using a natural view user interface according to a second exemplary embodiment of the present invention.
  • FIG. 7 is a schematic view illustrating a process of detecting a target by using a maker in the remote control system according to the second exemplary embodiment of the present invention.
  • FIG. 8 is a schematic diagram illustrating a process of detecting a target by using a logo in the remote control system according to the second exemplary embodiment of the present invention.
  • FIG. 5 is a flowchart illustrating an operation method of a remote control system according to the first exemplary embodiment of the present invention.
  • FIG. 6 is a schematic block diagram of a remote control system using a natural view user interface according to a second exemplary embodiment of the present invention.
  • FIG. 7 is a schematic view illustrating a process of detecting a target by using a maker in the
  • FIG. 9 is a schematic diagram illustrating a method of identifying a target by using a natural view (that is, an actual view) of the target in the remote control system according to the second exemplary embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a remote control system using a natural view user interface according to a third exemplary embodiment of the present invention.
  • FIG. 11 is a conceptual diagram of an NVUI mapping module in the remote control system using the natural view user interface according to the third exemplary embodiment of the present invention.
  • FIG. 12 is an exemplary diagram of driving the NVUI mapping module in the remote control system using the natural view user interface according to the third exemplary embodiment of the present invention.
  • FIG. 13 is a flowchart illustrating a method of providing a personalization service of the remote control system according to the third exemplary embodiment of the present invention.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Selective Calling Equipment (AREA)

Abstract

La présente invention concerne un système de télécommande mettant en œuvre une interface utilisateur basée sur une vue naturelle permettant la commande intuitive par l'utilisateur de divers appareils d'information en fournissant une interface utilisateur à base d'une vue naturelle pour une interface physique réel de divers appareils d'information dans un espace intelligent comprenant divers appareils d'information et assurant la cohérence de l'interface utilisateur. Le système de télécommande pour la commande à distance d'une cible dans un espace intelligent comporte : la cible à commander ; un serveur cible assurant le stockage d'une interface utilisateur à base de vue naturelle formée selon la même image qu'une interface physique de la cible ; et un pupitre de télécommande assurant la commande de l'interface utilisateur à base d'image naturelle depuis le serveur cible par l'acquisition de l'interface utilisateur à base d'image naturelle provenant du serveur cible par la détection de la cible, et recevant une information concernant le serveur cible assurant le stockage de l'identification de la cible et l'interface utilisateur à base d'image naturelle de la cible provenant de la cible.
PCT/KR2008/004851 2007-08-20 2008-08-20 Système de télécommande mettant en œuvre une interface utilisateur, dispositif de télécommande, et procédé correspondant Ceased WO2009025499A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2007-0083562 2007-08-20
KR1020070083562A KR20090019266A (ko) 2007-08-20 2007-08-20 자연 영상 기반 사용자 인터페이스를 이용한 원격 제어시스템, 원격 제어 장치, 및 그 방법
KR10-2008-0012848 2008-02-13
KR1020080012848A KR101012458B1 (ko) 2008-02-13 2008-02-13 자연영상 기반 사용자 인터페이스를 이용하여 개인화된서비스를 제공하는 원격제어 장치와 이를 구비하는원격제어 시스템 및 그 방법, 상기 방법을 구현하는프로그램이 기록된 기록매체

Publications (1)

Publication Number Publication Date
WO2009025499A1 true WO2009025499A1 (fr) 2009-02-26

Family

ID=40378343

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2008/004851 Ceased WO2009025499A1 (fr) 2007-08-20 2008-08-20 Système de télécommande mettant en œuvre une interface utilisateur, dispositif de télécommande, et procédé correspondant

Country Status (1)

Country Link
WO (1) WO2009025499A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010098591A2 (fr) 2009-02-27 2010-09-02 Samsung Electronics Co., Ltd. Système et procédé d'interface utilisateur à distance
EP2479734A1 (fr) * 2011-01-24 2012-07-25 Zachodniopomorski Uniwersytet Technologiczny w Szczecinie Mode de monitoring et de contrôle des parametres du processus industriel
EP2575289A1 (fr) * 2011-09-30 2013-04-03 Kabushiki Kaisha Toshiba Appareil électronique et programme informatique
US11402812B1 (en) 2019-03-22 2022-08-02 The Chamberlain Group Llc Apparatus and method for controlling a device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010032202A (ko) * 1998-09-17 2001-04-16 요트.게.아. 롤페즈 프로그램가능한 제어 장치를 업데이트하기 위한인터넷-기반 서비스
KR20060056728A (ko) * 2004-11-22 2006-05-25 주식회사 코맥스 원격제어 시스템의 원격 제어 방법
KR20060125735A (ko) * 2003-11-04 2006-12-06 코닌클리케 필립스 일렉트로닉스 엔.브이. 터치 스크린을 구비한 범용 원격 제어 장치
KR20070076808A (ko) * 2006-01-20 2007-07-25 주식회사 제노프릭스 다수의 기기제어를 위한 범용 리모콘 시스템

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010032202A (ko) * 1998-09-17 2001-04-16 요트.게.아. 롤페즈 프로그램가능한 제어 장치를 업데이트하기 위한인터넷-기반 서비스
KR20060125735A (ko) * 2003-11-04 2006-12-06 코닌클리케 필립스 일렉트로닉스 엔.브이. 터치 스크린을 구비한 범용 원격 제어 장치
KR20060056728A (ko) * 2004-11-22 2006-05-25 주식회사 코맥스 원격제어 시스템의 원격 제어 방법
KR20070076808A (ko) * 2006-01-20 2007-07-25 주식회사 제노프릭스 다수의 기기제어를 위한 범용 리모콘 시스템

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010098591A2 (fr) 2009-02-27 2010-09-02 Samsung Electronics Co., Ltd. Système et procédé d'interface utilisateur à distance
EP2401871A4 (fr) * 2009-02-27 2013-12-25 Samsung Electronics Co Ltd Système et procédé d'interface utilisateur à distance
EP2479734A1 (fr) * 2011-01-24 2012-07-25 Zachodniopomorski Uniwersytet Technologiczny w Szczecinie Mode de monitoring et de contrôle des parametres du processus industriel
EP2575289A1 (fr) * 2011-09-30 2013-04-03 Kabushiki Kaisha Toshiba Appareil électronique et programme informatique
US11402812B1 (en) 2019-03-22 2022-08-02 The Chamberlain Group Llc Apparatus and method for controlling a device
US11822302B1 (en) 2019-03-22 2023-11-21 The Chamberlain Group Llc Apparatus and method for controlling a device

Similar Documents

Publication Publication Date Title
KR101287497B1 (ko) 홈-네트워크 시스템의 제어 명령 전달 장치 및 그 방법
US8952779B2 (en) Portable terminal, method, and program of changing user interface
US8839137B2 (en) Information processing device, table, display control method, program, portable terminal, and information processing system
US11609541B2 (en) System and method of IOT device control using augmented reality
JP6448900B2 (ja) 状況情報基盤の情報提供方法、そのシステム及びその記録媒体
US20090285443A1 (en) Remote Control Based on Image Recognition
EP2666285B1 (fr) Procédé et appareil pour commander un dispositif
US8612636B2 (en) Method and apparatus for generating or using interaction activity information
EP3174307B1 (fr) Dispositif de commande à distance, et procédé d'utilisation associé
KR20130052750A (ko) 미디어 데이터의 스트리밍 제어방법 및 제어장치
CN101581969A (zh) 运动驱动系统和相关的运动数据库
KR101862358B1 (ko) 연계 사용 정보를 생성 또는 이용하는 방법 및 그 장치
KR20170091426A (ko) 디스플레이장치 및 그 제어방법
EP2563032A1 (fr) Connecteur électrique coaxial et ensemble de connecteur électrique coaxial
WO2009025499A1 (fr) Système de télécommande mettant en œuvre une interface utilisateur, dispositif de télécommande, et procédé correspondant
WO2014108284A1 (fr) Dispositif mobile et procédé destiné à établir une liaison sans fil
US20190052745A1 (en) Method For Presenting An Interface Of A Remote Controller In A Mobile Device
US20100228821A1 (en) Data access system, terminal apparatus, and method for accessing data
CN101002238A (zh) 用于控制设备的方法
KR101012458B1 (ko) 자연영상 기반 사용자 인터페이스를 이용하여 개인화된서비스를 제공하는 원격제어 장치와 이를 구비하는원격제어 시스템 및 그 방법, 상기 방법을 구현하는프로그램이 기록된 기록매체
US20150184992A1 (en) Electronic device and method of operating application thereof
EP4518329A1 (fr) Dispositif d'affichage et procédé de partage de contenu pour partager un contenu avec un dispositif d'affichage externe
JP2003023680A (ja) 遠隔操作器、遠隔操作方法及び遠隔操作制御システム
KR20090019266A (ko) 자연 영상 기반 사용자 인터페이스를 이용한 원격 제어시스템, 원격 제어 장치, 및 그 방법
AU2014227452B2 (en) Method and apparatus for generating or using interaction activity information

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08793364

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08793364

Country of ref document: EP

Kind code of ref document: A1