WO2005071604A2

WO2005071604A2 - Graphical user interface

Info

Publication number: WO2005071604A2
Application number: PCT/IB2005/050099
Authority: WO
Inventors: Mauro Barbieri
Original assignee: Koninklijke Philips Electronics NV
Current assignee: Koninklijke Philips NV
Priority date: 2004-01-20
Filing date: 2005-01-10
Publication date: 2005-08-04
Anticipated expiration: 2006-07-20
Also published as: TW200537381A; WO2005071604A3

Abstract

An apparatus (100, 200, 300) comprises: distance determining means (104) for determining a distance between a user and the apparatus (100, 200, 300); and a display device (102) for displaying a first layout of a graphical user interface comprising a set of at least two user interface components (106, 108) if the determined distance is below a predetermined threshold and for displaying a second layout of the graphical user interface comprising a sub-set (106) of the set, if the determined distance is above the predetermined threshold, the sub-set (106) having fewer user interface components than the set.

Description

Graphical user interface

The invention relates to an apparatus comprising means for generating a graphical user interface for displaying on a display device. The invention further relates to a method of displaying a graphical user interface on the display device. The invention further relates to a computer program product to be loaded by a computer arrangement, comprising instructions to display a graphical user interface on a display device of an apparatus.

An embodiment of the apparatus of the kind described in the opening paragraph is well known. The graphical user interface has a layout of user interface components. Several types of user interface components are known, e.g. buttons, scroll bars, option gadgets and viewports for displaying images. User interface designers try to develop an appropriate user interface for an application which runs on the apparatus. The user interface comprises output user interface components to provide the user with content related information, e.g. video data or text. Besides that the output user interface components are applied to provide the user with status related information. The input user interface components form means for the user to control the application which runs on the apparatus. Because of price issues or lack of space, in many cases the effective size of the display device is less than required. The result is that user interface designers find difficulties in developing user interfaces which comprise the required user interface components under the restriction of good visibility and/or readability.

It is an object of the invention to provide an apparatus of the kind described in the opening paragraph which is arranged to dynamically optimize the appearance of the graphical user interface. This object of the invention is achieved in that the apparatus comprises: distance determining means for determining a distance between a user and the apparatus; and a display device for displaying a first layout of a graphical user interface comprising a set of at least two user interface components if the determined distance is below a predetermined threshold and for displaying a second layout of the graphical user interface comprising a sub-set of the set, if the determined distance is above the predetermined threshold, the sub-set having fewer user interface components than the set. The apparatus according to the invention is arranged to optimize the appearance of the graphical user interface on basis of the determined distance between the user and the apparatus. The apparatus according to the invention is arranged to select an appropriate layout of the graphical user interface on basis of the determined distance. The invention is based on the observation that the presence of some user interface components is no longer required if the distance between the user and the apparatus is above the predetermined threshold. For example if the distance between the user and the apparatus is larger than e.g. 1 m and the apparatus comprises a touch screen as input device than it seems useless to display input user interface components like buttons. Since, a typical arm length is less than 1 m. Actual control of the apparatus is not possible then. Another issue is that the readability and/or visibility of some user interface components might be relatively low, i.e. displaying these user interface components is less useful. The apparatus can comprise the display device. Alternatively, the display device is part of another apparatus. In the latter case the concept of OSD (On Screen Display) is applied. An embodiment of the apparatus according to the invention is arranged to display a first one of the user interface components of the set with a first size, as part of the first layout and to display the first one of the user interface components with a second size, as part of the second layout, the second size being larger than the first size. That means that the actual size of a particular user interface component is based on the determined distance. If the user is further away from the apparatus then the actual size of the particular user interface component should be bigger for an improved visibility and/or readability. An embodiment of the apparatus according to the invention is arranged to display a first one of the user interface components of the set at a first spatial location of the display device, as part of the first layout and to display the first one of the user interface components at a second spatial location of the display device, as part of the second layout. A relocation of user interface components can be advantageous for esthetical reasons. However also the visibility and/or readability can be improved by the relocation of the user interface components. The set of user interface components might comprise an output component for providing information to the user. E.g. the output component represents an image or the output component is related to a state of the apparatus. The set of user interface components might also comprise an input component. Typically the input component represents means to control functionality of the apparatus. In an embodiment of the apparatus according to the invention, the set comprises the input component and the output component and the sub-set comprises the output component. The input component is no longer visible in the second layout. Preferably the output component as visible in the second layout is larger than as visible in the first layout. It is an object of the invention to provide a method of the kind described in the opening paragraph which is arranged to dynamically optimize the appearance of the graphical user interface. This object of the invention is achieved in that the method comprises: determining a distance between a user and the apparatus; and displaying a first layout of the graphical user interface comprising a set of at least two user interface components if the determined distance is below a predetermined threshold and for displaying a second layout of the graphical user interface comprising a subset of the set, if the determined distance is above the predetermined threshold, the sub-set having fewer user interface components than the set. It is an object of the invention to provide a computer program product of the kind described in the opening paragraph which is arranged to dynamically optimize the appearance of the graphical user interface. This object of the invention is achieved in that the computer program product to be loaded by a computer arrangement, comprising instructions to display a graphical user interface on a display device of an apparatus, the computer arrangement comprising processing means and a memory, the computer program product, after being loaded, provides said processing means with the capability to carry out: determining a distance between a user and the apparatus; and displaying a first layout of the graphical user interface comprising a set of at least two user interface components if the determined distance is below a predetermined threshold and for displaying a second layout of the graphical user interface comprising a sub- set of the set, if the determined distance is above the predetermined threshold, the sub-set having fewer user interface components than the set. Modifications of the apparatus may correspond to modifications and variations thereof of the method and the computer program product, being described.

These and other aspects of the apparatus, of the method and of the computer program product, according to the invention will become apparent from and will be elucidated with respect to the implementations and embodiments described hereinafter and with reference to the accompanying drawings, wherein: Fig. 1 A schematically shows an embodiment of the apparatus according to the invention, in a first state; Fig. IB schematically shows the embodiment of the apparatus of Fig. 1A, in a second state; Fig. 2A schematically shows another embodiment of the apparatus according to the invention, in a first state; Fig. 2B schematically shows the embodiment of the apparatus of Fig. 2A, in a second state; Fig. 2C schematically shows the embodiment of the apparatus of Fig. 2A, in a third state; and Fig. 3 shows a hardware/software design of the apparatus according to the invention. Same reference numerals are used to denote similar parts throughout the figures.

Fig. 1 A schematically shows an embodiment of the apparatus 100 according to the invention, in a first state. The first state corresponds to having established the presence of an object, in particular a user, in the proximity of the apparatus 100. That means that the apparatus has determined that there is an object having a distance from the apparatus which is below a predetermined threshold. The apparatus 100 is a multimedia device which is arranged to the display sequences of video images. These video images might be received by means of an antenna or cable which is connected to a network. Alternatively, the video images are stored within an internal memory device. Preferably, this memory device is removable. The memory device can be based on optical storage. Alternatively, the memory device is a solid state memory device. The apparatus comprises a display device 102 and distance determining means 104 for determining the distance between a user and the apparatus 100. Preferably, the distance determining means 104 are disposed adjacent to the display device 102. The determining of the distance might be based on acoustic, ultra-violet or radio frequency waves. The distance determining means 104 are arranged to detect the presence of an object, in their vicinity. Distance determining means 104 means based on light are commercially available, e.g. at IVO GmbH & Co. Typically these optical sensing means are arranged to measure a distance. These determining means are so-called proximity detectors. Alternatively, the distance between the apparatus and the user is determined using a video camera equipped with face detection. The size of the detected face is related to the distance of the user. This can prevent the fact that objects in the proximity of the apparatus influence the calculation of the distance using proximity sensors. The apparatus 100, being in the first state displays a first layout of a graphical user interface. The graphical user interface comprises a set of user interface components 106, 108, 110. The first one 106 of the user interface components is a output user interface component. It is a viewport for displaying an image. This image might be a still picture or it might be an image from a sequence of a video images. In this case the image represents an actor. The first layout of the graphical user interface also comprises two input user interface components 108, 110, i.e. so-called button-gadgets or button-widgets. The first one 108 of the input user interface components is related to a first user input command, e.g. starting the display of video content. The second one 110 of the input user interface components is related to a second user input command, e.g. stopping the display of video content. The extent of the various user interface components 106, 108, 110 is such that the complete display device is filled, i.e. all pixels of the display device are allocated to one of the user interface components 106, 108, 1 10. Fig. IB schematically shows the embodiment of the apparatus of Fig. 1A, in a second state. The second state corresponds to having established that there is no user in its direct proximity. That means that the apparatus has determined that there is no user having a distance from the apparatus which is below a predetermined threshold or that the apparatus has determined that there is a user having a distance from the apparatus which is above the predetermined threshold. The apparatus 100, being in the second state displays a second layout of the graphical user interface. Now, the graphical user interface comprises only one user interface component 106. The only visible user interface component 106 is a output user interface component. This particular user interface component 106 is also visible when the apparatus 100 is in the first state, as depicted and described in connection with Fig. 1A. The extent of the visible user interface component 106 is such that the complete display device 102 is applied, i.e. all pixels of the display device 102 are allocated to the output user interface component 106. Comparing the first layout of the graphical user interface as described in connection with Fig. 1A and the second layout of the graphical user interface as described in connection with Fig. IB, it becomes clear that the output user interface component 106 is larger in the second case. Fig. 2A schematically shows another embodiment of the apparatus 200 according to the invention, in a first state. Fig. 2B schematically shows the embodiment of the apparatus 200 of Fig. 2A, in a second state and Fig. 2C schematically shows the embodiment of the apparatus 200 of Fig. 2A, in a third state. These three states, i.e. first state, second state, third state, correspond to respective distances between a user and the apparatus 200. The first state corresponds to a first distance, the second state corresponds to a second distance which is larger than the first distance and the third state corresponds to a third distance which is larger than the second distance. The apparatus 200 is an audio device which is arranged to generate music. The audio device is e.g. a radio, a CD player, a CD recorder or a portable device like a disk-man or an MP3 -player. The apparatus 200 is arranged to display a graphical user interface on its display device 102. The graphical user interface has a first layout when the apparatus is in the first state, the graphical user interface has a second layout when the apparatus is in the second state and the graphical user interface has a third layout when the apparatus is in the third state. The first layout comprises an output user interface component 202, which represents the name of the artists of which music is generated by the apparatus. In this example music of the "Rolling Stones" can be heard. The first layout further comprises six input user interface components 204, 206, 208, 210, 212, 214. Each of these six input user interface components corresponds to a respective user input commands. The actual user input can be accepted by means of an input device (not depicted). The input device might be a touch screen, a remote control or a mouse controlling a cursor. The second layout also comprises the output user interface component 202, as depicted in Fig. 2A. However the size of the output user interface component 202 is larger in the second layout than in the first layout. That means that in the second layout more pixels are allocated to the output user interface component 202, than in the first layout. Besides the size, also the spatial coordinates of the center of the output user interface component 202 within the first layout differ from the spatial coordinates of the center of the output user interface component 202 in the first layout. Another difference between the first layout and the second layout is that a number of input user interface components 208, 210, 212, 214 are not comprised in the second layout. The extent of the input user interface components 204, 206 which are comprised in the second layout is larger than the corresponding representations of these user interface components 204, 206 in the first layout. The third layout also comprises the output user interface components 202, as depicted in Fig. 2A. However the size of the output user interface component 202 is larger in the third layout than in the first layout and even larger than in the second layout. That means that in the third layout more pixels are allocated to the output user interface component 202, than in the second layout. Besides the size, also the spatial coordinates of the center of the output user interface component 202 within the third layout differ from the spatial coordinates of the center of the output user interface component 202 in the first layout.

Another difference between the first layout and the third layout is that the third layout does not comprise input user interface components 204, 206. The third layout comprises a new output user interface component 216. This new output user interface component 216 represents the current frequency spectrum of the music which is generated by the apparatus 200. Fig. 3 shows a hardware/software design of the apparatus 300 according to the invention, comprising: a display device 102; distance determining means 104 for determining the distance between a user and the apparatus 300; a memory device 306 for storage of values of properties of user interface components; a layout manager 302 for updating the values of the properties of the user interface components on basis of a distance signal being provided by the distance determining means 104; a rendering means 304 for rendering the user interface components on basis of the values of the properties of the user interface components as stored in the memory device 306. The working of the apparatus 300 will be explained by means of the example as described in connection with Fig. 1 A and Fig. IB. The memory device 306 is arranged to store the values of the properties of the user interface components for each of the possible layouts. Table 1 A gives an example of the values of the properties of the user interface components being comprised in the first layout. Table IB gives an example of the values of the properties of the user interface components being comprised in the second layout.

Table 1 A: Template First layout: distance D < 0.5m

The distance determining means 104 determines the distance between the apparatus 300 and the user. If the distance is below a predetermined threshold then the layout manager 302 selects the template corresponding to the first layout. As a result the actual values of the properties of the user interface components are determined by the template of the first layout. The layout manager 302 notifies the rendering means 304 about the update which has taken place. On basis of the actual values the rendering means 304 will create the visual representations of the user interface components. These visual representations are visible on the display device 102. Alternatively, another storage approach for the storage of the values of the properties of the user interface components is applied. Table 2 shows an example of an alternative storage which is based on the graphical user interface of the apparatus 200 as described in connection with Fig. 2A, Fig. 2B, Fig. 2C.

Table 2: Template Audio player

The layout manager 302 and rendering means 304 may be implemented using one processor. Normally, these functions are performed under control of a software program product. During execution, normally the software program product is loaded into a memory, like a RAM, and executed from there. The program may be loaded from a background memory, like a ROM, hard disk, or magnetically and/or optical storage, or may be loaded via a network like Internet. Optionally an application specific integrated circuit provides the disclosed functionality. A large number of types of user interface components can be applied. The examples above (See Tables 1A, IB, 2) mention the types: button, text, viewport and BarPlot. Other types might be sliders, scroll bars, option gadgets and cyclic option gadgets. The apparatus according to the invention can be comprised in many systems and applications, e.g. computer applications, TV sets, audio equipment, DVD players, DVD recorders, set-top boxes, satellite tuners, etc. It should be noted that the above-mentioned embodiments illustrate rather than limit the invention and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be constructed as limiting the claim. The word 'comprising' does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitable programmed computer. In the unit claims enumerating several means, several of these means can be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words are to be interpreted as names.

Claims

CLAIMS:

1. An apparatus (100, 200, 300) comprising: distance determining means (104) for determining a distance between a user and the apparatus (100, 200, 300); and means for generating, on a display device (102), a first layout of a graphical user interface comprising a set of at least two user interface components (106,108) if the determined distance is below a predetermined threshold and for displaying a second layout of the graphical user interface comprising a sub-set (106) of the set, if the determined distance is above the predetermined threshold, the sub-set (106) having fewer user interface components than the set.

2. An apparatus (100, 200, 300) as claimed in Claim 1 , whereby the apparatus (100, 200, 300) is arranged to display a first one of the user interface components (106) of the set with a first size, as part of the first layout and to display the first one of the user interface components (106) with a second size, as part of the second layout, the second size being larger than the first size.

3. An apparatus (100, 200, 300) as claimed in Claim 1, whereby the apparatus (100, 200, 300) is arranged to display a first one of the user interface components (106) of the set at a first spatial location of the display device (102), as part of the first layout and to display the first one of the user interface components (106) at a second spatial location of the display device (102), as part of the second layout.

4. An apparatus (100, 200, 300) as claimed in Claim 1, whereby the set comprises an output component for providing information to the user.

5. An apparatus (100, 200, 300) as claimed in Claim 4, whereby the output component represents an image.

6. An apparatus (100, 200, 300) as claimed in Claim 4, whereby the output component is related to a state of the apparatus (100, 200, 300).

7. An apparatus (100, 200, 300) as claimed in Claim 1 or 4, whereby the set comprises an input component.

8. Apparatus (100, 200, 300) as claimed in Claim 7, whereby the input component represents means to control functionality of the apparatus (100, 200, 300).

9. Apparatus (100, 200, 300) as claimed in Claim 7, whereby the set comprises the input component and the output component and the sub-set (106) comprises the output component.

10. A method of displaying a graphical user interface on a display device (102) of an apparatus ( 100, 200, 300), the method comprising: determining a distance between a user and the apparatus (100, 200, 300); and displaying a first layout of the graphical user interface comprising a set of at least two user interface components (106,108) if the determined distance is below a predetermined threshold and for displaying a second layout of the graphical user interface comprising a sub-set (106) of the set, if the determined distance is above the predetermined threshold, the sub-set (106) having fewer user interface components than the set.

11. A computer program product to be loaded by a computer arrangement, comprising instructions to display a graphical user interface on a display device (102) of an apparatus (100, 200, 300), the computer arrangement comprising processing means and a memory, the computer program product, after being loaded, providing said processing means with the capability to carry out: determining a distance between a user and the apparatus (100, 200, 300); and displaying a first layout of the graphical user interface comprising a set of at least two user interface components (106,108) if the determined distance is below a predetermined threshold and for displaying a second layout of the graphical user interface comprising a sub-set (106) of the set, if the determined distance is above the predetermined threshold, the sub-set (106) having fewer user interface components than the set.