CN1996092A - Focus-adjustable head-mounted display system with virtual keyboard and device used in the system - Google Patents

Abstract

The main objective of the present invention is to provide a head-mounted display system with virtual keyboard and adjustable focal length, which comprises: a signal processing unit for processing the received image signal; a focus adjusting unit contained in the signal processing unit, the focus adjusting unit adjusting the input image according to a focus adjusting signal, the adjusted display image adjusting the input image according to the focus adjusting signal; an image display unit connected to the signal processing unit, the image display unit being installed in a head-mounted display device to display the adjusted display image, and a focus input unit connected to the focus adjustment unit, the focus input unit being a manually operated device to generate the focus adjustment signal to the signal processing unit; the focal length input unit provides a focal length value to the focal length adjusting unit; and a virtual keyboard input unit, wherein the virtual keyboard input unit comprises a hand-designated bit unit, a keyboard display unit, a key input processing unit and a virtual keyboard.

Description

Focus-adjustable head-mounted display system with virtual keyboard and device used in the system

technical field

The present invention relates to a head-mounted display, especially a head-mounted display system with an adjustable focus of a virtual keyboard and a device for realizing the system. A finger pointing device performs a button input action.

Background technique

In US Pat. No. 6,369,952, a head-mounted display device is proposed to transmit a generated image to the user for viewing. Preferably, the generated image is combined with an external image. The head-mounted display device includes a housing part to fix the optical components in the housing part, and an image generator is shielded by at least two masks to provide high-quality images; the device also includes a detachable Install a shielding unit or a movable device, and convert the display screen from a transmissive lens to a display, and vice versa; and the device can be installed on the user's head while still allowing The user uses conventional glasses; and can be easily separated from the HMD. This allows the HMD to be used alone (eg for watching movies).

A wearable display system is also proposed in US Pat. No. 6,611,385, which includes a display panel for displaying signals processed in a predetermined manner. The wearable display system includes a grating to output signals from the display panel, an optical waveguide to guide signals through the grating, a magnifying lens to amplify the signals amplified by the optical waveguide, and display the signals to user's eyes. It is combined with one or more substrates to form an optical waveguide. According to the wearable display system, the optical waveguide can be adjusted to be installed to meet the specifications, and furthermore, the optical waveguide can be manufactured and installed individually; thus applying the least amount of time and effort to manufacture the head-mounted display system.

In U.S. Patent No. 5,991,084, a sophisticated virtual image display system has been proposed, which includes a microdisplay, a first amplifying light device comprising three surfaces, a display input surface, a reflective/transmissive surface, and a reflective first The surface of the amplifying component, and a second amplifying light device. The light of the displayed object enters the first amplifying light device on the display input surface, and the light propagates in the first amplifying light device, so that the light is projected onto an area of the back-reflective penetrating surface, at least a part of which is within the field of view provided by the second amplifying light device, the reflection/transmission surface corresponding to the first angle of the reflection/transmission surface, so that the light is reflected by the reflection/transmission surface and directed to the reflective first A magnifying component surface; and the first magnifying component surface reflects light corresponding to the source target, such as an enlarged virtual image, and then the magnified virtual image is in the first amplifying light device with a second incident corresponding to the reflection/transmission surface The angle is transmitted back to the reflection/transmission surface, and leaves the first amplifying light device through the reflection/transmission surface; and a plurality of the second amplifying light devices receive the enlarged virtual image from the first amplifying light device, And the synthesized magnified virtual image of the magnified virtual image of the source object is displayed to the viewer.

In US Pat. No. 6,683,584 a camera display system is proposed which displays information via a matrix display assembly mounted on a housing part positioned to correspond to at least one eye of the user. The display is connected to a video or image sensor so that the user can see information or images displayed on the display; within or outside the observer's field of vision.

In U.S. Patent No. 6,680,802, a monocular head-mounted display device has been proposed. The device is quite delicate and suitable for wearing by the user. It includes a viewer and an elastic component; the viewer includes an LCD, a main prism, A lens, a mirror frame, and a microphone. The main lens introduces an image, and then displays the image on the LCD, so that the user can see the image at least one eye; the penetrating lens is fixed on a main lens; the microphone is installed on the mirror frame; the elastic component includes A nose frame is used to support the elastic component, so the viewer can be positioned at a predetermined position in front of both eyes of the user.

However, all the traditional technologies described above only provide optical systems or mechanical structures to display images to the head-mounted display system, but none of the conventional technologies provide information related to input keyboards, especially for virtual keyboards. That is, any information that reaches the keyboard input by finger positioning or in the form of sound is not proposed in any of the above-mentioned inventions.

Furthermore, no structures or mechanisms related to the viewing quality of the human eye have been proposed. In addition, many people have eye diseases, such as hyperopia, nearsightedness, amblyopia or strabismus, etc., so they cannot see clear images clearly. Therefore, when a normally clear image is displayed on the display screen of the head-mounted display device, it is a blurred image for viewers with eye diseases. For example, myopia usually wears glasses to adjust the focal length of the image so that the image The focal length of the head-mounted display can fall on the user's retina; but the general wearer of the head-mounted display device often does not have or is inconvenient to wear a pair of glasses, so the traditional head-mounted display device is not suitable for wearers with eye diseases. Therefore, it is necessary to have a head-mounted display device capable of adjusting the focus, so that the user can watch clear images.

Description of the invention

The main purpose of the present invention is to provide a head-mounted display system with a virtual keyboard and a device for realizing the system. The present invention provides a virtual keyboard so that users can perform key input actions through a finger positioning device.

Another object of the present invention is to provide a head-mounted display system with a virtual keyboard, which includes: a signal processing unit connected to the digital content storage for receiving image signals from the digital content storage, and processing the received image signal; a focus adjustment unit is included in the signal processing unit, the focus adjustment unit adjusts an input image from the digital content storage according to a focus adjustment signal, thereby generating an adjusted display image, The adjusted display image adjusts the input image according to the focus adjustment signal; an image display unit connected to the signal processing unit, the image display unit is installed in a head-mounted display device to display the adjusted display image, so that the user wearing the head-mounted display device can visually view the adjusted display image with at least one eye; and a focus input unit connected to the focus adjustment unit, the focus input unit is a manually operated device to generate The focus adjustment signal is sent to the signal processing unit; the focus input unit provides a focus value to the focus adjustment unit; and a virtual keyboard input unit, wherein the virtual keyboard input unit includes a finger positioning unit, a keyboard display unit, a A key input processing unit and a virtual keyboard.

The present invention further provides a head-mounted display device with a virtual keyboard, and the device includes: a housing part for accommodating certain components of the head-mounted display device; at least one frame for taking in A digital content storage for external images; an image display unit; the image display unit includes at least one display screen corresponding to at least one eye of the user wearing it; a focus input unit connected to the focus adjustment unit for generating a A focus adjustment signal is input to the signal processing unit; and the focus input unit provides a focus value to a focus adjustment software; and a finger positioning unit is worn by the user on the finger to sense the position of the finger, and thus will display the The position point signal of the finger position is transmitted back; a key input processing unit receives the position point signal from the finger positioning unit, and then corresponds the position point of the finger to the corresponding position on the virtual keyboard. After receiving the pressing action of the finger , that is, input the operation represented by the key indicated on the corresponding position into the signal processing unit for necessary signal processing.

In order to present the content of the present invention more specifically, the implementation forms of the present invention will be described in detail below with reference to the drawings.

In order to enable those skilled in the art to further understand the present invention, the details of the present invention will be described below; but the content and accompanying drawings described herein are to enable those skilled in the art to understand the purpose, features and characteristics of the present invention, Rather than limiting the present invention, the concept and spirit of the present invention are defined by the patent scope of the application.

Description of drawings

FIG. 1 is a perspective view of a head-mounted display device of the present invention.

FIG. 2 is a block diagram of the head-mounted display system of the present invention.

Fig. 3 is the assembly structure of the focus adjustment of the present invention.

Fig. 4 is a signal flow chart of finger button input in the present invention.

Fig. 5 is a signal flow chart of voice button input in the present invention.

FIG. 6 is a block diagram of another embodiment of the playing unit with key tone according to the present invention.

FIG. 7 is another embodiment of the head-mounted display device of the present invention, in which only a single display screen is used.

Detailed ways

Please refer to FIG. 1 now, which shows a head-mounted display device 1 with a virtual keyboard according to the present invention. The head-mounted display device 1 can be realized in the form of glasses, and the glasses include a housing portion 11 and two mirror frames 12, 13. The head-mounted display device of the present invention is mainly hidden in the shell part 11, and the shell part 11 has two display screens 14, 15 corresponding to the eyes of the person wearing the shell part.

However, the head-mounted display device of the present invention disclosed in FIG. 1 is a head-mounted display device showing a binocular form, but in the embodiment of the present invention, it can also be a single-eye form, that is, there is only a single display screen 15 mirror frames, as shown in Figure 7.

Now please refer to FIG. 2 and FIG. 3, which show a system block diagram of the head-mounted display device with adjustable focal length of the present invention, wherein the system is installed on the head-mounted display device 1 or is partially installed on the head-mounted display device 1. Head-mounted display device 1 . The system includes a signal processing unit 101 , a focus adjustment unit 102 , an image display unit 103 , and a virtual keyboard input unit 300 .

The aforementioned signal processing unit 101 can perform various signal processing required by the system.

The aforementioned focus adjustment unit 102 is installed in the signal processing unit 101 for adjusting the input image according to an input focus adjustment signal 20 , so that the displayed image is adjusted according to the focus adjustment signal 20 .

Another focus adjustment software 104 is installed in the focus adjustment unit 102, which can be seen in FIG. 3 . The focus adjustment software 104 operates on the input image to obtain an adjusted display image corresponding to the input image such that the adjusted display image has a specified focal length indicated by the focus adjustment signal 20 .

The image display unit 103 is connected to the signal processing unit 101, and the image display unit 103 is installed in the head-mounted display device 11 to display the adjusted display image, so that at least one eye wearing the glasses can to see the image.

A focus input unit 105 is connected to the focus adjustment unit 102, the focus input unit 105 is a device operated by hand, the user can adjust the focus input unit 105, and the focus adjustment signal 20 is generated accordingly to input the signal processing In the unit 101 , the focus input unit 105 provides a focus to the focus adjustment unit 102 .

In the present invention, the most important thing is to include a virtual keyboard input unit 300, as shown in Figure 4, wherein the virtual keyboard input unit 300 includes a finger positioning unit 301, a keyboard display unit 302, a key input processing unit 303, and a virtual keyboard 305 .

The finger positioning unit 301 is worn by the user on the finger to sense the position of the finger, as shown in FIG. In the present invention, the finger positioning unit 301 can be connected to the key input processing unit 303 in a wired or wireless manner.

After receiving the position point signal 30 from the finger positioning unit 301, the key input processing unit 303 corresponds the position point of the finger to the corresponding position on the virtual keyboard 305; The operation represented by the represented key is input to the signal processing unit 101 for necessary signal processing, if the key represents "a", it means that "a" is input.

The keyboard display unit 302 displays the relative positions of the keyboard and the fingers on the display screen to guide the user to visually observe the positions of the fingers.

In another embodiment of the present invention, as shown in FIG. 5, the present invention also includes a sound input unit 306, which is like a microphone, which can receive the user's voice input, convert it into a voice signal, and convert the voice The signal 32 is sent to the key input processing unit 303; in the present invention, the sound input unit 306 can be connected to the key input processing unit 303 in a wired or wireless manner.

After the key input processing unit 303 receives the voice signal 32 from the voice input unit 306 , it corresponds the voice represented by the voice signal to the corresponding position on the virtual keyboard 305 . After receiving the voice signal indicating pressing, input the operation represented by the key represented by the corresponding position into the signal processing unit 101 to perform necessary signal processing, if the key represents "a", it means input "a" .

The present invention also includes a sound playing unit 106, which is connected to the signal processing unit 101 to play sound signals, wherein the sound playing unit 106 can be a loudspeaker or an earphone.

Please refer to FIG. 6 , the present invention also includes a key input playback unit 307, which can transmit the signal represented by the key input by the key input processing unit 303 to the sound playback unit 106 to play in the voice mode. It is given to the user, so that the user can directly know the key input without going through the display screen.

In the present invention, the images of the two display screens 14 and 15 can be different, for example, one of the display screens displays a keyboard image, while the other display screen displays an image of a general monitor.

In some applications, the function of providing control to the user is helpful to the application of the present invention, and it is possible in some embodiments that the proposed control function is not in the head-mounted display device (such as making the remote control or master control device, etc.), in the embodiment shown, the present invention provides a button 16 to input the focus adjustment signal 20, so that different focus values are input from the button 16. In addition, a button 17 can be provided, which is a non-display function, that is, the button 17 can cause the image of the head-mounted display device to not be displayed; it is preferable to configure the non-display function so that the user can at least turn off the image and There is no need to turn on the power of the head-mounted display device, or to interrupt the input/output operation of data. Of course, the button 17 can also turn on the image display function and power at the same time. The present invention may also include a sound adjustment button 18 for adjusting the volume of the sound playing unit 106 .

Moreover, as shown in FIG. 1 , the present invention can also provide a button 50 that can turn on and off the button display function of the present invention.

Moreover, the present invention can also provide a button 19 , which turns on and off the head-mounted display device of the present invention.

Please refer to FIG. 1 again now, which shows that the signal processing unit 101 of the present invention is installed on the upper side of a display screen, but in the present invention, the signal processing unit 101 can be installed on any position of a head-mounted display, such as a mirror On the frame 12, 13, even the signal processing unit 101 is a component separate from the glasses, all of which are within the scope of the present invention.

In the present invention, the signal output of the display screen can be from a digital content storage device 100, which is a memory, such as DRAM, SRAM, flash memory, etc., which are used to store digital data, such as movies, songs, books, letters, web pages, short messages, Letters, programs, and all other recorded data, etc. The signal processing unit 101 is connected to the digital content storage 100 to receive the signal from the digital content storage 100, and then present the received signal on the display screen 14, 15; wherein, the data includes an image signal and non-image signals, or from an image capturing device 107 to capture external images, and the images are displayed to the user on the display screens 14 and 15 after the signal processing unit 101 .

In the present invention, the image display unit 103 can be a projected image display unit, that is, firstly generate a displayed image, and then project the image on the display screens 14 and 15, so that an image that can be viewed by human eyes can be obtained; Alternatively, the image display unit 103 is a direct image display unit, that is, the image is directly input to the display screen to be displayed to the user, for example, the display screen is provided with a liquid crystal display function. Moreover, in the present invention, the first button 16 is installed above a display screen 14, and the second button 17 is installed above the other display screen 15, as shown in the figure. However, the positions where the buttons 16, 17, 18, 19 are installed are not limited to the example shown in FIG. All such examples are within the spirit and concept of the invention.

As shown in FIG. 2 , the device of the present invention may further include an output device 108 to output data specified by the user from the signal processing unit 101 , wherein the data output can be performed in a wired or wireless manner.

In the present invention, the focusing of the two eyes can be controlled independently, so as to adapt to the different situations of binocular vision; In this embodiment, the button 17 can be used to switch the head-mounted display device of the present invention. When the button 17 is turned on, the head-mounted display device will act, thus starting the digital content storage 100, and processing from The digital content storage 100 captures the image, and displays the image on the image display unit 103; when the button is turned off, the head-mounted display device of the present invention is turned off, and the lens becomes a general lens, and can For viewing the outside world.

Moreover, in the present invention, the display screens 14 and 15 can be replaced by display screens, that is, they only have a display function without a lens function. Therefore, as mentioned above, in the present invention, there may be only a single display screen or display lens.

Although the present invention has been described in terms of preferred implementation, those skilled in the art can make modifications and changes to the above without departing from the spirit and viewpoint of the present invention after understanding. Only the viewpoint of the present invention is still limited by the scope of the patent application rather than the above-described embodiments; therefore, all other definitions of methods, types, etc. that are still equivalent to the scope of the patent application through configuration methods are included in the scope of the present invention view within.

Claims (16)

1. the focus-adjustable head-mounted type display system of a tool dummy keyboard is characterized in that comprising:

One signal processing unit is used to handle the signal of video signal that receives;

One focal length adjustment unit is included in this signal processing unit, this focal length adjustment unit is adjusted signal and is adjusted the input image according to a focal length, therefore produce a show image of adjusting, the show image of this adjustment is adjusted signal to whole this image of this input image according to this focal length;

One is connected to the image display cell of this signal processing unit, this image display cell is installed in the head-mounted display apparatus, to show the show image of this adjustment, make the user who dresses this head-mounted display apparatus can visually be somebody's turn to do the show image of adjusting at least at a glance; And

One is connected to the focal length input block of this focal length adjustment unit, and this focal length input block is a manually operated device, adjusts signal in this signal processing unit to produce this focal length; This focal length input block provides a focal length value to give this focal length adjustment unit; And

One dummy keyboard input block, wherein this dummy keyboard input block comprises a finger locating unit, a keyboard display unit, a button input processing unit and a dummy keyboard.

2. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1, it is characterized in that: this finger locating unit is to be worn on finger by the user to go up to sense the position of finger, therefore will show that the location point signal of this finger position transfers back to the button input processing unit.

3. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 2 is characterized in that: the finger locating unit can wired or wireless mode be connected to this button input processing unit.

4. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1, it is characterized in that: this button input processing unit receives the location point signal from this finger locating unit, the location point that to point corresponds to the correspondence position on this dummy keyboard later on, after the push action that receives finger, this signal processing unit is imported in the operation that is about to button representative represented on the correspondence position, to carry out necessary signal Processing.

5. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1 is characterized in that: this keyboard display unit be the relative position that on display screen, demonstrates this keyboard and finger with the guiding user can visual finger the position.

6. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1, it is characterized in that: still comprise a sound input block, can receive user's phonetic entry, change into voice signal again, and voice signal is sent to this button input processing unit.

7. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 6, it is characterized in that: this button input processing unit receives the voice signal from this sound input block, the location point that to point corresponds to the correspondence position on this dummy keyboard then, after receiving the voice signal that voice represent to push, this signal processing unit is imported in the operation that is about to button representative represented on the correspondence position, to carry out necessary signal Processing.

8. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 6 is characterized in that: still comprising a sound playing unit, is to be connected to this signal processing unit, with the signal that plays sound.

9. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 8 is characterized in that: this sound playing unit can be loudspeaker or earphone.

10. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 6, it is characterized in that: still comprise button input broadcast unit, this button input broadcast unit can be sent to the signal of the button representative imported by the button input processing unit this sound playing unit and play and give the user to use voice mode, makes can directly not know the button of being imported via display screen as the user.

11. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1 is characterized in that: this sound input block is a microphone.

12. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1 is characterized in that: the sound input block can wired or wireless mode be connected to this button input processing unit.

13. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1, it is characterized in that: this focal length adjustment unit comprises a focal length and adjusts software, this focal length is adjusted software operation should import image, therefore produce the show image of this adjustment, the image that the show image mapping of this adjustment will be imported, and to the focal length of this input image foundation from the appointment of one of this focal length adjustment signal, adjust importing this image.

14. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1 is characterized in that: still comprise an image-shooting device, to take in extraneous image, this image shows in display screen and gives the user behind signal processing unit.

15. the focus-adjustable head-mounted type display system of tool dummy keyboard as claimed in claim 1 is characterized in that: still comprise a digital content reservoir with storage of digital information.

16. the focus-adjustable head-mounted type display device of a tool dummy keyboard is characterized in that comprising:

One housing department, this housing department are used to hold some assembly of this head-mounted display apparatus;

At least one support body;

One signal processing unit is used to handle the signal of video signal that receives;

One image display cell; This image display cell comprises at least one pair of required display screen of a glance at least that is worn on this user;

One is connected to the focal length input block of this focal length adjustment unit, is used to produce a focal length and adjusts signal to import this signal processing unit; And this focal length input block provides a focal length value to give a focal length and adjusts software; And

One finger locating unit is to be worn on finger by the user to go up to sense the position of finger, will show that therefore the location point signal of this finger position passes back;

One button input processing unit receives the location point signal from this finger locating unit, the location point that to point corresponds to the correspondence position on this dummy keyboard later on, after the push action that receives finger, this signal processing unit is imported in the operation that is about to button representative represented on the correspondence position, to carry out necessary signal Processing.

Images