WO2016165799A1 - Method for operating virtual reality goggles and system comprising virtual reality goggles - Google Patents

Abstract

The invention relates to a method for operating virtual reality goggles (12), in which virtual observation positions corresponding to a continuously detected position of the virtual reality goggles (12) are predetermined, wherein a virtual object (20) and a near region (36) of a virtual environment (30) surrounding the virtual object (20) are displayed from the currently predetermined virtual observation position and a remote region (38) of the virtual environment (30) surrounding the near region (36) is displayed, independently of the detected position of the virtual reality goggles (12), from an unalterable virtual observation position. The invention further relates to a system (10) having virtual reality goggles (12).

Description

 Method of operating a virtual reality glasses and with system

 Virtual reality glasses

DESCRIPTION:

The invention relates to a method for operating a virtual reality glasses and a system with a virtual reality glasses.

A virtual reality goggle is a particular form of a so-called head-mounted display, which is a head-worn visual output device. It presents images on a near-eye screen or projects them directly onto the retina. A virtual reality glasses additionally has sensors for detecting the movement of the head. Thus, the display of the calculated graphics can be adapted to the movements of the wearer of the glasses. Due to the physical proximity, the displayed image areas of head-mounted displays are considerably larger than the free-standing screens and, in extreme cases, even cover the entire field of vision of the user. Since the display follows all the head movements of the wearer through the head posture, he gets the feeling to move directly in a picture landscape created by a computer.

By means of such virtual reality glasses, therefore, a virtual reality can be represented, wherein the representation and simultaneous perception of reality in its physical properties in a real-time computer-generated, interactive virtual environment is usually referred to as virtual reality.

For example, a virtual motor vehicle can be displayed by means of such virtual reality glasses. For example, if a wearer of the virtual reality glasses wishes to look at the cockpit of the virtual motor vehicle, it is conceivable that the virtual cockpit of the virtual motor vehicle is displayed by means of the virtual reality goggles. Usually, by means of the virtual reality glasses, the virtual cockpit thereby depending on a captured position of the virtual reality glasses from each different virtual observation positions. In order to enable a particularly realistic representation and perception of the virtual cockpit, it would be advantageous, among other things, to additionally display a virtual vehicle environment. This may possibly be associated with an increased computing effort on the part of the virtual reality glasses and / or a control device for driving the virtual reality glasses.

It is the object of the present invention to provide a method for operating a virtual reality glasses and a system with a virtual reality glasses, by means of which a particularly realistic representation of a virtual object and a virtual environment surrounding the virtual object in a simplified manner can be displayed. This object is achieved by a method for operating a virtual reality glasses and by a system with a virtual reality glasses with the features of the independent claims. Advantageous embodiments with expedient and non-trivial developments of the invention are specified in the dependent claims.

In the method according to the invention for operating a virtual reality goggle, respective virtual observation positions are predefined corresponding to a continuously recorded position of the virtual reality goggles. A virtual object and a vicinity of a virtual environment surrounding the virtual object are thereby displayed from the currently specified virtual observation position. At the same time, a remote area of the virtual environment surrounding the near area is displayed independently of the detected position of the virtual reality goggles from an invariable virtual observation position.

In other words, therefore, the position of the virtual reality glasses is continuously recorded in the room, wherein in a change in the position of the virtual reality glasses each changed virtual observation position is assigned. Depending on the currently assigned virtual viewing position, the virtual object is displayed from this virtual observation position. A virtual short-range is also displayed from the just given or assigned virtual observation position, which is given as a function of the currently detected position of the virtual reality glasses. A remote area surrounding Area of the virtual environment is always displayed regardless of the detected position of the virtual reality glasses from the same unchanged virtual observation position. Thus, in a near or middle virtual distance range, a computer-generated environment is provided together with the computer-generated virtual object, wherein, depending on the variable head position and thus variable position of the virtual reality glasses, this proximity or average distance range also results from altered virtual observation. is displayed. The long range surrounding the near range is always displayed from the same invariable virtual observation position. The fact that only the perspective on the virtual object and on the virtual close range is also changed as a function of the variable head position and the perspective on the far field remains unchanged, the computational effort and thus the requirements for hardware components, such as the virtual reality Glasses, control devices and the like, are considerably reduced, while still a particularly high immersion, so a particularly realistic representation by means of the virtual reality glasses can be achieved.

An advantageous embodiment of the invention provides that the near area extends from the virtual object to a first virtual distance, in particular from 10 m to 15 m, the far range extending from the near area to a second virtual distance which is larger than the first virtual distance is. In other words, the proximity of the virtual environment directly surrounds the virtual object, with the far-end being directly connected to and surrounding the proximity area. For example, the virtual object, the near zone and the far zone can be arranged concentrically. In the near range of preferably 10 m to 15 m distance to the virtual object, a wearer of the virtual reality goggles will perceive a change in perspective to corresponding parts of the close range. To more distant parts, ie to parts that belong to the far field, a wearer of the virtual reality glasses will not be able to detect any changes in his head position. By adjusting only the perspective of the virtual object and the near field depending on the detected head position, the computational effort when generating the display of the virtual reality glasses can be significantly reduced. This allows a particularly fluid representation be ensured in a simultaneously very realistic presentation.

In a further advantageous embodiment of the invention, it is provided that a virtual vehicle interior, in particular a virtual cockpit, and the virtual environment a virtual vehicle environment are displayed as the virtual object. For example, this can be particularly advantageous for car dealerships because they no longer have to hold a large number of differently configured vehicles. Instead, it is possible for potential buyers to configure their desired motor vehicles, in particular the vehicle interior, and display them by means of the virtual reality glasses. The fact that a virtual vehicle environment is displayed as the virtual environment allows a particularly realistic virtual assessment of the respectively configured vehicle variant, in particular of the vehicle interior.

According to a further advantageous embodiment of the invention, it is provided that by means of a stereo camera system an at least partially all-round recording of a real vehicle is recorded and converted into the virtual vehicle environment. The fact that the at least partially all-round recording is recorded by means of a stereo camera system, the virtual vehicle environment using the virtual reality glasses can be displayed quasi-three-dimensional by using virtual reality glasses for a respective right and left eye of a wearer of the virtual reality -Glasses slightly altered, recorded contents of the at least partial surround recording are displayed, as a result, sets up a three-dimensional effect. The at least partial all-round recording can be, for example, a 180 ° recording up to a 360 ° round recording. The wearer of the virtual reality glasses can thus see through pivoting of his head a part or even substantially the entire virtual vehicle environment, while the wearer of the virtual reality glasses virtually resides within the vehicle interior. Preferably, the at least partially all-round recording can be recorded during the journey of the real vehicle. As a result, it is also possible to simulate a virtual journey with the virtual motor vehicle, while the wearer of the virtual reality goggles can just display the virtual vehicle interior. The real vehicle environment is thus converted into the virtual vehicle environment, whereby the virtual vehicle environment for the wearer of the virtual reality glasses passes by it. pulls while it is virtually in the vehicle interior. As the head position is changed, the virtual perspective on the proximity of the virtual vehicle environment is also changed accordingly, leaving the virtual perspective on the far end of the virtual vehicle environment unchanged. This also contributes to be able to provide a particularly realistic representation with at the same time very little computational effort.

In a further advantageous embodiment of the invention, it is provided that parts of the near area and the far area are displayed concealed in dependence on the currently predetermined virtual observation position of parts of the virtual object. In other words, a kind of virtual parallax effect is achieved by different parts of the near range and the far range depending on the currently given virtual observation position of parts of the virtual object, depending on the head position, and thus depending on the position of the virtual reality glasses to be hidden. This allows a particularly realistic representation of the virtual object and surrounding surrounding area.

The system according to the invention comprises a virtual reality glasses and a detection device which is designed to continuously detect the position of the virtual reality glasses and to assign them to the respective virtual observation position. The inventive system further comprises a control device, which is designed to control the virtual reality glasses such that by means of the virtual reality glasses, a virtual object and a virtual object surrounding the vicinity of a virtual environment from the currently predetermined virtual observation position and a remote area of the virtual environment surrounding the near area is displayed from an invariable virtual observation position independently of the detected position of the virtual reality glasses. Advantageous embodiments of the method according to the invention are to be regarded as advantageous embodiments of the system according to the invention, wherein the system has in particular means for carrying out the method steps.

Further advantages, features and details of the invention will become apparent from the following description of preferred embodiments and from the drawing. The above mentioned in the description Features and combinations of features as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures can be used not only in the respectively indicated combination but also in other combinations or in isolation, without departing from the scope of the invention.

The drawing shows in:

Figure 1 is a schematic representation of a system having a virtual reality glasses, a detection device and a control device for driving the virtual reality glasses.

FIG. 2 is a perspective view of a carrier of the virtual reality glasses; FIG. 3 shows a perspective view of a virtual vehicle interior of a virtual motor vehicle displayed by means of the virtual reality glasses; and in

4 shows a schematic representation of a plan view of the arrangement of the virtual motor vehicle, wherein the virtual motor vehicle is surrounded by a near area and an adjoining long range of a virtual vehicle environment.

In the figures, identical or functionally identical elements are provided with the same reference numerals.

A system 10 with a virtual reality glasses 12, a detection device 14 and a control device 16 for driving the virtual reality glasses 12 is shown in a schematic representation in FIG. 1. The detection device 14 is designed to continuously record the position of the virtual reality glasses 12 and to assign them to respective virtual observation positions. The detection device 14 may, for example, have a camera system by means of which the position of the virtual reality glasses 12 can be detected and assigned to respective virtual observation positions.

In Fig. 2, a carrier 18 of the virtual reality glasses 12 is shown schematically. For example, the wearer 18 of the virtual reality goggles 12 may be a potential car buyer who does not use the virtual reality goggles. Glasses 12 has put on to display a just configured desired motor vehicle virtual.

In Fig. 3, a virtual vehicle interior 20 is shown in fragmentary form, which is displayed by means of the virtual reality glasses 12. By means of the detection device 14, the position of the virtual reality glasses 12 is continuously detected and assigned to respective virtual observation positions. If the carrier 18 moves its head to the right, for example, this is detected by means of the detection device 14 and the change in position correspondingly taken into account by. the virtual observation position from which the vehicle interior 20 is displayed by means of the virtual reality glasses 12 is changed accordingly. If the carrier 18 thus moves its head to the right, it virtually no longer sits directly in front of the steering wheel 22, but rather, for example, frontally in front of the virtual center console 24. This could be useful, for example, if the carrier 18 of the virtual reality For example, it may be desirable to more closely view, for example, a virtual display 26 or a virtual climate control panel 28 of the displayed virtual vehicle interior 20. The control device 16 of the system 10 is thus designed to control the virtual reality glasses 12 in such a way that by means of the virtual reality glasses 12, a virtual object, in the present case, the virtual vehicle interior 20, from the just by means of the detection device 14th currently specified virtual observation position is displayed.

In order to achieve a particularly realistic representation and perception of the virtual vehicle interior 20, which is displayed by means of the virtual reality glasses 12, a virtual vehicle environment 30 is also additionally displayed by means of the virtual reality glasses 12. The carrier 18 thus sees through the virtual reality glasses 12 not only the vehicle interior 20, but also the vehicle surroundings 30, for example by looking virtually through the unspecified virtual windshield of the motor vehicle. FIG. 4 schematically illustrates a virtual motor vehicle 34, a short range 36 of the virtual vehicle environment 30, and a long range 38 of the virtual vehicle environment 30. The schematic representation shown in FIG. 4 does not see the carrier 18 of the virtual reality glasses 12, instead this schematic representation is used. ment only to explain the subsequent steps in the operation of the virtual reality glasses 12th

As already explained, when the virtual reality glasses 12 are operated, the position of the virtual reality glasses 12 is detected continuously by means of the detection device 14. Corresponding to the continuously detected position of the virtual reality glasses 12, respective virtual observation positions are given. A first detected real position of the virtual reality glasses 12 is thus assigned a corresponding first virtual observation position, a second detected real position of the virtual reality glasses 12 is thus assigned a second virtual observation position, etc.

The vehicle interior 20 and the proximity area 36 of the vehicle surroundings 30 are displayed from the currently predetermined virtual observation position. If the carrier 8 thus changes its head position in a translatory direction, the virtual observation position, from which the vehicle interior 20 and the proximity area 36 are displayed by means of the virtual reality glasses 12, also changes. However, the far region 38 of the virtual vehicle environment 30 surrounding the near zone 36 is displayed independently of the detected position of the virtual reality glasses 12 from an invariable virtual observation position. In other words, a change in the head position of the wearer 18 and thus a change in the position of the virtual reality glasses 12 only causes the perspective of the virtual vehicle interior 20 and the proximity region 36 of the virtual vehicle environment 30 to be changed. Even with a change in the head position of the carrier 18 and thus a change in the position of the virtual reality glasses 12, however, does not change the representation of the long range 38 of the virtual vehicle environment 30 using the virtual reality glasses 12th

In this case, the proximity area 36 extends from the virtual object 34 to a first virtual distance, with the far range 38 extending from the first virtual environment 36 to a second virtual distance that is greater than the first virtual distance. By way of example, the proximity region 36 may extend to a virtual distance of 10 m to 15 m from the virtual motor vehicle 34, with the far region 38 corresponding to the vicinity of the vicinity of the motor vehicle 34. In order to be able to display the near area 36 and the far area 38 of the virtual vehicle environment 30 at all by means of the virtual reality glasses 12, it is first necessary to provide corresponding image or video material. For example, it is possible for an at least partially all-around image to be recorded by a real vehicle by means of a stereo camera system (not shown here) and to be converted into the virtual vehicle environment 30 encompassing the near area 36 and the far area 38. In this case, it is possible, for example, to record a 180 ° comprehensive partial surround recording or even a 360 ° complete surround scan of a real vehicle and convert it into the virtual vehicle environment 30. The at least partially all-round recording can be recorded, for example, during the journey of the real vehicle.

For example, it is possible for the user 18 to want to display the vehicle interior 20 by means of the virtual reality glasses 12 during a virtual journey with the motor vehicle 34. In this case, both the near zone 36 and the far zone 38 virtually pass by the carrier 18 of the virtual reality glasses 12. This results in a particularly realistic presentation and perception of the virtual vehicle interior 20. A translational head movement of the carrier 18 and thus a translational movement of the virtual reality glasses 12 in turn causes the virtual observation position to change and correspond to the changed virtual observation position the vehicle interior 20 as well as the near area 36 are shown changed. However, a change in the head position and thus a change in the position of the virtual reality glasses 12 causes no change in the display or display of the long range 38. While with respect to the virtual vehicle interior 20 and the vicinity of 36 a full three-dimensional impression on the carrier 18th arises, a virtual perspective change would hardly come into play in the distant long range 38, since the carrier 18 would not perceive this. The virtual vehicle environment 30 therefore only has to be recalculated and adapted with respect to the proximity area 36 in accordance with a detected change in the head position of the carrier 18 and thus a detected change in the position of the virtual reality goggles 12. A recalculation or adaptation of the long range 38 can be omitted. Infolgedes- Nevertheless, a very realistic representation and perception of the vehicle interior 20 and the virtual vehicle environment 30 can be made possible at the same time with a significantly reduced computational effort.

Claims

CLAIMS: Method for operating a virtual reality glasses (12), in which respective virtual observation positions corresponding to a continuously detected position of the virtual reality glasses (12) are given, wherein a virtual object (20) and a virtual object (20 ) surrounding near area (36) of a virtual environment (30) from the currently predetermined virtual observation position and a far area (36) surrounding remote area (38) of the virtual environment (30) regardless of the detected position of the virtual reality glasses (12) from a fixed virtual observation position. Method according to claim 1,  characterized in that  the proximity region (36) extends from the virtual object (20) to a first virtual distance, in particular from 10 to 15 meters, the far region (38) extending from the proximity region (36) to a second virtual distance, which is larger than the first virtual distance. Method according to claim 1 or 2,  characterized in that  as the virtual object (20) a virtual vehicle interior, in particular a virtual cockpit, and as the virtual environment (30) a virtual vehicle environment are displayed. Method according to claim 3,  characterized in that  by means of a stereo camera system recorded at least partially all-round recording of a real vehicle and converted into the virtual vehicle environment. Method according to claim 4,  characterized in that  the at least partially all-round recording is recorded during the drive of the real vehicle. 6. The method according to any one of the preceding claims, characterized in that  Parts of the near area (36) and the far area (38) are hidden from parts of the virtual object (20) depending on the currently given virtual observation position. 7. System comprising  a virtual reality glasses (12);  a detection device (14) which is designed to continuously record the position of the virtual reality glasses (12) and to assign them to respective virtual observation positions; a control device (16) which is designed to control the virtual reality goggles (12) in such a way that by means of the virtual reality goggles (12) a virtual object (20) as well as a proximity area surrounding the virtual object (20) (36) a virtual environment (30) from the currently given virtual observation position and a far region (36) surrounding remote area (38) of the virtual environment (30) regardless of the detected position of the virtual reality glasses (12) of an immutable virtual observation position.