WO2016150541A1 - Method for operating virtual reality goggles arranged in a motor vehicle, and virtual reality system - Google Patents

Abstract

The invention relates to a method for operating virtual reality goggles (14) arranged in a motor vehicle (10), comprising the following steps: sensing the motion of the motor vehicle (10); displaying a first virtual environment (24) by means of the virtual reality goggles (14) in a first display region (20) of the virtual reality goggles (14), the first virtual environment being presented independently of the sensed motion of the motor vehicle; simultaneously displaying a second virtual environment (26) by means of the virtual reality goggles (14) in a second display region (22) of the virtual reality goggles (14), which second virtual environment is presented in correspondence with the sensed motion of the motor vehicle (10). The invention further relates to a virtual reality system (12) having virtual reality goggles (14).

Description

 Method for operating a virtual vehicle arranged in a motor vehicle

Reality glasses and virtual reality system

DESCRIPTION:

The invention relates to a method for operating a arranged in a motor vehicle virtual reality glasses and a virtual reality system. Furthermore, the invention relates to a motor vehicle with a virtual reality system.

A virtual reality system in the sense of the invention is to be understood as a system by means of which a virtual reality can be visually displayed and, if appropriate, also reproduced acoustically. The virtual reality system can include virtual reality glasses for displaying virtual objects and, if necessary, headphones for sound reproduction.

A virtual reality glasses is a specific form of a so-called head-mounted display, so a portable on the head visual output device. It presents images on a near-eye screen or projects them directly onto the retina. A virtual reality glasses usually has additional sensors for detecting movement of the head. Thus, the display of the calculated graphics can be adapted to the movements of the wearer of the glasses. Due to the physical proximity, the displayed image areas of head-mounted displays are considerably larger than the free-standing screens and, in extreme cases, even cover the entire field of vision of the user. As the virtual reality goggle display follows all head movements of the wearer, it gives the feeling of moving directly into a computer generated landscape.

By means of such virtual reality glasses, therefore, a virtual reality can be represented, wherein as a virtual reality usually the representation and simultaneous perception of reality in its physical eigen- Shafts in a real-time computer-generated, interactive virtual environment is called.

Such a virtual reality system can be used in a motor vehicle, for example, so that a vehicle occupant can put on and use the virtual reality glasses while driving. The vehicle occupant can display various virtual environments, for example a film, a computer game or the like, by means of the virtual reality glasses. If this happens while driving a car, nausea may occur in the vehicle occupants wearing the virtual reality goggles. This is due, among other things, to a divergence between a virtual environment displayed by means of the virtual reality glasses and the natural movement of the vehicle occupant perceived by the equilibrium organ.

It is therefore the object of the invention to provide a method for operating a virtual reality system and a virtual reality system, by means of which the reproduction of virtual content is made possible without the vehicle occupant having a virtual reality glasses to reproduce the virtual content, causing nausea.

The object is achieved by a method for operating a virtual reality glasses arranged in a motor vehicle and by a virtual reality system having the features of the independent patent claims. Advantageous embodiments with expedient and non-trivial developments of the invention are specified in the dependent claims.

In the method according to the invention for operating a virtual reality spectacle arranged in a motor vehicle, the movement of the motor vehicle is detected. A first virtual environment is displayed by means of the virtual reality glasses in a first display region of the virtual reality glasses, wherein the first virtual environment is displayed independently of the detected movement of the motor vehicle. Simultaneously, a second virtual environment is displayed by means of the virtual reality glasses in a second display region of the virtual reality glasses, wherein the second virtual environment is displayed corresponding to the detected movement of the motor vehicle. In other words, therefore, there is a permanent detection and evaluation of the movement of the motor vehicle, the permanent detected movement of the motor vehicle in the representation or display of the second virtual environment is taken into account by means of the virtual reality glasses. Virtual reality glasses make it possible for a vehicle occupant, if he has put on the virtual reality glasses, to present media content in a special way. For example, vehicle occupants of a vehicle may enjoy a movie on a virtual screen, such as in a movie theater, while wearing such virtual reality glasses. However, when the vehicle is in motion, the divergence between a virtual environment shown by the virtual reality goggles and the self-motion sensed by the body of balance of the respective wearer of the virtual reality goggles may occur - especially when cornering, accelerating or decelerating the motor vehicle - create nausea. To circumvent this undesired effect, it is provided in the solution according to the invention, in addition to the first display area in which the media contents are displayed by means of the virtual reality glasses in the form of a virtual environment, in the second display area of the virtual reality glasses to represent another virtual environment, which is represented in correspondence to the detected movement of the motor vehicle. In other words, this second virtual environment moves adequately to the real relative movement of the environment to the moving motor vehicle. This gives the wearer of the virtual reality goggles a sort of optical feedback on how the motor vehicle - and thus the wearer of the virtual reality goggles - actually moves within the real world. As a result, there is no longer any discrepancy between the movement perceived by the wearer of the virtual reality glasses, in particular acceleration, in the real world and the first virtual environment which is additionally indicated by means of the virtual reality goggles, which are independent of the detected one Movement of the motor vehicle is shown. By means of the method according to the invention, therefore, the reproduction of virtual content is made possible without causing nausea in a vehicle occupant, the virtual reality glasses for playback of the virtual content. In an advantageous embodiment of the invention, it is provided that a landscape corresponding to the detected movement of the motor vehicle is displayed as the second virtual environment. This gives the wearer of the virtual reality glasses in a simple way an optical feedback about the actual movement of the motor vehicle and thus his own movement, whereby the said nausea in the wearer of the virtual reality glasses can be avoided.

According to an alternative advantageous embodiment of the invention, it is provided that the vehicle environment moving relative to the motor vehicle is detected by means of a camera system and displayed as the second virtual environment. As a result, the actual vehicle environment moving relative to the motor vehicle can be displayed in a particularly realistic manner. As a result, it may be possible, if necessary, to further prevent nausea from occurring in the wearer of the virtual reality glasses.

According to a further advantageous embodiment of the invention, it is provided that the longitudinal movement of the motor vehicle is detected and taken into account when displaying the second virtual environment. In this case, preferably both the speed of the motor vehicle in the longitudinal direction and the acceleration of the motor vehicle or the deceleration of the motor vehicle in the longitudinal direction are detected and taken into account when displaying the second virtual environment. For example, if the motor vehicle brakes relatively sharply, this is taken into account when displaying the second virtual environment, for example by displaying a displayed moving landscape also slowed down as it passes according to the braking of the motor vehicle. If, for example, the motor vehicle drives particularly fast over a motorway, then the displayed moving landscape is displayed in such a way that it virtually passes by the carrier of the virtual reality glasses in accordance with the speed of the motor vehicle. By detecting and taking into account the longitudinal movement of the motor vehicle when displaying the second virtual environment, it is possible to ensure that no nausea occurs in the wearer of the virtual reality goggles when viewing the first virtual environment.

In a further advantageous embodiment of the invention, it is provided that the transverse movement of the motor vehicle is detected and taken into account when displaying the second virtual environment. In particular, the lateral accelerations of the motor vehicle occurring during cornering can be taken into account and recorded so as to enable the displayed second virtual environment to be cornering or the like with regard to its Adjust presentation. This also helps to reduce the risk of nausea in the wearer of virtual reality glasses.

A further advantageous embodiment of the invention provides that the vertical movement of the motor vehicle is detected and taken into account when displaying the second virtual environment. As a result, vertical movements and vertical accelerations of the motor vehicle when displaying the second virtual environment can be taken into account so that the displayed second virtual environment is likewise varied in accordance with the vertical movements that occur. As a result, it can be ensured in a particularly reliable manner that the wearer of the virtual reality glasses does not experience nausea by displaying the first virtual environment.

In addition, it may also be provided that rotational movements about the longitudinal axis, transverse axis and / or vertical axis of the motor vehicle are also detected and taken into account in the display of the second virtual environment. Preferably, therefore, all possibilities of movement of the motor vehicle are detected, evaluated and taken into account in the display of the second virtual environment. As a result, a particularly realistic representation by means of the second virtual environment can take place such that the actual movement of the motor vehicle and the relative movement of the motor vehicle to the motor vehicle environment can be represented by the second virtual environment in order to increase the occurrence of nausea in the wearer of the virtual reality glasses prevent.

According to a further advantageous embodiment of the invention, it is provided that a lying in the direction of travel in front of the motor vehicle road course detected or provided or at least displayed as part of the second environment. Thereby, the wearer of the virtual reality glasses is continuously informed about the driving course of the motor vehicle, which in addition can contribute to reducing the risk of nausea generation in the wearer of the virtual reality glasses.

The virtual reality system according to the invention comprises a virtual reality glasses, a detection device for detecting the movement of a motor vehicle and a control device. The control device is designed to control the virtual reality glasses such that a first virtual environment by means of the virtual reality glasses in a first display region of the virtual reality glasses regardless of the detected movement of the force vehicle and simultaneously a second virtual environment by means of the virtual reality glasses in a second display area of the virtual reality glasses corresponding to the detected movement of the motor vehicle is displayed. Advantageous embodiments of the inventive method are to be regarded as advantageous embodiments of the virtual reality system according to the invention, wherein the virtual reality system has in particular means for performing the method steps.

The motor vehicle according to the invention comprises the inventive virtual reality system or an advantageous embodiment of the virtual reality system according to the invention.

Further advantages, features and details of the invention will become apparent from the following description of preferred embodiments and from the drawing. The features and combinations of features mentioned above in the description as well as the features and feature combinations mentioned below in the description of the figures and / or shown alone in the figures can be used not only in the respectively specified combination but also in other combinations or in a stand-alone position, without the To leave frame of the invention.

The drawing shows in:

1 is a schematic representation of a motor vehicle, which includes a virtual reality system that a virtual reality

Glasses, a detection device for detecting the movement of the motor vehicle and a control device for driving the virtual reality glasses; and FIG. 2 shows a schematic representation of two display areas of the

 Virtual reality glasses, wherein in the inner display area a first virtual environment and in the outer second display area a second virtual environment is displayed.

A motor vehicle 10 with a virtual reality system 12 is shown in a schematic representation in FIG. 1. The virtual reality system 12 includes at least one virtual reality goggle 14 for displaying virtual content. Furthermore, the virtual reality system 12 has an acquisition Device 16, which is adapted to detect the movement of the motor vehicle 10. The detection device 16 may, for example, have a variety of sensors, such as speed sensors, acceleration sensors and the like, by means of which both speeds and accelerations of the motor vehicle 10 in all possible directions of movement can be detected. The virtual reality system 12 further comprises a control device 18 for driving the virtual reality glasses 14. The control device 18 is coupled to the detection device 16 in such a way that the control device corresponding signals with respect to the detected movements of the motor vehicle 10 can be received by the detection device 16 and then evaluate. The control device 18 is configured to control the virtual reality glasses 14 such that a first virtual environment by means of the virtual reality glasses 14 in a first display region of the virtual reality glasses 14 regardless of the detected movement of the motor vehicle 10 and simultaneously a second virtual environment by means of the virtual reality glasses 14 in a second display region of the virtual reality glasses 14 corresponding to the detected movement of the motor vehicle 10 is shown. FIG. 2 schematically shows a first display area 20 and a second display area 22 of the virtual reality glasses 14. Hereinafter, a method for operating the virtual reality glasses 14 is explained in more detail. A vehicle occupant, not shown here, can put on the virtual reality glasses 14 while driving with the motor vehicle 10 in order to display a wide variety of media content. For example, the vehicle occupant wearing the virtual reality glasses 14 while driving with the motor vehicle 10 can display a film on a virtual screen, for example in a cinema. During operation of the virtual reality glasses 14, the movement of the motor vehicle 10 is detected continuously by means of the detection device 16. In this case, both longitudinal movements, transverse movements and vertical movements of the motor vehicle 10 are detected. Both respective speeds in the longitudinal direction, transverse direction and vertical direction as well as accelerations in the longitudinal direction, transverse direction and vertical direction of the motor vehicle 10 are continuously measured and recorded. In addition, rotational movements of the motor vehicle 10 about the longitudinal axis, transverse axis and vertical axis can be detected and evaluated. The control device 18 controls the virtual reality glasses 14 in such a way that a first virtual environment 24 is represented by the virtual reality glasses 14 in the first display region 20 of the virtual reality glasses 14 independently of the detected movement of the motor vehicle 10 , The control device 18 controls the virtual reality glasses 14 in such a way that simultaneously a second virtual environment 26 by means of the virtual reality glasses 14 in the second display region 22 of the virtual reality glasses 14 corresponding to the detected movement of the Motor vehicle 10 is shown. In the present case, the first display area 20 is surrounded by the second display area 22. There are also substantially any alternative arrangements of the display areas 20, 22 to each other possible. For example, the display area 22 may be selected in the form of respective bars arranged on the left and right of the display area 20. The two display areas 20, 22 can also be arranged next to one another, for example. For example, the wearer of the virtual reality glasses 14 can select or set by means of a corresponding menu how the size relationships between the display areas 20, 22 are configured and how the display areas 20, 22 are to be arranged relative to one another. For example, as the second virtual environment 26, a landscape corresponding to the detected movement of the motor vehicle 10 is displayed. Should the wearer of the virtual reality goggles 14 observe a film on a virtual screen within the first display area 20, a landscape moving in relation to the first displayed virtual environment 24 is displayed in the second display area 22, the landscape being in Dependence on the detected movement of the motor vehicle 10 moves. Alternatively, it is also possible that, for example by means of a camera system, the vehicle environment actually moving relative to the motor vehicle 10 is detected and displayed as the second virtual environment 22. Alternatively, it is also possible that the wearer of the virtual reality goggles 14 in the first display area 20 on the virtual screen watching a movie, while feeling hovering over an alienated landscape that moves adequately to the real environment by this alienated landscape is displayed in the second display area 22 in the form of the second virtual environment 26.

In addition, it is also possible for a road course lying in front of the motor vehicle 10 in the direction of travel to be detected or provided and at least as part of the second virtual environment 26 in the second display area. Rich 22 is displayed. The fact that in addition to the first virtual environment 24, which serves purely for the entertainment of the wearer of the virtual reality glasses 14, additionally the second virtual environment 26, which is displayed corresponding to the detected locomotion of the motor vehicle 10 is shown, can be prevented in that a nausea is produced at the wearer of the virtual reality glasses 4.

Otherwise, if the motor vehicle is in motion, the divergence between the first virtual environment 24 just shown and the actual movement actually reported by the inner ear of the wearer of the virtual reality goggles 14 could occur, in particular when cornering, accelerating or decelerating the motor vehicle 0, Create nausea. In order to avoid this undesired effect, the second display area 22 is provided in addition to the first display area 20 serving as the display area for the media content, and the second virtual area 26 is displayed there, which is displayed as a function of the detected movement of the motor vehicle.

Claims

CLAIMS: Method for operating a virtual reality spectacle (14) arranged in a motor vehicle (10), comprising the steps of:  - Detecting the movement of the motor vehicle (10);  - Viewing a first virtual environment (24) by means of the virtual reality glasses (14) in a first display area (20) of the virtual reality glasses (14), which is displayed independently of the detected movement of the motor vehicle (10);  - Simultaneously displaying a second virtual environment (26) by means of the virtual reality glasses (14) in a second display area (22) of the virtual reality glasses (14), which is shown corresponding to the detected movement of the motor vehicle (10) , Method according to claim 1, characterized in that a landscape moving in correspondence with the detected movement of the motor vehicle (10) is displayed as the second virtual environment (26). Method according to claim 1, characterized in that detected by a camera system relative to the motor vehicle (10) moving vehicle environment and displayed as the second virtual environment (26). Method according to one of the preceding claims, characterized in that the longitudinal movement of the motor vehicle (10) is detected and taken into account when displaying the second virtual environment (26). Method according to one of the preceding claims, characterized in that the transverse movement of the motor vehicle (10) is detected and taken into account when displaying the second virtual environment (26). Method according to one of the preceding claims, characterized in that the vertical movement of the motor vehicle (10) is detected and taken into account when displaying the second virtual environment (26). Method according to one of the preceding claims,  characterized in that  a lane course lying in front of the motor vehicle (10) in the direction of travel is detected or provided and displayed at least as part of the second virtual environment (26). 8. Virtual Reality System (12), comprising  - a virtual reality glasses (14);  - Detection means (16) for detecting the movement of a motor vehicle;  - A control device (18) which is adapted to the virtual reality glasses (14) to control such that a first virtual environment (24) by means of the virtual reality glasses (14) in a first display area (20) of Virtual reality glasses (14) independent of the detected movement of the motor vehicle (10) and simultaneously a second virtual environment (26) by means of the virtual reality glasses (14) in a second display region (22) of the virtual reality glasses (14) corresponding to the detected movement of the motor vehicle (10) is shown. Motor vehicle (10) with a virtual reality system (12) according to claim 8.