WO2025061157A1 - Display system, vehicle and cabin system - Google Patents

Abstract

A display system, which can be applied to a vehicle, for example, being mounted in the back of a seat, a seat headrest or a front-passenger console, etc. The display system (100, 600, 700) comprises: a display device (101, 200) and an adjustment device (610), wherein the display device (101, 200) comprises an image generation unit (201), a viewing window unit (202) and an image magnification unit (203), and the adjustment device (610) is connected to the display device (101, 200). The image generation unit (201) is used for emitting first imaging light to the viewing window unit (202); the viewing window unit (202) is used for reflecting to the image magnification unit (203) the first imaging light from the image generation unit (201), and for transmitting the first imaging light from the image magnification unit (203); and the image magnification unit (203) is used for reflecting to the viewing window unit (202) the first imaging light from the viewing window unit (202). The adjustment device (610) is used for adjusting the display device (101, 200) from a first angle to a second angle, so that a user views, at the second angle and by means of the viewing window unit (202), a virtual image which is formed by the first imaging light. The display system can achieve angle adjustment of the display device, thereby improving the viewing experience of a user.

Description

Display system, vehicle and cockpit system

This application claims the priority of the Chinese patent application with application number 202311242896.X filed with the State Intellectual Property Office of China on September 22, 2023, and the priority of the Chinese patent application with invention name “A method for adjusting height, a display system and a vehicle”, as well as the priority of the Chinese patent application with application number 202322865003.9 filed with the State Intellectual Property Office of China on October 25, 2023, and the priority of the Chinese patent application with utility model name “A display system and a vehicle”, all of which are incorporated by reference into this application.

Technical Field

The embodiments of the present application relate to the fields of display technology and intelligent automobile driving technology, and more specifically, to a display system, a vehicle, and a cockpit system.

Background Art

Cars have become an indispensable means of transportation in people's daily lives. With the development of intelligent cars, people's application needs for cars have been upgraded from simple transportation to living spaces with certain information acquisition and entertainment enjoyment. Among them, in-vehicle display technology has become a hot research direction. By installing in-vehicle display devices in cars, passengers in the car can obtain information or watch entertainment and other activities through the in-vehicle display devices, thus providing intelligent application scenarios for the cockpit space.

How to achieve automatic adjustment of the angle of the display device to improve the user's viewing experience is a problem that needs to be solved.

Summary of the invention

The present application provides a display system, a vehicle and a cockpit system. The display system provided by the present application can adjust the angle of the display device to improve the viewing experience of the user.

In a first aspect, an embodiment of the present application provides a display system, which can be used for vehicle-mounted display. The display system includes: a display device and an adjustment device, wherein the display device includes an image generation unit, an image magnification unit and a window unit, and the adjustment device is connected to the display device, wherein: the image generation unit is used to emit a first imaging light to the window unit; the window unit is used to reflect the first imaging light from the image generation unit to the image magnification unit and transmit the first imaging light from the image magnification unit; the image magnification unit is used to reflect the first imaging light from the window unit to the window unit, and the adjustment device is used to adjust the first angle of the display device to a second angle, so that the user can view the virtual image formed by the first imaging light at the second angle through the window unit.

It should be noted that, in the present application, the angle of the display device (including the first angle and the second angle) can be the pitch angle of the display device. When the display device is adjusted from the first angle to the second angle, the display device can be shaken up and down in the vertical direction, similar to the "nodding" effect; or, the angle of the display device can be the swing angle of the display device (or called the horizontal deflection angle). When the display device is adjusted from the first angle to the second angle, the display device can be shaken left and right in the horizontal direction, similar to the "shaking head" effect; or, the angle of the display device can be the pitch angle and the swing angle of the display device that change simultaneously. When the display device is adjusted from the first angle to the second angle, the display device can be adjusted in the entire spatial angle.

In the present application, the adjustment device may adjust the angle of the display device automatically or manually. When the automatic adjustment of the angle of the display device is achieved, the intelligent performance of the vehicle display system can be improved, thereby providing users with a smarter experience.

In combination with the first aspect, in certain implementations of the first aspect, the display system also includes a first acquisition device and a processing device, the first acquisition device being used to acquire one or more first images including the user's eyes when the display device is at the first angle, and send the one or more first images to the processing device; the processing device generating a first adjustment amount based on the one or more first images, and sending the first adjustment amount to the adjustment device; the adjustment device being specifically used to adjust the first angle to the second angle according to the first adjustment amount.

The display system provided in the present application can generate an angle adjustment amount according to an image containing the human eye, so that the display system provided in the present application can achieve an automatic adjustment effect according to the human eye.

In combination with the first aspect, in some implementations of the first aspect, when the first acquisition device acquires the first image, The processing device is specifically used to: determine a first human eye position and an ideal human eye position based on the first image, and generate the first adjustment amount based on the first human eye position and the ideal human eye position, wherein the first human eye position is the distance of the human eye in the first image relative to the image edge in the vertical direction and/or horizontal direction.

It should be noted that in the present application, the ideal human eye position is located at the center of the first image. When the adjustment device is adjusted according to the first adjustment amount angle, it is to make the actual human eye position coincide with the ideal human eye position as much as possible. In other words, when the adjustment device adjusts the display device from the first angle to the second angle, the human eye position at the second angle will meet the preset range with the ideal human eye position, and the user will be more comfortable when watching at the second angle compared to the first angle.

The angle adjustment amount calculated by the first eye position determined by the first image and the ideal eye position can make the adjusted eye position meet a better viewing angle. At the same time, angle adjustment based on a first image can enable the display device to adjust the angle in a timely and rapid manner according to the eye position, thereby increasing the efficiency of angle adjustment.

In combination with the first aspect, in certain implementations of the first aspect, when the first acquisition device acquires the multiple first images, the processing device is specifically used to: determine the second human eye position and the ideal human eye position based on the multiple first images, and generate the first adjustment amount based on the second human eye position and the ideal human eye position, the second human eye position being determined based on the distance of the human eye in each of the multiple first images relative to the edge of the corresponding image in the vertical direction and/or horizontal direction.

By generating the second eye position through multiple first images, the systematic error of the second eye position generated by the processing device can be eliminated, thereby further improving the accuracy of the calculation of the second eye position.

In combination with the first aspect, in certain implementations of the first aspect, the difference between the second human eye position and the ideal human eye position is greater than a first threshold, the multiple first images are acquired within a first preset time, and the distance of the human eye in each of the multiple first images relative to the corresponding image edge in the vertical direction and/or horizontal direction is within a first preset range.

By acquiring multiple first images that meet a preset range within a preset time, and only starting the angle adjustment when the difference between the second eye position and the ideal eye position meets the first threshold, it is possible to avoid abnormal jitter of the display system when it is in an unstable state, thereby improving the reliability of the system and further improving the user experience.

In combination with the first aspect, in certain implementations of the first aspect, the display system also includes a second acquisition device, which is used to acquire environmental information of the display device and send the environmental information to the processing device; the processing device is also used to determine the credibility of the second human eye position based on the environmental information.

It should be noted that, in the present application, the environmental information may be information such as the attitude of the cockpit, the brightness of the cockpit, the temperature of the cockpit, and the temperature of the display device. Exemplarily, when the cockpit is the cockpit of a smart car, the attitude of the cockpit may be the road conditions or navigation information of the road on which the smart car is traveling. It is understandable that the brightness of the cockpit may affect the brightness of one or more images acquired by the first acquisition device. Therefore, in some embodiments, the brightness of the cockpit may also be indirectly represented by the brightness of one or more images. For example, when the brightness of the cockpit is too low, the multiple images acquired within the first preset time cannot accurately calculate the second eye position, resulting in too low a credibility of the second eye position. The temperature of the cockpit and the temperature of the display device may affect the clarity of one or more images acquired by the first acquisition device. For example, when the temperature is too high, the first acquisition device may not work, resulting in the multiple images acquired within the first preset time being unusable, resulting in too low a credibility of the second eye position.

It should also be noted that factors that affect the credibility of the second eye position also include user factors. For example, the user's face is blocked by a hat, sunglasses, etc., which causes the processing device to be unable to accurately calculate the second eye position based on multiple first images. That is, at this time, the credibility of the second eye position is too low.

By determining the credibility of the second eye position, the processing device can generate the first adjustment amount according to the second eye position with higher credibility, thereby further improving the accuracy of angle adjustment and ensuring the stability of system performance.

In combination with the first aspect, in certain implementations of the first aspect, the processing device further generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generating unit; the image generating unit is used to generate an image of corresponding size according to the second adjustment amount, and emit second imaging light; the window unit is used to reflect the second imaging light from the image generating unit to the image magnifying unit, and transmit the second imaging light from the image magnifying unit, so that the user can view the virtual image formed by the second imaging light at the second angle through the window unit; the image magnifying unit is used to reflect the second imaging light from the window unit to the window unit.

Based on the above scheme, the display system provided in the embodiment of the present application is not only able to adjust the angle of the display device, but can also further calculate the size of the virtual image based on one or more second images, thereby ensuring that the user can view the complete virtual image when the angle cannot be adjusted (for example, reaching the limit of the angle adjustment of the display device), thereby further improving the reliability of the display system performance.

In combination with the first aspect, in some implementations of the first aspect, when the first acquisition device acquires the second image, A processing device, specifically used to: determine a first human eye depth based on the one second image, and generate the second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit when acquiring the one second image, and the second human eye depth is the distance between the human eye and the window unit when acquiring the third image, and the acquisition time of the third image is before the acquisition time of the one second image, or the second human eye depth is a preset human eye depth.

It is understandable that when the adjustment device adjusts the frame according to the second adjustment amount, it is to make the adjusted frame match the actual human eye depth, so that the user can see the complete virtual image. In other words, when the human eye depth changes from the second human eye depth to the first human eye depth, the display system provided by the present application can adjust the frame corresponding to the second human eye to the frame corresponding to the first human eye depth, thereby ensuring a reliable user experience. In addition, by adjusting the frame through a second image, the frame can be adjusted in a timely and rapid manner, making the frame adjustment more efficient.

In combination with the first aspect, in certain implementations of the first aspect, when the first acquisition device acquires the multiple second images, the processing device is specifically used to: determine a third human eye depth based on the multiple second images, and generate the second adjustment amount based on the third human eye depth and the fourth human eye depth, the third human eye depth is determined according to the distance between the human eye and the window unit when the multiple second images are acquired, the fourth human eye depth is determined according to the distance between the human eye and the window unit when the multiple third images are acquired, the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth.

By generating the third eye depth through multiple second images, the systematic error of the third eye depth generated by the processing device can be eliminated, thereby further improving the accuracy of the third eye depth calculation.

In combination with the first aspect, in certain implementations of the first aspect, the difference between the third human eye depth and the fourth human eye depth is greater than a second threshold, the multiple second images and the multiple third images are acquired within a second preset time, and when acquiring the multiple second images, the distance between the human eye and the window unit is within a second preset range, and when acquiring the multiple third images, the distance between the human eye and the window unit is within the second preset range.

By acquiring multiple second images that meet a preset range within a preset time, and only when the difference between the depth of the third eye and the depth of the fourth eye meets the second threshold, the adjustment of the frame is started. This can avoid abnormal jitter of the display system when it is in an unstable state, thereby further improving the reliability of the system and further improving the user experience.

In combination with the first aspect, in certain implementations of the first aspect, the display system also includes a second acquisition device, which is used to acquire environmental information of the display device and send the environmental information to the processing device; the processing device is also used to determine the credibility of the third human eye depth and the fourth human eye depth based on the environmental information.

By determining the credibility of the third eye depth and the fourth eye depth, the processing device can generate a second adjustment amount according to the third eye depth and the fourth eye depth with higher credibility, thereby further improving the accuracy of frame adjustment and ensuring the stability of system performance.

In a second aspect, an embodiment of the present application provides a vehicle, which includes a display system as described in the first aspect and its various implementations.

In combination with the second aspect, in certain implementations of the second aspect, the display system is arranged at at least one of a headrest of a seat of the vehicle, a back of a seat of the vehicle, and a co-pilot's console of the vehicle.

In a third aspect, an embodiment of the present application provides a cockpit system, which includes a display system as described in the first aspect and various implementations thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of an application scenario of a smart cockpit display system 100 applicable to an embodiment of the present application.

FIG. 2 is a schematic structural diagram of a display device 200 applicable to an embodiment of the present application.

FIG. 3 is a side perspective view of the display device 200 .

FIG. 4 is a schematic diagram of the display device 200 at various angles.

FIG. 5 is a schematic diagram 5 showing a rotation angle θ of the window unit 202 around the vertical direction.

FIG6 is a schematic structural diagram of a first display system 600 provided in an embodiment of the present application.

FIG. 7 is a schematic structural diagram of a second display system 700 provided in an embodiment of the present application.

FIG8 is a schematic diagram of adjusting the first eye position and the ideal eye position in the vertical direction provided in an embodiment of the present application.

FIG. 9 is a schematic diagram of adjusting the first eye position and the ideal eye position in the horizontal direction according to an embodiment of the present application.

FIG10 is a schematic diagram of simultaneously adjusting the first eye position and the ideal eye position in the vertical direction and the horizontal direction according to an embodiment of the present application.

FIG. 11 is a schematic diagram of the depth of the human eye provided in an embodiment of the present application.

FIG. 12 is a circuit diagram of a display device provided in an embodiment of the present application.

FIG. 13 is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application.

FIG. 14 is a schematic flowchart of a method 1400 for adjusting the angle of a display device provided in an embodiment of the present application.

FIG. 15 is a schematic flowchart of a method 1500 for adjusting the frame of a display device provided in an embodiment of the present application.

DETAILED DESCRIPTION

The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

In order to facilitate understanding of the embodiments of the present application, the following explanations are provided.

First, the terms "first", "second", etc. and various numbers in the text descriptions or drawings of the embodiments of the present application shown below are only used for the convenience of description, and are not necessarily used to describe a specific order or sequence, and are not used to limit the scope of the embodiments of the present application. For example, to distinguish different imaging lights, different angles, different images, etc.

Second, the terms "including" and "having" and any variations thereof in the embodiments of the present application shown below are intended to cover non-exclusive inclusions. For example, a system, product or device comprising a series of units is not necessarily limited to those units explicitly listed, but may include other units that are not explicitly listed or inherent to these products or devices.

Third, in the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or descriptions, and the embodiments or designs described as "exemplarily" or "for example" should not be interpreted as being more preferred or more advantageous than other embodiments or designs. The use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way for easy understanding.

Fourth, in the embodiments of the present application, imaging light refers to light carrying an image (or image information) and is used to generate an image.

Fifth, in the drawings of the present application, the thickness, size and shape of each optical element have been slightly exaggerated for the sake of convenience. Specifically, the shapes of the optical elements shown in the drawings are shown by way of example, and the drawings are only examples and not drawn strictly to scale.

Sixth, unless otherwise defined, all terms (including technical terms and scientific terms) used in this application have the same meaning as commonly understood by a person of ordinary skill in the art to which this application belongs. It should also be understood that terms (such as terms defined in commonly used dictionaries) should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined in this article.

With the rapid development of smart cars, cars play more and more roles in people's lives, and the demand for in-car displays is gradually increasing. For example, it can provide entertainment services such as games and movies for passengers who spend a long time in the car, or provide a private office display environment for office workers.

In order to provide in-vehicle display functions, it is a common solution to directly install a display screen in the car. For example, a liquid crystal display (LCD) can be hung on the roof or placed on the back of a seat for use by people in the car. However, the pitch angle of such LCDs cannot be adjusted automatically, and users usually need to manually adjust it according to their viewing habits. Some LCDs cannot even be adjusted once installed, resulting in a poor user experience.

In view of this, the present application provides a display system that can be used in a smart cockpit, which can not only realize automatic adjustment of the pitch angle, but also avoid cockpit jitter. While meeting the needs of different individuals, it improves the intelligent performance of the cockpit display system and further improves the user experience.

FIG1 is a schematic diagram of an application scenario of an intelligent cockpit display system 100 applicable to an embodiment of the present application. As shown in FIG1 , the intelligent cockpit display system 100 includes at least one display device 101 and at least one seat 102. FIG1 takes a display device and a seat as an example, and the display device 101 is arranged on the back of the seat 102. Among them, the display device 101 can generate a long-distance enlarged virtual image through the input of an external video signal (also referred to as a signal source), provide the viewer with a large-format, long-distance visual experience, and meet the needs of various application scenarios such as user leisure and entertainment, business office, etc. Among them, the display device 101 can be installed on the back of the seat 102 before leaving the factory, or installed on the back of the seat 102 by modifying the seat 102 after leaving the factory.

It is understandable that the smart cockpit display system 100 can be applied to vehicles including but not limited to the following: cars, trucks, buses, ships, airplanes, helicopters, recreational vehicles, trains, etc. In addition, the display device 101 can also be installed on the headrest of the seat or in the co-pilot console before leaving the factory, or the display device 101 can also be installed on the headrest of the seat by modifying the seat after leaving the factory, or installed in the co-pilot console by modifying the co-pilot console.

It should be noted that the display system provided in the present application can be applied to the smart cockpit display system 100 shown in FIG. 1 , but the embodiments of the present application are not limited thereto and may also be other similar systems including the smart cockpit display system 100 shown in FIG. 1 .

FIG. 2 is a schematic diagram of a structure of a display device 200 applicable to an embodiment of the present application. The display device 200 can be applied to the display device shown in FIG. 1 In the cockpit virtual image display system. As shown in FIG2 , the display device 200 is sequentially arranged along the transmission direction of the imaging light into an image generating unit 201, a window unit 202, and an image magnifying unit 203. Among them, the image generating unit 201 is used to emit the imaging light to the window unit. The window unit 202 is used to reflect the imaging light from the image generating unit 201 to the image magnifying unit 203, and transmit the imaging light from the image magnifying unit 203. The window unit 202 is also used for the human eye to view the virtual image formed by the imaging light through the window unit 202. The image magnifying unit 203 is used to reflect the imaging light from the window unit 1002 to the window unit 202.

The display device 200 further includes a rotating unit 204. Optionally, the rotating unit 204 is a rotating shaft or a rotating gear, etc., which can rotate the display device 200 as a whole under the adjustment of the adjustment device, so that the angle of the display device 200 changes.

Optionally, the image generating unit 201 may adopt a liquid crystal display (LCD) display, a liquid crystal on silicon (LCOS) display, an organic light-emitting diode (OLED) display, a micro light-emitting diode (Micro-LED) display, a display using micro LED (miniLED) display technology, a digital light processing (DLP) display or a micro-electro-mechanical system (MEMS) display, etc., and the present application does not make any limitation thereto.

Optionally, the image magnifying unit 203 is a free-form mirror.

Specifically, when a user uses the display device 200 to watch a video image, the image generation unit 201 emits imaging light to the window unit 202, and the imaging light is reflected by the window unit 202 and incident on the image magnification unit 203, and is reflected again by the image magnification unit 203 and incident on the window unit 202, and transmits the window unit 202. At this time, the user can see a large-format image located far away through the window unit 202.

When the display device 200 shown in FIG2 is installed in a cockpit system, in order to ensure the optical performance of the display device 200 and to protect the display device 200, it is generally necessary to fix the relative positions of the various components of the display device 200 through a housing, as shown in FIG3 , which is a side perspective view of the display device 200. In FIG3 , the image generating unit 201 and the image magnifying unit 203 are arranged in the internal cavity formed by the housing through the housing, and the window unit 202 is used as a light outlet of the closed housing, so that the user can view the virtual image generated by the display device 200 through the window unit 202, which not only ensures the optical performance of the display device 200, but also protects the image generating unit 201 and the image magnifying unit 203. When the display device 200 includes a rotating unit 204, the rotating unit 204 is arranged on the housing.

It should be noted that, in the present application, adjusting or changing the angle of the display device 200 can be understood as including but not limited to at least one of the following angle changes: the angle α between the plane where the window unit 202 is located and the vertical plane (the angles _α1 and _α2 before the change as shown in Figure 4), the angle β between the plane where the window unit 202 is located and the horizontal plane (the angles _β1 and _β2 before the change as shown in Figure 4), the angle γ between the imaging light and the vertical plane (the angles _γ1 and _γ2 before the change as shown in Figure 4), the angle δ between the imaging light and the horizontal plane (the angles _δ1 and _δ2 before the change as shown in Figure 4), the rotation angle θ of the window unit 202 around the vertical direction (the changed angle θ as shown in Figure 5), etc. Therefore, in the present application, adjusting the angle of the display device 200 may be adjusting the angle between the display device 200 and the horizontal plane (also referred to as the pitch angle). When the angle between the display device 200 and the horizontal plane changes, the display device 200 exhibits an effect similar to "nodding". Alternatively, adjusting the angle of the display device 200 may be adjusting the angle between the display device 200 and the vertical plane (also referred to as the horizontal deflection angle, the swing angle). When the angle between the display device 200 and the vertical plane changes, the display device 200 exhibits an effect similar to "shaking its head". Alternatively, adjusting the angle of the display device 200 may be adjusting the angle between the display device 200 and the vertical plane and adjusting the angle between the display device 200 and the vertical plane at the same time.

It is understandable that FIG. 2 is only an example of a display device applicable to the display system embodiment of the present application, that is, the structure of the display device applicable to the embodiment of the present application is not limited to the structure shown in FIG. 2. In other embodiments, the position of the image generation unit 201 in the display device 200 can also be arranged at other positions, for example, arranged behind the curved mirror 203. At this time, the imaging light emitted by the image generation unit 201 passes through the image magnification unit 203 and is incident on the surface of the window unit 202, and is reflected by the window unit 202 and is incident on the image magnification unit 203, and then is reflected by the image magnification unit 203 again to the window unit 202 and passes through the window unit 202 before entering the human eye.

FIG6 is a schematic structural diagram of a first display system 600 provided in an embodiment of the present application. It should be noted that the display system 600 shown in FIG6 is exemplarily described by taking the display device 200 shown in FIG2 as an example. As shown in FIG6 , the display system 600 includes a display device 200 and an adjustment device 610. The adjustment device 610 is used to adjust the first angle of the display device 200 to a second angle, so that the user can view the virtual image formed by the first imaging light at the second angle through the window unit 202.

Specifically, the adjusting device 610 is connected to the display device 200 via the rotating unit 204. Optionally, the adjusting device 610 is an automatic device (e.g., electric, magnetic, etc.) or a manual device. Exemplarily, when the adjusting device 610 is an automatic device, the adjusting device 610 may be a motor, and the motor drives the rotating unit 204 to rotate, thereby rotating the display device 200 from a first angle to a second angle. Alternatively, when the adjusting device 610 is a manual device, the adjusting device 610 may be a rotating handle of the rotating unit 204, such as a rotating gear or a rotating handle, and the display device 200 is rotated from a first angle to a second angle by the user operating the rotating unit 204.

Optionally, when the adjustment device 610 is an automatic device, the automatic device can be arranged inside the display device 200, or as shown in FIG. The adjusting device 610 is arranged outside the display device 200 , and the present application does not limit the position of the adjusting device 610 .

Based on the above scheme, the display system provided by the present application can utilize an adjustment device to realize automatic or manual adjustment of the angle of the display device. When the adjustment device automatically adjusts the angle of the display device, the intelligent performance of the display system is improved. The angle of the adjusted display device matches the user's viewing angle, thereby achieving the purpose of improving the user experience.

FIG7 is a schematic structural diagram of a second display system 700 provided in an embodiment of the present application. It should be noted that the display system 700 shown in FIG7 is exemplarily described by taking the display device 200 shown in FIG2 as an example. As shown in FIG7, the display system 700 includes a display device 200, an adjustment device 610, a first acquisition device 710, and a processing device 720. Among them, the first acquisition device 710 is connected to the processing device 720, and the processing device 720 is connected to the adjustment device 610. Specifically, the first acquisition device 710 is used to acquire one or more first images containing the user's human eyes when the display device 200 is at a first angle, and send one or more first images to the processing device 720. The processing device 720 generates a first adjustment amount based on the received one or more first images, and sends the first adjustment amount to the adjustment device 610. The description of the display device 200 and the adjustment device 610 can refer to the relevant parts in FIG2 or FIG6 above, and will not be repeated here.

Optionally, the first acquisition device 710 may be a sensor in the cabin, for example, the first acquisition device 710 may be an image sensor arranged on the top of the cabin or on the housing of the display device 200. When the first acquisition device 710 is an image sensor arranged on the top of the cabin, the first acquisition device 710 may be arranged in front of the user's eyes to capture one or more first images including the front view of the eyes; or the first acquisition device 710 may be arranged in the side face direction of the user to capture one or more first images including the side view of the eyes. When the first acquisition device 710 is an image sensor arranged on the housing of the display device 200, the first acquisition device 710 may be arranged on the housing above the window unit 202 (as shown in FIG. 7 ) to capture one or more first images including the front view of the eyes.

Optionally, the processing device 720 may be a processor disposed in the cockpit or on the housing of the display device 200. When the processing device 720 is a processor disposed in the cockpit, the processor may be a central processor for controlling the cockpit system. When the processing device 720 is located on the housing of the display device 200, it may be disposed next to the first acquisition device 710 located on the housing, as shown in FIG7 .

It should be noted that the present application does not limit the connection method between the processing device 720 and the first acquisition device 710, and the connection method between the processing device 720 and the adjustment device 610. Both can be connected through a wired link or a wireless link, either directly or indirectly through other network devices, controllers, etc., so that the processing device 720 can exchange information with the first acquisition device 710 or the adjustment device 610 through the connected link.

In some embodiments, when the first acquisition device 710 acquires a first image, the processing device 720 determines a first human eye position and an ideal human eye position based on the received first image, and generates a first adjustment amount based on the first human eye position and the ideal human eye position, wherein the first human eye position is the distance of the human eye in the first image relative to the image edge in the vertical direction and/or horizontal direction.

Specifically, when the first human eye position is the distance in the vertical direction relative to the edge of the first image, (a) in Figure 8 shows a schematic diagram of the first human eye position in the first image being located above and below the ideal human eye position, wherein the vertical direction is the y direction shown in Figure 8. At this time, the processing device 720 can determine the distance d or distance d' between the first human eye position and the ideal human eye position in the vertical direction (that is, the difference between the y coordinate of the first human eye position and the y coordinate of the ideal human eye position) through an image processing algorithm, and generate a first adjustment amount Δθ of the angle of the display device 200 based on the distance d or the distance d', and send the first adjustment amount Δθ to the adjustment device 510. The adjustment device 510 drives the rotation unit 204 to rotate Δθ based on the first adjustment amount Δθ to complete the angle adjustment of the display device 200, so that the human eye position in the image after the angle adjustment basically coincides with the ideal human eye position, as shown in (b) in Figure 8. It can be understood that if the ideal human eye position is used as the coordinate axis with a distance of 0, when the first human eye position is above the ideal human eye position, the distance d can be set to a positive value, and the display device 200 achieves a "head-up" effect when adjusting the angle. When the first human eye position is below the ideal human eye position, the distance d' is set to a negative value, and the display device 200 achieves a "head-down" effect when adjusting the angle.

When the first eye position is the distance in the horizontal direction relative to the edge of the first image, FIG. 9 (a) shows a schematic diagram of the first eye position being located to the left and right of the ideal eye position, wherein the horizontal direction is the x direction shown in FIG. 9 . At this time, the processing device 720 can determine the distance d or distance d' (i.e., the difference between the x coordinate of the first eye position and the x coordinate of the ideal eye position) in the horizontal direction between the first eye position and the ideal eye position through an image processing algorithm, and calculate and generate a first adjustment amount Δθ of the angle of the display device 200 according to the distance d, and send the first adjustment amount Δθ to the adjustment device 510. The adjustment device 510 drives the rotation unit 204 to rotate Δθ according to the first adjustment amount Δθ, and completes the angle adjustment of the display device 200, so that the eye position in the image after the angle adjustment is substantially coincident with the ideal eye position, as shown in FIG. 9 (b). It can be understood that when the first eye position is located to the left of the ideal eye position, the distance d is a negative value, and the display device 200 achieves a "shaking head" effect to the left when adjusting the angle. When the first human eye position is located to the right of the ideal human eye position, the distance d' is a positive value, and the display device 200 achieves a rightward "shaking head" effect when adjusting the angle.

When the first eye position in a first image acquired by the first acquisition device 710 changes relative to the ideal eye position in both the vertical and horizontal directions, for example, as shown in (a) of FIG. 10 , when the first eye position is located to the upper left of the ideal eye position, The processing device 720 can determine the distance d1 in the vertical direction and the distance d2 in the horizontal direction between the first human eye position and the ideal human eye position through an image processing algorithm, and calculate and generate a first adjustment amount Δθ of the angle of the display device 200 based on the distances d1 and d2, and send the first adjustment amount Δθ to the adjustment device 510. The adjustment device 510 drives the rotation unit 204 to rotate Δθ based on the first adjustment amount Δθ to complete the angle adjustment of the display device 200, so that the human eye position in the image after the angle adjustment basically coincides with the ideal human eye position, as shown in (b) in Figure 10.

Generally speaking, in the actual angle adjustment process, due to the existence of errors in the rotation process of the rotation unit 204, the calculation process of the processing device 720, or the process of the first acquisition device 710 acquiring the first image, the human eye position in the image after the angle adjustment described in the present application basically coincides with the ideal human eye position, which means that the distance between the human eye position after the angle adjustment and the ideal human eye position (including at least one of the vertical distance and the horizontal distance mentioned above) is within the allowable error range.

It can be understood that in the above-mentioned FIG8, since the coordinates of the first eye position only change in the vertical direction relative to the ideal eye position, the first eye position obtained by the processing device 720 is the coordinate value of the eye in the first image relative to the edge of the first image in the vertical direction. When the first image is a rectangle, the vertical direction can be understood as the short side direction of the rectangle. In FIG9, the coordinates of the first eye position only change in the horizontal direction relative to the ideal eye position, so the first eye position obtained by the processing device 720 is the coordinate value of the eye in the first image relative to the edge of the first image in the horizontal direction, and when the first image is a rectangle, the horizontal direction can be understood as the long side direction of the rectangle. In FIG10, the coordinates of the first eye position relative to the ideal eye position in both the vertical and horizontal directions change, so the first eye position obtained by the processing device 720 is determined by the coordinate values of the eye in the first image relative to the edge of the first image in the horizontal and vertical directions. In addition, in the present application, the ideal eye position is the center position of the first image. That is, the ideal human eye position is at the same distance from the upper and lower edges of the first image, and at the same time, the ideal human eye position is at the same distance from the left and right edges of the first image.

It can also be understood that in Figures 8 to 10, the lower edge of the first image is the axis of y=0, and the left edge of the first image is the axis of x=0, but the present application is not limited to this. In other words, in the description of the present application, the long side of the rectangle is used as the horizontal direction, and the short side of the rectangular image is used as the vertical direction for explanation. The horizontal direction and the vertical direction are only for the convenience of explanation, and can also be called the first direction and the second direction. The first direction and the second direction are perpendicular to each other. Therefore, the present application does not limit the positioning of the coordinate axis to be strictly the same as the above-mentioned example figure, as long as the first eye position in the first image and the ideal eye position are calculated using the same image coordinate.

It should be noted that, in the embodiment of the present application, when the image acquired by the first acquisition device 710 (including the above one or more first images, and the following one or more second images, and one or more third images) is a front view of the user, for example, when the image contains both eyes of the user, the eye position (including the above first eye position, and the following second eye position) can be understood as the midpoint of the line connecting the eyes, or the position of the user's eyebrows, etc., which is not limited in the present application. When the image acquired by the first acquisition device 710 (including the above one or more first images, and the following one or more second images, and one or more third images) is a side view of the user, the eye position can be understood as the distance of the eye relative to the edge of the image in the vertical direction and/or horizontal direction in the side view. It can be understood that the above Figures 8, 9 and 10 are all described by taking the front view of the user acquired by the first acquisition device 710 as an example.

In other embodiments, when the first acquisition device 710 acquires multiple first images, the processing device 720 determines the second eye position and the ideal eye position based on the received multiple first images, and generates a first adjustment amount based on the second eye position and the ideal eye position, wherein the second eye position is determined according to the distance of the eye in each of the multiple first images relative to the edge of the corresponding image in the vertical direction and/or horizontal direction. Optionally, the second eye position can be the average value, variance, mean square error, median, etc. of the distance of the eye in the multiple first images relative to the edge of the corresponding image in the vertical direction and/or horizontal direction, which is not limited in this application. Exemplarily, when the first acquisition device 710 sends 10 first images to the processing device 720, and the second eye position is represented by an average value, the processing device 720 calculates the eye position in each first image, and then calculates the average value of the 10 eye positions of the 10 first images to obtain the second eye position.

It is understandable that the eye position in each of the multiple first images can be a change in the vertical direction relative to the ideal eye position as shown in FIG. 8 above, or a change in the horizontal direction relative to the ideal eye position as shown in FIG. 9, or a change in the vertical and horizontal directions relative to the ideal eye position as shown in FIG. 10, which will not be described in detail here. In addition, when calculating the difference between the eye position in the multiple first images and the ideal eye position, it is always calculated by subtracting the ideal eye position from the actual eye position in the first image or by subtracting the actual eye position from the ideal eye position.

In some scenarios, such as when the car is driving on a bad road and there are bumps, the cockpit shakes. In order to prevent the display device 200 from frequently adjusting the angle, causing dizziness and fatigue to the user, in some other embodiments, when the processing device 720 determines that the distance between the second eye position and the ideal eye position is greater than the first threshold, that is, the difference between the second eye position and the ideal eye position is greater than the first threshold, the processing device 720 generates a first adjustment amount Δθ. Among them, multiple first images are acquired in a stable state. Among them, the stable state is defined as multiple first images are acquired within a first preset time, and at the same time, the distance of the human eye in each first image relative to the edge of the corresponding image in the vertical direction and/or horizontal direction is within a first preset range. In other words, the human eye position in the multiple first images acquired by the first acquisition device within the first preset time is within the first preset range. It should be noted that the first preset range refers to the human eye position within the first preset time. For example, it can be understood that among the multiple first images acquired in chronological order, the change of the eye position in the later acquired first image of two adjacent first images relative to the eye position in the previous first image is within the first preset range, or it can be understood that the difference between the maximum and minimum values of the eye position in the multiple first images is within the first preset range, etc., which is not limited in this application.

Specifically, after the first acquisition device 710 sends the first image acquired in real time to the processing device 720, the processing device 720 first determines that among the multiple first images acquired within the first preset time, the human eye position in each first image is within the first preset range. The processing device 720 may consider that the human eye position in the first preset time period is a position actively adjusted by the user, for example, the human eye position changes after the user changes the sitting posture, rather than passive shaking caused by the cockpit. If the processing device 720 continues to determine that the difference between the generated second human eye position and the ideal human eye position is greater than the first threshold, the processing device 720 generates a first adjustment amount to trigger the display device 200 to change its angle. It can be understood that when the second human eye position acquired in a stable state is less than the first threshold and the ideal human eye position is less than the first threshold, the display device 200 does not adjust. At this time, the processing device may discard the calculated second human eye position, and trigger the angle adjustment of the display device 200 until the difference between the second human eye position and the ideal human eye position in the next stable state is calculated to be greater than or equal to the first threshold. By setting the first threshold, the angle adjustment of the display device 200 is no longer too frequent, thereby ensuring the user experience.

It should be noted that, in the present application, the first preset time and the first preset range may be fixed values or may be variable values. Specifically, when the first preset time is a fixed value, it may be preset by the display system when it leaves the factory, or it may be generated by the processing device 720 based on the user's usage habits over a period of time, using machine learning or big data algorithms, etc., which is not limited in this application. For example, it may be 0.8s to 3s. When the first preset time is a variable value, the first preset time can be flexibly adjusted according to the environment in which the cockpit is located, where the environment in which the cockpit is located may include but is not limited to the brightness of the cockpit, the posture of the cockpit (such as the road conditions of the car, vehicle navigation information, etc.). For example, when the ambient light described in the cockpit is relatively dim, the accuracy of the second eye position generated by the processing device 720 based on multiple first images is poor. At this time, the first preset time can be set longer to avoid errors in the calculation. For another example, when a car is traveling on a flat highway, the possibility of the car bumping is small, or the frequency of the user's sitting posture adjustment is low, or the processing device 720 learns from the navigation information that the car will continue to travel on the highway for a long time in the future, etc. At this time, the processing device 720 can appropriately set a longer first preset time. When the first preset range is a fixed value, it can be preset in the processing device 720 by the display system at the factory, or it can be generated by the processing device 720 according to the user's usage habits, using machine learning or big data algorithms, etc., and this application does not limit it. For example, it can be 5cm to 7cm. When the first preset range is a variable value, the first preset time can be flexibly adjusted according to the environment of the cabin, etc. For example, when the car is traveling on a flat highway, the first preset range can be adjusted to be larger.

It should also be noted that in some scenarios, the processing device 720 may also stop calculating the first adjustment amount Δθ for a period of time. In this case, it can be considered that even if the processing device 720 calculates the first adjustment amount Δθ, it will not be sent to the adjustment device; or, it can be considered that the processing device 720 discards the data of multiple first images received during this period. For example, for an aircraft cockpit, the processing device 720 can know the flight environment in advance, such as the presence of strong airflow in a certain flight distance. At this time, the processing device 720 can calculate the time taken to pass through the airflow based on the flight speed of the aircraft and the length of the airflow, and stop adjusting the display device during this time.

Based on the above scheme, the accuracy of the eye position can be improved by generating the second eye position through multiple first images, thereby ensuring the accuracy of the angle adjustment of the display device. When the second eye position is generated through multiple first images in a stable state, and the first threshold is used to determine whether to adjust the angle, the jitter existing in the cockpit display system can be filtered, and the angle adjustment of the display device 200 can be performed under the trigger condition (that is, the above first threshold is used as the trigger condition), thereby further ensuring the reliability of the angle adjustment and further improving the user experience.

In order to further improve the reliability of the display system 700, the display system 700 optionally further includes a second acquisition device 730, which is used to acquire the environmental information of the display device 200, such as the cockpit posture (including but not limited to the road conditions of the vehicle, the navigation information of the vehicle, etc.), the brightness of the cockpit, the temperature of the display device 200, etc., so that the processing device 720 can further determine the credibility of the acquired second eye position according to the environmental information. Specifically, when the processing device 720 determines that the credibility of the second eye position generated according to the environmental information is low, the processing device 720 abandons the current second eye position and recalculates the second eye position with higher credibility according to the received multiple first images. When the processing device 720 determines the credibility of the second eye position according to the cockpit posture, exemplarily, the second acquisition device 730 can be a laser radar device for detecting road conditions or a navigation device for navigating routes, etc. At this time, the processing device 730 can generate road condition information corresponding to the multiple first images, compare the actual road condition information with the ideal road condition information, and obtain a road condition credibility coefficient. When the road condition credibility coefficient is greater than or equal to 0.5, the processing device 720 believes that the second eye position corresponding to the multiple first images is credible. When the processing device 720 determines the credibility of the second eye position based on the brightness of the cabin, the second acquisition device 730 can be a brightness detector. Exemplarily, when the second acquisition device 730 is a brightness detector, the processing device 730 can generate brightness information corresponding to the multiple first images, compare the brightness information with the ideal brightness information, and obtain a brightness credibility coefficient. When the brightness credibility coefficient is greater than or equal to 0.5, the processing device 720 believes that the second eye position corresponding to the multiple first images is credible. When the value of the second eye position corresponding to the plurality of first images is equal to 0.5, the processing device 720 considers that the second eye position corresponding to the plurality of first images is credible. When the processing device 720 determines the credibility of the second eye position according to the temperature of the display device 200, the second acquisition device 730 may be a temperature detector. At this time, the processing device 730 may determine whether the second eye position corresponding to the plurality of first images is credible according to the temperature of the display device 200 when the plurality of first images are acquired. It is to be understood that the above-mentioned environmental information is only an example and not a limitation, and the present application is not limited thereto. Other information of the display device 200 that affects the credibility of the second eye position, or other information of the cockpit, are within the protection scope of the present application.

It should be noted that the processing device 720 can also make a credibility judgment based on the information of the first image acquired by the first acquisition device 710. In this case, the display system 700 may not include the second acquisition device 730. Exemplarily, the processing device 730 can generate color information corresponding to multiple first images, compare the color information with the ideal color information, and obtain a color credibility coefficient. When the color credibility coefficient is greater than or equal to 0.5, the processing device 720 believes that the second eye position corresponding to the multiple first images is credible. Alternatively, the processing device 730 can also determine through image processing that the eye positions in the multiple first images (including the first eye position and the second eye position) are not credible. For example, the processing device 730 determines that the generated eye positions are inaccurate due to the obstructions such as sunglasses worn by the users in the multiple first images.

Based on the above solution, by using the processing device to determine the credibility of the second eye position, the reliability of the display system can be further improved, thereby improving the user experience.

It is understandable that the above-described embodiments are only for the angle adjustment of the display device 200. In other scenarios, the display system provided by the present application also has the function of adjusting the virtual image frame. For example, after the angle of the display device 200 is adjusted, the user may not be able to see the entire virtual image, and the virtual image needs to be reduced; or, the virtual image generated by the first imaging light emitted by the display device 200 is small, and the user needs to enlarge the virtual image. Specifically, the first acquisition device 710 is used to acquire one or more second images containing the user's eyes when the display device 200 is at a second angle, and send the one or more second images to the processing device 720. The processing device 720 also generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit 201. The image generation unit 201 generates an image of a corresponding size according to the second adjustment amount, and emits the second imaging light to the window unit 202. The window unit 202 reflects the second imaging light from the image generating unit 201 to the image magnifying unit 203, and transmits the second imaging light from the image magnifying unit 203, so that the user can view the virtual image formed by the second imaging light at the second angle through the window unit 202. The image magnifying unit 203 is used to reflect the second imaging light from the window unit 202 to the window unit 202.

In some embodiments, when the first acquisition device 710 acquires a second image, the processing device 720 determines the first human eye depth based on the received second image, and generates a second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit 202 when acquiring the second image, the second human eye depth is the human eye depth corresponding to the third image, the second human eye depth is the distance between the human eye and the window unit 202 when acquiring the third image, the acquisition time of the third image is before the acquisition time of a second image, or the second human eye depth is a preset human eye depth.

It is understandable that different eye depths correspond to different frame sizes, or different eye depth ranges correspond to different frame sizes. Therefore, after the processing device 720 determines the first eye depth, it can determine the first frame size corresponding to the first eye depth according to the value of the first eye depth or the range of the first eye depth, and simultaneously determine the second frame size corresponding to the second eye depth, and generate a second adjustment amount by comparing the first frame size and the second frame size, and send the second adjustment amount to the image generation unit 201, so that the image generation unit 201 emits the second imaging light corresponding to the second frame size.

It should be noted that different human eye depths correspond to different frame sizes, which may be the frame size of the virtual image or the frame size in the image generation unit 201, and this application does not limit this.

In addition, the preset human eye depth may be the one set before the cockpit display system leaves the factory, or the human eye depth corresponding to the frame adjusted by the user based on usage habits, or the human eye depth learned by the processing device 702 based on user usage habits, etc., and this application does not limit this.

In other embodiments, when the first acquisition device 710 acquires multiple second images, the processing device 720 determines a third human eye depth based on the received multiple second images, and generates a second adjustment amount based on the third human eye depth and the fourth human eye depth, wherein the third human eye depth is the distance between the human eye and the window unit 202 when the multiple second images are acquired, the fourth human eye depth is the human eye depth corresponding to the multiple third images, the fourth human eye depth is the distance between the human eye and the window unit 202 when the multiple third images are acquired, the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth.

It should be noted that the third human eye depth can be the average value, variance, mean square error, median, etc. of the distance between the human eye and the window unit 202 when each second image of the plurality of second images is acquired, and this application does not limit it. Exemplarily, when the first acquisition device 710 sends 10 second images to the processing device 720, and the third human eye depth is represented by an average value, the processing device 720 calculates the human eye depth when each second image is acquired, and then calculates the average value of the 10 human eye depths of the 10 second images to obtain the third human eye depth.

It should be noted that, in the embodiment of the present application, the human eye depth (including the first human eye depth to the fourth human eye depth in the text) is the human eye depth. The distance between the plane where the human eye is located and the plane where the window unit 202 is located. When the human eye in the acquired one or more images is a front view, since the one or more images have depth information, the depth of the human eye can be determined from the depth information. When the human eye in the acquired one or more images is a side view, the depth of the human eye in the one or more images can be converted by the distance d between the human eye and the window unit 202 in the image. Exemplarily, as shown in FIG. 11, the image is a side view of the human eye, wherein the depth of the human eye can be determined by the distance between the plane where the human eye is located and the plane where the window unit 202 is located in the image.

Similarly, in order to avoid unnecessary frame adjustment caused by cockpit shaking, in some other embodiments, when the processing device 720 determines that the distance between the third eye depth and the fourth eye depth is greater than the second threshold, that is, the difference between the third eye depth and the fourth eye depth is greater than the second threshold, the processing device 720 generates a second adjustment amount based on the third eye depth and the fourth eye depth. Among them, the multiple second images and the multiple third images are acquired in a stable state. In other words, the multiple second images and the multiple third images are acquired within the second preset time, and at the same time, the multiple eye depths corresponding to the multiple second images are within the second preset range, and the multiple eye depths corresponding to the multiple third images are within the second preset range. Exemplarily, the multiple eye depths corresponding to the multiple second images are within the second preset range, which can be understood as the change of the eye depth in the second image acquired later in the two adjacent second images relative to the eye depth in the previous second image is within the second preset range, or it can be understood that the difference between the maximum and minimum values of the eye depth in the multiple second images is within the second preset range, etc., which is not limited in this application. Similarly, the multiple human eye depths corresponding to the multiple third images are within the second preset range, which can be understood as the change in the human eye depth in the later acquired third image between two adjacent third images relative to the human eye depth in the previous third image is within the second preset range, or it can be understood as the difference between the maximum and minimum values of the human eye depth in the multiple third images is within the second preset range, etc., and this application is not limited to this.

Specifically, after the first acquisition device 710 sends the second image acquired in real time to the processing device 720, the processing device 720 first determines that the eye depth in each of the multiple second images acquired within the second preset time period is within the second preset range, and the processing device 720 believes that the eye depth in the second preset time period is actively adjusted by the user, for example, the eye depth changes after the user changes his sitting posture, rather than passive shaking caused by the cabin. At this time, the processing device 720 generates a third eye depth based on multiple eye depths. If the processing device 720 continues to determine that the difference between the generated third eye depth and the fourth eye depth is greater than the second threshold, the processing device 720 generates a second adjustment amount, triggering the frame of the display device 200 to change. At the same time, the fourth eye depth is saved for the next adjustment. It can be understood that when the difference between the third eye depth and the fourth eye depth obtained in a stable state is less than the second threshold, the display device 200 does not make any adjustments. At this time, the processing device may discard the calculated third eye depth and trigger the frame adjustment of the display device 200 only when the difference between the third eye depth and the fourth eye depth in the next stable state is calculated to meet the second threshold.

Similarly, the second preset range may be a fixed value or a variable value. The setting of the second preset range may refer to the setting of the first preset range, which will not be described in detail here.

In addition, the processing device 720 also stops calculating the second adjustment amount for a period of time according to the environment of the cabin, etc., and reference may be made to the description of the relevant parts in the above text, which will not be repeated here.

In order to further improve the reliability of the display system 700, the display system 700 can determine the credibility of the acquired third-person eye depth through the environmental information of the display device 200 obtained by the second acquisition device 730, or the information of multiple second images obtained by the first acquisition device 710. This process is the same as the process of determining the credibility of the second person's eye position, and will not be repeated here.

It can be understood that the angle adjustment of the display device 200 is performed based on one or more first images acquired by the first acquisition device 710, and the frame adjustment is performed based on one or more second images acquired by the first acquisition device 710. Since the second image is acquired when the display device is located at the second angle, in other words, the frame adjustment can further improve the user experience on the basis of the angle adjustment. Of course, in other embodiments, the display system 700 can also perform frame adjustment first and then angle adjustment, and the display device can use one or more identical images.

FIG12 is a circuit diagram of a display device provided by an embodiment of the present application. As shown in FIG12 , the circuit in the display device mainly includes a host CPU 1201, an external memory interface 1202, an internal memory 1203, an audio module 1204, a video module 1205, a power module 1206, a wireless communication module 1207, an I/O interface 1208, a video interface 1209, a display circuit 1210, and a modulator 1212. Among them, the host CPU 1201 and its peripheral components, such as the external memory interface 1202, the internal memory 1203, the audio module 1204, the video module 1205, the power module 1206, the wireless communication module 1207, the I/O interface 1208, the video interface 1209, and the display circuit 1210 can be connected through a bus. The host CPU 1201 can be called a front-end processor.

In addition, the circuit diagrams shown in the embodiments of the present application do not constitute a specific limitation on the display device. In other embodiments of the present application, the display device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The main processor 1201 includes one or more processing units. For example, the main processor 1201 may include an application processor. (Application Processor, AP), modem processor, graphics processor (Graphics Processing Unit, GPU), image signal processor (Image Signal Processor, ISP), controller, video codec, digital signal processor (Digital Signal Processor, DSP), baseband processor, and/or neural network processor (Neural-Network Processing Unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors.

The main processor 1201 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the main processor 1201 is a cache memory. The memory may store instructions or data that the main processor 1201 has just used or cyclically used. If the main processor 1201 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the main processor 1201, and thus improves the efficiency of the system.

In some embodiments, the display device may further include a plurality of input/output (I/O) interfaces 1208 connected to the main processor 1201. The interface 1208 may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc. The I/O interface 1208 may be connected to devices such as a mouse, touchpad, keyboard, camera, speaker, microphone, etc., and may also be connected to physical buttons on a display device (such as volume buttons, brightness adjustment buttons, power buttons, etc.).

The external memory interface 1202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with the main processor 1201 through the external memory interface 1202 to implement the data storage function.

The internal memory 1203 can be used to store computer executable program codes, which include instructions. The internal memory 1203 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a call function, a time setting function, etc.), etc. The data storage area can store data created during the use of the display device (such as a phone book, world time, etc.), etc. In addition, the internal memory 1203 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (Universal Flash Storage, UFS), etc. The main processor 1201 executes various functional applications and data processing of the display device by running instructions stored in the internal memory 1203 and/or instructions stored in a memory provided in the main processor 1201.

The display device can implement audio functions such as music playing and making calls through the audio module 1204 and the application processor.

The audio module 1204 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 1204 can also be used to encode and decode audio signals, such as playing or recording. In some embodiments, the audio module 1204 can be arranged in the main processor 1201, or some functional modules of the audio module 1204 can be arranged in the main processor 1201.

The video interface 1209 can receive external audio and video signals, which can be specifically a high-definition multimedia interface (HDMI), a digital video interface (DVI), a video graphics array (VGA), a display port (DP), etc. The video interface 1209 can also output video to the outside. When the display device is used as a vehicle display, the video interface 1209 can receive speed signals and power signals input from peripheral devices, and can also receive external VR video signals. When the display device is in use, the video interface 1209 can receive video signals input from an external computer or terminal device.

The video module 1205 can decode the video input by the video interface 1209, for example, by performing H.264 decoding. The video module can also encode the video collected by the display device, for example, by performing H.264 encoding on the video collected by the external camera. In addition, the main processor 1201 can also decode the video input by the video interface 1209, and then output the decoded image signal to the display circuit 1210.

The display circuit 1210 and the modulator 1212 are used to display the corresponding image. In this embodiment, the video interface 1209 receives an external video source signal, and the video module 1205 decodes and/or digitally processes and outputs one or more image signals to the display circuit 1210. The display circuit 1210 drives the modulator 1212 to image the incident polarized light according to the input image signal, and then outputs the image light. In addition, the main processor 1201 can also output one or more image signals to the display circuit 1210.

In this embodiment, the display circuit 1210 and the modulator 1212 are electronic components in the above-mentioned image generating unit, and the display circuit 1210 can be called a driving circuit.

The power module 1206 is used to provide power to the main processor 1201 and the light source 1200 according to the input power (e.g., direct current), and the power module 1206 may include a rechargeable battery, which can provide power to the main processor 1201 and the light source 1200. The light emitted by the light source 1200 can be transmitted to the modulator 1212 for imaging, thereby forming an image light signal.

The wireless communication module 1207 can enable the display device to communicate with the outside world wirelessly, and can provide a wireless local area network (WLAN). Area Networks, WLAN) (such as Wireless Fidelity (Wi-Fi) network), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR) and other wireless communication solutions. The wireless communication module 1207 can be one or more devices integrating at least one communication processing module. The wireless communication module 1207 receives electromagnetic waves via an antenna, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the main processor 1201. The wireless communication module 1207 can also receive the signal to be sent from the main processor 1201, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

In addition, in addition to being input through the video interface 1209, the video data decoded by the video module 1205 can also be wirelessly received through the wireless communication module 1207 or read from an external memory. For example, the display device can receive video data from a terminal device or an in-vehicle entertainment system through the wireless LAN in the vehicle, and the display device can also read audio and video data stored in an external memory.

The above-mentioned display device can be installed on a vehicle, please refer to Figure 13, which is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application.

As shown in FIG13 , the functional framework of the vehicle may include various subsystems, such as the sensor system 12, the control system 14, one or more peripheral devices 16 (one is shown as an example), the power supply 18, the computer system 20, and the vehicle display system 22. Optionally, the vehicle may also include other functional systems, such as an engine system that provides power for the vehicle, etc., which are not limited in this application.

Among them, the sensor system 12 may include several detection devices, which can sense the measured information and convert the sensed information into electrical signals or other required forms of information output according to certain rules. As shown in the figure, these detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser rangefinder, a camera device, a wheel speed sensor, a steering sensor, a gear position sensor, or other components for automatic detection, etc., and this application does not limit them.

The control system 14 may include several components, such as the steering unit, brake unit, lighting system, automatic driving system, map navigation system, network timing system and obstacle avoidance system shown in the figure. Optionally, the control system 14 may also include components such as a throttle controller and an engine controller for controlling the vehicle's speed, which are not limited in this application.

The peripheral device 16 may include several components, such as the communication system, touch screen, user interface, microphone, and speaker shown in the figure. The communication system is used to realize network communication between the vehicle and other devices other than the vehicle. In practical applications, the communication system may use wireless communication technology or wired communication technology to realize network communication between the vehicle and other devices. The wired communication technology may refer to communication between the vehicle and other devices through network cables or optical fibers.

The power source 18 represents a system that provides power or energy for the vehicle, which may include but is not limited to a rechargeable lithium battery or a lead-acid battery, etc. In practical applications, one or more battery components in the power source are used to provide power or energy for starting the vehicle, and the type and material of the power source are not limited in this application.

Several functions of the vehicle are controlled and implemented by the computer system 20. The computer system 20 may include one or more processors 2001 (one processor is shown as an example in the figure) and a memory 2002 (also referred to as a storage device). In actual applications, the memory 2002 is also inside the computer system 20, or it may be outside the computer system 20, for example, as a cache in the vehicle, etc., which is not limited in this application.

in,

The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 may be used to run the relevant programs or instructions corresponding to the programs stored in the memory 2002 to implement the corresponding functions of the vehicle.

The memory 2002 may include a volatile memory, such as a RAM; the memory may also include a non-volatile memory, such as a ROM, a flash memory, a HDD or a solid state drive SSD; the memory 2002 may also include a combination of the above-mentioned types of memories. The memory 2002 may be used to store a set of program codes or instructions corresponding to the program codes, so that the processor 2001 calls the program codes or instructions stored in the memory 2002 to implement the corresponding functions of the vehicle. In the present application, a set of program codes for vehicle control may be stored in the memory 2002, and the processor 2001 calls the program codes to control the safe driving of the vehicle. How to achieve safe driving of the vehicle is specifically described in detail below in the present application.

Optionally, in addition to storing program codes or instructions, the memory 2002 may also store information such as road maps, driving routes, sensor data, etc. The computer system 20 may be combined with other elements in the vehicle functional framework diagram, such as sensors in the sensor system, GPS, etc., to implement relevant functions of the vehicle. For example, the computer system 20 may control the driving direction or driving speed of the vehicle based on the data input from the sensor system 12, which is not limited in this application.

The vehicle display system 22 may include several components, such as a controller and a vehicle display. The controller 222 is used to generate an image (such as an image of VR content) according to a user instruction and send the image to the vehicle display for display; the vehicle display may include an image generation unit, The window unit and the image magnification unit, the passenger can watch the target image presented by the vehicle display through the window unit. Among them, the functions of some components in the vehicle display system can also be realized by other subsystems of the vehicle, for example, the controller can also be a component in the control system.

Among them, FIG. 13 of the present application shows that it includes four subsystems, and the sensor system 12, the control system 14, the computer system 20 and the vehicle-mounted display system 22 are only examples and do not constitute limitations. In actual applications, vehicles can combine several components in the vehicle according to different functions to obtain subsystems with corresponding different functions. In actual applications, vehicles can include more or fewer systems or components, and this application does not limit them.

The above-mentioned means of transportation may be a car, a truck, a bus, a ship, an airplane, a helicopter, an amusement vehicle, a train, etc., and the embodiments of the present application do not make any particular limitation.

FIG14 is a schematic flow chart of a method 1400 for adjusting the angle of a display device provided in an embodiment of the present application. The method can be applied to the cockpit virtual image display system shown in FIG1 . The method 1400 can be executed by the processing device 610 in the above-mentioned display system 700, and the present application does not limit it. As shown in FIG14 , the method 1400 includes the following steps.

S1401, obtaining the human eye position and the ideal human eye position in the image.

In some embodiments, the processing device 610 acquires a first image through the first acquisition device 710, and determines the first human eye position and the ideal human eye position based on the first image; in other embodiments, the processing device 610 acquires a first image through the first acquisition device 710, and determines the second human eye position and the ideal human eye position based on the multiple first images.

S1402, determining a first adjustment amount of the display device based on the human eye position in the image and the ideal human eye position, where the first adjustment amount is an angle adjustment amount of the display device.

In some embodiments, when the processing device 610 determines a first human eye position and an ideal human eye position based on a first image, the processing device 610 generates a first adjustment amount based on the first human eye position and the ideal human eye position; in other embodiments, when the processing device 610 determines a second human eye position and an ideal human eye position based on multiple first images, the processing device 610 generates a first adjustment amount based on the second human eye position and the ideal human eye position.

The acquisition process of the one or more first images, the first eye position, the second eye position, the ideal eye position, the first adjustment amount, etc. can all be referred to the relevant descriptions above and will not be repeated here.

FIG15 is a schematic flow chart of a method 1500 for adjusting the image frame of a display device provided in an embodiment of the present application. The method can be applied to the cockpit virtual image display system shown in FIG1 . The method 1500 can be executed by the processing device 610 in the above-mentioned display system 700, and the present application does not limit it. As shown in FIG15 , the method 1500 includes the following steps.

S1501, obtaining a first human eye depth and a second human eye depth in an image, or obtaining a third human eye depth and a fourth human eye depth in an image.

In some embodiments, the processing device 610 acquires a second image through the second acquisition device 730, and determines the first human eye depth based on the second image. The first human eye depth is the distance between the human eye and the window unit 202 when acquiring a second image. The second human eye depth is the distance between the human eye and the window unit 202 when acquiring a third image, and the acquisition time of the third image is before the acquisition time of the second image. Alternatively, the processing device 610 acquires multiple second images through the second acquisition device 730, and determines the third human eye depth based on the multiple second images. The third human eye depth is determined based on the distance between the human eye and the window unit 202 when acquiring the multiple second images. The fourth human eye depth is determined based on the distance between the human eye and the window unit 202 when acquiring multiple third images, and the acquisition time of the multiple third images is before the acquisition time of the multiple fourth images.

S1502: Generate a second adjustment amount based on the first eye depth and the second eye depth, or generate a second adjustment amount based on the third eye depth and the fourth eye depth, where the second adjustment amount is an adjustment amount of the frame.

In some embodiments, the processing device 610 generates the second adjustment amount based on the first human eye depth and the second human eye depth; in other embodiments, the processing device 610 generates the second adjustment amount based on the third human eye depth and the fourth human eye depth.

The above-mentioned process of acquiring one or more second images, the process of acquiring one or more third images, the process of acquiring one or more fourth images, the first human eye depth, the second human eye depth, the second adjustment amount, etc. can all refer to the relevant descriptions in the above text and will not be repeated here.

It can be understood that the specific working process of the system described in the above method can refer to the corresponding process in the aforementioned display system embodiment, and will not be repeated here.

Unless otherwise defined, technical or scientific terms used herein shall have the same meaning as commonly understood by one of ordinary skill in the art to which the present disclosure belongs.

The above description is only an embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the present application shall be included in the protection scope of the present application.

Claims (14)

A display system, characterized in that it is used for vehicle-mounted display, the display system comprises: a display device and an adjustment device, the display device comprises an image generating unit, an image magnifying unit and a window unit, the adjustment device is connected to the display device, wherein: The image generating unit is configured to emit first imaging light toward the window unit; The window unit is used to reflect the first imaging light from the image generating unit to the image amplifying unit, and transmit the first imaging light from the image amplifying unit; The image amplifying unit is used to reflect the first imaging light from the window unit to the window unit, The adjusting device is used to adjust the first angle of the display device to a second angle, so that the user can view the virtual image formed by the first imaging light at the second angle through the window unit. The display system according to claim 1, characterized in that the display system further comprises a first acquisition device and a processing device, The first acquisition device is used to acquire one or more first images including the user's eyes when the display device is at the first angle, and send the one or more first images to the processing device; The processing device generates a first adjustment amount based on the one or more first images, and sends the first adjustment amount to the adjustment device; The adjusting device is specifically used to adjust the first angle to the second angle according to the first adjustment amount. The display system according to claim 2, characterized in that when the first acquisition device acquires the first image, The processing device is specifically used to: determine a first human eye position and an ideal human eye position based on the first image, and generate the first adjustment amount based on the first human eye position and the ideal human eye position, wherein the first human eye position is the distance of the human eye in the first image relative to the image edge in the vertical direction and/or horizontal direction. The display system according to claim 2, characterized in that when the first acquisition device acquires the plurality of first images, The processing device is specifically used to: determine the second human eye position and the ideal human eye position based on the multiple first images, and generate the first adjustment amount based on the second human eye position and the ideal human eye position, wherein the second human eye position is determined based on the distance of the human eye in each first image of the multiple first images relative to the edge of the corresponding image in the vertical direction and/or horizontal direction. The display system according to claim 4, characterized in that The difference between the second human eye position and the ideal human eye position is greater than a first threshold, the multiple first images are acquired within a first preset time, and the distance of the human eye in each of the multiple first images relative to the corresponding image edge in the vertical direction and/or horizontal direction is within a first preset range. The display system according to claim 5, characterized in that the display system further comprises a second acquisition device, The second acquisition device is used to acquire the environment information of the display device and send the environment information to the processing device; The processing device is further used to determine the credibility of the second human eye position according to the environmental information. The display system according to claim 2, characterized in that The processing device further generates a second adjustment amount based on the one or more second images, and sends the second adjustment amount to the image generation unit; The image generating unit is configured to generate an image of a corresponding size according to the second adjustment amount, and emit a second imaging light; The window unit is used to reflect the second imaging light from the image generating unit to the image amplifying unit, and transmit the second imaging light from the image amplifying unit, so that the user can view the virtual image formed by the second imaging light at the second angle through the window unit; The image amplifying unit is used to reflect the second imaging light from the window unit to the window unit. The display system according to claim 7, characterized in that when the first acquisition device acquires the second image, The processing device is specifically used to: determine a first human eye depth based on the one second image, and generate the second adjustment amount based on the first human eye depth and the second human eye depth, wherein the first human eye depth is the distance between the human eye and the window unit when the one second image is acquired, and the second human eye depth is the distance between the human eye and the window unit when the third image is acquired, and the acquisition time of the third image is before the acquisition time of the one second image, or the second human eye depth is a preset human eye depth. The display system according to claim 7, characterized in that when the first acquisition device acquires the plurality of second images, The processing device is specifically used to: determine a third eye depth based on the multiple second images, and generate the second adjustment amount based on the third eye depth and the fourth eye depth, wherein the third eye depth is based on the distance between the human eye and the visual window when the multiple second images are acquired. The fourth human eye depth is determined by the distance between the human eye and the window unit when the multiple third images are acquired, and the acquisition time of the multiple third images is before the acquisition time of the multiple second images, or the fourth human eye depth is a preset human eye depth. The display system according to claim 9, characterized in that A difference between the third human eye depth and the fourth human eye depth is greater than a second threshold, the multiple second images and the multiple third images are acquired within a second preset time, the distance between the human eye and the window unit is within a second preset range when the multiple second images are acquired, and the distance between the human eye and the window unit is within the second preset range when the multiple third images are acquired. The display system according to claim 10, characterized in that the display system further comprises a second acquisition device, The second acquisition device is used to acquire the environment information of the display device and send the environment information to the processing device; The processing device is further used to determine the credibility of the third human eye depth and the fourth human eye depth according to the environmental information. A means of transport, characterized by comprising a display system as described in any one of claims 1 to 11 above. The vehicle according to claim 12, characterized in that the display system is arranged at at least one of a headrest of a seat of the vehicle, a back of a seat of the vehicle, and a co-pilot's console of the vehicle. A cockpit system, characterized by comprising the display system according to any one of claims 1 to 11.