[go: up one dir, main page]

WO2021241496A1 - Dispositif d'affichage tête haute - Google Patents

Dispositif d'affichage tête haute Download PDF

Info

Publication number
WO2021241496A1
WO2021241496A1 PCT/JP2021/019599 JP2021019599W WO2021241496A1 WO 2021241496 A1 WO2021241496 A1 WO 2021241496A1 JP 2021019599 W JP2021019599 W JP 2021019599W WO 2021241496 A1 WO2021241496 A1 WO 2021241496A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
image
pixels
priority
warning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/019599
Other languages
English (en)
Japanese (ja)
Inventor
誠 秦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nippon Seiki Co Ltd
Original Assignee
Nippon Seiki Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Seiki Co Ltd filed Critical Nippon Seiki Co Ltd
Priority to JP2022527028A priority Critical patent/JP7639814B2/ja
Publication of WO2021241496A1 publication Critical patent/WO2021241496A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/211—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays producing three-dimensional [3D] effects, e.g. stereoscopic images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/33—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving directional light or back-light sources
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10—Intensity circuits
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory

Definitions

  • the present invention relates to a head-up display (HUD) device that displays a virtual image, and projects (projects) image display light onto a projected member such as a windshield or combiner of a vehicle (vehicle), for example.
  • HUD head-up display
  • a HUD device having a light field type three-dimensional display unit (light field display) or the like capable of displaying a plurality of virtual images at a desired virtual image display distance in front of the driver (viewer or user), etc.
  • Patent Document 1 discloses a technique capable of displaying a plurality of annotations (information such as text, objects, signs, commands, etc. displayed by a display) at different focal lengths in a HUD device using a light field display. (For example, claims 1 and 2, paragraph [0012], FIGS. 3 to 6 and the like).
  • a ray in space can be represented by a position in the plane when passing through a plane whose normal is the optical axis, and an angle (in other words, a direction) formed by the ray with the optical axis.
  • stereoscopic display device for example, a high-definition flat display and a small lens (lens array) are used in combination, and "lighting pixels (lighting pixels)" in the flat display are used.
  • Position is controlled to reproduce the light beam specified at an arbitrary position and direction.
  • the depth position (depth distance) of the stereoscopic image in the light field (light field), for example, as seen from the light field display side, can be appropriately determined by changing the "lighting pattern of lighting pixels (lighting pixels)" in the flat display. , Can be adjusted.
  • the light beam can be reproduced at an arbitrary position (position in a two-dimensional plane), direction, and depth position by controlling the lighting position and lighting pattern of the pixel on the flat display.
  • the present inventor has made various studies on generating light field data (data for displaying an image having at least one of lighting pixels and lighting patterns in a flat display) by rendering, and as a result, the following problems are solved. It became clear.
  • a planar display has a large number of pixels arranged in a rectangular area in a planar view, and the lateral direction of the quadrangle is an observer (or a stereoscopic image) that observes a stereoscopic image in real space. It shall correspond to the horizontal direction, which is the direction along the line segment connecting the left and right eyes of the viewer).
  • the vertical direction of the quadrangle is a direction (referred to as a height direction) corresponding to the height of the observer (viewer).
  • the direction along the line segment (normal line) orthogonal to the quadrangle and away from the quadrangle is defined as the depth direction.
  • One light spot constituting the stereoscopic image emits a pair of light rays for the left eye and light rays for the right eye.
  • the angle (convergence angle) formed when the pair of light rays intersect at the light spot increases as the depth distance from the light field display (for example, the center position of the lens) to the stereoscopic image becomes shorter.
  • the larger the convergence angle the larger the distance between the pixels on the flat display corresponding to each of the two light rays.
  • the convergence angle becomes large and the distance between the two pixels corresponding to the two light rays becomes large, and as a result, one of the above At least one of the pixels for displaying the stereoscopic image of is entered into the area where the pixel for displaying the other stereoscopic image is arranged, and in some cases, it overlaps with one of the pixels for displaying the other stereoscopic image. Cases occur.
  • one pixel is used to display each of the two stereoscopic images, resulting in pixel batting, in which case which stereoscopic image is used to display. It becomes indefinite and proper light field rendering cannot be performed. This means that in the worst case, the two stereoscopic images cannot be properly displayed together.
  • One of the objects of the present invention is that in a HUD device having a light field type stereoscopic display unit, proper light field rendering can be achieved by overlapping pixels for displaying one image with pixels for displaying another image. It is to avoid being unable to do so.
  • the head-up display device is a head-up display (HUD) device that displays a virtual image.
  • a light field type stereoscopic display unit that reproduces the display light of a stereoscopic image, including a display and optical members, An optical system that projects the light rays reproduced by the stereoscopic display unit onto the projected member, and A control unit that controls the display of images on the display, and Have,
  • the distance between the stereoscopic display unit and the stereoscopic image is defined as the depth distance
  • the direction along the depth distance when the stereoscopic image is viewed from the stereoscopic display unit is defined as the depth direction.
  • the control unit A first display position including at least a position in the depth direction of the first image showing the first information and a second display position including at least the position in the depth direction of the second image showing the second information are set. death,
  • the first pixel in the display used when displaying the first image in the first display position and the second pixel used in displaying the second image in the second display position overlap. Determine at least one of whether or not there is a possibility of duplication, and When it is determined that the first pixel and the second pixel overlap or may overlap, Priority is given to the display of the image having the higher display priority, and duplication suppression control including turning off the lighting or lowering the brightness of at least the pixels of the overlapping portion of the image having the lower priority is performed.
  • priority is given based on the display priority (priority). Priority is given to lighting of pixels for displaying high-quality images. Pixel duplication is avoided by turning off the display pixels of an image having a low priority (priority) or reducing the brightness (in other words, performing duplication suppression control). This makes it possible to generate light field data by rendering.
  • the duplication suppression control may be performed only on the display pixels of the image, or the duplication suppression control may be performed on all the images having the lower priority.
  • the part of the image with the lower priority displayed using non-overlapping pixels can be visually recognized, and the information can be presented to the viewer (observer) by the part of the image.
  • a process of hiding or reducing the visibility of the entire lower priority image is performed so that the viewer (observer) can see the higher priority image (the observer). It is possible to pay attention only to the virtual image of), and to efficiently acquire or perceive information.
  • the control unit When at least one of the first and second images is a dynamic image corresponding to a virtual image superimposed on a moving object, the duplication is possible based on the prediction of the movement of the object.
  • the sex may be determined.
  • the possibility of duplication of display pixels is determined based on the motion prediction of the object, and duplication avoidance control is performed. Can be done.
  • the display for alerting that is superimposed on a person who has entered the road it is determined whether or not there is a possibility of duplication with other indications based on the movement of the object, and the indication for alerting is appropriately displayed. It is possible to display with priority. In this case, safety can be ensured by preferentially displaying warnings and the like that are important for ensuring safety.
  • the control unit The duplication suppression control may be implemented as a warning display, a navigation display, a POI (Point Of Interest) display, and other displays in order of display priority from highest to lowest.
  • a warning display a navigation display
  • POI Point Of Interest
  • necessary measures can be taken efficiently and promptly to avoid duplication.
  • information that is considered necessary (important) for driving is given priority and presented to the user of the HUD device. Can be done.
  • the control unit may variably control the priority of the displayed image according to the driving scene.
  • the display useful for the current driving scene can be prioritized, and practical information is crossed. It can be displayed while suppressing the talk.
  • the control unit After displaying one image according to the priority, when the visual detection unit detects that the displayed image is visually recognized by a viewer, the display is restricted to the pixel display of the other image. At least a part of may be released.
  • the fifth aspect after the highest priority image (virtual image) is visually recognized, at least a part of the restriction is lifted for the image (virtual image) whose display is restricted under a predetermined condition. Then, the viewer can visually recognize a useful display by another image (virtual image).
  • the control unit The pixel for displaying the first image and the pixel for displaying the second image do not overlap, but are within a predetermined distance, or the distance between each pixel due to the movement of at least one pixel.
  • the overlap suppression control may be performed on the pixels of the image having the lower priority.
  • the display pixels of the lower priority image are duplicated.
  • Suppression control in other words, duplication avoidance processing
  • the state in which the images are close to each other can be said to be a state in which it is difficult to distinguish between the images (a state in which visibility is reduced) even if there is no duplication. In this state, the deterioration of visibility can be effectively suppressed by performing the process of quickly eliminating (suppressing) the conflict between the images.
  • the control unit Although the pixel for displaying the first image and the pixel for displaying the second image do not overlap, it is determined that both pixels are close to each other within a predetermined distance by at least one movement, and the time has elapsed. At the same time, when the distance between the two pixels becomes smaller, a fade-out process may be performed to gradually reduce the brightness of the pixels of the image having the lower priority.
  • the degree of the visibility limitation is gradually increased, whereby the visual change accompanying the visibility control can be moderated. Therefore, it is possible to reduce the discomfort caused by the change in vision.
  • the control unit The duplication suppression control may display a notification image indicating that the display of the low-priority image is restricted.
  • the viewer is informed that not all the information is completely displayed, but at least one piece of information is hidden or incompletely displayed. Therefore, the viewer can accurately grasp the current display status.
  • the driving scene determined by the driving scene determination unit is A sunny city (city or traffic volume above a certain value), a sunny highway (city), a busy intersection, or the first scene of a school road, A sunny city area (countryside or traffic volume is less than the specified value), a sunny highway (countryside), or when the driver looks away or returns from the other side, or the second scene of an accident-prone point or area.
  • TSR traffic sign recognition
  • the display priority of each of the four (at least two of them) display contents corresponds to, for example, seven driving scenes (at least four of them) in advance. It can be defined in a list format. As a result, the priority of the display content (display information) can be quickly updated according to each driving scene, and appropriate display control can be performed.
  • the warning display is The first warning about high relative speed objects (including oncoming vehicles and pedestrians), A second warning about low relative velocity objects (including vehicles traveling in the same direction), The third warning about notifications about the situation around the vehicle (including notifications of natural disasters and traffic accidents), Including
  • the first warning is set to have a higher display priority than the second and third warnings.
  • the second warning is set to have a higher priority in the first to sixth scenes, but in the seventh scene, the second warning and the second warning are set. 3 Warning priorities may be set to the same.
  • the warning display is further subdivided into three types (first, second, and third warnings), and the priority for each driving scene is set for each.
  • the priority of the first warning is the highest, and in the first to sixth scenes, the priority of the second warning is higher than that of the third warning, but in the seventh scene (during automatic driving), the driver is basically the driver.
  • the priority of the second warning and the third warning is set to the same level.
  • each warning content (warning type) is used. Pixel duplication can be suppressed according to the priority (priority) considering the set driving scene. Safety is improved because warnings can always be displayed properly.
  • FIG. 2A is a diagram showing a basic configuration example of a stereoscopic display unit (stereoscopic display device) of a light field method (light ray reproduction method) and an example of displaying (generating) a stereoscopic image
  • FIG. 2B is a stereoscopic display. It is a figure which shows the example in which the virtual image is displayed by the light rays for the left eye and the right eye emitted from one light spot which constitutes a stereoscopic image in the HUD apparatus which used the part (three-dimensional display apparatus).
  • FIG. 2A is a diagram showing a basic configuration example of a stereoscopic display unit (stereoscopic display device) of a light field method (light ray reproduction method) and an example of displaying (generating) a stereoscopic image
  • FIG. 2B is a stereoscopic display. It is a figure which shows the example in which the virtual image is displayed by the light rays for the left eye and the right eye emitted from one light spot which constitutes
  • FIG. 3A is a diagram for explaining the display of a stereoscopic image in a stereoscopic display unit (stereoscopic display device) using a lenticular lens
  • FIG. 3B is a stereoscopic display unit (stereoscopic display device) using a lenticular lens.
  • FIG. 4A is a diagram showing an example of arrangement of display pixels (no overlap) on a planar display when two stereoscopic images are displayed at the same depth position
  • FIG. 4B is a diagram showing a depth position. It is a figure which shows the arrangement example (with overlap) of the display pixel on the plane display when displaying two different stereoscopic images.
  • FIG. 5 (A) and 5 (B) are diagrams showing an example of countermeasures when overlapping display pixels occur on a flat display when displaying two stereoscopic images having different depth positions.
  • FIG. 6A is a diagram showing an example in which display pixels overlap when displaying two stereoscopic images having different depth positions and moving one stereoscopic image in the horizontal direction
  • (C) is a diagram showing an example of measures for avoiding duplication of display pixels.
  • FIG. 7A is a diagram showing an example in which display pixels overlap when displaying two stereoscopic images having different depth positions and moving one stereoscopic image in the horizontal direction
  • FIG. 7B. 1 is a diagram showing a preliminary example of countermeasures when duplication of display pixels is predicted
  • FIG. 7C and 7D are diagrams showing an example of countermeasures for avoiding duplication of display pixels.
  • FIG. 8 is a diagram showing an example of the configuration of a HUD device using a light field type (light ray reproduction type) three-dimensional display unit (three-dimensional display device) and an example of a virtual image display.
  • 9 (A) is a diagram showing an example of display priority (display priority)
  • FIGS. 9 (B) and 9 (C) show the HUD device by implementing measures to avoid duplication of display pixels.
  • FIG. 9D is a diagram showing an example of suppressing duplication between virtual images to be displayed
  • FIG. 9D is a diagram showing a display example when the control for suppressing duplication between virtual images is canceled.
  • FIG. 10 (A) and 10 (B) are diagrams showing an example of suppressing duplication between virtual images displayed by the HUD device by implementing measures to avoid duplication of display pixels.
  • 11 (A) to 11 (C) are diagrams showing an example of suppressing duplication between virtual images displayed by the HUD device by implementing measures to avoid duplication of display pixels.
  • FIG. 12A is a diagram showing a system configuration example of the HUD device
  • FIG. 12B is a diagram showing a specific configuration example of a main part of the HUD device.
  • FIG. 13 is a diagram showing a configuration example of a functional block of the control unit (HMI control unit).
  • FIG. 14 is a diagram showing an example of setting a display priority for each display content (presentation information) according to a driving scene in a table format. It is a flowchart which shows the operation procedure example of the control which avoids the duplication of display pixels in the HUD apparatus.
  • FIG. 1 is a diagram for explaining the principle of stereoscopic display of the light field method (light ray reproduction method).
  • two stereoscopic images IM10 and IM20 are displayed at different depth positions (depth distances) by a light field type stereoscopic display unit (also referred to as a stereoscopic display device, hereinafter simply referred to as a stereoscopic display unit) 230.
  • a light field type stereoscopic display unit also referred to as a stereoscopic display device, hereinafter simply referred to as a stereoscopic display unit
  • the stereoscopic display unit (sometimes referred to as a light field display) 230 uses a flat display 210 using a liquid crystal panel or the like in combination with a wrenchular lens 220 as an optical member 220, and uses "lighting pixels (sometimes referred to as a light field display) 230" in the flat display 210.
  • the position of the lighting pixel) is controlled to reproduce the light beam specified at an arbitrary position and direction.
  • the depth position (or depth distance L10, L20) of the stereoscopic images IM10 and IM20 as seen from the stereoscopic display unit 230 side is appropriately determined by changing the "lighting pattern of lighting pixels (lighting pixels)" in the flat display. , Can be adjusted.
  • the depth distances L10 and L20 are the distances from the lens center of the lenticular lens constituting the stereoscopic display unit 230 to the stereoscopic images IM10 and IM20.
  • the center of the lens is used as a reference, and the depth distance may be defined based on another location.
  • the left eye AL and the right eye AR are located at the positions where the light rays emitted by the stereoscopic images IM10 and IM20 (reproduced light of the stereoscopic images IM10 and IM20) are formed, and the left eye AL and the right eye AR are located from the respective eyes AL and AR.
  • the distances to the stereoscopic images IM10 and IM20 are defined as image display distances L30 and L40.
  • the direction along the line segment connecting the left and right eyes AL and AR of the observer observing the stereoscopic images IM10 and IM20 in the real space (or the viewer who visually recognizes the stereoscopic images IM10 and IM20) is defined as the horizontal direction.
  • a plurality of pixels (pixels) G are arranged in the horizontal direction.
  • non-lit pixels are represented by white squares
  • lit pixels are represented by black-painted squares.
  • the lighting (emission) pattern PT1 of the pixels (display pixels) for displaying the stereoscopic image IM10 is a pattern different from the lighting (emission) pattern PT2 of the display pixels of the stereoscopic image IM20. Due to the difference in this pattern, the depth distances L10 and L20 of the stereoscopic images IM10 and IM20 can be set to different values.
  • the lighting pattern PT1 is on the upper side of the lighting pattern PT2 on the paper surface, and the positions of the lit pixels (lighting pixels) are different in the horizontal direction.
  • the positions of the two stereoscopic images IM10 and IM20 in the three-dimensional space in the horizontal direction can be different.
  • the lighting patterns PT1 and PT2 do not overlap, and the lighting pixels do not overlap.
  • the lighting pixels overlap.
  • the display pixels of the stereoscopic image IM10 and the display pixels of the stereoscopic image IM20 are batting, and the light field data cannot be generated by rendering (this point will be described later).
  • FIG. 2A is a diagram showing a basic configuration example of a stereoscopic display unit (stereoscopic display device) of a light field method (light ray reproduction method) and an example of displaying (generating) a stereoscopic image
  • FIG. 2B is a stereoscopic display. It is a figure which shows the example in which the virtual image is displayed by the light rays for the left eye and the right eye emitted from one light spot which constitutes a stereoscopic image in the HUD apparatus which used the part (three-dimensional display apparatus).
  • the same reference numerals are given to the parts common to those in FIG. 1 (this point is the same in the following figures).
  • the flat display 210 has an area (display area or display surface) 215 forming a quadrangle in a plan view.
  • a large number of pixels are two-dimensionally arranged in a grid pattern on the display surface 215.
  • the horizontal direction of the rectangular display surface 215 corresponds to the horizontal direction along the line segment connecting the left and right eyes of the observer (or the viewer who visually recognizes the stereoscopic image) observing the stereoscopic image in the real space.
  • the vertical direction of the display surface 215 is a direction (referred to as a height direction) corresponding to the height of the observer (viewer).
  • the direction along the line segment (normal line) orthogonal to the display surface 215 and away from the display surface 215 is defined as the depth direction.
  • a pixel IML used to generate the display light EL (1) for the left eye and a display light ER (1) for the right eye are generated on the display surface 215.
  • Pixel (pixel) IMR to be is shown.
  • a parallax barrier (parallax barrier) 225 may be used in addition to the lenticular lens 220 shown above. However, these are examples and are not limited thereto.
  • the lenticular lens 220 has a configuration in which a cylindrical lens (cylindrical lens) is arranged in the horizontal direction, and has a light ray separation function for separating light rays for each of the left and right eyes.
  • a cylindrical lens cylindrical lens
  • parallax barrier (parallax barrier) 225 for example, narrow strip-shaped (rectangular) shields 225a to 225n are arranged at a predetermined pitch in the lateral direction while providing a gap (slit) SL. Even for the same image, by blocking a part of the display light of the image with a shield, different image display light (directional display light) for each of the left and right eyes is generated. be. It is common with lenticular lenses in that it separates light rays for each of the left and right eyes.
  • the light separated by the optical member RS having a light ray separation function (in other words, the reproduced light E (L1) and E (R1) for each eye that reproduces the image) is the binocular AL located at the image formation point of the light.
  • the person can see the apparent stereoscopic image IM at the place where the congestion (intersection of light) occurs.
  • the stereoscopic image IM is displayed (or generated) by the stereoscopic display unit 230.
  • the convergence angle is ⁇ c.
  • FIG. 2B the eyebox EB is set in front of the viewer (vehicle driver, etc.), and the eyepoint EP (C) is located in the center of the eyebox EB.
  • the virtual image V (C) is located in the center of the overlapping region. ..
  • the convergence angle of the virtual image V (C) is ⁇ d, and the virtual image V (C) is recognized as a three-dimensional image by the viewer (user).
  • This three-dimensional virtual image V (C) is displayed (formed) as follows. That is, the optical system of the HUD apparatus includes the reproduction lights E (L1) and E (R1) for the left and right eyes of the virtual stereoscopic image IM generated by the 3D display shown in FIG. 2 (A). It is reflected by a curved mirror (concave mirror, etc.) 171 (the number of reflections is at least once), thereby projecting (projecting) the display light E (L1) and E (R1) onto the windshield 2, and the reflected light. Will reach both eyes of the viewer and form an image in front of the windshield (projected member) 2, whereby the virtual image V (C) will be displayed (formed).
  • the optical system of the HUD apparatus includes the reproduction lights E (L1) and E (R1) for the left and right eyes of the virtual stereoscopic image IM generated by the 3D display shown in FIG. 2 (A). It is reflected by a curved mirror (concave mirror, etc.) 171 (the number of reflections is at
  • FIG. 3A is a diagram for explaining the display of a stereoscopic image in a stereoscopic display unit (stereoscopic display device) using a lenticular lens
  • FIG. 3B is a stereoscopic display unit (stereoscopic display device) using a lenticular lens. It is a perspective view of.
  • a plurality of cylindrical lenses (cylindrical lenses) F1 to Fn as optical elements are arranged in a lateral direction (direction W in FIG. 4B). It is configured by arranging (arranging) at a predetermined pitch to form a lens array structure that is periodic in the lateral direction.
  • Cylindrical lenses (F1 to Fn) as optical elements are flat surfaces on which the surface facing the flat display 210 (rear surface) allows light to pass through, and the opposite surface (front surface) is an aspherical lens (however, aspherical surface). It is a vertically long cylindrical lens (cylindrical lens). In the example of FIG. 4A, the curvature of the spherical surface of the lens is uniform.
  • each of the left eye pixels (L pixels) L1 to Ln is arranged (formed) at a position corresponding to the left half of each of the cylindrical lenses F1 to Fn as optical elements.
  • Each of the right-eye pixels (R pixels) R1 to Rn is arranged (formed) at a position corresponding to the right half of each of the cylindrical lenses F1 to Fn as optical elements.
  • 1 pixel (1 pixel) is further composed of R (red), G (green), and B (blue) sub-pixels, but the sub-pixels are not shown in FIG. 3 (A).
  • optical elements (cylindrical lenses) F1a to F8a that refract light are arranged at a predetermined pitch along the lateral direction (horizontal direction).
  • a light ray separating portion having a predetermined resolution in the horizontal direction (horizontal direction) is configured.
  • the horizontal direction (horizontal direction) is H
  • the vertical direction (vertical direction) is T
  • the depth direction is J.
  • FIG. 4A is a diagram showing an example of arrangement of display pixels (no overlap) on a planar display when two stereoscopic images are displayed at the same depth position
  • FIG. 4B is a diagram showing a depth position. It is a figure which shows the arrangement example (with overlap) of the display pixel on the plane display when displaying two different stereoscopic images.
  • the first and second stereoscopic images IM1 and IM2 are both located at a position S2 separated from the viewpoint position (positions of the left and right eyes AL and AR) S1 by a distance D1 (image display distance D1). Is displayed in.
  • FIG. 4A four pixels (pixels) IM1L, IMIR, IM2L, and IM2R are shown in the flat display 210.
  • the IM1L is a pixel (pixel) used to reproduce the light ray for the left eye of the stereoscopic image IM1
  • the IM1R is a pixel (pixel) used to reproduce the light ray for the right eye of the stereoscopic image IM1.
  • the IM2L is a pixel (pixel) used to reproduce the light ray for the left eye of the stereoscopic image IM2
  • the IM2R is a pixel (pixel) used to reproduce the light ray for the right eye of the stereoscopic image IM2.
  • the stereoscopic image IM2 is located at the position S1'distanced from the viewpoint position S1 by the image display distance D1'. In this respect, it differs from FIG. 4 (A).
  • it is used to reproduce the pixel IM1L used to reproduce the light ray for the left eye of the first stereoscopic image IM1 and the light ray for the left eye of the second stereoscopic image IM2. It overlaps with the pixel IM2L. In this case, it is uncertain which one should be displayed, and therefore proper light field rendering cannot be performed.
  • this problem is addressed by implementing priority display control based on display priority (priority).
  • FIG. 5 (A) and 5 (B) are diagrams showing an example of countermeasures when overlapping display pixels occur on a flat display when displaying two stereoscopic images having different depth positions.
  • the display priority of the first stereoscopic image IM1 is higher than that of the second stereoscopic image IM2.
  • the first is according to the priority of the image to be displayed (in other words, the priority of the information presented by the image).
  • the pixel IM1L used to reproduce the light beam for the left eye of the stereoscopic image IM1 is given priority, and the IM2L is ignored. This means that the pixel IM2L used to reproduce the light beam for the left eye of the second stereoscopic image IM2 is turned off. This avoids duplication of display pixels and enables rendering to generate light field data.
  • IM2L is not lit, and the only pixel that is lit is IM2R. Therefore, it cannot be displayed as a stereoscopic image, and a non-stereoscopic image is displayed.
  • FIG. 5B two display examples of B1 and B2 are shown.
  • the second stereoscopic image IM2 itself is hidden. This eliminates the duplication of display pixels.
  • simply continuing the display of the display example B1 makes it impossible to present the information by the second stereoscopic image IM2 forever.
  • the notification information with non-display is also presented to the driver of the vehicle, and the IM1 is visually recognized by the viewer after a predetermined time has elapsed.
  • the process shifts to the display example of B2, and the second stereoscopic image IM2 is displayed here. This makes it possible to present information by the second stereoscopic image IM2.
  • the process returns to the display example of B1. As a result, the presentation of information by the high-priority stereoscopic image IM1 is resumed.
  • IM1 may be displayed (IM2 having a low priority may be hidden).
  • the "necessity of notification" is, for example, the degree of danger derived from the degree of seriousness that can occur, and the degree of urgency derived from the length of reaction time required for the viewer (vehicle driver) to take a reaction action. , The effectiveness derived from the situation of the vehicle or the viewer (or the other occupant of the vehicle 1), or a combination thereof, etc. (The index of the need for notification is not limited to these). That is, the control unit 300 described later may have a function of calculating the degree of need for notification based on the information acquired via the I / O interface 741 described later.
  • FIG. 6A is a diagram showing an example in which display pixels overlap when displaying two stereoscopic images having different depth positions and moving one stereoscopic image in the horizontal direction
  • FIG. 6B is a diagram showing an example of measures for avoiding duplication of display pixels.
  • the second stereoscopic image IM2 is, for example, a warning display (for example, a frame display surrounding the person) that calls attention to a person who has entered the road, and the second stereoscopic image is displayed with the movement of the person.
  • a warning display for example, a frame display surrounding the person
  • the second stereoscopic image is displayed with the movement of the person.
  • This is an example in which the stereoscopic image IM2 of the above moves in the horizontal direction.
  • the movement direction and movement speed of a person are detected, and the movement of the second stereoscopic image IM2 in the horizontal direction can be predicted by predictive analysis based on the detection information, and the movement of the display pixel corresponding to this can be predicted. Can also be predicted.
  • duplication avoidance processing is performed in advance.
  • the past time point is t0
  • the current time is t1
  • the time point at which movement is predicted is t2.
  • the positions of the second stereoscopic image IM2 in the horizontal direction at each time point are indicated by the notations IM2 (t0), IM2 (t1), and IM2 (t2).
  • the display pixels do not overlap at time t1, it is predicted that the display pixels IM1L and IM2L will overlap at time t2 (see FIG. 4B).
  • processing for avoiding duplication is started in advance at time t1, which is a time point before duplication of display pixels IM1L and IM2L occurs.
  • the pixel IM2L is not turned on. This avoids pixel duplication.
  • the displayed image (display image) IM2 is a non-stereoscopic image.
  • both the display pixels IM2L and IM2R are turned off at time t1.
  • the image IM2 is not displayed.
  • FIG. 7A is a diagram showing an example in which display pixels overlap when displaying two stereoscopic images having different depth positions and moving one stereoscopic image in the horizontal direction
  • FIG. 7B. 1 is a diagram showing a preliminary example of countermeasures when duplication of display pixels is predicted
  • FIGS. 7C and 7D are diagrams showing an example of countermeasures for avoiding duplication of display pixels.
  • FIG. 7 (A) The situation in FIG. 7 (A) is almost the same as that in FIG. 6 (A). However, in FIG. 7A, the distance between the position of the second image IM2 (IM2 (t1)) at time t1 and the first image IM1 is D2, and this D2 is a predetermined distance (predetermined threshold distance). ) Dth or less.
  • FIG. 7B the lighting brightness of the display pixels IM2L and IM2R is lowered, and as a result, the visibility of the second image IM2 (IM2 at the time t1) is lowered.
  • FIG. 7C the display pixel IM2L is not lit.
  • the second image IM2 is a non-stereoscopic image.
  • FIG. 7D the display pixel IM2R is also turned off. The second image IM2 is hidden.
  • the second Display control (fade-out control) can be performed so that the image IM2 gradually disappears from the time t1 to the time t2.
  • the situation where the second image IM2 suddenly disappears at time t2 is suppressed, and natural vision can be ensured.
  • FIG. 8 is a diagram showing an example of the configuration of a HUD device using a light field type (light ray reproduction type) three-dimensional display unit (three-dimensional display device) and an example of a virtual image display.
  • a light field type light ray reproduction type
  • three-dimensional display unit three-dimensional display device
  • the HUD device 100 of FIG. 8 has a flat surface display 210, a lenticular lens 220 as an optical member which is arranged in contact with or close to the flat surface display (display unit in a broad sense) 210 and has a light ray separation function, and a flat surface. It has a control unit (HMI control unit) 300 for controlling image display (lighting of pixels) on the display 210.
  • a stereoscopic display unit (stereoscopic display device) 230 is configured by the flat display 210 and the wrench character lens 220.
  • the HUD device 100 has an optical system 121 including a folded mirror 174 as a reflecting member and a curved mirror (concave mirror, magnifying glass) 171.
  • the curved mirror (concave mirror, magnifying mirror) 171 is the display light (in other words, the reproduction light) of the first image (first stereoscopic image) M (V1) virtually displayed by the stereoscopic display unit 230, and the second.
  • Image (second stereoscopic image) M (V2) display light (in other words, reproduction light) is provided in the vehicle 1 through the transparent window 176 as a windshield 2 as a projected member (reflected translucent member). Project to. A part of the projected light is reflected by the windshield 2 and projected onto the driver's eyes A, and as a result, the first and second positions are located in front of the vehicle 1 at the virtual image display distances L1 and L2.
  • Virtual images V1 and V2 are displayed (visually recognized).
  • the first virtual image V1 is, for example, the virtual image Q1 of the navigation arrow in FIGS. 9B to 9D.
  • the second virtual image V2 is, for example, the virtual image Q2 of the attention-calling frame for calling attention to the person 44 in FIGS. 9B to 9D.
  • the curved surface mirror 171 can be rotated by the rotating portion (actuator) 175 to adjust the inclination as appropriate. Further, the inclination of the stereoscopic display unit 230 can be adjusted by the adjustment unit (actuator) 173.
  • FIG. 9 (A) is a diagram showing an example of display priority (display priority), and FIGS. 9 (B) and 9 (C) show the HUD device by implementing measures to avoid duplication of display pixels.
  • FIG. 9D is a diagram showing an example of suppressing duplication between virtual images to be displayed, and FIG. 9D is a diagram showing a display example when the control for suppressing duplication between virtual images is canceled.
  • FIG. 9A shows an example of a priority list that determines the display priority (priority).
  • the display priority is set to warning display, navigation display, POI display, and other displays (in FIG. 9A, vehicle speed display and TSR (traffic sign recognition) information which are non-superimposed contents) in descending order.
  • the control unit (HMI control unit) 300 of the HUD device 100 implements duplication suppression control regarding the display of content that is or may be duplicated.
  • the display priority (priority) is determined based on the notification necessity calculated based on the information acquired from the I / O interface instead of (or in addition to) the preset priority list described above. May (may be changed).
  • the virtual image Q0 of the vehicle speed display as non-superimposed content in which the virtual image display distance is fixed, and the navigation arrow superimposed on the road surface 40 of the road.
  • the virtual image Q1 of the above and the virtual image Q2 of the caution display (here, the caution frame) that calls attention to the person 44 who has entered the road are displayed.
  • the virtual image Q1 of the arrow for navigation extends along the center line 42 (in other words, extends in the depth direction) on the front side portion Q1a and extends in the left-right direction (width direction of the vehicle). It can be distinguished from the side portion Q1b.
  • the arrow element AR1 of the portion Q1a extending in the depth direction has a distance W1 from the attention frame Q2 smaller than a predetermined distance (here, Wth) as a threshold value.
  • Wth a predetermined distance
  • the visibility is lowered (for example, the display luminance is lowered) not only for the portion corresponding to the display pixel but also for the entire arrow element AR1 including the portion. As a result, double appearance and the like are less likely to occur, and the display is easy to see.
  • FIG. 9C a person 44 is further entering the road.
  • the virtual image Q2 of the alert frame also moves to the right along the width direction of the vehicle 1 (which corresponds to the horizontal direction described above).
  • the entire arrow element AR1 including the portion displayed by the pixels is hidden. As a result, double appearance and the like are eliminated, and the display becomes easy to see.
  • the alerting frame Q2 is visually recognized by the viewer (driver), and the possibility of duplication has disappeared. Therefore, the display restriction by the duplication suppression control is released. As a result, the arrow elements AR1 and AR2 have returned to the normal display state.
  • the pixels used to display the warning display at a predetermined position and the navigation display are displayed at a predetermined position. Even if the pixels used for display in the above overlap and / or are likely to overlap, the light field data was not rendered in consideration of these.
  • FIG. 10 (A) and 10 (B) are diagrams showing an example of suppressing duplication between virtual images displayed by the HUD device by implementing measures to avoid duplication of display pixels.
  • "Warning display” and POI display J5 indicating the destination 46 are displayed.
  • the navigation arrow display J2 and the warning display J4 overlap, but for the overlapping part, the warning display J4 with high priority is given priority and is displayed on the front side. Further, in the example of FIG. 10A, the visibility of the entire display J2 of the navigation arrow is lowered in order to make the display easier to see.
  • FIG. 11 (A) to 11 (C) are diagrams showing an example of suppressing duplication between virtual images displayed by the HUD device by implementing measures to avoid duplication of display pixels.
  • the first POI display (display indicating the existence of a convenience store) J10 arranged on the front side (the side closer to the vehicle 1) and the TSR arranged behind the J10. (Traffic sign recognition) Display J20 of "speed limit” and “school road” which is information, and second POI display J30 (display showing the position of destination 47) arranged on the depth side (the side far from vehicle 1). ) And is shown.
  • J10 and J20 partially overlap, but with respect to the overlapping portion, the display of J10 having a higher display priority is preferentially displayed.
  • J20 having a low display priority is hidden.
  • a display of "1 hidden” has been added.
  • FIG. 11C after the visual recognition of J10 is confirmed, J20, which has been hidden until then, is displayed. After that, it is also possible to return to the state shown in FIG. 11 (A).
  • FIG. 12A is a diagram showing a system configuration example of the HUD device
  • FIG. 12B is a diagram showing a specific configuration example of a main part of the HUD device.
  • the system shown in FIG. 12A includes a display control unit (display control device) 300 included in the control unit 290, an object detection unit 801 and a vehicle information detection unit 803, and the solid shown in FIG. 8 above. It has a display unit 230, a first actuator 177, and a second actuator 179.
  • the control unit (HMI control unit) 300 has an I / O interface 741, a processor 742, and a memory 743.
  • the control unit (HMI control unit) 300, the object detection unit 801 and the vehicle information detection unit 803 are connected to a communication line (BUS or the like).
  • first actuator 177 and the second actuator 179 can be used as the rotating unit (rotating mechanism) 175 and the adjusting unit 173 shown in FIG. These can also be said to be an optical system or an adjustment system of a display unit.
  • the object detection unit 801 can be configured by, for example, an out-of-vehicle sensor, an out-of-vehicle camera, or the like provided in the vehicle 1.
  • the vehicle information detection unit 803 may be, for example, a speed sensor, a vehicle ECU, an external communication device, a sensor for detecting the position of eyes, a yaw rate sensor for detecting the pitch angle (tilt angle) of the vehicle 1, or a height sensor. Can be configured by.
  • the display control unit (display control device) 300 appropriately performs predetermined image processing based on the detection information of the object detection unit 801 and the information from the vehicle information detection unit 803 to display an appropriate perspective. , Reliable notification of information to the viewer (driver, HUD user) is compatible.
  • one or more processors 742 acquire, for example, the position information of the road surface 40, and based on the acquired information, drive at least one of the first and second actuators 177 and 179 to form a virtual image. It is also possible to adjust the display position and the like.
  • the control unit (HMI control unit) 300 includes a light field rendering unit 302 and a display drive unit 336.
  • the light field rendering unit 302 includes an input / output interface (I / F) 304, an image generation unit (light field data generation unit) 310, a multi-viewpoint image storage unit (image database) 312, and an image buffer 332 for the left eye. It has an image buffer 334 for the right eye.
  • the multi-viewpoint image storage unit (image database) 302 stores, for example, a sample of a multi-viewpoint image (original image) for a display target.
  • the image generation unit (light field data generation unit) 310 generates light field data.
  • the generated data is temporarily stored in the image buffers 332 and 334 for each of the left and right eyes, and then is displayed as a parallax image GL for the left eye and a parallax image GR for the right eye via the display unit drive unit 336. (Flat display) Supplied to 210.
  • the vehicle 1 visually recognizes a pupil imaging camera 900 that captures the user's eyes, a line-of-sight detection unit (viewpoint position detection unit) 902 that detects the user's viewpoint position, and a specific display that the viewer is displaying. It has a visual detection unit (visual confirmation unit) 903 that detects (confirms) that the image has been taken, a peripheral image pickup camera 17, and a driving scene determination unit 19 including an image processing unit 21.
  • a pupil imaging camera 900 that captures the user's eyes
  • a line-of-sight detection unit (viewpoint position detection unit) 902 that detects the user's viewpoint position
  • a specific display that the viewer is displaying.
  • It has a visual detection unit (visual confirmation unit) 903 that detects (confirms) that the image has been taken, a peripheral image pickup camera 17, and a driving scene determination unit 19 including an image processing unit 21.
  • FIG. 13 is a diagram showing a configuration example of a functional block of the control unit (HMI control unit).
  • the control unit (HMI control unit) 300 is, for example, as a functional block, what kind of overlap mode is the display mode determination unit 302 and the overlap detection unit 303 that detects at least one of the overlap and the possibility of duplication of display pixels. It has an overlap mode detection unit 304, an overlap suppression control unit 305, and an image generation control unit 306.
  • the duplication suppression control unit 305 implements duplication suppression control.
  • the image generation control unit 306 controls, for example, the generation operation by rendering the light field data.
  • FIG. 14 is a diagram showing an example of setting a display priority for each display content (presentation information) according to a driving scene in a table format.
  • a sunny urban area (city or traffic volume is equal to or higher than a predetermined value), a sunny highway (urban), or a person.
  • the 4th scene of the road (countryside), the 5th scene when the traffic is stopped, the 6th scene when there are restrictions on the running of the vehicle (including U-turn prohibition or under construction), and the 7th scene during automatic driving are shown. Has been done. It is not always necessary to include all seven driving scenes, but it is preferable to include at least four of
  • warning display information presented by display
  • navigation display POI display
  • traffic sign recognition Traffic Sign Recognition
  • the display priority of each of the four display contents is predetermined in a list format (table format) corresponding to the seven driving scenes. As a result, the priority of the display content (display information) can be quickly updated according to each driving scene, and appropriate display control can be performed.
  • the order of priority is warning display, navigation display, POI display, TSR information, etc., in order from the highest.
  • the priority of TSR information and the like is exceptionally set to "1".
  • the warning display further indicates a first warning for a high relative speed object (including an oncoming vehicle and a pedestrian) and a low relative speed object (including a vehicle traveling in the same direction). It is divided into a second warning about the above and a third warning about the notification about the situation around the vehicle (including the notification of natural disasters and traffic accidents).
  • the warning display is further subdivided into three types (first, second, and third warnings), and the priority for each driving scene is set for each.
  • the priority of the first warning is the highest, and with respect to the second and third warnings, in the first to sixth scenes, the priority of the second warning is higher than that of the third warning, but the seventh scene.
  • the priority of the second warning and the third warning are set to the same level (in FIG. 14, both have priority "3"). It is set.
  • FIG. 15 is a flowchart showing an example of a control operation procedure for avoiding duplication of display pixels in the HUD device.
  • the light field rendering unit 302 of FIG. 12B first has a first display position including at least a position in the depth direction of the first image showing the first information, and a second display position showing the second information.
  • a second display position including at least a position in the depth direction of the image is set (step S1).
  • step S2 whether or not the first pixel used when displaying the first image at the first display position and the second pixel used when displaying the second image at the second display position overlap. , It is determined whether or not there is a possibility of duplication (step S2).
  • step S3 when it is determined that there is a high possibility that the first pixel and the second pixel overlap, the image having the higher priority of the first information and the second information is displayed with priority.
  • Duplicate suppression control including not displaying at least overlapping pixels of the lower priority image is performed (step S3).
  • a HUD device having a light field type stereoscopic display unit proper light field rendering is performed by overlapping pixels for displaying one image with pixels for displaying another image. It is possible to avoid (suppress) the inability to do so.
  • the term vehicle can be broadly interpreted as a vehicle.
  • terms related to navigation shall be interpreted in a broad sense in consideration of, for example, the viewpoint of navigation information in a broad sense useful for vehicle operation.
  • the HUD device shall include a device used as a simulator (for example, an aircraft simulator, a game machine, etc.).
  • the types of the display unit and the optical member are not limited to the above-described embodiment, and various types can be adopted.
  • HUD display area 17 ... Surrounding image camera, 19 ... Driving scene determination unit, 21. -Image processing unit, 22 ... Visualizer (observer, driver, user), 300 ... Control unit (HMI control unit), 36 ... Attribute determination unit to be displayed, 40 ... Road Road surface, 100 ... HUD device, 171 ... curved mirror (concave mirror, etc.), 210 ... flat display as a display unit, 220 ... optical member (lenticular lens, etc.), 230 ... stereoscopic display Unit (3D display unit), 290 ... control device, 300 ... control unit (HMI (human interface) control unit), 310 ...
  • HMI human interface
  • image generation unit (light field data generation unit), 900 ... pupil Imaging camera, 902 ... line-of-sight detection unit, 903 ... visual detection unit (visual confirmation unit), IM1, IM2 ... first and second images, first and second display images, or first , Second stereoscopic image

Landscapes

  • Engineering & Computer Science (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Optics & Photonics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Instrument Panels (AREA)

Abstract

L'invention concerne un dispositif d'affichage tête haute (HUD) ayant une unité d'affichage stéréoscopique de type à champ lumineux avertissant une perte de capacité de rendu de champ de lumière correcte due à un chevauchement entre des pixels pour afficher une image et des pixels pour afficher une autre image. Le dispositif HUD comprend une unité d'affichage stéréoscopique de type à champ lumineux 230 et une unité de commande 300, l'unité de commande 300 effectuant des processus de commande de suppression de chevauchement qui comprennent : la détermination, entre des premiers pixels dans un afficheur utilisé lorsqu'une première image est affichée dans une première position d'affichage et des seconds pixels utilisés lorsqu'une seconde image est affichée dans une seconde position d'affichage, d'au moins un élément parmi : si un chevauchement s'est produit ou s'il existe une possibilité qu'un chevauchement se produise; si un chevauchement s'est produit ou s'il existe une possibilité qu'un chevauchement se produise, l'affichage par ordre de priorité de l'image avec le niveau de priorité d'affichage supérieur; et le masquage de l'affichage ou la réduction de la luminosité d'au moins la partie de chevauchement des pixels de l'image avec le niveau de priorité inférieur.
PCT/JP2021/019599 2020-05-26 2021-05-24 Dispositif d'affichage tête haute Ceased WO2021241496A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022527028A JP7639814B2 (ja) 2020-05-26 2021-05-24 ヘッドアップディスプレイ装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-090996 2020-05-26
JP2020090996 2020-05-26

Publications (1)

Publication Number Publication Date
WO2021241496A1 true WO2021241496A1 (fr) 2021-12-02

Family

ID=78744776

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/019599 Ceased WO2021241496A1 (fr) 2020-05-26 2021-05-24 Dispositif d'affichage tête haute

Country Status (2)

Country Link
JP (1) JP7639814B2 (fr)
WO (1) WO2021241496A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025088992A1 (fr) * 2023-10-26 2025-05-01 株式会社デンソー Dispositif d'affichage d'image virtuelle et procédé d'affichage d'image virtuelle
WO2025164369A1 (fr) * 2024-02-01 2025-08-07 株式会社デンソー Dispositif de reconnaissance d'image et procédé de reconnaissance d'image

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005106651A (ja) * 2003-09-30 2005-04-21 Mazda Motor Corp 車両用情報提供装置
JP2006350934A (ja) * 2005-06-20 2006-12-28 Denso Corp 情報表示装置
JP2008089787A (ja) * 2006-09-29 2008-04-17 Toshiba Corp 立体画像表示装置および立体画像の作製方法
JP2009192317A (ja) * 2008-02-13 2009-08-27 Toyota Motor Corp 情報提供装置
WO2010137091A1 (fr) * 2009-05-29 2010-12-02 三菱電機株式会社 Dispositif de navigation
JP2019056884A (ja) * 2017-09-22 2019-04-11 アイシン・エィ・ダブリュ株式会社 重畳画像表示装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005106651A (ja) * 2003-09-30 2005-04-21 Mazda Motor Corp 車両用情報提供装置
JP2006350934A (ja) * 2005-06-20 2006-12-28 Denso Corp 情報表示装置
JP2008089787A (ja) * 2006-09-29 2008-04-17 Toshiba Corp 立体画像表示装置および立体画像の作製方法
JP2009192317A (ja) * 2008-02-13 2009-08-27 Toyota Motor Corp 情報提供装置
WO2010137091A1 (fr) * 2009-05-29 2010-12-02 三菱電機株式会社 Dispositif de navigation
JP2019056884A (ja) * 2017-09-22 2019-04-11 アイシン・エィ・ダブリュ株式会社 重畳画像表示装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025088992A1 (fr) * 2023-10-26 2025-05-01 株式会社デンソー Dispositif d'affichage d'image virtuelle et procédé d'affichage d'image virtuelle
WO2025164369A1 (fr) * 2024-02-01 2025-08-07 株式会社デンソー Dispositif de reconnaissance d'image et procédé de reconnaissance d'image

Also Published As

Publication number Publication date
JP7639814B2 (ja) 2025-03-05
JPWO2021241496A1 (fr) 2021-12-02

Similar Documents

Publication Publication Date Title
JP6699675B2 (ja) 情報提供装置
JP7358909B2 (ja) 立体表示装置及びヘッドアップディスプレイ装置
JP6443716B2 (ja) 画像表示装置、画像表示方法及び画像表示制御プログラム
JPWO2017138297A1 (ja) 画像表示装置及び画像表示方法
CN104417369B (zh) 车辆用显示装置
JP2016109645A (ja) 情報提供装置、情報提供方法及び情報提供用制御プログラム
JP7300112B2 (ja) 制御装置、画像表示方法及びプログラム
US11106045B2 (en) Display system, movable object, and design method
EP3961353B1 (fr) Procédé et appareil de commande d'affichage tête haute basé sur l'état de suivi de l' oeil
JP2016203850A (ja) 情報提供装置、情報提供方法及び情報提供用制御プログラム
JP2016107947A (ja) 情報提供装置、情報提供方法及び情報提供用制御プログラム
JP2016210212A (ja) 情報提供装置、情報提供方法及び情報提供用制御プログラム
JP7354846B2 (ja) ヘッドアップディスプレイ装置
JP2019040634A (ja) 画像表示装置、画像表示方法及び画像表示制御プログラム
CN210666207U (zh) 一种抬头显示设备、成像系统和车辆
JP7639814B2 (ja) ヘッドアップディスプレイ装置
JP2022083609A (ja) 表示制御装置、ヘッドアップディスプレイ装置、及び画像の表示制御方法
JP2018058521A (ja) 仮想表示ミラー装置
KR20180046567A (ko) 차량용 헤드 업 디스플레이 제어 장치 및 방법
JP6814416B2 (ja) 情報提供装置、情報提供方法及び情報提供用制御プログラム
JP7767833B2 (ja) 表示制御装置、表示装置、及び表示制御方法
JP2021056358A (ja) ヘッドアップディスプレイ装置
JP7574607B2 (ja) 表示制御装置、ヘッドアップディスプレイ装置、及び画像の表示制御方法
JP6726412B2 (ja) 画像表示装置、移動体、画像表示方法及びプログラム
WO2018216552A1 (fr) Dispositif d'affichage tête haute

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21813976

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022527028

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21813976

Country of ref document: EP

Kind code of ref document: A1