WO2016103418A1 - Information displaying apparatus for vehicle - Google Patents
Information displaying apparatus for vehicle Download PDFInfo
- Publication number
- WO2016103418A1 WO2016103418A1 PCT/JP2014/084382 JP2014084382W WO2016103418A1 WO 2016103418 A1 WO2016103418 A1 WO 2016103418A1 JP 2014084382 W JP2014084382 W JP 2014084382W WO 2016103418 A1 WO2016103418 A1 WO 2016103418A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- projection
- distance
- image
- display device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/23—Head-up displays [HUD]
- B60K35/232—Head-up displays [HUD] controlling the projection distance of virtual images depending on the condition of the vehicle or the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K35/285—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver for improving awareness by directing driver's gaze direction or eye points
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Definitions
- the present invention relates to a vehicle information display device that is mounted on a vehicle and supports driving by an augmented reality function.
- various information for example, traveling
- vehicle information display device vehicle information display device mounted on the automobile.
- a technology an augmented reality function, Augmented Reality that projects an image including (speed) and superimposes it on a landscape is known.
- Patent Document 1 discloses a technique for adjusting the projection distance of the image and the size of the projection image in accordance with the vehicle speed for the purpose of displaying an image that is easy to see for the driver.
- An object of the present invention is to provide an information display device for a vehicle that changes and displays a projection distance of an image according to a traveling state of surrounding vehicles.
- the present invention is an information display device for a vehicle that is mounted on a vehicle and displays information by projecting an image on a space in front of the vehicle, and includes a front image detection unit that images a landscape in front of the vehicle, An input video analysis unit that performs recognition processing, an object type detection unit that determines the type of the object, an object distance detection unit that measures a distance to the object, and information to be displayed based on the type of the object An output video processing unit that outputs a video signal, a video display unit that generates a video to be projected based on the video signal, a projection optical system that projects the generated video by a projection lens, and a position of the projection lens A focusing drive unit that moves the output video processing unit, based on a type of the object and a distance to the object, controls the focusing drive unit to change a projection distance of a projected image. Configuration to.
- the projection distance of the projection image is set to the distance to the front vehicle, and the projection image is displayed near the front vehicle. Display in position.
- the amount of movement of the driver's viewpoint is reduced in order to see the displayed video, and safety during driving is improved.
- FIG. 1 is a block configuration diagram of a vehicle information display device according to Embodiment 1.
- FIG. The figure which shows the state which mounted the vehicle information display apparatus 1 in the vehicle. The figure explaining the determination method of the projection distance according to the driving
- the flowchart which shows the image
- FIG. 6 is a diagram illustrating a configuration of a projection optical system (time division method) in Embodiment 2.
- FIG. FIG. 6 is a diagram illustrating a configuration of a projection optical system (color separation method) in Embodiment 3.
- FIG. 6 is a diagram showing a configuration of a projection optical system (polarization separation method) in Example 4.
- FIG. 1 is a block configuration diagram of the vehicle information display device according to the first embodiment.
- the front video detection unit 2 is a camera that captures a landscape in front of the vehicle, and the input video analysis unit 3 performs object recognition processing from the captured video.
- the object type detection unit 4 determines the type (vehicle, person, bicycle, etc.), and the object distance detection unit 5 measures the distance to the object.
- the type of the object is identified by an image recognition technique by matching with a pattern of various objects, and the distance measurement is performed by a distance measuring technique by a camera.
- the right / left turn detection unit 6 detects from the turn signal or the like that the host vehicle is turning right or left, and the driving information acquisition unit 7 acquires GPS information and navigation information (for example, vehicle speed).
- the pupil detection unit 8 images the driver's or passenger's passenger's pupil 9 and detects the line-of-sight position (vertical and horizontal directions).
- the output video processing unit 10 determines the content of the information (video) to be displayed and the projection distance based on the detection result of the type / distance of the object, the detection result of the left / right turn, the driving information, and the information on the line of sight Output a signal.
- the video output here includes, for example, speed information and warning information (alert information), and is displayed in accordance with an object (vehicle, person, etc.) detection position in the display space. Further, the direction of the driver's line of sight is detected, and the display position is adjusted according to the direction.
- the scaling processing unit 11 enlarges / reduces the output video according to the size of the windshield of the vehicle that is the projection surface, and the video display unit 20 projects and displays the video.
- the video display unit 20 includes a light source and a video display element (liquid crystal element (LCD, LCOS), digital mirror element (DMD), etc.), and a video is projected onto a projection surface (front glass, half) by a projection optical system (lens, mirror). Project to a mirror.
- a projection optical system projection optical system
- the projection surface is described as being limited to the windshield, but this is not limited as long as it can reflect a certain amount of light, such as a half mirror called a combiner or a film.
- the focusing drive unit 12 moves the lens position of the projection optical system so that the projection distance of the image becomes a predetermined distance.
- the variable magnification drive unit 13 adjusts the size of the projected image by adjusting the lens position of the projection optical system.
- the present embodiment is characterized in that, based on the detection results of the object type detection unit 4 and the object distance detection unit 5, the output video processing unit 10 controls the focusing drive unit 12 to change the projection distance of the display video. is there.
- FIG. 2 is a diagram illustrating a state in which the vehicle information display device 1 is mounted on a vehicle.
- the vehicle information display device 1 is housed in a dashboard of a vehicle and projects an image including information necessary for driving toward the windshield 29.
- the projected image is reflected by the windshield 29 and is incident on the driver's pupil 9, and the driver visually recognizes the virtual image superimposed on the space in front of the windshield 29 with the scenery seen outside the vehicle. Therefore, the projection distance is a distance to the imaging position of the virtual image that is visually recognized through the windshield 29.
- the video light emitted from the video display unit 20 is reflected by the mirror 21 and projected onto the windshield 29 via the projection lens 22.
- the position of the projection lens 22 (lens interval) is adjusted by the focusing drive unit 12.
- FIG. 3 is a diagram for explaining a method for determining the projection distance according to the traveling state of the vehicle.
- the distance to the other vehicle 31 is measured.
- the other vehicle 31 is a vehicle traveling on the route in the right and left turn direction.
- the inter-vehicle distance S to the other vehicle 31 is compared with the threshold values S0 and S1, and the projection distance D is determined.
- the threshold value S0 is for straight traveling
- the threshold value S1 is for right / left turn traveling.
- the projection distance D is made equal to the inter-vehicle distance S and the main virtual image 41 such as vehicle speed information is projected. That is, when the inter-vehicle distance is small, the main virtual image 41 is displayed in accordance with the position of the other vehicle 31.
- the main virtual image 41 is projected with the projection distance D equal to the threshold distance S0. That is, when the inter-vehicle distance is large, it is displayed at a position before the other vehicle 31 (threshold value S0). The same applies when there is no other vehicle 31 traveling ahead, and the threshold distance S0 is displayed.
- the threshold distance S0 is a distance (a distance that can be watched) that is most easily seen by the driver during normal driving.
- the projection distance D is made equal to the inter-vehicle distance S and the main virtual image 41 such as vehicle speed information is projected.
- the main virtual image 41 is projected with the projection distance D being the distance to the position (intersection) at which the vehicle turns right and left. Since the driver often looks at a relatively short distance range when turning right or left, the threshold distance S1 is set to be smaller than the threshold value S0 when traveling straight ahead. For example, the distance is set to 1 ⁇ 2 of the threshold value S0 when traveling straight, or the distance to the front pedestrian crossing.
- an object 32 (hereinafter referred to as an alert target) 32 to be particularly noted in driving such as a pedestrian or a bicycle is detected ahead, a distance Sa to the alert target 32 is measured.
- the projection distance D is equal to the alert distance Sa, and the alert virtual image 42 is projected.
- the alert virtual image 42 is a frame display for emphasizing the alert target 32, but is not limited thereto.
- FIG. 4 is a diagram illustrating a display example of a projection position and a projected image during straight traveling.
- a display example of a projected image that can be seen from the windshield is shown on the left side and the road plan view on the right side.
- (A) is a case where the inter-vehicle distance S to the preceding vehicle 31 is less than the threshold value S0, and the projection image (main virtual image) 41 indicating the vehicle speed information is displayed, but the projection distance D is the distance S to the preceding vehicle 31.
- the position of the projected image 41 in the vertical and horizontal directions in the display space (hereinafter referred to as the display position in the screen) is in the vicinity of the vehicle (for example, on the road surface below the vehicle) so as not to overlap the forward vehicle 31 when viewed from the driver. It is staggering. This is to reduce the viewpoint movement between the forward vehicle 31 and the projected video 41 that are not observing the front vehicle and that is being watched.
- (B) is a case where the inter-vehicle distance S to the preceding vehicle 31 is greater than or equal to the threshold value S0, and the projection distance D of the projection image 41 is the threshold distance S0. Also in this case, the display position of the projected image 41 in the screen is shifted to the vicinity of the vehicle so as not to overlap the preceding vehicle 31. Even when the forward vehicle 31 does not exist, the projection distance D is set to the threshold distance S0, and the display position in the screen is set to a predetermined position (for example, the center position of the screen, the traveling lane, etc.).
- (C) is a case where an alert object 32 such as a pedestrian who is going to cross a road is detected, and a projection image (alert virtual image) 42 is displayed, but the projection distance D is a distance Sa to the alert object 32.
- the projection image 42 in this case is a frame line surrounding the alert target 32 (pedestrian), and the alert target 32 is watched by matching the display position in the screen with the alert target 32.
- FIG. 5 is a flowchart showing video display processing during straight traveling in FIG.
- the front image captured by the front image detection unit 2 is analyzed by the input image analysis unit 3, and it is determined whether or not the front vehicle (reference numeral 31 in FIG. 4) is detected by the object type detection unit 4. If detected, the process proceeds to S101, and if not detected, the process proceeds to S104.
- the inter-vehicle distance S to the preceding vehicle 31 is measured by the object distance detection unit 5.
- the inter-vehicle distance S is compared with a predetermined threshold value S0.
- the process proceeds to S103, and the projection distance D is the inter-vehicle distance S.
- the process proceeds to S104, and the projection distance D is set to the threshold value S0.
- the output video processing unit 10 projects the main virtual image at the position of the projection distance D determined in S103 or S104.
- the video to be projected at this time is, for example, vehicle speed information from the driving information acquisition unit 7, and the video signal is created and sent to the video display unit 20.
- the focusing drive unit 12 is controlled to project at the projection distance D.
- the front video imaged by the front video detection unit 2 is analyzed by the input video analysis unit 3, and an alert target (reference numeral 32 in FIG. 4) such as a pedestrian is detected by the object type detection unit 4.
- an alert target such as a pedestrian is detected by the object type detection unit 4.
- the object distance detection unit 5 measures the alert distance Sa to the alert target 32.
- the projection distance D is the alert distance Sa.
- the output video processing unit 10 projects an alert virtual image at the position of the projection distance D determined in S108.
- the video projected at this time is, for example, a frame surrounding the alert target 32, and the video signal is created and sent to the video display unit 20. Further, the focusing drive unit 12 is controlled to project at the projection distance D.
- FIG. 6 is a diagram showing a display example of a projection position and a projected image when traveling left and right. That is, when a right turn or a left turn is scheduled to be performed, the display is switched according to the distance S between the vehicles.
- a display example of a projected image that can be seen from the windshield on the left side and the windshield on the right side is shown for the case of turning right.
- the threshold S1 of the inter-vehicle distance at the time of right / left turn traveling is set to be smaller than the threshold S0 at the time of straight traveling.
- (A) is the case where the distance S to the forward vehicle 31 in the right turn direction is less than the threshold value S1
- the projection distance D of the projected image (main virtual image) 41 indicating the vehicle speed information is the distance S to the forward vehicle 31.
- the display position of the projected image 41 in the screen is shifted to the vicinity of the vehicle (for example, the rear of the vehicle) so as not to overlap the forward vehicle 31. This is to reduce the viewpoint movement between the forward vehicle 31 and the projected video 41 that are not observing the front vehicle and that is being watched.
- (B) is a case where the distance S to the forward vehicle 31 in the right turn direction is greater than or equal to the threshold S1, and the projection distance D of the projected image 41 is the distance Sb to the intersection. In addition, even when the front vehicle 31 does not exist, the projection distance D is the distance Sb to the intersection.
- the display position of the projected image 41 in the screen is the exit position of the intersection.
- the vehicle turns right and left and enters the building.
- the projection distance D is the distance to the entrance of the building
- the display position is the position before the entrance.
- the right / left turn entry position can be determined by using navigation information or the like.
- FIG. 7 is a flowchart showing a video display process during the right / left turn traveling of FIG.
- the right / left turn detection unit 6 detects a right / left turn operation from a turn signal, route guidance information, speed / camera information, and determines the direction (right turn or left turn).
- the image captured by the front image detection unit 2 is analyzed by the input image analysis unit 3, and it is determined whether the object type detection unit 4 detects the forward vehicle in the right-left turn direction (reference numeral 31 in FIG. 6). If detected, the process proceeds to S202, and if not detected, the process proceeds to S205.
- the inter-vehicle distance S to the preceding vehicle 31 is measured by the object distance detection unit 5.
- the inter-vehicle distance S is compared with a predetermined threshold value S1.
- the process proceeds to S204, where the projection distance D is the inter-vehicle distance S.
- the process proceeds to S205 and the distance Sb to the intersection is measured.
- the projection distance D is the distance Sb to the intersection.
- the output video processing unit 10 projects the main virtual image at the position of the projection distance D determined in S204 or S206.
- the video to be projected at this time is, for example, vehicle speed information from the driving information acquisition unit 7, and the video signal is created and sent to the video display unit 20.
- the focusing drive unit 12 is controlled to project at the projection distance D.
- the projection distance of the image (information) to be displayed is changed according to the vehicle traveling conditions of the own vehicle and the other vehicle, the amount of movement of the driver's viewpoint in order to see the displayed image There is an effect that safety is improved while driving.
- FIG. 8 is a diagram illustrating a configuration of the projection optical system (time division method) in the second embodiment.
- the image display unit 20 emits a plurality (three) of images 50a, 50b, and 50c in a time division manner and is reflected on different optical paths by the three time division mirrors 21a, 21b, and 21c arranged on the optical path.
- Projection lenses 22 a, 22 b, and 22 c are disposed in the respective optical paths, and the images 50 a, 50 b, and 50 c are projected onto the windshield 29.
- the positions (lens intervals) of the projection lenses 22a, 22b, and 22c by the focusing drive unit 12, it is possible to display the three images 50a, 50b, and 50c with different projection distances. .
- FIG. 9 is a diagram illustrating a block configuration of the vehicle information display apparatus according to the second embodiment.
- a time division mirror control unit 14 is added to the configuration of the first embodiment (FIG. 1).
- the time division mirror control unit 14 corresponds to the time division mirror 21a corresponding to the emission timing of each of the images 50a, 50b, 50c.
- 21b, 21c are switched on (rotated to the reflecting state) and projected through the projection lenses 22a, 22b, 22c.
- the driver can simultaneously display the plurality of images at different projection positions. Visual recognition is possible.
- the direction of the driver's line of sight (pupil 9) is detected by the pupil detection unit 8, and the duty ratio (ON time) with respect to the image that the driver is gazing at is increased to make the image brighter than the others. Visibility can be improved.
- FIG. 10 is a diagram illustrating a configuration of a projection optical system (color separation method) in the third embodiment.
- the video display unit 20 divides a plurality of (three) videos 50R, 50B, and 50G into different display colors (R, B, and G), synthesizes them, and emits them.
- the emitted composite image is reflected by the dichroic mirror 21G arranged on the optical path, the G image 50G is reflected by the dichroic mirror 21B, the B image 50B is reflected by the reflection mirror 21R, and the R image 50R is reflected by three images. Separated into 50R, 50B, and 50G, they travel on different optical paths.
- the images 50R, 50B, and 50G are projected onto the windshield 29 through the projection lenses 22R, 22B, and 22G, respectively.
- the focusing drive unit 12 By controlling the positions (lens intervals) of the projection lenses 22R, 22B, and 22G by the focusing drive unit 12, it is possible to display three images 50R, 50B, and 50G with different projection distances.
- FIG. 11 is a diagram illustrating a block configuration of the vehicle information display apparatus according to the third embodiment.
- a color division control unit 15 is added to the configuration of the first embodiment (FIG. 1).
- the color division control unit 15 divides a plurality of projection videos into different display colors according to the type thereof, for example, the main video (vehicle speed information) is configured in B or G color, and the alert video is configured in R color.
- the focusing drive unit 12 can change the projection distance of each image 50R, 50B, 50G by controlling the position of the projection lens 22R, 22B, 22G corresponding to each image color.
- the direction of the driver's line of sight (pupil 9) is detected by the pupil detection unit 8, and the intensity of the color of the image being viewed is increased, thereby making the image brighter than others and improving the visibility. it can.
- two dichroic mirrors 21G and 21B are added to display three images, but it goes without saying that the number of display colors and the number of dichroic mirrors can be increased to further increase the number of images to be displayed simultaneously. Yes.
- FIG. 12 is a diagram illustrating a configuration of a projection optical system (polarization separation method) in the fourth embodiment.
- the image display unit 20 switches two images 50 a and 50 b whose polarization directions are not unified (non-polarized) by a digital mirror element (DMD) or the like to time division and outputs the images to the polarization separation optical system 23.
- the polarizing plate 24 and the liquid crystal element 25 are switched and converted into P-polarized or S-polarized images in synchronization with the timing of the incident images 50a and 50b.
- the liquid crystal element 25 is controlled, and the image 50a is converted to P-polarized light and the image 50b is converted to S-polarized light. Thereafter, the light is separated into P-polarized light and S-polarized light by the polarization beam splitter 26 and led to different optical paths.
- the P-polarized light (image 50a) passes through the polarization beam splitter 26 and travels toward the windshield 29 via the projection lens 22a.
- the S-polarized light (image 50b) is reflected by the polarization beam splitter 26, passes through the projection lens 22b, is reflected by the projection direction switching mirror 27, and travels toward the windshield 29.
- the projection positions on the windshield 29 of the two images 50a and 50b are Each can be displayed separately on the front of the driver (pupil 9a) and the front of the passenger seat (pupil 9b). Further, the image 50b in front of the passenger seat can be viewed as the image 50b 'even by the driver (pupil 9a) by changing the angle of the projection direction switching mirror 27.
- FIG. 13 is a diagram illustrating a block configuration of the vehicle information display apparatus according to the fourth embodiment.
- a polarization switching liquid crystal control unit (polarization switching control unit) 16 and a projection direction switching mirror control unit 17 are added to the configuration of the first embodiment (FIG. 1).
- the polarization switching liquid crystal control unit 16 controls the polarization separation optical system 23 and controls the liquid crystal element 25 to switch the polarization direction of the emitted light between P-polarized light and S-polarized light.
- the projection direction switching mirror control unit 17 switches the angle of the projection direction switching mirror 27 to switch the projection direction of the video 50b to either the driver seat or the passenger seat.
- the two images 50a and 50b having different projection distances can be viewed almost simultaneously.
- the observation position can be switched between the driver seat and the passenger seat.
- the embodiments 2 to 4 described above are effective even when used alone, but by appropriately combining them, the number of images to be displayed can be further increased by changing the projection distance.
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Instrument Panels (AREA)
Abstract
Description
本発明は、車両に搭載し拡張現実機能により運転を支援する車両用情報表示装置に関するものである。 The present invention relates to a vehicle information display device that is mounted on a vehicle and supports driving by an augmented reality function.
自動車の運転支援技術の1つとして、自動車に搭載したヘッドアップディスプレイ(車両用情報表示装置)を用いて、運転者が見ている車両前方の空間に自動車を運転するときの各種情報(例えば走行速度)を含む映像を投射し、風景に重畳して表示する技術(拡張現実機能、Augmented Reality)が知られている。 As one of the driving assistance technologies for automobiles, various information (for example, traveling) when driving an automobile in a space in front of the vehicle viewed by the driver using a head-up display (vehicle information display device) mounted on the automobile. A technology (an augmented reality function, Augmented Reality) that projects an image including (speed) and superimposes it on a landscape is known.
例えば特許文献1には、運転者に見易い画像表示を行うことを目的とし、車速に応じて画像の投影距離や投影像の大きさを調整する技術が開示されている。
For example,
運転者が運転中に情報を取得する場合、運転者の視点(焦点)の移動量を少なくして情報を取得できることが理想である。なぜなら、視点の移動量が多いと前方風景への注意力が低下し、交通事故が発生する危険性が高まるからである。特許文献1では、運転者の注視距離が走行速度により異なることに着目し、車速に応じて画像の投影距離を変更するようにしている。
When the driver acquires information while driving, it is ideal that the information can be acquired by reducing the amount of movement of the driver's viewpoint (focus). This is because, when the amount of movement of the viewpoint is large, attention to the front landscape is reduced and the risk of a traffic accident is increased. In
しかしながら、運転中に前方に走行車両が存在する場合には、運転者の視点は前方車両の位置に移動し運転者の注視距離は車間距離となることから、特許文献1のように車速に応じて投影距離(投射距離)を変更するだけでは不十分と言える。 However, when there is a traveling vehicle ahead during driving, the driver's viewpoint moves to the position of the preceding vehicle and the driver's gaze distance becomes the inter-vehicle distance. Thus, it can be said that it is not sufficient to change the projection distance (projection distance).
また、表示する情報(映像)が複数存在し、それぞれの情報を異なる投射距離にて同時に表示したい場合もある。例えば、前方を走行する車両に関する情報と、直前を横断する歩行者に関する情報とを同時に表示したい場合には、それぞれの最適投射距離は異なる。特許文献1をはじめ従来技術では、複数の情報を異なる投射距離で表示することは考慮されていなかった。
Also, there are cases where there are a plurality of information (images) to be displayed and each information is desired to be displayed simultaneously at different projection distances. For example, when it is desired to simultaneously display information relating to a vehicle traveling ahead and information relating to a pedestrian crossing immediately before, the optimum projection distances are different. In the prior art including
本発明の目的は、周囲車両の走行状況に応じて映像の投射距離を変更して表示する車両用情報表示装置を提供することにある。 An object of the present invention is to provide an information display device for a vehicle that changes and displays a projection distance of an image according to a traveling state of surrounding vehicles.
本発明は、車両に搭載して車両前方の空間に映像を投射して情報を表示する車両用情報表示装置であって、車両前方の風景を撮像する前方映像検出部と、撮像した映像から物体の認識処理を行う入力映像解析部と、前記物体の種類を判定する物体種類検出部と、前記物体までの距離を測定する物体距離検出部と、前記物体の種類に基づき表示する情報を決定して映像信号を出力する出力映像処理部と、前記映像信号に基づき投射する映像を生成する映像表示部と、生成された前記映像を投射レンズにより投射する投射光学系と、前記投射レンズの位置を移動させるフォーカシング駆動部を備え、前記出力映像処理部は前記物体の種類と前記物体までの距離に基づき、前記フォーカシング駆動部を制御して、投射する映像の投射距離を変更する構成とする。 The present invention is an information display device for a vehicle that is mounted on a vehicle and displays information by projecting an image on a space in front of the vehicle, and includes a front image detection unit that images a landscape in front of the vehicle, An input video analysis unit that performs recognition processing, an object type detection unit that determines the type of the object, an object distance detection unit that measures a distance to the object, and information to be displayed based on the type of the object An output video processing unit that outputs a video signal, a video display unit that generates a video to be projected based on the video signal, a projection optical system that projects the generated video by a projection lens, and a position of the projection lens A focusing drive unit that moves the output video processing unit, based on a type of the object and a distance to the object, controls the focusing drive unit to change a projection distance of a projected image. Configuration to.
ここに、前記物体の種類が前方車両であり、該前方車両までの距離が閾値未満の場合は、前記投射映像の投射距離を前記前方車両までの距離とし、前記投射映像を前記前方車両近傍の位置に表示する。 Here, when the type of the object is a front vehicle and the distance to the front vehicle is less than a threshold, the projection distance of the projection image is set to the distance to the front vehicle, and the projection image is displayed near the front vehicle. Display in position.
本発明によれば、表示された映像を見るために運転者の視点の移動量が少なくなり、運転中の安全性が向上する。 According to the present invention, the amount of movement of the driver's viewpoint is reduced in order to see the displayed video, and safety during driving is improved.
以下、本発明の実施形態について図面を用いて説明する。 Hereinafter, embodiments of the present invention will be described with reference to the drawings.
実施例1では、周囲車両の状況に応じて映像の投射距離を変更して表示する構成について説明する。
図1は、実施例1にかかる車両用情報表示装置のブロック構成図である。
車両用情報表示装置(ヘッドアップディスプレイ)1において、前方映像検出部2は車両前方の風景を撮像するカメラであり、入力映像解析部3は撮像した映像から物体の認識処理を行う。物体を認識すると、物体種類検出部4はその種類(車両、人物、自転車など)を判定し、物体距離検出部5は物体までの距離を測定する。物体の種類の識別は各種物体のパターンとの照合による画像認識技術により、また距離測定はカメラによる測距技術を利用する。
In the first embodiment, a configuration in which the projection distance of the video is changed and displayed according to the situation of the surrounding vehicle will be described.
FIG. 1 is a block configuration diagram of the vehicle information display device according to the first embodiment.
In the vehicle information display device (head-up display) 1, the front
右左折検出部6は、ウインカー信号などから自車両が右折または左折が行われることを検出し、運転情報取得部7は、GPS情報やナビゲーション情報(例えば車速)を取得する。瞳検出部8は、運転者または助手席者の瞳9を撮像し、視線位置(上下、左右方向)を検出する。
The right / left turn detection unit 6 detects from the turn signal or the like that the host vehicle is turning right or left, and the driving
出力映像処理部10は、物体の種類・距離の検出結果、右左折の検出結果、運転情報、視線位置の情報をもとに、表示する情報(映像)の内容と投射距離を決定し、映像信号を出力する。ここに出力する映像は、例えば速度情報や警告情報(アラート情報)を含むものであり、表示する空間内の物体(車両、人物など)検出位置に合わせて表示する。また、運転者の視線の方向を検出し、その向きに応じて表示位置を調整する。
The output
スケーリング処理部11は、出力映像を投射面である車両のフロントガラスのサイズに合わせて拡大縮小し、映像表示部20にて映像を投射表示する。映像表示部20は、光源や映像表示素子(液晶素子(LCD、LCOS)、デジタルミラー素子(DMD)等)を有し、投射光学系(レンズ、ミラー)により映像を投射面(フロントガラス、ハーフミラー等)に投射する。以降、実施例の説明の際に投射面としてフロントガラスに限定して記載しているが、コンバイナと呼ばれるハーフミラーやフィルムなど、光を一定量反射できるものであればこの限りではない。
The
フォーカシング駆動部12は、映像の投射距離が所定の距離となるよう投射光学系のレンズ位置を移動させる。変倍駆動部13は、投射光学系のレンズ位置を調整して投射する映像の大きさを調整する。
The focusing
特に本実施例では、物体種類検出部4と物体距離検出部5の検出結果に基づき、出力映像処理部10は、フォーカシング駆動部12を制御し、表示映像の投射距離を変更することに特徴がある。
In particular, the present embodiment is characterized in that, based on the detection results of the object
図2は、車両用情報表示装置1を車両に搭載した状態を示す図である。
車両用情報表示装置1は、車両のダッシュボード内に収納され、運転に必要な情報を含む映像をフロントガラス29に向けて投射する。投射された映像はフロントガラス29で反射されて運転者の瞳9に入射するが、運転者はその虚像をフロントガラス29の前方の空間に、車外に見える風景と重畳させて視認する。よって投射距離とは、フロントガラス29を通して視認される虚像の結像位置までの距離である。
FIG. 2 is a diagram illustrating a state in which the vehicle
The vehicle
車両用情報表示装置1の内部では、映像表示部20から出射された映像光は、ミラー21で反射され、投射レンズ22を介してフロントガラス29へ投射される。運転者から見た虚像までの投射距離を変えるには、投射レンズ22の位置(レンズの間隔)をフォーカシング駆動部12により調整することで行う。
Inside the vehicle
図3は、車両の走行状況に応じた投射距離の決定法を説明する図である。
本実施例では、自車30の前方を走行する他車31が存在するとき、他車31までの距離を測定する。なお、右左折走行時には、他車31とは右左折方向の進路を走行する車両とする。他車31までの車間距離Sを閾値S0,S1と比較し、投射距離Dを決定する。閾値S0は直進走行時、閾値S1は右左折走行時のもので、互いに異なる値とする。
FIG. 3 is a diagram for explaining a method for determining the projection distance according to the traveling state of the vehicle.
In this embodiment, when there is another
直進走行時で車間距離Sが閾値S0未満の時は、投射距離Dは車間距離Sに等しくし車速情報などのメイン虚像41を投射する。すなわち、車間距離が小さいときは、メイン虚像41は他車31の位置に合わせて表示する。
When traveling straight ahead and the inter-vehicle distance S is less than the threshold value S0, the projection distance D is made equal to the inter-vehicle distance S and the main
直進走行時で車間距離Sが閾値S0以上の時は、投射距離Dは閾値距離S0に等しくとりメイン虚像41を投射する。すなわち、車間距離が大きいときは、他車31より手前の位置(閾値S0)に表示する。前方を走行する他車31が存在しないときも同様で、閾値距離S0に表示する。この閾値距離S0は、通常の走行時に運転者が最も見やすい距離(注視できる距離)とする。
When the vehicle travels straight ahead and the inter-vehicle distance S is greater than or equal to the threshold value S0, the main
一方、右左折走行時で車間距離Sが閾値S1未満の時は、投射距離Dは車間距離Sに等しくし車速情報などのメイン虚像41を投射する。車間距離Sが閾値S1以上の時は、投射距離Dは右左折する位置(交差点)までの距離としメイン虚像41を投射する。右左折走行時は運転者は比較的近距離範囲を見ている場合が多いので、閾値距離S1は、直進走行時の閾値S0よりも小さく設定する。例えば、直進時の閾値S0の1/2の距離、あるいは、前方の横断歩道までの距離などに設定する。
On the other hand, when the vehicle is turning left or right and the inter-vehicle distance S is less than the threshold value S1, the projection distance D is made equal to the inter-vehicle distance S and the main
さらに、前方に歩行者や自転車などの運転上特に注意すべき対象物(以下、アラート対象)32を検出した場合、アラート対象32までの距離Saを測定する。この場合の投射距離Dはアラート距離Saに等しくし、アラート虚像42を投射する。アラート虚像42は、例えばアラート対象32を強調させるための枠線表示とするが、これに限るものではない。
Further, when an object 32 (hereinafter referred to as an alert target) 32 to be particularly noted in driving such as a pedestrian or a bicycle is detected ahead, a distance Sa to the
次に、フロントガラスから見える投射映像の表示例を車両の走行状況に分けて説明する。
図4は、直進走行時の投射位置と投射映像の表示例を示す図である。車間距離Sの大きさに分けて、左側に道路平面図、右側にフロントガラスから見える投射映像の表示例を示す。
Next, a display example of a projected image that can be seen from the windshield will be described by dividing it into vehicle travel conditions.
FIG. 4 is a diagram illustrating a display example of a projection position and a projected image during straight traveling. A display example of a projected image that can be seen from the windshield is shown on the left side and the road plan view on the right side.
(a)は前方車両31までの車間距離Sが閾値S0未満の場合であり、車速情報を示す投射映像(メイン虚像)41を表示しているが、投射距離Dは前方車両31までの距離Sとする。投射映像41の表示空間内の上下左右方向位置(以下、画面内の表示位置という)は、運転者から見て前方車両31に重ならないよう、車両の近傍(例えば車両下側の道路面上)にずらしている。これは前方車両の視認を妨げず、かつ注視している前方車両31と投射映像41との間の視点移動を少なくするためである。
(A) is a case where the inter-vehicle distance S to the preceding
(b)は前方車両31までの車間距離Sが閾値S0以上の場合であり、投射映像41の投射距離Dは閾値距離S0とする。この場合も、投射映像41の画面内の表示位置は、前方車両31に重ならないよう車両の近傍にずらす。なお、前方車両31が存在しない場合も、投射距離Dは閾値距離S0とし、画面内の表示位置は予め定めた位置(例えば画面中央位置、走行車線上など)とする。
(B) is a case where the inter-vehicle distance S to the preceding
(c)は道路を横断しようとする歩行者などのアラート対象32を検出した場合であり、投射映像(アラート虚像)42を表示しているが、投射距離Dはアラート対象32までの距離Saとする。この場合の投射映像42はアラート対象32(歩行者)を囲む枠線であり、画面内の表示位置をアラート対象32に合わせることで、アラート対象32を注視させるようにする。
(C) is a case where an
図5は、図4の直進走行時の映像表示処理を示すフローチャートである。
S100では、前方映像検出部2で撮像した前方の映像を入力映像解析部3で解析し、物体種類検出部4により前方車両(図4の符号31)が検出されるかどうか判定する。検出される場合はS101へ進み、検出されない場合はS104へ進む。
FIG. 5 is a flowchart showing video display processing during straight traveling in FIG.
In S100, the front image captured by the front
S101では、物体距離検出部5により前方車両31までの車間距離Sを測定する。S102では、車間距離Sを予め定めた閾値S0と比較する。車間距離Sが閾値S0未満の時はS103へ進み、投射距離Dは車間距離Sとする。車間距離Sが閾値S0以上の時、あるいは前記S100の判定で前方車両が検出されないときはS104へ進み、投射距離Dは閾値S0とする。
In S101, the inter-vehicle distance S to the preceding
S105では、出力映像処理部10は、S103またはS104で決定した投射距離Dの位置にメイン虚像を投射させる。この時投射する映像は、例えば運転情報取得部7からの車速情報であり、その映像信号を作成して映像表示部20に送る。そのとき、前記投射距離Dで投射するようフォーカシング駆動部12を制御する。
In S105, the output
次にS106では、前方映像検出部2で撮像した前方の映像を入力映像解析部3で解析し、物体種類検出部4により歩行者などのアラート対象(図4の符号32)が検出されるかどうか判定する。検出される場合はS107へ進み、検出されない場合は処理を終了する。
Next, in S106, the front video imaged by the front
S107では、物体距離検出部5によりアラート対象32までのアラート距離Saを測定する。S108では、投射距離Dはアラート距離Saとする。
In S107, the object
S109では、出力映像処理部10は、S108で決定した投射距離Dの位置にアラート虚像を投射させる。この時投射する映像は、例えばアラート対象32を取り囲む枠線であり、その映像信号を作成して映像表示部20に送る。また、前記投射距離Dで投射するようフォーカシング駆動部12を制御する。
In S109, the output
これで映像表示処理の1サイクルを終了するが、上記サイクルを所定間隔で繰り返して実行する。 This completes one cycle of the video display process, but the above cycle is repeated at predetermined intervals.
図6は、右左折走行時の投射位置と投射映像の表示例を示す図である。すなわち、これから右折または左折走行が行われる予定のとき、車間距離Sの大きさに応じて表示を切り替える。ここでは、右折する場合について、左側に道路平面図、右側にフロントガラスから見える投射映像の表示例を示す。前記したように、右左折走行時の車間距離の閾値S1は直進走行時の閾値S0よりも小さく設定している。 FIG. 6 is a diagram showing a display example of a projection position and a projected image when traveling left and right. That is, when a right turn or a left turn is scheduled to be performed, the display is switched according to the distance S between the vehicles. Here, a display example of a projected image that can be seen from the windshield on the left side and the windshield on the right side is shown for the case of turning right. As described above, the threshold S1 of the inter-vehicle distance at the time of right / left turn traveling is set to be smaller than the threshold S0 at the time of straight traveling.
(a)は右折方向の前方車両31までの距離Sが閾値S1未満の場合であり、車速情報を示す投射映像(メイン虚像)41の投射距離Dは前方車両31までの距離Sとする。投射映像41の画面内の表示位置は、前方車両31に重ならないよう、車両の近傍(例えば車両の後方)にずらす。これは前方車両の視認を妨げず、かつ注視している前方車両31と投射映像41との間の視点移動を少なくするためである。
(A) is the case where the distance S to the
(b)は右折方向の前方車両31までの距離Sが閾値S1以上の場合であり、投射映像41の投射距離Dは交差点までの距離Sbとする。なお、前方車両31が存在しない場合も、投射距離Dは交差点までの距離Sbとする。投射映像41の画面内の表示位置は、交差点の出口位置とする。
(B) is a case where the distance S to the
また、自車両が右左折して建物に進入する場合も考えられる。その場合には、投射距離Dは建物の進入部までの距離とし、表示位置は進入部の手前位置とする。右左折進入位置の判断は、ナビゲーション情報などを利用することで可能である。 It is also possible that the vehicle turns right and left and enters the building. In that case, the projection distance D is the distance to the entrance of the building, and the display position is the position before the entrance. The right / left turn entry position can be determined by using navigation information or the like.
図7は、図6の右左折走行時の映像表示処理を示すフローチャートである。
S200では、右左折検出部6は、ウインカー信号、ルート案内情報、速度/カメラ情報などから、右左折操作を検出しその方向(右折か左折か)を判定する。
FIG. 7 is a flowchart showing a video display process during the right / left turn traveling of FIG.
In S200, the right / left turn detection unit 6 detects a right / left turn operation from a turn signal, route guidance information, speed / camera information, and determines the direction (right turn or left turn).
S201では、前方映像検出部2で撮像した映像を入力映像解析部3で解析し、物体種類検出部4により右左折方向の前方車両(図6の符号31)が検出されるかどうか判定する。検出される場合はS202へ進み、検出されない場合はS205へ進む。
In S201, the image captured by the front
S202では,物体距離検出部5により前方車両31までの車間距離Sを測定する。S203では、車間距離Sを予め定めた閾値S1と比較する。車間距離Sが閾値S1未満の時はS204へ進み、投射距離Dは車間距離Sとする。車間距離Sが閾値S1以上の時、あるいは前記S201の判定で前方車両が検出されないときは、S205へ進み交差点までの距離Sbを測定する。S206では、投射距離Dは交差点までの距離Sbとする。
In S202, the inter-vehicle distance S to the preceding
S207では、出力映像処理部10は、S204またはS206で決定した投射距離Dの位置にメイン虚像を投射させる。この時投射する映像は、例えば運転情報取得部7からの車速情報であり、その映像信号を作成して映像表示部20に送る。そのとき、前記投射距離Dで投射するようフォーカシング駆動部12を制御する。
In S207, the output
これで映像表示処理の1サイクルを終了するが、上記サイクルを所定間隔で繰り返して実行する。なお、直進走行と右左折走行の運転状況に応じて、図5と図7のフローを切り替えて実行すればよい。 This completes one cycle of the video display process, but the above cycle is repeated at predetermined intervals. In addition, what is necessary is just to switch and perform the flow of FIG. 5 and FIG.
実施例1によれば、自車および他車の車両走行状況に応じて表示する映像(情報)の投射距離を変えるようにしたので、表示された映像を見るために運転者の視点の移動量が少なくなり、運転中の安全性が向上する効果がある。 According to the first embodiment, since the projection distance of the image (information) to be displayed is changed according to the vehicle traveling conditions of the own vehicle and the other vehicle, the amount of movement of the driver's viewpoint in order to see the displayed image There is an effect that safety is improved while driving.
以下の実施例では、複数の映像(情報)をそれぞれ異なる投射距離で同時に表示する構成について説明する。まず実施例2では、時分割方式により複数の映像を表示する場合について述べる。 In the following embodiment, a configuration will be described in which a plurality of images (information) are simultaneously displayed at different projection distances. First, in the second embodiment, a case where a plurality of videos are displayed by a time division method will be described.
図8は、実施例2における投射光学系(時分割方式)の構成を示す図である。
映像表示部20は複数(3つ)の映像50a,50b,50cを時分割で出射し、光路上に配置した3個の時分割ミラー21a,21b,21cによりそれぞれ異なる光路上に反射される。各光路にはそれぞれ投射レンズ22a,22b,22cを配置して、各映像50a,50b,50cをフロントガラス29に投射する。その際、各投射レンズ22a,22b,22cの位置(レンズの間隔)をフォーカシング駆動部12により制御することにより、3つの映像50a,50b,50cを投射距離を変えて表示することが可能となる。
FIG. 8 is a diagram illustrating a configuration of the projection optical system (time division method) in the second embodiment.
The
図9は、実施例2の車両用情報表示装置のブロック構成を示す図である。
実施例1(図1)の構成に対し、時分割ミラー制御部14を追加している。映像表示部20から複数の映像50a,50b,50cが時分割で出射されると、時分割ミラー制御部14は、各映像50a,50b,50cの出射タイミングに同期して対応する時分割ミラー21a,21b,21cをONに切り替え(反射状態に回転動作させ)、投射レンズ22a,22b,22cを介して投射させる。
FIG. 9 is a diagram illustrating a block configuration of the vehicle information display apparatus according to the second embodiment.
A time division
その際、複数の映像50a,50b,50cの出射切替と時分割ミラー21a,21b,21cの切替タイミングを映像フレームレベルの速度で制御すれば、運転者は異なる投射位置の複数の映像をほぼ同時に視認することが可能となる。
At that time, if the output switching of the plurality of
さらに、瞳検出部8により運転者の視線(瞳9)の方向を検出し、運転者の注視している映像に対するデューティ比(ON時間)を長くすることで、その映像を他より明るくして視認性を向上させることができる。
Further, the direction of the driver's line of sight (pupil 9) is detected by the
この例では3個の時分割ミラー21a,21b,21cにより3つの映像を表示する場合を述べたが、時分割ミラーの数を増加し、同時に表示する映像数をさらに増加できることは言うまでもない。 In this example, the case where three images are displayed by the three time division mirrors 21a, 21b, and 21c has been described. However, it goes without saying that the number of time division mirrors can be increased and the number of images displayed simultaneously can be further increased.
実施例3では、色分離方式で複数の映像を投射する場合について述べる。
図10は、実施例3における投射光学系(色分離方式)の構成を示す図である。
映像表示部20は、複数(3つ)の映像50R,50B,50Gを異なる表示色(R,B,G)に色分けし合成して出射する。出射された合成映像は、光路上に配置したダイクロイックミラー21GではG色の映像50Gが、ダイクロイックミラー21BではB色の映像50Bが、反射ミラー21RではR色の映像50Rが反射され、3つの映像50R,50B,50Gに分離されてそれぞれ異なる光路上に進む。その後各映像50R,50B,50Gは、それぞれ投射レンズ22R,22B,22Gを介してフロントガラス29に投射される。各投射レンズ22R,22B,22Gの位置(レンズの間隔)をフォーカシング駆動部12により制御することにより、3つの映像50R,50B,50Gを投射距離を変えて表示することが可能となる。
In the third embodiment, a case where a plurality of images are projected by the color separation method will be described.
FIG. 10 is a diagram illustrating a configuration of a projection optical system (color separation method) in the third embodiment.
The
図11は、実施例3の車両用情報表示装置のブロック構成を示す図である。
実施例1(図1)の構成に対し、色分割制御部15を追加している。色分割制御部15は、複数の投射映像をその種類に応じて異なる表示色に色分けし、例えばメイン映像(車速情報)はB色またはG色で、アラート映像はR色で構成する。フォーカシング駆動部12は、各映像色に対応する投射レンズ22R,22B,22Gの位置を制御することで、各映像50R,50B,50Gの投射距離を変えることができる。
FIG. 11 is a diagram illustrating a block configuration of the vehicle information display apparatus according to the third embodiment.
A color
さらに、瞳検出部8により運転者の視線(瞳9)の方向を検出し、見ている映像の色の強度を高くすることで、その映像を他より明るくして視認性を向上させることができる。
Further, the direction of the driver's line of sight (pupil 9) is detected by the
本実施例では複雑なミラー制御が必要なく、ダイクロイックミラー21G,21Bの追加のみで実現できる。
In this embodiment, complicated mirror control is not necessary, and it can be realized only by adding the
この例では2個のダイクロイックミラー21G,21Bを追加し3つの映像を表示する場合を述べたが、表示色の数とダイクロイックミラーの数を増加し、同時に表示する映像数をさらに増加できることは言うまでもない。
In this example, two
実施例4では、偏光分離方式で複数の映像を投射する場合について述べる。
図12は、実施例4における投射光学系(偏光分離方式)の構成を示す図である。
映像表示部20は、デジタルミラー素子(DMD)などにより偏光方向が統一されない(無偏光の)2つの映像50a,50bを時分割に切り替えて、偏光分離光学系23に出射する。偏光分離光学系23では、偏光板24と液晶素子25により、入射した映像50a,50bのタイミングに同期してP偏光またはS偏光の映像に切り替え変換する。例えば、液晶素子25を制御し、映像50aはP偏光に、映像50bはS偏光に変換する。その後偏光ビームスプリッター26により、P偏光とS偏光に分離し、異なる光路に導く。P偏光(映像50a)は偏光ビームスプリッター26を透過し、投射レンズ22aを介してフロントガラス29に向かう。一方S偏光(映像50b)は偏光ビームスプリッター26を反射し、投射レンズ22bを通過し投射方向切替ミラー27で反射され、フロントガラス29に向かう。投射レンズ22a,22bの位置(レンズの間隔)をフォーカシング駆動部12により制御することにより、2つの映像50a,50bを投射距離を変えて表示することが可能となる。
In the fourth embodiment, a case where a plurality of images are projected by the polarization separation method will be described.
FIG. 12 is a diagram illustrating a configuration of a projection optical system (polarization separation method) in the fourth embodiment.
The
さらに本実施例では、偏光ビームスプリッター26を運転席の前方位置、投射方向切替ミラー27を助手席の前方位置に配置することで、2つの映像50a,50bのフロントガラス29上の投射位置を、それぞれ運転手(瞳9a)の正面と助手席(瞳9b)の正面に分離して表示することができる。また、助手席の正面の映像50bについては、投射方向切替ミラー27の角度を変えることで、運転手(瞳9a)においても映像50b’として見ることができる。
Further, in the present embodiment, by arranging the polarization beam splitter 26 at the front position of the driver's seat and the projection direction switching mirror 27 at the front position of the passenger seat, the projection positions on the windshield 29 of the two
図13は、実施例4の車両用情報表示装置のブロック構成を示す図である。
実施例1(図1)の構成に対し、偏光切替用液晶制御部(偏光切替制御部)16と投射方向切替ミラー制御部17を追加している。偏光切替用液晶制御部16は、偏光分離光学系23を制御するもので、液晶素子25を制御して出射光の偏光方向をP偏光とS偏光に切り替える。投射方向切替ミラー制御部17は、投射方向切替ミラー27の角度を切り替えて、映像50bの投射方向を運転席と助手席のいずれかに切り替える。
FIG. 13 is a diagram illustrating a block configuration of the vehicle information display apparatus according to the fourth embodiment.
A polarization switching liquid crystal control unit (polarization switching control unit) 16 and a projection direction switching
本実施例でも、映像50a,50bの出射と液晶素子25の制御を同期させ高速に切り替えることで、投射距離の異なる2つの映像50a,50bをほぼ同時に視認することができる。また、一方の映像50bについては、観測位置を運転席と助手席で切り替えることも可能である。
Also in this embodiment, by synchronizing the emission of the
以上説明した実施例2~4は単独でも有効であるが、適宜組み合わせることにより、投射距離を変えて表示する映像数をさらに増加することが可能となる。
The
1:車両用情報表示装置、2:前方映像検出部、3:入力映像解析部、4:物体種類検出部、5:物体距離検出部、6:右左折検出部、7:運転情報取得部、8:瞳検出部、9:瞳、10:出力映像処理部、11:スケーリング処理部、12:フォーカシング駆動部、13:変倍駆動部、14:時分割ミラー制御部、15:色分割制御部、16:偏光切替用液晶制御部、17:投射方向切替ミラー制御部、20:映像表示部、21:ミラー、21a,21b,21c:時分割ミラー、21B,21G:ダイクロイックミラー、22:投射レンズ、23:偏光分離光学系、24:偏光板、25:液晶素子、26:偏光ビームスプリッター、27:投射方向切替ミラー、29:フロントガラス、30:自車、31:他車(前方車両)、32:アラート対象、41:メイン虚像、42:アラート虚像、50:投射映像、S:車間距離、D:投射距離。 1: vehicle information display device, 2: front image detection unit, 3: input image analysis unit, 4: object type detection unit, 5: object distance detection unit, 6: right / left turn detection unit, 7: driving information acquisition unit, 8: pupil detection unit, 9: pupil, 10: output video processing unit, 11: scaling processing unit, 12: focusing drive unit, 13: zooming drive unit, 14: time division mirror control unit, 15: color division control unit , 16: Polarization switching liquid crystal control unit, 17: Projection direction switching mirror control unit, 20: Video display unit, 21: Mirror, 21a, 21b, 21c: Time division mirror, 21B, 21G: Dichroic mirror, 22: Projection lens , 23: polarization separation optical system, 24: polarizing plate, 25: liquid crystal element, 26: polarization beam splitter, 27: projection direction switching mirror, 29: windshield, 30: own vehicle, 31: other vehicle (front vehicle), 32: A Over preparative subject 41: main virtual image, 42: Alert virtual image, 50: projection image, S: inter-vehicle distance, D: projection distance.
Claims (9)
車両前方の風景を撮像する前方映像検出部と、
撮像した映像から物体の認識処理を行う入力映像解析部と、
前記物体の種類を判定する物体種類検出部と、
前記物体までの距離を測定する物体距離検出部と、
前記物体の種類に基づき表示する情報を決定して映像信号を出力する出力映像処理部と、
前記映像信号に基づき投射する映像を生成する映像表示部と、
生成された前記映像を投射レンズにより投射する投射光学系と、
前記投射レンズの位置を移動させるフォーカシング駆動部を備え、
前記出力映像処理部は前記物体の種類と前記物体までの距離に基づき、前記フォーカシング駆動部を制御して、投射する映像の投射距離を変更することを特徴とする車両用情報表示装置。 In an information display device for a vehicle that is mounted on a vehicle and displays information by projecting an image on a space in front of the vehicle,
A front image detector for imaging a landscape in front of the vehicle;
An input video analysis unit that performs object recognition processing from the captured video;
An object type detection unit for determining the type of the object;
An object distance detector for measuring the distance to the object;
An output video processing unit that determines information to be displayed based on the type of the object and outputs a video signal;
A video display unit for generating a video to be projected based on the video signal;
A projection optical system for projecting the generated image by a projection lens;
A focusing drive unit for moving the position of the projection lens;
The output video processing unit controls the focusing drive unit based on the type of the object and the distance to the object, and changes the projection distance of the projected image.
前記物体の種類が前方車両であり、該前方車両までの距離が閾値未満の場合は、前記投射映像の投射距離を前記前方車両までの距離とし、前記投射映像を前記前方車両近傍の位置に表示することを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 1,
When the type of the object is a front vehicle and the distance to the front vehicle is less than a threshold, the projection distance of the projection image is set to the distance to the front vehicle, and the projection image is displayed at a position near the front vehicle. An information display device for a vehicle, characterized in that:
前記物体の種類が前方車両であり、該前方車両までの距離が閾値以上の場合、あるいは、前方に車両が存在しない場合は、前記投射映像の投射距離を予め定めた距離とすることを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 1,
When the type of the object is a forward vehicle and the distance to the forward vehicle is greater than or equal to a threshold value, or when there is no vehicle ahead, the projection distance of the projection image is set to a predetermined distance. A vehicle information display device.
当該装置が搭載された車両が右折または左折走行が行われることを検出する右左折検出部を備え、
右左折走行を検出した際の前記前方車両は右左折方向の進路を走行する車両とし、前記閾値は、直進走行時の閾値よりも小さいことを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 2 or 3,
A vehicle equipped with the device includes a right / left turn detection unit that detects whether the vehicle is turning right or left.
The vehicle information display device according to claim 1, wherein the forward vehicle when detecting a right / left turn traveling is a vehicle traveling along a route in a right / left turn direction, and the threshold value is smaller than a threshold value when traveling straight ahead.
前記物体の種類が運転上特に注意すべきアラート対象の場合は、前記投射映像の投射距離は前記アラート対象までの距離とし、該アラート対象の位置に該アラート対象を強調させるアラート映像を表示することを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 1,
When the type of the object is an alert target to which special attention should be paid during driving, the projection distance of the projected video is the distance to the alert target, and an alert video that emphasizes the alert target is displayed at the position of the alert target. A vehicle information display device characterized by the above.
前記映像表示部から時分割で出射された複数の映像をそれぞれ異なる光路に反射する複数の時分割ミラーと、
前記複数の映像の出射タイミングに同期して前記複数の時分割ミラーの切り替えを制御する時分割ミラー制御部と、
前記複数の光路に配置され前記複数の映像を投射する複数の前記投射レンズを備え、
前記フォーカシング駆動部により前記複数の投射レンズの位置をそれぞれ制御することで、複数の映像をそれぞれ異なる投射距離で表示することを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 1,
A plurality of time division mirrors for reflecting a plurality of videos emitted from the video display unit in a time division to different optical paths;
A time-division mirror controller that controls switching of the plurality of time-division mirrors in synchronization with the emission timings of the plurality of videos;
A plurality of the projection lenses arranged in the plurality of optical paths and projecting the plurality of images;
An information display device for a vehicle, wherein a plurality of images are displayed at different projection distances by controlling the positions of the plurality of projection lenses by the focusing drive unit.
前記映像表示部にて合成する複数の映像を異なる表示色に色分けする色分割制御部と、
前記映像表示部から出射された複数の映像を表示色によりそれぞれ異なる光路上に反射するダイクロイックミラーを含む複数のミラーと、
前記複数の光路に配置され前記複数の映像を投射する複数の前記投射レンズを備え、
前記フォーカシング駆動部により前記複数の投射レンズの位置をそれぞれ制御することで、複数の映像をそれぞれ異なる投射距離で表示することを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 1,
A color division control unit for color-dividing a plurality of videos to be combined in the video display unit into different display colors;
A plurality of mirrors including a dichroic mirror that reflects a plurality of images emitted from the image display unit on different optical paths according to display colors;
A plurality of the projection lenses arranged in the plurality of optical paths and projecting the plurality of images;
An information display device for a vehicle, wherein a plurality of images are displayed at different projection distances by controlling the positions of the plurality of projection lenses by the focusing drive unit.
前記映像表示部から時分割で出射された複数の映像を、偏光方向の異なる映像に変換して分離し異なる光路に導く偏光分離光学系と、
前記複数の映像の出射タイミングに同期して前記偏光分離光学系の偏光切り替えを制御する偏光切替制御部と、
前記複数の光路に配置され前記複数の映像を投射する複数の前記投射レンズを備え、
前記フォーカシング駆動部により前記複数の投射レンズの位置をそれぞれ制御することで、複数の映像をそれぞれ異なる投射距離で表示することを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 1,
A polarization separation optical system that converts a plurality of images emitted in a time division manner from the image display unit into images having different polarization directions and separates them into different optical paths, and
A polarization switching control unit that controls polarization switching of the polarization separation optical system in synchronization with the output timing of the plurality of images;
A plurality of the projection lenses arranged in the plurality of optical paths and projecting the plurality of images;
An information display device for a vehicle, wherein a plurality of images are displayed at different projection distances by controlling the positions of the plurality of projection lenses by the focusing drive unit.
前記投射レンズを通過した投射映像を反射する投射方向切替ミラーと、
該投射方向切替ミラーの角度を切り替えて前記投射映像の投射方向を切り替える投射方向切替ミラー制御部を備えることを特徴とする車両用情報表示装置。 The vehicle information display device according to claim 8,
A projection direction switching mirror that reflects the projection image that has passed through the projection lens;
A vehicle information display device comprising: a projection direction switching mirror control unit that switches an angle of the projection direction switching mirror to switch a projection direction of the projection image.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2016565773A JP6279768B2 (en) | 2014-12-25 | 2014-12-25 | Vehicle information display device |
| PCT/JP2014/084382 WO2016103418A1 (en) | 2014-12-25 | 2014-12-25 | Information displaying apparatus for vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2014/084382 WO2016103418A1 (en) | 2014-12-25 | 2014-12-25 | Information displaying apparatus for vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016103418A1 true WO2016103418A1 (en) | 2016-06-30 |
Family
ID=56149511
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2014/084382 Ceased WO2016103418A1 (en) | 2014-12-25 | 2014-12-25 | Information displaying apparatus for vehicle |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP6279768B2 (en) |
| WO (1) | WO2016103418A1 (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018146883A (en) * | 2017-03-08 | 2018-09-20 | パナソニックIpマネジメント株式会社 | Image projection device |
| WO2018180857A1 (en) * | 2017-03-31 | 2018-10-04 | コニカミノルタ株式会社 | Head-up display apparatus |
| WO2018180856A1 (en) * | 2017-03-31 | 2018-10-04 | コニカミノルタ株式会社 | Head-up display apparatus |
| CN112154077A (en) * | 2018-05-24 | 2020-12-29 | 三菱电机株式会社 | Vehicle display control device and vehicle display control method |
| JP2021026131A (en) * | 2019-08-06 | 2021-02-22 | 三菱自動車工業株式会社 | Alarm system for vehicle |
| JP2021165776A (en) * | 2020-04-06 | 2021-10-14 | 株式会社デンソー | Virtual image display device and display control unit |
| WO2023176897A1 (en) * | 2022-03-16 | 2023-09-21 | 株式会社小糸製作所 | Image projection device and image projection method |
| JP2023136363A (en) * | 2022-03-16 | 2023-09-29 | 株式会社小糸製作所 | Image projection device and image projection method |
| JP2023149942A (en) * | 2022-03-31 | 2023-10-16 | 株式会社小糸製作所 | Image projector and method for projecting image |
| CN117644815A (en) * | 2024-01-29 | 2024-03-05 | 深圳市欧冶半导体有限公司 | Blind zone alarming method, device, equipment and system based on intelligent car lamp system |
| JP2024532363A (en) * | 2021-09-18 | 2024-09-05 | フーイャォ グラス インダストリー グループ カンパニー リミテッド | Display windows and vehicles |
| US12158580B2 (en) | 2022-12-05 | 2024-12-03 | Nichia Corporation | Light source unit and image display device |
| US12265220B2 (en) | 2022-11-15 | 2025-04-01 | Nichia Corporation | Image display device |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10607416B2 (en) * | 2018-08-30 | 2020-03-31 | Valeo Comfort And Driving Assistance | Conditional availability of vehicular mixed-reality |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08197981A (en) * | 1995-01-23 | 1996-08-06 | Aqueous Res:Kk | Vehicle display device |
| JP2004168230A (en) * | 2002-11-21 | 2004-06-17 | Nissan Motor Co Ltd | Display device for vehicles |
| JP2005242526A (en) * | 2004-02-25 | 2005-09-08 | Yamaha Corp | Danger information presentation system for vehicle and display device thereof |
| JP2008062762A (en) * | 2006-09-06 | 2008-03-21 | Fujitsu Ten Ltd | Driving support device and driving support method |
| JP2012162111A (en) * | 2011-02-03 | 2012-08-30 | Denso Corp | Vehicle display device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9008904B2 (en) * | 2010-12-30 | 2015-04-14 | GM Global Technology Operations LLC | Graphical vehicle command system for autonomous vehicles on full windshield head-up display |
-
2014
- 2014-12-25 WO PCT/JP2014/084382 patent/WO2016103418A1/en not_active Ceased
- 2014-12-25 JP JP2016565773A patent/JP6279768B2/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08197981A (en) * | 1995-01-23 | 1996-08-06 | Aqueous Res:Kk | Vehicle display device |
| JP2004168230A (en) * | 2002-11-21 | 2004-06-17 | Nissan Motor Co Ltd | Display device for vehicles |
| JP2005242526A (en) * | 2004-02-25 | 2005-09-08 | Yamaha Corp | Danger information presentation system for vehicle and display device thereof |
| JP2008062762A (en) * | 2006-09-06 | 2008-03-21 | Fujitsu Ten Ltd | Driving support device and driving support method |
| JP2012162111A (en) * | 2011-02-03 | 2012-08-30 | Denso Corp | Vehicle display device |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018146883A (en) * | 2017-03-08 | 2018-09-20 | パナソニックIpマネジメント株式会社 | Image projection device |
| WO2018180857A1 (en) * | 2017-03-31 | 2018-10-04 | コニカミノルタ株式会社 | Head-up display apparatus |
| WO2018180856A1 (en) * | 2017-03-31 | 2018-10-04 | コニカミノルタ株式会社 | Head-up display apparatus |
| EP3606064A4 (en) * | 2017-03-31 | 2020-03-18 | Konica Minolta, Inc. | HEAD-UP DISPLAY APPARATUS |
| JPWO2018180856A1 (en) * | 2017-03-31 | 2020-05-14 | コニカミノルタ株式会社 | Head up display device |
| US11130404B2 (en) * | 2017-03-31 | 2021-09-28 | Konica Minolta, Inc. | Head-up display apparatus |
| JP7189513B2 (en) | 2017-03-31 | 2022-12-14 | コニカミノルタ株式会社 | head-up display device |
| CN112154077A (en) * | 2018-05-24 | 2020-12-29 | 三菱电机株式会社 | Vehicle display control device and vehicle display control method |
| JP2021026131A (en) * | 2019-08-06 | 2021-02-22 | 三菱自動車工業株式会社 | Alarm system for vehicle |
| JP7334529B2 (en) | 2019-08-06 | 2023-08-29 | 三菱自動車工業株式会社 | vehicle notification system |
| JP7327253B2 (en) | 2020-04-06 | 2023-08-16 | 株式会社デンソー | virtual image display |
| JP2021165776A (en) * | 2020-04-06 | 2021-10-14 | 株式会社デンソー | Virtual image display device and display control unit |
| JP2024532363A (en) * | 2021-09-18 | 2024-09-05 | フーイャォ グラス インダストリー グループ カンパニー リミテッド | Display windows and vehicles |
| JP7681798B2 (en) | 2021-09-18 | 2025-05-22 | フーイャォ グラス インダストリー グループ カンパニー リミテッド | Display windows and vehicles |
| WO2023176897A1 (en) * | 2022-03-16 | 2023-09-21 | 株式会社小糸製作所 | Image projection device and image projection method |
| JP2023136363A (en) * | 2022-03-16 | 2023-09-29 | 株式会社小糸製作所 | Image projection device and image projection method |
| JP7769569B2 (en) | 2022-03-16 | 2025-11-13 | 株式会社小糸製作所 | Image projection device and image projection method |
| JP2023149942A (en) * | 2022-03-31 | 2023-10-16 | 株式会社小糸製作所 | Image projector and method for projecting image |
| US12265220B2 (en) | 2022-11-15 | 2025-04-01 | Nichia Corporation | Image display device |
| US12158580B2 (en) | 2022-12-05 | 2024-12-03 | Nichia Corporation | Light source unit and image display device |
| CN117644815A (en) * | 2024-01-29 | 2024-03-05 | 深圳市欧冶半导体有限公司 | Blind zone alarming method, device, equipment and system based on intelligent car lamp system |
| CN117644815B (en) * | 2024-01-29 | 2024-04-02 | 深圳市欧冶半导体有限公司 | Blind zone alarming method, device, equipment and system based on intelligent car lamp system |
Also Published As
| Publication number | Publication date |
|---|---|
| JPWO2016103418A1 (en) | 2017-07-06 |
| JP6279768B2 (en) | 2018-02-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6279768B2 (en) | Vehicle information display device | |
| US11181743B2 (en) | Head up display apparatus and display control method thereof | |
| JP6346614B2 (en) | Information display system | |
| JP6643969B2 (en) | Display device for vehicles | |
| JP6175589B2 (en) | Projection display apparatus and projection display method | |
| US10551619B2 (en) | Information processing system and information display apparatus | |
| US9678340B2 (en) | Vehicular display apparatus | |
| JP6806097B2 (en) | Image display device and image display method | |
| JP5723106B2 (en) | Vehicle display device and vehicle display method | |
| JP6272375B2 (en) | Display control device for vehicle | |
| US20160216521A1 (en) | Vehicle information projection system and projection device | |
| JP6865006B2 (en) | Vehicle display device | |
| JP6945933B2 (en) | Display system | |
| JPWO2017134865A1 (en) | Head-up display device | |
| US20200051529A1 (en) | Display device, display control method, and storage medium | |
| JP2010072455A (en) | In-vehicle display and display method | |
| WO2016203793A1 (en) | Virtual image presentation system, image projection device, and virtual image presentation method | |
| WO2015076142A1 (en) | Vehicle information projection system | |
| JP6801508B2 (en) | Head-up display device | |
| JP6448714B2 (en) | Information display system | |
| JP2015120395A (en) | Vehicle information projection system | |
| JP6213300B2 (en) | Vehicle display device | |
| JP2018144554A (en) | Head-up display device for vehicle | |
| JP2021037916A (en) | Display control device and display control program | |
| JPWO2019130860A1 (en) | Head-up display device and control program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14909025 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2016565773 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14909025 Country of ref document: EP Kind code of ref document: A1 |