[go: up one dir, main page]

WO2006100884A1 - Video display device, video display method, video display program, and computer-readable recording medium having the program recorded thereon - Google Patents

Video display device, video display method, video display program, and computer-readable recording medium having the program recorded thereon Download PDF

Info

Publication number
WO2006100884A1
WO2006100884A1 PCT/JP2006/303991 JP2006303991W WO2006100884A1 WO 2006100884 A1 WO2006100884 A1 WO 2006100884A1 JP 2006303991 W JP2006303991 W JP 2006303991W WO 2006100884 A1 WO2006100884 A1 WO 2006100884A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
video
display
information
video display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2006/303991
Other languages
French (fr)
Japanese (ja)
Inventor
Kenichi Kawasaki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pioneer Corp
Original Assignee
Pioneer Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pioneer Corp filed Critical Pioneer Corp
Publication of WO2006100884A1 publication Critical patent/WO2006100884A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/12Mirror assemblies combined with other articles, e.g. clocks
    • B60R2001/1253Mirror assemblies combined with other articles, e.g. clocks with cameras, video cameras or video screens
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/302Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8066Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring rearward traffic

Definitions

  • the present invention relates to a video display device that displays a video around a vehicle, a video display method, a video display program, and a computer-readable recording medium that records the program.
  • the present invention is not limited to the above-described video display device, video display method, video display program, and computer-readable recording medium on which the program is recorded.
  • Such a vehicle rear imaging device is provided with, for example, an obstacle sensor for detecting backward measurement at the rear end of the vehicle, and a side distance sensor for detecting an obstacle at a far rear, thereby providing a video power camera.
  • the camera is normally wide-angled by the judgment / view control circuit, including when an obstacle is detected by the obstacle sensor, while there is another vehicle only in the detection range of the distance sensor.
  • the angle is narrow and the rear can be confirmed on the display with the same sense of distance as when using a side mirror (for example, Patent Document 1). reference.).
  • Patent Document 1 Japanese Patent Laid-Open No. 6-32175
  • the video camera image displayed on the display is wide-angled only when an obstacle or another vehicle is detected by the obstacle sensor and the distance sensor. Display or display at a narrow angle. For this reason, when a fault occurs in an obstacle sensor or a lateral distance sensor, the wide-angle / narrow-angle display of the image is switched off. An example is the problem that the replacement cannot be performed well and there is a risk of hindering the confirmation of the rear.
  • the video display device is an image pickup means for picking up an image around a vehicle, an acquisition means for acquiring information relating to the behavior of the vehicle, a display means having a display screen, and the display screen.
  • Display control means for displaying at least a part of the video around the vehicle imaged by the imaging means based on the information regarding the behavior acquired by the acquisition means. It is characterized by providing.
  • the video display method according to the invention of claim 4 is acquired by an input step of receiving an input of a video around a vehicle, an acquisition step of acquiring information on the behavior of the vehicle, and the acquisition step. And a display step of displaying at least a part of the video input by the input step on a display screen based on the information related to the behavior.
  • a video display program according to the invention of claim 7 causes a computer to execute the video display method according to any one of claims 4 to 6.
  • a computer-readable recording medium records the video display program according to claim 7.
  • FIG. 1 is a block diagram illustrating an example of a functional configuration of a video display device according to an embodiment.
  • FIG. 2 is a flowchart illustrating an example of a video display processing procedure of the video display device according to the embodiment.
  • FIG. 3 is an explanatory diagram showing an example of the inside of a vehicle in which the video display device according to the first embodiment is mounted.
  • FIG. 4 is a block diagram of an example of a hardware configuration of the video display apparatus according to the first embodiment.
  • FIG. 5 is a flowchart illustrating an example of a video display processing procedure of the video display apparatus according to the first embodiment.
  • FIG. 6 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.
  • FIG. 7 is a diagram for explaining the video display process of the video display device according to the first embodiment.
  • FIG. 8 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.
  • FIG. 9 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.
  • FIG. 10 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.
  • FIG. 11 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.
  • FIG. 12 is a flowchart illustrating a video display processing procedure of the video display apparatus according to the second embodiment.
  • FIG. 1 is a block diagram showing an example of a functional configuration of the video display apparatus according to the embodiment of the present invention.
  • the video display device is mounted on a moving body such as a vehicle (including a four-wheeled vehicle and a two-wheeled vehicle) and includes an imaging unit 101, an acquiring unit 102, a display screen 103, and a display control unit 104. It has a configuration.
  • the imaging unit 101 images the surroundings of the vehicle.
  • the surroundings of the vehicle include, for example, the range reflected in the reflecting mirror provided inside the vehicle and the left and right reflecting mirrors provided on the side of the vehicle, and the surroundings of the entire vehicle in the vertical and horizontal directions Means.
  • the acquisition unit 102 acquires information on the behavior of the vehicle.
  • the information on the vehicle behavior is information indicating the movement or stop state of the vehicle.
  • information on the vehicle speed speed information, acceleration information, angular velocity information, etc.
  • inclination angle information inclination angle information
  • lateral G (Gravity) information current location information, and / or information associated with operation input can be included.
  • Display screen 103 displays an image of the surroundings of the vehicle imaged by imaging unit 101.
  • This display screen 103 is, for example, a display screen of an in-vehicle device such as a navigation device that may be mounted inside the vehicle in the vicinity of the left and right reflectors or mounted in front of the center of the driver's seat and passenger seat. It may be.
  • an in-vehicle device such as a navigation device that may be mounted inside the vehicle in the vicinity of the left and right reflectors or mounted in front of the center of the driver's seat and passenger seat. It may be.
  • the display control unit 104 controls the display screen 103, and based on the information about the behavior acquired by the acquisition unit 102, at least one of the images around the vehicle imaged by the imaging unit 101 is displayed. Part of the image is displayed on the display screen 103.
  • the at least part of the video may be all of the video around the vehicle imaged by the imaging unit 101, or may be a video obtained by cutting out a part of the video.
  • the display control unit 104 can display at least a part of a captured image around the vehicle on the display screen 103.
  • the image behind the vehicle is displayed by the imaging unit 101.
  • the display screen 103 displays all of the video behind the vehicle or cuts out a part of it. Can be displayed.
  • the display control unit 104 may enlarge or display at least a part of an image around the vehicle imaged by the imaging unit 101 on the display screen 103 or may display it in a divided manner. In this way, it becomes possible for the vehicle driver (user), etc., to see the situation around the vehicle in detail and instantaneously without accompanying a large line of sight movement, thus improving driving safety. Can be expected to lead to
  • information on the behavior of the vehicle acquired by the acquisition unit 102 includes, for example, information on vehicle speed, inclination angle information, lateral G (Gravity) information, current location information, and information associated with an operation input. Therefore, even if there is a problem with the sensors that obtain information about the vehicle speed, it is possible to perform video display processing using other information.
  • FIG. 2 is a flowchart showing an example of a video display processing procedure of the video display device according to the embodiment of the present invention.
  • the acquisition unit 102 determines whether or not information related to vehicle behavior has been acquired (step S202) . If the acquisition unit 102 determines that the information has been acquired (step S202: Yes), the display control unit 104 acquires the acquired behavior. It is determined what information (for example, information about the speed of the vehicle) is related to the information (step S203).
  • the display control unit 104 selects a video to be displayed on the display screen 103 from the captured video (for example, all video images).
  • the selected video is selected (step S204), and the selected video is displayed on the display screen 103 (step S205).
  • the series of video display processing according to this flowchart is completed.
  • step S202 By performing the video display processing in this way, the video around the vehicle that changes every moment can be displayed on the display screen 103, so that the field of view of the user of the vehicle can be supplemented. If it is determined in step S202 that the information regarding the behavior of the vehicle is not acquired (step S202: No), the process of step S202 is repeated until it is acquired.
  • the video display apparatus As described above, according to the video display apparatus according to the embodiment of the present invention, based on the information on the behavior of the vehicle composed of a plurality of pieces of information, the image of the surroundings of the vehicle is captured. At least a part of the video can be displayed. For this reason, it is possible to reliably acquire information on the behavior of the vehicle so that the user of the vehicle can view not only the image of the reflector but also the situation around the vehicle. Improvements can be made.
  • Example 1 and Example 2 that are useful for the embodiment of the present invention will be described in detail.
  • a case where the video display device which is useful in this embodiment is applied to a private car will be described as an example.
  • FIG. 3 is an explanatory diagram showing an example of the interior of the vehicle on which the video display apparatus according to Embodiment 1 of the present invention is mounted.
  • a console panel in-vehicle device 303 having a display screen (display) 103 in FIG. 1 is provided in front of the vicinity of the center of the driver seat 301 and the passenger seat 302. Further, in front of the driver's seat 301 and the passenger seat 302 and in the vicinity of the right reflector (side mirror) 311 and the left reflector (side mirror) 312 are the display screens (displays) shown in FIG. ) 103 are provided.
  • a ceiling mirror 313 near the center inside the vehicle has a reflecting mirror (room mirror) 314.
  • Speaking force 315 is provided on both sides (door side) of the driver seat 301 and the passenger seat 302, respectively.
  • the imaging unit (in-vehicle power camera) 101 in FIG. 1 facing the rear of the vehicle is provided inside the right side mirror 311 and the left side mirror 312, respectively.
  • the imaging unit 101 may be provided at the rear of the vehicle (not shown), or may be directed to the front of the vehicle, or may be mounted in various forms.
  • FIG. 4 is a block diagram showing an example of the hardware configuration of the video display apparatus according to Embodiment 1 of the present invention.
  • the video display apparatus includes a CPU 401 that functions as the display control unit 104 in FIG. 1, a RAM 402, a ROM 403, a memory 404, and a clock 405.
  • the user operation unit 410 a speed sensor 411 that detects the speed of the running vehicle, an in-vehicle camera 412 that images the surroundings of the vehicle, a tilt angle sensor 413 that detects the tilt angle of the vehicle, and the acceleration of the vehicle Acceleration sensor 414 that detects the angular velocity, angular velocity sensor 415 that detects the angular velocity of the vehicle during cornering, and lateral G sensor that detects lateral G that is an outward force (gravity) generated by centrifugal force during cornering 416 is connected to the display control unit 104.
  • a speed sensor 411 that detects the speed of the running vehicle
  • an in-vehicle camera 412 that images the surroundings of the vehicle
  • a tilt angle sensor 413 that detects the tilt angle of the vehicle
  • a GPS 417 that detects current position information (latitude and longitude information) of a vehicle by receiving radio waves from an artificial satellite and a gyro sensor 418 that detects the traveling direction of the vehicle are connected to the display control unit 104.
  • These sensors 411 and 413 to 418 realize the function of the acquisition unit 102 in FIG.
  • the display control unit 104 includes a display 420 that functions as the display screen 103 in FIG. 1, a video circuit 430 that performs video rendering processing on the display 420, an amplifier 421, and a speaker 422. Are connected to the display control unit 104.
  • the display control unit 104 outputs video information to the video circuit 430, controls the display 420, and based on the information acquired by the sensors 411 and 413 to 418. Thus, at least a part of the image around the vehicle imaged by the in-vehicle camera 412 is displayed.
  • the CPU 401 of the display control unit 104 controls the entire video display device, and executes various arithmetic processes according to the control program, thereby performing overall drive control of each unit included in the video display device.
  • the RAM 402 stores so-called variable data in a rewritable manner, and is used as a work area of the CPU 401 or the like.
  • the RAM 402 may be, for example, a volatile memory that erases data stored when the power is turned off, or may be a non-volatile memory that is backed up by a battery or the like.
  • the ROM 403 stores so-called fixed data such as a boot program, for example.
  • a basic processing program of the video display device is stored.
  • the data stored in the ROM 403 can be rewritten by the user's operation, but is not erased by turning off the power.
  • the memory 404 stores various types of information. Specifically, it is, for example, a hard disk (HD), instead of or in addition to HD, an optical disk (CD-ROM (CD-R, CD-RW), MO, DVD (Digital Versatile Disk)) or memory It may be a removable recording medium such as a card.
  • the clock 405 measures and stores information related to the current time.
  • User operation unit 410 receives an operation input to the video display device by a user or the like.
  • This user operation unit 410 is, for example, a variety of known devices such as a switch for detecting physical depression / non-depression, a keyboard, a touch panel, a joystick, a trackball, a remote controller, and buttons provided on a video display device. It is configured by form or a combination of these to realize its functions.
  • the touch panel when a touch panel is adopted as a form of the user operation unit 410, the touch panel is used by being stacked on the display screen side of the display 420. Then, the display timing on the display 420, the operation input timing on the touch panel (user operation unit 410) and the position coordinates thereof are managed by the display control unit 104, for example, and the input information is recognized.
  • the touch panel stacked on the display 420 as a form of the user operation unit 410 By adopting the network, it is possible to perform many operation inputs without increasing the size of the user operation unit 410.
  • the touch panel various known touch panels such as a resistance film type and a pressure sensitive type can be used.
  • GPS Global Positioning System 417 is provided with a GPS antenna (not shown).
  • GPS is a system that accurately determines the position on the ground by receiving radio waves from four or more artificial satellites.
  • the GPS positioning data obtained by the GPS antenna and the absolute direction data of the traveling direction of the vehicle are obtained from the speed sensor 411, the angular velocity sensor 415, the travel distance sensor (not shown), the inclination angle sensor 413, etc. Is corrected to obtain vehicle current point information.
  • the GPS 417 includes a tuner that demodulates received radio waves, an arithmetic circuit that calculates a position based on the demodulated data, and the like.
  • the GPS 417 outputs the obtained current vehicle location information to the display control unit 104.
  • the display 420 displays an image around the vehicle imaged by the in-vehicle camera 412 based on the video information output from the display control unit 104 and subjected to the drawing process by the video circuit 430.
  • the display 420 is configured by a display device such as a CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, and a plasma display.
  • the amplifier 421 controls output of sound output from the speaker 422. Specifically, for example, the sound volume adjustment or equalizing process is performed, and the sound output state is controlled.
  • the control of the sound output by the amplifier 421 is performed by, for example, an operation input from the user operation unit 410 or a control by the display control unit 104.
  • the speaker 422 outputs (reproduces) the sound controlled by the amplifier 421.
  • this speaker 422 is provided with headphones, so that the sound output field is changed so that the entire interior of the vehicle becomes a sound field.
  • the communication interface (IZF) 423 is, for example, an ECU (Electronic
  • I / F423 The communication server (not shown) via a base station that is not connected may have a function of performing wireless communication of each known method. In this case, the I / F 423 performs data communication with an external communication device by radio.
  • the video circuit 430 performs drawing processing and the like so as to optimally display on the display 420 based on the video information of the video around the vehicle imaged by the in-vehicle camera 412 and output from the display control unit 104.
  • the processed video information is output to the display 420.
  • the video circuit 430 includes, for example, a graphic controller that controls the entire display 420, a buffer memory such as a video RAM (VRAM) that temporarily stores information such as video that can be displayed immediately, and the like. Based on the information output from the graphics controller, it is composed of a control IC that controls video display on the display 420, a GPU (Graphics Processing Unit), and the like.
  • the video circuit 430 may be included in the display control unit 104.
  • a map DB (Database) provided in a general in-vehicle navigation device, a navigation control unit, a position recognition unit, a guidance sound output unit, a point search unit, The route acquisition unit, the route guidance unit, and the guidance sound generation unit may be included.
  • the navigation control unit outputs which position on the map is traveling to the display 420 based on the vehicle position information calculated by the position recognition unit and the map DB.
  • the guide sound output unit reproduces the guide sound by controlling the output to one or a plurality of speakers 422 using the amplifier 421.
  • the map DB used in the navigation control unit is stored in advance in the memory 404, for example, and includes background information that represents features (features) such as buildings, rivers, and the ground surface, and road shapes that represent the shape of the road. Information and is rendered in two or three dimensions on the display 420.
  • the background information includes background shape information representing the shape of the background and background type information representing the type of the background.
  • the background shape information includes, for example, information indicating feature points, polylines, polygons, feature coordinates, and the like.
  • the background type information includes, for example, text information indicating the name, address, telephone number, and the like of the feature, type information indicating the type of the feature such as a building “river”, and the like.
  • the road shape information is information related to a road network having a plurality of nodes and links.
  • the node is information indicating an intersection where a plurality of roads intersect, such as a three-way “crossroad” and a five-way.
  • a link is information indicating a road connecting nodes. Some links have shape interpolation points that allow the expression of curved roads.
  • the road shape information includes traffic condition information.
  • the traffic condition information is information indicating the characteristics of the intersection, the length (distance) of each link, the vehicle width, the traveling direction, the traffic prohibition, the road type, and the like.
  • the characteristics of intersections include, for example, complex intersections such as three- and five-way intersections, intersections where roads diverge at shallow angles, intersections around destination points, highway entrances and exits, and intersections with a high route deviation rate. Can be mentioned.
  • the route departure rate can be calculated from, for example, past travel history.
  • Examples of road types include expressways, toll roads, and general roads.
  • the point search unit searches for an arbitrary point based on the information input from the user operation unit 410 and outputs it to the display 420. Further, the route acquisition unit calculates an optimal route to the point based on the point information obtained by the point search unit. In addition, the route guidance unit generates real-time route guidance information based on the information obtained by the route acquisition unit and the vehicle position information.
  • the guidance sound generation unit generates tone and voice data corresponding to the guidance pattern. In other words, based on the route information, a virtual sound source corresponding to the guidance point is set and voice guidance information is generated, and this is output to the guidance sound output unit.
  • FIG. 5 is a flowchart showing an example of a video display processing procedure of the video display apparatus according to Embodiment 1 of the present invention.
  • a video display process in a case where the information regarding the behavior of the vehicle acquired by the acquisition unit 102 in FIG. 1 is information regarding the speed of the vehicle will be described.
  • the display control unit 104 (refer to FIG. 4, the same applies hereinafter) is displayed on the periphery of the vehicle imaged by the in-vehicle camera 412 (refer to FIG. 4; the same applies hereinafter) as the imaging unit 101 in FIG. Video is input (step S501). After inputting the video, the display control unit 104 displays the video. It is determined whether or not the display 420 (see FIG. 4, the same applies hereinafter) as the display screen 103 in FIG. 3 is ON via the circuit 430 (see FIG. 4, the same applies hereinafter) (step S502).
  • step S502 When the display control unit 104 determines that the display 420 is ON (step S502: Yes), the display control unit 104 determines that the speed sensor 411 (see FIG. 4, the same applies hereinafter), the tilt angle sensor 413, and so on. (See Fig. 4, the same applies hereinafter), acceleration sensor 414 (see Fig. 4, same applies below), angular velocity sensor 415 (see Fig. 4, same applies below), and lateral G sensor 416 (see Fig. 4, same applies below) Among the obtained information on the behavior of the vehicle, information on the speed of the vehicle obtained by the speed sensor 411, the acceleration sensor 414, and the angular velocity sensor 415 is acquired (step S503).
  • step S502 determines that the display 420 is not ⁇ N (step S502: No)
  • the display control unit 104 determines whether or not the display 420 in step S502 is ⁇ N. Repeat.
  • step S504 After acquiring information about the speed obtained by each of the sensors 411, 414, and 415, the display control unit 104 is based on various control parameters stored in the memory 404 (see FIG. 4, the same applies hereinafter). Thus, it is determined whether or not the information regarding the speed is equal to or greater than a predetermined threshold (step S504).
  • step S504 determines that the information regarding the speed is equal to or greater than the predetermined threshold (step S504: Yes)
  • the display control unit 104 for example, the vehicle obtained as an image around the vehicle.
  • Video information of the rear video (wide-angle video) is output to the video circuit 430 (see Fig. 4; the same applies hereinafter), the video circuit 430 is controlled to perform drawing processing on the display 420, and a part of the wide-angle video is cut out Is displayed on the display 420 (step S505).
  • step S504 determines that the information regarding the speed is not equal to or greater than the predetermined threshold (step S504: No)
  • the display control unit 104 displays the rear of the vehicle obtained as an image around the vehicle.
  • the video information of the video (wide-angle video) is output to the video circuit 430, and the video circuit 430 is controlled to perform drawing processing on the display 420, so that all of the wide-angle video is displayed on the display 420 (step S507).
  • step S505 after a part of the wide-angle video is cut out and displayed on the display 420, the display control unit 104 has an operation input from the user operation unit 410 for interrupting the video display processing. Whether or not (step S506). If the display control unit 104 determines that there is an operation input (step S506: Yes), the process proceeds to step S507, and the display control unit 104 displays all of the wide-angle video on the display 420 (step S507). .
  • step S507 after displaying all of the wide-angle video on the display 420, the display control unit 104 determines whether or not the display 420 is OFF via the video circuit 430 (step S508).
  • step S508 Yes
  • the display control unit 104 ends a series of video display processing according to this flowchart.
  • Step S508 No
  • the process returns to Step S507, and the display control unit 104 displays all of the wide-angle video on the display 420 (Step S507) .
  • the process proceeds to Step S508, and whether the display 420 is OFF.
  • a determination process of whether or not is performed (step S508).
  • FIG. 6 to 11 are diagrams for explaining the video display processing of the video display apparatus according to Embodiment 1 of the present invention.
  • the video shown in FIG. 6 is, for example, the console panel in-vehicle device in FIG. It is displayed on the display screen 103 (display 420 in FIG. 4) of the device 303.
  • the display control unit 104 displays one of the images shown in FIG. 6 in step S505.
  • the rear view force that the driver can confirm with the right side mirror 311 is shown in FIG.
  • the driver displays not only the image of range A but also the image of range B indicated by the dotted diagonal line on display screen 103 (display 420 in FIG. 4) near the right side mirror 311. Can be confirmed.
  • the driver displays not only the image of range A but also the image of range B on display screen 103 in the vicinity of right side mirror 311 (FIG. 4). In this case, it can be confirmed on the display 420). For this reason, even when driving at risk such as merging points or lane changes, the driver can see the situation around the vehicle only with the images of the mirrors 311, 312, and 314 in Fig. 3. Therefore, safety can be improved.
  • display control unit 104 and video circuit 430 use a variety of well-known techniques to display at least a part of a video image of the surroundings of the vehicle on display screen 103, so-called enlarged display or division. It is also possible to display or change various display forms such as colors.
  • the video display apparatus has the information power regarding the vehicle behavior acquired by the sensors 4111 and 413 to 416 in FIG. If it is equal to or greater than the predetermined threshold, at least a part of the image around the vehicle can be cut out and displayed on the display 420 in FIG.
  • the display change can be switched by an operation input from the user operation unit 410 in FIG. 4 or a threshold determination process in step S504. For this reason, the driver of the vehicle As a result, not only the image of the reflector but also the situation (image) around the vehicle can be seen instantly and easily without being aware of it under various driving conditions. Can be improved.
  • Example 2 a video display apparatus according to Example 2 will be described.
  • the video display device if the information on the behavior of the vehicle acquired by the acquisition unit 102 in FIG. When it is determined that the threshold is equal to or greater than a predetermined threshold, a part of the captured video is cut out and displayed to improve the safety of operation.
  • the current location information indicates the specific location.
  • a configuration is adopted in which it is determined whether or not it is point information to be shown, and when it is point information indicating a specific point, a part of the captured video is cut out and displayed. Since the hardware configuration of the second embodiment is the same as that of the first embodiment, the same reference numerals as those in FIG. 4 are used in the following description, and illustration and description thereof are omitted.
  • FIG. 12 is a flowchart of the video display processing procedure of the video display apparatus according to the second embodiment.
  • the display control unit 104 inputs an image of the surroundings of the vehicle imaged by the in-vehicle camera 412 as the imaging unit 101 in FIG. 3 (step S 1201).
  • the display control unit 104 determines whether or not the display 420 as the display screen 103 in FIG. 3 is ON via the video circuit 430 (step S1202).
  • step S1202 When the display control unit 104 determines that the display 420 is ON (step S1202: Yes), the display control unit 104 is obtained by the GPS417 (see FIG. 4, the same applies hereinafter). The current location information of the acquired vehicle is acquired (step S1203). On the other hand, when the display control unit 104 determines that the display 420 is not ON (step S1202: No), the display control unit 104 determines whether the display 420 in step S1202 is ON. Repeat the process.
  • the display control unit 104 determines the current position information based on various control parameters and map information stored in the memory 404. It is determined whether or not the point information indicates a specific point (step S1204).
  • the display control unit 104 determines that the current point information is point information indicating a specific point (step S1204: Yes)
  • the display control unit 104 displays an image around the vehicle.
  • the obtained video information of the rear of the vehicle (wide-angle video) is output to the video circuit 430, and the video circuit 430 is controlled to perform drawing processing on the display 420, and a part of the wide-angle video is cut out on the display 420. It is displayed (step S1205).
  • step S1204 determines that the current point information is not point information indicating a specific point (step S1204: No)
  • the display control unit 104 obtains, for example, an image of the surroundings of the vehicle.
  • the video information of the rear of the vehicle (wide-angle video) is output to the video circuit 430, and the video circuit 430 is controlled to perform drawing processing on the display 420, so that all of the wide-angle video is displayed on the display 420 (step S 1207).
  • step S1205 after a part of the wide-angle video is cut out and displayed on the display 420, the display control unit 104 determines whether there is an operation input of the user operation unit 410 force to interrupt the video display processing. It is determined whether or not (step S 1206). If the display control unit 104 determines that there is an operation input (step S1206: Yes), the process proceeds to step S1207, and the display control unit 104 displays all of the wide-angle video on the display 420 ( Step S 1207).
  • the display control unit 104 determines whether the display 420 is OFF via the video circuit 430 (step S1207). S1208). If the display control unit 104 determines that the display 420 is OFF (step S1208: Yes), the display control unit 104 ends a series of video display processing according to this flowchart.
  • Step S1208 No
  • the display control unit 104 displays all of the wide-angle video on the display 420 (Step S1207), proceeds to Step S1208, and the display 420 is OFF.
  • a process for determining whether or not there is present is performed (step S1208).
  • the specific video display processing in step S 1205 in the video display device of the second embodiment is the same as that described with reference to FIGS. 6 to 11 in the first embodiment, and thus the description thereof is omitted here. To do.
  • the video display apparatus has the case where the current location information of the vehicle acquired by the GPS 417 in Fig. 4 is location information indicating a specific location such as an expressway.
  • location information indicating a specific location such as an expressway.
  • the display change can be switched by an operation input from the user operation unit 410 in FIG. 4 or a point information determination process in step S1204. This makes it possible for a vehicle driver to view not only the image of the reflector but also the situation around the vehicle (video) instantly and easily in various places without being aware of it. Therefore, driving safety can be improved.
  • the video display device the video display method, the video display program, and the computer-readable recording medium recording the program according to the present invention. For example, at least a part of the captured image around the vehicle is displayed on the display screen based on information on the behavior of the vehicle composed of information on the vehicle speed and current location information. Can do.
  • the video display method described in the present embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer.
  • This program is recorded on a computer-readable recording medium such as a hard disk, flexible disk, CD-ROM, M0, or DVD, and is executed by being read from the recording medium by the computer.
  • the program may be a transmission medium that can be distributed via a network such as the Internet.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

A video display device has an imaging section (101) for imaging the surroundings of a vehicle; an acquisition section (102) for acquiring information on the behavior of the vehicle; and a display control section (104) for controlling a display screen (103) to display, based on the information on the behavior acquired by the acquisition section (102), at least a part of video out of the video of the surroundings of the vehicle taken by the imaging section (101). The video display device acquires, for example as the information on the vehicle behavior, information on the speed of the vehicle and displays a part of the taken video on the display screen (103).

Description

明 細 書  Specification

映像表示装置、映像表示方法、映像表示プログラムおよびこのプログラム を記録したコンピュータに読み取り可能な記録媒体  VIDEO DISPLAY DEVICE, VIDEO DISPLAY METHOD, VIDEO DISPLAY PROGRAM, AND COMPUTER-READABLE RECORDING MEDIUM CONTAINING THE PROGRAM

技術分野  Technical field

[0001] この発明は、車両の周囲の映像を表示する映像表示装置、映像表示方法、映像表 示プログラムおよびこのプログラムを記録したコンピュータに読み取り可能な記録媒 体に関する。ただし、この発明は、上述した映像表示装置、映像表示方法、映像表 示プログラム、およびこのプログラムを記録したコンピュータに読み取り可能な記録媒 体に限られない。  The present invention relates to a video display device that displays a video around a vehicle, a video display method, a video display program, and a computer-readable recording medium that records the program. However, the present invention is not limited to the above-described video display device, video display method, video display program, and computer-readable recording medium on which the program is recorded.

背景技術  Background art

[0002] 近年、 自動車などの車両に搭載されたルームミラーやサイドミラーなどの反射鏡の 映像のみならず、車両の周囲の映像を撮像して表示画面に表示し、運転者の後方 の視界などを補完する車両用後方撮像装置が提供されている。  [0002] In recent years, not only images of reflectors such as rearview mirrors and side mirrors mounted on vehicles such as automobiles, but also images of the surroundings of the vehicle are captured and displayed on the display screen, and the driver's rear view, etc. There is provided a vehicle rear imaging device that complements the above.

[0003] このような車両用後方撮像装置は、たとえば、車両後端に後測方を検知する障害 物センサと、さらに遠方後方の障害物を検知する側距センサとが設置され、ビデオ力 メラによる画像がディスプレイに表示される。そして、カメラは判断 ·視界制御回路によ り、障害物センサで障害物が検知されているときを含め通常は広角とされる一方、側 距センサの検知範囲のみに他車両があって該車両との距離感を得たい所定の関係 にあるときは、狭角とされて、サイドミラーによる場合と同様の距離感をもってディスプ レイ上で後方が確認できる構成とされている(たとえば、特許文献 1参照。)。  [0003] Such a vehicle rear imaging device is provided with, for example, an obstacle sensor for detecting backward measurement at the rear end of the vehicle, and a side distance sensor for detecting an obstacle at a far rear, thereby providing a video power camera. Is displayed on the display. The camera is normally wide-angled by the judgment / view control circuit, including when an obstacle is detected by the obstacle sensor, while there is another vehicle only in the detection range of the distance sensor. When it is in a predetermined relationship that it is desired to obtain a sense of distance, the angle is narrow and the rear can be confirmed on the display with the same sense of distance as when using a side mirror (for example, Patent Document 1). reference.).

[0004] 特許文献 1 :特開平 6— 32175号公報  Patent Document 1: Japanese Patent Laid-Open No. 6-32175

発明の開示  Disclosure of the invention

発明が解決しょうとする課題  Problems to be solved by the invention

[0005] しかしながら、上記従来技術の車両用後方撮像装置では、障害物センサおよび側 距センサによって障害物や他車両が検知されたときのみに、ディスプレイ上に表示さ れるビデオカメラによる画像を広角に表示したり、狭角に表示したりする。このため、 障害物センサゃ側距センサに不具合が生じたときは、画像の広角/狭角の表示切り 替えを良好におこなうことができず、後方の確認に支障をきたすおそれがあるとレ、う 問題が一例として挙げられる。 [0005] However, in the above-described conventional vehicle rear imaging device, the video camera image displayed on the display is wide-angled only when an obstacle or another vehicle is detected by the obstacle sensor and the distance sensor. Display or display at a narrow angle. For this reason, when a fault occurs in an obstacle sensor or a lateral distance sensor, the wide-angle / narrow-angle display of the image is switched off. An example is the problem that the replacement cannot be performed well and there is a risk of hindering the confirmation of the rear.

課題を解決するための手段  Means for solving the problem

[0006] 請求項 1の発明にかかる映像表示装置は、車両の周囲を撮像する撮像手段と、前 記車両の挙動に関する情報を取得する取得手段と、表示画面を有する表示手段と、 前記表示画面を制御して、前記取得手段によって取得された挙動に関する情報に 基づいて、前記撮像手段によって撮像された前記車両の周囲の映像のうち少なくと も一部の映像を表示する表示制御手段と、を備えることを特徴とする。  [0006] The video display device according to the invention of claim 1 is an image pickup means for picking up an image around a vehicle, an acquisition means for acquiring information relating to the behavior of the vehicle, a display means having a display screen, and the display screen. Display control means for displaying at least a part of the video around the vehicle imaged by the imaging means based on the information regarding the behavior acquired by the acquisition means. It is characterized by providing.

[0007] また、請求項 4の発明にかかる映像表示方法は、車両の周囲の映像の入力を受け 付ける入力工程と、前記車両の挙動に関する情報を取得する取得工程と、前記取得 工程によって取得された挙動に関する情報に基づいて、前記入力工程によって入力 された映像のうち少なくとも一部の映像を表示画面に表示する表示工程と、を含んだ ことを特徴とする。  [0007] Further, the video display method according to the invention of claim 4 is acquired by an input step of receiving an input of a video around a vehicle, an acquisition step of acquiring information on the behavior of the vehicle, and the acquisition step. And a display step of displaying at least a part of the video input by the input step on a display screen based on the information related to the behavior.

[0008] また、請求項 7の発明に力かる映像表示プログラムは、請求項 4〜6のいずれか一 つに記載の映像表示方法をコンピュータに実行させることを特徴とする。  [0008] A video display program according to the invention of claim 7 causes a computer to execute the video display method according to any one of claims 4 to 6.

[0009] また、請求項 8の発明にかかるコンピュータに読み取り可能な記録媒体は、請求項 7に記載の映像表示プログラムを記録したことを特徴とする。  [0009] Further, a computer-readable recording medium according to the invention of claim 8 records the video display program according to claim 7.

図面の簡単な説明  Brief Description of Drawings

[0010] [図 1]図 1は、実施の形態にかかる映像表示装置の機能的構成の一例を示すブロック 図である。  FIG. 1 is a block diagram illustrating an example of a functional configuration of a video display device according to an embodiment.

[図 2]図 2は、実施の形態にかかる映像表示装置の映像表示処理手順の一例を示す フローチャートである。  FIG. 2 is a flowchart illustrating an example of a video display processing procedure of the video display device according to the embodiment.

[図 3]図 3は、実施例 1にかかる映像表示装置が搭載された車両内部の一例を示す 説明図である。  FIG. 3 is an explanatory diagram showing an example of the inside of a vehicle in which the video display device according to the first embodiment is mounted.

[図 4]図 4は、実施例 1にかかる映像表示装置のハードウェア構成の一例を示すプロ ック図である。  FIG. 4 is a block diagram of an example of a hardware configuration of the video display apparatus according to the first embodiment.

[図 5]図 5は、実施例 1にかかる映像表示装置の映像表示処理手順の一例を示すフ ローチャートである。 [図 6]図 6は、実施例 1にかかる映像表示装置の映像表示処理を説明するための図 である。 FIG. 5 is a flowchart illustrating an example of a video display processing procedure of the video display apparatus according to the first embodiment. FIG. 6 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.

[図 7]図 7は、実施例 1にかかる映像表示装置の映像表示処理を説明するための図 である。  FIG. 7 is a diagram for explaining the video display process of the video display device according to the first embodiment.

[図 8]図 8は、実施例 1にかかる映像表示装置の映像表示処理を説明するための図 である。  FIG. 8 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.

[図 9]図 9は、実施例 1にかかる映像表示装置の映像表示処理を説明するための図 である。  FIG. 9 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.

[図 10]図 10は、実施例 1にかかる映像表示装置の映像表示処理を説明するための 図である。  FIG. 10 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.

[図 11]図 11は、実施例 1にかかる映像表示装置の映像表示処理を説明するための 図である。  FIG. 11 is a diagram for explaining video display processing of the video display apparatus according to the first embodiment.

[図 12]図 12は、実施例 2にかかる映像表示装置の映像表示処理手順を示すフ口一 チャートである。  FIG. 12 is a flowchart illustrating a video display processing procedure of the video display apparatus according to the second embodiment.

符号の説明  Explanation of symbols

[0011] 101 撮像部 [0011] 101 imaging unit

102 取得部  102 Acquisition Department

103 表示画面  103 Display screen

104 表示制御部  104 Display controller

301 運転席シート  301 Driver's seat

302 助手席シート  302 Passenger seat

311 右サイドミラー  311 Right side mirror

312 左サイドミラー  312 Left side mirror

314 ノレームミラー  314 Nolem Mirror

発明を実施するための最良の形態  BEST MODE FOR CARRYING OUT THE INVENTION

[0012] 以下に添付の図面を参照して、この発明にかかる映像表示装置、映像表示方法、 映像表示プログラム、およびこのプログラムを記録したコンピュータに読み取り可能な 記録媒体の好適な実施の形態を詳細に説明する。 [0013] (実施の形態) Exemplary embodiments of a video display device, a video display method, a video display program, and a computer-readable recording medium recording the program according to the present invention will be described in detail below with reference to the accompanying drawings. Explained. [0013] (Embodiment)

(映像表示装置の機能的構成)  (Functional configuration of video display device)

まず、この発明の実施の形態に力かる映像表示装置の内容について説明する。図 1は、この発明の実施の形態にかかる映像表示装置の機能的構成の一例を示すブ ロック図である。図 1において、映像表示装置は、車両(四輪車、二輪車を含む)など の移動体に搭載され、撮像部 101と、取得部 102と、表示画面 103と、表示制御部 1 04とを含む構成となっている。  First, the contents of a video display apparatus that is useful in the embodiment of the present invention will be described. FIG. 1 is a block diagram showing an example of a functional configuration of the video display apparatus according to the embodiment of the present invention. In FIG. 1, the video display device is mounted on a moving body such as a vehicle (including a four-wheeled vehicle and a two-wheeled vehicle) and includes an imaging unit 101, an acquiring unit 102, a display screen 103, and a display control unit 104. It has a configuration.

[0014] 撮像部 101は、車両の周囲を撮像する。ここで、車両の周囲とは、たとえば、車両 内部に備えられた反射鏡および車両側部に備えられた左右反射鏡に映る範囲を含 み、車両全体の上下、左右、前後すベての周囲を意味する。  [0014] The imaging unit 101 images the surroundings of the vehicle. Here, the surroundings of the vehicle include, for example, the range reflected in the reflecting mirror provided inside the vehicle and the left and right reflecting mirrors provided on the side of the vehicle, and the surroundings of the entire vehicle in the vertical and horizontal directions Means.

[0015] 取得部 102は、車両の挙動に関する情報を取得する。車両の挙動に関する情報と は、具体的には、車両の移動または停止状態を示す情報であり、たとえば、車両の 速度に関する情報 (速度情報、加速度情報、角速度情報など)、傾斜角情報、横 G ( Gravity)情報、現在地点情報および操作入力に伴う情報のうち少なくともいずれか 1つを含むことができる。  [0015] The acquisition unit 102 acquires information on the behavior of the vehicle. Specifically, the information on the vehicle behavior is information indicating the movement or stop state of the vehicle. For example, information on the vehicle speed (speed information, acceleration information, angular velocity information, etc.), inclination angle information, lateral G (Gravity) information, current location information, and / or information associated with operation input can be included.

[0016] 表示画面 103は、撮像部 101によって撮像された車両の周囲の映像を表示する。  Display screen 103 displays an image of the surroundings of the vehicle imaged by imaging unit 101.

この表示画面 103は、たとえば、左右反射鏡の近傍の車両内部に搭載されたり、運 転席および助手席の中央付近前方に搭載されたりしてもよぐナビゲーシヨン装置な どの車載機器の表示画面であってもよい。  This display screen 103 is, for example, a display screen of an in-vehicle device such as a navigation device that may be mounted inside the vehicle in the vicinity of the left and right reflectors or mounted in front of the center of the driver's seat and passenger seat. It may be.

[0017] 表示制御部 104は、表示画面 103を制御して、取得部 102によって取得された挙 動に関する情報に基づいて、撮像部 101によって撮像された車両の周囲の映像のう ち、少なくとも一部の映像を表示画面 103に表示する。少なくとも一部の映像とは、撮 像部 101によって撮像された車両の周囲の映像のうち、すべての映像であってもよい し、一部を切り出した映像であってもよい。  [0017] The display control unit 104 controls the display screen 103, and based on the information about the behavior acquired by the acquisition unit 102, at least one of the images around the vehicle imaged by the imaging unit 101 is displayed. Part of the image is displayed on the display screen 103. The at least part of the video may be all of the video around the vehicle imaged by the imaging unit 101, or may be a video obtained by cutting out a part of the video.

[0018] このように、表示制御部 104は、撮像された車両の周囲の映像の少なくとも一部を 表示画面 103に表示することができるため、たとえば、撮像部 101によって車両の後 方の映像が撮像された場合、取得部 102によって取得された挙動に関する情報に基 づいて、表示画面 103に車両の後方の映像のすべてを表示したり、一部を切り出し て表示したりすることができる。 [0018] In this way, the display control unit 104 can display at least a part of a captured image around the vehicle on the display screen 103. For example, the image behind the vehicle is displayed by the imaging unit 101. When captured, based on the information about the behavior acquired by the acquisition unit 102, the display screen 103 displays all of the video behind the vehicle or cuts out a part of it. Can be displayed.

[0019] このため、たとえば、車両が車線変更をおこなう際には車両の後方の映像を広角的 に表示画面 103に表示し、車両内部に備えられた反射鏡などでは確認しにくい他車 線の状況を確認したり、車両が低速走行中には車両の後方の映像を狭角的に表示 画面 103に表示し、車両内部に備えられた反射鏡などでは確認しにくい後方死角を 確認したりすることができる。  [0019] For this reason, for example, when the vehicle changes lanes, an image of the rear of the vehicle is displayed on the display screen 103 in a wide angle, and other lanes that are difficult to check with a reflector provided inside the vehicle are displayed. Check the situation or display the rear image of the vehicle at a narrow angle while the vehicle is traveling at a low speed on the screen 103 and check the rear blind spot that is difficult to check with the reflectors provided inside the vehicle. be able to.

[0020] また、表示制御部 104によって、撮像部 101により撮像された車両の周囲の映像の 少なくとも一部を、表示画面 103に拡大表示したり、分割表示したりしてもよい。この ようにすれば、車両の運転者 (ユーザ)などにとって、大きな視線移動を伴うことなく車 両の周囲の状況を詳細かつ瞬時に視認することができるようになるため、運転の安全 性の向上につながることが期待できる。  [0020] In addition, the display control unit 104 may enlarge or display at least a part of an image around the vehicle imaged by the imaging unit 101 on the display screen 103 or may display it in a divided manner. In this way, it becomes possible for the vehicle driver (user), etc., to see the situation around the vehicle in detail and instantaneously without accompanying a large line of sight movement, thus improving driving safety. Can be expected to lead to

[0021] さらに、取得部 102によって取得される車両の挙動に関する情報が、たとえば、車 両の速度に関する情報、傾斜角情報、横 G (Gravity)情報、現在地点情報および操 作入力に伴う情報などの複数の情報で構成されるため、車両の速度に関する情報を 得るセンサ類などに不具合があっても、他の情報を利用して映像表示処理をおこなう こと力 Sできる。  [0021] Further, information on the behavior of the vehicle acquired by the acquisition unit 102 includes, for example, information on vehicle speed, inclination angle information, lateral G (Gravity) information, current location information, and information associated with an operation input. Therefore, even if there is a problem with the sensors that obtain information about the vehicle speed, it is possible to perform video display processing using other information.

[0022] (映像表示装置の映像表示処理手順)  [0022] (Video Display Processing Procedure of Video Display Device)

つぎに、この発明の実施の形態にかかる映像表示装置の映像表示処理手順につ いて説明する。図 2は、この発明の実施の形態にかかる映像表示装置の映像表示処 理手順の一例を示すフローチャートである。  Next, the video display processing procedure of the video display device according to the embodiment of the present invention will be described. FIG. 2 is a flowchart showing an example of a video display processing procedure of the video display device according to the embodiment of the present invention.

[0023] 図 2のフローチャートにおいて、まず、撮像部 101によって車両の周囲が撮像され、 表示制御部 104に撮像された映像を入力する (ステップ S201)。つぎに、取得部 10 2によって、車両の挙動に関する情報を取得したか否かを判断し (ステップ S202)、 取得したと判断した場合 (ステップ S202 : Yes)、表示制御部 104によって、取得した 挙動に関する情報がどのような情報 (たとえば、車両の速度に関する情報)かを判定 する(ステップ S203)。  In the flowchart of FIG. 2, first, the surroundings of the vehicle are imaged by the imaging unit 101, and the captured video is input to the display control unit 104 (step S201). Next, the acquisition unit 102 determines whether or not information related to vehicle behavior has been acquired (step S202) .If the acquisition unit 102 determines that the information has been acquired (step S202: Yes), the display control unit 104 acquires the acquired behavior. It is determined what information (for example, information about the speed of the vehicle) is related to the information (step S203).

[0024] そして、表示制御部 104は、ステップ S203における判定結果に基づいて、撮像さ れた映像のうち、表示画面 103に表示する映像を選択(たとえば、すべての映像のう ちの一部を切り出して拡大した映像などを選択)し (ステップ S204)、選択した映像を 表示画面 103に表示する(ステップ S205)。これにより、本フローチャートによる一連 の映像表示処理を終了する。 [0024] Based on the determination result in step S203, the display control unit 104 selects a video to be displayed on the display screen 103 from the captured video (for example, all video images). The selected video is selected (step S204), and the selected video is displayed on the display screen 103 (step S205). Thus, the series of video display processing according to this flowchart is completed.

[0025] このように映像表示処理することによって、刻々と変化する車両の周囲の映像を表 示画面 103に表示することができるため、車両のユーザなどの視界を補完することが できる。なお、ステップ S202において、車両の挙動に関する情報を取得していないと 判断した場合は(ステップ S202 : No)、取得するまでステップ S202の処理が繰り返 される。 [0025] By performing the video display processing in this way, the video around the vehicle that changes every moment can be displayed on the display screen 103, so that the field of view of the user of the vehicle can be supplemented. If it is determined in step S202 that the information regarding the behavior of the vehicle is not acquired (step S202: No), the process of step S202 is repeated until it is acquired.

[0026] 以上説明したように、この発明の実施の形態に力かる映像表示装置によれば、複 数の情報で構成される車両の挙動に関する情報に基づいて、撮像された車両の周 囲の映像のうち、少なくとも一部を表示することができる。このため、車両の挙動に関 する情報を確実に取得して、車両のユーザなどが、反射鏡の映像だけでなく車両の 周囲の状況を視認することができるようになり、運転の安全性の向上を図ることができ る。  [0026] As described above, according to the video display apparatus according to the embodiment of the present invention, based on the information on the behavior of the vehicle composed of a plurality of pieces of information, the image of the surroundings of the vehicle is captured. At least a part of the video can be displayed. For this reason, it is possible to reliably acquire information on the behavior of the vehicle so that the user of the vehicle can view not only the image of the reflector but also the situation around the vehicle. Improvements can be made.

[0027] つぎに、この発明の実施の形態に力かる実施例 1および実施例 2について詳細に 説明する。ここでは、この実施の形態に力かる映像表示装置を、 自家用車に適用し た場合を例示して説明する。  [0027] Next, Example 1 and Example 2 that are useful for the embodiment of the present invention will be described in detail. Here, a case where the video display device which is useful in this embodiment is applied to a private car will be described as an example.

実施例 1  Example 1

[0028] (映像表示装置が搭載された車両内部の説明)  [0028] (Description of inside of vehicle equipped with video display device)

まず、この発明の実施例 1にかかる映像表示装置が搭載された車両内部について 説明する。図 3は、この発明の実施例 1にかかる映像表示装置が搭載された車両内 部の一例を示す説明図である。  First, the inside of a vehicle equipped with a video display apparatus according to Embodiment 1 of the present invention will be described. FIG. 3 is an explanatory diagram showing an example of the interior of the vehicle on which the video display apparatus according to Embodiment 1 of the present invention is mounted.

[0029] 図 3において、運転席シート 301および助手席シート 302の中央付近前方には、図 1における表示画面(ディスプレイ) 103を有するコンソールパネル車載機器 303が設 けられている。また、運転席シート 301および助手席シート 302の前方であって、 つ右反射鏡 (サイドミラー) 311および左反射鏡 (サイドミラー) 312の近傍には、それ ぞれ図 1における表示画面(ディスプレイ) 103がそれぞれ設けられている。  In FIG. 3, a console panel in-vehicle device 303 having a display screen (display) 103 in FIG. 1 is provided in front of the vicinity of the center of the driver seat 301 and the passenger seat 302. Further, in front of the driver's seat 301 and the passenger seat 302 and in the vicinity of the right reflector (side mirror) 311 and the left reflector (side mirror) 312 are the display screens (displays) shown in FIG. ) 103 are provided.

[0030] そして、車両内部の中央付近前方の天井部 313には、反射鏡 (ルームミラー) 314 が設けられ、運転席シート 301および助手席シート 302の両サイド(ドア側)には、ス ピー力 315がそれぞれ設けられている。なお、右サイドミラー 311および左サイドミラ 一 312の内部には、たとえば、車両の後方に向けられた図 1における撮像部(車載力 メラ) 101がそれぞれ設けられている。この撮像部 101は、図示しない車両の後部に 設けられたり、車両の前方に向けられたり、その他、種々の形態で搭載されていても よい。 [0030] A ceiling mirror 313 near the center inside the vehicle has a reflecting mirror (room mirror) 314. Speaking force 315 is provided on both sides (door side) of the driver seat 301 and the passenger seat 302, respectively. Note that, for example, the imaging unit (in-vehicle power camera) 101 in FIG. 1 facing the rear of the vehicle is provided inside the right side mirror 311 and the left side mirror 312, respectively. The imaging unit 101 may be provided at the rear of the vehicle (not shown), or may be directed to the front of the vehicle, or may be mounted in various forms.

[0031] (映像表示装置のハードウェア構成)  [0031] (Hardware configuration of video display device)

つぎに、この発明の実施例 1にかかる映像表示装置のハードウェア構成について 説明する。図 4は、この発明の実施例 1にかかる映像表示装置のハードウェア構成の 一例を示すブロック図である。  Next, a hardware configuration of the video display apparatus according to Embodiment 1 of the present invention will be described. FIG. 4 is a block diagram showing an example of the hardware configuration of the video display apparatus according to Embodiment 1 of the present invention.

[0032] 図 4において、映像表示装置は、図 1における表示制御部 104として機能する CP U401と、 RAM402と、 ROM403と、メモリ 404と、クロック 405とを含む構成となって いる。また、ユーザ操作部 410と、走行中の車両の速度を検出する速度センサ 411と 、車両の周囲を撮像する車載カメラ 412と、車両の傾斜角を検出する傾斜角センサ 4 13と、車両の加速度を検出する加速度センサ 414と、コーナリングの際の車両の角 速度を検出する角速度センサ 415と、コーナリングの際に遠心力によって発生する外 向きの力(重力)である横 Gを検出する横 Gセンサ 416とが、表示制御部 104に接続 されている。  In FIG. 4, the video display apparatus includes a CPU 401 that functions as the display control unit 104 in FIG. 1, a RAM 402, a ROM 403, a memory 404, and a clock 405. In addition, the user operation unit 410, a speed sensor 411 that detects the speed of the running vehicle, an in-vehicle camera 412 that images the surroundings of the vehicle, a tilt angle sensor 413 that detects the tilt angle of the vehicle, and the acceleration of the vehicle Acceleration sensor 414 that detects the angular velocity, angular velocity sensor 415 that detects the angular velocity of the vehicle during cornering, and lateral G sensor that detects lateral G that is an outward force (gravity) generated by centrifugal force during cornering 416 is connected to the display control unit 104.

[0033] また、人工衛星からの電波を受信することによって車両の現在地点情報 (緯度経度 情報)を検出する GPS417と、車両の進行方向を検出するジャイロセンサ 418とが表 示制御部 104に接続されている。これらの各センサ類 411および 413〜418によって 図 1における取得部 102の機能を実現する。また、車載カメラ 412によって図 1におけ る撮像部 101の機能を実現する。  [0033] In addition, a GPS 417 that detects current position information (latitude and longitude information) of a vehicle by receiving radio waves from an artificial satellite and a gyro sensor 418 that detects the traveling direction of the vehicle are connected to the display control unit 104. Has been. These sensors 411 and 413 to 418 realize the function of the acquisition unit 102 in FIG. In addition, the function of the imaging unit 101 in FIG.

[0034] この表示制御部 104には、図 1における表示画面 103として機能するディスプレイ 4 20と、このディスプレイ 420への映像の描画処理をおこなう映像回路 430と、さらには 、アンプ 421と、スピーカ 422とが表示制御部 104に接続されている。  The display control unit 104 includes a display 420 that functions as the display screen 103 in FIG. 1, a video circuit 430 that performs video rendering processing on the display 420, an amplifier 421, and a speaker 422. Are connected to the display control unit 104.

[0035] ここで、表示制御部 104は、映像回路 430に映像情報を出力し、ディスプレイ 420 を制御して、各センサ類 411および 413〜418によって取得された各情報に基づい て、車載カメラ 412によって撮像された車両の周囲の映像のうち、少なくとも一部の映 像を表示する。表示制御部 104の CPU401は、たとえば、映像表示装置全体の制 御を司り、制御プログラムにしたがって各種の演算処理を実行することにより、映像表 示装置が備える各部を統括的に駆動制御する。 Here, the display control unit 104 outputs video information to the video circuit 430, controls the display 420, and based on the information acquired by the sensors 411 and 413 to 418. Thus, at least a part of the image around the vehicle imaged by the in-vehicle camera 412 is displayed. For example, the CPU 401 of the display control unit 104 controls the entire video display device, and executes various arithmetic processes according to the control program, thereby performing overall drive control of each unit included in the video display device.

[0036] RAM402は、いわゆる可変的なデータを書き換え自在に記憶し、 CPU401のヮー クエリアなどとして使用される。この RAM402は、たとえば、電源 OFFによって記憶さ れたデータが消去される揮発性のメモリであっても良いし、バッテリなどによってバッ クアップされることによる不揮発性のメモリであっても良い。  The RAM 402 stores so-called variable data in a rewritable manner, and is used as a work area of the CPU 401 or the like. The RAM 402 may be, for example, a volatile memory that erases data stored when the power is turned off, or may be a non-volatile memory that is backed up by a battery or the like.

[0037] ROM403は、たとえば、ブートプログラムなどの、いわゆる固定的データを記憶し ている。ここでは、具体的には、映像表示装置の基本処理プログラムを記憶している 。 ROM403に記憶されたデータは、ユーザの操作によって書き換えることは可能で あるが、電源 OFFによって消去されることはないものとする。  [0037] The ROM 403 stores so-called fixed data such as a boot program, for example. Here, specifically, a basic processing program of the video display device is stored. The data stored in the ROM 403 can be rewritten by the user's operation, but is not erased by turning off the power.

[0038] メモリ 404は、各種情報を記憶する。具体的には、たとえば、ハードディスク(HD) であり、その代わりにあるいは HDに加えて、光ディスク(CD— ROM (CD— R、 CD -RW)、 MO、 DVD (Digital Versatile Disk) )や、メモリーカードなどの着脱可 能な記録媒体であってもよい。また、クロック 405は、現在時刻に関する情報を計時し 記憶する。  [0038] The memory 404 stores various types of information. Specifically, it is, for example, a hard disk (HD), instead of or in addition to HD, an optical disk (CD-ROM (CD-R, CD-RW), MO, DVD (Digital Versatile Disk)) or memory It may be a removable recording medium such as a card. The clock 405 measures and stores information related to the current time.

[0039] ユーザ操作部 410は、ユーザなどによる映像表示装置への操作入力を受け付ける 。このユーザ操作部 410は、たとえば、物理的な押下げ/非押下げを検出するスイツ チ、キーボード、タツチパネル、ジョイスティック、トラックボール、リモコン、映像表示装 置に備えられたボタン類などの公知の各種形態によって構成されたり、これらの組み 合わせによって構成されたりして、その機能を実現する。  [0039] User operation unit 410 receives an operation input to the video display device by a user or the like. This user operation unit 410 is, for example, a variety of known devices such as a switch for detecting physical depression / non-depression, a keyboard, a touch panel, a joystick, a trackball, a remote controller, and buttons provided on a video display device. It is configured by form or a combination of these to realize its functions.

[0040] ここで、たとえば、ユーザ操作部 410の形態としてタツチパネルを採用する場合、こ のタツチパネルはディスプレイ 420の表示画面側に積層して使用される。そして、ディ スプレイ 420における表示タイミングとタツチパネル (ユーザ操作部 410)に対する操 作入力タイミングおよびその位置座標とを、たとえば、表示制御部 104によって管理 することにより、入力された情報を認識する。  Here, for example, when a touch panel is adopted as a form of the user operation unit 410, the touch panel is used by being stacked on the display screen side of the display 420. Then, the display timing on the display 420, the operation input timing on the touch panel (user operation unit 410) and the position coordinates thereof are managed by the display control unit 104, for example, and the input information is recognized.

[0041] このように、ユーザ操作部 410の形態としてディスプレイ 420に積層されたタツチパ ネルを採用することにより、ユーザ操作部 410の形態を大型化することなぐ多くの操 作入力を行うことができる。なお、タツチパネルとしては、抵抗膜式、感圧式などの公 知の各種タツチパネルを用いることができる。 As described above, the touch panel stacked on the display 420 as a form of the user operation unit 410. By adopting the network, it is possible to perform many operation inputs without increasing the size of the user operation unit 410. As the touch panel, various known touch panels such as a resistance film type and a pressure sensitive type can be used.

[0042] なお、 GPS (Global Positioning System) 417は、図示しない GPSアンテナを 備えている。ここで、 GPSとは、 4つ以上の人工衛星からの電波を受信することによつ て地上での位置を正確に求めるシステムである。たとえば、 GPSアンテナによって得 られる GPS測位データおよび車両の進行方向の絶対方位データを、速度センサ 41 1、角速度センサ 415、走行距離センサ(図示せず)および傾斜角センサ 413などか ら得られる各情報を補正することによって、車両の現在地点情報を取得する。  Note that GPS (Global Positioning System) 417 is provided with a GPS antenna (not shown). GPS is a system that accurately determines the position on the ground by receiving radio waves from four or more artificial satellites. For example, the GPS positioning data obtained by the GPS antenna and the absolute direction data of the traveling direction of the vehicle are obtained from the speed sensor 411, the angular velocity sensor 415, the travel distance sensor (not shown), the inclination angle sensor 413, etc. Is corrected to obtain vehicle current point information.

[0043] この GPS417は、受信した電波を復調するチューナーや復調したデータに基づい て位置を算出する演算回路などを備えている。そして、 GPS417は、得られた車両の 現在地点情報を表示制御部 104に出力する。  [0043] The GPS 417 includes a tuner that demodulates received radio waves, an arithmetic circuit that calculates a position based on the demodulated data, and the like. The GPS 417 outputs the obtained current vehicle location information to the display control unit 104.

[0044] ディスプレイ 420は、表示制御部 104から出力され、映像回路 430によって描画処 理が施された映像情報に基づいて、車載カメラ 412によって撮像された車両の周囲 の映像を表示する。このディスプレイ 420は、具体的には、たとえば、 CRT (Cathod e Ray Tube)、液晶ディスプレイ、有機 ELディスプレイ、およびプラズマディスプレ ィなどのディスプレイ装置によって構成される。  The display 420 displays an image around the vehicle imaged by the in-vehicle camera 412 based on the video information output from the display control unit 104 and subjected to the drawing process by the video circuit 430. Specifically, the display 420 is configured by a display device such as a CRT (Cathode Ray Tube), a liquid crystal display, an organic EL display, and a plasma display.

[0045] アンプ 421は、スピーカ 422から出力される音声の出力を制御する。具体的には、 たとえば、音声の音量の調整ゃィコライジング処理などをおこなレ、、音声の出力状態 を制御する。このアンプ 421による音声の出力の制御は、たとえば、ユーザ操作部 41 0からの操作入力や表示制御部 104による制御によっておこなわれる。  The amplifier 421 controls output of sound output from the speaker 422. Specifically, for example, the sound volume adjustment or equalizing process is performed, and the sound output state is controlled. The control of the sound output by the amplifier 421 is performed by, for example, an operation input from the user operation unit 410 or a control by the display control unit 104.

[0046] スピーカ 422は、アンプ 421によって制御された音声を出力(再生)する。たとえば、 このスピーカ 422にヘッドホンを設け、車両の内部全体が出力される音声の音場とな らなレ、ように、音声の出力形態を変更するようにしてもょレ、。  The speaker 422 outputs (reproduces) the sound controlled by the amplifier 421. For example, this speaker 422 is provided with headphones, so that the sound output field is changed so that the entire interior of the vehicle becomes a sound field.

[0047] 通信インタフェース(IZF) 423は、たとえば、車両に搭載された ECU (Electronic  [0047] The communication interface (IZF) 423 is, for example, an ECU (Electronic

Control Unit)などの他の装置や、リモートコントローノレ機器などの他の機器と、 表示制御部 104との各種情報の送受信をおこなう。この IZF423における各種情報 の送受信は、たとえば、有線、無線を問わずおこなわれる。また、 I/F423は、図示 しない基地局を介して図示しない通信サーバと、公知の各方式の無線通信をおこな う機能を備えて構成されていてもよい。この場合、 I/F423は、外部の通信装置と無 線によってデータ通信をおこなう。 Various information is transmitted and received between the display control unit 104 and other devices such as the Control Unit) and other devices such as the remote control device. The transmission and reception of various types of information in IZF423 is performed regardless of whether it is wired or wireless. I / F423 is shown The communication server (not shown) via a base station that is not connected may have a function of performing wireless communication of each known method. In this case, the I / F 423 performs data communication with an external communication device by radio.

[0048] 映像回路 430は、車載カメラ 412で撮像され表示制御部 104から出力された車両 の周囲の映像の映像情報に基づいて、ディスプレイ 420上で最適に表示するように 描画処理などをおこなレ、、処理した映像情報をディスプレイ 420に出力する。この映 像回路 430は、具体的には、たとえば、ディスプレイ 420全体の制御をおこなうグラフ イツクコントローラと、即時表示可能な映像などの情報を一時的に記憶する VRAM ( Video RAM)などのバッファメモリと、グラフィックコントローラから出力される情報に 基づいて、ディスプレイ 420上での映像表示を制御する制御 ICや GPU (Graphics Processing Unit)などによって構成される。この映像回路 430は、表示制御部 10 4に含まれていてもよい。  [0048] The video circuit 430 performs drawing processing and the like so as to optimally display on the display 420 based on the video information of the video around the vehicle imaged by the in-vehicle camera 412 and output from the display control unit 104. The processed video information is output to the display 420. Specifically, the video circuit 430 includes, for example, a graphic controller that controls the entire display 420, a buffer memory such as a video RAM (VRAM) that temporarily stores information such as video that can be displayed immediately, and the like. Based on the information output from the graphics controller, it is composed of a control IC that controls video display on the display 420, a GPU (Graphics Processing Unit), and the like. The video circuit 430 may be included in the display control unit 104.

[0049] さらに、図示を省略するが、一般的な車載ナビゲーシヨン装置が備える地図 DB (D atabase)と、ナビゲーシヨン制御部と、位置認識部と、案内音出力部と、地点検索部 と、経路取得部と、経路誘導部と、案内音生成部と、を含む構成となっていてもよい。  [0049] Further, although not shown, a map DB (Database) provided in a general in-vehicle navigation device, a navigation control unit, a position recognition unit, a guidance sound output unit, a point search unit, The route acquisition unit, the route guidance unit, and the guidance sound generation unit may be included.

[0050] ここで、ナビゲーシヨン制御部は、位置認識部によって算出された自車位置情報と 、地図 DBとに基づいて、ディスプレイ 420へ地図上のどの位置を走行しているかを 出力する。案内音出力部は、アンプ 421を用いて 1つまたは複数のスピーカ 422へ の出力を制御することによって、案内音を再生する。  Here, the navigation control unit outputs which position on the map is traveling to the display 420 based on the vehicle position information calculated by the position recognition unit and the map DB. The guide sound output unit reproduces the guide sound by controlling the output to one or a plurality of speakers 422 using the amplifier 421.

[0051] ナビゲーシヨン制御部で用いられる地図 DBは、たとえば、メモリ 404にあらかじめ記 憶され、建物、河川、地表面などの地物(フィーチャ)をあらわす背景情報と、道路の 形状をあらわす道路形状情報とを有しており、ディスプレイ 420において 2次元また は 3次元に描画される。  [0051] The map DB used in the navigation control unit is stored in advance in the memory 404, for example, and includes background information that represents features (features) such as buildings, rivers, and the ground surface, and road shapes that represent the shape of the road. Information and is rendered in two or three dimensions on the display 420.

[0052] 背景情報は、背景の形状をあらわす背景形状情報と、背景の種別をあらわす背景 種別情報とを有する。背景形状情報は、たとえば、地物の代表点、ポリライン、ポリゴ ン、地物の座標などを示す情報を含む。背景種別情報は、たとえば、地物の名称や 住所や電話番号などを示すテキスト情報、建物'河川などの地物の種別を示す種別 情報などを含む。 [0053] 道路形状情報は、複数のノードおよびリンクを有する道路ネットワークに関する情報 である。ノードは、三叉路 '十字路'五叉路など複数の道路が交差する交差点を示す 情報である。リンクは、ノード間を連結する道路を示す情報である。リンクには、曲線 道路の表現を可能とする形状補完点を有するものもある。 [0052] The background information includes background shape information representing the shape of the background and background type information representing the type of the background. The background shape information includes, for example, information indicating feature points, polylines, polygons, feature coordinates, and the like. The background type information includes, for example, text information indicating the name, address, telephone number, and the like of the feature, type information indicating the type of the feature such as a building “river”, and the like. [0053] The road shape information is information related to a road network having a plurality of nodes and links. The node is information indicating an intersection where a plurality of roads intersect, such as a three-way “crossroad” and a five-way. A link is information indicating a road connecting nodes. Some links have shape interpolation points that allow the expression of curved roads.

[0054] 加えて、道路形状情報は、交通条件情報を有する。交通条件情報は、交差点の特 徴、各リンクの長さ(距離)、車幅、進行方向、通行禁止、道路種別などを示す情報で ある。交差点の特徴としては、たとえば、三叉路や五叉路などの複雑な交差点、浅い 角度で道路が分岐する交差点、 目的地点周辺の交差点、高速道路の出入り口ゃジ ヤンクシヨン、経路逸脱率の高い交差点などが挙げられる。なお、経路逸脱率は、た とえば、過去の走行履歴から算出することが可能である。そして、道路種別としては、 たとえば、高速道路、有料道路、一般道路などが挙げられる。  [0054] In addition, the road shape information includes traffic condition information. The traffic condition information is information indicating the characteristics of the intersection, the length (distance) of each link, the vehicle width, the traveling direction, the traffic prohibition, the road type, and the like. The characteristics of intersections include, for example, complex intersections such as three- and five-way intersections, intersections where roads diverge at shallow angles, intersections around destination points, highway entrances and exits, and intersections with a high route deviation rate. Can be mentioned. Note that the route departure rate can be calculated from, for example, past travel history. Examples of road types include expressways, toll roads, and general roads.

[0055] 地点検索部は、ユーザ操作部 410から操作入力された情報に基づいて、任意の地 点を検索し、これをディスプレイ 420へ出力する。また、経路取得部は、地点検索部 によって得られた地点情報に基づいて、当該地点までの最適な経路などを算出する 。また、経路誘導部は、経路取得部によって得られた情報と、自車位置情報とに基づ いて、リアルタイムな経路誘導情報の生成をおこなう。  The point search unit searches for an arbitrary point based on the information input from the user operation unit 410 and outputs it to the display 420. Further, the route acquisition unit calculates an optimal route to the point based on the point information obtained by the point search unit. In addition, the route guidance unit generates real-time route guidance information based on the information obtained by the route acquisition unit and the vehicle position information.

[0056] 案内音生成部は、案内パターンに対応したトーンと音声のデータを生成する。すな わち、経路情報に基づいて、案内ポイントに対応した仮想音源の設定と音声ガイダン ス情報の生成をおこなレ、、これを案内音出力部へ出力する。  The guidance sound generation unit generates tone and voice data corresponding to the guidance pattern. In other words, based on the route information, a virtual sound source corresponding to the guidance point is set and voice guidance information is generated, and this is output to the guidance sound output unit.

[0057] (映像表示装置の映像表示処理手順)  [0057] (Video Display Processing Procedure of Video Display Device)

つぎに、この発明の実施例 1にかかる映像表示装置の映像表示処理手順について 説明する。図 5は、この発明の実施例 1にかかる映像表示装置の映像表示処理手順 の一例を示すフローチャートである。ここでは、図 1における取得部 102によって取得 される車両の挙動に関する情報が、車両の速度に関する情報である場合の映像表 示処理について説明する。  Next, a video display processing procedure of the video display apparatus according to Embodiment 1 of the present invention will be described. FIG. 5 is a flowchart showing an example of a video display processing procedure of the video display apparatus according to Embodiment 1 of the present invention. Here, a video display process in a case where the information regarding the behavior of the vehicle acquired by the acquisition unit 102 in FIG. 1 is information regarding the speed of the vehicle will be described.

[0058] 図 5において、まず、表示制御部 104 (図 4参照、以下同じ)は、図 3における撮像 部 101としての車載カメラ 412 (図 4参照、以下同じ)によって撮像された車両の周囲 の映像を入力する(ステップ S501)。映像を入力したのち、表示制御部 104は、映像 回路 430 (図 4参照、以下同じ)を介して図 3における表示画面 103としてのディスプ レイ 420 (図 4参照、以下同じ)が ONであるか否かを判定する(ステップ S502)。 In FIG. 5, first, the display control unit 104 (refer to FIG. 4, the same applies hereinafter) is displayed on the periphery of the vehicle imaged by the in-vehicle camera 412 (refer to FIG. 4; the same applies hereinafter) as the imaging unit 101 in FIG. Video is input (step S501). After inputting the video, the display control unit 104 displays the video. It is determined whether or not the display 420 (see FIG. 4, the same applies hereinafter) as the display screen 103 in FIG. 3 is ON via the circuit 430 (see FIG. 4, the same applies hereinafter) (step S502).

[0059] 表示制御部 104によって、ディスプレイ 420が ONであると判定された場合 (ステツ プ S502 : Yes)、表示制御部 104は、速度センサ 411 (図 4参照、以下同じ)、傾斜角 センサ 413 (図 4参照、以下同じ)、加速度センサ 414 (図 4参照、以下同じ)、角速度 センサ 415 (図 4参照、以下同じ)、および横 Gセンサ 416 (図 4参照、以下同じ)によ つて得られた車両の挙動に関する情報のうち、速度センサ 411、加速度センサ 414 および角速度センサ 415によって得られた車両の速度に関する情報を取得する(ス テツプ S 503)。 [0059] When the display control unit 104 determines that the display 420 is ON (step S502: Yes), the display control unit 104 determines that the speed sensor 411 (see FIG. 4, the same applies hereinafter), the tilt angle sensor 413, and so on. (See Fig. 4, the same applies hereinafter), acceleration sensor 414 (see Fig. 4, same applies below), angular velocity sensor 415 (see Fig. 4, same applies below), and lateral G sensor 416 (see Fig. 4, same applies below) Among the obtained information on the behavior of the vehicle, information on the speed of the vehicle obtained by the speed sensor 411, the acceleration sensor 414, and the angular velocity sensor 415 is acquired (step S503).

[0060] 表示制御部 104によって、ディスプレイ 420が〇Nでないと判定された場合 (ステツ プ S502 : No)、表示制御部 104は、ステップ S502のディスプレイ 420が〇Nである か否かの判定処理を繰り返しおこなう。  [0060] When the display control unit 104 determines that the display 420 is not ◯ N (step S502: No), the display control unit 104 determines whether or not the display 420 in step S502 is ◯ N. Repeat.

[0061] 各センサ 411、 414および 415によって得られた速度に関する情報を取得したのち 、表示制御部 104は、メモリ 404 (図 4参照、以下同じ)に記憶された各種制御パラメ ータ類に基づいて、速度に関する情報が所定の閾値以上であるか否力を判定する( ステップ S504)。このステップ S504での判定処理は、たとえば、閾値が車速 = 30k m/hである場合に、速度に関する情報を分析した結果、車速がそれ以上であるか 否かを判定することによりおこなわれる。  [0061] After acquiring information about the speed obtained by each of the sensors 411, 414, and 415, the display control unit 104 is based on various control parameters stored in the memory 404 (see FIG. 4, the same applies hereinafter). Thus, it is determined whether or not the information regarding the speed is equal to or greater than a predetermined threshold (step S504). The determination process in step S504 is performed, for example, by determining whether or not the vehicle speed is higher than the result of analyzing information related to the speed when the threshold is the vehicle speed = 30 km / h.

[0062] 表示制御部 104によって、速度に関する情報が所定の閾値以上であると判定され た場合 (ステップ S504 : Yes)、表示制御部 104は、たとえば、車両の周囲の映像とし て得られた車両後方の映像(広角映像)の映像情報を映像回路 430 (図 4参照、以下 同じ)に出力し、映像回路 430を制御してディスプレイ 420への描画処理を施し、広 角映像の一部を切り出してディスプレイ 420上に表示する(ステップ S505)。  [0062] When the display control unit 104 determines that the information regarding the speed is equal to or greater than the predetermined threshold (step S504: Yes), the display control unit 104, for example, the vehicle obtained as an image around the vehicle. Video information of the rear video (wide-angle video) is output to the video circuit 430 (see Fig. 4; the same applies hereinafter), the video circuit 430 is controlled to perform drawing processing on the display 420, and a part of the wide-angle video is cut out Is displayed on the display 420 (step S505).

[0063] 表示制御部 104によって、速度に関する情報が所定の閾値以上でないと判定され た場合 (ステップ S504 : No)、表示制御部 104は、たとえば、車両の周囲の映像とし て得られた車両後方の映像(広角映像)の映像情報を映像回路 430に出力し、映像 回路 430を制御してディスプレイ 420への描画処理を施し、広角映像のすべてをディ スプレイ 420上に表示する(ステップ S507)。 [0064] ステップ S505において、ディスプレイ 420上に広角映像の一部を切り出して表示し たのち、表示制御部 104は、映像表示処理を中断するための、ユーザ操作部 410か らの操作入力があるか否かを判定する(ステップ S506)。表示制御部 104によって、 操作入力があると判定された場合(ステップ S506 : Yes)、ステップ S507に移行し、 表示制御部 104は、広角映像のすべてをディスプレイ 420上に表示する(ステップ S 507)。 [0063] When the display control unit 104 determines that the information regarding the speed is not equal to or greater than the predetermined threshold (step S504: No), the display control unit 104, for example, displays the rear of the vehicle obtained as an image around the vehicle. The video information of the video (wide-angle video) is output to the video circuit 430, and the video circuit 430 is controlled to perform drawing processing on the display 420, so that all of the wide-angle video is displayed on the display 420 (step S507). [0064] In step S505, after a part of the wide-angle video is cut out and displayed on the display 420, the display control unit 104 has an operation input from the user operation unit 410 for interrupting the video display processing. Whether or not (step S506). If the display control unit 104 determines that there is an operation input (step S506: Yes), the process proceeds to step S507, and the display control unit 104 displays all of the wide-angle video on the display 420 (step S507). .

[0065] 表示制御部 104によって、操作入力がないと判定された場合 (ステップ S506 : No) 、ステップ S504に戻り、表示制御部 104は、速度に関する情報が所定の閾値以上で あるか否かの判定処理をおこなう(ステップ S504)。すなわち、この映像表示処理で は、たとえば、閾値が車速 = 30km/hである場合に、車速がそれ以上であるとき(ス テツプ S504 :Yes)は、広角映像の一部を切り出して表示し、車速がそれ未満である とき(ステップ S504 : No)は、広角映像のすべてを表示する処理が、表示制御部 10 4によっておこなわれる。  [0065] When the display control unit 104 determines that there is no operation input (step S506: No), the process returns to step S504, and the display control unit 104 determines whether or not the information regarding the speed is equal to or greater than a predetermined threshold value. Judgment processing is performed (step S504). That is, in this video display process, for example, when the threshold is vehicle speed = 30 km / h and the vehicle speed is higher (step S504: Yes), a part of the wide-angle video is cut out and displayed. When the vehicle speed is less than that (step S504: No), the display control unit 104 performs processing to display all of the wide-angle video.

[0066] ステップ S507において、ディスプレイ 420上に広角映像のすべてを表示したのち、 表示制御部 104は、映像回路 430を介してディスプレイ 420が OFFであるか否かを 判定する(ステップ S508)。表示制御部 104によって、ディスプレイ 420が OFFであ ると判定された場合 (ステップ S508 : Yes)、表示制御部 104は、本フローチャートに よる一連の映像表示処理を終了する。  [0066] In step S507, after displaying all of the wide-angle video on the display 420, the display control unit 104 determines whether or not the display 420 is OFF via the video circuit 430 (step S508). When the display control unit 104 determines that the display 420 is OFF (step S508: Yes), the display control unit 104 ends a series of video display processing according to this flowchart.

[0067] 一方、表示制御部 104によって、ディスプレイ 420が OFFでないと判定された場合  [0067] On the other hand, when the display control unit 104 determines that the display 420 is not OFF

(ステップ S508 : No)、ステップ S507に戻り、表示制御部 104は、広角映像のすべ てをディスプレイ 420上に表示し (ステップ S507)、ステップ S508に移行して、デイス プレイ 420が OFFであるか否かの判定処理をおこなう(ステップ S 508)。  (Step S508: No), the process returns to Step S507, and the display control unit 104 displays all of the wide-angle video on the display 420 (Step S507) .The process proceeds to Step S508, and whether the display 420 is OFF. A determination process of whether or not is performed (step S508).

[0068] ここで、ステップ S505における、映像表示処理について説明する。図 6〜図 11は、 この発明の実施例 1にかかる映像表示装置の映像表示処理を説明するための図で ある。図 6において、たとえば、図 3における車両の右サイドミラー 311の内部、左サイ ドミラー 312の内部、および図示しない車両の後方に搭載された撮像部 101 (図 4に おいては、車載カメラ 412)が撮像した車両の周囲の映像 (広角映像)を、図 6に示す ものとする。この図 6に示す映像は、たとえば、図 3におけるコンソールパネル車載機 器 303の表示画面 103 (図 4においては、ディスプレイ 420)上に表示される。 [0068] Here, the video display processing in step S505 will be described. 6 to 11 are diagrams for explaining the video display processing of the video display apparatus according to Embodiment 1 of the present invention. In FIG. 6, for example, the imaging unit 101 mounted in the right side mirror 311 of the vehicle in FIG. 3, the inside of the left side mirror 312 and the rear of the vehicle (not shown in FIG. Figure 6 shows an image of the surroundings of the vehicle (wide-angle image) captured by. The video shown in FIG. 6 is, for example, the console panel in-vehicle device in FIG. It is displayed on the display screen 103 (display 420 in FIG. 4) of the device 303.

[0069] そして、たとえば、右サイドミラー 311に映っている映像力 図 7に示すものであると したとき、表示制御部 104 (図 4参照)は、ステップ S505において、図 6に示す映像の 一部を切り出して、図 3における運転席シート 301の前方右サイドミラー 311の近傍 位置の表示画面 103 (図 4においては、ディスプレイ 420)上に、図 8に示す映像を表 示すること力 Sできる。 [0069] Then, for example, when it is assumed that the image power shown in the right side mirror 311 is as shown in FIG. 7, the display control unit 104 (see FIG. 4) displays one of the images shown in FIG. 6 in step S505. The ability to display the image shown in FIG. 8 on the display screen 103 (display 420 in FIG. 4) in the vicinity of the front right side mirror 311 of the driver's seat 301 in FIG. .

[0070] これにより、たとえば、図 9に示すように、運転者が右サイドミラー 311 (図 3参照)で 確認できる後方視界力 斜線で示す範囲 Aである場合であっても、図 10に示すよう に、合流地点において、運転者は範囲 Aの映像のみならず、点斜線で示す範囲 Bの 映像を、右サイドミラー 311の近傍位置の表示画面 103 (図 4においては、ディスプレ ィ 420)上で確認することができる。  Thus, for example, as shown in FIG. 9, the rear view force that the driver can confirm with the right side mirror 311 (see FIG. 3) is shown in FIG. Thus, at the junction, the driver displays not only the image of range A but also the image of range B indicated by the dotted diagonal line on display screen 103 (display 420 in FIG. 4) near the right side mirror 311. Can be confirmed.

[0071] 同様に、図 11に示すように、たとえば、車線変更において、運転者は範囲 Aの映像 のみならず、範囲 Bの映像を、右サイドミラー 311の近傍位置の表示画面 103 (図 4 においては、ディスプレイ 420)上で確認することもできる。このため、合流地点や車 線変更などの危険を伴う運転の際にも、運転者が図 3における各ミラー 311、 312、 および 314の映像だけでなぐ車両の周囲の状況を視認することができ、安全性の向 上を図ることができる。  Similarly, as shown in FIG. 11, for example, when changing lanes, the driver displays not only the image of range A but also the image of range B on display screen 103 in the vicinity of right side mirror 311 (FIG. 4). In this case, it can be confirmed on the display 420). For this reason, even when driving at risk such as merging points or lane changes, the driver can see the situation around the vehicle only with the images of the mirrors 311, 312, and 314 in Fig. 3. Therefore, safety can be improved.

[0072] なお、表示制御部 104および映像回路 430によって、公知の種々の技術により、撮 像した車両の周囲の映像のうち、少なくとも一部を表示画面 103上に、いわゆる拡大 表示したり、分割表示したり、あるいは、色彩などの各種表示形態を変更して表示し たりすることも可能である。  [0072] It is to be noted that display control unit 104 and video circuit 430 use a variety of well-known techniques to display at least a part of a video image of the surroundings of the vehicle on display screen 103, so-called enlarged display or division. It is also possible to display or change various display forms such as colors.

[0073] 以上説明したように、実施例 1にかかる映像表示装置は、図 4における各センサ 41 1および 413〜416によって取得された車両の挙動に関する情報力 車両の速度に 関する情報である場合に、所定の閾値以上の場合は車両の周囲の映像の少なくとも 一部を切り出して図 4におけるディスプレイ 420上に表示し、所定の閾値未満の場合 はそのまま表示することができる。  [0073] As described above, the video display apparatus according to the first embodiment has the information power regarding the vehicle behavior acquired by the sensors 4111 and 413 to 416 in FIG. If it is equal to or greater than the predetermined threshold, at least a part of the image around the vehicle can be cut out and displayed on the display 420 in FIG.

[0074] 表示変更の切り替えは、図 4におけるユーザ操作部 410からの操作入力やステップ S504における閾値判定処理によっておこなうことができる。このため、車両の運転者 などが、反射鏡の映像だけでなく車両の周囲の状況(映像)を、様々な運転状況下に おいて、意識せずに瞬時かつ容易に視認することができるようになり、運転の安全性 の向上を図ることができる。 [0074] The display change can be switched by an operation input from the user operation unit 410 in FIG. 4 or a threshold determination process in step S504. For this reason, the driver of the vehicle As a result, not only the image of the reflector but also the situation (image) around the vehicle can be seen instantly and easily without being aware of it under various driving conditions. Can be improved.

実施例 2  Example 2

[0075] つぎに、実施例 2にかかる映像表示装置について説明する。実施例 1にかかる映像 表示装置では、図 1における取得部 102によって取得される車両の挙動に関する情 報が、車両の速度に関する情報である場合に、それが所定の閾値以上であるか否か を判定して、所定の閾値以上の場合に、撮像した映像の一部を切り出して表示し、運 転の安全性の向上を図る構成とした。  [0075] Next, a video display apparatus according to Example 2 will be described. In the video display device according to the first embodiment, if the information on the behavior of the vehicle acquired by the acquisition unit 102 in FIG. When it is determined that the threshold is equal to or greater than a predetermined threshold, a part of the captured video is cut out and displayed to improve the safety of operation.

[0076] 一方、実施例 2にかかる映像表示装置では、図 1における取得部 102によって取得 される車両の挙動に関する情報が、車両の現在地点情報である場合に、その現在地 点情報が特定地点を示す地点情報であるか否かを判定して、特定地点を示す地点 情報である場合に、撮像した映像の一部を切り出して表示する構成を採用する。な お、実施例 2のハードウェア構成については、実施例 1と同様であるため、以下の説 明においては図 4と同様の符号を用レ、、図示および説明は省略する。  On the other hand, in the video display device according to the second embodiment, when the information on the behavior of the vehicle acquired by the acquisition unit 102 in FIG. 1 is the current location information of the vehicle, the current location information indicates the specific location. A configuration is adopted in which it is determined whether or not it is point information to be shown, and when it is point information indicating a specific point, a part of the captured video is cut out and displayed. Since the hardware configuration of the second embodiment is the same as that of the first embodiment, the same reference numerals as those in FIG. 4 are used in the following description, and illustration and description thereof are omitted.

[0077] (映像表示装置の映像表示処理手順) [0077] (Video Display Processing Procedure of Video Display Device)

以下、実施例 2にかかる映像表示装置の映像表示処理手順について説明する。図 12は、実施例 2にかかる映像表示装置の映像表示処理手順を示すフローチャートで ある。図 12において、まず、表示制御部 104は、図 3における撮像部 101としての車 載カメラ 412によつて撮像された車両の周囲の映像を入力する(ステップ S 1201)。 映像を入力したのち、表示制御部 104は、映像回路 430を介して図 3における表示 画面 103としてのディスプレイ 420が ONであるか否かを判定する(ステップ S1202)  The video display processing procedure of the video display apparatus according to the second embodiment will be described below. FIG. 12 is a flowchart of the video display processing procedure of the video display apparatus according to the second embodiment. In FIG. 12, first, the display control unit 104 inputs an image of the surroundings of the vehicle imaged by the in-vehicle camera 412 as the imaging unit 101 in FIG. 3 (step S 1201). After inputting the video, the display control unit 104 determines whether or not the display 420 as the display screen 103 in FIG. 3 is ON via the video circuit 430 (step S1202).

[0078] そして、表示制御部 104によって、ディスプレイ 420が ONであると判定された場合( ステップ S1202 : Yes)、表示制御部 104は、 GPS417 (図 4参照、以下同じ)によつ て得られた車両の現在地点情報を取得する(ステップ S1203)。一方、表示制御部 1 04によって、ディスプレイ 420が ONでないと判定された場合(ステップ S1202 : No) 、表示制御部 104は、ステップ S 1202のディスプレイ 420が ONであるか否かの判定 処理を繰り返しおこなう。 [0078] When the display control unit 104 determines that the display 420 is ON (step S1202: Yes), the display control unit 104 is obtained by the GPS417 (see FIG. 4, the same applies hereinafter). The current location information of the acquired vehicle is acquired (step S1203). On the other hand, when the display control unit 104 determines that the display 420 is not ON (step S1202: No), the display control unit 104 determines whether the display 420 in step S1202 is ON. Repeat the process.

[0079] つぎに、 GPS417によって得られた車両の現在地点情報を取得したのち、表示制 御部 104は、メモリ 404に記憶された各種制御パラメータ類や地図情報などに基づ いて、現在地点情報が特定地点を示す地点情報であるか否かを判定する(ステップ S1204)。  [0079] Next, after acquiring the current position information of the vehicle obtained by the GPS 417, the display control unit 104 determines the current position information based on various control parameters and map information stored in the memory 404. It is determined whether or not the point information indicates a specific point (step S1204).

[0080] ここで、特定地点とは、高速道路や駐車場などの運転者の視界をできる限り広げた い地点のことをレ、い、このステップ S 1204での判定処理は、たとえば、現在地点情報 が現在地点 =高速道路であるか否力 ^判定することによりおこなわれる。なお、特定 地点でないとは、たとえば、一般道であるとする。  [0080] Here, the specific point is a point where the driver's field of view such as an expressway or a parking lot is to be expanded as much as possible, and the determination process in step S1204 is, for example, the current point. This is done by judging whether the current location = highway or not. For example, it is assumed that it is a general road if it is not a specific point.

[0081] また、表示制御部 104によって、現在地点情報が特定地点を示す地点情報である と判定された場合 (ステップ S1204 : Yes)、表示制御部 104は、たとえば、車両の周 囲の映像として得られた車両後方の映像 (広角映像)の映像情報を映像回路 430に 出力し、映像回路 430を制御してディスプレイ 420への描画処理を施し、広角映像の 一部を切り出してディスプレイ 420上に表示する(ステップ S1205)。  [0081] When the display control unit 104 determines that the current point information is point information indicating a specific point (step S1204: Yes), the display control unit 104, for example, displays an image around the vehicle. The obtained video information of the rear of the vehicle (wide-angle video) is output to the video circuit 430, and the video circuit 430 is controlled to perform drawing processing on the display 420, and a part of the wide-angle video is cut out on the display 420. It is displayed (step S1205).

[0082] また、表示制御部 104によって、現在地点情報が特定地点を示す地点情報でない と判定された場合 (ステップ S1204 : No)、表示制御部 104は、たとえば、車両の周 囲の映像として得られた車両後方の映像 (広角映像)の映像情報を映像回路 430に 出力し、映像回路 430を制御してディスプレイ 420への描画処理を施し、広角映像の すべてをディスプレイ 420上に表示する(ステップ S 1207)。  [0082] If the display control unit 104 determines that the current point information is not point information indicating a specific point (step S1204: No), the display control unit 104 obtains, for example, an image of the surroundings of the vehicle. The video information of the rear of the vehicle (wide-angle video) is output to the video circuit 430, and the video circuit 430 is controlled to perform drawing processing on the display 420, so that all of the wide-angle video is displayed on the display 420 (step S 1207).

[0083] ステップ S 1205において、ディスプレイ 420上に広角映像の一部を切り出して表示 したのち、表示制御部 104は、映像表示処理を中断するための、ユーザ操作部 410 力 の操作入力があるか否かを判定する(ステップ S 1206)。表示制御部 104によつ て、操作入力があると判定された場合(ステップ S1206 : Yes)、ステップ S1207に移 行し、表示制御部 104は、広角映像のすべてをディスプレイ 420上に表示する(ステ ップ S 1207)。  [0083] In step S1205, after a part of the wide-angle video is cut out and displayed on the display 420, the display control unit 104 determines whether there is an operation input of the user operation unit 410 force to interrupt the video display processing. It is determined whether or not (step S 1206). If the display control unit 104 determines that there is an operation input (step S1206: Yes), the process proceeds to step S1207, and the display control unit 104 displays all of the wide-angle video on the display 420 ( Step S 1207).

[0084] また、表示制御部 104によって、操作入力がないと判定された場合 (ステップ S120 6 : No)、ステップ S1204に戻り、表示制御部 104は、現在地点情報が特定地点を示 す地点情報であるか否かの判定処理をおこなう(ステップ S1204)。すなわち、この映 像表示処理では、たとえば、現在地点情報が現在地点 =高速道路である場合 (ステ ップ S1204 :Yes)には、広角映像の一部を切り出して表示し、現在地点情報が現在 地点 =一般道である場合 (ステップ S 1204 : No)は、広角映像のすべてを表示する 処理が、表示制御部 104によっておこなわれる。 [0084] If the display control unit 104 determines that there is no operation input (step S120 6: No), the process returns to step S1204, and the display control unit 104 displays point information indicating that the current point information indicates a specific point. Whether or not is determined is performed (step S1204). That is, this movie In the image display process, for example, if the current location information is current location = highway (step S1204: Yes), a part of the wide-angle video is cut out and displayed, and the current location information is current location = general road. If it is (step S 1204: No), the display control unit 104 performs processing to display all of the wide-angle video.

[0085] ステップ S1207におレ、て、ディスプレイ 420上に広角映像のすべてを表示したのち 、表示制御部 104は、映像回路 430を介してディスプレイ 420が OFFであるか否か を判定する(ステップ S1208)。表示制御部 104によって、ディスプレイ 420が OFFで あると判定された場合 (ステップ S1208 : Yes)、表示制御部 104は、本フローチヤ一 トによる一連の映像表示処理を終了する。  [0085] After displaying all of the wide-angle video on the display 420 in step S1207, the display control unit 104 determines whether the display 420 is OFF via the video circuit 430 (step S1207). S1208). If the display control unit 104 determines that the display 420 is OFF (step S1208: Yes), the display control unit 104 ends a series of video display processing according to this flowchart.

[0086] 一方、表示制御部 104によって、ディスプレイ 420が OFFでないと判定された場合  [0086] On the other hand, when the display control unit 104 determines that the display 420 is not OFF

(ステップ S1208 : No)、ステップ S1207に戻り、表示制御部 104は、広角映像のす ベてをディスプレイ 420上に表示し (ステップ S 1207)、ステップ S 1208に移行して、 ディスプレイ 420が OFFであるか否かの判定処理をおこなう(ステップ S 1208)。なお 、この実施例 2の映像表示装置におけるステップ S 1205での具体的な映像表示処理 は、実施例 1で図 6〜図 11を用いて説明したものと同様であるため、ここでは説明を 省略する。  (Step S1208: No), returning to Step S1207, the display control unit 104 displays all of the wide-angle video on the display 420 (Step S1207), proceeds to Step S1208, and the display 420 is OFF. A process for determining whether or not there is present is performed (step S1208). The specific video display processing in step S 1205 in the video display device of the second embodiment is the same as that described with reference to FIGS. 6 to 11 in the first embodiment, and thus the description thereof is omitted here. To do.

[0087] 以上説明したように、実施例 2にかかる映像表示装置は、図 4における GPS417に よって取得された車両の現在地点情報が、高速道路などの特定地点を示す地点情 報である場合に、車両の周囲の映像の少なくとも一部を切り出して図 4におけるディ スプレイ 420上に表示し、特定地点を示す地点情報でない場合はそのまま表示する こと力 Sできる。  [0087] As described above, the video display apparatus according to the second embodiment has the case where the current location information of the vehicle acquired by the GPS 417 in Fig. 4 is location information indicating a specific location such as an expressway. In addition, it is possible to cut out at least a part of the video around the vehicle and display it on the display 420 in FIG. 4, and display it as it is if it is not point information indicating a specific point.

[0088] 表示変更の切り替えは、図 4におけるユーザ操作部 410からの操作入力やステップ S1204における地点情報判定処理によっておこなうことができる。このため、車両の 運転者などが、反射鏡の映像だけでなく車両の周囲の状況(映像)を、様々な場所に おいて、意識せずに瞬時かつ容易に視認することができるようになり、運転の安全性 の向上を図ることができる。  The display change can be switched by an operation input from the user operation unit 410 in FIG. 4 or a point information determination process in step S1204. This makes it possible for a vehicle driver to view not only the image of the reflector but also the situation around the vehicle (video) instantly and easily in various places without being aware of it. Therefore, driving safety can be improved.

[0089] 以上のように、この発明にかかる映像表示装置、映像表示方法、映像表示プロダラ ム、およびこのプログラムを記録したコンピュータに読み取り可能な記録媒体によれ ば、車両の速度に関する情報や現在地点情報などの複数の情報で構成される車両 の挙動に関する情報に基づいて、撮像された車両の周囲の映像のうち、少なくとも一 部を表示画面に表示することができる。 As described above, according to the video display device, the video display method, the video display program, and the computer-readable recording medium recording the program according to the present invention. For example, at least a part of the captured image around the vehicle is displayed on the display screen based on information on the behavior of the vehicle composed of information on the vehicle speed and current location information. Can do.

[0090] このため、車両の挙動に関する情報を確実に取得して、車両のユーザなどが、反射 鏡の映像だけでなく車両の周囲の状況(映像)を瞬時に、安全、確実かつ容易に視 認することができるようになり、様々な場所や運転状況下での運転の安全性の向上を 図ることができるという効果を奏する。  [0090] For this reason, information on the behavior of the vehicle is reliably acquired, and the vehicle user can view not only the image of the reflector but also the situation (image) around the vehicle instantaneously, safely, reliably and easily. This has the effect of improving the safety of driving in various places and driving situations.

[0091] なお、本実施の形態で説明した映像表示方法は、予め用意されたプログラムをパ 一ソナル ·コンピュータなどのコンピュータで実行することにより実現することができる Note that the video display method described in the present embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer.

。このプログラムは、ハードディスク、フレキシブルディスク、 CD— ROM、 M〇、 DVD などのコンピュータで読み取り可能な記録媒体に記録され、コンピュータによって記 録媒体から読み出されることによって実行される。また、このプログラムは、インターネ ットなどのネットワークを介して配布することが可能な伝送媒体であっても良い。 . This program is recorded on a computer-readable recording medium such as a hard disk, flexible disk, CD-ROM, M0, or DVD, and is executed by being read from the recording medium by the computer. The program may be a transmission medium that can be distributed via a network such as the Internet.

Claims

請求の範囲 The scope of the claims [1] 車両の周囲を撮像する撮像手段と、 [1] imaging means for imaging the surroundings of the vehicle; 前記車両の挙動に関する情報を取得する取得手段と、  Obtaining means for obtaining information on the behavior of the vehicle; 表示画面を有する表示手段と、  Display means having a display screen; 前記表示画面を制御して、前記取得手段によって取得された挙動に関する情報に 基づいて、前記撮像手段によって撮像された前記車両の周囲の映像のうち少なくと も一部の映像を表示する表示制御手段と、  Display control means for controlling the display screen to display at least a part of the video around the vehicle imaged by the imaging means based on information on the behavior acquired by the acquisition means. When, を備えることを特徴とする映像表示装置。  A video display device comprising: [2] 前記取得手段は、前記車両の挙動に関する情報として、前記車両の速度に関する 情報を取得し、  [2] The acquisition means acquires information regarding the speed of the vehicle as information regarding the behavior of the vehicle, 前記表示制御手段は、前記取得手段によって取得された速度に関する情報が所 定の閾値以上の場合、前記映像のうち少なくとも一部の映像を表示することを特徴と する請求項 1に記載の映像表示装置。  2. The video display according to claim 1, wherein the display control unit displays at least a part of the video when the information about the speed acquired by the acquisition unit is equal to or greater than a predetermined threshold. apparatus. [3] 前記取得手段は、前記車両の挙動に関する情報として、前記車両の現在地点情 報を取得し、 [3] The acquisition means acquires the current position information of the vehicle as information on the behavior of the vehicle, 前記表示制御手段は、前記取得手段によって取得された現在地点情報が特定地 点を示す地点情報である場合、前記映像のうち少なくとも一部の映像を表示すること を特徴とする請求項 1または 2に記載の映像表示装置。  The display control means displays at least a part of the video when the current point information acquired by the acquisition means is point information indicating a specific point. The video display device described in 1. [4] 車両の周囲の映像の入力を受け付ける入力工程と、 [4] An input process for receiving input of images around the vehicle, 前記車両の挙動に関する情報を取得する取得工程と、  An acquisition step of acquiring information relating to the behavior of the vehicle; 前記取得工程によって取得された挙動に関する情報に基づいて、前記入力工程に よって入力された映像のうち少なくとも一部の映像を表示画面に表示する表示工程と を含んだことを特徴とする映像表示方法。  A display step of displaying at least a portion of the video input by the input step on a display screen based on information on the behavior acquired by the acquisition step. . [5] 前記取得工程は、前記車両の挙動に関する情報として、前記車両の速度に関する 情報を取得し、 [5] The acquisition step acquires information on the speed of the vehicle as information on the behavior of the vehicle, 前記表示工程は、前記取得工程によって取得された速度に関する情報が所定の 閾値以上の場合、前記映像のうち少なくとも一部の映像を表示することを特徴とする 請求項 4に記載の映像表示方法。 The display step displays at least a part of the video when the information about the speed acquired in the acquisition step is equal to or greater than a predetermined threshold. The video display method according to claim 4. [6] 前記取得工程は、前記車両の挙動に関する情報として、前記車両の現在地点情 報を取得し、 [6] The acquisition step acquires the current position information of the vehicle as information on the behavior of the vehicle, 前記表示工程は、前記取得工程によって取得された現在地点情報が特定地点を 示す地点情報である場合、前記映像のうち少なくとも一部の映像を表示することを特 徴とする請求項 4または 5に記載の映像表示方法。  6. The display step according to claim 4 or 5, wherein when the current location information acquired by the acquisition step is location information indicating a specific location, at least a part of the video is displayed. The video display method described. [7] 請求項 4〜6のいずれか一つに記載の映像表示方法をコンピュータに実行させるこ とを特徴とする映像表示プログラム。 7. A video display program that causes a computer to execute the video display method according to any one of claims 4 to 6. [8] 請求項 7に記載の映像表示プログラムを記録したことを特徴とするコンピュータに読 み取り可能な記録媒体。 [8] A computer-readable recording medium in which the video display program according to claim 7 is recorded.
PCT/JP2006/303991 2005-03-18 2006-03-02 Video display device, video display method, video display program, and computer-readable recording medium having the program recorded thereon Ceased WO2006100884A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2005-080756 2005-03-18
JP2005080756 2005-03-18

Publications (1)

Publication Number Publication Date
WO2006100884A1 true WO2006100884A1 (en) 2006-09-28

Family

ID=37023560

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2006/303991 Ceased WO2006100884A1 (en) 2005-03-18 2006-03-02 Video display device, video display method, video display program, and computer-readable recording medium having the program recorded thereon

Country Status (1)

Country Link
WO (1) WO2006100884A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016505450A (en) * 2013-01-29 2016-02-25 ローベルト ボッシュ ゲゼルシャフト ミット ベシュレンクテル ハフツング VEHICLE CAMERA SYSTEM, METHOD AND DEVICE FOR CONTROLLING IMAGE AREA OF IMAGES OF VEHICLE VEHICLE
JP2017163399A (en) * 2016-03-10 2017-09-14 株式会社Jvcケンウッド Vehicle display controller, vehicle display system, vehicle display control method, and program
US20230132456A1 (en) * 2021-10-29 2023-05-04 Canon Kabushiki Kaisha Image processing device, mobile object, image processing method, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000207696A (en) * 1999-01-18 2000-07-28 Sharp Corp In-vehicle camera device
JP2001055100A (en) * 1999-08-18 2001-02-27 Matsushita Electric Ind Co Ltd Multi-function vehicle camera system and image display method of multi-function vehicle camera
JP2002019556A (en) * 2000-07-04 2002-01-23 Matsushita Electric Ind Co Ltd Monitoring system
JP2004312523A (en) * 2003-04-09 2004-11-04 Equos Research Co Ltd In-vehicle image processing device
JP2004322797A (en) * 2003-04-24 2004-11-18 Mitsubishi Motors Corp Nose view device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000207696A (en) * 1999-01-18 2000-07-28 Sharp Corp In-vehicle camera device
JP2001055100A (en) * 1999-08-18 2001-02-27 Matsushita Electric Ind Co Ltd Multi-function vehicle camera system and image display method of multi-function vehicle camera
JP2002019556A (en) * 2000-07-04 2002-01-23 Matsushita Electric Ind Co Ltd Monitoring system
JP2004312523A (en) * 2003-04-09 2004-11-04 Equos Research Co Ltd In-vehicle image processing device
JP2004322797A (en) * 2003-04-24 2004-11-18 Mitsubishi Motors Corp Nose view device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016505450A (en) * 2013-01-29 2016-02-25 ローベルト ボッシュ ゲゼルシャフト ミット ベシュレンクテル ハフツング VEHICLE CAMERA SYSTEM, METHOD AND DEVICE FOR CONTROLLING IMAGE AREA OF IMAGES OF VEHICLE VEHICLE
CN105432074A (en) * 2013-01-29 2016-03-23 罗伯特·博世有限公司 Camera system for a vehicle, and method and device for controlling an image region of an image of a vehicle camera for a vehicle
JP2017163399A (en) * 2016-03-10 2017-09-14 株式会社Jvcケンウッド Vehicle display controller, vehicle display system, vehicle display control method, and program
US20230132456A1 (en) * 2021-10-29 2023-05-04 Canon Kabushiki Kaisha Image processing device, mobile object, image processing method, and storage medium
US12361724B2 (en) * 2021-10-29 2025-07-15 Canon Kabushiki Kaisha Image processing device, mobile object, image processing method, and storage medium

Similar Documents

Publication Publication Date Title
JP5461065B2 (en) Current position specifying device and current position specifying method
JP4923647B2 (en) Driving support image display device and program
US7304653B2 (en) Display apparatus and method for altering display elements based on viewpoint
JP4352092B1 (en) Speed alarm device
JP4489447B2 (en) In-vehicle navigation device and method for displaying 3D map thereof
WO2008020517A1 (en) Navigation device, navigation server, and navigation system
JP2002311821A (en) Map display method and navigation device for navigation
JP2023012793A (en) Superimposed image display device
JP2010003086A (en) Drive recorder
JP4799565B2 (en) Information recording apparatus, information recording method, information recording program, and computer-readable recording medium
US20070115433A1 (en) Communication device to be mounted on automotive vehicle
JP5156307B2 (en) In-vehicle camera system
JP2882251B2 (en) Route guidance device
JP2007148901A (en) Traffic congestion information display device
WO2006100884A1 (en) Video display device, video display method, video display program, and computer-readable recording medium having the program recorded thereon
JP2005249485A (en) Voice guidance method of onboard navigation system
JP4421410B2 (en) Driving support information providing apparatus and method
JP4572235B2 (en) POSITION SETTING DEVICE, POSITION SETTING METHOD, POSITION SETTING PROGRAM, AND RECORDING MEDIUM
JP2011179854A (en) Device, method and program for map display
JP2006275823A (en) Image display, image display method, image display program, and recording medium
JP2006177814A (en) Information providing device
JP4940587B2 (en) Road imaging device
JP4530424B2 (en) Navigation device and estimated arrival time calculation method
WO2008053533A1 (en) Map display device, map display method, map display program, and recording medium
WO2008056401A1 (en) Map display device, map display method, map display program, and recording medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 06715100

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP