US20150367859A1 - Input device for a motor vehicle - Google Patents
Input device for a motor vehicle Download PDFInfo
- Publication number
- US20150367859A1 US20150367859A1 US14/654,491 US201314654491A US2015367859A1 US 20150367859 A1 US20150367859 A1 US 20150367859A1 US 201314654491 A US201314654491 A US 201314654491A US 2015367859 A1 US2015367859 A1 US 2015367859A1
- Authority
- US
- United States
- Prior art keywords
- sensor
- circuit
- input device
- display
- hand gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/10—Interpretation of driver requests or demands
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/213—Virtual instruments
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/23—Head-up displays [HUD]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K37/00—Dashboards
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
- B60R11/0229—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/365—Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/09623—Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
- H04M1/6033—Substation equipment, e.g. for use by subscribers including speech amplifiers for providing handsfree use or a loudspeaker mode in telephone sets
- H04M1/6041—Portable telephones adapted for handsfree use
- H04M1/6075—Portable telephones adapted for handsfree use adapted for handsfree use in a vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/54—Arrangements for diverting calls for one subscriber to another predetermined subscriber
- H04M3/543—Call deflection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
- H04N13/279—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/16—Communication-related supplementary services, e.g. call-transfer or call-hold
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- B60K2350/1052—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/146—Instrument input by gesture
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/18—Information management
- B60K2360/182—Distributing information between displays
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/27—Optical features of instruments using semi-transparent optical elements
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/33—Illumination features
- B60K2360/334—Projection means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04804—Transparency, e.g. transparent or translucent windows
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2101/00—Still video cameras
Definitions
- the present invention relates to an input device for a motor vehicle.
- ROHM Co., Ltd. shows a “1 Chip Optical Proximity+Ambient Light sensor IC”—BH1772GLC, measuring a distance between the sensor and a human hand up to 150 mm using IR-LED light.
- the object of the invention is to improve an input device for a motor vehicle.
- An input device for a motor vehicle with a dashboard and a steering wheel.
- the input device has a sensor and a circuit connected to the sensor.
- the sensor is positioned in the dashboard sensitive toward the steering wheel.
- the sensor is designed to output a sensor signal based on a contactless hand gesture.
- the circuit is configured to evaluate the sensor signal.
- the circuit and/or the sensor are configured to distinguish between a steering movement and the hand gesture and to output a detection signal based on the detection of the hand gesture.
- the object of the invention furthermore is to provide an improved system for a vehicle.
- a system for a vehicle having a dashboard and a steering wheel and a windshield.
- the system has a head-up display and an input device.
- the head-up display is configured to project an image onto the windshield.
- the input device has a sensor and a circuit connected to the sensor and the head-up display.
- the sensor is positioned in the dashboard sensitive toward the steering wheel.
- the sensor is designed to output a sensor signal based on a contactless hand gesture.
- the circuit is configured to evaluate the sensor signal.
- the circuit is configured to distinguish between a steering movement and the hand gesture and to output a detection signal based on the detection of the hand gesture.
- the circuit is configured to change the image based on the detection of the hand gesture.
- the evaluation circuit may be configured to determine and/or to control an amplitude of the sensor signal.
- the amplitude may be adjusted by adjusting the transmit power of an IR transmitter.
- the amplitude may be determined by means of an analog-to-digital converter and determination of a maximum value from the digitized sensor signal.
- the evaluation circuit may be configured to compare the amplitude of the sensor signal with a threshold.
- the threshold may be associated with a position of the hand within a space between the steering wheel and the sensor.
- the evaluation circuit may be configured to compare a course of the sensor signal with a pattern course associated with the hand gesture.
- the circuit may be configured, based on the sensor signal, to determine at least two distance values associated with at least two different distances between the hand and the sensor.
- a function of application software may be controlled by means of different distance values.
- the senor may be configured to generate the sensor signal based on a direction of a hand movement. Preferably, at least two directions may be determined. According to one embodiment, it is provided that six directions of hand movement can be distinguished by the sensor.
- a sensitivity of the sensor and/or the circuit can be designed to be adjustable.
- the circuit may be configured by means of an input to program a command in an application program.
- the command may be assigned to the detection of the hand gesture.
- the user can assign a current input or a frequently required input to the hand gesture.
- the circuit may be configured to add or remove an object of an application program in the image in order to change the image.
- the circuit may be configured to determine a selection input, the selection input being associated with a selection of an application program.
- the circuit may be configured to output information of the application program in another display.
- the object may contain information associated with the selected application program.
- FIG. 1 a schematic representation of a vehicle interior
- FIG. 2 a schematic block diagram of a system for a motor vehicle
- FIG. 3 another schematic representation of a vehicle interior
- FIG. 4 another schematic representation of a vehicle interior
- FIG. 5 a schematic diagram
- FIG. 6 another schematic diagram
- FIG. 7 one embodiment of views of displays
- FIG. 8 one embodiment of a view of a display
- FIG. 9 one embodiment with views for a telephone call.
- FIG. 10 one embodiment with views showing the reducing an object of an application program.
- FIG. 1 shows a schematic representation of a vehicle interior.
- the vehicle may include a driver seat 140 and a passenger seat 150 .
- the vehicle may further include a steering wheel 110 on the driver's side and a gear shift 170 and a front windshield 130 .
- a system may be provided, the system also referred to as an infotainment system providing information and entertainment functionality.
- the infotainment system may have a central information display 430 in the form of a user interface.
- Central information display 430 may be centrally arranged in dashboard 120 or center console of the vehicle.
- Central information display 430 may be touch screen, comprising a touch sensitive surface for user input.
- the infotainment system may have, or be in communication with an instrument cluster display 420 .
- instrument cluster display 420 may be arranged inline with the position of steering wheel 110 , so that the user may see the displayed information content through the openings in steering wheel 110 .
- Instrument cluster display 420 may be a color screen.
- the infotainment system may have a head-up display 410 .
- Head-up display 410 may be configured to project an image 411 onto front windshield 130 .
- a surface of front windshield 130 may reflect the projected image towards the user, in the case of the embodiment of FIG. 1 , towards the driver of the vehicle.
- the projected image can be of the size of a reflection area 419 .
- the form of front windshield 130 may deviate from a flat reflection surface, and an electronic rectification and/or optical rectification may be used.
- front windshield 130 can have a flat additional pane for reflection. Using mirroring technique the focus may be adjusted in an area outside the vehicle, so that the image 411 may appear virtually in front of the car of above the front lid.
- an input device for the motor vehicle is realized by sensor 302 and a circuit 200 , which is shown schematically in one embodiment of FIG. 2 .
- Sensor 302 may be positioned in the dashboard 120 sensitive toward the steering wheel 110 .
- the sensor 302 may be arranged and designed to determine a position and/or a movement between steering wheel 110 and dashboard 120 .
- the infotainment system may have a first sensor 301 and a second sensor 302 .
- First sensor 301 and a second sensor 302 may be infrared sensors.
- First sensor 301 and/or a second sensor 302 may be positioned in predetermined locations, in order to sense a movement of a hand of a user of the vehicle.
- the second sensor's 302 sensitivity may be directed toward an area 111 of steering wheel 110 .
- Said area 111 may be a grip position preferred by the driver.
- the first sensor 301 may be arranged in the central console to enable input in the area of central display 430 .
- the first sensor 301 may be designed in such a way that an input motion, for example, a hand gesture, is distinguished from an operation of the gear shift.
- the infotainment system may have an input device 304 in the central console.
- the input device 304 may be part of the user interface, and may have one or more push-buttons, input-wheels, and so forth.
- the system may have an input device 303 integrated in steering wheel 110 , having one or more push-buttons, switches and so forth.
- a separation of functions may occur.
- the sensor 301 , 302 the user can switch between applications and basic program functions can be controlled. Separated may be a plurality of submenu items of application programs that may be selectable by an input by means of input device 304 .
- the infotainment system may have a first near field communication device 361 (NFC) in a predetermined position, such as proximate to a left retainer 161 in one embodiment of FIG. 1 .
- the infotainment system may have a second near field communication device 362 (NFC) in a predetermined position, such as proximate to a right retainer 162 in an embodiment of FIG. 1 .
- First near field communication device 361 and second near field communication device 362 can be configured to connect to a mobile device 461 , 462 , such as to a mobile phone, or other mobile communication device in close proximity. Therefore a mobile device 461 positioned in or near the left retainer 161 according to one embodiment shown in FIG. 1 can have a connection to first near field communication device 361 and a mobile device 462 positioned in or near right retainer 162 shown in FIG. 1 may have a connection to second near field connection device 362 .
- FIG. 2 shows a block diagram of an example of the system for a motor vehicle.
- the system may have a circuit 200 .
- the circuit 200 may have a processor to run a program.
- the circuit 200 may have a plurality of interfaces to connect other devices.
- a sensor 302 can be connected to circuit 200 .
- the sensor 302 is designed to output a sensor signal S 302 based on a contactless hand gesture 912 , 913 .
- Hand gesture 912 , 913 is shown schematically, for example, in FIG. 4 .
- the circuit 200 may be configured to evaluate the sensor signal S 302 .
- the circuit 200 and/or the sensor 302 may be configured to distinguish between a steering movement 910 , 911 and hand gesture 912 , 913 .
- Steering movement 910 , 911 is shown schematically in FIG. 3 by movement arrows.
- Hand gesture 912 , 913 is shown schematically in FIG. 4 by movement arrows.
- the sensor 302 can be designed structurally to detect a movement only in an area up to distance d th .
- the distance d th is shown schematically in FIG. 3 .
- the distance d th according to one embodiment of FIG. 3 does not extend to the operating elements of steering wheel 110 , such as steering column switch 112 for the turn signal, windshield wipers, etc.
- FIG. 3 the distance d th according to one embodiment of FIG. 3 does not extend to the operating elements of steering wheel 110 , such as steering column switch 112 for the turn signal, windshield wipers, etc.
- the circuit 200 may have a function block 201 for evaluating the sensor signal S 302 .
- the function block 201 can be realized by hardware or as a program sequence by software.
- the function block 201 may enable the differentiation between steering movement 910 , 911 and hand gesture 912 , 913 .
- the circuit 200 may be configured to output a detection signal S 3 based on the detection of hand gesture 912 , 913 . If hand gesture 912 , 913 is detected by function block 201 , detection signal S 3 may be output to the function block 202 for control.
- the function block 202 of the circuit 200 based on detection signal S 3 may generate image data 412 , 422 , 432 for displays 410 , 420 , 430 .
- a head-up display 410 and/or an instrument cluster display 420 and/or a central information display 430 and/or a first sensor 301 and/or a second sensor 302 and/or a first near field connection device 361 and/or a second near field connection device 362 and/or an input device 303 , 304 may be connected to or in communication with circuit 200 .
- the head-up display 410 may also be referred to as head-up display.
- an infotainment system of a vehicle may include an imaging system.
- the infotainment system may have a head-up display 410 and a central information display 430 and a sensor 302 for detecting gestures 912 , 913 of a user.
- the infotainment system may have a circuit 200 connectable to head-up display 410 and to central information display 430 and to sensor 302 .
- the circuit 200 may be configured to send first image data 412 to the head-up display 410 and second image data 432 to the central information display 430 to be displayed.
- the head-up display 410 may be configured to project an image 411 onto the front windshield 130 , as shown in FIG. 1 .
- the image 411 may be based on first image data 412 .
- the central information display 430 may have a screen configured to display an image based on image data 432 .
- the circuit 200 may be configured to add content information to first image data 412 for head-up display 410 and to reduce content information from image data 412 for head-up display 410 , when a corresponding gesture 912 , 913 of the user is detectable by means of the sensor 302 .
- Image data 412 for the head-up display 410 and image data 432 for the central information display 430 may be different. Reducing information contained in image data 412 for the head-up display 410 may be initiated easily by hand gesture 912 , 913 of the driver, relieving strain on the driver. The workload of the driver is therefore reduced further to a minimum by reducing the content in the image 411 an increasing transparency.
- Image 411 may be projected within an area 419 .
- the projected image 411 may be predefined, and may be adjustable by the user.
- the area 419 may be positioned to the driver's view. The position of the area 419 may be adjusted to steering wheel 110 , so that the image 411 is viewable by the driver who is also able to observe the traffic in front of the vehicle.
- the image 411 may be at least partially transparent, such as semitransparent. At least parts of the area 419 may be transparent during driving, so that the view of the driver is not disturbed significantly.
- an infotainment system of a vehicle that includes the imaging system.
- the infotainment system may have a display 410 , 420 , 430 .
- the infotainment system may have a sensor 302 for detecting gestures of a user.
- the infotainment system may have a circuit 200 connectable to display 410 , 420 , 430 and to the sensor 302 .
- the sensor 302 may be of a contactless type.
- the sensor 302 may be an infrared sensor.
- the sensor 302 may be positioned in a predetermined position, such as a dashboard 120 of the vehicle sensitive towards a steering wheel 110 of the vehicle.
- the sensor 302 may be positioned in dashboard 120 facing an area 111 of steering wheel 110 , where a human hand 900 of the driver is in a normal position.
- the driver can therefore easily make gestures 912 , 913 while driving the vehicle as shown in an embodiment of FIG. 4 .
- the driver therefore does not need to search for a sensitive area of the sensor 302 .
- An input by means of the sensor 302 may occur in a quite general area before sensor 302 . In contrast to a keypad, the probability of an incorrect input is significantly reduced.
- the sensor 302 may be positionable by the driver to detect in a predetermined area.
- the sensor 302 may be placed adjustable in the dashboard 120 .
- the circuit 200 and the sensor 302 may be configured to distinguish between a gesture 912 , 913 to change the information content in display 410 , 420 , 430 and a steering movement 910 , 911 of the hand 900 of the user.
- a gesture 912 , 913 to change the information content in display 410 , 420 , 430 and a steering movement 910 , 911 of the hand 900 of the user.
- corresponding differences in amplitude C 1 , C 2 of the sensor signal S 302 of the sensor 302 may be analyzed.
- Amplitude C 1 , C 2 is shown schematically in the diagram in FIG. 5 .
- FIG. 5 shows by way of example the dependence of the numerical value of an infrared proximity sensor 302 on a distance d of an object, for example, a human hand, on a light intensity IR of the emitted infrared light, and on an angle ⁇ of the hand to a central position in front of sensor 302 . If the numerical values C do not exceed a threshold th, no hand gesture 912 , 913 is detected by circuit 200 . This is true, for example, in the case of FIG. 3 , whereby hand 900 during steering movement 910 , 911 does not fall below the distance threshold d th associated with threshold th.
- both first distance d 1 and second distance d 2 fall below the distance threshold d th .
- the circuit 200 according to FIG. 2 may be configured to determine, based on the sensor signal S 302 , at least two distance values C 1 , C 2 associated with at least two different distances d 1 , d 2 between the hand 900 and the sensor 302 .
- Inputs may occur by means of distance values C 1 , C 2 .
- Such an input may be a selection of a number of options or the adjustment of a value—by counting up or down in the image in one of displays 410 , 420 , 430 .
- the circuit 200 may be configured to recognize a predefined steering movement 910 , 911 and/or a predefined gesture 912 , 913 .
- the circuit 200 in FIG. 2 is configured to compare a course of sensor signal C u (t), C l (t) with a pattern course C p (t), associated with hand gesture 912 , 913 , over the time t.
- Two courses of sensor signals C u (t), C l (t) and a pattern course C p (t) are shown schematically in FIG. 6 .
- the two sensor signal courses C u (t), C l (t) are thereby offset in time, so that a movement direction 912 or 913 of the hand gesture may be determined by the succession of sensor signal courses C u (t), C l (t).
- the time offset can be generated by two spatially separated IR diodes or by two spatially separated IR receivers. If both sensor signal courses C u (t), C l (t) are within the pattern course C p (t), a hand gesture 912 , 913 is detected.
- the two sensors 301 , 302 may be both connected to a circuit 200 .
- An interior camera 305 may be connected to circuit 200 .
- Interior camera 305 may be aligned to record a face of the user, especially the face of the driver of the vehicle to determine eye movements.
- the infotainment system may have a microphone 306 to record the voice of the user.
- the infotainment system may be configured to run a program for voice recognition.
- the infotainment system may have an interface 340 to a bus of the vehicle, e.g., a CAN bus, to retrieve data of the vehicle, e.g., the current speed, vehicle rain sensor data, and so forth.
- the infotainment system may have a satellite receiver 330 to receive position data of the current position of the vehicle, such as GPS data or GLONASS data.
- the system may have a transceiver 350 for communicating with a wireless network such as, for example, a UMTS network or a WLAN network.
- the infotainment system may have one or more cameras 311 , 312 , 313 , 314 positioned to record an image of the surroundings of the vehicle.
- the circuit 200 may be connected to a front camera 311 capturing image data of the road and traffic in front of the vehicle.
- the circuit 200 may be connected to a back camera 312 capturing image data of the road and traffic behind the vehicle.
- the circuit 200 may be connected to a left camera 313 and/or to a right camera 314 recording an image correspondingly.
- the one or more cameras 311 , 312 , 313 , 314 may be used to record the complete surroundings of the vehicle concurrently.
- Circuit 200 may be configured to run a program of object recognition to recognize objects in the recorded image data.
- the recognized object may be a road user like a vehicle.
- the infotainment system may have one or more distance sensors 321 , 322 , 323 , 329 .
- the distance sensors 321 , 322 , 323 , 329 may be ultrasonic sensors or radar sensors, or any other device or system for measuring a distance to an object in the surroundings of the vehicle.
- the one or more distance sensors 321 , 322 , 323 , 329 may be connectable to circuit 200 .
- FIGS. 3 and 4 show a schematic view of a driver's cockpit.
- the driver makes a steering movement 910 , 911 , whereby hand 900 grips steering wheel 110 .
- One finger may operate steering column switch 112 to start the turn signal.
- the hand 900 does not fall below the distance d th .
- An incorrect input by the detection of steering movement 910 , 911 as a hand gesture can be ruled out by this.
- the driver in FIG. 5 moves hand 900 in a space between steering column switch 112 and sensor 302 .
- the hand 900 may fall below the distance threshold d th .
- the hand 900 may make a contactless hand gesture 912 , 913 , whereby sensor 302 may not be touched by the hand 900 .
- Also shown in FIG. 5 are two distances d 1 and d 2 between the hand 900 and the sensor 302 causing a difference in the sensor signal S 302 for control purposes.
- FIG. 7 shows the functional relationships for sensors 301 , 302 .
- surroundings 1 of the vehicle are shown as a view through the windshield.
- An image 411 of head-up display 410 is projected onto the windshield and thereby into the driver's view area overlaying the surroundings 1 .
- the display of the instrument cluster display 420 is shown with a speed display and a three-dimensional street view.
- the image of central information display 430 is shown with a number of applications, such as email, telephone, and weather report.
- a first image 411 may be output via a head-up display 410
- a second image may be output via an instrument cluster display 420
- a third image may be output via a central information display 430 .
- a first sensor 301 may be used to select applications in central information display 430 .
- a second sensor 302 may be used to add or reduce information content.
- a hand gesture 912 with a sensed upward movement of the hand is detected by second sensor 302
- an usage for example, a navigation view
- information in image 411 of the head-up display 410 may be reduced; for example, the navigation may no longer be shown in image 411 of the head-up display 410 .
- second sensor 302 may, moreover, detect a horizontal movement.
- a hand gesture 914 with a movement of hand 900 to the left the application selected in the central information display 430 may be added to the instrument cluster display 420 .
- a hand gesture 915 with a movement of the hand 900 to the right again removes it.
- the application in the central information display 430 may be selected by means of the first sensor 301 by means of a detection of a hand gesture 916 , 917 by movement of the hand to the left or right.
- a system of a vehicle may have a display 410 , 420 , 430 .
- the system may have a sensor 302 for detecting gestures of a user.
- the system may have a circuit 200 connectable to display 410 , 420 , 430 and connectable to sensor 302 .
- the circuit 200 may also be referred to as a central unit 200 .
- the sensor 302 may be positioned in a dashboard 120 of the vehicle sensitive towards a steering wheel 110 of the vehicle.
- the circuit 200 and the sensor 302 may be configured to distinguish between a gesture 912 , 913 , 914 , 915 to change the information content in display 410 , 420 , 430 and a steering movement 910 , 911 of the hand 900 of the user.
- a gesture 912 , 913 , 914 , 915 recognized by the sensor 302 may be assigned to one of a predetermined number of keys, such as four keys W, S, Q, and E.
- the information content from the instruments cluster display 420 may be added to the head-up display 410 .
- the information content in the head-up display 410 can be reduced.
- the information content from the central information display 430 may be added to the instrument cluster display 420 .
- the information content in the instrument cluster display 420 can be reduced.
- First sensor 301 and/or second sensor 302 may be configured to zoom in and out according to a change of a distance d 1 , d 2 of hand 900 of the user to corresponding sensor 301 , 302 .
- FIG. 8 A view of surroundings 1 of the motor vehicle is shown schematically in FIG. 8 .
- the view of the user is through a windshield 130 , as this is shown schematically in FIG. 1 .
- Image 411 of a head-up display 410 is projected onto windshield 130 , which in the embodiment of FIG. 8 partially overlaps the view of surroundings 1 .
- a system of a vehicle includes an imaging system.
- the system may have a head-up display 410 .
- the system may have a circuit 200 connectable to head-up display 410 .
- the circuit 200 of one embodiment in FIG. 2 may be configured to send image data 412 to the head-up display 410 to be displayed.
- the head-up display 410 may be configured to project an image 411 onto front windshield 130 .
- the image 411 may be based on image data 412 .
- the circuit 200 may be configured to output a first information item and a second information item.
- the first information item may have a higher priority than the second information item.
- the circuit may be configured to replace the second information item by the first information item, when an alert signal is estimated based on measured traffic related data and/or received traffic related data.
- a traffic jam may be detected in front of the vehicle.
- the circuit 200 may be configured to output a warning signal on approach to the traffic jam.
- a symbol with high priority may be output as a warning signal as a component of image 411 .
- a previously displayed navigation guidance may be faded out before or may be decreased in size significantly.
- the driver may change the information shown in image 411 by detected hand gestures by means of sensor 302 . It may allow swiping between three different information levels about the traffic jam, while zooming in or out with gesture sensor 203 : Traffic warning, alternative route, big route guidance arrow, or an overview map may be displayed based on the hand gesture.
- the average speed of road users in front the vehicle may be compared with a threshold. If the average speed of the road users is below the threshold, a warning symbol may be displayed as the first information item.
- Traffic congestion data may be received wirelessly, such as from a radio station. As the vehicle approaches the traffic congestion, a warning symbol may be shown as the first information item.
- the second information item of lower priority is, for example, a route guidance symbol.
- FIG. 9 a sequence is shown schematically by means of different views on different displays 410 , 430 of FIG. 1 .
- the topmost view shows central information display 430 with a number of applications.
- swipe hand gesture 917 of hand 900 detected by a first sensor 301 the applications in central information display 430 are moved and the application in the center may be selected.
- swipe hand gesture 917 brings the application “phone book” into the middle of the foreground.
- the middle view in FIG. 9 also shows the central information display 430 with a second sensor 302 .
- the application “phone book” in the middle of the central information display 430 may be displayed in addition in a head-up display 410 as image 411 .
- the displaying of the same application in the central information display 430 and in the head-up display 410 may differ.
- the lower view in FIG. 9 shows a view through the windshield with an image 411 of the head-up display 410 .
- only pictures of people from the phone book are shown in the head-up display 410 .
- a simple intuitive selection by the driver is possible by displaying of the pictures of people.
- the position of a number of pictures of people may be changed by changing the distance d between hand 900 and second sensor 302 .
- To make a selection one of the pictures of people can be scrolled into the foreground. If the distance of hand 900 to second sensor 302 is kept constant, a selection gesture may be detected and a telephone call may be initiated. A telephone connection can be ended by another hand gesture.
- an infotainment system of a vehicle may include an imaging system with a function to initiate a telephone call.
- the phone book may be brought into the central information display 430 via a swipe gesture.
- the phone book application may be brought to head-up display 410 using a gesture.
- the head-up display 410 may show pictures from the phone book.
- a gesture changing the proximity of hand 900 to sensor 302 makes the pictures flip. If the gesture is held, a telephone call may be initiated in a fifth step. The corresponding picture may be enlarged in a sixth step.
- the telephone call may be ended in a seventh step.
- An infrared sensor 302 between instrumentation cluster display 420 and head-up display 410 may be used to reduce or add information by gesture.
- FIG. 10 Two views through a windshield with an image 411 projected onto the windshield and a sensor 302 with a hand gesture 913 of a hand 900 are shown schematically in one embodiment of FIG. 10 .
- An object 415 (text) of an application within image 411 is moved downward and/or made smaller by hand gesture 913 detected by means of sensor 302 .
- the object is a text and/or a graphic and/or a video and/or a widget. Then, the object 415 in image 411 disappears automatically.
- the application associated with object 415 can continue to be shown on another display 420 , 430 .
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- General Physics & Mathematics (AREA)
- Combustion & Propulsion (AREA)
- Chemical & Material Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Optics & Photonics (AREA)
- Instrument Panels (AREA)
- Traffic Control Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
- Controls And Circuits For Display Device (AREA)
- Mobile Radio Communication Systems (AREA)
- Processing Or Creating Images (AREA)
- Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
- Telephonic Communication Services (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
Embodiments are disclosed for an input device for a motor vehicle. An example input device for a motor vehicle having a dashboard and a steering wheel includes a sensor and a circuit connected to the sensor,
-
- wherein the sensor is positioned in the dashboard sensitive toward an area of the steering wheel,
- wherein the sensor is configured to output a sensor signal based on a contactless hand gesture,
- wherein the circuit is configured to evaluate the sensor signal,
- wherein the circuit and/or the sensor is configured to distinguish between a steering movement and the hand gesture, and
- wherein the circuit is configured to output a detection signal (S3) based on the detection of the hand gesture.
Description
- The present invention relates to an input device for a motor vehicle.
- ROHM Co., Ltd., shows a “1 Chip Optical Proximity+Ambient Light sensor IC”—BH1772GLC, measuring a distance between the sensor and a human hand up to 150 mm using IR-LED light.
- The object of the invention is to improve an input device for a motor vehicle.
- This object is attained by an input device with the features of
independent claim 1. Advantageous refinements are the subject of dependent claims and included in the description. - An input device is provided for a motor vehicle with a dashboard and a steering wheel. The input device has a sensor and a circuit connected to the sensor.
- The sensor is positioned in the dashboard sensitive toward the steering wheel.
- The sensor is designed to output a sensor signal based on a contactless hand gesture.
- The circuit is configured to evaluate the sensor signal.
- The circuit and/or the sensor are configured to distinguish between a steering movement and the hand gesture and to output a detection signal based on the detection of the hand gesture.
- Tests by the applicant have shown that the arrangement in the dashboard and direction of the sensor sensitivity toward the steering wheel may enable the driver to make inputs without having to avert his gaze from the road traffic, so that safety in road traffic is increased. At the same time, an erroneous unwanted input during a steering movement can be effectively eliminated.
- The object of the invention furthermore is to provide an improved system for a vehicle.
- Said object is attained by the system with the features of independent claim 9. Advantageous refinements are the subject of dependent claims and included in the description.
- Therefore, a system is provided for a vehicle having a dashboard and a steering wheel and a windshield.
- The system has a head-up display and an input device.
- The head-up display is configured to project an image onto the windshield.
- The input device has a sensor and a circuit connected to the sensor and the head-up display.
- The sensor is positioned in the dashboard sensitive toward the steering wheel.
- The sensor is designed to output a sensor signal based on a contactless hand gesture.
- The circuit is configured to evaluate the sensor signal.
- The circuit is configured to distinguish between a steering movement and the hand gesture and to output a detection signal based on the detection of the hand gesture.
- The circuit is configured to change the image based on the detection of the hand gesture.
- The embodiments described hereinafter refer to both the input device and the system.
- According to one embodiment, the evaluation circuit may be configured to determine and/or to control an amplitude of the sensor signal. The amplitude may be adjusted by adjusting the transmit power of an IR transmitter. The amplitude may be determined by means of an analog-to-digital converter and determination of a maximum value from the digitized sensor signal.
- According to one embodiment, the evaluation circuit may be configured to compare the amplitude of the sensor signal with a threshold. The threshold may be associated with a position of the hand within a space between the steering wheel and the sensor.
- According to one embodiment, the evaluation circuit may be configured to compare a course of the sensor signal with a pattern course associated with the hand gesture.
- According to one embodiment, the circuit may be configured, based on the sensor signal, to determine at least two distance values associated with at least two different distances between the hand and the sensor. A function of application software may be controlled by means of different distance values.
- According to one embodiment, the sensor may be configured to generate the sensor signal based on a direction of a hand movement. Preferably, at least two directions may be determined. According to one embodiment, it is provided that six directions of hand movement can be distinguished by the sensor.
- According to one embodiment, a sensitivity of the sensor and/or the circuit can be designed to be adjustable.
- According to one embodiment, the circuit may be configured by means of an input to program a command in an application program. The command may be assigned to the detection of the hand gesture. By this means, the user can assign a current input or a frequently required input to the hand gesture.
- According to one embodiment, the circuit may be configured to add or remove an object of an application program in the image in order to change the image.
- According to one embodiment, the circuit may be configured to determine a selection input, the selection input being associated with a selection of an application program. According to one embodiment the circuit may be configured to output information of the application program in another display. According to one embodiment the object may contain information associated with the selected application program.
- The previously described refinement variants are especially advantageous both individually and in combination. In this regard, all embodiments may be combined with one another. Some possible combinations are explained in the description of the exemplary embodiments shown in the figures. These possible combinations of the refinement variants, depicted therein, are not definitive, however.
- The invention will be described in greater detail hereinafter by exemplary embodiments using graphic illustrations.
- Shown are:
-
FIG. 1 a schematic representation of a vehicle interior; -
FIG. 2 a schematic block diagram of a system for a motor vehicle; -
FIG. 3 another schematic representation of a vehicle interior; -
FIG. 4 another schematic representation of a vehicle interior; -
FIG. 5 a schematic diagram; -
FIG. 6 another schematic diagram; -
FIG. 7 one embodiment of views of displays; -
FIG. 8 one embodiment of a view of a display; -
FIG. 9 one embodiment with views for a telephone call; and -
FIG. 10 one embodiment with views showing the reducing an object of an application program. -
FIG. 1 shows a schematic representation of a vehicle interior. According to one embodiment ofFIG. 1 , the vehicle may include adriver seat 140 and apassenger seat 150. The vehicle may further include asteering wheel 110 on the driver's side and agear shift 170 and afront windshield 130. In one embodiment ofFIG. 1 , a system may be provided, the system also referred to as an infotainment system providing information and entertainment functionality. The infotainment system may have acentral information display 430 in the form of a user interface.Central information display 430 may be centrally arranged indashboard 120 or center console of the vehicle.Central information display 430 may be touch screen, comprising a touch sensitive surface for user input. The infotainment system may have, or be in communication with aninstrument cluster display 420. According to one embodiment,instrument cluster display 420 may be arranged inline with the position ofsteering wheel 110, so that the user may see the displayed information content through the openings insteering wheel 110.Instrument cluster display 420 may be a color screen. - The infotainment system may have a head-up
display 410. Head-updisplay 410 may be configured to project animage 411 ontofront windshield 130. A surface offront windshield 130 may reflect the projected image towards the user, in the case of the embodiment ofFIG. 1 , towards the driver of the vehicle. According to one embodiment shown inFIG. 1 , the projected image can be of the size of areflection area 419. The form offront windshield 130 may deviate from a flat reflection surface, and an electronic rectification and/or optical rectification may be used. Likewise,front windshield 130 can have a flat additional pane for reflection. Using mirroring technique the focus may be adjusted in an area outside the vehicle, so that theimage 411 may appear virtually in front of the car of above the front lid. - According to one embodiment of
FIG. 1 , an input device for the motor vehicle is realized bysensor 302 and acircuit 200, which is shown schematically in one embodiment ofFIG. 2 .Sensor 302 may be positioned in thedashboard 120 sensitive toward thesteering wheel 110. Thesensor 302 may be arranged and designed to determine a position and/or a movement betweensteering wheel 110 anddashboard 120. - The infotainment system may have a
first sensor 301 and asecond sensor 302.First sensor 301 and asecond sensor 302 may be infrared sensors.First sensor 301 and/or asecond sensor 302 may be positioned in predetermined locations, in order to sense a movement of a hand of a user of the vehicle. In this respect, the second sensor's 302 sensitivity may be directed toward anarea 111 ofsteering wheel 110. Saidarea 111 may be a grip position preferred by the driver. In contrast, thefirst sensor 301 may be arranged in the central console to enable input in the area ofcentral display 430. Thefirst sensor 301 may be designed in such a way that an input motion, for example, a hand gesture, is distinguished from an operation of the gear shift. - The infotainment system may have an
input device 304 in the central console. Theinput device 304 may be part of the user interface, and may have one or more push-buttons, input-wheels, and so forth. The system may have aninput device 303 integrated insteering wheel 110, having one or more push-buttons, switches and so forth. According to one embodiment, a separation of functions may occur. By means of the 301, 302 the user can switch between applications and basic program functions can be controlled. Separated may be a plurality of submenu items of application programs that may be selectable by an input by means ofsensor input device 304. - The infotainment system may have a first near field communication device 361 (NFC) in a predetermined position, such as proximate to a
left retainer 161 in one embodiment ofFIG. 1 . Also the infotainment system may have a second near field communication device 362 (NFC) in a predetermined position, such as proximate to aright retainer 162 in an embodiment ofFIG. 1 . First nearfield communication device 361 and second nearfield communication device 362 can be configured to connect to a 461, 462, such as to a mobile phone, or other mobile communication device in close proximity. Therefore amobile device mobile device 461 positioned in or near theleft retainer 161 according to one embodiment shown inFIG. 1 can have a connection to first nearfield communication device 361 and amobile device 462 positioned in or nearright retainer 162 shown inFIG. 1 may have a connection to second nearfield connection device 362. -
FIG. 2 shows a block diagram of an example of the system for a motor vehicle. The system may have acircuit 200. Thecircuit 200 may have a processor to run a program. Thecircuit 200 may have a plurality of interfaces to connect other devices. - A
sensor 302 can be connected tocircuit 200. Thesensor 302 is designed to output a sensor signal S302 based on a 912, 913.contactless hand gesture 912, 913 is shown schematically, for example, inHand gesture FIG. 4 . According to one embodiment inFIG. 2 , thecircuit 200 may be configured to evaluate the sensor signal S302. - According to one embodiment, the
circuit 200 and/or thesensor 302 may be configured to distinguish between a 910, 911 andsteering movement 912, 913.hand gesture 910, 911 is shown schematically inSteering movement FIG. 3 by movement arrows. 912, 913 is shown schematically inHand gesture FIG. 4 by movement arrows. Thesensor 302 can be designed structurally to detect a movement only in an area up to distance dth. The distance dth is shown schematically inFIG. 3 . The distance dth according to one embodiment ofFIG. 3 does not extend to the operating elements ofsteering wheel 110, such assteering column switch 112 for the turn signal, windshield wipers, etc. According to one embodiment inFIG. 2 , thecircuit 200 may have afunction block 201 for evaluating the sensor signal S302. Thefunction block 201 can be realized by hardware or as a program sequence by software. Thefunction block 201 may enable the differentiation between 910, 911 andsteering movement 912, 913. Thehand gesture circuit 200 may be configured to output a detection signal S3 based on the detection of 912, 913. Ifhand gesture 912, 913 is detected byhand gesture function block 201, detection signal S3 may be output to thefunction block 202 for control. Thefunction block 202 of thecircuit 200 based on detection signal S3 may generate 412, 422, 432 forimage data 410, 420, 430.displays - A head-up
display 410 and/or aninstrument cluster display 420 and/or acentral information display 430 and/or afirst sensor 301 and/or asecond sensor 302 and/or a first nearfield connection device 361 and/or a second nearfield connection device 362 and/or an 303, 304 may be connected to or in communication withinput device circuit 200. The head-updisplay 410 may also be referred to as head-up display. - According to one embodiment, an infotainment system of a vehicle may include an imaging system. The infotainment system may have a head-up
display 410 and acentral information display 430 and asensor 302 for detecting 912, 913 of a user. The infotainment system may have agestures circuit 200 connectable to head-updisplay 410 and tocentral information display 430 and tosensor 302. - The
circuit 200 may be configured to sendfirst image data 412 to the head-updisplay 410 andsecond image data 432 to thecentral information display 430 to be displayed. The head-updisplay 410 may be configured to project animage 411 onto thefront windshield 130, as shown inFIG. 1 . Theimage 411 may be based onfirst image data 412. - The
central information display 430 may have a screen configured to display an image based onimage data 432. Thecircuit 200 may be configured to add content information tofirst image data 412 for head-updisplay 410 and to reduce content information fromimage data 412 for head-updisplay 410, when a 912, 913 of the user is detectable by means of thecorresponding gesture sensor 302. -
Image data 412 for the head-updisplay 410 andimage data 432 for thecentral information display 430 may be different. Reducing information contained inimage data 412 for the head-updisplay 410 may be initiated easily by 912, 913 of the driver, relieving strain on the driver. The workload of the driver is therefore reduced further to a minimum by reducing the content in thehand gesture image 411 an increasing transparency. -
Image 411 may be projected within anarea 419. The projectedimage 411 may be predefined, and may be adjustable by the user. Thearea 419 may be positioned to the driver's view. The position of thearea 419 may be adjusted tosteering wheel 110, so that theimage 411 is viewable by the driver who is also able to observe the traffic in front of the vehicle. Theimage 411 may be at least partially transparent, such as semitransparent. At least parts of thearea 419 may be transparent during driving, so that the view of the driver is not disturbed significantly. - According to one embodiment, an infotainment system of a vehicle that includes the imaging system is provided. The infotainment system may have a
410, 420, 430. The infotainment system may have adisplay sensor 302 for detecting gestures of a user. The infotainment system may have acircuit 200 connectable to display 410, 420, 430 and to thesensor 302. Thesensor 302 may be of a contactless type. Thesensor 302 may be an infrared sensor. - The
sensor 302 may be positioned in a predetermined position, such as adashboard 120 of the vehicle sensitive towards asteering wheel 110 of the vehicle. InFIG. 1 , thesensor 302 may be positioned indashboard 120 facing anarea 111 ofsteering wheel 110, where ahuman hand 900 of the driver is in a normal position. The driver can therefore easily make 912, 913 while driving the vehicle as shown in an embodiment ofgestures FIG. 4 . The driver therefore does not need to search for a sensitive area of thesensor 302. An input by means of thesensor 302 may occur in a quite general area beforesensor 302. In contrast to a keypad, the probability of an incorrect input is significantly reduced. According to one embodiment, thesensor 302 may be positionable by the driver to detect in a predetermined area. For example, thesensor 302 may be placed adjustable in thedashboard 120. - The
circuit 200 and thesensor 302 may be configured to distinguish between a 912, 913 to change the information content ingesture 410, 420, 430 and adisplay 910, 911 of thesteering movement hand 900 of the user. To distinguish between 912, 913 andgesture 910, 911, corresponding differences in amplitude C1, C2 of the sensor signal S302 of thesteering movement sensor 302 may be analyzed. Amplitude C1, C2 is shown schematically in the diagram inFIG. 5 . The diagram ofFIG. 5 shows by way of example the dependence of the numerical value of aninfrared proximity sensor 302 on a distance d of an object, for example, a human hand, on a light intensity IR of the emitted infrared light, and on an angle α of the hand to a central position in front ofsensor 302. If the numerical values C do not exceed a threshold th, no 912, 913 is detected byhand gesture circuit 200. This is true, for example, in the case ofFIG. 3 , wherebyhand 900 during 910, 911 does not fall below the distance threshold dth associated with threshold th.steering movement - In contrast, with
912, 913 according to the embodiment inhand gesture FIG. 4 , both first distance d1 and second distance d2 fall below the distance threshold dth. This is reflected in the diagram ofFIG. 5 , whereby in the case of first distance d1 first amplitude C1 is generated and in the case of second distance d2 second amplitude C2. In an embodiment, thecircuit 200 according toFIG. 2 may be configured to determine, based on the sensor signal S302, at least two distance values C1, C2 associated with at least two different distances d1, d2 between thehand 900 and thesensor 302. Inputs may occur by means of distance values C1, C2. Such an input may be a selection of a number of options or the adjustment of a value—by counting up or down in the image in one of 410, 420, 430.displays - The
circuit 200 may be configured to recognize a 910, 911 and/or apredefined steering movement 912, 913.predefined gesture - According to one embodiment, the
circuit 200 inFIG. 2 is configured to compare a course of sensor signal Cu(t), Cl(t) with a pattern course Cp(t), associated with 912, 913, over the time t. Two courses of sensor signals Cu(t), Cl(t) and a pattern course Cp(t) are shown schematically inhand gesture FIG. 6 . The two sensor signal courses Cu(t), Cl(t) are thereby offset in time, so that a 912 or 913 of the hand gesture may be determined by the succession of sensor signal courses Cu(t), Cl(t). The time offset can be generated by two spatially separated IR diodes or by two spatially separated IR receivers. If both sensor signal courses Cu(t), Cl(t) are within the pattern course Cp(t), amovement direction 912, 913 is detected.hand gesture - According to one embodiment in
FIG. 2 , there may be two 301, 302 sensing movements of asensors hand 900 of a user. The two 301, 302 may be both connected to asensors circuit 200. Aninterior camera 305 may be connected tocircuit 200.Interior camera 305 may be aligned to record a face of the user, especially the face of the driver of the vehicle to determine eye movements. - The infotainment system may have a
microphone 306 to record the voice of the user. The infotainment system may be configured to run a program for voice recognition. The infotainment system may have aninterface 340 to a bus of the vehicle, e.g., a CAN bus, to retrieve data of the vehicle, e.g., the current speed, vehicle rain sensor data, and so forth. - The infotainment system may have a
satellite receiver 330 to receive position data of the current position of the vehicle, such as GPS data or GLONASS data. The system may have atransceiver 350 for communicating with a wireless network such as, for example, a UMTS network or a WLAN network. - The infotainment system may have one or
311, 312, 313, 314 positioned to record an image of the surroundings of the vehicle. According to one embodiment, themore cameras circuit 200 may be connected to afront camera 311 capturing image data of the road and traffic in front of the vehicle. Thecircuit 200 may be connected to aback camera 312 capturing image data of the road and traffic behind the vehicle. Thecircuit 200 may be connected to aleft camera 313 and/or to aright camera 314 recording an image correspondingly. The one or 311, 312, 313, 314 may be used to record the complete surroundings of the vehicle concurrently.more cameras Circuit 200 may be configured to run a program of object recognition to recognize objects in the recorded image data. The recognized object may be a road user like a vehicle. - The infotainment system may have one or
321, 322, 323, 329. Themore distance sensors 321, 322, 323, 329 may be ultrasonic sensors or radar sensors, or any other device or system for measuring a distance to an object in the surroundings of the vehicle. The one ordistance sensors 321, 322, 323, 329 may be connectable tomore distance sensors circuit 200. -
FIGS. 3 and 4 show a schematic view of a driver's cockpit. InFIG. 3 , the driver makes a 910, 911, wherebysteering movement hand 900grips steering wheel 110. One finger may operatesteering column switch 112 to start the turn signal. During 910, 911 thesteering movement hand 900 does not fall below the distance dth. An incorrect input by the detection of 910, 911 as a hand gesture can be ruled out by this. In contrast, the driver insteering movement FIG. 5 moveshand 900 in a space betweensteering column switch 112 andsensor 302. Thehand 900 may fall below the distance threshold dth. In this space, thehand 900 may make a 912, 913, wherebycontactless hand gesture sensor 302 may not be touched by thehand 900. Also shown inFIG. 5 are two distances d1 and d2 between thehand 900 and thesensor 302 causing a difference in the sensor signal S302 for control purposes. -
FIG. 7 shows the functional relationships for 301, 302. In the upper left area,sensors surroundings 1 of the vehicle are shown as a view through the windshield. Animage 411 of head-updisplay 410 is projected onto the windshield and thereby into the driver's view area overlaying thesurroundings 1. In the lower left area, the display of theinstrument cluster display 420 is shown with a speed display and a three-dimensional street view. In the right lower area, the image ofcentral information display 430 is shown with a number of applications, such as email, telephone, and weather report. - According to one embodiment of
FIG. 7 , afirst image 411 may be output via a head-updisplay 410, a second image may be output via aninstrument cluster display 420, and a third image may be output via acentral information display 430. Afirst sensor 301 may be used to select applications incentral information display 430. Asecond sensor 302 may be used to add or reduce information content. - If a
hand gesture 912 with a sensed upward movement of the hand is detected bysecond sensor 302, an usage, for example, a navigation view, may be added toimage 411 of the head-updisplay 410 from theinstrument cluster display 420. If ahand gesture 913 with a sensed downward movement of the hand is detected bysecond sensor 302, information inimage 411 of the head-updisplay 410 may be reduced; for example, the navigation may no longer be shown inimage 411 of the head-updisplay 410. - According to one embodiment of
FIG. 7 ,second sensor 302 may, moreover, detect a horizontal movement. Ahand gesture 914 with a movement ofhand 900 to the left, the application selected in thecentral information display 430 may be added to theinstrument cluster display 420. Ahand gesture 915 with a movement of thehand 900 to the right again removes it. The application in thecentral information display 430 may be selected by means of thefirst sensor 301 by means of a detection of a 916, 917 by movement of the hand to the left or right.hand gesture - According to one embodiment a system of a vehicle is provided. The embodiment may be explained using
FIGS. 1 , 2, and 7. The system may have a 410, 420, 430. The system may have adisplay sensor 302 for detecting gestures of a user. The system may have acircuit 200 connectable to display 410, 420, 430 and connectable tosensor 302. Thecircuit 200 may also be referred to as acentral unit 200. - The
sensor 302 may be positioned in adashboard 120 of the vehicle sensitive towards asteering wheel 110 of the vehicle. Thecircuit 200 and thesensor 302 may be configured to distinguish between a 912, 913, 914, 915 to change the information content ingesture 410, 420, 430 and adisplay 910, 911 of thesteering movement hand 900 of the user. - A
912, 913, 914, 915 recognized by thegesture sensor 302 may be assigned to one of a predetermined number of keys, such as four keys W, S, Q, and E. According to one embodiment based on key W, the information content from theinstruments cluster display 420 may be added to the head-updisplay 410. According to one embodiment based on key S, the information content in the head-updisplay 410 can be reduced. According to one embodiment based on key Q, the information content from thecentral information display 430 may be added to theinstrument cluster display 420. According to one embodiment based on key E, the information content in theinstrument cluster display 420 can be reduced. -
First sensor 301 and/orsecond sensor 302 may be configured to zoom in and out according to a change of a distance d1, d2 ofhand 900 of the user to 301, 302.corresponding sensor - A view of
surroundings 1 of the motor vehicle is shown schematically inFIG. 8 . The view of the user is through awindshield 130, as this is shown schematically inFIG. 1 .Image 411 of a head-updisplay 410 is projected ontowindshield 130, which in the embodiment ofFIG. 8 partially overlaps the view ofsurroundings 1. - According to one embodiment, a system of a vehicle is provided that includes an imaging system. The system may have a head-up
display 410. The system may have acircuit 200 connectable to head-updisplay 410. - The
circuit 200 of one embodiment inFIG. 2 may be configured to sendimage data 412 to the head-updisplay 410 to be displayed. The head-updisplay 410 may be configured to project animage 411 ontofront windshield 130. Theimage 411 may be based onimage data 412. - The
circuit 200 may be configured to output a first information item and a second information item. The first information item may have a higher priority than the second information item. - The circuit may be configured to replace the second information item by the first information item, when an alert signal is estimated based on measured traffic related data and/or received traffic related data.
- According to one embodiment of
FIG. 8 , a traffic jam may be detected in front of the vehicle. Thecircuit 200 may be configured to output a warning signal on approach to the traffic jam. A symbol with high priority may be output as a warning signal as a component ofimage 411. For example, a previously displayed navigation guidance may be faded out before or may be decreased in size significantly. The driver may change the information shown inimage 411 by detected hand gestures by means ofsensor 302. It may allow swiping between three different information levels about the traffic jam, while zooming in or out with gesture sensor 203: Traffic warning, alternative route, big route guidance arrow, or an overview map may be displayed based on the hand gesture. - The average speed of road users in front the vehicle may be compared with a threshold. If the average speed of the road users is below the threshold, a warning symbol may be displayed as the first information item. Traffic congestion data may be received wirelessly, such as from a radio station. As the vehicle approaches the traffic congestion, a warning symbol may be shown as the first information item. The second information item of lower priority is, for example, a route guidance symbol.
- In an embodiment of
FIG. 9 , a sequence is shown schematically by means of different views on 410, 430 ofdifferent displays FIG. 1 . The topmost view showscentral information display 430 with a number of applications. Byhand gesture 917 ofhand 900 detected by afirst sensor 301, the applications incentral information display 430 are moved and the application in the center may be selected. According to one embodiment ofFIG. 9 ,swipe hand gesture 917 brings the application “phone book” into the middle of the foreground. - The middle view in
FIG. 9 also shows thecentral information display 430 with asecond sensor 302. By ahand gesture 912 ofhand 900 detected by thesecond sensor 302, the application “phone book” in the middle of thecentral information display 430 may be displayed in addition in a head-updisplay 410 asimage 411. In this respect, the displaying of the same application in thecentral information display 430 and in the head-updisplay 410 may differ. - The lower view in
FIG. 9 shows a view through the windshield with animage 411 of the head-updisplay 410. According to one embodiment, only pictures of people from the phone book are shown in the head-updisplay 410. A simple intuitive selection by the driver is possible by displaying of the pictures of people. The position of a number of pictures of people may be changed by changing the distance d betweenhand 900 andsecond sensor 302. To make a selection, one of the pictures of people can be scrolled into the foreground. If the distance ofhand 900 tosecond sensor 302 is kept constant, a selection gesture may be detected and a telephone call may be initiated. A telephone connection can be ended by another hand gesture. - According to one embodiment of
FIG. 9 , an infotainment system of a vehicle is provided. The system may include an imaging system with a function to initiate a telephone call. In a first step the phone book may be brought into thecentral information display 430 via a swipe gesture. In a second step the phone book application may be brought to head-updisplay 410 using a gesture. In the third step the head-updisplay 410 may show pictures from the phone book. In a fourth step a gesture changing the proximity ofhand 900 tosensor 302 makes the pictures flip. If the gesture is held, a telephone call may be initiated in a fifth step. The corresponding picture may be enlarged in a sixth step. The telephone call may be ended in a seventh step. - According to one embodiment of
FIG. 10 , the possibility of reducing the information in a head-updisplay 410 is provided. Aninfrared sensor 302 betweeninstrumentation cluster display 420 and head-updisplay 410 may be used to reduce or add information by gesture. - Two views through a windshield with an
image 411 projected onto the windshield and asensor 302 with ahand gesture 913 of ahand 900 are shown schematically in one embodiment ofFIG. 10 . An object 415 (text) of an application withinimage 411 is moved downward and/or made smaller byhand gesture 913 detected by means ofsensor 302. According to one embodiment inFIG. 10 , the object is a text and/or a graphic and/or a video and/or a widget. Then, theobject 415 inimage 411 disappears automatically. The application associated withobject 415 can continue to be shown on another 420, 430.display - While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the invention. Accordingly, the invention is not limited to the aforementioned embodiments.
-
- 110 steering wheel
- 111 grip area
- 112 steering column switch
- 120 dashboard
- 130 windshield
- 140 driver seat
- 150 passenger seat
- 161, 162 retainer
- 170 gear shift
- 200 circuit
- 201, 202 function block
- 301, 302 sensor, IR distance sensor
- 303, 304 input keypad
- 305 interior camera
- 306 microphone
- 311, 312, 313, 314 exterior camera
- 321, 322, 323, 329 outside distance sensors
- 330 satellite receiver
- 340 bus interface
- 350 transceiver
- 361, 362 NFC
- 410 head-up display
- 411 image
- 412, 422, 432 image data
- 419 projection area
- 420, 430 display
- 461, 462 cell phone, smartphone
- 900 hand
- 910, 911 steering movement
- 912, 913 hand gesture
- d, d1, d2, dth distance
- t time
- IR infrared light
- S301, S302 sensor signal
- S3 detection signal, command
- C, Cu(t), Cl(t) signal values, signal course
- C1, C2 amplitude
- Cp(t) pattern course
- α angle
Claims (13)
1. An input device for a motor vehicle having a dashboard and a steering wheel, the input device comprising:
a sensor; and
a circuit connected to the sensor,
wherein the sensor is positioned in the dashboard sensitive toward an area of the steering wheel,
wherein the sensor is configured to output a sensor signal based on a contactless hand gesture,
wherein the circuit is configured to evaluate the sensor signal, and
wherein the circuit and/or the sensor is configured to distinguish between a steering movement and the hand gesture, and
wherein the circuit is configured to output a detection signal (S3) based on the detection of the hand gesture.
2. The input device according to claim 1 ,
wherein the evaluation circuit is configured to determine an amplitude of the sensor signal and/or to control the amplitude of the sensor signal.
3. The input device according to claim 2 ,
wherein the evaluation circuit is configured to compare the amplitude (C) of the sensor signal with a threshold (th), whereby the threshold (th) is associated with a position (dth) of the hand in a space between the steering wheel and the sensor.
4. The input device according to claim 1 ,
wherein the evaluation circuit is configured to compare a course of the sensor signal (Cu(t), Cl(t)) with a pattern course (Cp(t)) associated with the hand gesture.
5. The input device according to claim 1 ,
wherein the circuit is configured, based on the sensor signal, to determine at least two distance values (C1, C2) associated with at least two different distances (d1, d2) between the hand and the sensor.
6. The input device according to claim 1 ,
wherein the sensor is configured to generate the sensor signal based on a direction of a movement of the hand.
7. The input device according to claim 1 ,
wherein the sensor and/or the circuit is configured to adjust a sensitivity of the sensor and/or the circuit.
8. The input device according to claim 1 ,
wherein the circuit is configured to initiate a command (S3) in an application program, which is assigned to the detection of the hand gesture based on an input by a user.
9. The input device according to claim 8 ,
wherein a type of the command (S3) depends on the currently displayed application program.
10. A system for a motor vehicle having a dashboard and a steering wheel and a windshield, the system comprising
a head-up display,
configured to project an image onto the windshield or onto a separate combiner; and
an input device,
wherein the circuit is connected to the head-up display and configured to generate the image, and
wherein the circuit is configured, based on the recognition of a hand gesture, to change the image.
11. The system according to claim 10 ,
wherein the circuit is configured to change the image based on an addition or removal of an object in the image, the object being associated with an application program running on the circuit.
12. The system according to claim 11 ,
wherein the circuit is configured to determine a selection input, the selection input being associated with a selection of an application program,
wherein the circuit is configured to output information associated with the application program on another display, and
wherein the object in the image of the head-up display includes information associated with the selected application program.
13. The system according to claim 10 , wherein the input device has a sensor and a circuit connected to the sensor and to the head-up display, wherein the sensor is positioned in the dashboard sensitive toward the steering wheel, wherein the hand gesture comprises a contactless hand gesture and the sensor is configured to output a sensor signal based on the contactless hand gesture, wherein the circuit is configured to evaluate the sensor signal, and wherein the circuit is configured to distinguish between a steering movement and the hand gesture and to output a detection signal based on the detection of the hand gesture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/654,491 US20150367859A1 (en) | 2012-12-21 | 2013-12-19 | Input device for a motor vehicle |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261745229P | 2012-12-21 | 2012-12-21 | |
| PCT/EP2013/003863 WO2014095070A1 (en) | 2012-12-21 | 2013-12-19 | Input device for a motor vehicle |
| US14/654,491 US20150367859A1 (en) | 2012-12-21 | 2013-12-19 | Input device for a motor vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20150367859A1 true US20150367859A1 (en) | 2015-12-24 |
Family
ID=49949609
Family Applications (5)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/654,441 Active 2035-05-31 US11008017B2 (en) | 2012-12-21 | 2013-12-19 | System for a vehicle and communication method |
| US14/654,467 Active US10029700B2 (en) | 2012-12-21 | 2013-12-19 | Infotainment system with head-up display for symbol projection |
| US14/654,477 Active 2034-04-21 US10081370B2 (en) | 2012-12-21 | 2013-12-19 | System for a vehicle |
| US14/654,491 Abandoned US20150367859A1 (en) | 2012-12-21 | 2013-12-19 | Input device for a motor vehicle |
| US14/654,484 Active 2034-05-20 US10071747B2 (en) | 2012-12-21 | 2013-12-19 | System for a vehicle |
Family Applications Before (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/654,441 Active 2035-05-31 US11008017B2 (en) | 2012-12-21 | 2013-12-19 | System for a vehicle and communication method |
| US14/654,467 Active US10029700B2 (en) | 2012-12-21 | 2013-12-19 | Infotainment system with head-up display for symbol projection |
| US14/654,477 Active 2034-04-21 US10081370B2 (en) | 2012-12-21 | 2013-12-19 | System for a vehicle |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/654,484 Active 2034-05-20 US10071747B2 (en) | 2012-12-21 | 2013-12-19 | System for a vehicle |
Country Status (4)
| Country | Link |
|---|---|
| US (5) | US11008017B2 (en) |
| EP (5) | EP2936847B1 (en) |
| JP (5) | JP2016509767A (en) |
| WO (5) | WO2014095070A1 (en) |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160089980A1 (en) * | 2013-05-23 | 2016-03-31 | Pioneer Corproation | Display control apparatus |
| US20160124514A1 (en) * | 2014-11-05 | 2016-05-05 | Samsung Electronics Co., Ltd. | Electronic device and method of controlling the same |
| US20160171320A1 (en) * | 2013-07-01 | 2016-06-16 | Pioneer Corporation | Imaging system |
| US9547373B2 (en) * | 2015-03-16 | 2017-01-17 | Thunder Power Hong Kong Ltd. | Vehicle operating system using motion capture |
| DE102016108878A1 (en) * | 2016-05-13 | 2017-11-16 | Visteon Global Technologies, Inc. | Display unit and method for displaying information |
| US9855817B2 (en) * | 2015-03-16 | 2018-01-02 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle operating system using motion capture |
| US9884586B2 (en) * | 2014-03-28 | 2018-02-06 | Pioneer Corporation | Vehicle lighting device |
| US9954260B2 (en) | 2015-03-16 | 2018-04-24 | Thunder Power New Energy Vehicle Development Company Limited | Battery system with heat exchange device |
| US10067341B1 (en) * | 2014-02-04 | 2018-09-04 | Intelligent Technologies International, Inc. | Enhanced heads-up display system |
| US10093284B2 (en) | 2015-03-16 | 2018-10-09 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle camera cleaning system |
| US20180299963A1 (en) * | 2015-12-18 | 2018-10-18 | Sony Corporation | Information processing apparatus, information processing method, and program |
| US10155530B2 (en) * | 2015-03-16 | 2018-12-18 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle control system for controlling steering of vehicle |
| US10173687B2 (en) | 2015-03-16 | 2019-01-08 | Wellen Sham | Method for recognizing vehicle driver and determining whether driver can start vehicle |
| US10322741B2 (en) * | 2014-12-09 | 2019-06-18 | Continental Automotive France | Method of interaction from the steering wheel between a user and an onboard system embedded in a vehicle |
| US10525787B2 (en) | 2015-03-16 | 2020-01-07 | Thunder Power New Energy Vehicle Development Company Limited | Electric vehicle thermal management system with series and parallel structure |
| US20200036411A1 (en) * | 2016-09-29 | 2020-01-30 | TB Deu Abwicklungs-Aktiengesellschaft | Vehicle components, switch to be arranged on a vehicle component, and method for producing a vehicle component |
| RU195563U1 (en) * | 2019-02-15 | 2020-01-31 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Саратовский национальный исследовательский государственный университет имени Н.Г. Чернышевского" | INTERACTIVE INFORMATION AND REFERENCE DEVICE |
| CN110816266A (en) * | 2018-08-07 | 2020-02-21 | 本田技研工业株式会社 | Display device, display control method, and storage medium |
| US10628020B2 (en) * | 2015-08-26 | 2020-04-21 | Fujifilm Corporation | Projection type display device |
| US10687403B2 (en) * | 2016-03-21 | 2020-06-16 | Koninklijke Philips N.V. | Adaptive lighting system for a mirror component and a method of controlling an adaptive lighting system |
| US10703211B2 (en) | 2015-03-16 | 2020-07-07 | Thunder Power New Energy Vehicle Development Company Limited | Battery pack, battery charging station, and charging method |
| US20210086754A1 (en) * | 2019-09-23 | 2021-03-25 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling vehicle |
| CN113497875A (en) * | 2020-03-20 | 2021-10-12 | 阿尔派株式会社 | Image processing device for vehicle |
| US12272277B1 (en) * | 2024-01-25 | 2025-04-08 | Fca Us Llc | Selectively operational heads-up display system for a vehicle |
Families Citing this family (123)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20230393867A1 (en) * | 2012-04-22 | 2023-12-07 | Emerging Automotive, Llc | Methods and Interfaces for Rendering Content on Display Screens of a Vehicle and Cloud Processing |
| JP6094399B2 (en) * | 2013-06-24 | 2017-03-15 | 株式会社デンソー | Head-up display and program |
| US10277837B2 (en) * | 2013-11-05 | 2019-04-30 | Visteon Global Technologies, Inc. | System and method for monitoring a driver of a vehicle |
| AU2015238339B2 (en) | 2014-03-25 | 2018-02-22 | Jaguar Land Rover Limited | Navigation system |
| GB2524514B (en) * | 2014-03-25 | 2017-08-16 | Jaguar Land Rover Ltd | Navigation system |
| US10444518B2 (en) * | 2014-03-31 | 2019-10-15 | Wayray Ag | Method of data display through the vehicle windscreen and device for its implementation |
| US20170004641A1 (en) * | 2014-04-14 | 2017-01-05 | Mitsubishi Electric Corporation | Display control device, display control method, and computer-readable medium for display control |
| JP6459205B2 (en) * | 2014-04-25 | 2019-01-30 | 日本精機株式会社 | Vehicle display system |
| US9672368B2 (en) * | 2014-04-30 | 2017-06-06 | Visteon Global Technologies, Inc. | Providing selective control of information shared from a first device to a second device |
| EP2958347B1 (en) * | 2014-06-17 | 2017-11-15 | Fujitsu Limited | Scheduling method and scheduling controller for wireless-connected apparatus |
| CN104125343A (en) * | 2014-08-11 | 2014-10-29 | 上海斐讯数据通信技术有限公司 | System and method for realizing scrolling of mobile phone scroll bar by accelerated air movement |
| DE102014014662A1 (en) * | 2014-09-19 | 2016-03-24 | Mekra Lang North America, Llc | Display device for vehicles, in particular commercial vehicles |
| FR3026502A1 (en) * | 2014-09-30 | 2016-04-01 | Valeo Comfort & Driving Assistance | SYSTEM AND METHOD FOR CONTROLLING EQUIPMENT OF A MOTOR VEHICLE |
| US9469248B2 (en) * | 2014-10-10 | 2016-10-18 | Honda Motor Co., Ltd. | System and method for providing situational awareness in a vehicle |
| US9547172B2 (en) * | 2014-10-13 | 2017-01-17 | Ford Global Technologies, Llc | Vehicle image display |
| JP6358038B2 (en) * | 2014-10-17 | 2018-07-18 | セイコーエプソン株式会社 | Head-mounted display device, method for controlling head-mounted display device, computer program |
| JP6421543B2 (en) * | 2014-10-17 | 2018-11-14 | セイコーエプソン株式会社 | Head-mounted display device, method for controlling head-mounted display device, computer program |
| DE102014116292A1 (en) * | 2014-11-07 | 2016-05-12 | Visteon Global Technologies, Inc. | System for transmitting information in a motor vehicle |
| US9690104B2 (en) | 2014-12-08 | 2017-06-27 | Hyundai Motor Company | Augmented reality HUD display method and device for vehicle |
| EP3031656B1 (en) * | 2014-12-10 | 2018-01-03 | Ricoh Company, Ltd. | Information provision device, information provision method, and carrier medium storing information provision program |
| KR101673305B1 (en) * | 2014-12-11 | 2016-11-22 | 현대자동차주식회사 | Head unit for providing streaming service between different device and streaming control method the same, and computer-readable medium storing program for executing the same |
| US9875576B2 (en) * | 2015-01-06 | 2018-01-23 | Clearag, Inc. | Three-dimensional visualization model of roadway information in a pavement condition analysis |
| CN105984387A (en) * | 2015-02-06 | 2016-10-05 | 德尔福电子(苏州)有限公司 | Aerial view monitor system with function of automatic aligning |
| EP3054371A1 (en) * | 2015-02-06 | 2016-08-10 | Nokia Technologies OY | Apparatus, method and computer program for displaying augmented information |
| JP6520668B2 (en) * | 2015-02-09 | 2019-05-29 | 株式会社デンソー | Display control device for vehicle and display unit for vehicle |
| JP6661883B2 (en) * | 2015-02-09 | 2020-03-11 | 株式会社デンソー | Vehicle display control device and vehicle display control method |
| CN107580795B (en) * | 2015-05-18 | 2021-06-08 | 杜塞尔多夫华为技术有限公司 | Mobile wireless communication device and method |
| JP6580872B2 (en) * | 2015-06-05 | 2019-09-25 | 株式会社デンソーテン | Driving support device and driving support method |
| DE102015216108A1 (en) * | 2015-08-24 | 2017-03-02 | Continental Automotive Gmbh | Method for triggering at least one processing step by assigning an information element to a device |
| JP2017052460A (en) * | 2015-09-11 | 2017-03-16 | クラリオン株式会社 | Hud system, hud device, and hud display information generation method |
| JP6703747B2 (en) * | 2015-09-18 | 2020-06-03 | 株式会社リコー | Information display device, information providing system, mobile device, information display method and program |
| GB2545074B (en) * | 2015-10-26 | 2020-03-11 | Active Knowledge Ltd | Utilizing vehicle window shading to improve quality of video viewed with a head-mounted display |
| US9469195B1 (en) * | 2015-11-17 | 2016-10-18 | International Business Machines Corporation | Adaptive, automatically-reconfigurable, vehicle instrument display |
| US9581457B1 (en) | 2015-12-03 | 2017-02-28 | At&T Intellectual Property I, L.P. | System and method for displaying points of interest on a heads-up display |
| EP3384475B1 (en) * | 2015-12-06 | 2021-12-22 | Cerence Operating Company | System and method of conversational adjustment based on user's cognitive state |
| US20170169612A1 (en) | 2015-12-15 | 2017-06-15 | N.S. International, LTD | Augmented reality alignment system and method |
| EP3394833B1 (en) | 2015-12-21 | 2020-01-29 | Robert Bosch GmbH | Dynamic image blending for multiple-camera vehicle systems |
| JP6543185B2 (en) * | 2015-12-22 | 2019-07-10 | クラリオン株式会社 | In-vehicle device |
| KR101916993B1 (en) * | 2015-12-24 | 2018-11-08 | 엘지전자 주식회사 | Display apparatus for vehicle and control method thereof |
| US9913111B2 (en) | 2015-12-29 | 2018-03-06 | At&T Mobility Ii Llc | Device pairing for textual communications |
| DE102016200608A1 (en) * | 2016-01-19 | 2017-07-20 | Bayerische Motoren Werke Aktiengesellschaft | Method for arranging and displaying graphical elements of a representation of a vehicle navigation system |
| JP6414096B2 (en) | 2016-02-17 | 2018-10-31 | トヨタ自動車株式会社 | In-vehicle device, control method for in-vehicle device, and control program for in-vehicle device |
| US20170248434A1 (en) * | 2016-02-29 | 2017-08-31 | Blake Dearring Best | Car-top mount with population density estimation |
| US9942861B2 (en) | 2016-03-21 | 2018-04-10 | At&T Mobility Ii Llc | Facilitation of link loss reduction for radio antennas |
| EP3437949B1 (en) * | 2016-03-28 | 2023-12-27 | Nippon Seiki Co., Ltd. | Display device |
| IL245334B (en) * | 2016-04-21 | 2018-10-31 | Elbit Systems Ltd | Head wearable display reliability verification |
| US10021029B2 (en) | 2016-05-11 | 2018-07-10 | International Business Machines Corporation | Method for routing incoming communication |
| US9855860B2 (en) * | 2016-05-19 | 2018-01-02 | Waymo Llc | Second row priority seating for vehicles |
| US11400997B2 (en) * | 2016-05-23 | 2022-08-02 | Indian Motorcycle International, LLC | Display systems and methods for a recreational vehicle |
| WO2017209313A1 (en) * | 2016-05-30 | 2017-12-07 | 엘지전자 주식회사 | Vehicle display device and vehicle |
| WO2017208180A1 (en) * | 2016-06-01 | 2017-12-07 | Sharma Ruchita | System and method for seamless navigation |
| US10142674B2 (en) | 2016-06-03 | 2018-11-27 | Rovi Guides, Inc. | Systems and methods for aggressively recording content when a user is not at home |
| FR3053804B1 (en) * | 2016-07-05 | 2018-08-17 | Valeo Comfort & Driving Assistance | HEAD-UP DISPLAY AND METHOD FOR CONTROLLING A DEVICE FOR GENERATING IMAGES OF A HEAD-UP DISPLAY |
| US9809165B1 (en) | 2016-07-12 | 2017-11-07 | Honda Motor Co., Ltd. | System and method for minimizing driver distraction of a head-up display (HUD) in a vehicle |
| US20180017799A1 (en) * | 2016-07-13 | 2018-01-18 | Ford Global Technologies, Llc | Heads Up Display For Observing Vehicle Perception Activity |
| JP6834537B2 (en) * | 2017-01-30 | 2021-02-24 | 株式会社リコー | Display device, mobile device, manufacturing method and display method of display device. |
| WO2018032417A1 (en) * | 2016-08-17 | 2018-02-22 | 华为技术有限公司 | Context-based mode control method, and mobile terminal |
| JP6462194B2 (en) * | 2016-09-26 | 2019-01-30 | 富士フイルム株式会社 | Projection display device, projection display method, and projection display program |
| US10867445B1 (en) * | 2016-11-16 | 2020-12-15 | Amazon Technologies, Inc. | Content segmentation and navigation |
| DE102016224166B3 (en) * | 2016-12-05 | 2018-05-30 | Continental Automotive Gmbh | Head-Up Display |
| US10051128B2 (en) * | 2016-12-06 | 2018-08-14 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Rerouting electronic communications to trusted user's device while a primary user is occupied |
| KR102751144B1 (en) * | 2016-12-16 | 2025-01-08 | 현대자동차주식회사 | Vehicle and controlling method of vehicle |
| US10045157B2 (en) * | 2017-01-05 | 2018-08-07 | International Business Machines Corporation | Targeting notifications intended for drivers to a trusted automobile passenger |
| TWI634474B (en) * | 2017-01-23 | 2018-09-01 | 合盈光電科技股份有限公司 | Audiovisual system with gesture recognition |
| JP6930120B2 (en) * | 2017-02-02 | 2021-09-01 | 株式会社リコー | Display device, mobile device and display method. |
| DE102017202466B4 (en) * | 2017-02-15 | 2019-08-08 | Audi Ag | Controlling a headlamp of a motor vehicle |
| EP3409553B1 (en) * | 2017-06-01 | 2021-08-04 | Honda Research Institute Europe GmbH | System and method for automated execution of a maneuver or behavior of a system |
| EP3655794B1 (en) * | 2017-07-20 | 2021-05-05 | Signify Holding B.V. | A device for positioning information at a location in an image |
| US10300789B2 (en) * | 2017-07-25 | 2019-05-28 | Denso International America, Inc. | Vehicle heads-up display |
| KR102397089B1 (en) | 2017-07-28 | 2022-05-12 | 삼성전자주식회사 | Method of processing images and apparatus thereof |
| JP6991794B2 (en) * | 2017-08-29 | 2022-01-13 | 矢崎総業株式会社 | Vehicle display device and display control method |
| JP2019049505A (en) * | 2017-09-12 | 2019-03-28 | 矢崎総業株式会社 | Display device for vehicle and display control method |
| JP2019054395A (en) * | 2017-09-14 | 2019-04-04 | オムロン株式会社 | Display device |
| KR102434580B1 (en) | 2017-11-09 | 2022-08-22 | 삼성전자주식회사 | Method and apparatus of dispalying virtual route |
| US20190161010A1 (en) * | 2017-11-30 | 2019-05-30 | Panasonic Automotive Systems Company Of America, Division Of Panasonic Corporation Of North America | High visibility head up display (hud) |
| KR102547823B1 (en) * | 2017-12-13 | 2023-06-26 | 삼성전자주식회사 | Method and device to visualize content |
| WO2019131143A1 (en) * | 2017-12-27 | 2019-07-04 | ソニー株式会社 | Information processing device, information processing method, and program |
| DE102018103092A1 (en) * | 2018-02-12 | 2019-08-14 | Arnold & Richter Cine Technik Gmbh & Co. Betriebs Kg | Focus setting display unit |
| US11676425B2 (en) * | 2018-03-08 | 2023-06-13 | Geotoll, Inc. | System and method for speech recognition for occupancy detection in high occupancy toll applications |
| DE102018203927A1 (en) * | 2018-03-15 | 2019-09-19 | Volkswagen Aktiengesellschaft | A method, apparatus and computer readable storage medium having instructions for controlling a display of an augmented reality display device for a motor vehicle |
| US10597042B2 (en) * | 2018-03-27 | 2020-03-24 | Intel Corporation | User gesture directed object detection and recognition in a vehicle |
| JP7037764B2 (en) * | 2018-03-29 | 2022-03-17 | 株式会社リコー | Travel route guidance device, mobile body, travel route guidance method and program |
| US11059421B2 (en) | 2018-03-29 | 2021-07-13 | Honda Motor Co., Ltd. | Vehicle proximity system using heads-up display augmented reality graphics elements |
| CN110365952B (en) * | 2018-04-11 | 2022-05-31 | 京东方科技集团股份有限公司 | A viewing angle test method and test system for a projection display device |
| JP6523522B2 (en) * | 2018-04-25 | 2019-06-05 | 京セラ株式会社 | Electronic device, electronic device control method, and electronic device control program |
| US10760918B2 (en) | 2018-06-13 | 2020-09-01 | Here Global B.V. | Spatiotemporal lane maneuver delay for road navigation |
| DE102018209934A1 (en) * | 2018-06-20 | 2019-12-24 | Bayerische Motoren Werke Aktiengesellschaft | Field of view display device for a motor vehicle |
| US10880533B2 (en) * | 2018-06-25 | 2020-12-29 | Canon Kabushiki Kaisha | Image generation apparatus, image generation method, and storage medium, for generating a virtual viewpoint image |
| US20200019782A1 (en) * | 2018-07-13 | 2020-01-16 | International Business Machines Corporation | Accommodating object occlusion in point-of-view displays |
| US10850746B2 (en) * | 2018-07-24 | 2020-12-01 | Harman International Industries, Incorporated | Coordinating delivery of notifications to the driver of a vehicle to reduce distractions |
| JP6668564B1 (en) * | 2018-08-29 | 2020-03-18 | 京セラ株式会社 | Head-up display, head-up display system, and moving object |
| US11537354B2 (en) | 2018-09-13 | 2022-12-27 | Maxell, Ltd. | Head-up display system |
| CN109547925A (en) * | 2018-12-07 | 2019-03-29 | 纳恩博(北京)科技有限公司 | Location updating method, the display methods of position and navigation routine, vehicle and system |
| FR3089644A1 (en) * | 2018-12-07 | 2020-06-12 | Psa Automobiles Sa | Head-up display device for vehicle |
| JP7293648B2 (en) * | 2018-12-21 | 2023-06-20 | トヨタ自動車株式会社 | Driving support device, vehicle, driving support system, and driving support method |
| JP6827609B2 (en) * | 2019-01-10 | 2021-02-10 | 三菱電機株式会社 | Information display control devices and methods, as well as programs and recording media |
| JP2020117184A (en) * | 2019-01-28 | 2020-08-06 | 株式会社東海理化電機製作所 | Operation recognition device, computer program, and storage medium |
| JP6876277B2 (en) * | 2019-03-29 | 2021-05-26 | 株式会社リコー | Control device, display device, display method and program |
| US10860095B2 (en) * | 2019-05-02 | 2020-12-08 | Cognixion | Dynamic eye-tracking camera alignment utilizing eye-tracking maps |
| CN110213730B (en) * | 2019-05-22 | 2022-07-15 | 未来(北京)黑科技有限公司 | Method and device for establishing call connection, storage medium and electronic device |
| DE102019208649B3 (en) * | 2019-06-13 | 2020-01-02 | Volkswagen Aktiengesellschaft | Control of a display of an augmented reality head-up display device for a motor vehicle |
| US10885819B1 (en) * | 2019-08-02 | 2021-01-05 | Harman International Industries, Incorporated | In-vehicle augmented reality system |
| CN112406727B (en) * | 2019-08-23 | 2022-06-10 | 比亚迪股份有限公司 | Vehicle and control method and device of multi-screen system |
| US10996480B1 (en) * | 2019-10-11 | 2021-05-04 | GM Global Technology Operations LLC | Head-up display calibration |
| CN114667474B (en) * | 2019-10-23 | 2024-12-10 | 艾哈迈德·苏莱曼·艾哈迈德·阿尔穆萨 | Smart glass for vehicle |
| US11386871B2 (en) * | 2019-12-18 | 2022-07-12 | Continental Automotive Systems, Inc. | Instrumentation perspective and light emulator |
| KR102862959B1 (en) | 2020-01-02 | 2025-09-22 | 삼성전자 주식회사 | Apparatus and method for displaying navigation information of three dimention augmented reality |
| JP7439563B2 (en) * | 2020-02-26 | 2024-02-28 | トヨタ自動車株式会社 | Driving support device |
| US11080993B1 (en) * | 2020-03-26 | 2021-08-03 | Qualcomm Incorporated | Vehicle to everything communication management according to a vulnerable roadside user device configuration |
| DE112020007352B4 (en) * | 2020-09-01 | 2024-07-11 | Mitsubishi Electric Corporation | MANAGEMENT INSTITUTION, PROGRAM AND MANAGEMENT PROCEDURES |
| US20220242234A1 (en) * | 2020-09-11 | 2022-08-04 | Stephen Favis | System integrating autonomous driving information into head up display |
| JP7515384B2 (en) * | 2020-11-30 | 2024-07-12 | 本田技研工業株式会社 | Display method and system |
| US11450204B2 (en) * | 2020-12-01 | 2022-09-20 | Verizon Patent And Licensing Inc. | Systems and methods for fiber optic based vehicle-direction detection |
| CN114756156A (en) * | 2020-12-25 | 2022-07-15 | 群创光电股份有限公司 | Electronic device |
| KR20220107537A (en) * | 2021-01-25 | 2022-08-02 | 주식회사 와이즈오토모티브 | Apparatus for generating front image for heavy equipment |
| DE102021202666A1 (en) | 2021-03-18 | 2022-09-22 | Volkswagen Aktiengesellschaft | Dynamic AR hint |
| JP7767738B2 (en) * | 2021-06-01 | 2025-11-12 | マツダ株式会社 | Head-up display device |
| CN113468702B (en) * | 2021-07-22 | 2024-03-22 | 久瓴(江苏)数字智能科技有限公司 | Pipeline arrangement method, pipeline arrangement device and computer readable storage medium |
| DE102021211139B3 (en) | 2021-10-04 | 2023-03-16 | Volkswagen Aktiengesellschaft | Method for controlling a display device and vehicle with a display device |
| KR20240065750A (en) * | 2022-11-07 | 2024-05-14 | 현대모비스 주식회사 | Method And System for Providing Entertainment |
| US12387601B2 (en) * | 2022-12-08 | 2025-08-12 | Toyota Connected North America, Inc. | Vehicle determination for media collaboration |
| AU2024233376A1 (en) * | 2023-03-03 | 2025-07-03 | Kodiak Robotics, Inc. | Sensor pod with user interface and method of two-way communication with sensor pod |
| CN118939223A (en) * | 2023-05-09 | 2024-11-12 | 本田技研工业株式会社 | Display control system and display control method thereof |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050063564A1 (en) * | 2003-08-11 | 2005-03-24 | Keiichi Yamamoto | Hand pattern switch device |
| US20060136846A1 (en) * | 2004-12-20 | 2006-06-22 | Sung-Ho Im | User interface apparatus using hand gesture recognition and method thereof |
| US20070075919A1 (en) * | 1995-06-07 | 2007-04-05 | Breed David S | Vehicle with Crash Sensor Coupled to Data Bus |
| US20080069403A1 (en) * | 1995-06-07 | 2008-03-20 | Automotive Technologies International, Inc. | Face Monitoring System and Method for Vehicular Occupants |
| WO2012144217A1 (en) * | 2011-04-22 | 2012-10-26 | パナソニック株式会社 | Input device for vehicle and input method for vehicle |
| US20130076615A1 (en) * | 2010-11-18 | 2013-03-28 | Mike Iao | Interface method and apparatus for inputting information with air finger gesture |
| US20130134730A1 (en) * | 2011-11-16 | 2013-05-30 | Flextronics Ap, Llc | Universal console chassis for the car |
Family Cites Families (106)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US1863257A (en) * | 1929-03-28 | 1932-06-14 | Armen H Tashjian | Combination steel joist and decking for floor construction |
| JPH0825410B2 (en) | 1987-06-23 | 1996-03-13 | 日産自動車株式会社 | Vehicle display |
| JPH06147909A (en) * | 1992-11-04 | 1994-05-27 | Honda Motor Co Ltd | Vehicle running guide device |
| JPH09102098A (en) * | 1995-10-03 | 1997-04-15 | Honda Motor Co Ltd | Information display device for vehicles |
| JPH09123848A (en) | 1995-11-06 | 1997-05-13 | Toyota Motor Corp | Information display device for vehicles |
| JPH1096776A (en) * | 1996-09-24 | 1998-04-14 | Honda Access Corp | Display device for inter vehicle distance |
| US5757268A (en) * | 1996-09-26 | 1998-05-26 | United Technologies Automotive, Inc. | Prioritization of vehicle display features |
| JPH10339646A (en) * | 1997-06-10 | 1998-12-22 | Toyota Motor Corp | Guide display system for car |
| US6289332B2 (en) | 1999-02-26 | 2001-09-11 | Freightliner Corporation | Integrated message display system for a vehicle |
| JP3575346B2 (en) * | 1999-09-03 | 2004-10-13 | 日本電気株式会社 | Road white line detection system, road white line detection method, and recording medium recording road white line detection program |
| DE19962666A1 (en) * | 1999-12-23 | 2001-07-05 | Siemens Ag | Method for reconstructing 3D image data relating to a volume of interest of an examination object |
| JP2001270346A (en) * | 2000-03-24 | 2001-10-02 | Nissan Motor Co Ltd | Display device for vehicles |
| DE10045303C2 (en) * | 2000-09-12 | 2003-04-30 | Siemens Ag | Communication device of a motor vehicle and method for producing a call diversion |
| JP2002107161A (en) * | 2000-10-03 | 2002-04-10 | Matsushita Electric Ind Co Ltd | Route guidance device for moving objects |
| US6807464B2 (en) * | 2002-01-02 | 2004-10-19 | International Business Machines Corporation | Systems and methods for distributing information to an operator of a vehicle |
| US6926429B2 (en) * | 2002-01-30 | 2005-08-09 | Delphi Technologies, Inc. | Eye tracking/HUD system |
| JP2003341383A (en) * | 2002-05-29 | 2003-12-03 | Denso Corp | Display device for vehicles |
| US6998972B2 (en) * | 2002-10-31 | 2006-02-14 | General Motors Corporation | Driving workload estimation |
| US20040214596A1 (en) | 2003-04-22 | 2004-10-28 | Chulhee Lee | Systems and methods for mobile communications |
| US7292152B2 (en) * | 2003-06-12 | 2007-11-06 | Temic Automotive Of North America, Inc. | Method and apparatus for classifying vehicle operator activity state |
| JP2005063090A (en) * | 2003-08-11 | 2005-03-10 | Keio Gijuku | Hand pattern switch device |
| JP4104532B2 (en) * | 2003-11-10 | 2008-06-18 | 本田技研工業株式会社 | Vehicle control device |
| JP2005201635A (en) * | 2004-01-13 | 2005-07-28 | Denso Corp | Navigation system for vehicle |
| JP4389708B2 (en) * | 2004-07-21 | 2009-12-24 | 株式会社デンソー | Vehicle display device and display method thereof |
| WO2006063603A1 (en) * | 2004-12-14 | 2006-06-22 | Bayerische Motoren Werke Aktiengesellschaft | System for utilizing at least one mobile terminal device in a motor vehicle |
| JP4277802B2 (en) * | 2005-01-14 | 2009-06-10 | 株式会社デンソー | In-vehicle phone system, in-vehicle communication device and mobile phone |
| DE102005010843B4 (en) * | 2005-03-07 | 2019-09-19 | Volkswagen Ag | Head-up display of a motor vehicle |
| JP2006285370A (en) * | 2005-03-31 | 2006-10-19 | Mitsubishi Fuso Truck & Bus Corp | Hand pattern switch device and hand pattern operation method |
| JP2006284458A (en) | 2005-04-01 | 2006-10-19 | Denso Corp | Driving support information display system |
| JP2006300786A (en) * | 2005-04-22 | 2006-11-02 | Alpine Electronics Inc | Apparatus and system for detecting object |
| ES2325374T3 (en) * | 2005-05-03 | 2009-09-02 | Seac02 S.R.L. | INCREASED REALITY SYSTEM WITH IDENTIFICATION OF REAL MARKER OBJECT. |
| CN1863257A (en) * | 2005-05-10 | 2006-11-15 | 英华达股份有限公司 | Regulation of mobile communication devices, automobiles and control devices that perform intended functions of automobiles |
| JP2006343194A (en) * | 2005-06-08 | 2006-12-21 | Mitsubishi Heavy Ind Ltd | Car navigation system |
| WO2007000030A1 (en) * | 2005-06-29 | 2007-01-04 | National Ict Australia Limited | Measuring cognitive load |
| US7394393B2 (en) * | 2005-08-02 | 2008-07-01 | Gm Global Technology Operations, Inc. | Adaptive driver workload estimator |
| JP2007045169A (en) * | 2005-08-05 | 2007-02-22 | Aisin Aw Co Ltd | Information processor for vehicle |
| JP2007081498A (en) * | 2005-09-12 | 2007-03-29 | Nec Access Technica Ltd | Portable communication terminal |
| DE102006010478A1 (en) * | 2006-03-07 | 2007-09-13 | Robert Bosch Gmbh | Method and arrangement for displaying navigation instructions |
| JP4788426B2 (en) * | 2006-03-23 | 2011-10-05 | 株式会社デンソー | Vehicle display system |
| DE102006032118B4 (en) * | 2006-07-12 | 2022-03-03 | Volkswagen Ag | Instrument cluster for a motor vehicle and motor vehicle |
| JP2008168799A (en) * | 2007-01-12 | 2008-07-24 | Calsonic Kansei Corp | Display unit for vehicle |
| JP4980737B2 (en) * | 2007-01-30 | 2012-07-18 | 株式会社デンソー | Vehicle information presentation device |
| JP2010531478A (en) * | 2007-04-26 | 2010-09-24 | フォード グローバル テクノロジーズ、リミテッド ライアビリティ カンパニー | Emotional advice system and method |
| JP2009020089A (en) * | 2007-06-12 | 2009-01-29 | Panasonic Corp | NAVIGATION DEVICE, NAVIGATION METHOD, AND NAVIGATION PROGRAM |
| JP2009029203A (en) * | 2007-07-25 | 2009-02-12 | Honda Motor Co Ltd | Driving assistance device |
| DE102007035769A1 (en) * | 2007-07-27 | 2009-02-26 | Continental Automotive Gmbh | Motor vehicle cockpit |
| JP5228439B2 (en) * | 2007-10-22 | 2013-07-03 | 三菱電機株式会社 | Operation input device |
| DE102007058295A1 (en) * | 2007-12-05 | 2009-06-10 | Audi Ag | Display device for motor vehicle |
| JP5067217B2 (en) * | 2008-03-18 | 2012-11-07 | アイシン・エィ・ダブリュ株式会社 | Traffic information processing system, statistical processing device, traffic information processing method, and traffic information processing program |
| JP2009246505A (en) * | 2008-03-28 | 2009-10-22 | Toshiba Corp | Image display apparatus and image display method |
| EP2306434B1 (en) * | 2008-06-25 | 2015-01-21 | Toyota Jidosha Kabushiki Kaisha | Driving support apparatus |
| US8525728B2 (en) | 2008-06-25 | 2013-09-03 | Autoliv Development Ab | Method of detecting object in the vicinity of a vehicle |
| KR20100026466A (en) * | 2008-08-29 | 2010-03-10 | 엘지전자 주식회사 | Head up display system and method for adjusting video display angle thereof |
| JP4686586B2 (en) * | 2008-09-19 | 2011-05-25 | 株式会社東芝 | In-vehicle display device and display method |
| JP4886751B2 (en) * | 2008-09-25 | 2012-02-29 | 株式会社東芝 | In-vehicle display system and display method |
| JP2010096874A (en) * | 2008-10-15 | 2010-04-30 | Nippon Seiki Co Ltd | Display device for vehicle |
| DE102008060766A1 (en) * | 2008-12-05 | 2009-09-03 | Daimler Ag | Vehicle i.e. motor vehicle, has head-up-display-system coupled with navigation system in such manner that visual driving references of navigation system are represented dynamically on vehicle windscreen |
| JP5161760B2 (en) * | 2008-12-26 | 2013-03-13 | 株式会社東芝 | In-vehicle display system and display method |
| JP2010184600A (en) * | 2009-02-12 | 2010-08-26 | Autonetworks Technologies Ltd | Onboard gesture switch device |
| KR101163446B1 (en) * | 2009-03-18 | 2012-07-18 | 기아자동차주식회사 | A lane departure warning system using a virtual lane and a system according to the same |
| US8350724B2 (en) * | 2009-04-02 | 2013-01-08 | GM Global Technology Operations LLC | Rear parking assist on full rear-window head-up display |
| US8395529B2 (en) * | 2009-04-02 | 2013-03-12 | GM Global Technology Operations LLC | Traffic infrastructure indicator on head-up display |
| US8269652B2 (en) * | 2009-04-02 | 2012-09-18 | GM Global Technology Operations LLC | Vehicle-to-vehicle communicator on full-windshield head-up display |
| DE102009032069A1 (en) * | 2009-07-07 | 2011-01-13 | Volkswagen Aktiengesellschaft | Method and device for providing a user interface in a vehicle |
| WO2011015843A2 (en) * | 2009-08-07 | 2011-02-10 | Light Blue Optics Ltd | Head up displays |
| US8503762B2 (en) * | 2009-08-26 | 2013-08-06 | Jacob Ben Tzvi | Projecting location based elements over a heads up display |
| US8315617B2 (en) * | 2009-10-31 | 2012-11-20 | Btpatent Llc | Controlling mobile device functions |
| CN102667888B (en) * | 2009-11-27 | 2014-12-31 | 丰田自动车株式会社 | Drive assistance device and drive assistance method |
| US8755949B2 (en) * | 2009-12-22 | 2014-06-17 | Electronics And Telecommunications Research Institute | Telematics system using human body communication, portable device having telematics function using human body communication, and method for providing telematics service using human body communication |
| US8659658B2 (en) * | 2010-02-09 | 2014-02-25 | Microsoft Corporation | Physical interaction zone for gesture-based user interfaces |
| US8416263B2 (en) * | 2010-03-08 | 2013-04-09 | Empire Technology Development, Llc | Alignment of objects in augmented reality |
| JP2011253097A (en) * | 2010-06-03 | 2011-12-15 | Toshiba Corp | Display device and display method |
| US9213522B2 (en) * | 2010-07-29 | 2015-12-15 | Ford Global Technologies, Llc | Systems and methods for scheduling driver interface tasks based on driver workload |
| US8902254B1 (en) * | 2010-09-02 | 2014-12-02 | The Boeing Company | Portable augmented reality |
| US20130208938A1 (en) * | 2010-10-21 | 2013-08-15 | Vivek Midha | Systems of apparel with inbuilt devices for communication, entertainment, learning and health monitoring |
| US8457686B2 (en) | 2010-12-02 | 2013-06-04 | General Motors Llc | Method of communication between a vehicle telematics unit and a call center |
| KR101544524B1 (en) * | 2010-12-16 | 2015-08-17 | 한국전자통신연구원 | Display system for augmented reality in vehicle, and method for the same |
| US9113050B2 (en) * | 2011-01-13 | 2015-08-18 | The Boeing Company | Augmented collaboration system |
| JP5818242B2 (en) * | 2011-01-18 | 2015-11-18 | 株式会社ユピテル | System and program |
| US20120224060A1 (en) * | 2011-02-10 | 2012-09-06 | Integrated Night Vision Systems Inc. | Reducing Driver Distraction Using a Heads-Up Display |
| US20140276090A1 (en) * | 2011-03-14 | 2014-09-18 | American Vehcular Sciences Llc | Driver health and fatigue monitoring system and method using optics |
| JP5331146B2 (en) | 2011-03-22 | 2013-10-30 | 株式会社東芝 | Monocular head mounted display |
| KR20120113579A (en) * | 2011-04-05 | 2012-10-15 | 현대자동차주식회사 | Apparatus and method for displaying road guide information on the windshield |
| EP2511137B1 (en) * | 2011-04-14 | 2019-03-27 | Harman Becker Automotive Systems GmbH | Vehicle Surround View System |
| EP2530647A1 (en) * | 2011-06-01 | 2012-12-05 | Harman Becker Automotive Systems GmbH | Method of calibrating a vehicle vision system and vehicle vision system |
| JP5811605B2 (en) * | 2011-06-08 | 2015-11-11 | セイコーエプソン株式会社 | Display device |
| EP2723625B1 (en) * | 2011-06-22 | 2017-08-09 | TK Holdings Inc. | Sensor system for steering wheel for vehicle |
| US8688321B2 (en) * | 2011-07-11 | 2014-04-01 | Ford Global Technologies, Llc | Traffic density estimation |
| TWI468645B (en) * | 2011-11-09 | 2015-01-11 | Altek Autotronics Corp | Blind spot detection alert system |
| US9443429B2 (en) * | 2012-01-24 | 2016-09-13 | GM Global Technology Operations LLC | Optimum gaze location on full windscreen display |
| EP2629506A1 (en) * | 2012-02-15 | 2013-08-21 | Harman Becker Automotive Systems GmbH | Two-step brightness adjustment in around-view systems |
| KR101793628B1 (en) * | 2012-04-08 | 2017-11-06 | 삼성전자주식회사 | Transparent display apparatus and method thereof |
| JP6102117B2 (en) * | 2012-08-08 | 2017-03-29 | ソニー株式会社 | MOBILE BODY, SYSTEM, PROGRAM, AND INFORMATION PROCESSING DEVICE |
| US8766710B1 (en) * | 2012-08-10 | 2014-07-01 | Cambridge Silicon Radio Limited | Integrated circuit |
| US9429912B2 (en) * | 2012-08-17 | 2016-08-30 | Microsoft Technology Licensing, Llc | Mixed reality holographic object development |
| KR101866860B1 (en) * | 2012-09-04 | 2018-06-14 | 엘지전자 주식회사 | Electronic device and control method for the electronic device |
| US8996197B2 (en) * | 2013-06-20 | 2015-03-31 | Ford Global Technologies, Llc | Lane monitoring with electronic horizon |
| US9216745B2 (en) * | 2013-09-16 | 2015-12-22 | Disney Enterprises, Inc. | Shared control of semi-autonomous vehicles including collision avoidance in multi-agent scenarios |
| US9630631B2 (en) * | 2013-10-03 | 2017-04-25 | Honda Motor Co., Ltd. | System and method for dynamic in-vehicle virtual reality |
| EP3031656B1 (en) * | 2014-12-10 | 2018-01-03 | Ricoh Company, Ltd. | Information provision device, information provision method, and carrier medium storing information provision program |
| US9754417B2 (en) * | 2014-12-31 | 2017-09-05 | Canon Information And Imaging Solutions, Inc. | Methods and systems for displaying virtual objects |
| US9685005B2 (en) * | 2015-01-02 | 2017-06-20 | Eon Reality, Inc. | Virtual lasers for interacting with augmented reality environments |
| JP6402684B2 (en) * | 2015-06-10 | 2018-10-10 | トヨタ自動車株式会社 | Display device |
| KR101942793B1 (en) * | 2015-07-03 | 2019-01-28 | 엘지전자 주식회사 | Driver Assistance Apparatus and Vehicle Having The Same |
| JP5945999B1 (en) * | 2015-07-31 | 2016-07-05 | パナソニックIpマネジメント株式会社 | Driving support device, driving support system, driving support method, driving support program, and autonomous driving vehicle |
| US9809231B2 (en) * | 2015-10-28 | 2017-11-07 | Honda Motor Co., Ltd. | System and method for executing gesture based control of a vehicle system |
-
2013
- 2013-12-19 US US14/654,441 patent/US11008017B2/en active Active
- 2013-12-19 US US14/654,467 patent/US10029700B2/en active Active
- 2013-12-19 WO PCT/EP2013/003863 patent/WO2014095070A1/en not_active Ceased
- 2013-12-19 EP EP13824119.5A patent/EP2936847B1/en active Active
- 2013-12-19 WO PCT/EP2013/003864 patent/WO2014095071A1/en not_active Ceased
- 2013-12-19 JP JP2015548284A patent/JP2016509767A/en active Pending
- 2013-12-19 WO PCT/EP2013/003862 patent/WO2014095069A2/en not_active Ceased
- 2013-12-19 JP JP2015548286A patent/JP2016500352A/en active Pending
- 2013-12-19 US US14/654,477 patent/US10081370B2/en active Active
- 2013-12-19 US US14/654,491 patent/US20150367859A1/en not_active Abandoned
- 2013-12-19 EP EP13824306.8A patent/EP2936283A1/en not_active Withdrawn
- 2013-12-19 WO PCT/EP2013/003860 patent/WO2014095067A1/en not_active Ceased
- 2013-12-19 WO PCT/EP2013/003861 patent/WO2014095068A1/en not_active Ceased
- 2013-12-19 EP EP13818982.4A patent/EP2936235B1/en active Active
- 2013-12-19 EP EP13820735.2A patent/EP2936065B1/en active Active
- 2013-12-19 EP EP13828977.2A patent/EP2936240B1/en active Active
- 2013-12-19 JP JP2015548283A patent/JP2016506572A/en active Pending
- 2013-12-19 JP JP2015548285A patent/JP2016503741A/en active Pending
- 2013-12-19 US US14/654,484 patent/US10071747B2/en active Active
- 2013-12-19 JP JP2015548282A patent/JP2016503918A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070075919A1 (en) * | 1995-06-07 | 2007-04-05 | Breed David S | Vehicle with Crash Sensor Coupled to Data Bus |
| US20080069403A1 (en) * | 1995-06-07 | 2008-03-20 | Automotive Technologies International, Inc. | Face Monitoring System and Method for Vehicular Occupants |
| US20050063564A1 (en) * | 2003-08-11 | 2005-03-24 | Keiichi Yamamoto | Hand pattern switch device |
| US20060136846A1 (en) * | 2004-12-20 | 2006-06-22 | Sung-Ho Im | User interface apparatus using hand gesture recognition and method thereof |
| US20130076615A1 (en) * | 2010-11-18 | 2013-03-28 | Mike Iao | Interface method and apparatus for inputting information with air finger gesture |
| WO2012144217A1 (en) * | 2011-04-22 | 2012-10-26 | パナソニック株式会社 | Input device for vehicle and input method for vehicle |
| US20130090807A1 (en) * | 2011-04-22 | 2013-04-11 | Yoshihiro Kojima | Vehicular input device and vehicular input method |
| US20130134730A1 (en) * | 2011-11-16 | 2013-05-30 | Flextronics Ap, Llc | Universal console chassis for the car |
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160089980A1 (en) * | 2013-05-23 | 2016-03-31 | Pioneer Corproation | Display control apparatus |
| US20160171320A1 (en) * | 2013-07-01 | 2016-06-16 | Pioneer Corporation | Imaging system |
| US10061995B2 (en) * | 2013-07-01 | 2018-08-28 | Pioneer Corporation | Imaging system to detect a trigger and select an imaging area |
| US10067341B1 (en) * | 2014-02-04 | 2018-09-04 | Intelligent Technologies International, Inc. | Enhanced heads-up display system |
| US11397518B2 (en) * | 2014-03-28 | 2022-07-26 | Pioneer Corporation | Vehicle lighting device |
| US11644965B2 (en) | 2014-03-28 | 2023-05-09 | Pioneer Corporation | Vehicle lighting device |
| US10189404B2 (en) * | 2014-03-28 | 2019-01-29 | Pioneer Corporation | Vehicle lighting device |
| US9884586B2 (en) * | 2014-03-28 | 2018-02-06 | Pioneer Corporation | Vehicle lighting device |
| US11899920B2 (en) | 2014-03-28 | 2024-02-13 | Pioneer Corporation | Vehicle lighting device |
| US20180118105A1 (en) * | 2014-03-28 | 2018-05-03 | Pioneer Corporation | Vehicle lighting device |
| US12340081B2 (en) | 2014-03-28 | 2025-06-24 | Pioneer Corporation | Vehicle lighting device |
| US20190106054A1 (en) * | 2014-03-28 | 2019-04-11 | Pioneer Corporation | Vehicle lighting device |
| US20160124514A1 (en) * | 2014-11-05 | 2016-05-05 | Samsung Electronics Co., Ltd. | Electronic device and method of controlling the same |
| US10322741B2 (en) * | 2014-12-09 | 2019-06-18 | Continental Automotive France | Method of interaction from the steering wheel between a user and an onboard system embedded in a vehicle |
| US9855817B2 (en) * | 2015-03-16 | 2018-01-02 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle operating system using motion capture |
| US10479327B2 (en) | 2015-03-16 | 2019-11-19 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle camera cleaning system |
| US10173687B2 (en) | 2015-03-16 | 2019-01-08 | Wellen Sham | Method for recognizing vehicle driver and determining whether driver can start vehicle |
| US10124648B2 (en) | 2015-03-16 | 2018-11-13 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle operating system using motion capture |
| US10093284B2 (en) | 2015-03-16 | 2018-10-09 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle camera cleaning system |
| US10281989B2 (en) | 2015-03-16 | 2019-05-07 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle operating system using motion capture |
| US9954260B2 (en) | 2015-03-16 | 2018-04-24 | Thunder Power New Energy Vehicle Development Company Limited | Battery system with heat exchange device |
| US10155530B2 (en) * | 2015-03-16 | 2018-12-18 | Thunder Power New Energy Vehicle Development Company Limited | Vehicle control system for controlling steering of vehicle |
| US10525787B2 (en) | 2015-03-16 | 2020-01-07 | Thunder Power New Energy Vehicle Development Company Limited | Electric vehicle thermal management system with series and parallel structure |
| US9547373B2 (en) * | 2015-03-16 | 2017-01-17 | Thunder Power Hong Kong Ltd. | Vehicle operating system using motion capture |
| US10703211B2 (en) | 2015-03-16 | 2020-07-07 | Thunder Power New Energy Vehicle Development Company Limited | Battery pack, battery charging station, and charging method |
| US10628020B2 (en) * | 2015-08-26 | 2020-04-21 | Fujifilm Corporation | Projection type display device |
| US10963063B2 (en) * | 2015-12-18 | 2021-03-30 | Sony Corporation | Information processing apparatus, information processing method, and program |
| US20180299963A1 (en) * | 2015-12-18 | 2018-10-18 | Sony Corporation | Information processing apparatus, information processing method, and program |
| US10687403B2 (en) * | 2016-03-21 | 2020-06-16 | Koninklijke Philips N.V. | Adaptive lighting system for a mirror component and a method of controlling an adaptive lighting system |
| DE102016108878A1 (en) * | 2016-05-13 | 2017-11-16 | Visteon Global Technologies, Inc. | Display unit and method for displaying information |
| EP3246745A1 (en) * | 2016-05-13 | 2017-11-22 | Visteon Global Technologies, Inc. | Display unit and method for representing information |
| US20200036411A1 (en) * | 2016-09-29 | 2020-01-30 | TB Deu Abwicklungs-Aktiengesellschaft | Vehicle components, switch to be arranged on a vehicle component, and method for producing a vehicle component |
| CN110816266A (en) * | 2018-08-07 | 2020-02-21 | 本田技研工业株式会社 | Display device, display control method, and storage medium |
| RU195563U1 (en) * | 2019-02-15 | 2020-01-31 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Саратовский национальный исследовательский государственный университет имени Н.Г. Чернышевского" | INTERACTIVE INFORMATION AND REFERENCE DEVICE |
| US20210086754A1 (en) * | 2019-09-23 | 2021-03-25 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling vehicle |
| US11685365B2 (en) * | 2019-09-23 | 2023-06-27 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling vehicle |
| US20230278542A1 (en) * | 2019-09-23 | 2023-09-07 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling vehicle |
| US11964650B2 (en) * | 2019-09-23 | 2024-04-23 | Samsung Electronics Co., Ltd. | Apparatus and method for controlling vehicle |
| CN113497875A (en) * | 2020-03-20 | 2021-10-12 | 阿尔派株式会社 | Image processing device for vehicle |
| US12272277B1 (en) * | 2024-01-25 | 2025-04-08 | Fca Us Llc | Selectively operational heads-up display system for a vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| US20150331238A1 (en) | 2015-11-19 |
| WO2014095068A1 (en) | 2014-06-26 |
| EP2936847A2 (en) | 2015-10-28 |
| EP2936235A1 (en) | 2015-10-28 |
| US10071747B2 (en) | 2018-09-11 |
| EP2936235B1 (en) | 2021-10-13 |
| US10081370B2 (en) | 2018-09-25 |
| JP2016500352A (en) | 2016-01-12 |
| EP2936240B1 (en) | 2022-05-18 |
| WO2014095069A3 (en) | 2014-08-21 |
| JP2016509767A (en) | 2016-03-31 |
| US10029700B2 (en) | 2018-07-24 |
| WO2014095071A8 (en) | 2015-07-16 |
| WO2014095071A1 (en) | 2014-06-26 |
| EP2936065B1 (en) | 2023-05-17 |
| WO2014095070A1 (en) | 2014-06-26 |
| EP2936065A1 (en) | 2015-10-28 |
| EP2936240A1 (en) | 2015-10-28 |
| JP2016503741A (en) | 2016-02-08 |
| EP2936847B1 (en) | 2019-11-20 |
| WO2014095069A2 (en) | 2014-06-26 |
| US11008017B2 (en) | 2021-05-18 |
| WO2014095067A1 (en) | 2014-06-26 |
| US20150331487A1 (en) | 2015-11-19 |
| JP2016506572A (en) | 2016-03-03 |
| JP2016503918A (en) | 2016-02-08 |
| US20150331236A1 (en) | 2015-11-19 |
| US20150358471A1 (en) | 2015-12-10 |
| EP2936283A1 (en) | 2015-10-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20150367859A1 (en) | Input device for a motor vehicle | |
| US20160132126A1 (en) | System for information transmission in a motor vehicle | |
| US11124118B2 (en) | Vehicular display system with user input display | |
| KR101367593B1 (en) | Interactive operating device and method for operating the interactive operating device | |
| CN107107841B (en) | Information processing apparatus | |
| CN102470757B (en) | For providing the method and apparatus of user interface in the car | |
| JP5124397B2 (en) | Automotive Input/Output Devices | |
| US10471894B2 (en) | Method and apparatus for controlling vehicular user interface under driving circumstance | |
| US10209832B2 (en) | Detecting user interactions with a computing system of a vehicle | |
| JP2018531332A6 (en) | Apparatus and method for visually communicating with a vehicle | |
| JP2018531332A (en) | Apparatus and method for visually communicating with a vehicle | |
| JP5141878B2 (en) | Touch operation input device | |
| US20140236454A1 (en) | Control Device for a Motor Vehicle and Method for Operating the Control Device for a Motor Vehicle | |
| KR101946746B1 (en) | Positioning of non-vehicle objects in the vehicle | |
| KR20180091732A (en) | User interface, means of transport and method for distinguishing a user | |
| KR101491169B1 (en) | Device and method for controlling AVN of vehicle | |
| JPWO2014087523A1 (en) | Electronics | |
| JP2017197015A (en) | On-board information processing system | |
| RU2410259C2 (en) | Interactive control device and method of operating interactive control device | |
| KR101709129B1 (en) | Apparatus and method for multi-modal vehicle control | |
| JP2018103646A (en) | Vehicle information display device and vehicle information display program | |
| JP6390380B2 (en) | Display operation device | |
| TWM564749U (en) | Vehicle multi-display control system | |
| EP3054371A1 (en) | Apparatus, method and computer program for displaying augmented information | |
| WO2017188098A1 (en) | Vehicle-mounted information processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ROTH, HANS;REEL/FRAME:040604/0212 Effective date: 20161110 |
|
| STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |