[go: up one dir, main page]

EP1733190B1 - Procede et systeme de presentation d'informations - Google Patents

Procede et systeme de presentation d'informations Download PDF

Info

Publication number
EP1733190B1
EP1733190B1 EP04803400.3A EP04803400A EP1733190B1 EP 1733190 B1 EP1733190 B1 EP 1733190B1 EP 04803400 A EP04803400 A EP 04803400A EP 1733190 B1 EP1733190 B1 EP 1733190B1
Authority
EP
European Patent Office
Prior art keywords
information
vision
person
foveal
peripheral
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP04803400.3A
Other languages
German (de)
English (en)
Other versions
EP1733190A1 (fr
Inventor
Trent Victor
Johan Jarlengrip
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Volvo Technology AB
Original Assignee
Volvo Technology AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/EP2003/013479 external-priority patent/WO2005055189A1/fr
Application filed by Volvo Technology AB filed Critical Volvo Technology AB
Priority to EP04803400.3A priority Critical patent/EP1733190B1/fr
Publication of EP1733190A1 publication Critical patent/EP1733190A1/fr
Application granted granted Critical
Publication of EP1733190B1 publication Critical patent/EP1733190B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/365Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22Display screens
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23Head-up displays [HUD]
    • B60K35/235Head-up displays [HUD] with means for detecting the driver's gaze direction or eye points
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80Arrangements for controlling instruments
    • B60K35/81Arrangements for controlling instruments for controlling displays
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18Information management
    • B60K2360/184Displaying the same information on different displays
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20Optical features of instruments
    • B60K2360/33Illumination features
    • B60K2360/334Projection means

Definitions

  • the invention relates to a method and system for presenting or reproducing information in a viewing especially of a driver of a vehicle, or a train, or a captain of a ship, or a pilot of an airplane or of any other person who has to gaze in a certain direction, especially for observing or monitoring the environment like for example a road in case of a vehicle driver.
  • SE 0201571-7 discloses a device for indicating an operational state of a vehicle comprising a display unit which shows graphical information in the form of an arc shaped scale extending from a first angle to a second angle and a number of numerals.
  • the operational state is indicated by a first segment which extends from the first angle to a third variable angle and which assumes a state that is visually distinguishable from the second segment between the third and the second angle.
  • each numeral is arranged to be able to assume a first normal format and a second larger format, wherein the latter is activated in the area around the relevant operational state.
  • This device is provided to reduce the time for transmitting the information concerned, like for example the speed of a vehicle, while retaining the precision, whereby the driver is able to keep his attention directed towards the current driving situation to a greater extent.
  • JP 07-280592A discloses a meter device for a vehicle, wherein a display mode of the meter device can be altered between a peripheral vision mode and a central vision mode in response to a judgment of a driver's sight line being separated from the meter device or not.
  • a general object of this invention is to provide a method and system by which the above mentioned risks can be further reduced and the safety especially of driving a vehicle can be further increased.
  • an object of the invention to provide a method and system for presenting or reproducing information in such a way that especially a person mentioned in the first paragraph who is operating a vehicle, airplane, ship or train, is less impaired with respect to his ability to detect changes in the environment, when reading such information.
  • a driver of a vehicle is enabled to read or recognize information by peripheral vision when his gaze is not directed at, or close to, an in-vehicle display or head-up display.
  • the information is presented by means of a display device in such a way that the driver's eye movements towards the information image (i. e. the presentation or reproduction of the information) and subsequent eye-fixations upon the information image are not necessary.
  • the information is readable or recognizable without having to move the eyes off the road.
  • the information is presented as simply and large enough to enable information extraction by peripheral vision.
  • the visual acuity of a human eye is greatest at the gaze point a person is looking at (which is defined as the visual 0° direction or gaze direction) and an area which extends to about 3° around the gaze point (angle of eccentricity).
  • This area of maximum of visual acuity is called foveal vision area or fovea.
  • the area surrounding this foveal vision area is called peripheral vision area in which the visual acuity decreases with increasing angle from the visual 0° or gaze direction (or eccentricity).
  • the area between 3° and 10° is also called the parafovea.
  • Figure 1 shows a diagram of this relative acuity V of vision (vertical axis) of a human eye in the nasal and temporal (i.e. to the temple) angular direction on the retina R in degree (horizontal axis) wherein 0° denotes the gaze direction.
  • the blind spot on the retina is indicated by a black area.
  • information is presented to a driver in such a way (especially with respect to its magnitude and/or thickness of letters or symbols and/or complexity and volume of content) that he can recognize it only by his foveal vision but not by his peripheral vision. This has the consequence that every time the driver wants to read such information he has to direct his view away from the road and onto the display on which the information is presented or reproduced.
  • the size of the information like especially text and line size of the presented or reproduced information, have to be enlarged and simplified to compensate for the loss of visual acuity in peripheral vision.
  • the amount of such enlargement and simplification increases according to Figure 1 in dependency on the angle of eccentricity in which the information is presented relative to the gaze direction.
  • the rules for the enlargement and simplification of information can be determined by trial and error or from the above established knowledge of contingencies.
  • a regression line can be used as an alternative to determine this enlargement.
  • Figure 2 shows such an equal magnification of letters on the basis of this equation (2) at ten times stimuli threshold size. If the viewer's gaze is directed on the central dot then the letters surrounding this dot are nearly equally "good” readable.
  • Figure 3 shows a side view into the cabin C of a vehicle with a driver D who is driving the vehicle and shows a preferred embodiment of a system for presenting or reproducing information according to the invention.
  • a main component of this system is a control device 10 for receiving information data to be displayed to the driver D and for processing these data so that at least one of the display devices 21, 22, 23 can be controlled for presenting or reproducing the information data to the driver D.
  • a first display device is for example a laser projector 21 which is provided and installed to project the information data for example onto a certain location of the windscreen of the vehicle or onto the dashboard.
  • a second display device is for example a usual screen 22 installed at a dashboard, and a third display device is for example a head-down display 23 (or a head-up display) for presenting the information data to the driver.
  • display device is used in this disclosure to refer to any source of visual information presentation to the driver.
  • displays include conventional computer displays, e.g. Liquid Crystal Displays (LCD) or similar, used to present GPS-based navigation and map information or other electronic devices, displays in the instrument panel, head-up displays, light emitting diodes (LEDs), and other projection displays.
  • LCD Liquid Crystal Displays
  • LEDs light emitting diodes
  • Helmet-mounted-, visor-mounted-, eyeglass-mounted displays can also be used.
  • a projection display is a commercially available diode laser (see e.g. www.lasershow.se) which is capable of producing color picture stimuli.
  • a picture stimulus is made up of a single laser beam which is moved around so quickly that the impression of an image is generated.
  • the beam is controlled by two small electromagnetic motors (x-, and y-axis) with a small mirror on the motor axis.
  • the use of a number of different lasers is advantageous, including a red and/or blue and/or green laser.
  • a simple, inexpensive laser such as those commonly used for as pointing devices for presentations in an auditorium; an automotive grade laser could be used as well.
  • the system comprises a push button or switch 30 on the instrument panel or steering wheel to be operated by the driver D for switching the system between a "Peripheral-Vision Information On"-state and a "Foveal-Vision Information On”-state.
  • the gaze position of the driver D is not detected and evaluated.
  • This system is designed in such a way that the driver D can decide by operating the push button or switch 30 whether the information is presented or reproduced by one of the display devices 21, 22, 23 in a way so that it is adapted to be recognized by peripheral vision or by foveal vision.
  • the control device 10 is provided to control the display device(s) 21, 22, 23 such that in the "Foveal-Vision Information On"-state the information is presented or reproduced for the foveal vision of the driver and in the "Peripheral-Vision Information On”-state the information is presented or reproduced for the peripheral vision of the driver.
  • the size of the peripheral information presentation or reproduction has to be enlarged and possibly simplified in comparison to the foveal vision presentation or reproduction as explained above.
  • the magnification and simplification for the peripheral information presentation/reproduction is predetermined and preset as fixed values either on the basis of eccentricity to the road center.
  • the above equations (1) or (2) can be used or they are evaluated by try and error.
  • the information is presented with a smaller size according to the enhanced visual acuity, e. g. by projecting the related image onto the windscreen in a location which is in the foveal vision area of the driver D.
  • the driver D can additionally select which kind of information he wants to be presented either in his foveal vision and/or in his peripheral vision.
  • peripheral presentation/reproduction of information can be provided either magnified (and possibly simplified) so that it is readable when directing the gaze onto the road, or in the usual manner i.e. without any magnification so that the driver can read it only when directing his gaze away from the road onto the related display.
  • Such selections can especially be made for reasons of a limited area to present information because the peripherally indicated information is presented in large size.
  • the selection can be made on the basis of the importance of the information. For example most relevant information like safety or collision warning is presented or reproduced in the foveal vision, less important information like navigation information is presented or reproduced peripherally and enlarged and simplified for recognizing in peripheral vision and all other information is presented or reproduced peripherally as well but in normal size for recognizing only when directing the gaze on it.
  • Another switch (not shown) can preferably be provided for selecting these types of information.
  • Examples of information-types that could be presented or reproduced are current speed, navigation information, text messages, or gear information. If the technological prerequisites (like especially transponders, camera based image processing for sign recognition, information rich digital maps which are based on GPS or other navigation systems) are provided, then traffic information can be presented to the driver in a readable peripheral vision format. Examples of such traffic information are current speed limit, traffic lights, the texts and images found on current road signs, information regarding upcoming hazards etc..

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Claims (9)

  1. Procédé de présentation ou de reproduction d'informations dans le champ de vision d'une personne au moyen d'au moins un dispositif d'affichage,
    caractérisé en ce que la présentation ou la reproduction des informations par ledit au moins un dispositif d'affichage peut être sélectionnée par la personne pour une reconnaissance par la vision fovéale ou par la vision périphérique, et
    dans lequel la présentation ou la reproduction des informations est adaptée selon la sélection par rapport à leur grandeur et/ou à leur taille et/ou à leur contraste et/ou à leur intensité selon que les informations doivent être reconnues par la vision fovéale ou par la vision périphérique de la personne.
  2. Procédé selon la revendication 1,
    dans lequel des types prédéterminés d'informations sont présentés ou reproduits pour être reconnus par la vision fovéale et/ou par la vision périphérique de la personne.
  3. Procédé selon la revendication 2,
    dans lequel des informations relatives à la sécurité sont présentées ou reproduites pour être reconnues par la vision fovéale et/ou par la vision périphérique de la personne.
  4. Procédé selon la revendication 1,
    dans lequel la personne peut sélectionner le type d'informations qu'elle souhaite voir présenté dans sa vision fovéale et/ou dans sa vision périphérique.
  5. Système de présentation ou de reproduction d'informations dans le champ de vision d'une personne, en particulier pour exécuter un procédé selon la revendication 1, comprenant:
    - au moins un dispositif d'affichage (21, 22, 23);
    - caractérisé par un bouton poussoir ou un commutateur (30) à actionner par la personne pour commuter le système entre un état "informations pour vision périphérique actif" et un état "informations pour vision fovéale actif"; et
    - un dispositif de commande (10) pour commander ledit au moins un dispositif d'affichage (21, 22, 23) selon l'actionnement du commutateur, pour adapter la présentation ou la reproduction des informations par rapport à leur grandeur et/ou à leur taille et/ou à leur contraste et/ou à leur intensité selon que les informations doivent être reconnues par la vision fovéale ou par la vision périphérique de la personne.
  6. Système selon la revendication 5,
    dans lequel le dispositif d'affichage est un affichage par projection (21) ou un écran (22) ou un affichage tête basse ou tête haute (23) ou un affichage monté sur un casque, monté sur un viseur ou monté sur des lunettes.
  7. Programme d'ordinateur comprenant des moyens de code de programme d'ordinateur adaptés pour réaliser un procédé selon au moins une des revendications 1 à 4 lorsque ledit programme est exécuté sur un micro-ordinateur programmable.
  8. Programme d'ordinateur selon la revendication 7 adapté pour être téléchargé sur un système selon la revendication 5 ou l'un de ses composants lorsqu'il est exécuté sur un ordinateur connecté à l'Internet.
  9. Produit de programme d'ordinateur stocké sur un support lisible par un ordinateur, comprenant des moyens de code de programme d'ordinateur selon la revendication 7.
EP04803400.3A 2003-12-01 2004-12-01 Procede et systeme de presentation d'informations Expired - Lifetime EP1733190B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP04803400.3A EP1733190B1 (fr) 2003-12-01 2004-12-01 Procede et systeme de presentation d'informations

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
PCT/EP2003/013479 WO2005055189A1 (fr) 2003-12-01 2003-12-01 Affichages d'ameliorations perceptives bases sur la connaissance de la position de la tete et/ou des yeux et/ou du regard
PCT/EP2004/013631 WO2005054786A1 (fr) 2003-12-01 2004-12-01 Procede et systeme de presentation d'informations
EP04803400.3A EP1733190B1 (fr) 2003-12-01 2004-12-01 Procede et systeme de presentation d'informations

Publications (2)

Publication Number Publication Date
EP1733190A1 EP1733190A1 (fr) 2006-12-20
EP1733190B1 true EP1733190B1 (fr) 2014-08-06

Family

ID=37398472

Family Applications (1)

Application Number Title Priority Date Filing Date
EP04803400.3A Expired - Lifetime EP1733190B1 (fr) 2003-12-01 2004-12-01 Procede et systeme de presentation d'informations

Country Status (1)

Country Link
EP (1) EP1733190B1 (fr)

Also Published As

Publication number Publication date
EP1733190A1 (fr) 2006-12-20

Similar Documents

Publication Publication Date Title
US8497880B2 (en) Method and system for presenting information
US6774772B2 (en) Attention control for operators of technical equipment
EP1611560B1 (fr) Procede et dispositif pour alerter le pilote d'un vehicule qui devie d'une zone de conduite definie sur une voie
US6876307B1 (en) System for assisting the operator of a technical appliance
US6906619B2 (en) Visual attention influenced condition indicia apparatus and method
CN102343819B (zh) 车辆显示装置,设置有车辆显示装置的车辆
JP4830384B2 (ja) 情報表示方法、表示制御装置、情報表示装置
CN103359118B (zh) 车辆瞥视光设备和用于控制该车辆瞥视光设备的方法
CN110116619B (zh) 用于在车辆的抬头显示器hud中显示信息的方法
US20180067307A1 (en) Heads-up display windshield
EP3031654B1 (fr) Appareil d'affichage pour un véhicule automobile comprenant un dispositif écran, système d'assistance au conducteur, véhicule et procédé
US20070262971A1 (en) Method and device for operating an optical display device
JP4501778B2 (ja) 車両用情報表示方法及び車両用情報表示装置
CN114248624B (zh) 车辆用显示装置
EP1733190B1 (fr) Procede et systeme de presentation d'informations
US12252014B2 (en) Vehicle display control for color-impaired viewers
CN116963926A (zh) 使用增强现实平视显示器的改善的可视化显示
Kooi et al. Peripheral motion displays: tapping the potential of the visual periphery
KR102709950B1 (ko) 차량의 클러스터 및 hud 통합 제어시스템
KR102640693B1 (ko) 차량의 클러스터 및 hud 통합 제어시스템
JP2025073452A (ja) 虚像表示装置及び虚像表示方法
Knoll et al. Human-Machine Interface: How to Make It Simple and Effective
Brown et al. Optimization suggestions for instrument‐cluster information using displays
JP2022181848A (ja) 表示制御装置、表示装置、及び表示制御方法
JP2018192999A (ja) 視線誘導装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20060629

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20130718

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20140226

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 681255

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140815

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602004045603

Country of ref document: DE

Effective date: 20140918

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 681255

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140806

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20140806

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141209

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141107

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141206

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602004045603

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602004045603

Country of ref document: DE

26N No opposition filed

Effective date: 20150507

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141201

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20141201

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20150831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150701

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141201

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20041201

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140806