[go: up one dir, main page]

WO1999012137A1 - Dispositif de detection de l'assoupissement/de la vigilance - Google Patents

Dispositif de detection de l'assoupissement/de la vigilance Download PDF

Info

Publication number
WO1999012137A1
WO1999012137A1 PCT/US1998/018658 US9818658W WO9912137A1 WO 1999012137 A1 WO1999012137 A1 WO 1999012137A1 US 9818658 W US9818658 W US 9818658W WO 9912137 A1 WO9912137 A1 WO 9912137A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
drowsiness
head
eye
motion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US1998/018658
Other languages
English (en)
Inventor
Henrietta L. Galiana
Ian W. Hunter
Lynette A. Jones
James L. Tangora
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Massachusetts Institute of Technology
Original Assignee
Massachusetts Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Massachusetts Institute of Technology filed Critical Massachusetts Institute of Technology
Publication of WO1999012137A1 publication Critical patent/WO1999012137A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1103—Detecting muscular movement of the eye, e.g. eyelid movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20—Workers
    • A61B2503/22—Motor vehicles operators, e.g. drivers, pilots, captains
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813—Specially adapted to be attached to a specific body part
    • A61B5/6814—Head
    • A61B5/6821—Eye

Definitions

  • the present invention pertains to a method and apparatus for monitoring alertness of a subject on the basis of saccade frequency and other physiological measures and for providing an alarm in case of detected drowsiness.
  • a method for detecting drowsiness of a subject has the steps of monitoring motion of the head of the subject in at least one dimension, measuring motion of one or both eyes of the subject, deriving at least one physiological indicator based on motion of the head and eye or eyes, and comparing the derived physiological indicator or indicators with predetermined ranges of acceptable values in such a manner as to determine any onset of drowsiness in the subject.
  • the physiological indicator is selected from the group of gaze stability, saccade speed, saccade frequency, blink duration, and instrument- world scanning performance. Additionally, one or more alarms may be triggered based on the onset of drowsiness for restoring alertness of the subject.
  • Gaze stability has the components of stability of the eye within the head and of the head in space.
  • involuntary (reflex) characteristics such as those described may be monitored quantitatively in order to detect the onset of drowsiness.
  • Eye and head movements are measured, allowing saccades, blinks, and an estimate of the gain of the vestibular-ocular reflex (VOR) to be derived.
  • VOR vestibular-ocular reflex
  • These data may be linked to the scanning performance of the subject; for example, the relative dwell-time on various instruments or external targets, etc.
  • the dwell time on such instruments or targets may, furthermore, be correlated with appropriate values based on the impact of the information provided by each to an alert subject.
  • specified thresholds, and appropriate combinatorial logic is used to automate the alertness monitor and to trigger alarms, of a visual or non- visual nature, in accordance with the nature of the task being performed by the subject.
  • FIG. 1 a schematic diagram is shown of an apparatus, designated generally by numeral 10, for monitoring the alertness of a subject, in accordance with a preferred embodiment of the present invention.
  • a Head Tracker 12 tracks motion of the head of the subject in at least one dimension.
  • Head Tracker 12 may be magnetically-based (Polhemus or Ascension), for example, or inertial-based (DC accelerometer, push-pull linear accelerometer, for example) tracker and may provide a single coordinate as a function of time.
  • Eye Tracker 14 provides a signal E corresponding to the direction of regard of one or both of the eyes of the subject.
  • Eye angles may be measured and converted to electrical signals, with the eye angles referred, for example, to the nasal direction.
  • Data streams E and H are digitized and prefiltered by signal conditioning unit 16, and are preferably recorded in memory and/or fixed in recording media. In either case, bandwidth exceeding 20 Hz is preferred.
  • the digitized data stream corresponding to signals E and H are designated E' and H', respectively.
  • the head and eye position data are used by a VOR processor 18 to calculate the ideal conjugate VOR gain, taking into account the context, or, equivalently, the vergence, where the vergence set point is the sum of the two eye angles referenced to the nasal direction.
  • the ideal or expected VOR may be referred to as the 'model' VOR. Since ocular responses in any protocol contain nystagmus, the signal analysis includes automatic classification of eye (or gaze) slow and fast phases, based, for example, on classification software described by Rey & Galiana, "Parametric classification of segments in ocular nystagmus," IEEE Trans. Biomed. Eng.. vol. 38, (1991), pp. 142-48, which is incorporated herein by reference. A U.S.
  • Classification processor 20 sorts responses of the eyes into intervals corresponding to a slow phase and a fast phase (saccades), separately flagging blinks.
  • Alarm processor 22 corrects for context
  • alarm processor 22 may calculate the fraction of time spent by the subject viewing targets in different sectors of the field of view of the subject. For example, if the subject is the operator of a vehicle such as a ground vehicle or an aircraft, the percentage of time spent by the operator viewing internal instruments and targets outside the vehicle may be calculated by processor 22.
  • Alarm processor 22 applies specified thresholds and logical criteria, such as the conjunction of a first threshold with respect to a first criterion with a second threshold with respect to another criterion, in order to determine
  • Such implementation may include a series of computer instructions fixed either on a tangible medium, such as a computer readable medium (e.g., a diskette, CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or other interface device, such as a communications adapter connected to a network over a medium.
  • the medium may be either a tangible medium (e.g., optical or analog communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques).
  • the series of computer instructions embodies all or part of the functionality previously described herein with respect to the system. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems.
  • Such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies.
  • a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the network (e.g., the Internet or World Wide Web).
  • a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the network (e.g., the Internet or World Wide Web).
  • some embodiments of the invention may be implemented as a combination of both software (e.g., a computer program product) and hardware.
  • Still other embodiments of the invention are implemented as entirely hardware, or entirely software (e.g., a computer program product). Analysis of data obtained by performing the method described above is now discussed. Both eye movement (providing signal E) and head it becomes possible to monitor gaze in space (E+H) which is the preferable variable for detecting the occurrence of saccades. Often, natural head turns can be associated with saccades or fast phases whose velocity with respect to the head is zero, while gaze velocity with respect to a fixed frame of reference is still in the range of saccades. The true neural determinant of saccade occurrence is the silencing of Pause cells in the brainstem and the release of activity on saccade-related Burst cells nearby. The speed of eye movements in the head is not a robust indicator; gaze in space is a preferred choice so long as the body is reasonably stationary in the environment in which the subject is operating.
  • the measured saccadic rate inasmuch as it is a measure of burst activation rate, provides an advantageous measure of drowsiness.
  • this measure is complemented by estimates of VOR gain. While VOR gain is typically greater or equal to 0.6 while viewing targets in the far field, even in the dark, it is known that VOR gain may decrease significantly during drowsiness.
  • VOR gain and its correction for the current vergence set-point is discussed in Viire et al., A Re examination of the Gain of the Vestibulo-Ocular Reflex, Journal of.
  • Eg, E L monocular horizontal eye angles (right, left), in degrees, with negative angles for nasal deviations;
  • Eg +E L the vergence angle, in degrees, subtended by the two lines of sight;
  • Eg -E L conjugate eye deviations, in degrees, with rightward with respect to the head defined as the positive sense
  • H v horizontal head velocity, in deg-s "1 , positive is rightward as seen from above the head;
  • Ev conJ conjugate eye velocity, in deg-s "1 , the time-derivative of Eg -E L * the two eyes of the subject;
  • I total interocular distance, center-to-center, in mm.
  • VOR gain is a function of the depth of a target of interest
  • the two eyes are preferably monitored separately.
  • the expected ideal conjugate VOR gain may be corrected for the current vergence set-point according to the approximate formula:
  • VOR ⁇ Ev conj /H v - -1 - R(E R +EJ (cos E R + cos EJ / (21) . (1)
  • the ideal gain when fixating at infinity is -1 (when vergence is zero), and quickly increases in magnitude with convergence angle. It is within the scope of the invention to apply calibration schemes to account for variability in head geometry across subjects.
  • an alarm flagging possible drowsiness results form processing the particular combination of reflex VOR performance (e.g., gaze stability), saccade rate, and, in some cases, blink frequency and/or duration.
  • Recognition of a drowsiness state in terms of these variables or a subset thereof may be implemented, in accordance with an embodiment of the invention, using known techniques of non-linear processing including, for example, simple pattern detection with neural networks or other non-linear filters.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Multimedia (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Human Computer Interaction (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Theoretical Computer Science (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

L'invention traite d'un procédé et d'un dispositif permettant d'analyser l'assoupissement d'une personne. Ce dispositif de surveillance mesure le déplacement de la tête d'une personne et le déplacement de l'un ou des deux yeux d'une personne dans au moins une dimension. Ensuite, ce dispositif dérive au moins une indication physiologique telle que la stabilité du regard, la vitesse des saccades, la fréquence de ces saccades, la durée du clignement des yeux et la perception des objets et de l'environnement de cette personne. L'indicateur physiologique, ou les indicateurs physiologiques, est/sont comparé(s) à des plages prédéterminées de valeurs acceptables de manière à déterminer un début d'assoupissement chez ladite personne.
PCT/US1998/018658 1997-09-05 1998-09-04 Dispositif de detection de l'assoupissement/de la vigilance Ceased WO1999012137A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US5810397P 1997-09-05 1997-09-05
US60/058,103 1997-09-05

Publications (1)

Publication Number Publication Date
WO1999012137A1 true WO1999012137A1 (fr) 1999-03-11

Family

ID=22014700

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1998/018658 Ceased WO1999012137A1 (fr) 1997-09-05 1998-09-04 Dispositif de detection de l'assoupissement/de la vigilance

Country Status (1)

Country Link
WO (1) WO1999012137A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012021316A3 (fr) * 2010-08-09 2012-06-07 Uop Llc Procédé d'hydrocraquage sélectif pour la production soit de pétrole soit de distillat
WO2013031138A1 (fr) * 2011-08-26 2013-03-07 Canon Kabushiki Kaisha Dispositif de mesure du clignement d'œil, procédé associé et programme
RU2477881C1 (ru) * 2011-11-24 2013-03-20 Федеральное государственное бюджетное образовательное учреждение высшего профессионального образования "Санкт-Петербургский торгово-экономический институт" Способ обеспечения защищенности автоматизированной системы
US9545224B2 (en) 2010-11-08 2017-01-17 Optalert Australia Pty Ltd Fitness for work test
JP2017023519A (ja) * 2015-07-24 2017-02-02 株式会社デンソー 状態推定装置および状態推定プログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2215040A (en) * 1988-02-13 1989-09-13 William George David Ritchie A method and apparatus for monitoring the driver of a vehicle
US5293427A (en) * 1990-12-14 1994-03-08 Nissan Motor Company, Ltd. Eye position detecting system and method therefor
US5570698A (en) * 1995-06-02 1996-11-05 Siemens Corporate Research, Inc. System for monitoring eyes for detecting sleep behavior
DE19613614A1 (de) * 1995-05-10 1996-11-14 Mitsubishi Electric Corp Vorrichtung zur Bearbeitung eines Bildes eines Gesichts

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2215040A (en) * 1988-02-13 1989-09-13 William George David Ritchie A method and apparatus for monitoring the driver of a vehicle
US5293427A (en) * 1990-12-14 1994-03-08 Nissan Motor Company, Ltd. Eye position detecting system and method therefor
DE19613614A1 (de) * 1995-05-10 1996-11-14 Mitsubishi Electric Corp Vorrichtung zur Bearbeitung eines Bildes eines Gesichts
US5570698A (en) * 1995-06-02 1996-11-05 Siemens Corporate Research, Inc. System for monitoring eyes for detecting sleep behavior

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
UENO H ET AL: "DEVELOPMENT OF DROWSINESS DETECTION SYSTEM", PROCEEDINGS OF THE VEHICLE NAVIGATION AND INFORMATION SYSTEMS CONFERENCE, YOKOHAMA, AUG. 31 - SEPT. 2, 1994, 31 August 1994 (1994-08-31), INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS, pages 15 - 20, XP000641294 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012021316A3 (fr) * 2010-08-09 2012-06-07 Uop Llc Procédé d'hydrocraquage sélectif pour la production soit de pétrole soit de distillat
US9545224B2 (en) 2010-11-08 2017-01-17 Optalert Australia Pty Ltd Fitness for work test
WO2013031138A1 (fr) * 2011-08-26 2013-03-07 Canon Kabushiki Kaisha Dispositif de mesure du clignement d'œil, procédé associé et programme
CN103764015A (zh) * 2011-08-26 2014-04-30 佳能株式会社 眨眼测量设备及其方法和程序
RU2477881C1 (ru) * 2011-11-24 2013-03-20 Федеральное государственное бюджетное образовательное учреждение высшего профессионального образования "Санкт-Петербургский торгово-экономический институт" Способ обеспечения защищенности автоматизированной системы
JP2017023519A (ja) * 2015-07-24 2017-02-02 株式会社デンソー 状態推定装置および状態推定プログラム

Similar Documents

Publication Publication Date Title
US6091334A (en) Drowsiness/alertness monitor
Wang et al. Driver fatigue detection: a survey
Kapitaniak et al. Application of eye-tracking in drivers testing: A review of research
US6346887B1 (en) Eye activity monitor
US5726916A (en) Method and apparatus for determining ocular gaze point of regard and fixation duration
US6623243B1 (en) Minimization of motion smear: an approach to reducing avian collisions with wind turbines
EP3649920B1 (fr) Système de detection de l'utilisation d'un moniteur de comportement visuel
Stuart et al. Quantifying saccades while walking: validity of a novel velocity-based algorithm for mobile eye tracking
WO1993020499A1 (fr) Appareil et procede destines a une interface suivant les mouvements des yeux
WO2016168724A1 (fr) Système et méthode pour la détection et la quantification d'une commotion cérébrale
Choudhary et al. A survey paper on drowsiness detection & alarm system for drivers
US20210345937A1 (en) Analysis of neurological conditions, including prediction of future seizure events and/or detection of current seizure events, based on analysis of blepharometric data
Prasath et al. Driver drowsiness detection using machine learning algorithm
WO1998049028A1 (fr) Systeme de surveillance de la vigilance
Coetzer et al. Driver fatigue detection: A survey
DE19642830A1 (de) Verfahren und Vorrichtung zur Unterbindung des Einschlafens und der Reaktionskontrolle von Personen
Khan et al. Efficient Car Alarming System for Fatigue Detectionduring Driving
CN116115179B (zh) 眼动检查设备
Schenk et al. Can a motion‐blind patient reach for moving objects?
WO1999012137A1 (fr) Dispositif de detection de l'assoupissement/de la vigilance
Ahlström et al. Considerations when calculating percent road centre from eye movement data in driver distraction monitoring
US10478066B2 (en) System and method for detection of cravings in individuals with addiction
EP3590421A1 (fr) Procédé et dispositif de surveillance de la capacité à agir d'un membre d'équipage d'un aéronef
Beukman et al. A multi-sensor system for detection of driver fatigue
Touryan et al. Translation of EEG-based performance prediction models to rapid serial visual presentation tasks

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP KR

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
NENP Non-entry into the national phase

Ref country code: KR

122 Ep: pct application non-entry in european phase