[go: up one dir, main page]

WO2006000166B1 - Method and device for detecting operator fatigue or quality - Google Patents

Method and device for detecting operator fatigue or quality

Info

Publication number
WO2006000166B1
WO2006000166B1 PCT/CZ2005/000051 CZ2005000051W WO2006000166B1 WO 2006000166 B1 WO2006000166 B1 WO 2006000166B1 CZ 2005000051 W CZ2005000051 W CZ 2005000051W WO 2006000166 B1 WO2006000166 B1 WO 2006000166B1
Authority
WO
WIPO (PCT)
Prior art keywords
operator
fatigue
quality
operators
activity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CZ2005/000051
Other languages
French (fr)
Other versions
WO2006000166A1 (en
Inventor
Miloslav Pavelka
Tamer Keshi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2006000166A1 publication Critical patent/WO2006000166A1/en
Publication of WO2006000166B1 publication Critical patent/WO2006000166B1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7253Details of waveform analysis characterised by using transforms
    • A61B5/726Details of waveform analysis characterised by using transforms using Wavelet transforms
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Psychiatry (AREA)
  • Pathology (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physiology (AREA)
  • Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Emergency Management (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The method of operator fatigue detection from operator muscular activity is performed by detecting at least one parameter affected by operator muscular activity, which parameter is assessed using fatigue assessment rules obtained using a data mining method from a corresponding parameter of at least one operator for whom the extent of fatigue is known. The device to perform the fatigue detection method comprises a programmable unit with a pre­programmed fatigue detection model - that is to say fatigue assessment rules obtained by measuring a signal of at least one of parameters generated by operator muscular activity for at least one fatigued operator and at least one alert operator -, a detector or detectors to measure or measure and process the signal of the parameter or parameters used by the model, connected to the input of the programmable unit to assess operator fatigue, while the programmable unit output is connected to a fatigue signaling device.

Claims

59AMENDED CLAIMS received by the International Bureau on 27 December 2005 (27.12.05)NEW CLAIMS
1. A method of operator fatigue detection or operator quality evaluation from an activity performed by the operator, said activity comprising operator's muscular activity, wherein a fatigue detection model or a quality evaluation model being capable of generalization is created, said model being based upon measuring parameters derived from the activity of different operators performing said activity, whereas the extent of their fatigue or quality is known beforehand, the fatigue or the quality evaluation model is created as a set of decision rules for evaluating operator fatigue or quality or for making a decision if the operator is capable of performing his activity or not.
2. A method according to claim 1, characterized by detecting at least one parameter affected by operator's muscular activity, which parameter is evaluated based on fatigue detection or quality evaluation model or rules obtained using a data mining method from a corresponding parameter of different operators for whom the extent of fatigue or quality is known beforehand.
3. A method according to claim 2 characterized in that the data mining method uses one of the following techniques: neural networks, decision trees, regression, random forests, genetic algorithms, splines, SVM3 CHAID, CART, non-parametric system identification models, non parametric regression, clustering, and any combination of those techniques.
4. A method according to any of claims 1 to 3, characterized by creating variables derived from parameters affected by the operator muscular activity, said variables express the fatigue difference between a fatigued operator and alert operator or the quality difference between a high-quality-operator and low-quality-operator.
5 A method according to claim 4, characterized by creating a table or structure comprising sets of input variables and a corresponding output variable set, the input variable values are derived from the parameter or parameters of individual operators in individual time intervals, the output variable value describes the corresponding extent of operator fatigue in each time interval for each individual operator. 60
6. A method according to any of Claims 1 to 5, characterized in that one parameter obtained by the activity of operators performing said activity is generated from a motor vehicle steering-wheel movement being detected from any suitable part of the vehicle including the steering-wheel itself, the parts between the steering-wheel and the axle, or the axle itself.
7. A method according to Claim 6, characterized in that further parameters derived from the activity of operators performing said activity are generated from at least one of the following components: speed control related to an accelerator pedal movement, speed control related to a brake pedal movement, vehicle speed, vehicle lateral acceleration, vehicle longitudinal acceleration, windscreen wiper switched on as a rain indicator, vehicle loading, outside temperature values measured, and vehicle's position on the street.
8. A method according to any of Claims 1 to 7, characterized in that the parameters are generated from the vehicle longitudinal and/or transverse acceleration.
9. A method of operator fatigue or quality evaluation from operator muscular activity, wherein: a) at least one parameter influenced by the operator muscular activity is detected to ensure generalization for at least two alert operators and at least two fatigued operators or at least two high-quality operators and at least two low-quality operators b) a set of data or preferably variables is obtained and stored in a suitable form, c) based on the stored data or variables a fatigue detection model or a quality evaluation model is created using a data mining method, d) at least one parameter measured in step a) is measured for the evaluated operator, e) values measured in step d) are used to create data or preferably variables in the same or similar way as in step b) f) data or variables are used as input data for the model created in step c), whilst the model output provides the fatigue detection or quality estimation of the evaluated operator. 61
10. A device for fatigue detection or quality evaluation capable of generalization, comprising a programmable unit, wherein the programmable unit includes fatigue or quality evaluation model for operator fatigue evaluation or for operator quality evaluation, the model being obtained by a data mining method using signal derived from at least one of parameters generated by operator muscular activity, the parameters being detected for different fatigued operators and for different alert operators or for different high-quality operators and for different low-quality operators, the device further comprising at least one detector to measure or to measure-and-process the signal derived from the parameter or parameters used by the model, the detector or detectors are connected to the input of the programmable unit to evaluate operator fatigue or quality, the programmable unit output being connected to a fatigue or quality signaling equipment, while the device advantageously also comprises at least one unit for signal or data processing to generate suitable inputs for the fatigue or quality evaluation model.
11. A device according to claim 10, characterized by performing signal measuring, signal processing into the form of input data or variables of the detection or evaluation model, and fatigue detection or quality estimation in real time, i.e. simultaneously with operator's routine activity.
12. A device for performing a method according to any of claims 1 to 9 for a real-time fatigue detection or quality evaluation, capable of generalization, comprising a programmable unit, wherein the programmable unit includes fatigue or quality evaluation model for operator fatigue evaluation or for operator quality evaluation, the model being obtained by a data mining method using a signal obtained from at least one of parameters generated by operator muscular activity for more than 5 fatigued operators and for more than 5 alert operators or for more than 5 high-quality operators and for more than 5 low-quality operators, the device further comprising at least one detector to measure or to measure-and-process the signal used by the model, the detector or detectors are connected to the input of the programmable unit to evaluate operator fatigue or quality, the programmable unit output being connected to a fatigue or quality signaling equipment, while the device preferably also comprises at least one unit for signal or data processing to generate suitable inputs for the fatigue or quality evaluation model, the device further performing signal measuring, signal processing into the 62
form of input data or variables of the detection or evaluation model, and fatigue or quality estimation m real time, i.e. simultaneously with operator's routine activity.
PCT/CZ2005/000051 2004-06-29 2005-06-29 Method and device for detecting operator fatigue or quality Ceased WO2006000166A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CZ20040770A CZ2004770A3 (en) 2004-06-29 2004-06-29 Method of detecting operator fatigue caused by muscle activity and apparatus for making the same
CZPV2004-770 2004-06-29

Publications (2)

Publication Number Publication Date
WO2006000166A1 WO2006000166A1 (en) 2006-01-05
WO2006000166B1 true WO2006000166B1 (en) 2006-05-11

Family

ID=35058858

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CZ2005/000051 Ceased WO2006000166A1 (en) 2004-06-29 2005-06-29 Method and device for detecting operator fatigue or quality

Country Status (2)

Country Link
CZ (1) CZ2004770A3 (en)
WO (1) WO2006000166A1 (en)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10370012B2 (en) 2017-03-09 2019-08-06 Ge Global Sourcing Llc Adaptive vehicle control system
GB0619753D0 (en) 2006-10-06 2006-11-15 Chroma Therapeutics Ltd Enzyme inhibitors
US7570991B2 (en) 2007-11-13 2009-08-04 Wavesynch Technologies, Inc. Method for real time attitude assessment
AT506667B1 (en) * 2008-04-03 2013-06-15 Gesunde Arbeitsplatzsysteme Gmbh METHOD FOR CHECKING THE TIRED DEGRESSION OF A PERSON OPERATING A DEVICE
WO2011000373A1 (en) * 2009-06-30 2011-01-06 Asp Technology Aps Pause adviser system and use thereof
US10154382B2 (en) 2013-03-12 2018-12-11 Zendrive, Inc. System and method for determining a driver in a telematic application
NZ630770A (en) 2013-10-09 2016-03-31 Resmed Sensor Technologies Ltd Fatigue monitoring and management system
US20150223743A1 (en) * 2014-02-12 2015-08-13 Wipro Limited Method for monitoring a health condition of a subject
US10504068B2 (en) 2015-07-14 2019-12-10 Omnitracs, Llc Driver log analytics system
ES2904564T3 (en) 2015-08-20 2022-04-05 Zendrive Inc Accelerometer assisted navigation method
CN105261152B (en) * 2015-09-30 2018-01-30 中国民用航空总局第二研究所 Air traffic controller's fatigue detection method based on cluster analysis, device and system
FR3048542A1 (en) * 2016-03-01 2017-09-08 Valeo Comfort & Driving Assistance DEVICE AND METHOD FOR PERSONALIZED MONITORING OF A DRIVER OF A MOTOR VEHICLE
US9955319B2 (en) 2016-09-12 2018-04-24 Zendrive, Inc. Method for mobile device-based cooperative data capture
US10012993B1 (en) 2016-12-09 2018-07-03 Zendrive, Inc. Method and system for risk modeling in autonomous vehicles
JP2018102617A (en) * 2016-12-27 2018-07-05 オムロン株式会社 Emotion estimation apparatus, method, and program
US10328946B2 (en) 2017-01-03 2019-06-25 Ge Global Sourcing Llc Alerter augmentation system
US11065958B2 (en) 2017-01-03 2021-07-20 Transportation Ip Holdings, Llc Control system and method
WO2018158704A1 (en) * 2017-02-28 2018-09-07 Omron Corporation Work management apparatus, method, and program
JP2018142259A (en) * 2017-02-28 2018-09-13 オムロン株式会社 Manufacturing management device, method, and program
WO2018158702A1 (en) * 2017-02-28 2018-09-07 Omron Corporation Production management apparatus, method, and program
JP2018142258A (en) * 2017-02-28 2018-09-13 オムロン株式会社 Manufacturing management device, method, and program
US12246761B2 (en) 2017-03-09 2025-03-11 Transportation Ip Holdings, Llc Adaptive vehicle control system
US10304329B2 (en) * 2017-06-28 2019-05-28 Zendrive, Inc. Method and system for determining traffic-related characteristics
WO2019104348A1 (en) 2017-11-27 2019-05-31 Zendrive, Inc. System and method for vehicle sensing and analysis
JP7070253B2 (en) * 2018-08-31 2022-05-18 オムロン株式会社 Performance measuring device, performance measuring method and performance measuring program
CN110796207B (en) * 2019-11-08 2023-05-30 中南大学 Fatigue driving detection method and system
US12400272B2 (en) 2019-12-02 2025-08-26 Credit Karma, Llc System and method for assessing device usage
US11775010B2 (en) 2019-12-02 2023-10-03 Zendrive, Inc. System and method for assessing device usage
US11938947B2 (en) * 2022-01-05 2024-03-26 Honeywell International S.R.O. Systems and methods for sensor-based operator fatigue management
CN115285133A (en) * 2022-08-30 2022-11-04 重庆长安汽车股份有限公司 Driver fatigue detection method, system, electronic device and readable storage medium
CN117271271B (en) * 2023-11-21 2024-03-22 深圳市利新联电子有限公司 Hand fatigue identification method, system and storage medium based on mouse usage monitoring
CN118430821B (en) * 2024-07-04 2024-09-27 上海华模科技有限公司 Fatigue driving detection method and system in flight simulation training

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2742706B1 (en) * 1995-12-22 1998-02-13 Peugeot METHOD FOR DETECTING THE DEVELOPMENT OF THE DRIVING BEHAVIOR OF A MOTOR VEHICLE DRIVER AND DEVICE FOR CARRYING OUT SUCH A METHOD
US5798695A (en) * 1997-04-02 1998-08-25 Northrop Grumman Corporation Impaired operator detection and warning system employing analysis of operator control actions
GB2366062A (en) * 2000-02-18 2002-02-27 Philip John Pearce Detecting fatigue in machine operator or vehicle driver

Also Published As

Publication number Publication date
CZ2004770A3 (en) 2006-02-15
WO2006000166A1 (en) 2006-01-05

Similar Documents

Publication Publication Date Title
WO2006000166B1 (en) Method and device for detecting operator fatigue or quality
CN101535079B (en) Method and device for driver state recognition
US20190217886A1 (en) Hands-on/-off detection in a steer-by-wire system
CN103180179B (en) Sensor device for automobile
US20110264325A1 (en) Impaired operation detection method
CN106379318A (en) Adaptive cruise control profiles
DE102005026456A1 (en) Method and device for detecting fatigue
CN108248610B (en) A monitoring and intervention device for adaptive distracted driving behavior
CN110942671A (en) Vehicle dangerous driving detection method, device and storage medium
CN105745134A (en) Method for evaluating driver behavior in a motor vehicle
CN116353584A (en) A vehicle collision risk prediction system and vehicle
US20210153796A1 (en) Control device, system, and method for determining a comfort level of a driver
JP3328807B2 (en) Method of analyzing vehicle running characteristics, and method and apparatus for adjusting vehicle running characteristics
Shirazi et al. Detection of intoxicated drivers using online system identification of steering behavior
CN109436085A (en) A kind of wire-controlled steering system gearratio control method based on driving style
CN106882141A (en) Driving behavior detection method and device
JPH08268013A (en) Judging method of pressure reduction in tire of traveling vehicle
CN116443027A (en) Vehicle comfort evaluation method, device, server and storage medium
CN108898795B (en) Pedestrian state real-time analysis method and system based on mobile device
Zou et al. Driving behavior recognition based on EEG data from a driver taking over experiment on a simulated autonomous vehicle
JP5838577B2 (en) Travel evaluation device
CN113335295A (en) Fatigue driving early warning method and device
DE102009058882B4 (en) Tire pressure determination with sensor data, wheel speed data and tire data
CN117216515A (en) Safety detection methods, devices and computer equipment based on autonomous driving
Butakov et al. Driver/vehicle response diagnostic system for the vehicle-following case

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
B Later publication of amended claims

Effective date: 20051227

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase