[go: up one dir, main page]

CN115366909B - Dynamic early warning method and device for driver accidents in long and large longitudinal slope section and electronic equipment - Google Patents

Dynamic early warning method and device for driver accidents in long and large longitudinal slope section and electronic equipment Download PDF

Info

Publication number
CN115366909B
CN115366909B CN202211291757.1A CN202211291757A CN115366909B CN 115366909 B CN115366909 B CN 115366909B CN 202211291757 A CN202211291757 A CN 202211291757A CN 115366909 B CN115366909 B CN 115366909B
Authority
CN
China
Prior art keywords
slope
longitudinal slope
condition
driver
section
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211291757.1A
Other languages
Chinese (zh)
Other versions
CN115366909A (en
Inventor
何恩怀
何云勇
孙璐
刘自强
杨昌凤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Department of Transportation Highway Planning Prospecting and Design Research Institute
Original Assignee
Sichuan Department of Transportation Highway Planning Prospecting and Design Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Department of Transportation Highway Planning Prospecting and Design Research Institute filed Critical Sichuan Department of Transportation Highway Planning Prospecting and Design Research Institute
Priority to CN202211291757.1A priority Critical patent/CN115366909B/en
Publication of CN115366909A publication Critical patent/CN115366909A/en
Application granted granted Critical
Publication of CN115366909B publication Critical patent/CN115366909B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2510/00Input parameters relating to a particular sub-units
    • B60W2510/18Braking system
    • B60W2510/184Brake temperature, e.g. of fluid, pads or discs
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/225Direction of gaze
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/229Attention level, e.g. attentive to driving, reading or sleeping

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)

Abstract

本申请提供一种长大纵坡路段驾驶员事故动态预警方法、装置及电子设备,属于安全预警技术领域。该长大纵坡路段驾驶员事故动态预警方法,利用驾驶员工作区域图像,判断眼部的开合状态,并确定驾驶员疲劳状态;通过获取方向盘转角值数据判断方向盘在预设时间内是否发生转动;通过长大纵坡路段路段信息和驾驶车辆的车辆信息预测下坡结束时制动器温度。当存在潜在驾驶风险时,向驾驶员进行预警,减少交通事故的发生。

Figure 202211291757

The application provides a dynamic early warning method, device and electronic equipment for driver accidents on long longitudinal slope road sections, which belong to the technical field of safety early warning. The dynamic early warning method for driver accidents on the long longitudinal slope section uses the image of the driver's work area to judge the opening and closing state of the driver's eyes, and determines the driver's fatigue state; by obtaining the steering wheel angle value data, it is judged whether the steering wheel has occurred within a preset time Rotation; Predict the brake temperature at the end of the downhill through the road section information of the long longitudinal slope section and the vehicle information of the driving vehicle. When there is a potential driving risk, the driver will be warned to reduce the occurrence of traffic accidents.

Figure 202211291757

Description

长大纵坡路段驾驶员事故动态预警方法、装置及电子设备Method, device and electronic equipment for dynamic early warning of accidents for drivers on long longitudinal slope sections

技术领域Technical Field

本申请涉及安全预警技术领域,具体而言,涉及一种长大纵坡路段驾驶员事故动态预警方法、装置及电子设备。The present application relates to the field of safety warning technology, and in particular to a method, device and electronic equipment for dynamic warning of accidents for drivers on long longitudinal slope sections.

背景技术Background Art

在山岭地区,高差大、地形和地质条件复杂,高速公路施工难度大,采取较长坡长和较大坡度的公路设计,这种路段行驶相较于平原地区的平缓路段发生交通事故的可能性更高,在连续长大纵坡路段行驶,频繁制动会导致制动器温度上升,当温度短时间内迅速上升,极易导致刹车失效。此外,对于行驶在长大纵坡路段的货车而言,长时间的山区道路驾驶容易疲劳,驾驶员的疲劳驾驶导致驾驶行为危险,容易导致交通事故,发生追尾或者冲撞护栏。In mountainous areas, there are large height differences, complex terrain and geological conditions, and it is difficult to construct highways. Highways with longer slopes and steeper slopes are designed. Traffic accidents are more likely to occur on such roads than on gentle roads in plains. Frequent braking on roads with continuous long longitudinal slopes will cause the brake temperature to rise. When the temperature rises rapidly in a short period of time, it is very easy to cause brake failure. In addition, for trucks driving on long longitudinal slopes, long-term driving on mountain roads can easily lead to fatigue. Drivers' fatigue driving leads to dangerous driving behavior, which can easily lead to traffic accidents, rear-end collisions or collisions with guardrails.

为了,有必要对驾驶员当前驾驶行为进行预警,对潜在导致事故的危险行为进行动态预警。In order to do this, it is necessary to give early warning to the driver's current driving behavior and to dynamically warn of dangerous behaviors that may lead to accidents.

发明内容Summary of the invention

本申请实施例的目的在于提供一种长大纵坡路段驾驶员事故动态预警方法、装置及电子设备,以对驾驶员的驾驶行为进行监测,及时发现存在隐患的驾驶行为,并向驾驶员进行提醒警告,从而更好地保障道路通行安全。The purpose of the embodiments of the present application is to provide a method, device and electronic equipment for dynamic early warning of accidents for drivers on long longitudinal slope sections, so as to monitor the driving behavior of the driver, promptly discover driving behaviors with hidden dangers, and remind and warn the driver, so as to better ensure road safety.

为了实现上述目的,本申请的实施例通过如下方式实现:In order to achieve the above purpose, the embodiments of the present application are implemented in the following ways:

第一方面,本申请实施例提供一种长大纵坡路段驾驶员事故动态预警方法,包括:获取驾驶员工作区域图像进行图像识别,确定驾驶员眼睛特征,根据驾驶员眼睛特征判断眼部的开合状态,确定驾驶员疲劳状态,若驾驶员处于疲劳状态,确定满足第一条件。In a first aspect, an embodiment of the present application provides a method for dynamic warning of driver accidents on a road section with a long longitudinal slope, including: obtaining an image of the driver's working area for image recognition, determining the driver's eye features, judging the opening and closing state of the eyes based on the driver's eye features, determining the driver's fatigue state, and if the driver is in a fatigued state, determining that the first condition is met.

获取方向盘转角值数据判断方向盘在预设时间内是否发生转动,若方向盘在预设时间内未转动,确定满足第二条件。The steering wheel angle value data is obtained to determine whether the steering wheel is turned within a preset time. If the steering wheel is not turned within the preset time, it is determined that the second condition is met.

获取导航路线长大纵坡路段的路段信息,获取驾驶车辆的车辆信息,根据当前路段信息和当前车辆信息确定无辅助制动条件下,下坡结束时制动器温度,当制动器温度大于预设温度时,确定满足第三条件。Obtain the section information of the long longitudinal slope section of the navigation route, obtain the vehicle information of the driving vehicle, determine the brake temperature at the end of downhill without auxiliary braking conditions based on the current section information and the current vehicle information, and when the brake temperature is greater than the preset temperature, determine that the third condition is met.

在满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,确定此行驶状态存在事故隐患,发出提醒信息。When any one of the first condition, the second condition and the third condition is met, it is determined that there is a potential accident hazard in this driving state, and a reminder message is issued.

结合第一方面,在一些实施方案中,获取驾驶员工作区域图像进行图像识别确定驾驶员眼睛特征,根根据驾驶员眼睛特征判断眼部的开合状态,确定驾驶员疲劳状态,包括In combination with the first aspect, in some implementation schemes, an image of the driver's work area is obtained for image recognition to determine the driver's eye features, and the opening and closing state of the eyes is determined based on the driver's eye features to determine the driver's fatigue state, including:

对驾驶员工作区域图像进行人脸检测,确定面部宽度、高度参数,对人脸区域进行眼睛检测对虹膜进行初次定位,确定当前帧图像虹膜所处位置参数;基于相邻帧差法,利用前后两帧图像的相邻帧差的绝对值,获取相邻帧差值二值图像,并基于此判断前后两帧图像是否具有交集,若无交集则重复前一步骤,若存在交集,则检测面部移动参数,并根据移动参数确定当前帧图像内虹膜所处位置参数;根据Sobel算子检测垂直边缘,获取虹膜区域图像,识别开眼和合眼图像;对开眼虹膜区域图像进行边缘检测,获取虹膜与上眼睑和下眼睑的交界,并视上眼睑和下眼睑之间的区域为虹膜暴露面积,根据上眼睑和下眼睑的边缘确定眼睛长度,根据虹膜暴露面积以及眼睛长度的比值定义眼睛张开值;根据时间序列获取预设时间段T内等时间间隔内的工作区域图像,并根据上述步骤获得相应帧图像的眼睛张开值;以时间序列作为横坐标,以相应帧图像的眼睛张开值作为纵坐标,绘制曲线,获取曲线与横坐标围合形成的区域面积S,以区域面积S和时间段T的比值确定该时间段的眼睛张开度;根据张开度与预设阈值比较,当张开度小于预设阈值,则确定驾驶员处于疲劳状态。Perform face detection on the driver's work area image to determine the facial width and height parameters, perform eye detection on the face area to initially locate the iris, and determine the iris position parameters of the current frame image; based on the adjacent frame difference method, use the absolute value of the adjacent frame difference between the previous and next frames to obtain the adjacent frame difference binary image, and based on this, determine whether the previous and next frames have an intersection. If there is no intersection, repeat the previous step. If there is an intersection, detect the facial movement parameters, and determine the iris position parameters in the current frame image based on the movement parameters; detect vertical edges based on the Sobel operator, obtain the iris area image, and identify the open and closed eye images; perform edge detection on the open eye iris area image to obtain the iris and the upper eyelid and lower eyelid The method comprises the following steps: determining the boundary of the upper eyelid and the lower eyelid, and regarding the area between the upper eyelid and the lower eyelid as the iris exposure area, determining the eye length according to the edges of the upper eyelid and the lower eyelid, and defining the eye opening value according to the ratio of the iris exposure area to the eye length; obtaining the working area images within the preset time period T at equal time intervals according to the time series, and obtaining the eye opening values of the corresponding frame images according to the above steps; drawing a curve with the time series as the horizontal coordinate and the eye opening values of the corresponding frame images as the vertical coordinate, obtaining the area S enclosed by the curve and the horizontal coordinate, and determining the eye opening degree of the time period according to the ratio of the area S to the time period T; and comparing the opening degree with a preset threshold value, when the opening degree is less than the preset threshold value, determining that the driver is in a fatigue state.

结合第一方面,在一些实施方案中,方向盘转角值数据由方向盘转角传感器采集获取。In combination with the first aspect, in some implementation schemes, the steering wheel angle value data is collected and acquired by a steering wheel angle sensor.

结合第一方面,在一些实施方案中,提醒信息为声报警信息和/或光报警信息。In combination with the first aspect, in some embodiments, the reminder information is sound alarm information and/or light alarm information.

结合第一方面,在一些实施方案中,在满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,确定此行驶状态存在事故隐患,发出提醒信息,具体为:在仅满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,提醒信息为声报警信息;在仅满足其中所述第一条件、所述第二条件和所述第三条件中的两个条件时,提醒信息为光报警信息;在同时满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,提醒信息为声报警信息和光报警信息。结合第一方面,在一些实施方案中,路段信息包括:路段编号、路段长度以及路段坡度。In combination with the first aspect, in some implementation schemes, when any one of the first condition, the second condition, and the third condition is met, it is determined that there is a potential accident hazard in this driving state, and a reminder message is issued, specifically: when only any one of the first condition, the second condition, and the third condition is met, the reminder message is an audible alarm message; when only two of the first condition, the second condition, and the third condition are met, the reminder message is an optical alarm message; when any one of the first condition, the second condition, and the third condition is met at the same time, the reminder message is an audible alarm message and an optical alarm message. In combination with the first aspect, in some implementation schemes, the road section information includes: road section number, road section length, and road section slope.

结合第一方面,在一些实施方案中,驾驶车辆的车辆信息包括车辆编号、车辆质量、车辆速度以及制动器当前温度。In combination with the first aspect, in some implementation schemes, the vehicle information of the driving vehicle includes a vehicle number, a vehicle mass, a vehicle speed, and a current brake temperature.

结合第一方面,在一些实施方案中,根据当前路段信息和当前车辆信息确定无辅助制动条件下,下坡结束时制动器温度,包括:In combination with the first aspect, in some implementation schemes, determining the brake temperature at the end of a downhill slope under a non-assisted braking condition according to current road section information and current vehicle information includes:

简化长大纵坡路段的连续路况,忽略不同纵坡之间的过渡连坡,视为同一坡度纵坡,其中,该同一坡度纵坡的起点为简化前长大纵坡路段的起点,Simplify the continuous road conditions of the long longitudinal slope section, ignore the transition slopes between different longitudinal slopes, and regard them as the same slope longitudinal slope, where the starting point of the same slope longitudinal slope is the starting point of the long longitudinal slope section before simplification.

假设长大纵坡路段具有n段连续纵坡,则Assuming that the long longitudinal slope section has n continuous longitudinal slopes, then

该同一坡度纵坡的坡长定义为The slope length of the same slope is defined as

L=L 1+ L 2+ L 3…+L n ,其中,L为坡长,L 1为第1段连续纵坡的坡长,L 2为第2段连续纵坡的坡长,L 3为第3段连续纵坡的坡长,L n 为第n段连续纵坡的坡长。 L = L 1 + L 2 + L 3 …+ L n , where L is the slope length, L 1 is the length of the first section of the continuous longitudinal slope, L 2 is the length of the second section of the continuous longitudinal slope, L 3 is the length of the third section of the continuous longitudinal slope, and L n is the length of the nth section of the continuous longitudinal slope.

该同一坡度纵坡的坡度定义为The slope of the same slope longitudinal slope is defined as

I=(I 1 L 1+I 2 L 2+I 3 L 3…+I 1 L n )/(L 1+L 2+L 3…+L n ), I = ( I 1 L 1 + I 2 L 2 + I 3 L 3 …+ I 1 L n )/( L 1 + L 2 + L 3 … + L n ),

其中,I为坡度,I 1为第1段连续纵坡的坡度,I 2为第2段连续纵坡的坡度,I 3为第3段连续纵坡的坡度,I n 为第n段连续纵坡的坡度。Among them, I is the slope , I1 is the slope of the first section of continuous longitudinal slope , I2 is the slope of the second section of continuous longitudinal slope, I3 is the slope of the third section of continuous longitudinal slope, and In is the slope of the nth section of continuous longitudinal slope.

假设长大纵坡路段下坡过程中,车辆速度恒定为V,根据简化后的长大纵坡路段参数,确定无辅助制动条件下,下坡结束时制动器温度。Assuming that the vehicle speed is constant at V during the descent on a long longitudinal slope section, the brake temperature at the end of the descent without auxiliary braking is determined based on the simplified parameters of the long longitudinal slope section.

结合第一方面,在一些实施方案中,下坡结束时制动器温度In conjunction with the first aspect, in some embodiments, the brake temperature at the end of a downhill slope

当该同一坡度纵坡坡度处于2%< I ≤5%时,When the longitudinal slope of the same slope is 2%<I ≤5%,

Figure 221386DEST_PATH_IMAGE001
Figure 221386DEST_PATH_IMAGE001

当该同一坡度纵坡坡度处于I >5%时,When the longitudinal slope of the same slope is I>5%,

Figure 715690DEST_PATH_IMAGE002
Figure 715690DEST_PATH_IMAGE002

式中,

Figure 964269DEST_PATH_IMAGE003
为连续纵坡的行驶时间;H为连续纵坡简化前起点与终点位置的高差;M为车辆总质量,
Figure 952954DEST_PATH_IMAGE004
为重力加速度,k为修正系数(当坡度在达到5%以上,坡度每提高1%,k值增加0.1,其中,坡度在5%时,K=1),P 0为制动器当前温度,
Figure 970588DEST_PATH_IMAGE005
为下坡结束时制动器温度。In the formula,
Figure 964269DEST_PATH_IMAGE003
is the travel time of the continuous longitudinal slope; H is the height difference between the starting point and the end point before the continuous longitudinal slope is simplified; M is the total mass of the vehicle,
Figure 952954DEST_PATH_IMAGE004
is the acceleration of gravity, k is the correction coefficient (when the slope reaches more than 5%, the k value increases by 0.1 for every 1% increase in the slope, where K = 1 when the slope is 5%), P0 is the current temperature of the brake,
Figure 970588DEST_PATH_IMAGE005
is the brake temperature at the end of a downhill slope.

第二方面,本申请实施例提供一种长大纵坡路段驾驶员事故动态预警装置,包括:第一判断模块,所述第一判断模块用于获取驾驶员工作区域图像进行图像识别,确定驾驶员眼睛特征,根据驾驶员眼睛特征判断眼部的开合状态,确定驾驶员疲劳状态,若驾驶员处于疲劳状态,确定满足第一条件。In the second aspect, an embodiment of the present application provides a dynamic warning device for driver accidents on long longitudinal slope sections, including: a first judgment module, the first judgment module is used to obtain an image of the driver's working area for image recognition, determine the driver's eye features, judge the opening and closing state of the eyes based on the driver's eye features, determine the driver's fatigue state, and if the driver is in a fatigued state, determine that the first condition is met.

第二判断模块,所述第二判断模块用于获取方向盘转角值数据判断方向盘在预设时间内是否发生转动,若方向盘在预设时间内未转动,确定满足第二条件。The second judgment module is used to obtain the steering wheel angle value data to determine whether the steering wheel is turned within a preset time. If the steering wheel is not turned within the preset time, it is determined that the second condition is met.

第三判断模块,所述第三判断模块用于获取导航路线长大纵坡路段的路段信息,获取驾驶车辆的车辆信息,根据当前路段信息和当前车辆信息确定无辅助制动条件下,下坡结束时制动器温度,当制动器温度大于预设温度时,确定满足第三条件。The third judgment module is used to obtain the section information of the long longitudinal slope section of the navigation route, obtain the vehicle information of the driving vehicle, and determine the brake temperature at the end of downhill without auxiliary braking conditions based on the current section information and the current vehicle information. When the brake temperature is greater than the preset temperature, it is determined that the third condition is met.

提醒模块,所述提醒模块用于在满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,确定此行驶状态存在事故隐患,发出提醒信息。A reminder module is used to determine that there is a potential accident hazard in this driving state and issue a reminder message when any one of the first condition, the second condition and the third condition is met.

第三方面,本申请实施例提供一种电子设备,包括存储器和处理器,所述存储器用于存储包括程序指令的信息,所述处理器用于控制程序指令的执行,所述程序指令被处理器加载并执行时实现第一方面或第一方面的可能的实现方式中任意一项所述的长大纵坡路段驾驶员事故动态预警方法。In a third aspect, an embodiment of the present application provides an electronic device comprising a memory and a processor, wherein the memory is used to store information including program instructions, and the processor is used to control the execution of the program instructions, and when the program instructions are loaded and executed by the processor, the method for dynamic warning of driver accidents on long longitudinal slope sections as described in the first aspect or any one of the possible implementation methods of the first aspect is implemented.

本申请提供的长大纵坡路段驾驶员事故动态预警方法,利用驾驶员工作区域图像,判断眼部的开合状态,并确定驾驶员疲劳状态;通过获取方向盘转角值数据判断方向盘在预设时间内是否发生转动;通过长大纵坡路段路段信息和驾驶车辆的车辆信息预测下坡结束时制动器温度。当存在潜在驾驶风险时,向驾驶员进行预警,减少交通事故的发生。The method for dynamic early warning of accidents for drivers on long and steep slopes provided by the application uses the image of the driver's work area to determine the opening and closing state of the eyes and the driver's fatigue state; obtains the steering wheel angle value data to determine whether the steering wheel has been turned within a preset time; and predicts the brake temperature at the end of the downhill slope through the road section information of the long and steep slope and the vehicle information of the driving vehicle. When there is a potential driving risk, the driver is warned to reduce the occurrence of traffic accidents.

为使本申请的上述目的、特征和优点能更明显易懂,下文特举较佳实施例,并配合所附附图,作详细说明如下。In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

为了更清楚地说明本申请实施例的技术方案,下面将对本申请实施例中所需要使用的附图作简单地介绍,应当理解,以下附图仅示出了本申请的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他相关的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

图1为本申请实施例提供的一种长大纵坡路段驾驶员事故动态预警方法的流程图;FIG1 is a flow chart of a method for dynamic early warning of accidents for drivers on long longitudinal slopes provided by an embodiment of the present application;

图2为本申请实施例提供的一种长大纵坡路段驾驶员事故动态预警装置的示意图;FIG2 is a schematic diagram of a dynamic early warning device for drivers on a long longitudinal slope provided by an embodiment of the present application;

图3为本申请实施例提供的一种电子设备的示意图。FIG. 3 is a schematic diagram of an electronic device provided in an embodiment of the present application.

图标:10-长大纵坡路段驾驶员事故动态预警装置;11-第一判断模块;12-第二判断模块;13-第三判断模块;14-提醒模块;20-电子设备;21-存储器;22-通信模块;23-总线;24-处理器。Icons: 10-dynamic early warning device for driver accidents on long and steep longitudinal slopes; 11-first judgment module; 12-second judgment module; 13-third judgment module; 14-reminding module; 20-electronic equipment; 21-memory; 22-communication module; 23-bus; 24-processor.

具体实施方式DETAILED DESCRIPTION

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

请参阅图1,图1为本申请实施例提供的一种长大纵坡路段驾驶员事故动态预警方法的流程图。在本实施例中,长大纵坡路段驾驶员事故动态预警方法可以由电子设备执行,此电子设备可以为服务器(例如云服务器,服务器集群等)或者终端(例如个人电脑、笔记本电脑等),此处不作限定。Please refer to Figure 1, which is a flow chart of a method for dynamic early warning of driver accidents on long longitudinal slope sections provided by an embodiment of the present application. In this embodiment, the method for dynamic early warning of driver accidents on long longitudinal slope sections can be executed by an electronic device, which can be a server (such as a cloud server, a server cluster, etc.) or a terminal (such as a personal computer, a laptop, etc.), which is not limited here.

在本实施例中,长大纵坡路段驾驶员事故动态预警方法可以包括步骤S10、步骤S20、步骤S30和步骤S40。In this embodiment, the method for dynamic warning of driver accidents on a road section with a long longitudinal slope may include step S10, step S20, step S30 and step S40.

为了对长大纵坡路段驾驶员进行事故动态预警,电子设备可以执行步骤S10。In order to provide a dynamic accident warning to the driver on a road section with a long longitudinal slope, the electronic device may execute step S10.

步骤S10:获取驾驶员工作区域图像进行图像识别,确定驾驶员眼睛特征,根据驾驶员眼睛特征判断眼部的开合状态,确定驾驶员疲劳状态,若驾驶员处于疲劳状态,确定满足第一条件。Step S10: Acquire the image of the driver's working area for image recognition, determine the driver's eye features, judge the opening and closing state of the eyes based on the driver's eye features, and determine the driver's fatigue state. If the driver is in a fatigued state, it is determined that the first condition is met.

在本实施例中,电子设备可以确定驾驶员疲劳状态。而驾驶员疲劳状态主要可以通过以下方式进行处理得到:In this embodiment, the electronic device can determine the driver's fatigue state. The driver's fatigue state can be obtained mainly by processing in the following ways:

对驾驶员工作区域图像进行人脸检测,确定面部宽度、高度参数,对人脸区域进行眼睛检测对虹膜进行初次定位,确定当前帧图像虹膜所处位置参数。Perform face detection on the driver's work area image to determine the facial width and height parameters, perform eye detection on the face area to initially locate the iris, and determine the position parameters of the iris in the current frame image.

基于相邻帧差法,利用前后两帧图像的相邻帧差的绝对值,获取相邻帧差值二值图像,并基于此判断前后两帧图像是否具有交集,若无交集则重复前一步骤,若存在交集,则检测面部移动参数,并根据移动参数确定当前帧图像内虹膜所处位置参数。Based on the adjacent frame difference method, the absolute value of the adjacent frame difference between the previous and next two frames is used to obtain the adjacent frame difference binary image, and based on this, it is judged whether the previous and next two frames have an intersection. If there is no intersection, the previous step is repeated. If there is an intersection, the facial movement parameters are detected, and the position parameters of the iris in the current frame image are determined according to the movement parameters.

根据Sobel算子检测垂直边缘,获取虹膜区域图像,识别开眼和合眼图像。The vertical edges are detected according to the Sobel operator, the iris area image is obtained, and the open and closed eye images are identified.

对开眼虹膜区域图像进行边缘检测,获取虹膜与上眼睑和下眼睑的交界,并视上眼睑和下眼睑之间的区域为虹膜暴露面积,根据上眼睑和下眼睑的边缘确定眼睛长度,根据虹膜暴露面积以及眼睛长度的比值定义眼睛张开值。Perform edge detection on the open eye iris area image to obtain the boundary between the iris and the upper and lower eyelids, and regard the area between the upper and lower eyelids as the iris exposure area. Determine the eye length based on the edges of the upper and lower eyelids, and define the eye opening value based on the ratio of the iris exposure area to the eye length.

根据时间序列获取预设时间段T内等时间间隔内的工作区域图像,并根据上述步骤获得相应帧图像的眼睛张开值。The working area images within the preset time period T are acquired according to the time series, and the eye opening values of the corresponding frame images are acquired according to the above steps.

以时间序列作为横坐标,以相应帧图像的眼睛张开值作为纵坐标,绘制曲线,获取曲线与横坐标围合形成的区域面积S,以区域面积S和时间段T的比值确定该时间段的眼睛张开度。A curve is drawn with the time series as the horizontal coordinate and the eye opening value of the corresponding frame image as the vertical coordinate, and the area S formed by the curve and the horizontal coordinate is obtained. The eye opening degree of the time period is determined by the ratio of the area S to the time period T.

根据张开度与预设阈值比较,当张开度小于预设阈值,则确定驾驶员处于疲劳状态。According to the comparison between the opening degree and the preset threshold, when the opening degree is less than the preset threshold, it is determined that the driver is in a fatigue state.

在这里,首先对驾驶员工作区域图像进行人脸检测,确定面部宽度、高度参数,对虹膜位置进行初次定位,然后基于相邻帧差法,利用前后两帧图像的相邻帧差的绝对值,获取相邻帧差值二值图像,并基于此判断前后两帧图像是否具有交集,若存在交集,则检测面部移动参数,并根据移动参数确定当前帧图像内虹膜所处位置参数,这一过程可以大幅减少人脸识别的计算量,图像识别速度提高,能够迅速获取当前前帧图像内虹膜所处位置参数。发明人在实践中发现,在非虹膜区域,垂直边缘信息很少,采用Sobel算子进行边缘检测效果更好。在获取虹膜区域图像,识别开眼和合眼图像后,着重对开眼图像再次进行边缘检测,获取虹膜与上眼睑和下眼睑的交界,并定义相应帧图像的眼睛张开值。最后,采用图形法,确定单位时间内的眼睛张开度,以眼睛张开度表征驾驶员疲劳状态。Here, firstly, face detection is performed on the driver's working area image to determine the facial width and height parameters, and the iris position is initially located. Then, based on the adjacent frame difference method, the absolute value of the adjacent frame difference between the two frames of images is used to obtain the adjacent frame difference binary image, and based on this, it is judged whether the two frames of images have an intersection. If there is an intersection, the facial movement parameters are detected, and the position parameters of the iris in the current frame image are determined according to the movement parameters. This process can greatly reduce the amount of calculation for face recognition, improve the image recognition speed, and quickly obtain the position parameters of the iris in the current frame image. The inventor found in practice that in the non-iris area, there is little vertical edge information, and the edge detection effect of using the Sobel operator is better. After obtaining the iris area image and identifying the open and closed eye images, the open eye image is focused on edge detection again, the boundary between the iris and the upper eyelid and the lower eyelid is obtained, and the eye opening value of the corresponding frame image is defined. Finally, the graphic method is used to determine the eye opening degree per unit time, and the eye opening degree is used to characterize the driver's fatigue state.

获取驾驶员疲劳状态后,电子设备可以执行步骤S20。After acquiring the driver's fatigue status, the electronic device may execute step S20.

步骤S20:获取方向盘转角值数据判断方向盘在预设时间内是否发生转动,若方向盘在预设时间内未转动,确定满足第二条件。Step S20: Obtain steering wheel angle data to determine whether the steering wheel is turned within a preset time. If the steering wheel is not turned within the preset time, it is determined that the second condition is met.

在这里,方向盘转角值数据由方向盘转角传感器采集获取,此处不作限定。Here, the steering wheel angle value data is collected and obtained by a steering wheel angle sensor, which is not limited here.

当驾驶员处于疲劳状态时,将会出现操作动作呆滞,有时甚至会忘记操作,甚至出现短时间睡眠现象,导致方向盘长时间不转动。通过方向盘转角传感器采集获取方向盘转角值,能够在方向盘长时间不转动时进行提醒。When the driver is in a fatigued state, the operation will be sluggish, and sometimes even forget to operate, or even fall asleep for a short time, causing the steering wheel to not turn for a long time. The steering wheel angle sensor collects the steering wheel angle value and can remind you when the steering wheel does not turn for a long time.

在判断方向盘在预设时间内是否发生转动后,电子设备可以执行步骤S30。After determining whether the steering wheel is turned within the preset time, the electronic device may execute step S30.

步骤S30:获取导航路线长大纵坡路段的路段信息,获取驾驶车辆的车辆信息,根据当前路段信息和当前车辆信息确定无辅助制动条件下,下坡结束时制动器温度,当制动器温度大于预设温度时,确定满足第三条件。Step S30: Obtain the section information of the long longitudinal slope section of the navigation route, obtain the vehicle information of the driving vehicle, determine the brake temperature at the end of downhill without auxiliary braking conditions based on the current section information and the current vehicle information, and when the brake temperature is greater than the preset temperature, determine that the third condition is met.

在这里,根据当前路段信息(例如路段编号、路段长度以及路段坡度。)和当前车辆信息(车辆编号、车辆质量(包括驾驶员和货物重量)、车辆速度以及制动器当前温度)确定无辅助制动条件下,下坡结束时制动器温度,包括:Here, the brake temperature at the end of downhill slope without auxiliary braking is determined based on the current road section information (such as road section number, road section length and road section slope) and the current vehicle information (vehicle number, vehicle mass (including driver and cargo weight), vehicle speed and current brake temperature), including:

简化长大纵坡路段的连续路况,忽略不同纵坡之间的过渡连坡,视为同一坡度纵坡,其中,该同一坡度纵坡的起点为简化前长大纵坡路段的起点,Simplify the continuous road conditions of the long longitudinal slope section, ignore the transition slopes between different longitudinal slopes, and regard them as the same slope longitudinal slope, where the starting point of the same slope longitudinal slope is the starting point of the long longitudinal slope section before simplification.

假设长大纵坡路段具有n段连续纵坡,则Assuming that the long longitudinal slope section has n continuous longitudinal slopes, then

该同一坡度纵坡的坡长定义为The slope length of the same slope is defined as

L=L 1+ L 2+ L 3…+L n ,其中,L为坡长,L 1为第1段连续纵坡的坡长,L 2为第2段连续纵坡的坡长,L 3为第3段连续纵坡的坡长,L n 为第n段连续纵坡的坡长。 L = L 1 + L 2 + L 3 …+ L n , where L is the slope length, L 1 is the length of the first section of the continuous longitudinal slope, L 2 is the length of the second section of the continuous longitudinal slope, L 3 is the length of the third section of the continuous longitudinal slope, and L n is the length of the nth section of the continuous longitudinal slope.

该同一坡度纵坡的坡度定义为The slope of the same slope longitudinal slope is defined as

I=(I 1 L 1+I 2 L 2+I 3 L 3…+I 1 L n )/(L 1+L 2+L 3…+L n ), I = ( I 1 L 1 + I 2 L 2 + I 3 L 3 …+ I 1 L n )/( L 1 + L 2 + L 3 … + L n ),

其中,I为坡度,I 1为第1段连续纵坡的坡度,I 2为第2段连续纵坡的坡度,I 3为第3段连续纵坡的坡度,I n 为第n段连续纵坡的坡度。Among them, I is the slope , I1 is the slope of the first section of continuous longitudinal slope , I2 is the slope of the second section of continuous longitudinal slope, I3 is the slope of the third section of continuous longitudinal slope, and In is the slope of the nth section of continuous longitudinal slope.

假设长大纵坡路段下坡过程中,车辆速度恒定为V,根据简化后的长大纵坡路段参数,基于能量守恒,结合不同坡度下的升温规律,确定无辅助制动条件下,下坡结束时制动器温度。Assuming that the vehicle speed is constant at V during the descent on a long longitudinal slope section, the brake temperature at the end of the descent is determined without auxiliary braking based on the simplified parameters of the long longitudinal slope section, based on the law of energy conservation and the temperature rise law under different slopes.

当该同一坡度纵坡坡度处于2%< I ≤5%时,When the longitudinal slope of the same slope is 2%<I ≤5%,

Figure 137258DEST_PATH_IMAGE001
Figure 137258DEST_PATH_IMAGE001

当该同一坡度纵坡坡度处于I >5%时,When the longitudinal slope of the same slope is I>5%,

Figure 873133DEST_PATH_IMAGE002
Figure 873133DEST_PATH_IMAGE002

式中,

Figure 665509DEST_PATH_IMAGE006
为连续纵坡的行驶时间;H为连续纵坡简化前起点与终点位置的高差;M为车辆总质量,
Figure 803229DEST_PATH_IMAGE004
为重力加速度,k为修正系数(当坡度在达到5%以上,坡度每提高1%,k值增加0.1,其中,坡度在5%时,K=1),P 0为制动器当前温度,
Figure 376686DEST_PATH_IMAGE007
为下坡结束时制动器温度。In the formula,
Figure 665509DEST_PATH_IMAGE006
is the travel time of the continuous longitudinal slope; H is the height difference between the starting point and the end point before the continuous longitudinal slope is simplified; M is the total mass of the vehicle,
Figure 803229DEST_PATH_IMAGE004
is the acceleration of gravity, k is the correction coefficient (when the slope reaches more than 5%, the k value increases by 0.1 for every 1% increase in the slope, where K = 1 when the slope is 5%), P0 is the current temperature of the brake,
Figure 376686DEST_PATH_IMAGE007
is the brake temperature at the end of a downhill slope.

在这里,目前长大连续纵坡的不同纵坡之间有过渡连坡,这些过渡连坡坡度较缓,此处的设计也是为了便于车辆降低车速,这种缓冲段相比于纵坡段一般较短,可以忽略。长大纵坡路段预警难点在于,不同路段的坡长和坡度不同,因此,本申请提出一种新的设计思路,将长大连续纵坡路段简化成单坡,重新定义单坡的坡度和坡长,然后根据长大纵坡的坡度分别确定无辅助制动条件下的升温模型,从而在驾驶员进入长大纵坡路段时,假设其不进行辅助制动操作,预测其制动器升温情况,从而进行提前预警,提醒驾驶员可能有必要采用辅助制动,合理减速。Here, there are transition slopes between different longitudinal slopes of long and continuous longitudinal slopes. The gradient of these transition slopes is relatively gentle. The design here is also to facilitate the vehicle to reduce the speed. This buffer section is generally shorter than the longitudinal slope section and can be ignored. The difficulty of early warning of long and long longitudinal slope sections is that the slope lengths and slopes of different sections are different. Therefore, this application proposes a new design idea, which simplifies the long and long continuous longitudinal slope section into a single slope, redefines the slope and slope length of the single slope, and then determines the temperature rise model under the condition of no auxiliary braking according to the slope of the long and long longitudinal slope. When the driver enters the long and long longitudinal slope section, it is assumed that he does not perform auxiliary braking operation, and the temperature rise of his brake is predicted, so as to give an early warning to remind the driver that it may be necessary to use auxiliary braking and slow down reasonably.

确定下坡结束时制动器温度后,电子设备可以执行步骤S40。After determining the brake temperature at the end of the downhill slope, the electronic device may execute step S40.

步骤S40:在满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,确定此行驶状态存在事故隐患,发出提醒信息。Step S40: When any one of the first condition, the second condition and the third condition is met, it is determined that there is a potential accident hazard in this driving state, and a reminder message is issued.

在本实施例中,提醒信息为声报警信息和/或光报警信息。示例性地,在满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,确定此行驶状态存在事故隐患,发出提醒信息,具体为:In this embodiment, the reminder information is an audible alarm information and/or a visual alarm information. Exemplarily, when any of the first condition, the second condition and the third condition is met, it is determined that there is a potential accident hazard in this driving state, and a reminder information is issued, specifically:

在仅满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,提醒信息为声报警信息;在仅满足其中所述第一条件、所述第二条件和所述第三条件中的两个条件时,提醒信息为光报警信息;在同时满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,提醒信息为声报警信息和光报警信息。When only any one of the first condition, the second condition and the third condition is met, the reminder information is sound alarm information; when only two of the first condition, the second condition and the third condition are met, the reminder information is light alarm information; when any one of the first condition, the second condition and the third condition is met at the same time, the reminder information is sound alarm information and light alarm information.

如此以来,可以根据当前驾驶员的行为所处条件,区别化提醒,当处于极度危险的情况下,通过声报警信息和光报警信息进行提醒。In this way, differentiated reminders can be given according to the current conditions of the driver's behavior. When the driver is in an extremely dangerous situation, reminders can be given through sound and light alarm information.

因此,本方案提供的长大纵坡路段驾驶员事故动态预警方法,利用驾驶员工作区域图像,判断眼部的开合状态,并确定驾驶员疲劳状态;通过获取方向盘转角值数据判断方向盘在预设时间内是否发生转动;通过长大纵坡路段路段信息和驾驶车辆的车辆信息预测下坡结束时制动器温度。当存在潜在驾驶风险时,向驾驶员进行预警,减少交通事故的发生。Therefore, the dynamic early warning method for driver accidents on long and steep slopes provided by this solution uses the image of the driver's work area to determine the opening and closing state of the eyes and the driver's fatigue state; obtains the steering wheel angle value data to determine whether the steering wheel has been turned within the preset time; and predicts the brake temperature at the end of the downhill slope through the long and steep slope section information and the vehicle information of the driving vehicle. When there is a potential driving risk, the driver is warned to reduce the occurrence of traffic accidents.

请参阅图2,图2为本申请实施例提供一种长大纵坡路段驾驶员事故动态预警装置的示意图。Please refer to FIG. 2 , which is a schematic diagram of a dynamic early warning device for driver accidents on a road section with a long longitudinal slope according to an embodiment of the present application.

在本实施例中,长大纵坡路段驾驶员事故动态预警装置10可以包括:In this embodiment, the long longitudinal slope section driver accident dynamic warning device 10 may include:

第一判断模块11,用于获取驾驶员工作区域图像进行图像识别,确定驾驶员眼睛特征,根据驾驶员眼睛特征判断眼部的开合状态,确定驾驶员疲劳状态,若驾驶员处于疲劳状态,确定满足第一条件。The first judgment module 11 is used to obtain the image of the driver's working area for image recognition, determine the driver's eye features, judge the opening and closing state of the eyes based on the driver's eye features, and determine the driver's fatigue state. If the driver is in a fatigued state, it is determined that the first condition is met.

第二判断模块12,用于获取方向盘转角值数据判断方向盘在预设时间内是否发生转动,若方向盘在预设时间内未转动,确定满足第二条件。The second judgment module 12 is used to obtain the steering wheel angle value data to determine whether the steering wheel is turned within a preset time. If the steering wheel is not turned within the preset time, it is determined that the second condition is met.

第三判断模块13,用于获取导航路线长大纵坡路段的路段信息,获取驾驶车辆的车辆信息,根据当前路段信息和当前车辆信息确定无辅助制动条件下,下坡结束时制动器温度,当制动器温度大于预设温度时,确定满足第三条件。The third judgment module 13 is used to obtain the section information of the long longitudinal slope section of the navigation route, obtain the vehicle information of the driving vehicle, and determine the brake temperature at the end of downhill without auxiliary braking conditions based on the current section information and the current vehicle information. When the brake temperature is greater than the preset temperature, it is determined that the third condition is met.

提醒模块14,用于在满足所述第一条件、所述第二条件和所述第三条件中的任一条件时,确定此行驶状态存在事故隐患,发出提醒信息。The reminder module 14 is used to determine that there is a potential accident hazard in the driving state and issue a reminder message when any one of the first condition, the second condition and the third condition is met.

另外,请参阅图3,图3为本申请实施例提供的一种电子设备20的示意图。In addition, please refer to FIG. 3 , which is a schematic diagram of an electronic device 20 provided in an embodiment of the present application.

在本实施例中,电子设备20可以为终端,例如平板电脑、个人电脑等;电子设备20也可以为服务器,例如云服务器、服务器集群等,此处不作限定。In this embodiment, the electronic device 20 may be a terminal, such as a tablet computer, a personal computer, etc.; the electronic device 20 may also be a server, such as a cloud server, a server cluster, etc., which is not limited here.

示例性的,电子设备20可以包括:通过网络与外界连接的通信模块22、用于执行程序指令的一个或多个处理器24、总线23和不同形式的存储器21,例如,磁盘、ROM、或RAM,或其任意组合。存储器21、通信模块22、处理器24之间可以通过总线23连接。Exemplarily, the electronic device 20 may include: a communication module 22 connected to the outside world via a network, one or more processors 24 for executing program instructions, a bus 23, and different forms of memory 21, such as a disk, ROM, or RAM, or any combination thereof. The memory 21, the communication module 22, and the processor 24 may be connected via the bus 23.

示例性的,存储器21中存储有程序。处理器24可以从存储器21调用并运行这些程序,从而便可以通过运行程序而实现长大纵坡路段驾驶员事故动态预警方法。Exemplarily, programs are stored in the memory 21. The processor 24 can call and run these programs from the memory 21, so that the dynamic early warning method for driver accidents on long longitudinal slope sections can be implemented by running the programs.

在本申请所提供的实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,又例如,多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些通信接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

另外,作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。In this document, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any such actual relationship or order between these entities or operations.

以上所述仅为本申请的实施例而已,并不用于限制本申请的保护范围,对于本领域的技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the scope of protection of the present application.

Claims (7)

1. A dynamic early warning method for accidents of drivers in long and large longitudinal slope sections is characterized by comprising the following steps:
acquiring an image of a working area of a driver for image recognition, determining the eye characteristics of the driver, judging the opening and closing state of eyes according to the eye characteristics of the driver, determining the fatigue state of the driver, and determining that a first condition is met if the driver is in the fatigue state;
acquiring steering wheel angle value data to judge whether the steering wheel rotates within preset time, and determining that a second condition is met if the steering wheel does not rotate within the preset time;
acquiring road section information of a long and large longitudinal slope road section of a navigation route, acquiring vehicle information of a driving vehicle, determining the temperature of a brake at the end of a downhill under the condition of no auxiliary braking according to the current road section information and the current vehicle information, and determining that a third condition is met when the temperature of the brake is greater than a preset temperature;
when any one of the first condition, the second condition and the third condition is met, determining that accident potential exists in the driving state, and sending out reminding information;
wherein the link information includes: the method comprises the steps of obtaining vehicle information of a driving vehicle, including a vehicle number, vehicle mass, vehicle speed and current temperature of a brake, according to the length of a road section and the gradient of the road section;
determining the brake temperature at the end of a downhill under the condition of no auxiliary braking according to the current road section information and the current vehicle information, wherein the method comprises the following steps:
simplifying continuous road conditions of the long and large longitudinal slope section, neglecting transitional continuous slopes among different longitudinal slopes, regarding the sections as longitudinal slopes with the same gradient, wherein the starting point of the longitudinal slope with the same gradient is the starting point of the long and large longitudinal slope section before simplification,
the long and large longitudinal slope section is assumed to havenSection-continuous longitudinal slope, then
The length of the longitudinal slope with the same gradient is defined as
L=L 1 + L 2 + L 3 …+L n WhereinLthe length of the slope is the length of the slope,L 1 is the slope length of the 1 st section continuous longitudinal slope,L 2 is as followsThe slope length of the 2-section continuous longitudinal slope,L 3 is the slope length of the 3 rd continuous longitudinal slope,L n is a firstnThe slope length of the segmental continuous longitudinal slope;
the gradient of the longitudinal slope with the same gradient is defined as
I=(I 1 L 1 +I 2 L 2 +I 3 L 3 …+I 1 L n )/(L 1 +L 2 +L 3 …+L n ),
Wherein,Iin order to be the slope of the slope,I 1 is the gradient of the 1 st section continuous longitudinal slope,I 2 is the gradient of the 2 nd continuous longitudinal slope,I 3 the slope of the 3 rd section continuous longitudinal slope,I n is a firstnThe gradient of the segmental continuous longitudinal slope;
the vehicle speed is assumed to be constant asVDetermining the temperature of a brake at the end of a downhill under the condition of no auxiliary braking according to the simplified parameters of the long and large longitudinal slope section;
when the gradient of the longitudinal slope with the same gradient is more than 2 percent and I is less than or equal to 5 percent,
Figure QLYQS_1
when the gradient of the longitudinal slope with the same gradient is I more than 5 percent,
Figure QLYQS_2
in the formula,
Figure QLYQS_3
the running time of the continuous longitudinal slope; h is the height difference between the starting point and the end point before the simplification of the continuous longitudinal slope; m is the total mass of the vehicle, and>
Figure QLYQS_4
is heavyThe acceleration of the force is accelerated and,kfor correcting the coefficient, when the gradient reaches more than 5 percent and every time the gradient is improved by 1 percent,kthe value increases by 0.1, wherein, at a gradient of 5%,k=1,P 0 for the current temperature of the brake>
Figure QLYQS_5
Brake temperature at the end of the downhill slope.
2. The dynamic early warning method for the accidents of the driver on the long and long longitudinal slope road section as claimed in claim 1, wherein the image of the working area of the driver is obtained to identify the eye characteristics of the driver through image recognition, the eye opening and closing state is judged according to the eye characteristics of the driver, and the fatigue state of the driver is determined, which comprises the steps of
Carrying out face detection on the image of the working area of the driver, determining parameters of the width and the height of the face, carrying out eye detection on the face area, carrying out primary positioning on the iris, and determining the position parameter of the iris of the current frame image;
based on an adjacent frame difference method, acquiring an adjacent frame difference binary image by using an absolute value of an adjacent frame difference of a front frame image and a rear frame image, judging whether the front frame image and the rear frame image have an intersection or not based on the adjacent frame difference binary image, repeating the previous step if the front frame image and the rear frame image do not have the intersection, detecting a face movement parameter if the front frame image and the rear frame image have the intersection, and determining a position parameter of an iris in a current frame image according to the movement parameter;
detecting the vertical edge according to a Sobel operator, acquiring an iris area image, and identifying open-eye and closed-eye images;
performing edge detection on the image of the open eye iris region to obtain the junction of the iris and the upper eyelid and the lower eyelid, determining the length of the eye according to the edge of the upper eyelid and the lower eyelid, and defining the opening value of the eye according to the ratio of the iris exposure area to the eye length;
obtaining working area images in equal time intervals within a preset time period T according to the time sequence, and obtaining eye opening values of corresponding frame images according to the steps;
drawing a curve by taking the time sequence as an abscissa and the eye opening value of the corresponding frame image as an ordinate, acquiring a region area S formed by the curve and the abscissa in a surrounding manner, and determining the eye opening of the time period according to the ratio of the region area S to the time period T;
and comparing the opening degree with a preset threshold value, and determining that the driver is in a fatigue state when the opening degree is smaller than the preset threshold value.
3. The dynamic early warning method for the accidents of the drivers on the long and large longitudinal slope sections according to claim 1, wherein steering wheel angle value data is acquired by a steering wheel angle sensor.
4. The dynamic early warning method for the accidents of the drivers on the long and large longitudinal slope sections according to claim 1, wherein the reminding information is sound alarm information and/or light alarm information.
5. The dynamic early warning method for the accident of the driver on the long and large longitudinal slope section as claimed in claim 4, wherein when any one of the first condition, the second condition and the third condition is met, it is determined that the accident potential exists in the driving state, and a warning message is sent, specifically:
when any one of the first condition, the second condition and the third condition is only met, the reminding information is sound alarm information;
when only two conditions of the first condition, the second condition and the third condition are met, the reminding information is light alarm information;
and when any one of the first condition, the second condition and the third condition is met, the reminding information is sound alarm information and light alarm information.
6. A dynamic early warning device for accidents of drivers on long and large longitudinal slope sections is characterized by comprising
The first judgment module is used for acquiring images of a working area of a driver to perform image recognition, determining the eye characteristics of the driver, judging the opening and closing state of eyes according to the eye characteristics of the driver, determining the fatigue state of the driver, and determining that a first condition is met if the driver is in the fatigue state;
the second judgment module is used for acquiring steering wheel angle value data to judge whether the steering wheel rotates within the preset time, and if the steering wheel does not rotate within the preset time, the second judgment module determines that a second condition is met;
the third judgment module is used for acquiring the road section information of a long and large longitudinal slope road section of the navigation route, acquiring the vehicle information of a driving vehicle, determining the brake temperature at the end of a downhill under the condition of no auxiliary brake according to the current road section information and the current vehicle information, and determining that a third condition is met when the brake temperature is greater than a preset temperature;
the reminding module is used for determining that accident potential exists in the driving state and sending reminding information when any one of the first condition, the second condition and the third condition is met;
wherein the link information includes: the method comprises the steps of obtaining vehicle information of a driving vehicle, including a vehicle number, vehicle mass, vehicle speed and current temperature of a brake, according to the length of a road section and the gradient of the road section;
determining the brake temperature at the end of a downhill under the condition of no auxiliary braking according to the current road section information and the current vehicle information, wherein the method comprises the following steps:
simplifying continuous road conditions of the long and large longitudinal slope section, neglecting transitional continuous slopes among different longitudinal slopes, regarding the sections as longitudinal slopes with the same gradient, wherein the starting point of the longitudinal slope with the same gradient is the starting point of the long and large longitudinal slope section before simplification,
the long and large longitudinal slope section is assumed to havenSection-continuous longitudinal slope, then
The length of the longitudinal slope with the same gradient is defined as
L=L 1 + L 2 + L 3 …+L n WhereinLthe length of the slope is the length of the slope,L 1 is the slope length of the 1 st section continuous longitudinal slope,L 2 the slope length of the 2 nd continuous longitudinal slope,L 3 slope of 3 rd continuous longitudinal slopeThe length of the utility model is long,L n is as followsnThe length of the section of continuous longitudinal slope;
the gradient of the longitudinal slope with the same gradient is defined as
I=(I 1 L 1 +I 2 L 2 +I 3 L 3 …+I 1 L n )/(L 1 +L 2 +L 3 …+L n ),
Wherein,Iin order to be the slope of the slope,I 1 is the gradient of the 1 st section continuous longitudinal slope,I 2 is the gradient of the 2 nd section continuous longitudinal slope,I 3 the slope of the 3 rd section continuous longitudinal slope,I n is as followsnThe gradient of the segmental continuous longitudinal slope;
the vehicle speed is assumed to be constant during the downhill process of a long and large longitudinal slope sectionVDetermining the temperature of a brake at the end of a downhill under the condition of no auxiliary braking according to the simplified parameters of the long and large longitudinal slope section;
when the gradient of the longitudinal slope with the same gradient is more than 2 percent and I is less than or equal to 5 percent,
Figure QLYQS_6
when the gradient of the longitudinal slope with the same gradient is I more than 5 percent,
Figure QLYQS_7
in the formula,
Figure QLYQS_8
the running time of the continuous longitudinal slope; h is the height difference between the starting point and the end point before the simplification of the continuous longitudinal slope; m is the total mass of the vehicle, based on the sum of the measured values>
Figure QLYQS_9
In order to be the acceleration of the gravity,kfor correcting the coefficient, when the gradient reaches more than 5 percent, the gradientEvery time the yield is increased by 1 percent,kthe value increases by 0.1, wherein, at a gradient of 5%,k=1,P 0 is the current temperature of the brake>
Figure QLYQS_10
Brake temperature at the end of the downhill slope.
7. An electronic device, comprising a memory for storing information including program instructions and a processor for controlling execution of the program instructions, wherein the program instructions are loaded and executed by the processor to implement the dynamic early warning method for accidents of drivers on long and long longitudinal slope sections as claimed in any one of claims 1 to 5.
CN202211291757.1A 2022-10-21 2022-10-21 Dynamic early warning method and device for driver accidents in long and large longitudinal slope section and electronic equipment Active CN115366909B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211291757.1A CN115366909B (en) 2022-10-21 2022-10-21 Dynamic early warning method and device for driver accidents in long and large longitudinal slope section and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211291757.1A CN115366909B (en) 2022-10-21 2022-10-21 Dynamic early warning method and device for driver accidents in long and large longitudinal slope section and electronic equipment

Publications (2)

Publication Number Publication Date
CN115366909A CN115366909A (en) 2022-11-22
CN115366909B true CN115366909B (en) 2023-04-07

Family

ID=84074401

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211291757.1A Active CN115366909B (en) 2022-10-21 2022-10-21 Dynamic early warning method and device for driver accidents in long and large longitudinal slope section and electronic equipment

Country Status (1)

Country Link
CN (1) CN115366909B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117671962B (en) * 2024-01-31 2024-04-19 四川康新高速公路有限责任公司 Method and device for analyzing vehicle out-of-control state aiming at long longitudinal slope section of expressway

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105404746A (en) * 2015-12-01 2016-03-16 桂林电子科技大学 Reliability design method for long and steep downhill highway
CN105446391A (en) * 2015-12-07 2016-03-30 长安大学 Temperature rise prediction method for long downgrade driving brake for lorry
CN106504164A (en) * 2016-10-19 2017-03-15 东南大学 A kind of division methods of combination area of city and country's inferior grade road speeds control zone
CN108340900A (en) * 2018-01-31 2018-07-31 中交第二公路勘察设计研究院有限公司 Truck hub temperature predicting method of the large longitudinal slope route based on brake behavior
CN109017740A (en) * 2018-07-29 2018-12-18 合肥市智信汽车科技有限公司 A kind of temperature monitoring method for automobile
CN114715111A (en) * 2022-05-07 2022-07-08 交通运输部公路科学研究所 A TBOX-based Brake Temperature Estimation Method for Freight Vehicles

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59153625A (en) * 1983-02-18 1984-09-01 Nissan Motor Co Ltd Drowsy driving detection device
DE102005026456B4 (en) * 2005-06-09 2017-04-20 Daimler Ag Method for detecting fatigue
CN101872171B (en) * 2009-04-24 2012-06-27 中国农业大学 Driver fatigue state recognition method and system based on information fusion
CN101692980B (en) * 2009-10-30 2011-06-08 深圳市汉华安道科技有限责任公司 Method and device for detecting fatigue driving
US8731795B2 (en) * 2010-10-12 2014-05-20 Bendix Commercial Vehicle Systems Llc System and method for reducing brake fade
CN104809445B (en) * 2015-05-07 2017-12-19 吉林大学 method for detecting fatigue driving based on eye and mouth state
CN204956446U (en) * 2015-09-30 2016-01-13 山西省交通科学研究院 Big freight train brake drum temperature rise in downhill path highway section of growing up is reported to police and cooling system
CN107139934B (en) * 2017-07-03 2023-04-28 吉林大学 System and method for car driver fatigue relief and wake-up based on masking effect
US11040726B2 (en) * 2017-12-15 2021-06-22 Baidu Usa Llc Alarm system of autonomous driving vehicles (ADVs)
CN108446600A (en) * 2018-02-27 2018-08-24 上海汽车集团股份有限公司 A kind of vehicle driver's fatigue monitoring early warning system and method
CN208515586U (en) * 2018-03-20 2019-02-19 星展测控科技股份有限公司 A kind of long descending control system of automobile
CN108720851B (en) * 2018-05-23 2021-06-29 释码融和(上海)信息科技有限公司 Driving state detection method, mobile terminal and storage medium
GB2577270B (en) * 2018-09-19 2021-04-07 Jaguar Land Rover Ltd Apparatus and method for monitoring vehicle operation
CN109969083B (en) * 2019-03-13 2024-01-30 中南大学 Safety pre-warning and monitoring system for large trucks and trucks
CN112428921B (en) * 2019-08-06 2022-11-04 上海博泰悦臻网络技术服务有限公司 Continuous downhill road section prompting method and device and vehicle
CN111376909A (en) * 2020-03-21 2020-07-07 东风汽车集团有限公司 Indirect fatigue monitoring method
CN111488650A (en) * 2020-04-07 2020-08-04 天津市市政工程设计研究院 Expressway long downhill section danger avoiding lane early warning method
CN111986488B (en) * 2020-09-14 2021-11-30 湖南三一中型起重机械有限公司 Fatigue driving detection method and device, electronic equipment and storage medium
CN112802356B (en) * 2020-12-30 2022-01-04 深圳市微网力合信息技术有限公司 Vehicle automatic driving method and terminal based on Internet of things
CN112686161A (en) * 2020-12-31 2021-04-20 遵义师范学院 Fatigue driving detection method based on neural network
CN214623936U (en) * 2021-02-22 2021-11-05 四川省交通投资集团有限责任公司 Temperature measurement early warning system for road vehicles on long downhill section and mountain continuous downhill section
CN113375805A (en) * 2021-04-23 2021-09-10 西安纳兴电子科技有限公司 Early warning system for long downhill road section
CN114267169A (en) * 2021-09-15 2022-04-01 赣南师范大学 A speed limit control method for preventing fatigue driving based on machine vision
CN115081756B (en) * 2022-08-19 2022-11-11 四川省公路规划勘察设计研究院有限公司 Road section brake drum temperature prediction and road section risk assessment method based on long and large longitudinal slope road section
CN115158274B (en) * 2022-08-31 2022-11-29 四川省公路规划勘察设计研究院有限公司 Long and large longitudinal slope dangerous road section identification method based on truck braking and heavy braking characteristics

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105404746A (en) * 2015-12-01 2016-03-16 桂林电子科技大学 Reliability design method for long and steep downhill highway
CN105446391A (en) * 2015-12-07 2016-03-30 长安大学 Temperature rise prediction method for long downgrade driving brake for lorry
CN106504164A (en) * 2016-10-19 2017-03-15 东南大学 A kind of division methods of combination area of city and country's inferior grade road speeds control zone
CN108340900A (en) * 2018-01-31 2018-07-31 中交第二公路勘察设计研究院有限公司 Truck hub temperature predicting method of the large longitudinal slope route based on brake behavior
CN109017740A (en) * 2018-07-29 2018-12-18 合肥市智信汽车科技有限公司 A kind of temperature monitoring method for automobile
CN114715111A (en) * 2022-05-07 2022-07-08 交通运输部公路科学研究所 A TBOX-based Brake Temperature Estimation Method for Freight Vehicles

Also Published As

Publication number Publication date
CN115366909A (en) 2022-11-22

Similar Documents

Publication Publication Date Title
US11407426B2 (en) Collision warning method and apparatus
US11027750B2 (en) Method and system for assisting drivers to drive with precaution
US11945435B2 (en) Devices and methods for predicting collisions and/or intersection violations
JP7544502B2 (en) Driving assistance device and data collection system
JP7509628B2 (en) Driving Support Devices
US12187270B2 (en) Devices and methods for predicting intersection violations and/or collisions
Lashkov et al. Driver dangerous state detection based on OpenCV & dlib libraries using mobile video processing
CN107527000A (en) The apparatus and method that the concentration degree of driver is monitored using eyes tracking
CN115649133A (en) Vehicle emergency braking control method, device, electronic equipment and vehicle
US20250289404A1 (en) Intelligent Driving Decision-Making Method, Apparatus, Storage Medium, And Electronic Device
US20210309221A1 (en) Devices and methods for determining region of interest for object detection in camera images
CN115366909B (en) Dynamic early warning method and device for driver accidents in long and large longitudinal slope section and electronic equipment
CN117944416A (en) Suspension height adjusting method and device, electronic equipment and readable storage medium
CN115782911A (en) Data processing method for steering wheel hands-off event in driving scene and related device
JP6011450B2 (en) Vehicle braking device
JP2011150577A (en) Alarm device
CN115923809A (en) Human-machine co-driving control method, device, system and vehicle
WO2022265776A1 (en) Devices and methods for predicting collisions, predicting intersection violations, and/or determining region of interest for object detection in camera images
KR102338067B1 (en) Driver monitoring system for using interest area
CN119872571A (en) Vehicle braking method, system, vehicle terminal and storage medium
WO2020105094A1 (en) Notification control device, notification device, notification system, and notification control method
CN118306389A (en) Rear-end collision prevention control method and device, electronic equipment and storage medium
CN118597185A (en) A method, device, vehicle and storage medium for assisting driving
CN206264897U (en) A kind of device for reducing lane-change early warning rate of false alarm
CN113428176B (en) Unmanned vehicle driving strategy adjustment method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant