Background
With the development of automobile technology, particularly the application of intelligent and networking technology, the man-machine interaction system of intelligent automobiles is more and more complex, the operation of the vehicle-mounted interaction system has the trend of larger and larger screens and more operation tasks, and the man-machine interaction of corresponding drivers is more and more frequent, such as music playing, map navigation, self-adaptive cruise system, automatic parking system, traffic jam auxiliary system and the like, has quite a plurality of interactive operations. The good interaction system can bring convenient operation and good user experience, but the poor man-machine interaction system can lead a driver to have low operation efficiency and poor experience, and can lead the driver to be abandoned in the past, and more seriously, the poor interaction design can influence the normal driving task of driving, so that the driver is in a state of distraction driving and fatigue driving, and the driving danger is brought.
Correspondingly, a corresponding interaction system is also provided for the driver distraction and fatigue driving states, namely a DMS system (Drive Monitoring System, driver monitoring system). At present, a plurality of vehicles are provided with a DMS system, which can realize the functions of driver fatigue driving state monitoring, driver attention monitoring, dangerous driving behavior monitoring and the like, can correspondingly give an alarm when the dangerous behavior or the dangerous driving state is identified, and is beneficial to reducing the occurrence rate of driving accidents. However, with the great use of such interactive systems, new problems are correspondingly presented—no scientific and effective real vehicle test evaluation method capable of effectively evaluating the interactive system itself exists at present, so that the judgment accuracy of the DMS system itself is not considered, and the existing evaluation mode for the DMS system can complete the evaluation of the DMS system, but has more defects.
The existing evaluation modes for the DMS system mainly have two modes, namely, the first mode is to simulate various movements such as distraction, fatigue and the like by a real person so as to detect the recognition accuracy of the DMS system on the distraction, fatigue movements. However, the method cannot achieve standardization and consistency, so that the error of a test result is large, the transverse comparability among different vehicles is poor, and meanwhile, the risks of actions such as eye closure, right-looking and left-looking pan and the like such as real fatigue and distraction are large in real vehicle driving. The second is to adopt the simulation robot to simulate the distraction and fatigue actions, the action control standard is improved to some extent, but because the simulation robot is installed at the driver position, the vehicle driving operation cannot be performed, and if the DMS system evaluates the restriction conditions such as the real vehicle speed, the GPS signal, the map fence and the like, the effective evaluation cannot be performed.
Disclosure of Invention
The invention aims to provide an intelligent automobile man-machine interaction evaluation system and an intelligent automobile man-machine interaction evaluation method, which can accurately test and evaluate the operation effect of a DMS system, and particularly can accurately evaluate the operation effect of the DMS system under the real driving condition.
In order to achieve the above object, the present invention provides the following solutions:
scheme one:
An intelligent automobile man-machine interaction evaluation system comprises an acquisition subsystem, an operation subsystem, an auxiliary subsystem and a control subsystem;
The acquisition subsystem comprises an alarm acquisition sensor, an operation subsystem and an auxiliary subsystem, wherein the alarm acquisition sensor is in communication connection with the DMS system, the alarm acquisition sensor is used for acquiring alarm information data of the DMS system, the operation subsystem comprises a simulation robot, the auxiliary subsystem comprises an auxiliary driving auxiliary pedal and an auxiliary driving auxiliary steering wheel which are both arranged on an auxiliary driving position, the auxiliary driving auxiliary pedal is connected with a main driving pedal and used for controlling the main driving pedal, and the auxiliary driving auxiliary steering wheel is connected with the main driving steering wheel and used for controlling the main driving steering wheel;
The control subsystem comprises a controller and a comparison module, wherein the controller is used for outputting a control instruction according to a preset strategy to control the action of the simulation robot, and the comparison module is used for comparing the control instruction with alarm information data fed back by the DMS system and evaluating the DMS system according to the comparison strategy.
The working principle and the working principle of the scheme have the advantages that the simulation robot is placed on a vehicle driving position during evaluation, the controller outputs a control instruction to control the simulation robot to make different actions, the action is simulated by the simulation robot, the standardization and the consistency of the action can be reliably ensured, and the reduction of test errors is facilitated. The DMS system in the vehicle monitors and feeds back the action of the simulation robot, and at the same time, the alarm acquisition sensor immediately acquires alarm information fed back by the DMS system, and the comparison module makes an evaluation on the DMS system by comparing the control instruction with the feedback data of the DMS system according to a comparison strategy. Moreover, a tester can sit at a co-driver position of the vehicle to drive and control the vehicle through the auxiliary subsystem, so that an evaluation environment under the real driving condition is built, the evaluation results of the DMS system under different limiting conditions can be obtained, and the evaluation of the DMS system can be carried out in the real application environment.
Compared with the real person evaluation scheme, the simulation robot is adopted to execute the test action, the comparison module is adopted to complete the evaluation analysis, the test action is standardized, the evaluation analysis is dataized, and higher evaluation accuracy can be ensured. Compared with the evaluation scheme of adopting the simulation robot, the simulation robot can synchronously and safely drive the automobile in the evaluation process through the arrangement of the auxiliary subsystem, further can evaluate the DMS system under the real driving condition, can meet the sensing triggering limiting conditions (such as the vehicle speed condition, the moving condition and the like) for sensing the action in some DMS systems, and ensures the comprehensive and reliable evaluation.
Further, the auxiliary driving pedal comprises an auxiliary driving auxiliary accelerator pedal and an auxiliary driving auxiliary brake pedal, and the auxiliary driving auxiliary accelerator pedal is connected with the main driving accelerator pedal, and the auxiliary driving brake pedal is connected with the main driving brake pedal through steel wires.
The auxiliary driving accelerator pedal has the beneficial effects that the auxiliary driving accelerator pedal correspondingly controls the main driving accelerator and the main driving brake, so that the movement of the vehicle can be accurately controlled.
Further, the controller is provided with a manual control module, and the manual control module is used for manually selecting and outputting control instructions.
The controller has the beneficial effects that the controller can provide a manual control mode, can be used for a tester to independently select and output control instructions, and has stronger applicability.
Further, the control instructions include a blink instruction, an eyeball rotation instruction, a yawing instruction, a turning instruction, a head raising instruction, a head lowering instruction, and a hand raising instruction.
The simulation robot has the beneficial effects that the control instruction is rich in variety, and different distraction and fatigue operations can be simulated by the simulation robot so as to be recognized and processed by the DMS system.
Further, the acquisition subsystem further comprises a voice recognition sensor and an image recognition sensor, wherein the voice recognition sensor and the image recognition sensor are respectively used for acquiring voice and image data of the DMS system.
The method has the beneficial effects that the method not only collects the alarm information of the DMS system, but also correspondingly collects the voice and image data of the DMS system, and can provide more diversified data references for evaluating the DMS system.
The preset strategy further comprises the steps of executing various control instructions in sequence and executing preset times of each type of control instruction.
The method has the beneficial effects that the preset strategy comprises two types of operation logic, different test modes can be obtained through simulation through random combination and sequential repeated control instruction output, and the response capability of the DMS system to distraction and fatigue operation can be better evaluated.
Further, the comparison method comprises the steps of comparing the output time point of the control command with the feedback time point of the DMS system, determining the feedback timeliness of the DMS system according to the difference value between the output time point and the feedback time point, comparing the output times of the control command with the feedback times of the DMS system, and determining the feedback accuracy of the DMS system according to the difference value between the output times and the feedback times.
The method has the advantages that the feedback timeliness and the feedback accuracy of the DMS system can be evaluated according to the comparison strategy, and the evaluation effect is good.
Scheme II:
a testing method of intelligent automobile man-machine interaction is provided, which is applied to the evaluation system of intelligent automobile man-machine interaction according to the scheme I, and comprises the following steps:
The method comprises the following steps of 1, installing a simulation robot on a main driving position of a vehicle to be tested, and controlling the operation of the vehicle to be tested through an auxiliary subsystem;
Step 2, the controller outputs a control instruction according to a preset strategy to control the action of the simulation robot;
And 3, comparing the control instruction and the feedback data of the DMS by the comparison module, and evaluating the DMS according to the comparison strategy.
The evaluation method provided by the scheme has the advantages that the operation of the DMS system can be accurately tested and evaluated, and particularly the operation effect of the DMS system under the real driving condition can be accurately evaluated.
Further, the test environment of the vehicle to be tested comprises an indoor rotary drum, a closed test field and a public road.
The test system has the beneficial effects that the test environment of the vehicle to be tested is various and comprises a real road environment, so that the operation state of the DMS system under the limiting conditions of real vehicle speed, GPS signals, map fences and the like can be effectively tested.
Detailed Description
The following is a further detailed description of the embodiments:
embodiment one:
The embodiment is basically as shown in figure 1, and the evaluation system for intelligent automobile man-machine interaction comprises an acquisition subsystem, an operation subsystem, an auxiliary subsystem and a control subsystem.
The acquisition subsystem comprises an alarm acquisition sensor, wherein the alarm acquisition sensor is in communication connection with the DMS system, and the alarm acquisition sensor is used for acquiring alarm information data of the DMS system. Wherein the DMS system (Drive Monitoring System) refers to a driver monitoring system. The DMS system in this embodiment is a conventional driver monitoring system configured in an intelligent vehicle, and is configured to implement recognition and monitoring of the action behavior of the driver through cooperation of a camera and other vehicle body sensors, and send out alarm information when monitoring and determining that the driver is in an abnormal driving state, so as to form alarm information data.
The operation subsystem comprises a simulation robot, wherein the simulation robot comprises a simulation head and a simulation trunk, and the simulation human size accords with the specification of basic human values in the GB/T10000-1988 Chinese adult human body size standard so as to ensure that the simulation robot accords with the human body standard of a driver seat. In this embodiment, a conventional simulation robot having a motion simulation function may be used.
The auxiliary subsystem comprises an auxiliary driving auxiliary pedal and an auxiliary driving auxiliary steering wheel which are both arranged on the auxiliary driving position, wherein the auxiliary driving auxiliary pedal is connected with the main driving pedal and used for controlling the main driving pedal, and the auxiliary driving auxiliary steering wheel is connected with the main driving steering wheel and used for controlling the main driving steering wheel. Specifically, as shown in fig. 2 and 4, the auxiliary driving pedal comprises an auxiliary driving auxiliary accelerator pedal and an auxiliary driving auxiliary brake pedal, wherein the auxiliary driving auxiliary accelerator pedal is connected with the main driving accelerator pedal, the auxiliary driving brake pedal is connected with the main driving brake pedal through a steel wire, the auxiliary driving auxiliary accelerator pedal keeps consistent with the main driving accelerator pedal in action, and the auxiliary driving brake pedal keeps consistent with the main driving brake pedal in action.
Specifically, the auxiliary steering wheel is consistent with the main steering wheel in size, as shown in fig. 3, and is connected with the main steering wheel through a steering wheel connecting rod, and the steering wheel connecting rod comprises a rigid connecting rod, a ball head and a ball sleeve. Both ends of the rigid connecting rod are welded with a ball head and a ball sleeve, so that the rigid connecting rod can be matched with the inner circle surface of the steering wheel well, and the rigid connecting rod is simple in connecting structure and effective in connection.
The control subsystem comprises a controller and a comparison module, wherein the controller is used for outputting a control instruction according to a preset strategy to control the action of the simulation robot, and the comparison module is used for comparing the control instruction with alarm information data fed back by the DMS system and evaluating the DMS system according to the comparison strategy.
The control instruction comprises a blink instruction, an eyeball rotation instruction, a yawning instruction, a head turning instruction, a head raising instruction, a head lowering instruction and a hand raising instruction. In this embodiment, the hand-up instruction includes an instruction action related to hand movement, such as a call-on instruction, a smoke instruction, etc. Specifically, corresponding to the control instruction, the complete behavior action correspondingly executed by the simulation robot is shown in the attached table 1:
table 1 definition table for single complete test of behavior actions
The preset strategy comprises randomly calling a plurality of different control instructions to form a control group and executing the control group, for example, 3-5 control instructions are randomly selected from the control instructions to form a control group. The preset strategy further comprises the steps of executing various control instructions in sequence and executing preset times of each type of control instruction, wherein the preset times can be set to 20 times, 40 times or 60 times in the embodiment, and certain external test conditions can be correspondingly added.
Specifically, in the present embodiment, the preset number of times setting may be set as per the accompanying table 2.
Table 2 preset times
The comparison method comprises the steps of comparing the output time point of the control command with the feedback time point of the DMS system, determining the feedback timeliness of the DMS system according to the difference value between the output time point and the feedback time point, comparing the output times of the control command with the feedback times of the DMS system, and determining the feedback accuracy of the DMS system according to the difference value between the output times and the feedback times.
Specifically, in this embodiment, the time point at which the control instruction is output specifically refers to a time point at which the control instruction is transmitted to the simulation robot, and may also correspond to a time point at which the simulation robot receives the control instruction to start to act. The feedback time point of the DMS system specifically refers to the time point of producing alarm information after the DMS system monitors and recognizes the action information, and also corresponds to the time point of receiving alarm information data of the DMS system by the alarm acquisition sensor. In this embodiment, when the difference between the output time point and the feedback time point is 0-4 s, it is determined that the feedback timeliness of the DMS system is high, when the difference between the output time point and the feedback time point is 5-8 s, it is determined that the feedback timeliness of the DMS system is medium, and when the difference between the output time point and the feedback time point is greater than 9s, it is determined that the feedback timeliness of the DMS system is low. The scheme is set in such a way that the setting of the judgment standards of different feedback timeliness is based on the setting of action duration corresponding to a single control instruction, and the evaluation standards are reliable.
The feedback times of the DMS system are the total times of feedback alarm information data of the DMS system, and also correspond to the total times of alarm information data received by the alarm acquisition sensor. In this embodiment, when the difference between the output frequency and the feedback frequency is 0-2 times, the feedback accuracy of the DMS system is determined to be high, when the difference between the output frequency and the feedback frequency is 3-5 times, the feedback accuracy of the DMS system is determined to be medium, and when the difference between the output frequency and the feedback frequency is greater than 6 times, the feedback accuracy of the DMS system is determined to be low. The scheme is that the feedback accuracy grade is confirmed based on the difference value of the output times and the feedback times, the difference value judging range of each grade is strictly set, and the evaluation reliability is high.
The embodiment also provides a testing method of the intelligent automobile man-machine interaction, which is applied to the testing system of the intelligent automobile man-machine interaction and comprises the following steps:
Step 1, installing a simulation robot on a main driving position of a vehicle to be tested, and controlling the operation of the vehicle to be tested by a tester through an auxiliary subsystem. Specifically, the test environment of the vehicle to be tested comprises an indoor rotary drum, a closed test field and a public road.
It can be understood that the test environment of the vehicle to be tested in the present solution may be a stationary scene (i.e. a scene where the vehicle is stationary and not moving), and the auxiliary subsystem does not participate in the operation when the vehicle is stationary. When the vehicle to be tested is tested in the test environments such as an indoor rotary drum, a closed test field, a public road and the like, a tester can control the auxiliary pedal and the auxiliary steering wheel in the auxiliary subsystem to control the movement of the vehicle, so that an evaluation environment under the actual driving condition is formed.
And 2, the controller outputs a control instruction according to a preset strategy to control the action of the simulation robot, and the DMS system of the automobile to be tested monitors the action of the simulation robot in real time.
And 3, comparing the control instruction and the feedback data of the DMS by the comparison module, and evaluating the DMS according to the comparison strategy.
The evaluation system and the test method for the man-machine interaction of the intelligent automobile can accurately test and evaluate the operation effect of the DMS system, and particularly can accurately evaluate the operation effect of the DMS system under the real driving condition. In the conventional evaluation scheme aiming at the DMS system, the operation effect of the DMS system is evaluated by taking the result as a guide, and only the omission factor is comprehensively evaluated, but the timeliness of the operation of the DMS system is not evaluated, but in fact, the timeliness of the DMS system for the response of the distraction/fatigue actions is very important for the real driving behavior. In a real driving scenario, the distraction of the driver for a fraction of a second may cause a major safety accident, and even if the DMS system is able to detect distraction/fatigue behavior without omission, the DMS system is still unreliable if the detection reminder is not sufficiently timely. The scheme discovers the problems, sets the feedback timeliness and the feedback accuracy of the corresponding comparison strategy multidimensional evaluation DMS system, and can evaluate and analyze the DMS system more comprehensively.
In addition, the simulation robot is used for executing the test action, in the conventional test scheme, the test is often more favored to be carried out by a real person tester, because the real person action can ensure the authenticity of the distraction action and the fatigue action, the real person tester can autonomously control the vehicle, the real person tester is more in line with the actual application environment and can trigger some special running conditions of the DMS system, but the real person test also has the problems such as uncontrollable behavior and nonstandard simulation of the distraction/fatigue action, so that the reliability of the test result is lower. The simulation robot is adopted to test, so that the moment controllability of action behavior can be ensured, the action simulation is accurate, and the authenticity of part of actions is lost, but in practice, for the test of a DMS system, the authenticity of the actions is not the standard which is required to be reached, and the authenticity of the action and the whole test environment are more required to be ensured, because the method is directly aligned with the execution triggering standard of the functions of the DMS system.
In the scheme, the simulation robot is applied to ensure the former (namely, the action standardization), and meanwhile, the auxiliary subsystem is particularly arranged to ensure the latter (namely, the authenticity of the whole test environment). Even if a few conventional test schemes adopt the simulation robots to test, the simulation robots cannot guarantee the simulation robots, because the simulation robots cannot drive automobiles and occupy driving positions, the DMS system cannot operate in the real driving process, and some DMS system functions which can be triggered only by special vehicle speed conditions and geographical position conditions are not triggered, so that the evaluation of the DMS system is imperfect and the reliability is poor. The problem is well solved in the scheme, the control function of the main driving position on the automobile running is transferred through the auxiliary subsystem, the intervention of a tester is facilitated, the automobile running is operated, the DMS system can be operated in the real driving process, the special automobile running condition required by the DMS system can be controlled, and meanwhile, compared with a real person testing scheme, the test is more standard and safer.
Embodiment two:
an intelligent automobile man-machine interaction evaluation system is used for adjusting an acquisition subsystem and a control subsystem on the basis of the first embodiment.
Specifically, the controller is provided with a manual control module, and the manual control module is used for manually selecting and outputting control instructions. The acquisition subsystem further comprises a voice recognition sensor and an image recognition sensor, wherein the voice recognition sensor and the image recognition sensor are respectively used for acquiring voice and image data of the DMS system.
Specifically, the voice recognition sensor and the image recognition sensor in this embodiment may be a voice recognition sensor and an image recognition sensor that are self-adopted by the DMS system, and the comparison module correspondingly receives data information acquired by the voice recognition sensor and the image recognition sensor. In this embodiment, when the comparison module determines the feedback timeliness of the DMS system according to the difference between the output timeliness and the feedback timeliness, the comparison module correspondingly invokes the voice and image data of the DMS system to further verify whether the DMS system monitors the action of the simulation robot.
The present embodiment also provides a method for testing man-machine interaction of an intelligent automobile, which is the same as the method described in the first embodiment, so that details are not repeated here.
Compared with the first embodiment, the evaluation system and the test method for the man-machine interaction of the intelligent automobile correspondingly acquire the voice and image data of the DMS system, can provide more diversified data references for evaluating the DMS system, and are more convenient for comparison and analysis. And moreover, the manual control module can be used for the testers to automatically select and output the control instruction, so that the applicability is higher.
The foregoing is merely an embodiment of the present application, and a specific structure and characteristics of common knowledge in the art, which are well known in the scheme, are not described herein, so that a person of ordinary skill in the art knows all the prior art in the application date or before the priority date, can know all the prior art in the field, and has the capability of applying the conventional experimental means before the date, and a person of ordinary skill in the art can complete and implement the present embodiment in combination with his own capability in the light of the present application, and some typical known structures or known methods should not be an obstacle for a person of ordinary skill in the art to implement the present application. It should be noted that modifications and improvements can be made by those skilled in the art without departing from the structure of the present application, and these should also be considered as the scope of the present application, which does not affect the effect of the implementation of the present application and the utility of the patent. The protection scope of the present application is subject to the content of the claims, and the description of the specific embodiments and the like in the specification can be used for explaining the content of the claims.