[go: up one dir, main page]

WO2018058266A1 - Mobile terminal-based notification method and system - Google Patents

Mobile terminal-based notification method and system Download PDF

Info

Publication number
WO2018058266A1
WO2018058266A1 PCT/CN2016/100232 CN2016100232W WO2018058266A1 WO 2018058266 A1 WO2018058266 A1 WO 2018058266A1 CN 2016100232 W CN2016100232 W CN 2016100232W WO 2018058266 A1 WO2018058266 A1 WO 2018058266A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
vehicle
mobile terminal
terminal
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/100232
Other languages
French (fr)
Chinese (zh)
Inventor
张哲文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Zhile Technologies Ltd Co
Original Assignee
Shenzhen Zhile Technologies Ltd Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Zhile Technologies Ltd Co filed Critical Shenzhen Zhile Technologies Ltd Co
Priority to PCT/CN2016/100232 priority Critical patent/WO2018058266A1/en
Publication of WO2018058266A1 publication Critical patent/WO2018058266A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/06Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems

Definitions

  • the present invention relates to the field of automobiles, and in particular, to a prompting method and system based on a mobile terminal.
  • the technical problem to be solved by the embodiments of the present invention is to provide a prompting method and system based on a mobile terminal. To solve the problem of insufficient intelligence of existing cars.
  • a first aspect of the embodiments of the present invention provides a prompting method based on a mobile terminal, including:
  • the mobile terminal initiates a connection request to the in-vehicle terminal to establish a connection with the in-vehicle terminal;
  • the mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected. And generating, in real time, an analog pattern output corresponding to the acquired eye image to the projection device and projecting to the rear windshield of the automobile, the simulation pattern including upper and lower eyelids and a cocoon and the upper and lower eyelids following a change of the user's eyelid, the coix seed
  • the mobile terminal receives the steering information sent by the in-vehicle terminal and correspondingly controls the position of the coix seed projected by the projection device in the simulation pattern when the user changes the steering wheel to a certain angle;
  • the rear camera of the mobile terminal is activated to monitor the vehicle in front of the user's car; if the user's car and the vehicle in front are monitored When the distance between the user is less than the first preset threshold, the user is reminded to pay attention to the following distance; if the distance between the user's car and the vehicle in front is less than the second preset threshold, the first brake is sent to the vehicle terminal.
  • the front camera of the mobile terminal is activated to capture the facial expression of the user; if the user's current facial expression and pre-existence The expressions in the fatigue driving expression library are matched, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; if the user reminds the parking stop at the mobile terminal After the vehicle has not stopped and rested, the acceleration changes in the left, right and front directions of the user's vehicle are further detected.
  • the vehicle terminal When the amount of acceleration change in the three directions reaches a preset amount of change, the vehicle terminal is Sending a brake command, notifying the vehicle terminal to step on the brake and turning on the danger alarm flash; and dialing the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user.
  • a second aspect of the embodiments of the present invention provides a system, including:
  • a mobile terminal configured to initiate a connection request to the in-vehicle terminal, and establish a connection with the in-vehicle terminal;
  • the mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected.
  • the upper and lower eyelids follow the user's eyelid changes, the scorpion changes with the user's scorpion; and when the user drives the steering wheel in a certain direction beyond a preset angle, the mobile terminal receives the steering information sent by the vehicle-mounted terminal and correspondingly controls the projection device The position of the projected coix seed in the simulated pattern;
  • the mobile terminal When the user inputs a pre-collision function on command on the mobile terminal, the mobile terminal is configured to activate a rear camera of the mobile terminal to monitor a vehicle in front of the user's car; if the user's car is monitored and the vehicle in front is monitored When the distance is less than the first preset threshold, the user is reminded to pay attention to the following distance; if the distance between the user's car and the preceding vehicle is less than the second preset threshold, then the vehicle is The carrier terminal sends a first brake command to notify the vehicle terminal to step on the brake of the preset depth; if the distance between the user car and the vehicle in front is monitored to be less than a third preset threshold and the third preset threshold is close to the user a minimum braking distance of the vehicle at the current speed, sending a second braking command to the vehicle-mounted terminal to notify the vehicle-mounted terminal to step on the brake; wherein the third preset threshold ⁇ second preset threshold ⁇ first pre- Set a threshold;
  • the vehicle-mounted terminal is configured to receive a first brake command or a second brake command sent by the mobile terminal, and perform a corresponding brake operation;
  • the mobile terminal When the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the mobile terminal is configured to activate a front camera of the mobile terminal to capture a facial expression of the user;
  • the current facial expression matches the expression in the pre-stored fatigue driving expression library, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user;
  • the mobile terminal further reminds the user that the acceleration of the acceleration in the left, right and front directions when the vehicle is traveling is not stopped after the parking break, when the acceleration variation in the three directions reaches the preset variation
  • the vehicle with low configuration and simple function can use the functions of the camera, the sensor and the processor on the mobile terminal to realize the purpose of intelligent driving of the vehicle; by capturing the eyes of the user Part of the image, and through the projection device to project the corresponding analog pattern to the rear windshield of the car, the rear car can more accurately know the intention and state of the front car user, can improve the safety of driving; by detecting the distance from the preceding car and The control of the brake can realize the pre-collision and avoid the occurrence of rear-end collision.
  • the above functions can be realized by the cooperation of the mobile terminal and the vehicle terminal, which can greatly reduce the cost of the automobile, is easy to implement and use, and is beneficial to improving the user experience.
  • FIG. 1 is a schematic flowchart of a prompting method based on a mobile terminal according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram showing the composition of a system according to an embodiment of the present invention.
  • the mobile terminal in the embodiment of the present invention may include a smart phone (such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.), a tablet computer, a palmtop computer, a notebook computer, a mobile Internet device (MID, Mobile Internet Devices), or a wearable device. It has a camera and an accelerometer for taking pictures and video calls, as well as detecting car speed and direction changes.
  • a smart phone such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.
  • a tablet computer such as an iOS mobile phone, a Windows Phone mobile phone, etc.
  • a palmtop computer such as a Samsung Galaxy Tabs, etc.
  • a notebook computer such as a tablet computer, a palmtop computer, a notebook computer, a mobile Internet device (MID, Mobile Internet Devices), or a wearable device.
  • MID Mobile Internet Devices
  • the vehicle-mounted terminal in the embodiment of the present invention may be a central control navigation terminal integrated in the automobile, or may be a terminal external to the automobile, and can control the lighting, the horn, the steering wheel, the brake and the throttle of the automobile.
  • FIG. 1 is a schematic flowchart of a prompting method based on a mobile terminal according to an embodiment of the present invention.
  • the method includes the following steps:
  • the mobile terminal initiates a connection request to the in-vehicle terminal, and establishes a connection with the in-vehicle terminal.
  • the mobile terminal and the vehicle terminal can be connected through a USB cable or through the blue Wireless connection such as teeth, wifi or NFC. After the connection, the two can perform control commands and data transmission.
  • the mobile terminal initiates a connection request to the projection device, and establishes a connection with the projection device.
  • the front camera of the mobile terminal is started; and the user's eye is collected.
  • the simulation pattern including upper and lower eyelids and coix seed and the upper and lower eyelids following the eyelid of the user.
  • the mobile terminal receives the steering information sent by the vehicle-mounted terminal and correspondingly controls the position of the image of the scorpion projected by the projection device in the simulation pattern when the user changes the steering wheel to a certain angle.
  • the communication means between the currently driving cars is very limited, and can only be simply expressed by the lights and the horns. Not only the content expressed is very limited, but also the timeliness is poor, and the occurrence of traffic accidents is often a momentary event.
  • the cars around the problem vehicle were often unpredictable. For example, if the car does not change the turn signal and suddenly changes lanes, can the car predict in advance? Is the front brake in the normal braking or an emergency in front of the front? After the car unconsciously hit the high beam to interfere with the front car, how to inform the car in the front car? Is the front car tired driving? Demands such as these are not reflected in real time by lights and speakers.
  • the user's eye image can be captured by the camera of the mobile terminal and a corresponding analog image can be generated and projected onto the rear windshield of the automobile through the projection device. It is recognized by the driver of the following vehicle and can greatly improve the safety performance of the running vehicle. The reason is: human eye changes can transmit a lot of useful information, combined with the driving scene, when the driver wants to turn and change lanes, the pupil of the eye will subconsciously move in the direction to be turned; when the driver is driving fatigue At the time, the eyelids must be enlarged and reduced intermittently. If it is particularly tired, it will maintain a state of micro-closed; the current side has an unexpected situation, the eyes will suddenly enlarge, and the distance between the eyelids will be significantly widened.
  • the mobile terminal may further receive voice data input by the user, and convert the voice data into text information and send the information to the projection device for text information projection.
  • the eye information can let the following vehicle real-time information about the driver of the car, but the driver of the car should actively remind the car, and the eyes alone still have certain limitations. For example, if the driver's eye-opening light interferes with the driver's driving, the driver of the car can say "Please turn off the high beam, thank you!, let the voice be converted into text and projected to the rear windshield. I know my mistakes and adjust the lights to improve the safety factor of the car.
  • the method before converting the voice data into text information and transmitting the text information to the projection device for text information projection, the method further includes:
  • This step is a further improvement of text projection. Because, if the driver of the car is not good at words, converting the original words into text and projecting it to the rear windshield will easily irritate the car and cause unnecessary consequences. Therefore, the voice input by the driver can be processed correspondingly, the keywords are extracted from the utterances, and then the preset civilized terms are matched and projected. Still use the reminder to turn off the flash as an example.
  • the driver of the car may be irritated by the high beam of the rear car, and the vocabulary containing the high beam and the insulting character is included.
  • the mobile terminal recognizes the keyword "high beam” and calls the civilized language "Please turn off the high beam. Light, thank you! Then send it to the projection device to project out, which can not only accurately remind, but also improve the possibility of the rear driver to close the high beam.
  • the front camera of the mobile terminal is activated to capture a facial expression of the user; if the current facial expression of the user Matching the expression in the pre-stored fatigue driving expression library, the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; if the user reminds the mobile terminal After the parking break is still not stopped, the acceleration changes in the left, right and front directions of the user's car are further detected.
  • the The vehicle terminal sends a brake command to notify the vehicle terminal to step on the brake and turn on the danger alarm flash; and dials the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user.
  • the user's facial expression is captured by the front camera of the mobile terminal, and combined with the preset expression database to determine whether the user is in a fatigue driving state, thereby reminding the user to stop and rest. Therefore, the traffic accident caused by the fatigue driving can be avoided, and the safety of driving is improved.
  • By notifying the third party and controlling the brakes it is possible to ensure that the fatigued user continues to drive and further ensure the safety of driving.
  • the mobile terminal initiates a connection request to the in-vehicle terminal to establish a connection with the in-vehicle terminal.
  • Also includes:
  • the driving data of the user is read according to the determined user identity, and the driving data is stored or uploaded to the cloud server for storage by the mobile terminal;
  • the driving data includes a seat. Adjust data, mirror adjustment data and music type preference data;
  • the read driving data is transmitted to the in-vehicle terminal to cause the in-vehicle terminal to adjust the seat and the rear view mirror, and to load a corresponding type of music.
  • the password comprises a fingerprint password, an iris password, a digital password or a gesture password.
  • the relevant driving parameters can be adaptively adjusted, and the user can save the data after adjusting once for the next direct use, which is very convenient.
  • the vehicle with low configuration and simple function can use the camera, the sensor and the processor on the mobile terminal. Function, to achieve the purpose of intelligent driving of the car; by capturing the user's eye image, and projecting the corresponding analog pattern to the rear windshield of the car through the projection device, the rear car can more accurately know the intent and state of the car user.
  • FIG. 2 is a schematic structural diagram of a system according to an embodiment of the present invention.
  • the system includes: a mobile terminal 100 and an in-vehicle terminal 200.
  • the mobile terminal 100 is configured to initiate a connection request to the in-vehicle terminal, and establish a connection with the in-vehicle terminal;
  • the mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected. And generating, in real time, an analog pattern corresponding to the acquired eye image output to the projection device, the projection device 300 for projecting the simulation pattern to a rear windshield of the automobile, the simulated pattern including upper and lower eyelids and cocoons And the upper and lower eyelids follow the change of the user's eyelids, the scorpion changes with the user's scorpion; and when the user drives the steering wheel to a certain direction, the mobile terminal receives the steering information sent by the vehicle-mounted terminal and controls the projection correspondingly.
  • the mobile terminal 100 When the user inputs a pre-collision function on command on the mobile terminal, the mobile terminal 100 is configured to activate a rear camera of the mobile terminal to monitor a vehicle in front of the user's car; if the user's car and the vehicle in front are monitored When the distance between the user is less than the first preset threshold, the user is reminded to pay attention to the following distance; if the distance between the user's car and the vehicle in front is less than the second preset threshold, the first brake is sent to the vehicle terminal.
  • the vehicle-mounted terminal 200 is configured to receive a first brake command or a second brake sent by the mobile terminal Car command to perform the corresponding brake operation;
  • the mobile terminal 100 When the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the mobile terminal 100 is configured to activate a front camera of the mobile terminal to capture a facial expression of the user;
  • the current facial expression of the user matches the expression in the pre-stored fatigue driving expression library, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user;
  • the mobile terminal further reminds that after the parking break, the vehicle does not stop and rest, and further detects the acceleration change in the left, right and the first three directions when the user's car is traveling, when the acceleration change amount in the three directions reaches the preset change amount And sending a brake command to the vehicle-mounted terminal, informing the vehicle-mounted terminal to brake the brake and turning on the danger alarm flash; and dialing the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user.
  • the mobile terminal 100 is further configured to:
  • the driving data of the user is read according to the determined user identity, and the driving data is stored or uploaded to the cloud server for storage by the mobile terminal;
  • the driving data includes a seat. Adjust data, mirror adjustment data and music type preference data;
  • the vehicle-mounted terminal is further configured to adjust the seat and the rearview mirror according to the driving data sent by the mobile terminal, and load the corresponding type of music.
  • the password comprises a fingerprint password, an iris password, a digital password or a gesture password.
  • the mobile terminal is further configured to receive voice data input by the user, and convert the voice data into text information and send the information to the projection device for text information projection.
  • the mobile terminal before converting the voice data into text information and transmitting the text information to the projection device for text information projection, the mobile terminal is further configured to:
  • the present invention has the following advantages:
  • the vehicle with low configuration and simple function can use the functions of the camera, the sensor and the processor on the mobile terminal to realize the purpose of intelligent driving of the vehicle; by capturing the eyes of the user Part of the image, and through the projection device to project the corresponding analog pattern to the rear windshield of the car, the rear car can more accurately know the intention and state of the front car user, can improve the safety of driving; by detecting the distance from the preceding car and The control of the brake can realize the pre-collision and avoid the occurrence of rear-end collision.
  • the above functions can be realized by the cooperation of the mobile terminal and the vehicle terminal, which can greatly reduce the cost of the automobile, is easy to implement and use, and is beneficial to improving the user experience.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Traffic Control Systems (AREA)
  • Lighting Device Outwards From Vehicle And Optical Signal (AREA)

Abstract

A mobile terminal-based notification method and system, improving the level of intelligence and safety of driving a car. The method comprises: a mobile terminal (100) sending a connection request to an in-vehicle terminal (200), and establishing a connection to the in-vehicle terminal (200) (S101); capturing, by means of the mobile terminal (100), an eye area image of a user, generating a corresponding simulation image, and projecting, by means of a projector device (300), the same on a rear window glass pane, such that a car directly behind can clearly learn an intention and potential action of the user; determining, by the mobile terminal (100), a distance to a car directly ahead, and performing pre-crash processing by means of providing a user notification and brake control; and employing the mobile terminal (100) to detect a facial expression of the user to determine whether the user is driving when fatigued, and performing corresponding control on the car to prevent driver fatigue-caused accidents.

Description

一种基于移动终端的提示方法及系统Method and system for prompting based on mobile terminal 技术领域Technical field

本发明涉及汽车领域,尤其涉及一种基于移动终端的提示方法及系统。The present invention relates to the field of automobiles, and in particular, to a prompting method and system based on a mobile terminal.

背景技术Background technique

随着人们生活水平的不断提高,越来越多的用户和家庭拥有了自己的汽车。人们可以轻松的出行。但是随着道路上行驶的车辆越来越多,随之而来的道路交通事故也呈上升趋势。根据交通部门的资料显示,由于新手驾驶员驾驶经验不足以及疲劳驾驶的原因导致的交通事故十分之多。交通事故给国家造成巨大的经济损失和人员伤亡,已引起人们的强烈关注。As people's living standards continue to improve, more and more users and families have their own cars. People can travel easily. However, as more and more vehicles are driving on the road, the road traffic accidents that follow are also on the rise. According to the information of the transportation department, there are many traffic accidents caused by the lack of driving experience of the novice driver and the cause of fatigue driving. Traffic accidents have caused huge economic losses and casualties to the country, which have aroused people's strong concern.

虽然随着汽车技术的飞速发展,越来越多新的安全技术如预碰撞系统、自动泊车系统等得以应用,但是配置这些新安全技术的车辆价格通常十分昂贵,普通用户无力购买和使用;且现有新技术的智能化程度还远远不够。Although with the rapid development of automotive technology, more and more new safety technologies such as pre-crash systems and automatic parking systems have been applied, but the price of vehicles equipped with these new safety technologies is usually very expensive, and ordinary users cannot afford to buy and use them; And the degree of intelligence of existing new technologies is far from enough.

发明内容Summary of the invention

本发明实施例所要解决的技术问题在于,提供一种基于移动终端的提示方法及系统。以解决现有汽车智能化程度不够的问题。The technical problem to be solved by the embodiments of the present invention is to provide a prompting method and system based on a mobile terminal. To solve the problem of insufficient intelligence of existing cars.

为了解决上述技术问题,本发明实施例第一方面提供了一种基于移动终端的提示方法,包括:In order to solve the above technical problem, a first aspect of the embodiments of the present invention provides a prompting method based on a mobile terminal, including:

移动终端向车载终端发起连接请求,与所述车载终端建立连接;The mobile terminal initiates a connection request to the in-vehicle terminal to establish a connection with the in-vehicle terminal;

移动终端向投影设备发起连接请求,与所述投影设备建立连接;当用户在所述移动终端上输入同步显示功能开启指令时,启动所述移动终端的前置摄像头;采集用户的眼部图像,并实时生成与采集到的眼部图像对应的模拟图案输出至所述投影设备投影至汽车后挡风玻璃,所述模拟图案包括上下眼睑和瞳仁且所述上下眼睑跟随用户眼睑变化,所述瞳仁跟随用户瞳仁变化;且用户向某方向打方向盘超过预设角度时,所述移动终端接收所述车载终端发送的转向信息并对应控制所述投影设备投影的瞳仁在模拟图案中的位置;The mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected. And generating, in real time, an analog pattern output corresponding to the acquired eye image to the projection device and projecting to the rear windshield of the automobile, the simulation pattern including upper and lower eyelids and a cocoon and the upper and lower eyelids following a change of the user's eyelid, the coix seed The mobile terminal receives the steering information sent by the in-vehicle terminal and correspondingly controls the position of the coix seed projected by the projection device in the simulation pattern when the user changes the steering wheel to a certain angle;

当用户在所述移动终端上输入预碰撞功能开启指令时,启动所述移动终端的后置摄像头,监控用户汽车前方的车辆;若监控到用户汽车与前方的车辆之 间的距离小于第一预设阈值时,则提醒用户注意跟车距离;若监控到用户汽车与前方的车辆之间的距离小于第二预设阈值时,则向所述车载终端发送第一刹车指令,通知所述车载终端踩下预设深度的刹车;若监控到用户汽车与前方的车辆之间的距离小于第三预设阈值且所述第三预设阈值接近用户汽车在当前速度下的最小刹车距离,则向所述车载终端发送第二刹车指令,通知所述车载终端踩死刹车;其中,所述第三预设阈值<第二预设阈值<第一预设阈值;When the user inputs a pre-collision function on command on the mobile terminal, the rear camera of the mobile terminal is activated to monitor the vehicle in front of the user's car; if the user's car and the vehicle in front are monitored When the distance between the user is less than the first preset threshold, the user is reminded to pay attention to the following distance; if the distance between the user's car and the vehicle in front is less than the second preset threshold, the first brake is sent to the vehicle terminal. Instructing the vehicle terminal to step on a preset depth of the brake; if the distance between the user's car and the preceding vehicle is monitored to be less than a third predetermined threshold and the third predetermined threshold is close to the user's car at the current speed a second braking command is sent to the vehicle-mounted terminal to notify the vehicle-mounted terminal to step on the brake; wherein the third preset threshold <the second preset threshold <the first preset threshold;

当用户行驶时间超过预设时间或者当用户在所述移动终端上输入防疲劳驾驶功能开启指令时,启动所述移动终端的前置摄像头,捕捉用户的面部表情;若用户当前的面部表情与预存的疲劳驾驶表情库中的表情相匹配,则提醒用户停车休息并向预设终端发起视频请求以便所述预设终端的使用者查看用户当前的面部表情;若用户在所述移动终端提醒停车休息之后仍未停车休息,则进一步检测用户汽车行驶时在左、右和前三个方向上的加速度变化,当所述三个方向上的加速度变化量达到预设变化量时,向所述车载终端发送刹车指令,通知所述车载终端踩死刹车并开启危险报警闪光灯;并向所述预设终端拨号以便所述预设终端的使用者获取用户当前的身体疲劳状况。When the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the front camera of the mobile terminal is activated to capture the facial expression of the user; if the user's current facial expression and pre-existence The expressions in the fatigue driving expression library are matched, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; if the user reminds the parking stop at the mobile terminal After the vehicle has not stopped and rested, the acceleration changes in the left, right and front directions of the user's vehicle are further detected. When the amount of acceleration change in the three directions reaches a preset amount of change, the vehicle terminal is Sending a brake command, notifying the vehicle terminal to step on the brake and turning on the danger alarm flash; and dialing the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user.

本发明实施例第二方面提供了一种系统,包括:A second aspect of the embodiments of the present invention provides a system, including:

移动终端,用于向车载终端发起连接请求,与所述车载终端建立连接;a mobile terminal, configured to initiate a connection request to the in-vehicle terminal, and establish a connection with the in-vehicle terminal;

移动终端向投影设备发起连接请求,与所述投影设备建立连接;当用户在所述移动终端上输入同步显示功能开启指令时,启动所述移动终端的前置摄像头;采集用户的眼部图像,并实时生成与采集到的眼部图像对应的模拟图案输出至所述投影设备,所述投影设备用于将所述模拟图案投影至汽车后挡风玻璃,所述模拟图案包括上下眼睑和瞳仁且所述上下眼睑跟随用户眼睑变化,所述瞳仁跟随用户瞳仁变化;且用户向某方向打方向盘超过预设角度时,所述移动终端接收所述车载终端发送的转向信息并对应控制所述投影设备投影的瞳仁在模拟图案中的位置;The mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected. Generating, in real time, an analog pattern corresponding to the acquired eye image to the projection device, the projection device for projecting the simulation pattern to a rear windshield of the automobile, the simulated pattern including upper and lower eyelids and cocoons The upper and lower eyelids follow the user's eyelid changes, the scorpion changes with the user's scorpion; and when the user drives the steering wheel in a certain direction beyond a preset angle, the mobile terminal receives the steering information sent by the vehicle-mounted terminal and correspondingly controls the projection device The position of the projected coix seed in the simulated pattern;

当用户在所述移动终端上输入预碰撞功能开启指令时,所述移动终端用于启动所述移动终端的后置摄像头,监控用户汽车前方的车辆;若监控到用户汽车与前方的车辆之间的距离小于第一预设阈值时,则提醒用户注意跟车距离;若监控到用户汽车与前方的车辆之间的距离小于第二预设阈值时,则向所述车 载终端发送第一刹车指令,通知所述车载终端踩下预设深度的刹车;若监控到用户汽车与前方的车辆之间的距离小于第三预设阈值且所述第三预设阈值接近用户汽车在当前速度下的最小刹车距离,则向所述车载终端发送第二刹车指令,通知所述车载终端踩死刹车;其中,所述第三预设阈值<第二预设阈值<第一预设阈值;When the user inputs a pre-collision function on command on the mobile terminal, the mobile terminal is configured to activate a rear camera of the mobile terminal to monitor a vehicle in front of the user's car; if the user's car is monitored and the vehicle in front is monitored When the distance is less than the first preset threshold, the user is reminded to pay attention to the following distance; if the distance between the user's car and the preceding vehicle is less than the second preset threshold, then the vehicle is The carrier terminal sends a first brake command to notify the vehicle terminal to step on the brake of the preset depth; if the distance between the user car and the vehicle in front is monitored to be less than a third preset threshold and the third preset threshold is close to the user a minimum braking distance of the vehicle at the current speed, sending a second braking command to the vehicle-mounted terminal to notify the vehicle-mounted terminal to step on the brake; wherein the third preset threshold <second preset threshold <first pre- Set a threshold;

所述车载终端用于接收所述移动终端发送的第一刹车指令或第二刹车指令,进行对应的刹车操作;The vehicle-mounted terminal is configured to receive a first brake command or a second brake command sent by the mobile terminal, and perform a corresponding brake operation;

当用户行驶时间超过预设时间或者当用户在所述移动终端上输入防疲劳驾驶功能开启指令时,所述移动终端用于启动所述移动终端的前置摄像头,捕捉用户的面部表情;若用户当前的面部表情与预存的疲劳驾驶表情库中的表情相匹配,则提醒用户停车休息并向预设终端发起视频请求以便所述预设终端的使用者查看用户当前的面部表情;若用户在所述移动终端提醒停车休息之后仍未停车休息,则进一步检测用户汽车行驶时在左、右和前三个方向上的加速度变化,当所述三个方向上的加速度变化量达到预设变化量时,向所述车载终端发送刹车指令,通知所述车载终端踩死刹车并开启危险报警闪光灯;并向所述预设终端拨号以便所述预设终端的使用者获取用户当前的身体疲劳状况。When the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the mobile terminal is configured to activate a front camera of the mobile terminal to capture a facial expression of the user; The current facial expression matches the expression in the pre-stored fatigue driving expression library, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; The mobile terminal further reminds the user that the acceleration of the acceleration in the left, right and front directions when the vehicle is traveling is not stopped after the parking break, when the acceleration variation in the three directions reaches the preset variation Sending a brake command to the vehicle-mounted terminal, informing the vehicle-mounted terminal to step on the brake and turning on the danger alarm flash; and dialing the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user.

实施本发明实施例,具有如下有益效果:Embodiments of the present invention have the following beneficial effects:

通过将移动终端和车载终端连接构成智能驾驶系统,使得配置较低且功能简单的汽车可以使用移动终端上的摄像头、传感器及处理器的功能,实现汽车驾驶智能化的目的;通过捕捉用户的眼部图像,并通过投影设备投影对应的模拟图案至汽车后挡风玻璃,后车可以更加准确的获知前车用户的意图和状态,可以提高驾驶的安全性;通过检测与前车的距离以及对刹车的控制,可以实现预碰撞,避免追尾事故的发生;通过检测用户表情及汽车加速度变化,可以确定用户是否在疲劳驾驶,进而可以提醒用户停车休息甚至控制停车及发送用户情况给第三方,避免了疲劳驾驶导致的事故发生,大大提高了汽车驾驶的安全性;通过移动终端与车载终端的配合实现上述功能,可以大大降低汽车的成本,易于实现和使用,利于提升用户的使用体验。By connecting the mobile terminal and the vehicle terminal to form an intelligent driving system, the vehicle with low configuration and simple function can use the functions of the camera, the sensor and the processor on the mobile terminal to realize the purpose of intelligent driving of the vehicle; by capturing the eyes of the user Part of the image, and through the projection device to project the corresponding analog pattern to the rear windshield of the car, the rear car can more accurately know the intention and state of the front car user, can improve the safety of driving; by detecting the distance from the preceding car and The control of the brake can realize the pre-collision and avoid the occurrence of rear-end collision. By detecting the user's expression and the acceleration of the car, it can be determined whether the user is driving fatigue, and then can remind the user to stop or even control the parking and send the user to the third party to avoid The accident caused by fatigue driving greatly improves the safety of driving the vehicle; the above functions can be realized by the cooperation of the mobile terminal and the vehicle terminal, which can greatly reduce the cost of the automobile, is easy to implement and use, and is beneficial to improving the user experience.

附图说明 DRAWINGS

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are only some of the present invention. For the embodiments, those skilled in the art can obtain other drawings according to the drawings without any creative work.

图1是本发明实施例一种基于移动终端的提示方法的流程示意图;1 is a schematic flowchart of a prompting method based on a mobile terminal according to an embodiment of the present invention;

图2是本发明实施例一种系统的组成示意图。2 is a schematic diagram showing the composition of a system according to an embodiment of the present invention.

具体实施方式detailed description

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

本发明实施例中的移动终端可以包括智能手机(如Android手机、iOS手机、Windows Phone手机等)、平板电脑、掌上电脑、笔记本电脑、移动互联网设备(MID,Mobile Internet Devices)或穿戴式设备等,其具备摄像头和加速度传感器,可拍摄图片和视频通话,还可以检测汽车行驶速度及方向变化。上述移动终端仅是举例,而非穷举,包含但不限于上述移动终端。The mobile terminal in the embodiment of the present invention may include a smart phone (such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.), a tablet computer, a palmtop computer, a notebook computer, a mobile Internet device (MID, Mobile Internet Devices), or a wearable device. It has a camera and an accelerometer for taking pictures and video calls, as well as detecting car speed and direction changes. The above mobile terminal is only an example, not an exhaustive one, including but not limited to the above mobile terminal.

本发明实施例中的车载终端可以是汽车内部集成的中控导航终端,也可以是与汽车外挂的终端,且可以控制汽车的灯光、喇叭、方向盘、刹车和油门等。The vehicle-mounted terminal in the embodiment of the present invention may be a central control navigation terminal integrated in the automobile, or may be a terminal external to the automobile, and can control the lighting, the horn, the steering wheel, the brake and the throttle of the automobile.

本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”和“第三”等是用于区别不同对象,而非用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second" and "third" and the like in the specification and claims of the present invention and the above drawings are used to distinguish different objects, and are not intended to describe a specific order. Furthermore, the terms "comprises" and "comprising" and "comprising" are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or alternatively Other steps or units inherent to these processes, methods, products or equipment.

请参照图1,为本发明实施例一种基于移动终端的提示方法的流程示意图,在本实施例中,所述方法包括以下步骤:1 is a schematic flowchart of a prompting method based on a mobile terminal according to an embodiment of the present invention. In this embodiment, the method includes the following steps:

S101,移动终端向车载终端发起连接请求,与所述车载终端建立连接。S101. The mobile terminal initiates a connection request to the in-vehicle terminal, and establishes a connection with the in-vehicle terminal.

可选地,移动终端与车载终端之间可以通过USB线连接,也可以通过蓝 牙、wifi或NFC等无线方式连接。连接之后,二者可以进行控制指令和数据传输。Optionally, the mobile terminal and the vehicle terminal can be connected through a USB cable or through the blue Wireless connection such as teeth, wifi or NFC. After the connection, the two can perform control commands and data transmission.

S102,移动终端向投影设备发起连接请求,与所述投影设备建立连接;当用户在所述移动终端上输入同步显示功能开启指令时,启动所述移动终端的前置摄像头;采集用户的眼部图像,并实时生成与采集到的眼部图像对应的模拟图案输出至所述投影设备投影至汽车后挡风玻璃,所述模拟图案包括上下眼睑和瞳仁且所述上下眼睑跟随用户眼睑变化,所述瞳仁跟随用户瞳仁变化;且用户向某方向打方向盘超过预设角度时,所述移动终端接收所述车载终端发送的转向信息并对应控制所述投影设备投影的瞳仁在模拟图案中的位置。S102: The mobile terminal initiates a connection request to the projection device, and establishes a connection with the projection device. When the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is started; and the user's eye is collected. And generating, in real time, an analog pattern output corresponding to the acquired eye image to the projection device and projecting to the rear windshield of the automobile, the simulation pattern including upper and lower eyelids and coix seed and the upper and lower eyelids following the eyelid of the user, The mobile terminal receives the steering information sent by the vehicle-mounted terminal and correspondingly controls the position of the image of the scorpion projected by the projection device in the simulation pattern when the user changes the steering wheel to a certain angle.

具体地,目前行驶的汽车之间的交流手段非常有限,只能通过车灯、喇叭来进行简单的表达,不仅表达的内容非常有限,且时效性差,而交通事故的发生往往是一瞬间的事情,在事故发生之前,问题车辆周边的汽车往往是无法预测的。比如汽车不打转向灯突然变道后车能否提前预知?前车刹车到底是正常刹车还是前车的前方出现紧急情况?后车无意识打远光灯干扰前车,前车如何告知后车?前车是不是疲劳驾驶?诸如此类的需求通过车灯和喇叭是无法实时反映出来的。Specifically, the communication means between the currently driving cars is very limited, and can only be simply expressed by the lights and the horns. Not only the content expressed is very limited, but also the timeliness is poor, and the occurrence of traffic accidents is often a momentary event. Before the accident, the cars around the problem vehicle were often unpredictable. For example, if the car does not change the turn signal and suddenly changes lanes, can the car predict in advance? Is the front brake in the normal braking or an emergency in front of the front? After the car unconsciously hit the high beam to interfere with the front car, how to inform the car in the front car? Is the front car tired driving? Demands such as these are not reflected in real time by lights and speakers.

因此,在本实施例中,可以通过移动终端的摄像头捕捉用户眼部图像并生成对应的模拟图像,经投影设备投影至汽车后挡风玻璃。被后面的车辆的驾驶员所识别,可以大幅提高运行车辆的安全性能。理由在于:人类的眼神变化可以传递很多有用的信息,结合到驾驶场景来看,当驾驶员想转弯、变道的时候,眼睛的瞳孔会下意识先往待转的方向移动;当驾驶员疲劳驾驶的时候,其眼睑一定间歇性放大、缩小,如果特别疲劳,会一种保持微闭的状态;当前方有突发状况,眼睛会突然睁大,眼睑之间的间距明显加宽。这些眼睛的动作都是人类潜意识的反应,因此,驾驶员可能忘记打转向灯,但不会忘记转瞳孔,准确度非常高。而且眼神的变化往往先于动作的变化,可以帮助周围的驾驶员提前做出判断,大幅提高安全系数。另外,眼神的信息往往是瞬间读懂的,所以眼神的信息传递相比文字、图片更高效、更直接。其次,本发明不需要驾驶员分散注意力做任何动作,也确保了驾驶员本身的安全。 Therefore, in the embodiment, the user's eye image can be captured by the camera of the mobile terminal and a corresponding analog image can be generated and projected onto the rear windshield of the automobile through the projection device. It is recognized by the driver of the following vehicle and can greatly improve the safety performance of the running vehicle. The reason is: human eye changes can transmit a lot of useful information, combined with the driving scene, when the driver wants to turn and change lanes, the pupil of the eye will subconsciously move in the direction to be turned; when the driver is driving fatigue At the time, the eyelids must be enlarged and reduced intermittently. If it is particularly tired, it will maintain a state of micro-closed; the current side has an unexpected situation, the eyes will suddenly enlarge, and the distance between the eyelids will be significantly widened. These eye movements are all human subconscious reactions, so the driver may forget to turn the turn signal, but will not forget to turn the pupil, the accuracy is very high. Moreover, the change of the eye often precedes the change of the action, which can help the surrounding drivers to make judgments in advance and greatly improve the safety factor. In addition, the information of the eyes is often read in an instant, so the information transmission of the eyes is more efficient and direct than the words and pictures. Secondly, the present invention does not require the driver to distract attention to perform any action, and also ensures the safety of the driver itself.

可选地,移动终端还可以接收用户输入的语音数据,将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影。Optionally, the mobile terminal may further receive voice data input by the user, and convert the voice data into text information and send the information to the projection device for text information projection.

眼神信息可以让后面的车辆实时了本车驾驶员的信息,但本车驾驶员要主动提醒后车,单靠眼神还是有一定的局限性。比如后车开眼光灯干扰本车驾驶员行驶,本车驾驶员就可以说出“请关闭远光灯,谢谢!”,让将语音转换成文本投影到后挡风玻璃,后车看到后就知道自己的错误,从而调整灯光,提高了本车运行的安全系数。The eye information can let the following vehicle real-time information about the driver of the car, but the driver of the car should actively remind the car, and the eyes alone still have certain limitations. For example, if the driver's eye-opening light interferes with the driver's driving, the driver of the car can say "Please turn off the high beam, thank you!", let the voice be converted into text and projected to the rear windshield. I know my mistakes and adjust the lights to improve the safety factor of the car.

可选地,在将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影之前,还包括:Optionally, before converting the voice data into text information and transmitting the text information to the projection device for text information projection, the method further includes:

提取所述语音数据中的关键词,根据所述关键词调用预设语句发送至所述投影设备进行文本信息投影。Extracting keywords in the voice data, and calling a preset statement according to the keyword to send to the projection device for text information projection.

此步骤为文本投影的进一步改进。因为,如果本车驾驶员言语不善,将其原话转换为文本投射到后挡风玻璃,容易激怒后车,引发不必要的后果。因此,可以对驾驶员输入的语音做相应的处理,从其话语中提取关键词,然后匹配预设的文明用语再投影出去。仍然以提醒关闭闪光灯为例说明。本车的驾驶员有可能被后车的远光灯激怒,说出包含有远光灯及有辱骂性质的词汇,移动终端识别出关键词“远光灯”,调用文明用语“请关闭远光灯,谢谢!”再发送到投影设备投影出去,这样既能起到准确提醒,又能提高后车驾驶员配合关闭远光灯的可能性。This step is a further improvement of text projection. Because, if the driver of the car is not good at words, converting the original words into text and projecting it to the rear windshield will easily irritate the car and cause unnecessary consequences. Therefore, the voice input by the driver can be processed correspondingly, the keywords are extracted from the utterances, and then the preset civilized terms are matched and projected. Still use the reminder to turn off the flash as an example. The driver of the car may be irritated by the high beam of the rear car, and the vocabulary containing the high beam and the insulting character is included. The mobile terminal recognizes the keyword "high beam" and calls the civilized language "Please turn off the high beam. Light, thank you!" Then send it to the projection device to project out, which can not only accurately remind, but also improve the possibility of the rear driver to close the high beam.

S103,当用户在所述移动终端上输入预碰撞功能开启指令时,启动所述移动终端的后置摄像头,监控用户汽车前方的车辆;若监控到用户汽车与前方的车辆之间的距离小于第一预设阈值时,则提醒用户注意跟车距离;若监控到用户汽车与前方的车辆之间的距离小于第二预设阈值时,则向所述车载终端发送第一刹车指令,通知所述车载终端踩下预设深度的刹车;若监控到用户汽车与前方的车辆之间的距离小于第三预设阈值且所述第三预设阈值接近用户汽车在当前速度下的最小刹车距离,则向所述车载终端发送第二刹车指令,通知所述车载终端踩死刹车。S103. When the user inputs a pre-collision function on command on the mobile terminal, start the rear camera of the mobile terminal to monitor the vehicle in front of the user's car; if the distance between the user's car and the vehicle in front is monitored is less than the first When a preset threshold is used, the user is reminded to pay attention to the following distance; if the distance between the user's car and the preceding vehicle is less than the second preset threshold, the first brake command is sent to the vehicle-mounted terminal to notify the The vehicle terminal presses the brake of the preset depth; if it is monitored that the distance between the user's car and the vehicle in front is less than a third preset threshold and the third preset threshold is close to the minimum braking distance of the user's car at the current speed, then Sending a second brake command to the vehicle-mounted terminal to notify the vehicle-mounted terminal to step on the brake.

其中,所述第三预设阈值<第二预设阈值<第一预设阈值。The third preset threshold <the second preset threshold <the first preset threshold.

通过移动终端的摄像头进行测距,并提示用户控制跟车距离,在距离较小 时直接控制刹车,从而可以避免追尾事故,且通过移动终端实现,无需增加汽车成本。Ranging through the camera of the mobile terminal, and prompting the user to control the distance with the car, at a small distance Direct control of the brakes, so as to avoid rear-end collisions, and through the mobile terminal, without increasing the cost of the car.

S104,当用户行驶时间超过预设时间或者当用户在所述移动终端上输入防疲劳驾驶功能开启指令时,启动所述移动终端的前置摄像头,捕捉用户的面部表情;若用户当前的面部表情与预存的疲劳驾驶表情库中的表情相匹配,则提醒用户停车休息并向预设终端发起视频请求以便所述预设终端的使用者查看用户当前的面部表情;若用户在所述移动终端提醒停车休息之后仍未停车休息,则进一步检测用户汽车行驶时在左、右和前三个方向上的加速度变化,当所述三个方向上的加速度变化量达到预设变化量时,向所述车载终端发送刹车指令,通知所述车载终端踩死刹车并开启危险报警闪光灯;并向所述预设终端拨号以便所述预设终端的使用者获取用户当前的身体疲劳状况。S104, when the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the front camera of the mobile terminal is activated to capture a facial expression of the user; if the current facial expression of the user Matching the expression in the pre-stored fatigue driving expression library, the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; if the user reminds the mobile terminal After the parking break is still not stopped, the acceleration changes in the left, right and front directions of the user's car are further detected. When the acceleration change amount in the three directions reaches the preset change amount, the The vehicle terminal sends a brake command to notify the vehicle terminal to step on the brake and turn on the danger alarm flash; and dials the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user.

通过移动终端的前置摄像头捕捉用户面部表情,并结合预设的表情库来判断用户是否处于疲劳驾驶状态,进而提醒用户停车休息。从而可以避免用户因疲劳驾驶引发的交通事故,提升了驾驶的安全性。且通过通知第三方及控制刹车的方式,可以确保疲劳用户继续行驶,进一步确保驾驶的安全性。The user's facial expression is captured by the front camera of the mobile terminal, and combined with the preset expression database to determine whether the user is in a fatigue driving state, thereby reminding the user to stop and rest. Therefore, the traffic accident caused by the fatigue driving can be avoided, and the safety of driving is improved. By notifying the third party and controlling the brakes, it is possible to ensure that the fatigued user continues to drive and further ensure the safety of driving.

可选地,由于一个家庭中可能有多个汽车用户使用一台汽车,或者用户会将汽车借给其他朋友使用,因此,在移动终端向车载终端发起连接请求,与所述车载终端建立连接之后,还包括:Alternatively, since a plurality of car users in a home may use one car, or the user lends the car to other friends, the mobile terminal initiates a connection request to the in-vehicle terminal to establish a connection with the in-vehicle terminal. ,Also includes:

根据用户输入的密码确定用户身份;Determine the user's identity based on the password entered by the user;

若当前用户与上一次使用汽车的用户身份不同,则根据确定的用户身份读取用户的驾驶数据,所述驾驶数据由所述移动终端存储或上传至云端服务器存储;所述驾驶数据包括座椅调节数据、后视镜调节数据和音乐类型喜好数据;If the current user is different from the user identity of the last time the car was used, the driving data of the user is read according to the determined user identity, and the driving data is stored or uploaded to the cloud server for storage by the mobile terminal; the driving data includes a seat. Adjust data, mirror adjustment data and music type preference data;

将读取到的驾驶数据发送给所述车载终端以使所述车载终端调节座椅和后视镜,并加载相应类型的音乐。The read driving data is transmitted to the in-vehicle terminal to cause the in-vehicle terminal to adjust the seat and the rear view mirror, and to load a corresponding type of music.

可选地,所述密码包括指纹密码、虹膜密码、数字密码或手势密码。Optionally, the password comprises a fingerprint password, an iris password, a digital password or a gesture password.

通过用户身份确认,可以自适应调节相关驾驶参数,用户在调整一次之后便可以保存数据以便下次直接使用,十分方便。Through the user identity confirmation, the relevant driving parameters can be adaptively adjusted, and the user can save the data after adjusting once for the next direct use, which is very convenient.

在本实施例中,通过将移动终端和车载终端连接构成智能驾驶系统,使得配置较低且功能简单的汽车可以使用移动终端上的摄像头、传感器及处理器的 功能,实现汽车驾驶智能化的目的;通过捕捉用户的眼部图像,并通过投影设备投影对应的模拟图案至汽车后挡风玻璃,后车可以更加准确的获知前车用户的意图和状态,可以提高驾驶的安全性;通过检测与前车的距离以及对刹车的控制,可以实现预碰撞,避免追尾事故的发生;通过检测用户表情及汽车加速度变化,可以确定用户是否在疲劳驾驶,进而可以提醒用户停车休息甚至控制停车及发送用户情况给第三方,避免了疲劳驾驶导致的事故发生,大大提高了汽车驾驶的安全性;通过移动终端与车载终端的配合实现上述功能,可以大大降低汽车的成本,易于实现和使用,利于提升用户的使用体验。In this embodiment, by connecting the mobile terminal and the vehicle-mounted terminal to form an intelligent driving system, the vehicle with low configuration and simple function can use the camera, the sensor and the processor on the mobile terminal. Function, to achieve the purpose of intelligent driving of the car; by capturing the user's eye image, and projecting the corresponding analog pattern to the rear windshield of the car through the projection device, the rear car can more accurately know the intent and state of the car user. Improve the safety of driving; by detecting the distance from the preceding vehicle and controlling the brakes, pre-crash can be realized to avoid the occurrence of rear-end collisions; by detecting the user's expression and the acceleration of the car, it can be determined whether the user is driving fatigue, and then can be reminded The user stops and even stops the parking and sends the user's situation to the third party, avoiding the accident caused by the fatigue driving, and greatly improving the safety of the driving of the car; by implementing the above functions through the cooperation of the mobile terminal and the vehicle terminal, the cost of the automobile can be greatly reduced. Easy to implement and use, which will help improve the user experience.

请参照图2,为本发明实施例一种系统的组成示意图,在本实施例中,所述系统包括:移动终端100和车载终端200。2 is a schematic structural diagram of a system according to an embodiment of the present invention. In this embodiment, the system includes: a mobile terminal 100 and an in-vehicle terminal 200.

移动终端100,用于向车载终端发起连接请求,与所述车载终端建立连接;The mobile terminal 100 is configured to initiate a connection request to the in-vehicle terminal, and establish a connection with the in-vehicle terminal;

移动终端向投影设备发起连接请求,与所述投影设备建立连接;当用户在所述移动终端上输入同步显示功能开启指令时,启动所述移动终端的前置摄像头;采集用户的眼部图像,并实时生成与采集到的眼部图像对应的模拟图案输出至所述投影设备,所述投影设备300用于将所述模拟图案投影至汽车后挡风玻璃,所述模拟图案包括上下眼睑和瞳仁且所述上下眼睑跟随用户眼睑变化,所述瞳仁跟随用户瞳仁变化;且用户向某方向打方向盘超过预设角度时,所述移动终端接收所述车载终端发送的转向信息并对应控制所述投影设备投影的瞳仁在模拟图案中的位置;The mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected. And generating, in real time, an analog pattern corresponding to the acquired eye image output to the projection device, the projection device 300 for projecting the simulation pattern to a rear windshield of the automobile, the simulated pattern including upper and lower eyelids and cocoons And the upper and lower eyelids follow the change of the user's eyelids, the scorpion changes with the user's scorpion; and when the user drives the steering wheel to a certain direction, the mobile terminal receives the steering information sent by the vehicle-mounted terminal and controls the projection correspondingly. The position of the hazelnut projected by the device in the simulated pattern;

当用户在所述移动终端上输入预碰撞功能开启指令时,所述移动终端100用于启动所述移动终端的后置摄像头,监控用户汽车前方的车辆;若监控到用户汽车与前方的车辆之间的距离小于第一预设阈值时,则提醒用户注意跟车距离;若监控到用户汽车与前方的车辆之间的距离小于第二预设阈值时,则向所述车载终端发送第一刹车指令,通知所述车载终端踩下预设深度的刹车;若监控到用户汽车与前方的车辆之间的距离小于第三预设阈值且所述第三预设阈值接近用户汽车在当前速度下的最小刹车距离,则向所述车载终端发送第二刹车指令,通知所述车载终端踩死刹车;其中,所述第三预设阈值<第二预设阈值<第一预设阈值;When the user inputs a pre-collision function on command on the mobile terminal, the mobile terminal 100 is configured to activate a rear camera of the mobile terminal to monitor a vehicle in front of the user's car; if the user's car and the vehicle in front are monitored When the distance between the user is less than the first preset threshold, the user is reminded to pay attention to the following distance; if the distance between the user's car and the vehicle in front is less than the second preset threshold, the first brake is sent to the vehicle terminal. Instructing the vehicle terminal to step on a preset depth of the brake; if the distance between the user's car and the preceding vehicle is monitored to be less than a third predetermined threshold and the third predetermined threshold is close to the user's car at the current speed a second braking command is sent to the vehicle-mounted terminal to notify the vehicle-mounted terminal to step on the brake; wherein the third preset threshold <the second preset threshold <the first preset threshold;

所述车载终端200用于接收所述移动终端发送的第一刹车指令或第二刹 车指令,进行对应的刹车操作;The vehicle-mounted terminal 200 is configured to receive a first brake command or a second brake sent by the mobile terminal Car command to perform the corresponding brake operation;

当用户行驶时间超过预设时间或者当用户在所述移动终端上输入防疲劳驾驶功能开启指令时,所述移动终端100用于启动所述移动终端的前置摄像头,捕捉用户的面部表情;若用户当前的面部表情与预存的疲劳驾驶表情库中的表情相匹配,则提醒用户停车休息并向预设终端发起视频请求以便所述预设终端的使用者查看用户当前的面部表情;若用户在所述移动终端提醒停车休息之后仍未停车休息,则进一步检测用户汽车行驶时在左、右和前三个方向上的加速度变化,当所述三个方向上的加速度变化量达到预设变化量时,向所述车载终端发送刹车指令,通知所述车载终端踩死刹车并开启危险报警闪光灯;并向所述预设终端拨号以便所述预设终端的使用者获取用户当前的身体疲劳状况。When the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the mobile terminal 100 is configured to activate a front camera of the mobile terminal to capture a facial expression of the user; The current facial expression of the user matches the expression in the pre-stored fatigue driving expression library, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; The mobile terminal further reminds that after the parking break, the vehicle does not stop and rest, and further detects the acceleration change in the left, right and the first three directions when the user's car is traveling, when the acceleration change amount in the three directions reaches the preset change amount And sending a brake command to the vehicle-mounted terminal, informing the vehicle-mounted terminal to brake the brake and turning on the danger alarm flash; and dialing the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user.

可选地,所述移动终端100还用于:Optionally, the mobile terminal 100 is further configured to:

根据用户输入的密码确定用户身份;Determine the user's identity based on the password entered by the user;

若当前用户与上一次使用汽车的用户身份不同,则根据确定的用户身份读取用户的驾驶数据,所述驾驶数据由所述移动终端存储或上传至云端服务器存储;所述驾驶数据包括座椅调节数据、后视镜调节数据和音乐类型喜好数据;If the current user is different from the user identity of the last time the car was used, the driving data of the user is read according to the determined user identity, and the driving data is stored or uploaded to the cloud server for storage by the mobile terminal; the driving data includes a seat. Adjust data, mirror adjustment data and music type preference data;

将读取到的驾驶数据发送给所述车载终端;Transmitting the read driving data to the vehicle-mounted terminal;

所述车载终端还用于根据所述移动终端发送的驾驶数据调节座椅和后视镜,并加载相应类型的音乐。The vehicle-mounted terminal is further configured to adjust the seat and the rearview mirror according to the driving data sent by the mobile terminal, and load the corresponding type of music.

可选地,所述密码包括指纹密码、虹膜密码、数字密码或手势密码。Optionally, the password comprises a fingerprint password, an iris password, a digital password or a gesture password.

可选地,所述移动终端还用于接收用户输入的语音数据,将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影。Optionally, the mobile terminal is further configured to receive voice data input by the user, and convert the voice data into text information and send the information to the projection device for text information projection.

可选地,在将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影之前,所述移动终端还用于:Optionally, before converting the voice data into text information and transmitting the text information to the projection device for text information projection, the mobile terminal is further configured to:

提取所述语音数据中的关键词,根据所述关键词调用预设语句发送至所述投影设备进行文本信息投影。Extracting keywords in the voice data, and calling a preset statement according to the keyword to send to the projection device for text information projection.

需要说明的是,本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其它实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。对于装置实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。 It should be noted that the various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments are mutually referred to. can. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

通过上述实施例的描述,本发明具有以下优点:Through the description of the above embodiments, the present invention has the following advantages:

通过将移动终端和车载终端连接构成智能驾驶系统,使得配置较低且功能简单的汽车可以使用移动终端上的摄像头、传感器及处理器的功能,实现汽车驾驶智能化的目的;通过捕捉用户的眼部图像,并通过投影设备投影对应的模拟图案至汽车后挡风玻璃,后车可以更加准确的获知前车用户的意图和状态,可以提高驾驶的安全性;通过检测与前车的距离以及对刹车的控制,可以实现预碰撞,避免追尾事故的发生;通过检测用户表情及汽车加速度变化,可以确定用户是否在疲劳驾驶,进而可以提醒用户停车休息甚至控制停车及发送用户情况给第三方,避免了疲劳驾驶导致的事故发生,大大提高了汽车驾驶的安全性;通过移动终端与车载终端的配合实现上述功能,可以大大降低汽车的成本,易于实现和使用,利于提升用户的使用体验。By connecting the mobile terminal and the vehicle terminal to form an intelligent driving system, the vehicle with low configuration and simple function can use the functions of the camera, the sensor and the processor on the mobile terminal to realize the purpose of intelligent driving of the vehicle; by capturing the eyes of the user Part of the image, and through the projection device to project the corresponding analog pattern to the rear windshield of the car, the rear car can more accurately know the intention and state of the front car user, can improve the safety of driving; by detecting the distance from the preceding car and The control of the brake can realize the pre-collision and avoid the occurrence of rear-end collision. By detecting the user's expression and the acceleration of the car, it can be determined whether the user is driving fatigue, and then can remind the user to stop or even control the parking and send the user to the third party to avoid The accident caused by fatigue driving greatly improves the safety of driving the vehicle; the above functions can be realized by the cooperation of the mobile terminal and the vehicle terminal, which can greatly reduce the cost of the automobile, is easy to implement and use, and is beneficial to improving the user experience.

本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,简称ROM)或随机存储记忆体(Random Access Memory,简称RAM)等。One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

以上所揭露的仅为本发明较佳实施例而已,当然不能以此来限定本发明之权利范围,因此依本发明权利要求所作的等同变化,仍属本发明所涵盖的范围。 The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and thus equivalent changes made in the claims of the present invention are still within the scope of the present invention.

Claims (10)

一种基于移动终端的提示方法,其特征在于,包括:A prompting method based on a mobile terminal, comprising: 移动终端向车载终端发起连接请求,与所述车载终端建立连接;The mobile terminal initiates a connection request to the in-vehicle terminal to establish a connection with the in-vehicle terminal; 移动终端向投影设备发起连接请求,与所述投影设备建立连接;当用户在所述移动终端上输入同步显示功能开启指令时,启动所述移动终端的前置摄像头;采集用户的眼部图像,并实时生成与采集到的眼部图像对应的模拟图案输出至所述投影设备投影至汽车后挡风玻璃,所述模拟图案包括上下眼睑和瞳仁且所述上下眼睑跟随用户眼睑变化,所述瞳仁跟随用户瞳仁变化;且用户向某方向打方向盘超过预设角度时,所述移动终端接收所述车载终端发送的转向信息并对应控制所述投影设备投影的瞳仁在模拟图案中的位置;The mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected. And generating, in real time, an analog pattern output corresponding to the acquired eye image to the projection device and projecting to the rear windshield of the automobile, the simulation pattern including upper and lower eyelids and a cocoon and the upper and lower eyelids following a change of the user's eyelid, the coix seed The mobile terminal receives the steering information sent by the in-vehicle terminal and correspondingly controls the position of the coix seed projected by the projection device in the simulation pattern when the user changes the steering wheel to a certain angle; 当用户在所述移动终端上输入预碰撞功能开启指令时,启动所述移动终端的后置摄像头,监控用户汽车前方的车辆;若监控到用户汽车与前方的车辆之间的距离小于第一预设阈值时,则提醒用户注意跟车距离;若监控到用户汽车与前方的车辆之间的距离小于第二预设阈值时,则向所述车载终端发送第一刹车指令,通知所述车载终端踩下预设深度的刹车;若监控到用户汽车与前方的车辆之间的距离小于第三预设阈值且所述第三预设阈值接近用户汽车在当前速度下的最小刹车距离,则向所述车载终端发送第二刹车指令,通知所述车载终端踩死刹车;其中,所述第三预设阈值<第二预设阈值<第一预设阈值;When the user inputs a pre-collision function on command on the mobile terminal, the rear camera of the mobile terminal is activated to monitor the vehicle in front of the user's car; if the distance between the user's car and the vehicle in front is monitored is less than the first pre-preview When the threshold is set, the user is reminded to pay attention to the following distance; if the distance between the user's car and the preceding vehicle is less than the second preset threshold, the first braking command is sent to the vehicle-mounted terminal to notify the vehicle-mounted terminal. Depressing a preset depth of brake; if it is monitored that the distance between the user's car and the preceding vehicle is less than a third predetermined threshold and the third predetermined threshold is close to the minimum braking distance of the user's car at the current speed, then The vehicle-mounted terminal sends a second brake command to notify the vehicle-mounted terminal to step on the brake; wherein the third preset threshold <the second preset threshold <the first preset threshold; 当用户行驶时间超过预设时间或者当用户在所述移动终端上输入防疲劳驾驶功能开启指令时,启动所述移动终端的前置摄像头,捕捉用户的面部表情;若用户当前的面部表情与预存的疲劳驾驶表情库中的表情相匹配,则提醒用户停车休息并向预设终端发起视频请求以便所述预设终端的使用者查看用户当前的面部表情;若用户在所述移动终端提醒停车休息之后仍未停车休息,则进一步检测用户汽车行驶时在左、右和前三个方向上的加速度变化,当所述三个方向上的加速度变化量达到预设变化量时,向所述车载终端发送刹车指令,通知所述车载终端踩死刹车并开启危险报警闪光灯;并向所述预设终端拨号以便所述预设终端的使用者获取用户当前的身体疲劳状况。 When the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the front camera of the mobile terminal is activated to capture the facial expression of the user; if the user's current facial expression and pre-existence The expressions in the fatigue driving expression library are matched, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; if the user reminds the parking stop at the mobile terminal After the vehicle has not stopped and rested, the acceleration changes in the left, right and front directions of the user's vehicle are further detected. When the amount of acceleration change in the three directions reaches a preset amount of change, the vehicle terminal is Sending a brake command, notifying the vehicle terminal to step on the brake and turning on the danger alarm flash; and dialing the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user. 如权利要求1所述的方法,其特征在于,在移动终端向车载终端发起连接请求,与所述车载终端建立连接之后,还包括:The method according to claim 1, wherein after the mobile terminal initiates a connection request to the in-vehicle terminal, and after establishing a connection with the in-vehicle terminal, the method further includes: 根据用户输入的密码确定用户身份;Determine the user's identity based on the password entered by the user; 若当前用户与上一次使用汽车的用户身份不同,则根据确定的用户身份读取用户的驾驶数据,所述驾驶数据由所述移动终端存储或上传至云端服务器存储;所述驾驶数据包括座椅调节数据、后视镜调节数据和音乐类型喜好数据;If the current user is different from the user identity of the last time the car was used, the driving data of the user is read according to the determined user identity, and the driving data is stored or uploaded to the cloud server for storage by the mobile terminal; the driving data includes a seat. Adjust data, mirror adjustment data and music type preference data; 将读取到的驾驶数据发送给所述车载终端以使所述车载终端调节座椅和后视镜,并加载相应类型的音乐。The read driving data is transmitted to the in-vehicle terminal to cause the in-vehicle terminal to adjust the seat and the rear view mirror, and to load a corresponding type of music. 如权利要求2所述的方法,其特征在于,The method of claim 2 wherein 所述密码包括指纹密码、虹膜密码、数字密码或手势密码。The password includes a fingerprint password, an iris password, a numeric password, or a gesture password. 如权利要求1所述的方法,其特征在于,还包括:The method of claim 1 further comprising: 移动终端接收用户输入的语音数据,将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影。The mobile terminal receives the voice data input by the user, converts the voice data into text information, and transmits the voice data to the projection device for text information projection. 如权利要求4所述的方法,其特征在于,在将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影之前,还包括:The method of claim 4, further comprising: before converting the voice data into text information and transmitting the text information to the projection device for text information projection, further comprising: 提取所述语音数据中的关键词,根据所述关键词调用预设语句发送至所述投影设备进行文本信息投影。Extracting keywords in the voice data, and calling a preset statement according to the keyword to send to the projection device for text information projection. 一种系统,其特征在于,包括:A system, comprising: 移动终端,用于向车载终端发起连接请求,与所述车载终端建立连接;a mobile terminal, configured to initiate a connection request to the in-vehicle terminal, and establish a connection with the in-vehicle terminal; 移动终端向投影设备发起连接请求,与所述投影设备建立连接;当用户在所述移动终端上输入同步显示功能开启指令时,启动所述移动终端的前置摄像头;采集用户的眼部图像,并实时生成与采集到的眼部图像对应的模拟图案输出至所述投影设备,所述投影设备用于将所述模拟图案投影至汽车后挡风玻璃,所述模拟图案包括上下眼睑和瞳仁且所述上下眼睑跟随用户眼睑变化,所述瞳仁跟随用户瞳仁变化;且用户向某方向打方向盘超过预设角度时,所述移动终 端接收所述车载终端发送的转向信息并对应控制所述投影设备投影的瞳仁在模拟图案中的位置;The mobile terminal initiates a connection request to the projection device to establish a connection with the projection device; when the user inputs a synchronization display function on command on the mobile terminal, the front camera of the mobile terminal is activated; and the eye image of the user is collected. Generating, in real time, an analog pattern corresponding to the acquired eye image to the projection device, the projection device for projecting the simulation pattern to a rear windshield of the automobile, the simulated pattern including upper and lower eyelids and cocoons The upper and lower eyelids follow a change of the user's eyelids, the scorpion changes with the user's scorpion; and when the user hits the steering wheel in a certain direction beyond a preset angle, the mobile end Receiving, by the end, the steering information sent by the vehicle-mounted terminal and correspondingly controlling the position of the coix seed projected by the projection device in the simulation pattern; 当用户在所述移动终端上输入预碰撞功能开启指令时,所述移动终端用于启动所述移动终端的后置摄像头,监控用户汽车前方的车辆;若监控到用户汽车与前方的车辆之间的距离小于第一预设阈值时,则提醒用户注意跟车距离;若监控到用户汽车与前方的车辆之间的距离小于第二预设阈值时,则向所述车载终端发送第一刹车指令,通知所述车载终端踩下预设深度的刹车;若监控到用户汽车与前方的车辆之间的距离小于第三预设阈值且所述第三预设阈值接近用户汽车在当前速度下的最小刹车距离,则向所述车载终端发送第二刹车指令,通知所述车载终端踩死刹车;其中,所述第三预设阈值<第二预设阈值<第一预设阈值;When the user inputs a pre-collision function on command on the mobile terminal, the mobile terminal is configured to activate a rear camera of the mobile terminal to monitor a vehicle in front of the user's car; if the user's car is monitored and the vehicle in front is monitored When the distance is less than the first preset threshold, the user is reminded to pay attention to the following distance; if the distance between the user's car and the preceding vehicle is less than the second preset threshold, the first brake command is sent to the vehicle terminal. Notifying the vehicle-mounted terminal to step on the brake of the preset depth; if the distance between the user's car and the vehicle in front is monitored to be less than a third preset threshold and the third preset threshold is close to the minimum of the user's car at the current speed a second brake command is sent to the vehicle-mounted terminal to notify the vehicle-mounted terminal to brake the brake; wherein the third preset threshold <the second preset threshold <the first preset threshold; 所述车载终端用于接收所述移动终端发送的第一刹车指令或第二刹车指令,进行对应的刹车操作;The vehicle-mounted terminal is configured to receive a first brake command or a second brake command sent by the mobile terminal, and perform a corresponding brake operation; 当用户行驶时间超过预设时间或者当用户在所述移动终端上输入防疲劳驾驶功能开启指令时,所述移动终端用于启动所述移动终端的前置摄像头,捕捉用户的面部表情;若用户当前的面部表情与预存的疲劳驾驶表情库中的表情相匹配,则提醒用户停车休息并向预设终端发起视频请求以便所述预设终端的使用者查看用户当前的面部表情;若用户在所述移动终端提醒停车休息之后仍未停车休息,则进一步检测用户汽车行驶时在左、右和前三个方向上的加速度变化,当所述三个方向上的加速度变化量达到预设变化量时,向所述车载终端发送刹车指令,通知所述车载终端踩死刹车并开启危险报警闪光灯;并向所述预设终端拨号以便所述预设终端的使用者获取用户当前的身体疲劳状况。When the user travels for more than a preset time or when the user inputs an anti-fatigue driving function on command on the mobile terminal, the mobile terminal is configured to activate a front camera of the mobile terminal to capture a facial expression of the user; The current facial expression matches the expression in the pre-stored fatigue driving expression library, and the user is reminded to stop the parking and initiate a video request to the preset terminal so that the user of the preset terminal can view the current facial expression of the user; The mobile terminal further reminds the user that the acceleration of the acceleration in the left, right and front directions when the vehicle is traveling is not stopped after the parking break, when the acceleration variation in the three directions reaches the preset variation Sending a brake command to the vehicle-mounted terminal, informing the vehicle-mounted terminal to step on the brake and turning on the danger alarm flash; and dialing the preset terminal so that the user of the preset terminal acquires the current physical fatigue condition of the user. 如权利要求6所述的系统,其特征在于,所述移动终端还用于:The system of claim 6 wherein said mobile terminal is further configured to: 根据用户输入的密码确定用户身份;Determine the user's identity based on the password entered by the user; 若当前用户与上一次使用汽车的用户身份不同,则根据确定的用户身份读取用户的驾驶数据,所述驾驶数据由所述移动终端存储或上传至云端服务器存储;所述驾驶数据包括座椅调节数据、后视镜调节数据和音乐类型喜好数据;If the current user is different from the user identity of the last time the car was used, the driving data of the user is read according to the determined user identity, and the driving data is stored or uploaded to the cloud server for storage by the mobile terminal; the driving data includes a seat. Adjust data, mirror adjustment data and music type preference data; 将读取到的驾驶数据发送给所述车载终端; Transmitting the read driving data to the vehicle-mounted terminal; 所述车载终端还用于根据所述移动终端发送的驾驶数据调节座椅和后视镜,并加载相应类型的音乐。The vehicle-mounted terminal is further configured to adjust the seat and the rearview mirror according to the driving data sent by the mobile terminal, and load the corresponding type of music. 如权利要求7所述的系统,其特征在于,The system of claim 7 wherein: 所述密码包括指纹密码、虹膜密码、数字密码或手势密码。The password includes a fingerprint password, an iris password, a numeric password, or a gesture password. 如权利要求6所述的系统,其特征在于,The system of claim 6 wherein: 所述移动终端还用于接收用户输入的语音数据,将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影。The mobile terminal is further configured to receive voice data input by the user, and convert the voice data into text information and send the information to the projection device for text information projection. 如权利要求9所述的系统,其特征在于,The system of claim 9 wherein: 在将所述语音数据转换为文本信息发送至所述投影设备进行文本信息投影之前,所述移动终端还用于:Before converting the voice data into text information and transmitting the text information to the projection device for text information projection, the mobile terminal is further configured to: 提取所述语音数据中的关键词,根据所述关键词调用预设语句发送至所述投影设备进行文本信息投影。 Extracting keywords in the voice data, and calling a preset statement according to the keyword to send to the projection device for text information projection.
PCT/CN2016/100232 2016-09-27 2016-09-27 Mobile terminal-based notification method and system Ceased WO2018058266A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/100232 WO2018058266A1 (en) 2016-09-27 2016-09-27 Mobile terminal-based notification method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/100232 WO2018058266A1 (en) 2016-09-27 2016-09-27 Mobile terminal-based notification method and system

Publications (1)

Publication Number Publication Date
WO2018058266A1 true WO2018058266A1 (en) 2018-04-05

Family

ID=61762297

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/100232 Ceased WO2018058266A1 (en) 2016-09-27 2016-09-27 Mobile terminal-based notification method and system

Country Status (1)

Country Link
WO (1) WO2018058266A1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110667468A (en) * 2018-07-03 2020-01-10 奥迪股份公司 Driving assistance system and driving assistance method
CN110766912A (en) * 2018-07-27 2020-02-07 长沙智能驾驶研究院有限公司 Driving early warning method, device and computer readable storage medium
CN111429898A (en) * 2018-12-21 2020-07-17 上海博泰悦臻网络技术服务有限公司 Intelligent terminal control method and system based on vehicle-mounted camera and vehicle-mounted camera
CN112339655A (en) * 2019-08-08 2021-02-09 常州星宇车灯股份有限公司 Adaptive control system and method for vehicle tail lamp and vehicle
CN113055526A (en) * 2021-02-08 2021-06-29 南京富士通南大软件技术有限公司 Self-adaptive mobile phone non-inductive interconnection method based on automobile driving state
CN113360703A (en) * 2021-06-03 2021-09-07 安徽大学 Communication method, device, computer and storage medium for lovers in different places
CN113460065A (en) * 2021-06-21 2021-10-01 上汽通用五菱汽车股份有限公司 Vehicle control method, vehicle, and computer-readable storage medium
CN114074679A (en) * 2020-08-18 2022-02-22 诺博汽车科技有限公司 Vehicle A-pillar blind area monitoring system and monitoring method
CN114694450A (en) * 2020-12-25 2022-07-01 博泰车联网科技(上海)股份有限公司 Teaching method for automobile
CN114756160A (en) * 2022-04-02 2022-07-15 浙江吉利控股集团有限公司 Vehicle-mounted video and audio content pushing method, device, storage medium and device
CN115320540A (en) * 2022-08-04 2022-11-11 重庆长安汽车股份有限公司 Vehicle control method, device, system, electronic device, storage medium and vehicle
CN115723524A (en) * 2022-11-24 2023-03-03 重庆长安汽车股份有限公司 Control method and system for releasing multifunctional fragrance for automobile, electronic equipment and storage medium
CN115883605A (en) * 2022-11-30 2023-03-31 成都赛力斯科技有限公司 Visitor-based vehicle-mounted function control method and device
CN116456551B (en) * 2023-06-16 2023-09-08 亿美汽车光电科技(长春)有限公司 Intelligent control system for automobile atmosphere lamp

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060132319A1 (en) * 2004-12-08 2006-06-22 Denso Corporation Driver fatigue assessment device and method
JP2009219555A (en) * 2008-03-13 2009-10-01 Toyota Motor Corp Drowsiness detector, driving support apparatus, drowsiness detecting method
CN104537888A (en) * 2014-12-25 2015-04-22 东风汽车公司 Automobile collision alarming method based on mobile phone
CN104574817A (en) * 2014-12-25 2015-04-29 清华大学苏州汽车研究院(吴江) Machine vision-based fatigue driving pre-warning system suitable for smart phone
CN105034979A (en) * 2015-04-30 2015-11-11 南京理工大学 Vehicle active safety control method and vehicle active safety control system
CN105034804A (en) * 2015-05-11 2015-11-11 南京理工大学 Vehicle active safety control method and vehicle active safety control system
CN105096528A (en) * 2015-08-05 2015-11-25 广州云从信息科技有限公司 Fatigue driving detection method and system
CN105691290A (en) * 2016-03-22 2016-06-22 深圳市十方联智科技有限公司 Intelligent car reminding method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060132319A1 (en) * 2004-12-08 2006-06-22 Denso Corporation Driver fatigue assessment device and method
JP2009219555A (en) * 2008-03-13 2009-10-01 Toyota Motor Corp Drowsiness detector, driving support apparatus, drowsiness detecting method
CN104537888A (en) * 2014-12-25 2015-04-22 东风汽车公司 Automobile collision alarming method based on mobile phone
CN104574817A (en) * 2014-12-25 2015-04-29 清华大学苏州汽车研究院(吴江) Machine vision-based fatigue driving pre-warning system suitable for smart phone
CN105034979A (en) * 2015-04-30 2015-11-11 南京理工大学 Vehicle active safety control method and vehicle active safety control system
CN105034804A (en) * 2015-05-11 2015-11-11 南京理工大学 Vehicle active safety control method and vehicle active safety control system
CN105096528A (en) * 2015-08-05 2015-11-25 广州云从信息科技有限公司 Fatigue driving detection method and system
CN105691290A (en) * 2016-03-22 2016-06-22 深圳市十方联智科技有限公司 Intelligent car reminding method and system

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110667468A (en) * 2018-07-03 2020-01-10 奥迪股份公司 Driving assistance system and driving assistance method
CN110766912A (en) * 2018-07-27 2020-02-07 长沙智能驾驶研究院有限公司 Driving early warning method, device and computer readable storage medium
CN110766912B (en) * 2018-07-27 2022-03-18 长沙智能驾驶研究院有限公司 Driving early warning method, device and computer readable storage medium
CN111429898A (en) * 2018-12-21 2020-07-17 上海博泰悦臻网络技术服务有限公司 Intelligent terminal control method and system based on vehicle-mounted camera and vehicle-mounted camera
CN112339655A (en) * 2019-08-08 2021-02-09 常州星宇车灯股份有限公司 Adaptive control system and method for vehicle tail lamp and vehicle
CN112339655B (en) * 2019-08-08 2024-04-19 常州星宇车灯股份有限公司 Self-adaptive control system and method for vehicle tail lamp and vehicle
CN114074679B (en) * 2020-08-18 2024-05-28 诺博汽车科技有限公司 Vehicle A-pillar blind spot monitoring system and monitoring method
CN114074679A (en) * 2020-08-18 2022-02-22 诺博汽车科技有限公司 Vehicle A-pillar blind area monitoring system and monitoring method
CN114694450A (en) * 2020-12-25 2022-07-01 博泰车联网科技(上海)股份有限公司 Teaching method for automobile
CN113055526A (en) * 2021-02-08 2021-06-29 南京富士通南大软件技术有限公司 Self-adaptive mobile phone non-inductive interconnection method based on automobile driving state
CN113360703B (en) * 2021-06-03 2022-09-23 安徽大学 Communication method, device, computer and storage medium for long-distance love couples
CN113360703A (en) * 2021-06-03 2021-09-07 安徽大学 Communication method, device, computer and storage medium for lovers in different places
CN113460065A (en) * 2021-06-21 2021-10-01 上汽通用五菱汽车股份有限公司 Vehicle control method, vehicle, and computer-readable storage medium
CN114756160A (en) * 2022-04-02 2022-07-15 浙江吉利控股集团有限公司 Vehicle-mounted video and audio content pushing method, device, storage medium and device
CN115320540A (en) * 2022-08-04 2022-11-11 重庆长安汽车股份有限公司 Vehicle control method, device, system, electronic device, storage medium and vehicle
CN115320540B (en) * 2022-08-04 2024-03-08 重庆长安汽车股份有限公司 Vehicle control method, device, system, electronic equipment and storage medium
CN115723524A (en) * 2022-11-24 2023-03-03 重庆长安汽车股份有限公司 Control method and system for releasing multifunctional fragrance for automobile, electronic equipment and storage medium
CN115883605A (en) * 2022-11-30 2023-03-31 成都赛力斯科技有限公司 Visitor-based vehicle-mounted function control method and device
CN116456551B (en) * 2023-06-16 2023-09-08 亿美汽车光电科技(长春)有限公司 Intelligent control system for automobile atmosphere lamp

Similar Documents

Publication Publication Date Title
WO2018058266A1 (en) Mobile terminal-based notification method and system
US12080284B2 (en) Two-way in-vehicle virtual personal assistant
US10699569B2 (en) Information processing apparatus, information processing method, and program
US10908677B2 (en) Vehicle system for providing driver feedback in response to an occupant&#39;s emotion
KR101895485B1 (en) Drive assistance appratus and method for controlling the same
JP7329755B2 (en) Support method and support system and support device using the same
WO2018058275A1 (en) Smart driving method and system employing mobile terminal
US10666901B1 (en) System for soothing an occupant in a vehicle
US10101737B2 (en) Remote operation system, vehicle, and remote operation apparatus
US20170162197A1 (en) System and method of conversational adjustment based on user&#39;s cognitive state and/or situational state
JP2021163345A (en) Driving support device and data collection system
CN112041201B (en) Method, system, and medium for controlling access to vehicle features
US10674003B1 (en) Apparatus and system for identifying occupants in a vehicle
WO2018058273A1 (en) Anti-theft method and system
WO2018058274A1 (en) Mobile terminal-based driver-assistance method and system
WO2018058267A1 (en) Car adjustment method and system
CN103481817B (en) Automotive steering reminding device and method
CN205540265U (en) Car long -distance video moves car system
WO2018058265A1 (en) Car control method and system
US20240367667A1 (en) Notification system, vehicle control device, and notification method
CN116022158B (en) Driving safety control method and device for cooperation of multi-domain controller
WO2018058263A1 (en) Driving method and system
JP7784229B2 (en) Information processing device and information processing method
CN115635978A (en) Vehicle human-computer interaction method and device and vehicle
US12512099B2 (en) Two-way in-vehicle virtual personal assistant

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16917026

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20.08.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16917026

Country of ref document: EP

Kind code of ref document: A1