[go: up one dir, main page]

WO2019051725A1 - Call reminding method and call reminding system for intelligent terminal - Google Patents

Call reminding method and call reminding system for intelligent terminal Download PDF

Info

Publication number
WO2019051725A1
WO2019051725A1 PCT/CN2017/101758 CN2017101758W WO2019051725A1 WO 2019051725 A1 WO2019051725 A1 WO 2019051725A1 CN 2017101758 W CN2017101758 W CN 2017101758W WO 2019051725 A1 WO2019051725 A1 WO 2019051725A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart terminal
face
distance
alarm
target image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/101758
Other languages
French (fr)
Chinese (zh)
Inventor
冯德敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Transsion Communication Co Ltd
Original Assignee
Shenzhen Transsion Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Transsion Communication Co Ltd filed Critical Shenzhen Transsion Communication Co Ltd
Priority to PCT/CN2017/101758 priority Critical patent/WO2019051725A1/en
Publication of WO2019051725A1 publication Critical patent/WO2019051725A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M19/00Current supply arrangements for telephone systems
    • H04M19/02Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone or busy tone
    • H04M19/04Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone or busy tone the ringing-current being generated at the substations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers

Definitions

  • the present invention relates to the field of control of intelligent terminals, and in particular, to a call reminding method and a call reminding system for an intelligent terminal.
  • intelligent terminals With the development and advancement of technology, the development of intelligent terminals is also changing with each passing day. Intelligent terminals Currently, intelligent terminals have gradually penetrated into all aspects of people's lives because of their convenience and functionality, and have become an indispensable auxiliary equipment in people's lives. At the same time, with the diversification of the functionality of smart terminals, the convenience of the functions of smart terminals has become one of the user's choice factors.
  • the present invention provides a method for calling a reminder of a smart terminal and a call reminding system.
  • the invention utilizes a distance measuring module and a current monitoring module in the smart terminal to timely send a call reminder to the user by monitoring the distance between the face and the smart terminal and the current change in the earpiece of the smart terminal, so that the user can answer the call of the other party in time. content.
  • an aspect of the present invention provides a method for calling a reminder of an intelligent terminal, comprising the steps of: capturing an operation instruction, starting a call reminding system; and sensing a distance between the smart terminal and a face; When the distance between the smart terminal and the face is greater than a preset distance, monitoring the current intensity in the earpiece of the smart terminal; when the current intensity of the earpiece is greater than a preset current intensity, generating an alarm command, according to The alarm instruction controls the smart terminal to send an alarm signal.
  • the step of sensing the distance between the smart terminal and the human face comprises: capturing a target image including a scene of the front end of the smart terminal screen, tracking the face information in the target image, and measuring a distance between the smart terminal and a face, wherein the distance is set when there is no face information in the target image From infinity.
  • the step of tracking the face information in the target image comprises: identifying a facial contour shape, a facial facial feature, a facial skin color, a facial skin texture in the target image, When there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face.
  • the method further includes: when the smart terminal senses that the distance between the smart terminal and the human body is less than or equal to the preset distance, generating a stop alarm instruction, according to the stop alarm instruction, The intelligent terminal stops transmitting the alarm signal.
  • the alarm signal includes a sound signal, a flash signal or a vibration signal.
  • Another aspect of the present invention provides a reminder system for an intelligent terminal, which includes the following module, the startup module captures an operation instruction, activates a call reminding system according to the operation instruction, and the ranging module senses the smart terminal. a distance between the face and the face; the current monitoring module monitors the current intensity in the earpiece of the smart terminal, and when the current intensity of the earpiece is greater than a predetermined current intensity, generates an alarm command, and the alarm module according to the alarm And instructing the smart terminal to send an alarm signal.
  • the ranging module comprises: an image capturing unit, capturing a target image including a scene facing the screen of the smart terminal, a face tracking unit, tracking face information in the target image, and measuring The distance unit measures a distance between the smart terminal and a human face, wherein when the face image has no face information, the distance is set to infinity.
  • the face tracking unit includes a face recognition unit that recognizes a face facial contour shape, a facial facial feature position, a face skin color, and a face skin texture in the target image, wherein When there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face.
  • the system further includes: an instruction module, when the smart terminal senses that the distance between the smart terminal and the human body is less than or equal to the preset distance, generating a stop alarm instruction; and an alarm control module And, according to the stop alarm instruction, the smart terminal stops sending the alarm signal.
  • the alarm module includes an audio unit that plays an audio signal according to the alarm instruction; a light unit that emits a flash signal according to the alarm instruction; or a vibration unit that issues according to the alarm instruction Vibration signal.
  • the present invention utilizes tracking face information to know that the user is in a state of not receiving a call
  • the invention utilizes monitoring the current in the earpiece of the intelligent terminal to know that the other party of the call is inputting voice;
  • the present invention provides a convenient call reminding method and system, which saves time for users to wait for a call and has good Market application value.
  • FIG. 1 is a schematic flow chart of a call reminding method of a smart terminal according to a preferred embodiment of the present invention
  • FIG. 2 is a schematic flow chart of the distance between the sensing intelligent terminal and the face in FIG. 1;
  • FIG. 3 is a schematic flow chart of another method for calling a reminder of a smart terminal according to a preferred embodiment of the present invention.
  • FIG. 4 is a structural diagram of a call reminding system of a smart terminal in accordance with a preferred embodiment of the present invention.
  • Figure 5 is a structural view of the ranging module of Figure 4.
  • FIG. 6 is a structural diagram of a call reminding system of a smart terminal according to another preferred embodiment of the present invention.
  • first, second, third, etc. may be employed in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
  • the first intelligent terminal may also be referred to as a second smart terminal without departing from the scope of the present disclosure.
  • the second smart terminal may also be referred to as a first smart terminal.
  • an aspect of the present invention provides a call reminding method for an intelligent terminal, which can monitor a voice situation when a party interrupts a call, and provide an alarm reminder to the user when the other party resumes the call, which brings the user a pole.
  • FIG. 1 is a schematic flowchart of a call reminding method of a smart terminal according to a preferred embodiment of the present invention. It can be seen from the figure that the call reminding method of the smart terminal provided by this embodiment mainly includes the following steps:
  • the startup module of the smart terminal may capture the operation instruction input by the user to the smart terminal, and after parsing the operation instruction, start the call reminding system of the smart terminal according to the operation instruction.
  • the ranging module of the call reminding system monitors the distance between the smart terminal and the face, and obtains a specific between the smart terminal and the face.
  • the distance data is compared with a pre-stored pre-stored distance in the smart terminal, and a corresponding operation instruction is sent out according to the comparison result.
  • FIG. 2 it is a schematic flowchart of the distance between the sensing intelligent terminal and the human face in FIG.
  • the distance between the sensing intelligent terminal and the face can be as follows:
  • a target image that can be included that is, includes a scene to which the smart terminal screen faces.
  • the face tracking unit in the smart terminal may search in the target image to scan face information in the target image.
  • the final search object is set as a face information and the error range allowed by the search result is set by the face tracking unit by pre-compilation, so that when the face tracking unit is in the When the error in the target image and the preset face information is within a preset error range, it is considered that the corresponding face information is searched.
  • the step of tracking the face information in the target image comprises:
  • the face tracking unit includes a face recognition unit, which can specifically identify the facial features including the facial features, the facial features, the facial skin color, and the person in the target image.
  • a face information such as a face skin texture, but in the embodiment, when the face recognition unit searches for the presence of at least a face skin color and a face skin texture in the target image, determining the target image Contains human faces.
  • the specific searching step of the face recognition unit includes: 1) first establishing a person Face information file. That is, the camera unit collects a certain number of face images of the user's face in advance or forms an image file using the existing photos of the user, and uses the statistical principle to generate a faceprint code of the face; 2) acquire one Virtual face coding, that is, when the camera unit captures a target image, the scene in the current target image is processed in the same coding form to generate a virtual face code; 3) the virtual face code and file inventory are generated The face code is compared, and when there is a portion of the virtual face code that has a deviation from the pre-stored face code within a predetermined range, then a face is considered to exist in the target image. In this embodiment, when there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face.
  • the distance measuring module in the smart terminal further measures the distance between the smart terminal and the face.
  • the ranging module includes a ranging unit, and the ranging unit includes a distance sensor, and the method for measuring time is used to acquire between the smart terminal and the human face.
  • the distance sensor may emit an infrared ray that is irradiated onto a human face, and the skin of the human face generates a heat dissipation effect on the infrared ray, and the distance sensor further receives the emitted infrared ray reflected by the human skin.
  • the distance sensor calculates the distance between the face and the smart terminal by the time difference between the infrared ray and the reflected infrared ray.
  • the ranging module After the ranging module obtains the distance between the smart terminal and the human face, it compares with a preset distance, when the distance between the smart terminal and the human face is greater than the preset distance, The ranging module further generates a monitoring command and sends it out.
  • the face tracking unit does not search for the face information in the target image, and the distance between the face and the smart terminal is considered to be infinite, and thus, At this time, the ranging module will also generate a monitoring command.
  • the current monitoring module in the smart terminal receives the one sent by the ranging module. Monitoring instructions, thereby monitoring the intensity of the current in the earpiece of the smart terminal.
  • the principle of the above design is that there are many types of mobile phone handsets, that is, mobile phone speakers, but the basic working principle is similar, and both are components for converting electrical signals into sound signals for playback.
  • the electric speaker which consists of a diaphragm, a voice coil, a permanent magnet, a bracket, and the like.
  • the working principle of the speaker is that when the voice coil of the speaker is connected to the audio current, the voice coil generates an alternating magnetic field under the action of current, and the permanent magnet also Produces a constant magnetic field of constant size and direction.
  • the interaction of the two magnetic fields causes the voice coil to move in the direction of the current in the vertical chirp, connected by the voice coil and the diaphragm.
  • the vibrating membrane is driven to generate vibration, and the vibrating membrane vibrates to cause vibration of the air to emit sound.
  • the current input to the voice coil is larger, the force of the magnetic field is greater, the amplitude of the vibration of the diaphragm is greater, and the sound is more ambiguous.
  • the mobile phone microphone is used to convert the sound signal into an electrical signal for processing and storage, that is, the sound reproduction process with the mobile phone is reversed.
  • the current monitoring module can monitor the current change in the earpiece of the smart terminal. To determine if the other party is inputting audio (speech) to their smart terminal.
  • the current monitoring module detects that a current intensity greater than a predetermined current intensity is generated in the earpiece of the smart terminal, an alarm command is generated and sent out.
  • an intelligent module is further provided with an alarm module, and the alarm module can receive an alarm command sent by the current monitoring module, analyze and control the corresponding alarm unit according to the alarm instruction. Send the corresponding alarm information.
  • the alarm module specifically includes an audio unit, a light unit, and/or a vibration unit. It can receive an appropriate alarm command and emit an audio signal, a flash signal, and/or a vibration signal.
  • the user can preset one or more kinds of signal combination alarm signals and their specific alarm signal contents according to their own needs or preferences, such as the type of audio and the frequency of the flash. And / or the form of vibration, etc.
  • FIG. 3 it is a schematic flowchart of another method for calling reminding of a smart terminal according to a preferred embodiment of the present invention. It can be seen from the figure that the call reminding method provided in this embodiment further includes a method step of ending the call reminding, which specifically includes:
  • the smart terminal may stop the call reminding function after the user continues to answer the call. Specifically, when the user moves the smart terminal to be close to the face thereof, the ranging module of the smart terminal continues to monitor the distance from the smart terminal to the human face, and when the ranging module detects the smart terminal and the human body When the distance is less than or equal to the preset distance, an operation instruction is sent out, and an instruction module of the intelligent terminal receives and generates a stop alarm instruction according to the operation instruction, and sends the instruction to the outside.
  • the alarm control module in the smart terminal can receive the stop alarm command, and control the alarm module in the smart terminal to stop sending the alarm signal, such as stopping playing music, stopping flashing lights, stopping vibrating intelligent terminals, etc. .
  • the present invention provides a method for calling a reminder of a smart terminal.
  • the user is interrupted by a call with another person and initiates a call reminder, the user is determined to place the smart terminal by sensing the distance between the smart terminal and the face. The distance of the other party's voice cannot be heard, and the other party who is talking to the user is continuously monitored by monitoring the current change in the earpiece, thereby issuing a call reminder to the user, so as to prevent the user from missing the other party's call content.
  • FIG. 4 it is a structural diagram of a call reminding system of a smart terminal in accordance with a preferred embodiment of the present invention.
  • the call reminding system provided in this embodiment mainly includes the following structure:
  • the startup module is configured to capture an operation instruction of a startup call reminding system input by the user to the smart terminal, and start the call reminding system according to the operation instruction.
  • the user's misoperation may cause interference to the normal call of the user, so the startup module is set, and the user consciously activates the call reminding system according to his own needs, and the user is aware of the call reminding system.
  • the startup module is set, and the user consciously activates the call reminding system according to his own needs, and the user is aware of the call reminding system.
  • the call reminder system is activated when needed, the waste of the power of the smart terminal can be reduced.
  • the ranging module can implement measuring a distance between the smart terminal and a human face.
  • the ranging module in the embodiment includes: an imaging unit, a face tracking unit, and a ranging unit. Its specific description is as follows:
  • At least one front camera is included, which is capable of capturing a target image that can be included by the front camera, that is, a scene including the face of the smart terminal screen.
  • the operation of the face tracking unit is to search for a preset face information in the target image, and when the target image is searched for an error with the preset face information, When the error range is preset, it is considered that the corresponding face information is searched.
  • the face tracking unit includes a face recognition unit, and the face recognition unit can identify a facial contour shape, a facial feature position, and a human face in the target image. skin color, Human face skin texture.
  • the specific searching step of the face recognition unit comprises: 1) first establishing a face information file.
  • the camera unit collects a certain number of face images of the user's face in advance or forms an image file using the existing photos of the user, and uses the statistical principle to generate a faceprint code of the face; 2) acquire one Virtual face coding, that is, when the camera unit captures a target image, the scene in the current target image is processed in the same coding form to generate a virtual face code; 3) the virtual face code and file inventory are generated The face code is compared, and when there is a portion of the virtual face code that has a deviation from the pre-stored face code within a predetermined range, then a face is considered to exist in the target image.
  • the distance between the smart terminal and the human face is measured.
  • the distance is set to infinity. Therefore, when the user is guaranteed to leave the range of the front camera of the smart terminal, the smart terminal can normally send a call reminder.
  • the distance measuring unit comprises a distance sensor
  • the working principle is: detecting the physical change amount of the object by using various components, and measuring the slave sensor by converting the change amount into a distance. The machine that shifts the distance to the object.
  • the distance sensor may be one of an optical displacement sensor, a linear proximity sensor, an ultrasonic displacement sensor, and the like.
  • Optical displacement sensor (smart sensor ZX-L-N series, etc.): Light emitted by a light source is collected by a lens and irradiated onto an object. The reflected light from the object is concentrated by a light receiving lens onto a one-dimensional position detecting element (PSD)*. If the position of the object (distance from the measurer) changes, the imaging position on the PSD will be different; if the two output balances of the PSD change, the imaging position on the PSD will be different and the two output balances of the PSD will change again.
  • PSD position detecting element
  • Linear proximity sensor (smart sensor ZX-E series, etc.): If the coil is AC, it will generate magnetic flux. If it passes through the metal object, it will generate an eddy current in the object and emit magnetic flux to prevent this. kind of change. As a result, the inductance of the coil changes. The amount of change in this induction is a function of the distance between the coil and the object, and as a result, the distance displacement of the object can be measured.
  • the ultrasonic wave is transmitted from the wave transmitter to the object, and the reflected wave is received by the wave receiver.
  • the way of calculating the distance by calculating the relationship between the time required for the ultrasonic wave from transmission to reception and the speed of sound.
  • the ranging unit includes an infrared distance sensor, and the distance between the smart terminal and the human face is obtained by using a measurement time method.
  • the infrared distance sensor may emit an infrared ray, and the infrared ray is irradiated onto a human face, and the skin of the human face generates a heat dissipation effect on the infrared ray, and the infrared distance sensor further receives the emission reflected by the human skin. infrared.
  • the infrared distance sensor calculates the distance between the face and the smart terminal by the time difference between the infrared ray and the reflected infrared ray.
  • the utility model is configured to monitor a current intensity in the earpiece of the smart terminal, and generate an alarm command when a current intensity of the earpiece is greater than a preset current intensity.
  • a current intensity of the earpiece is greater than a preset current intensity.
  • the current monitoring module can monitor the current in the earpiece of the smart terminal. Change to determine if the other party is inputting audio (speech) to their smart terminal.
  • an alarm command is generated and sent out.
  • the alarm module may control the smart terminal to send an alarm signal according to the alarm instruction.
  • the alarm module specifically includes an audio unit, a light unit, and/or a vibration unit. It can receive a corresponding alarm command and emit an audio signal, a flash signal, and/or a vibration signal accordingly.
  • FIG. 6 is a structural diagram of a call reminding system of a smart terminal according to another preferred embodiment of the present invention. It can be seen from the figure that, in order to implement the instant stop smart terminal to continuously send the call reminding notification, the call reminding system of the embodiment further includes the following modules:
  • the instruction module may receive an operation instruction sent by the ranging module, and according to the operation instruction Generate a stop alarm command and send it out.
  • the alarm control module controls, according to the stop alarm instruction, each specific alarm unit in the intelligent terminal, such as an audio unit, a light unit, and/or a vibration unit, to stop transmitting the alarm signal.
  • the invention utilizes the tracking face information to know that the user is in the state of not answering the phone; the invention uses the current in the earpiece of the monitoring intelligent terminal to know that the other party of the call is inputting the voice; the invention provides a convenient call reminding method and system, saving The time the user waits for a call has good market application value.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)

Abstract

本发明提供一种智能终端的通话提醒方法及通话提醒系统,其包括以下步骤:捕获一操作指令,启动通话提醒系统;感应所述智能终端与人脸之间的距离;当所述智能终端与人脸之间的距离大于一预设距离时,监测所述智能终端听筒中的电流强度;当所述听筒的电流强度大于一预设电流强度时,生成一告警指令,根据所述告警指令,控制所述智能终端发出一告警信号。本发明提供一种便利的通话提醒方法和系统,节约了用户等待通话的时间,具有良好的市场应用价值。The invention provides a call reminding method and a call reminding system for an intelligent terminal, comprising the steps of: capturing an operation instruction, starting a call reminding system; sensing a distance between the smart terminal and a face; and when the smart terminal and the smart terminal When the distance between the faces is greater than a preset distance, monitoring the current intensity in the earpiece of the smart terminal; when the current intensity of the earpiece is greater than a preset current intensity, generating an alarm command, according to the alarm command, Controlling the smart terminal to send an alarm signal. The invention provides a convenient call reminding method and system, which saves the time for the user to wait for a call and has good market application value.

Description

一种智能终端的通话提醒方法及通话提醒系统Call reminding method and call reminding system of intelligent terminal 技术领域Technical field

本发明涉及智能终端的控制领域,尤其涉及一种智能终端的通话提醒方法及通话提醒系统。The present invention relates to the field of control of intelligent terminals, and in particular, to a call reminding method and a call reminding system for an intelligent terminal.

背景技术Background technique

随着科技的发展和进步,智能终端的发展也是日新月异,智能终端当前,智能终端因其便利性和功能性,已经逐渐渗入到人们生活的方方面面,成为人们生活中不可或缺的辅助设备。同时,随着智能终端功能性的多样化,智能终端各功能的便捷性也成为用户的选择因素之一。With the development and advancement of technology, the development of intelligent terminals is also changing with each passing day. Intelligent terminals Currently, intelligent terminals have gradually penetrated into all aspects of people's lives because of their convenience and functionality, and have become an indispensable auxiliary equipment in people's lives. At the same time, with the diversification of the functionality of smart terminals, the convenience of the functions of smart terminals has become one of the user's choice factors.

在智能终端的实际应用中,常出现在通话过程中,由于通话双方中的一方由于突发事件而临时中断通话的情况,由于无法预计突发事件的处理时间,另一方则需一直保持接听状态,以防一方突然恢复通话。上述情况中,用户需要保持接听电话状态,且无法脱身从事其他的工作,对用户的实际应用造成了极大的不便。In the actual application of the smart terminal, it often occurs during the call. Because one of the two parties temporarily interrupts the call due to an emergency, the other party needs to keep the answering state because the processing time of the emergency cannot be expected. In case one party suddenly resumes the call. In the above case, the user needs to keep on receiving the call state, and cannot get out of the work for other work, which causes great inconvenience to the user's actual application.

发明内容Summary of the invention

为解决上述问题,本发明提供一种智能终端的通话提醒的方法及通话提醒系统。本发明利用在所述智能终端中设置一测距模块及电流监测模块,通过监测人脸与智能终端的距离及智能终端听筒中的电流变化,及时向用户发出通话提醒,使用户及时接听对方通话内容。To solve the above problems, the present invention provides a method for calling a reminder of a smart terminal and a call reminding system. The invention utilizes a distance measuring module and a current monitoring module in the smart terminal to timely send a call reminder to the user by monitoring the distance between the face and the smart terminal and the current change in the earpiece of the smart terminal, so that the user can answer the call of the other party in time. content.

具体地,本发明一方面提供一种智能终端的通话提醒的方法,其特征在于,包括以下步骤:捕获一操作指令,启动通话提醒系统;感应所述智能终端与人脸之间的距离;当所述智能终端与人脸之间的距离大于一预设距离时,监测所述智能终端听筒中的电流强度;当所述听筒的电流强度大于一预设电流强度时,生成一告警指令,根据所述告警指令,控制所述智能终端发出一告警信号。Specifically, an aspect of the present invention provides a method for calling a reminder of an intelligent terminal, comprising the steps of: capturing an operation instruction, starting a call reminding system; and sensing a distance between the smart terminal and a face; When the distance between the smart terminal and the face is greater than a preset distance, monitoring the current intensity in the earpiece of the smart terminal; when the current intensity of the earpiece is greater than a preset current intensity, generating an alarm command, according to The alarm instruction controls the smart terminal to send an alarm signal.

优选地,上述方法中,感应所述智能终端与人脸之间的距离的步骤包括,捕获一包括所述智能终端屏幕前端的景象的目标图像,追踪所述目标图像中的人脸信息,测量所述智能终端与人脸之间的距离,其中,当所述目标图像中没有人脸信息时,设定所述距 离为无穷大。Preferably, in the above method, the step of sensing the distance between the smart terminal and the human face comprises: capturing a target image including a scene of the front end of the smart terminal screen, tracking the face information in the target image, and measuring a distance between the smart terminal and a face, wherein the distance is set when there is no face information in the target image From infinity.

优选地,上述方法中,追踪所述目标图像中的人脸信息的步骤包括,识别所述目标图像中人脸五官轮廓形状、人脸五官位置、人脸皮肤颜色、人脸皮肤纹理,当所述目标图像中至少存在人脸皮肤颜色、人脸皮肤纹理时,确定所述目标图像中包含人脸。Preferably, in the above method, the step of tracking the face information in the target image comprises: identifying a facial contour shape, a facial facial feature, a facial skin color, a facial skin texture in the target image, When there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face.

优选地,上述方法还包括,当所述智能终端感应到所述智能终端与人体之间的距离小于或者等于所述预设距离时,生成一停止告警指令,根据所述停止告警指令,所述智能终端停止发送所述告警信号。Preferably, the method further includes: when the smart terminal senses that the distance between the smart terminal and the human body is less than or equal to the preset distance, generating a stop alarm instruction, according to the stop alarm instruction, The intelligent terminal stops transmitting the alarm signal.

优选地,上述方法中,所述告警信号包括,声音信号、闪光信号或者振动信号。Preferably, in the above method, the alarm signal includes a sound signal, a flash signal or a vibration signal.

本发明的另一方面,在于提供一种智能终端的通过提醒系统,其包括以下模块,启动模块,捕获一操作指令,根据所述操作指令启动通话提醒系统;测距模块,感应所述智能终端与人脸之间的距离;电流监测模块,监测所述智能终端听筒中的电流强度,当所述听筒的电流强度大于一预设电流强度时,生成一告警指令,告警模块,根据所述告警指令,控制所述智能终端发出一告警信号。Another aspect of the present invention provides a reminder system for an intelligent terminal, which includes the following module, the startup module captures an operation instruction, activates a call reminding system according to the operation instruction, and the ranging module senses the smart terminal. a distance between the face and the face; the current monitoring module monitors the current intensity in the earpiece of the smart terminal, and when the current intensity of the earpiece is greater than a predetermined current intensity, generates an alarm command, and the alarm module according to the alarm And instructing the smart terminal to send an alarm signal.

优选地,上述系统中,所述测距模块包括,摄像单元,捕获一包括所述智能终端屏幕所面向的景象的目标图像,人脸追踪单元,追踪所述目标图像中的人脸信息,测距单元,测量所述智能终端与人脸之间的距离,其中,当所述目标图像中没有人脸信息时,设定所述距离为无穷大。Preferably, in the above system, the ranging module comprises: an image capturing unit, capturing a target image including a scene facing the screen of the smart terminal, a face tracking unit, tracking face information in the target image, and measuring The distance unit measures a distance between the smart terminal and a human face, wherein when the face image has no face information, the distance is set to infinity.

优选地,上述系统中,所述人脸追踪单元包括,人脸识别单元,识别所述目标图像中人脸五官轮廓形状、人脸五官位置、人脸皮肤颜色、人脸皮肤纹理,其中,当所述目标图像中至少存在人脸皮肤颜色、人脸皮肤纹理时,确定所述目标图像中包含人脸。Preferably, in the above system, the face tracking unit includes a face recognition unit that recognizes a face facial contour shape, a facial facial feature position, a face skin color, and a face skin texture in the target image, wherein When there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face.

优选地,上述系统中还包括,一指令模块,当所述智能终端感应到所述智能终端与人体之间的距离小于或者等于所述预设距离时,生成一停止告警指令;一告警控制模块,根据所述停止告警指令,所述智能终端停止发送所述告警信号。Preferably, the system further includes: an instruction module, when the smart terminal senses that the distance between the smart terminal and the human body is less than or equal to the preset distance, generating a stop alarm instruction; and an alarm control module And, according to the stop alarm instruction, the smart terminal stops sending the alarm signal.

优选地,上述系统中,所述告警模块包括,音频单元,根据所述告警指令,播放音频信号;灯光单元,根据所述告警指令,发出闪光信号;或振动单元,根据所述告警指令,发出振动信号。Preferably, in the above system, the alarm module includes an audio unit that plays an audio signal according to the alarm instruction; a light unit that emits a flash signal according to the alarm instruction; or a vibration unit that issues according to the alarm instruction Vibration signal.

与现有技术相比较,本发明的技术优势在于:Compared with the prior art, the technical advantages of the present invention are:

1)本发明利用追踪人脸信息,获知用户处于未接听电话状态;1) The present invention utilizes tracking face information to know that the user is in a state of not receiving a call;

2)本发明利用监测智能终端听筒中的电流,获知通话的另一方正在输入语音;2) The invention utilizes monitoring the current in the earpiece of the intelligent terminal to know that the other party of the call is inputting voice;

3)本发明提供一种便利的通话提醒方法和系统,节约了用户等待通话的时间,具有良好 的市场应用价值。3) The present invention provides a convenient call reminding method and system, which saves time for users to wait for a call and has good Market application value.

附图说明DRAWINGS

图1为一符合本发明一优选实施例的智能终端的通话提醒方法的流程示意图1 is a schematic flow chart of a call reminding method of a smart terminal according to a preferred embodiment of the present invention

图2为图1中感应智能终端与人脸之间距离的流程示意图;2 is a schematic flow chart of the distance between the sensing intelligent terminal and the face in FIG. 1;

图3为另一符合本发明一优选实施例的智能终端的通话提醒的方法的流程示意图;3 is a schematic flow chart of another method for calling a reminder of a smart terminal according to a preferred embodiment of the present invention;

图4为一符合本发明一优选实施例的智能终端的通话提醒系统的结构图;4 is a structural diagram of a call reminding system of a smart terminal in accordance with a preferred embodiment of the present invention;

图5为图4中的测距模块的结构图;Figure 5 is a structural view of the ranging module of Figure 4;

图6为一符合本发明另一优选实施例的一种智能终端的通话提醒系统的结构图。FIG. 6 is a structural diagram of a call reminding system of a smart terminal according to another preferred embodiment of the present invention.

具体实施方式Detailed ways

下面结合附图及具体实施例,详细阐述本发明的优势。The advantages of the present invention are explained in detail below with reference to the accompanying drawings and specific embodiments.

下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with aspects of the present disclosure as detailed in the appended claims.

首先,应当理解,尽管在本公开可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本公开范围的情况下,第一智能终端也可以被称为第二智能终端,类似地,第二智能终端也可以被称为第一智能终端。First, it should be understood that although the terms first, second, third, etc. may be employed in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, the first intelligent terminal may also be referred to as a second smart terminal without departing from the scope of the present disclosure. Similarly, the second smart terminal may also be referred to as a first smart terminal.

在智能终端的实际应用中,常出现在通话过程中,由于通话双方中的一方由于突发事件而临时中断通话的情况,由于无法预计突发事件的处理时间,另一方则需一直保持接听状态,以防一方突然恢复通话。上述情况中,用户需要保持接听电话状态,且无法脱身从事其他的工作,对用户的实际应用造成了极大的不便。为解决上述问题,本发明一方面提供一种智能终端的通话提醒方法,可以在出现一方中断通话的过程中监听其语音情况,并在对方恢复通话时为用户提供告警提醒,为用户带来极大的便利。In the actual application of the smart terminal, it often occurs during the call. Because one of the two parties temporarily interrupts the call due to an emergency, the other party needs to keep the answering state because the processing time of the emergency cannot be expected. In case one party suddenly resumes the call. In the above case, the user needs to keep on receiving the call state, and cannot get out of the work for other work, which causes great inconvenience to the user's actual application. In order to solve the above problem, an aspect of the present invention provides a call reminding method for an intelligent terminal, which can monitor a voice situation when a party interrupts a call, and provide an alarm reminder to the user when the other party resumes the call, which brings the user a pole. Great convenience.

具体地,参见图1,其为一符合本发明一优选实施例的智能终端的通话提醒方法的流程示意图。从图中可以看出,本实施例所提供的智能终端的通话提醒方法主要包括以下步骤:Specifically, referring to FIG. 1 , which is a schematic flowchart of a call reminding method of a smart terminal according to a preferred embodiment of the present invention. It can be seen from the figure that the call reminding method of the smart terminal provided by this embodiment mainly includes the following steps:

-捕获一操作指令,启动通话提醒系统 - Capture an operation command to activate the call reminder system

本实施例中,当用户通话过程中,对方遇到突发事件,保持连接状态,但是中断与用户的通话,并要求用户等待其恢复通话时,用户可以触发所述智能终端的通话提醒系统,利用智能终端监控对方的通话状态,并及时向用户发出告警通知。从而,所述智能终端的启动模块可以捕获用户对所述智能终端输入的上述操作指令,并解析所述操作指令后,根据所述操作指令启动所述智能终端的通话提醒系统。In this embodiment, when the user encounters an emergency event during the conversation, the other party encounters an emergency, but maintains the connection state, but interrupts the call with the user, and asks the user to wait for the resume call, the user can trigger the call reminding system of the smart terminal. The intelligent terminal is used to monitor the call status of the other party, and an alarm notification is sent to the user in time. Therefore, the startup module of the smart terminal may capture the operation instruction input by the user to the smart terminal, and after parsing the operation instruction, start the call reminding system of the smart terminal according to the operation instruction.

-感应所述智能终端与人脸之间的距离- sensing the distance between the smart terminal and the face

本实施例中,当所述通话提醒系统被启动后,所述通话提醒系统的测距模块监测所述智能终端与人脸之间的距离,并获得所述智能终端与人脸之间的具体距离数据,并将所述具体距离数据与所述智能终端中一预存的预存距离进行对比,并根据上述对比结果,向外发送一相应的操作指令。In this embodiment, after the call reminding system is activated, the ranging module of the call reminding system monitors the distance between the smart terminal and the face, and obtains a specific between the smart terminal and the face. The distance data is compared with a pre-stored pre-stored distance in the smart terminal, and a corresponding operation instruction is sent out according to the comparison result.

参阅图2,其为图1中感应智能终端与人脸之间距离的流程示意图。从图中可以看出,优选地,感应智能终端与人脸之间的距离可以采用如下方法步骤:Referring to FIG. 2, it is a schematic flowchart of the distance between the sensing intelligent terminal and the human face in FIG. As can be seen from the figure, preferably, the distance between the sensing intelligent terminal and the face can be as follows:

-捕获一包括所述智能终端屏幕前端的景象的目标图像Capturing a target image comprising a scene of the front end of the screen of the smart terminal

即,当根据用户的指令启动所述智能终端的通话提醒系统后,所述通话提醒系统中的摄像单元在后台启动,并通过所述摄像单元中的前置摄像头,捕获一所述前置摄像头能够囊括的,也即包括所述智能终端屏幕所面向的景象的目标图像。That is, after the call reminding system of the smart terminal is activated according to an instruction of the user, the camera unit in the call reminding system is activated in the background, and a front camera is captured by the front camera in the camera unit. A target image that can be included, that is, includes a scene to which the smart terminal screen faces.

-追踪所述目标图像中的人脸信息- Tracking face information in the target image

本实施例中,当所述摄像单元捕获所述目标图像后,所述智能终端中的人脸追踪单元可以在所述目标图像中搜索,扫描所述目标图像中的人脸信息。其中优选地,本实施例中,可以通过预先编译,为所述人脸追踪单元设置最终搜索对象为一人脸信息,及搜索结果允许的误差范围,从而,当所述人脸追踪单元在所述目标图像中搜索到与预设的人脸信息的误差在预设的误差范围时,则认为搜索到相应的人脸信息。In this embodiment, after the image capturing unit captures the target image, the face tracking unit in the smart terminal may search in the target image to scan face information in the target image. Preferably, in this embodiment, the final search object is set as a face information and the error range allowed by the search result is set by the face tracking unit by pre-compilation, so that when the face tracking unit is in the When the error in the target image and the preset face information is within a preset error range, it is considered that the corresponding face information is searched.

更加优选地,本实施例中,追踪所述目标图像中的人脸信息步骤包括:More preferably, in this embodiment, the step of tracking the face information in the target image comprises:

-识别所述目标图像中人脸五官轮廓形状、人脸五官位置、人脸皮肤颜色、人脸皮肤纹理Identifying the facial features of the facial image, the facial features, the facial skin color, and the facial skin texture in the target image

更加优选地,本实施例中,所述人脸追踪单元中包括一人脸识别单元,其可具体识别所述目标图像中的包括人脸五官轮廓形状、人脸五官位置、人脸皮肤颜色、人脸皮肤纹理等的人脸信息,而,本实施例中,设定所述人脸识别单元搜索发现所述目标图像中至少存在人脸皮肤颜色、人脸皮肤纹理时,则确定所述目标图像中包含人脸。More preferably, in the embodiment, the face tracking unit includes a face recognition unit, which can specifically identify the facial features including the facial features, the facial features, the facial skin color, and the person in the target image. a face information such as a face skin texture, but in the embodiment, when the face recognition unit searches for the presence of at least a face skin color and a face skin texture in the target image, determining the target image Contains human faces.

其中优选地,本实施例中,所述人脸识别单元的具体搜索步骤包括:1)首先建立人 脸信息档案。即利用摄像单元预先采集一定数量的用户人脸的面像文件或利用用户的现有照片形成面像文件,利用统计学原理,生成人脸的面纹(Faceprint)编码贮存起来;2)获取一虚拟面纹编码,即当所述摄像单元捕获一目标图像时,将当前的目标图像中的景象按照相同的编码形式处理,生成虚拟面纹编码;3)将所述虚拟面纹编码与档案库存的面纹编码进行比对,当所述虚拟面纹编码中存在与预存的面纹编码的偏差在一预设范围内的部分时,则认为所述目标图像中存在人脸。而,本实施例中,其中,当所述目标图像中至少存在人脸皮肤颜色、人脸皮肤纹理时,则确定所述目标图像中包含人脸。Preferably, in this embodiment, the specific searching step of the face recognition unit includes: 1) first establishing a person Face information file. That is, the camera unit collects a certain number of face images of the user's face in advance or forms an image file using the existing photos of the user, and uses the statistical principle to generate a faceprint code of the face; 2) acquire one Virtual face coding, that is, when the camera unit captures a target image, the scene in the current target image is processed in the same coding form to generate a virtual face code; 3) the virtual face code and file inventory are generated The face code is compared, and when there is a portion of the virtual face code that has a deviation from the pre-stored face code within a predetermined range, then a face is considered to exist in the target image. In this embodiment, when there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face.

-测量所述智能终端与人脸之间的距离- measuring the distance between the smart terminal and the face

继续参阅图1,本实施例中,所述智能终端追踪所述目标图像中的人脸信息后,进一步所述智能终端中的测距模块测量所述智能终端与人脸之间的距离。With reference to FIG. 1 , in the embodiment, after the smart terminal tracks the face information in the target image, the distance measuring module in the smart terminal further measures the distance between the smart terminal and the face.

优选地,参阅图2,本实施例中,所述测距模块包括一测距单元,所述测距单元包括一距离传感器,实现利用测量时间的方法获取所述智能终端及人脸之间的距离。具体地,所述距离传感器可以发出一红外线,所述红外线照射到人脸上,人脸的皮肤对所述红外线产生散热作用,所述距离传感器进一步可接收由人脸皮肤反射回的发射红外线。所述距离传感器通过其发出红外线到接收到反射红外线之间的时间差,计算获得人脸与所述智能终端之间的距离。Preferably, referring to FIG. 2, in the embodiment, the ranging module includes a ranging unit, and the ranging unit includes a distance sensor, and the method for measuring time is used to acquire between the smart terminal and the human face. distance. Specifically, the distance sensor may emit an infrared ray that is irradiated onto a human face, and the skin of the human face generates a heat dissipation effect on the infrared ray, and the distance sensor further receives the emitted infrared ray reflected by the human skin. The distance sensor calculates the distance between the face and the smart terminal by the time difference between the infrared ray and the reflected infrared ray.

所述测距模块获得所述智能终端与人脸之间的距离后,将与一预设距离进行比对,当所述智能终端与人脸之间的距离大于所述预设距离时,所述测距模块进一步生成一监测指令,并向外发送。After the ranging module obtains the distance between the smart terminal and the human face, it compares with a preset distance, when the distance between the smart terminal and the human face is greater than the preset distance, The ranging module further generates a monitoring command and sends it out.

其中,应当理解的,本实施例中,将所述人脸追踪单元在所述目标图像中没有搜索到人脸信息的情况,认为是人脸与所述智能终端之间的距离无穷大,从而,此时,所述测距模块也将生成一监测指令。It should be understood that, in this embodiment, the face tracking unit does not search for the face information in the target image, and the distance between the face and the smart terminal is considered to be infinite, and thus, At this time, the ranging module will also generate a monitoring command.

-监测所述智能终端听筒中的电流强度Monitoring the current intensity in the earpiece of the smart terminal

继续参阅图1,可见,本实施例中,当所述智能终端与人脸之间的距离大于一预设距离时,所述智能终端中的电流监测模块将接收所述测距模块发送的一监测指令,从而,监测所述智能终端听筒中的电流强度。With reference to FIG. 1, it can be seen that, in this embodiment, when the distance between the smart terminal and the face is greater than a preset distance, the current monitoring module in the smart terminal receives the one sent by the ranging module. Monitoring instructions, thereby monitoring the intensity of the current in the earpiece of the smart terminal.

上述设计的原理在于,手机听筒,也即手机扬声器有许多种类,但其基本的工作原理是相似的,均是一种将电信号转换为声音信号进行重放的元件。目前使用最为广泛的是电动式扬声器,它由振动膜、音圈、永久磁铁、支架等组成。扬声器的工作原理是当扬声器的音圈通入音频电流后音圈在电流的作用下便产生交变的磁场,永久磁铁同时也 产生一个大小和方向不变的恒定的磁场。由于音圈所产生磁场的大小和方向随音频电流的变化不断地在改变,这样两个磁场的相互作用使音圈作垂直千音圈中电流方向的运动,由千音圈和振动膜相连,从而带动振动膜产生振动,由振动膜振动引起空气的振动而发出声音。当输入音圈的电流越大,其磁场的作用力就越大,振动膜振动的幅度也就越大,声音则越晌。而通话时,则是利用手机麦克风将声音信号转变成电信号加以处理储存,即和手机播放声音互为逆过程。The principle of the above design is that there are many types of mobile phone handsets, that is, mobile phone speakers, but the basic working principle is similar, and both are components for converting electrical signals into sound signals for playback. Currently the most widely used is the electric speaker, which consists of a diaphragm, a voice coil, a permanent magnet, a bracket, and the like. The working principle of the speaker is that when the voice coil of the speaker is connected to the audio current, the voice coil generates an alternating magnetic field under the action of current, and the permanent magnet also Produces a constant magnetic field of constant size and direction. Since the magnitude and direction of the magnetic field generated by the voice coil are constantly changing with the change of the audio current, the interaction of the two magnetic fields causes the voice coil to move in the direction of the current in the vertical chirp, connected by the voice coil and the diaphragm. Thereby, the vibrating membrane is driven to generate vibration, and the vibrating membrane vibrates to cause vibration of the air to emit sound. When the current input to the voice coil is larger, the force of the magnetic field is greater, the amplitude of the vibration of the diaphragm is greater, and the sound is more ambiguous. In the case of a call, the mobile phone microphone is used to convert the sound signal into an electrical signal for processing and storage, that is, the sound reproduction process with the mobile phone is reversed.

可见,当与用户通话的对方有音频传输至用户的智能终端的听筒时,听筒中会接收到较大的电流变化,从而,所述电流监测模块可通过监测所述智能终端听筒中的电流变化,以确定对方是否对其智能终端输入音频(语音)。而,当所述电流监测模块监测到所述智能终端听筒中产生一大于一预设电流强度的电流强度时,则生成一告警指令,并向外发送。It can be seen that when the other party talking with the user has an audio transmission to the earpiece of the user's smart terminal, a large current change is received in the earpiece, so that the current monitoring module can monitor the current change in the earpiece of the smart terminal. To determine if the other party is inputting audio (speech) to their smart terminal. When the current monitoring module detects that a current intensity greater than a predetermined current intensity is generated in the earpiece of the smart terminal, an alarm command is generated and sent out.

-根据所述告警指令,控制所述智能终端发出一告警信号- controlling the smart terminal to send an alarm signal according to the alarm instruction

继续参阅图1,本实施例中,所述智能终端中还设置有一告警模块,所述告警模块可接收所述电流监测模块发出的一告警指令,解析并根据所述告警指令控制相应的告警单元发出相应的告警信息。With reference to FIG. 1 , in the embodiment, an intelligent module is further provided with an alarm module, and the alarm module can receive an alarm command sent by the current monitoring module, analyze and control the corresponding alarm unit according to the alarm instruction. Send the corresponding alarm information.

其中,优选地,所述告警模块具体包括音频单元、灯光单元和/或振动单元。其可接收相应的告警指令,而发出音频信号、闪光信号和/或振动信号。Preferably, the alarm module specifically includes an audio unit, a light unit, and/or a vibration unit. It can receive an appropriate alarm command and emit an audio signal, a flash signal, and/or a vibration signal.

应当理解的是,上述告警信号不一定要单独发出,用户可以根据自身需求或者喜好,预先设置一种或者多种信号组合的告警信号及其具体地告警信号内容,如音频的类型、闪光的频率和/或振动的形式等。It should be understood that the above alarm signals do not have to be sent separately. The user can preset one or more kinds of signal combination alarm signals and their specific alarm signal contents according to their own needs or preferences, such as the type of audio and the frequency of the flash. And / or the form of vibration, etc.

另外,优选地,参阅图3,其为另一符合本发明一优选实施例的智能终端的通话提醒的方法的流程示意图。从图中可以看好,本实施例所提供的通话提醒方法中,还包括一种通话提醒结束的方法步骤,其具体包括:In addition, preferably, referring to FIG. 3, it is a schematic flowchart of another method for calling reminding of a smart terminal according to a preferred embodiment of the present invention. It can be seen from the figure that the call reminding method provided in this embodiment further includes a method step of ending the call reminding, which specifically includes:

-生成一停止告警指令- Generate a stop alarm command

本实施例中,所述智能终端可在用户继续接听电话后,停止所述通话提醒功能。具体地,用户移动智能终端靠近其脸部时,所述智能终端的测距模块继续监测所述智能终端到人脸的距离,当所述测距模块监测到所述智能终端与人体之间的距离小于或者等于所述预设距离时,向外发送一操作指令,所述智能终端中的一指令模块接收并根据所述操作指令生成一停止告警指令,并向外发送。In this embodiment, the smart terminal may stop the call reminding function after the user continues to answer the call. Specifically, when the user moves the smart terminal to be close to the face thereof, the ranging module of the smart terminal continues to monitor the distance from the smart terminal to the human face, and when the ranging module detects the smart terminal and the human body When the distance is less than or equal to the preset distance, an operation instruction is sent out, and an instruction module of the intelligent terminal receives and generates a stop alarm instruction according to the operation instruction, and sends the instruction to the outside.

-停止发送所述告警信号。 - Stop sending the alarm signal.

从而,所述智能终端中的告警控制模块则可接收上述停止告警指令,并控制所述智能终端中的告警模块停止发送所述告警信号,如停止播放音乐,停止闪烁灯光,停止振动智能终端等。Therefore, the alarm control module in the smart terminal can receive the stop alarm command, and control the alarm module in the smart terminal to stop sending the alarm signal, such as stopping playing music, stopping flashing lights, stopping vibrating intelligent terminals, etc. .

综上可见,本发明提供一种智能终端的通话提醒的方法,在用户与他人通话被打断,并启动通话提醒时,通过感应智能终端与人脸之间的距离判断用户将智能终端置于无法听到对方语音的距离,通过监测听筒中的电流变化监控与用户通话的另一方继续通话,从而向用户发出通话提醒,以免用户错失另一方的通话内容。In summary, the present invention provides a method for calling a reminder of a smart terminal. When the user is interrupted by a call with another person and initiates a call reminder, the user is determined to place the smart terminal by sensing the distance between the smart terminal and the face. The distance of the other party's voice cannot be heard, and the other party who is talking to the user is continuously monitored by monitoring the current change in the earpiece, thereby issuing a call reminder to the user, so as to prevent the user from missing the other party's call content.

本发明的另一方面在于,提供一种智能终端的通话提醒系统。参阅图4,其为一符合本发明一优选实施例的智能终端的通话提醒系统的结构图。从图中可以看出,本实施例所提供的通话提醒系统主要包括以下结构:Another aspect of the present invention is to provide a call reminding system for a smart terminal. Referring to FIG. 4, it is a structural diagram of a call reminding system of a smart terminal in accordance with a preferred embodiment of the present invention. As can be seen from the figure, the call reminding system provided in this embodiment mainly includes the following structure:

-启动模块-Start module

所述启动模块用于捕获用户对所述智能终端输入的启动通话提醒系统的操作指令,并根据所述操作指令,启动所述通话提醒系统。The startup module is configured to capture an operation instruction of a startup call reminding system input by the user to the smart terminal, and start the call reminding system according to the operation instruction.

本实施例中,为了避免通话提醒系统保持开启状态时,用户误操作会对用户正常通话造成干扰,故设置启动模块,用户根据自身的需求,有意识地启动通话提醒系统,用户在了解通话提醒系统的工作原理的情况下,能够有意识地避免误操作的产生。另一方面在需要时才启动通话提醒系统也可减少对智能终端电量的浪费。In this embodiment, in order to prevent the call reminding system from being kept open, the user's misoperation may cause interference to the normal call of the user, so the startup module is set, and the user consciously activates the call reminding system according to his own needs, and the user is aware of the call reminding system. In the case of the working principle, it is possible to consciously avoid the occurrence of misoperations. On the other hand, when the call reminder system is activated when needed, the waste of the power of the smart terminal can be reduced.

-测距模块-Ranging module

所述测距模块可实现测量所述智能终端与人脸之间的距离。The ranging module can implement measuring a distance between the smart terminal and a human face.

具体优选地,参见图5,其为图4中的测距模块的结构图。从图中可以看出,本实施例中所述测距模块包括:摄像单元、人脸追踪单元和测距单元。其具体说明如下:Specifically, referring to FIG. 5, it is a structural diagram of the ranging module in FIG. As can be seen from the figure, the ranging module in the embodiment includes: an imaging unit, a face tracking unit, and a ranging unit. Its specific description is as follows:

-摄像单元- camera unit

至少包括一前置摄像头,能够捕获一所述前置摄像头能够囊括的,也即包括所述智能终端屏幕所面向的景象的目标图像。At least one front camera is included, which is capable of capturing a target image that can be included by the front camera, that is, a scene including the face of the smart terminal screen.

-人脸追踪单元- Face tracking unit

本实施例中,所述人脸追踪单元的操作目的为在所述目标图像中搜索一预设的人脸信息,且当在所述目标图像中搜索到与预设的人脸信息的误差在预设误差范围时,则认为搜索到相应的人脸信息。In this embodiment, the operation of the face tracking unit is to search for a preset face information in the target image, and when the target image is searched for an error with the preset face information, When the error range is preset, it is considered that the corresponding face information is searched.

其中,具体地,所述人脸追踪单元包括一人脸识别单元,所述人脸识别单元,所述人脸识别单元可识别所述目标图像中人脸五官轮廓形状、人脸五官位置、人脸皮肤颜色、 人脸皮肤纹理。优选地,本实施例中,所述人脸识别单元的具体搜索步骤包括:1)首先建立人脸信息档案。即利用摄像单元预先采集一定数量的用户人脸的面像文件或利用用户的现有照片形成面像文件,利用统计学原理,生成人脸的面纹(Faceprint)编码贮存起来;2)获取一虚拟面纹编码,即当所述摄像单元捕获一目标图像时,将当前的目标图像中的景象按照相同的编码形式处理,生成虚拟面纹编码;3)将所述虚拟面纹编码与档案库存的面纹编码进行比对,当所述虚拟面纹编码中存在与预存的面纹编码的偏差在一预设范围内的部分时,则认为所述目标图像中存在人脸。而,本实施例中,其中,当所述目标图像中至少存在人脸皮肤颜色、人脸皮肤纹理时,则确定所述目标图像中包含人脸。Specifically, the face tracking unit includes a face recognition unit, and the face recognition unit can identify a facial contour shape, a facial feature position, and a human face in the target image. skin color, Human face skin texture. Preferably, in this embodiment, the specific searching step of the face recognition unit comprises: 1) first establishing a face information file. That is, the camera unit collects a certain number of face images of the user's face in advance or forms an image file using the existing photos of the user, and uses the statistical principle to generate a faceprint code of the face; 2) acquire one Virtual face coding, that is, when the camera unit captures a target image, the scene in the current target image is processed in the same coding form to generate a virtual face code; 3) the virtual face code and file inventory are generated The face code is compared, and when there is a portion of the virtual face code that has a deviation from the pre-stored face code within a predetermined range, then a face is considered to exist in the target image. In this embodiment, when there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face.

-测距单元-Ranging unit

用于测量所述智能终端与人脸之间的距离,其中,本实施例中,将所述目标图像中没有人脸信息时,所述距离设定为无穷大。从而,保证用户离开所述智能终端的前置摄像头的范围内时,所述智能终端能够正常的发出通话提醒。The distance between the smart terminal and the human face is measured. In the embodiment, when there is no face information in the target image, the distance is set to infinity. Therefore, when the user is guaranteed to leave the range of the front camera of the smart terminal, the smart terminal can normally send a call reminder.

其中,优选地,本实施例中,所述测距单元包括一距离传感器,其工作原理在于:利用各种元件检测对象物的物理变化量,通过将该变化量换算为距离,来测量从传感器到对象物的距离位移的机器。Preferably, in the embodiment, the distance measuring unit comprises a distance sensor, and the working principle is: detecting the physical change amount of the object by using various components, and measuring the slave sensor by converting the change amount into a distance. The machine that shifts the distance to the object.

其中,优选地,所述距离传感器可为光学式位移传感器、线性接近传感器、超声波位移传感器等中的一种。Preferably, the distance sensor may be one of an optical displacement sensor, a linear proximity sensor, an ultrasonic displacement sensor, and the like.

光学式位移传感器(智能传感器ZX-L-N系列等):利用光源发出的光通过透镜进行聚光,并照射到物体上。物体发出的反射光通过受光透镜集中到一维的位置检测元件(PSD)*上。如果物体的位置(距离测定器的距离)发生变化,PSD上成像位置将不同;如果PSD的两个输出平衡发生变化,PSD上的成像位置将不同,PSD的两个输出平衡会再次发生变化。如果将这两个输出作为A、B,计算A/(A+B),并加上适当的拉线系数‘k’和残留误差‘C’,可求得公式为:位移量=A/(A+B)+K+C。测得的值不是照度(亮度),而是A、B两个输出的位移量,因此即使与测定对象物之间的距离发生变化,受光光量发生变化也不会受影响,可以得到与距离的差、位置的偏移成比例的线性输出。Optical displacement sensor (smart sensor ZX-L-N series, etc.): Light emitted by a light source is collected by a lens and irradiated onto an object. The reflected light from the object is concentrated by a light receiving lens onto a one-dimensional position detecting element (PSD)*. If the position of the object (distance from the measurer) changes, the imaging position on the PSD will be different; if the two output balances of the PSD change, the imaging position on the PSD will be different and the two output balances of the PSD will change again. If these two outputs are taken as A and B, and A/(A+B) is calculated, and the appropriate pull coefficient 'k' and residual error 'C' are added, the formula can be obtained as: displacement = A / (A +B)+K+C. The measured value is not the illuminance (brightness), but the displacement of the two outputs A and B. Therefore, even if the distance to the object to be measured changes, the amount of received light does not change, and the distance can be obtained. The differential, positional offset is proportional to the linear output.

线性接近传感器(智能传感器ZX-E系列等):其线圈中如通过交流电,则会产生磁通,如通过金属对象物,则会在对象物中产生一种涡电流,发出磁通,防止这种变化。其结果将使线圈的感应发生变化。这种感应的变化量是线圈与对象物之间距离的函数,作为结果,能测量对象物的距离位移。Linear proximity sensor (smart sensor ZX-E series, etc.): If the coil is AC, it will generate magnetic flux. If it passes through the metal object, it will generate an eddy current in the object and emit magnetic flux to prevent this. Kind of change. As a result, the inductance of the coil changes. The amount of change in this induction is a function of the distance between the coil and the object, and as a result, the distance displacement of the object can be measured.

超声波位移传感器,则由送波器向对象物发送超声波,通过受波器来接收其反射波。 通过计算超声波从发送到接收为止所需的时间与音速之间的关系,来计算距离的方式。In the ultrasonic displacement sensor, the ultrasonic wave is transmitted from the wave transmitter to the object, and the reflected wave is received by the wave receiver. The way of calculating the distance by calculating the relationship between the time required for the ultrasonic wave from transmission to reception and the speed of sound.

优选地,本实施例中,所述测距单元包括一红外距离传感器,实现利用测量时间的方法获取所述智能终端及人脸之间的距离。具体地,所述红外距离传感器可以发出一红外线,所述红外线照射到人脸上,人脸的皮肤对所述红外线产生散热作用,所述红外距离传感器进一步可接收由人脸皮肤反射回的发射红外线。所述红外距离传感器通过其发出红外线到接收到反射红外线之间的时间差,计算获得人脸与所述智能终端之间的距离。Preferably, in the embodiment, the ranging unit includes an infrared distance sensor, and the distance between the smart terminal and the human face is obtained by using a measurement time method. Specifically, the infrared distance sensor may emit an infrared ray, and the infrared ray is irradiated onto a human face, and the skin of the human face generates a heat dissipation effect on the infrared ray, and the infrared distance sensor further receives the emission reflected by the human skin. infrared. The infrared distance sensor calculates the distance between the face and the smart terminal by the time difference between the infrared ray and the reflected infrared ray.

-电流监测模块- Current monitoring module

用于监测所述智能终端听筒中的电流强度,当所述听筒的电流强度大于一预设电流强度时,生成一告警指令。具体地,当与用户通话的对方有音频传输至用户的智能终端的听筒时,听筒中会接收到较大的电流变化,从而,所述电流监测模块可通过监测所述智能终端听筒中的电流变化,以确定对方是否对其智能终端输入音频(语音)。而,当所述电流监测模块监测到所述智能终端听筒中产生一大于一预设电流强度的电流强度时,则生成一告警指令,并向外发送。The utility model is configured to monitor a current intensity in the earpiece of the smart terminal, and generate an alarm command when a current intensity of the earpiece is greater than a preset current intensity. Specifically, when the other party talking to the user has an audio transmission to the earpiece of the user's smart terminal, a large current change is received in the earpiece, so that the current monitoring module can monitor the current in the earpiece of the smart terminal. Change to determine if the other party is inputting audio (speech) to their smart terminal. When the current monitoring module detects that a current intensity greater than a predetermined current intensity is generated in the earpiece of the smart terminal, an alarm command is generated and sent out.

-告警模块- alarm module

所述告警模块可根据所述告警指令,控制所述智能终端发出一告警信号。The alarm module may control the smart terminal to send an alarm signal according to the alarm instruction.

其中,优选地,所述告警模块具体包括音频单元、灯光单元和/或振动单元。其可接收相应的告警指令,而相应地发出音频信号、闪光信号和/或振动信号。Preferably, the alarm module specifically includes an audio unit, a light unit, and/or a vibration unit. It can receive a corresponding alarm command and emit an audio signal, a flash signal, and/or a vibration signal accordingly.

另外,参阅图6,其为一符合本发明另一优选实施例的一种智能终端的通话提醒系统的结构图。从图中可以看出,优选地,为实现即时停止智能终端持续发送通话提醒通知,本实施例的通话提醒系统中还包括以下模块:In addition, referring to FIG. 6, which is a structural diagram of a call reminding system of a smart terminal according to another preferred embodiment of the present invention. It can be seen from the figure that, in order to implement the instant stop smart terminal to continuously send the call reminding notification, the call reminding system of the embodiment further includes the following modules:

-指令模块- instruction module

当所述智能终端感应到所述智能终端与人体之间的距离小于或者等于所述预设距离时,所述指令模块可接收所述测距模块发送的一操作指令,并根据所述操作指令生成一停止告警指令,并向外发送。When the smart terminal senses that the distance between the smart terminal and the human body is less than or equal to the preset distance, the instruction module may receive an operation instruction sent by the ranging module, and according to the operation instruction Generate a stop alarm command and send it out.

-告警控制模块- Alarm Control Module

所述告警控制模块则根据所述停止告警指令,控制所述智能终端中的各具体告警单元,如音频单元、灯光单元和/或振动单元,停止发送所述告警信号。The alarm control module controls, according to the stop alarm instruction, each specific alarm unit in the intelligent terminal, such as an audio unit, a light unit, and/or a vibration unit, to stop transmitting the alarm signal.

本发明利用追踪人脸信息,获知用户处于未接听电话状态;本发明利用监测智能终端听筒中的电流,获知通话的另一方正在输入语音;本发明提供一种便利的通话提醒方法和系统,节约了用户等待通话的时间,具有良好的市场应用价值。 The invention utilizes the tracking face information to know that the user is in the state of not answering the phone; the invention uses the current in the earpiece of the monitoring intelligent terminal to know that the other party of the call is inputting the voice; the invention provides a convenient call reminding method and system, saving The time the user waits for a call has good market application value.

应当注意的是,本发明的实施例有较佳的实施性,且并非对本发明作任何形式的限制,任何熟悉该领域的技术人员可能利用上述揭示的技术内容变更或修饰为等同的有效实施例,但凡未脱离本发明技术方案的内容,依据本发明的技术实质对以上实施例所作的任何修改或等同变化及修饰,均仍属于本发明技术方案的范围内。 It should be noted that the embodiments of the present invention are preferred embodiments, and are not intended to limit the scope of the present invention. Any one skilled in the art may use the above-disclosed technical contents to change or modify the equivalent embodiments. Any modification or equivalent changes and modifications of the above embodiments in accordance with the technical spirit of the present invention are still within the scope of the technical solutions of the present invention.

Claims (10)

一种智能终端的通话提醒的方法,其特征在于,包括以下步骤:A method for calling a reminder of a smart terminal, comprising the steps of: 捕获一操作指令,启动通话提醒系统;Capture an operation command to activate the call reminding system; 感应所述智能终端与人脸之间的距离;Sensing a distance between the smart terminal and a human face; 当所述智能终端与人脸之间的距离大于一预设距离时,监测所述智能终端听筒中的电流强度;Monitoring the current intensity in the earpiece of the smart terminal when the distance between the smart terminal and the face is greater than a preset distance; 当所述听筒的电流强度大于一预设电流强度时,生成一告警指令,Generating an alarm command when the current intensity of the earpiece is greater than a predetermined current intensity, 根据所述告警指令,控制所述智能终端发出一告警信号。And controlling, according to the alarm instruction, the smart terminal to send an alert signal. 如权利要求1所述的方法,其特征在于,The method of claim 1 wherein 感应所述智能终端与人脸之间的距离的步骤包括,The step of sensing the distance between the smart terminal and the face includes: 捕获一包括所述智能终端屏幕前端的景象的目标图像,Capturing a target image including a scene of a front end of the screen of the smart terminal, 追踪所述目标图像中的人脸信息,Tracking face information in the target image, 测量所述智能终端与人脸之间的距离,Measuring the distance between the smart terminal and the face, 其中,当所述目标图像中没有人脸信息时,设定所述距离为无穷大。Wherein, when there is no face information in the target image, the distance is set to infinity. 如权利要求2所述的方法,其特征在于,The method of claim 2 wherein 追踪所述目标图像中的人脸信息的步骤包括,The step of tracking the face information in the target image includes, 识别所述目标图像中人脸五官轮廓形状、人脸五官位置、人脸皮肤颜色、人脸皮肤纹理,Identifying a facial features, a facial features, a facial skin color, and a facial skin texture in the target image, 当所述目标图像中至少存在人脸皮肤颜色、人脸皮肤纹理时,确定所述目标图像中包含人脸。When there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a face. 如权利要求1所述的方法,其特征在于,The method of claim 1 wherein 还包括,Also includes, 当所述智能终端感应到所述智能终端与人体之间的距离小于或者等于所述预设距离时,生成一停止告警指令,When the smart terminal senses that the distance between the smart terminal and the human body is less than or equal to the preset distance, generating a stop alarm instruction, 根据所述停止告警指令,控制所述智能终端停止发送所述告警信号。And controlling, according to the stop alarm instruction, the smart terminal to stop sending the alarm signal. 如权利要求1所述的方法,其特征在于,The method of claim 1 wherein 所述告警信号包括,声音信号、闪光信号或者振动信号。The alarm signal includes a sound signal, a flash signal, or a vibration signal. 一种智能终端的通话提醒系统,其特征在于,包括以下模块,A call reminding system for an intelligent terminal, comprising the following modules, 启动模块,捕获一操作指令,根据所述操作指令启动通话提醒系统; Starting a module, capturing an operation instruction, and starting a call reminding system according to the operation instruction; 测距模块,感应所述智能终端与人脸之间的距离;a ranging module that senses a distance between the smart terminal and a human face; 电流监测模块,监测所述智能终端听筒中的电流强度,当所述听筒的电流强度大于一预设电流强度时,生成一告警指令,a current monitoring module monitors a current intensity in the earpiece of the smart terminal, and generates an alarm command when the current intensity of the earpiece is greater than a preset current intensity, 告警模块,根据所述告警指令,控制所述智能终端发出一告警信号The alarm module controls the smart terminal to send an alarm signal according to the alarm instruction. 如权利要求6所述的通过提醒系统,其特征在于,A pass reminder system according to claim 6, wherein 所述测距模块包括,The ranging module includes 摄像单元,捕获一包括所述智能终端屏幕所面向的景象的目标图像,a camera unit that captures a target image including a scene facing the screen of the smart terminal, 人脸追踪单元,追踪所述目标图像中的人脸信息,a face tracking unit that tracks face information in the target image, 测距单元,测量所述智能终端与人脸之间的距离,其中,当所述目标图像中没有人脸信息时,设定所述距离为无穷大。The ranging unit measures a distance between the smart terminal and a human face, wherein when the target image has no face information, the distance is set to infinity. 如权利要求7所述的通过提醒系统,其特征在于,A pass reminder system according to claim 7, wherein 所述人脸追踪单元包括,The face tracking unit includes 人脸识别单元,识别所述目标图像中人脸五官轮廓形状、人脸五官位置、人脸皮肤颜色、人脸皮肤纹理,a face recognition unit that recognizes a facial features, a facial features, a facial skin color, and a facial skin texture in the target image, 其中,当所述目标图像中至少存在人脸皮肤颜色、人脸皮肤纹理时,确定所述目标图像中包含人脸。Wherein, when there is at least a face skin color and a face skin texture in the target image, it is determined that the target image includes a human face. 如权利要求6所述的通过提醒系统,其特征在于,A pass reminder system according to claim 6, wherein 还包括,Also includes, 一指令模块,当所述智能终端感应到所述智能终端与人体之间的距离小于或者等于所述预设距离时,生成一停止告警指令,An instruction module, when the smart terminal senses that the distance between the smart terminal and the human body is less than or equal to the preset distance, generating a stop alarm instruction, 一告警控制模块,根据所述停止告警指令,所述智能终端停止发送所述告警信号。An alarm control module stops the sending of the alarm signal according to the stop alarm command. 如权利要求6所述的通过提醒系统,其特征在于,A pass reminder system according to claim 6, wherein 所述告警模块包括,The alarm module includes 音频单元,根据所述告警指令,播放音频信号,An audio unit that plays an audio signal according to the alarm instruction, 灯光单元,根据所述告警指令,发出闪光信号,或a lighting unit that emits a flash signal according to the warning command, or 振动单元,根据所述告警指令,发出振动信号。 The vibration unit emits a vibration signal according to the alarm command.
PCT/CN2017/101758 2017-09-14 2017-09-14 Call reminding method and call reminding system for intelligent terminal Ceased WO2019051725A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/101758 WO2019051725A1 (en) 2017-09-14 2017-09-14 Call reminding method and call reminding system for intelligent terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/101758 WO2019051725A1 (en) 2017-09-14 2017-09-14 Call reminding method and call reminding system for intelligent terminal

Publications (1)

Publication Number Publication Date
WO2019051725A1 true WO2019051725A1 (en) 2019-03-21

Family

ID=65722218

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/101758 Ceased WO2019051725A1 (en) 2017-09-14 2017-09-14 Call reminding method and call reminding system for intelligent terminal

Country Status (1)

Country Link
WO (1) WO2019051725A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102780815A (en) * 2012-06-29 2012-11-14 宇龙计算机通信科技(深圳)有限公司 Method for hanging up call automatically and communication terminal
US8619965B1 (en) * 2010-05-07 2013-12-31 Abraham & Son On-hold processing for telephonic systems
CN103795873A (en) * 2014-02-17 2014-05-14 宇龙计算机通信科技(深圳)有限公司 Method and device for reminding users of responses according to phone call state
CN105100484A (en) * 2015-07-31 2015-11-25 小米科技有限责任公司 Method, device and system for ending voice call
CN106527101A (en) * 2016-10-28 2017-03-22 努比亚技术有限公司 Smart watch, content display method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8619965B1 (en) * 2010-05-07 2013-12-31 Abraham & Son On-hold processing for telephonic systems
CN102780815A (en) * 2012-06-29 2012-11-14 宇龙计算机通信科技(深圳)有限公司 Method for hanging up call automatically and communication terminal
CN103795873A (en) * 2014-02-17 2014-05-14 宇龙计算机通信科技(深圳)有限公司 Method and device for reminding users of responses according to phone call state
CN105100484A (en) * 2015-07-31 2015-11-25 小米科技有限责任公司 Method, device and system for ending voice call
CN106527101A (en) * 2016-10-28 2017-03-22 努比亚技术有限公司 Smart watch, content display method and device

Similar Documents

Publication Publication Date Title
KR102667645B1 (en) Apparatus and method for providing a notification by interworking a plurality of electronic devices
JP6446142B2 (en) Safety attention processing method, apparatus, program, and recording medium
TW201923737A (en) Interactive Method and Device
CN106534541A (en) Volume adjusting method and device and terminal equipment
US20210289290A1 (en) Sound reproduction device and sound reproduction system
CN109145679A (en) A kind of method, apparatus and system issuing warning information
KR20170048236A (en) Method for reminding and device thereof
CN108763978A (en) Information cuing method, device, terminal, earphone and readable storage medium storing program for executing
WO2017020507A1 (en) Method and device for acquiring sound of surveillance frame
CN113138557A (en) Household equipment control method and device and storage medium
CN106406175B (en) Door opening reminder method and device
WO2024163278A1 (en) Methods and apparatus for motion detection
US20250355613A1 (en) Speaker control based on signal source
US11095473B2 (en) Doorbell prompting control method, device and storage medium
CN109243447A (en) Voice sends triggering method and device
CN109543666A (en) Structure light assembly control method and device
CN106772390B (en) Device and method for distance detection
WO2019051725A1 (en) Call reminding method and call reminding system for intelligent terminal
CN114639383A (en) Device wake-up method, apparatus, electronic device and medium
CN111127846A (en) Door-knocking reminding method, door-knocking reminding device and electronic equipment
CN105635378A (en) Call quality adjusting method, device and mobile terminal
US9613509B2 (en) Mobile electronic device and method for crime prevention
TW201426569A (en) Electronic device and method of adjusting specific parameters thereof
CN110751771A (en) Door body abnormity warning method and related product
CN205610703U (en) Take focus mobile terminal of camera of laser

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17925001

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17925001

Country of ref document: EP

Kind code of ref document: A1