CN111736688A - Bluetooth headset, system and method for gesture recognition thereof - Google Patents
Bluetooth headset, system and method for gesture recognition thereof Download PDFInfo
- Publication number
- CN111736688A CN111736688A CN202010125303.1A CN202010125303A CN111736688A CN 111736688 A CN111736688 A CN 111736688A CN 202010125303 A CN202010125303 A CN 202010125303A CN 111736688 A CN111736688 A CN 111736688A
- Authority
- CN
- China
- Prior art keywords
- gesture
- preset
- radar device
- hand
- bluetooth
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B5/00—Near-field transmission systems, e.g. inductive or capacitive transmission systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. Transmission Power Control [TPC] or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
- Headphones And Earphones (AREA)
Abstract
本发明公开了蓝牙耳机、系统及其手势识别的方法。该一种蓝牙耳机,包括雷达装置和耳机处理器,所述雷达装置用于检测手的手势、以及所述手相对于所述雷达装置的位置;所述耳机处理器用于判断所述雷达装置检测到的第一手势是否为第一预设手势、所述手所在的位置是否在第一预设位置范围内、且所述手停留在其所在位置的时长和所述手保持所述第一预设手势持续的时长是否在预设时长范围内,若均为是,则继续判断所述雷达装置随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则将所述第二手势解析为与所述第二预设手势对应的指令;其中,所述第一预设手势与第二预设手势不同。本发明可以降低雷达误触发手势操作的几率,提升用户体验。
The invention discloses a bluetooth headset, a system and a gesture recognition method thereof. The bluetooth headset includes a radar device and a headset processor, the radar device is used to detect hand gestures and the position of the hand relative to the radar device; the headset processor is used to determine whether the radar device has detected Whether the first gesture is the first preset gesture, whether the position of the hand is within the range of the first preset position, and the duration of the hand staying at its position and the hand holding the first preset Whether the duration of the gesture is within the range of the preset duration, if both are yes, continue to judge whether the second gesture detected by the radar device is the second preset gesture, if it is the second preset gesture, then The second gesture is parsed into an instruction corresponding to the second preset gesture; wherein the first preset gesture is different from the second preset gesture. The present invention can reduce the probability that the radar triggers the gesture operation by mistake, and improve the user experience.
Description
技术领域technical field
本发明涉及蓝牙通信领域,尤其涉及蓝牙耳机、系统及其手势识别的方法。The invention relates to the field of bluetooth communication, in particular to a bluetooth headset, a system and a gesture recognition method thereof.
背景技术Background technique
随着真无线(TWS)蓝牙耳机的技术越来越成熟,用户对蓝牙耳机的体验要求越来越高,蓝牙耳机的功能也越来越丰富,目前出现了利用雷达进行手势操作的耳机。As the technology of true wireless (TWS) Bluetooth headsets becomes more and more mature, users have higher and higher requirements for the experience of Bluetooth headsets, and the functions of Bluetooth headsets become more and more abundant. At present, there are headsets that use radar for gesture operation.
公开号为CN110018471A的专利文献公开了多功能雷达系统及其操作方法和耳机装置,其中,蓝牙耳机内设置雷达系统,雷达系统可以识别用户的手势,并将该手势解析为对应的指令,从而实现相应的功能操作,例如播放音频、暂停音频、接听电话等操作。该雷达系统可以采用二维毫米波(MMV)相位阵列雷达,该雷达发射和接收50GHz至80GHz范围内的信号。The patent document with publication number CN110018471A discloses a multi-function radar system, an operation method thereof, and a headset device, wherein a radar system is set in the Bluetooth headset, and the radar system can recognize the user's gesture and parse the gesture into a corresponding command, thereby realizing Corresponding functional operations, such as playing audio, pausing audio, answering calls, etc. The radar system can employ a two-dimensional millimeter wave (MMV) phased array radar that transmits and receives signals in the 50GHz to 80GHz range.
然而在上述现有技术中,为了实现蓝牙耳机多种功能操作,需要设置对应的多种手势,这样,用户无意中做出与控制操作对应手势的几率大大增加,从而增加了用户误触发蓝牙耳机进行手势操作的几率,极大影响了用户体验。However, in the above-mentioned prior art, in order to realize multiple functional operations of the Bluetooth headset, it is necessary to set corresponding multiple gestures. In this way, the probability of the user making a gesture corresponding to the control operation inadvertently increases greatly, thereby increasing the user's false triggering of the Bluetooth headset. The probability of performing gesture operations greatly affects the user experience.
发明内容SUMMARY OF THE INVENTION
为了解决现有蓝牙耳机的雷达容易误触发手势操作的缺陷,本发明提供了蓝牙耳机、系统及其手势识别的方法,以降低雷达误触发手势操作的几率,提升用户体验。In order to solve the defect that the radar of the existing bluetooth earphone is easy to trigger the gesture operation by mistake, the present invention provides a bluetooth earphone, a system and a gesture recognition method thereof, so as to reduce the probability of the radar falsely triggering the gesture operation and improve the user experience.
一种蓝牙耳机,包括雷达装置和耳机处理器,所述雷达装置用于检测手的手势、以及所述手相对于所述雷达装置的位置;所述耳机处理器用于判断所述雷达装置检测到的第一手势是否为第一预设手势、所述手所在的位置是否在第一预设位置范围内、且所述手停留在其所在位置的时长和所述手保持所述第一预设手势持续的时长是否大于第一预设时长且小于第二预设时长,若均为是,则继续判断所述雷达装置随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则将所述第二手势解析为与所述第二预设手势对应的指令;其中,所述第一预设手势与第二预设手势不同。A bluetooth headset, comprising a radar device and a headset processor, the radar device is used for detecting hand gestures and the position of the hand relative to the radar device; the headset processor is used for judging the detection of the radar device. Whether the first gesture is the first preset gesture, whether the position of the hand is within the range of the first preset position, and the duration of the hand staying at its position and the hand holding the first preset gesture Whether the continuous duration is greater than the first preset duration and less than the second preset duration, if both are yes, continue to determine whether the second gesture detected by the radar device is the second preset gesture, and if it is the second preset gesture. If a gesture is set, the second gesture is parsed into an instruction corresponding to the second preset gesture; wherein the first preset gesture is different from the second preset gesture.
优选的,所述耳机处理器还用于在判断出所述第二手势为第二预设手势后判断所述第二手势所在的位置是否在第二预设位置范围内,若是,才将所述第二手势解析为与所述第二预设手势对应的指令;其中,所述第二预设位置范围包含且大于所述第一预设位置范围。Preferably, the earphone processor is further configured to determine whether the position of the second gesture is within the range of the second preset position after determining that the second gesture is the second preset gesture, and if so, only Parsing the second gesture into an instruction corresponding to the second preset gesture; wherein the second preset position range includes and is greater than the first preset position range.
优选的,所述蓝牙耳机还包括电声换能器,所述耳机处理器还用于通过所述电声换能器发出与所述指令对应的语音提示。Preferably, the Bluetooth headset further includes an electro-acoustic transducer, and the headset processor is further configured to issue a voice prompt corresponding to the instruction through the electro-acoustic transducer.
优选的,所述第一预设手势的数量小于所述第二预设手势的数量。Preferably, the number of the first preset gestures is smaller than the number of the second preset gestures.
优选的,所述第一预设手势的数量为一。Preferably, the number of the first preset gesture is one.
优选的,所述第一预设手势比所述第二预设手势更加复杂。Preferably, the first preset gesture is more complex than the second preset gesture.
优选的,所述第一预设手势为手掌伸开且五指并拢。Preferably, the first preset gesture is to stretch out the palm and put the five fingers together.
优选的,所述第二预设手势包括:手掌伸开而拇指张开、且其余四指并拢;或者,保持手掌伸开而拇指张开、且其余四指并拢,手掌朝远离或靠近所述蓝牙耳机方向平移;或者,保持手掌伸开而拇指张开、且其余四指并拢,手掌在设定方向旋转;或者,保持手掌伸开且五指张开;或者,保持手掌伸开且五指张开,手掌朝设定方向旋转后再旋转回初始位置附近。Preferably, the second preset gesture includes: the palm is extended, the thumb is open, and the remaining four fingers are closed; Translate the direction of the Bluetooth headset; or, keep the palm open and the thumb open, and the other four fingers together, and the palm rotates in the set direction; or, keep the palm open and the five fingers open; or, keep the palm open and the five fingers open , rotate the palm in the set direction, and then rotate it back to the original position.
本发明还提供了一种蓝牙系统,包括蓝牙耳机和移动设备,所述蓝牙耳机包括雷达装置、耳机处理器和蓝牙通讯模块,所述雷达装置用于检测手的手势、以及所述手相对于雷达装置的位置;所述耳机处理器用于判断所述雷达装置检测到的第一手势是否为第一预设手势、所述位置是否在第一预设位置范围内、且所述手停留在其所在位置的时长和所述手保持所述第一预设手势持续的时长是否大于第一预设时长且小于第二预设时长,若均为是,则继续判断所述雷达装置随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则将所述第二手势解析为与所述第二预设手势对应的指令;所述蓝牙通讯模块用于将所述指令发送给移动设备;所述移动设备用于接收所述指令,并根据所述指令执行相应操作。The present invention also provides a bluetooth system, including a bluetooth headset and a mobile device, the bluetooth headset includes a radar device, a headset processor and a bluetooth communication module, the radar device is used to detect hand gestures, and the relative position of the hand to the radar The position of the device; the earphone processor is used to determine whether the first gesture detected by the radar device is a first preset gesture, whether the position is within the range of the first preset position, and the hand stays where it is Whether the duration of the position and the duration of the hand holding the first preset gesture is greater than the first preset duration and less than the second preset duration, if both are, continue to judge the first detected by the radar device. Whether the second gesture is the second preset gesture, if it is the second preset gesture, parse the second gesture into an instruction corresponding to the second preset gesture; the Bluetooth communication module is used to The instruction is sent to the mobile device; the mobile device is configured to receive the instruction and perform corresponding operations according to the instruction.
优选的,所述耳机处理器还用于在判断出所述第二手势为第二预设手势后判断所述第二手势所在的位置是否在第二预设位置范围内,若是,才将所述第二手势解析为与所述第二预设手势对应的指令;其中,所述第二预设位置范围包含且大于所述第一预设位置范围。Preferably, the earphone processor is further configured to determine whether the position of the second gesture is within the range of the second preset position after determining that the second gesture is the second preset gesture, and if so, only Parsing the second gesture into an instruction corresponding to the second preset gesture; wherein the second preset position range includes and is greater than the first preset position range.
优选的,所述蓝牙耳机还包括电声换能器,所述耳机处理器还用于通过所述电声换能器发出与所述指令对应的语音提示。Preferably, the Bluetooth headset further includes an electro-acoustic transducer, and the headset processor is further configured to issue a voice prompt corresponding to the instruction through the electro-acoustic transducer.
本发明还提供了一种蓝牙耳机手势识别的方法,其中,所述蓝牙耳机包括雷达装置和耳机处理器,所述方法包括如下步骤:所述耳机处理器判断所述雷达装置检测到的第一手势是否为第一预设手势、所述手所在的位置是否在第一预设位置范围内、且所述手停留在其所在位置的时长和所述手保持所述第一预设手势持续的时长是否大于第一预设时长且小于第二预设时长,若均为是,则继续判断所述雷达装置随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则将所述第二手势解析为与所述第二预设手势对应的指令;其中,所述第一预设手势与第二预设手势不同。The present invention also provides a method for gesture recognition of a Bluetooth headset, wherein the Bluetooth headset includes a radar device and a headset processor, and the method includes the following steps: the headset processor determines the first Whether the gesture is the first preset gesture, whether the position of the hand is within the range of the first preset position, and the duration of the hand staying at its position and the duration of the hand holding the first preset gesture Whether the duration is greater than the first preset duration and less than the second preset duration, if both are yes, continue to determine whether the second gesture detected by the radar device subsequently is the second preset gesture, if it is the second preset gesture , the second gesture is parsed into an instruction corresponding to the second preset gesture; wherein the first preset gesture is different from the second preset gesture.
优选的,所述耳机处理器还在判断出所述第二手势为第二预设手势后判断所述第二手势所在的位置是否在第二预设位置范围内,若是,才将所述第二手势解析为与所述第二预设手势对应的指令;其中,所述第二预设位置范围包含且大于所述第一预设位置范围。Preferably, after determining that the second gesture is a second preset gesture, the earphone processor further determines whether the position where the second gesture is located is within the second preset position range, and if so, only The second gesture is parsed as an instruction corresponding to the second preset gesture; wherein, the second preset position range includes and is greater than the first preset position range.
优选的,所述蓝牙耳机还包括电声换能器,其特征是,所述方法还包括如下步骤:所述耳机处理器还用于通过所述电声换能器发出与所述指令对应的语音提示。Preferably, the bluetooth headset further includes an electro-acoustic transducer, and it is characterized in that the method further includes the following steps: the headset processor is further configured to send out, through the electro-acoustic transducer, an audio signal corresponding to the instruction Voice prompts.
本发明还提供了一种蓝牙系统的手势识别的方法,其中,所述蓝牙系统包括蓝牙耳机和移动设备,所述蓝牙耳机包括雷达装置、耳机处理器和蓝牙通讯模块,所述方法包括如下步骤:所述雷达装置检测手的手势、以及所述手相对于所述雷达装置的位置;所述耳机处理器判断所述雷达装置检测到的第一手势是否为第一预设手势、所述手所在的位置是否在第一预设位置范围内、且所述手停留在其所在位置的时长和所述手保持所述第一预设手势持续的时长是否大于第一预设时长且小于第二预设时长,若均为是,则继续判断所述雷达装置随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则将所述第二手势解析为与所述第二预设手势对应的指令;其中,所述第一预设手势与第二预设手势不同;所述蓝牙通讯模块将所述指令发送给移动设备;所述移动设备接收所述指令,并根据所述指令执行相应操作。The present invention also provides a gesture recognition method for a Bluetooth system, wherein the Bluetooth system includes a Bluetooth headset and a mobile device, the Bluetooth headset includes a radar device, a headset processor and a Bluetooth communication module, and the method includes the following steps : the radar device detects the gesture of the hand and the position of the hand relative to the radar device; the earphone processor determines whether the first gesture detected by the radar device is the first preset gesture, the position of the hand Whether the position of the hand is within the range of the first preset position, and whether the duration of the hand staying at its position and the duration of the hand holding the first preset gesture are greater than the first preset duration and less than the second preset duration. Set the duration, if both are yes, continue to judge whether the second gesture detected by the radar device is the second preset gesture, if it is the second preset gesture, then parse the second gesture as the same as the second gesture. The instruction corresponding to the second preset gesture; wherein, the first preset gesture is different from the second preset gesture; the Bluetooth communication module sends the instruction to the mobile device; the mobile device receives the instruction, and perform corresponding operations according to the instructions.
有益效果:Beneficial effects:
通过上述方案,可以有效降低雷达装置被手误触发而进行手势识别的几率,提升了用户体验。具体而言,当手位于该第一预设位置范围才有可能触发手势识别,这样可以有效排除用户在该第一预设位置范围之外无意的动作;当手势为第一预设手势时才有可能触发手势识别,这样可以有效排除用户该第一预设手势外无意的手势动作;当手势保持该第一预设手势持续的时长大于第一预设时长且小于第二预设时长,可以排除在该预设时长范围之外的手势误触发,例如用户无意中将手放置在耳机旁边并长时间(大于该预设时长)保持某个操作手势,或者无意中手从蓝牙耳机的雷达装置前面划过(时间小于该预设时长)。Through the above solution, the probability of gesture recognition by the radar device being triggered by hand by mistake can be effectively reduced, and the user experience is improved. Specifically, it is possible to trigger gesture recognition when the hand is located in the first preset position range, which can effectively exclude unintentional actions of the user outside the first preset position range; only when the gesture is the first preset position It is possible to trigger gesture recognition, which can effectively exclude the user's unintentional gesture actions of the first preset gesture; when the gesture keeps the first preset gesture for a duration longer than the first preset duration and less than the second preset duration, you can Gestures outside the preset duration range are triggered by mistake, for example, the user inadvertently places his hand next to the headset and maintains a certain operation gesture for a long time (greater than the preset duration), or inadvertently removes his hand from the radar device of the Bluetooth headset Swipe in front (the time is less than the preset duration).
优选的,为了实现较多的功能操作,需设置数量较多的第二预设手势,而通过设置数量远小于第二预设手势的第一预设手势,以进一步降低误触发雷达装置101进行手势识别的几率。当第一预设手势的数量有且仅有一个,可以以最大限度降低误触发雷达装置的几率。Preferably, in order to achieve more functional operations, a larger number of second preset gestures need to be set, and by setting the number of first preset gestures far smaller than the number of the second preset gestures, to further reduce the false triggering of the
优选的,第一预设手势比第二预设手势更加复杂,例如与第二预设手势相比,第一预设手势需要更多的手指参与弯折动作,或者需要更多的手指参与弯折动作、并且至少两个手指朝不同方向弯折,等等。通过将第一预设手势设置为比第二预设手势更加复杂,从而使得雷达装置更难被用户无意的手势误触发。Preferably, the first preset gesture is more complex than the second preset gesture. For example, compared with the second preset gesture, the first preset gesture requires more fingers to participate in the bending action, or requires more fingers to participate in the bending action. folding motion, and at least two fingers are bent in different directions, and so on. By setting the first preset gesture to be more complicated than the second preset gesture, it is more difficult for the radar device to be falsely triggered by the user's unintentional gesture.
优选的,采用毫米波雷达装置功耗很低,在实现手势识别的同时,可以最大限度地节省蓝牙耳机的电量,这对蓝牙耳机有限的电量而言意义很大。另外,又因为蓝牙耳机及蓝牙芯片自身是射频电路结构,毫米波雷达能够与蓝牙射频共用较多的功能电路。Preferably, the power consumption of the millimeter-wave radar device is very low, and the power of the Bluetooth headset can be saved to the maximum while the gesture recognition is realized, which is of great significance for the limited power of the Bluetooth headset. In addition, because the Bluetooth headset and the Bluetooth chip themselves are radio frequency circuit structures, the millimeter-wave radar can share more functional circuits with the Bluetooth radio frequency.
附图说明Description of drawings
图1为本发明蓝牙系统一种实施例的示意图;1 is a schematic diagram of an embodiment of a Bluetooth system of the present invention;
图2为本发明蓝牙耳机一种实施例的示意图;2 is a schematic diagram of an embodiment of a Bluetooth headset of the present invention;
图3为本发明蓝牙耳机的应用示意图;3 is a schematic diagram of the application of the Bluetooth headset of the present invention;
图4为第二预设手势中对应音量控制指令手势一种实施例的示意图;4 is a schematic diagram of an embodiment of a gesture corresponding to a volume control instruction in a second preset gesture;
图5为第二预设手势中对应音量控制手势另一种实施例的示意图;5 is a schematic diagram of another embodiment of the corresponding volume control gesture in the second preset gesture;
图6为第二预设手势中对应歌曲切换指令手势一种实施例的示意图;6 is a schematic diagram of an embodiment of the corresponding song switching instruction gesture in the second preset gesture;
图7为本发明蓝牙耳机更加详细实施例的示意图;7 is a schematic diagram of a more detailed embodiment of the Bluetooth headset of the present invention;
图8为本发明蓝牙系统数据交互示意图。FIG. 8 is a schematic diagram of data interaction in the Bluetooth system of the present invention.
具体实施方式Detailed ways
为了对本发明的技术方案进行更详细的说明,以促进对本发明的进一步理解,下面结合附图描述本发明的具体实施方式。但应当理解,所有示意性实施例及其说明用于解释本发明,并不构成对本发明的唯一限定。In order to describe the technical solutions of the present invention in more detail and to facilitate further understanding of the present invention, the specific embodiments of the present invention are described below with reference to the accompanying drawings. However, it should be understood that all the exemplary embodiments and their descriptions are used to explain the present invention and do not constitute the only limitation of the present invention.
图1是本发明蓝牙系统一种实施例的示意图,该蓝牙系统包括蓝牙耳机10和移动设备30,其中蓝牙耳机10佩戴于人的耳朵,可以接收来自移动设备30发送的音频数据和控制指令,移动设备30可以是具有蓝牙通讯模块的智能手机。图2是本发明蓝牙耳机一种实施例的示意图,该蓝牙耳机10包括:雷达装置101、耳机处理器102、蓝牙通讯模块103、电源模块104和电声换能器105,电源模块104用于对雷达装置101、耳机处理器102、蓝牙通讯模块103和电声换能器105进行供电,电声换能器105用于将耳机处理器102发送的音频数据转换为声音。1 is a schematic diagram of an embodiment of the Bluetooth system of the present invention. The Bluetooth system includes a
雷达装置101可以是毫米波雷达装置,其发射的电磁波是一个锥状的波束,该电磁波的波长在1-10mm之间、频率在20-100Ghz之间。毫米波雷达装置带宽大、分辨率高、天线部件尺寸小,能适应恶劣环境。毫米波雷达装置结构简单成本较低,适合近距离探测的FMCW(调频连续波)雷达调制。The
雷达装置101用于检测用户手20的手势、以及手20相对于雷达装置101的位置;耳机处理器102用于判断雷达装置101检测到的第一手势是否为第一预设手势、手20所在的位置是否在第一预设位置范围内、且手20停留在手20所在位置的时长手20保持第一预设手势持续的时长是否大于第一预设时长且小于第二预设时长(即在预设时长范围内),若均为是(即满足上述三个条件),蓝牙耳机10进入了一种可以称之为手势操作的状态,耳机处理器102继续判断雷达装置101随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则耳机处理器102将第二手势解析为与第二预设手势对应的指令。该指令可以是由蓝牙耳机10执行的指令,也可以是发送给移动设备30执行的指令。在该指令是由移动设备30执行的指令的情况下,蓝牙通讯模块103将相关指令发送给移动设备30。移动设备30接收指令,并根据指令执行相应操作;其中,第一预设手势与第二预设手势不同。The
通过上述方案,可以有效降低雷达装置101被手20误触发而进行手势识别的几率。具体而言,当手20所在的位置在该第一预设位置范围才有可能触发手势识别,这样可以有效排除用户在该第一预设位置范围之外无意的动作;当手势为第一预设手势时才有可能触发手势识别,这样可以有效排除用户该第一预设手势外无意的手势动作;当手停留在其所在位置的时长和手势保持该第一预设手势持续的时长在预设时长范围内,才有可能触发手势识别,这样可以排除保持时长在该预设时长范围之外的手势的误触发,以及手停留在其所在位置的时长在该预设时长范围之外的手势的误触发,例如用户无意中将手20放置在耳机旁边并长时间保持某个操作手势(即大于第二预设时长),或者无意中手20从蓝牙耳机10的雷达装置101前面划过(即手停留在所在位置的时长小于第一该预设时长)。Through the above solution, the probability that the
为了实现较多的功能操作,需设置数量较多的第二预设手势,而通过设置数量远小于第二预设手势的第一预设手势,以进一步降低误触发雷达装置101进行手势识别的几率。在一些实施例中,第一预设手势的数量有且仅有一个,以最大限度降低误触发雷达装置101的几率。In order to realize more functional operations, a larger number of second preset gestures need to be set, and by setting the number of first preset gestures far smaller than the number of second preset gestures, it is possible to further reduce the risk of erroneously triggering the
在开始进行手势识别之前,可以对蓝牙耳机10进行手势识别训练,以提高蓝牙耳机10识别手势的准确度。例如,在移动设备30与蓝牙耳机10建立蓝牙通讯之后,在移动设备30界面上选择手势识别训练界面,并选择预设手势“手掌伸开且五指并拢”,移动设备30将该预设手势“手掌伸开且五指并拢”发送给蓝牙耳机10,然后用户做出对应的手势“手掌伸开且五指并拢”以让蓝牙耳机10进行识别训练,直至蓝牙耳机10能够对该手势准确识别。Before starting to perform gesture recognition, gesture recognition training can be performed on the
图3是本发明蓝牙耳机的应用示意图,如图3所示,上述第一预设手势可以为手掌伸开且五指并拢;第一预设位置范围可以为:在雷达装置101的电磁波发射方向上至雷达装置101的设定距离(X1)范围内,例如在5cm-15cm之间;上述预设时长范围可以根据具体应用进行设定,例如1-5秒之间,更优的在1-3秒之间等。FIG. 3 is a schematic diagram of the application of the Bluetooth headset of the present invention. As shown in FIG. 3 , the above-mentioned first preset gesture can be extending the palm and putting the five fingers together; the first preset position range can be: in the electromagnetic wave emission direction of the
在一些实施例中,当蓝牙耳机10进入手势操作状态之后,在判断出雷达装置101识别出的第二手势为第二预设手势后,判断所述第二手势所在的位置是否在第二预设位置范围内,若在第二预设位置范围内,才将所述第二手势解析为与第二预设手势对应的指令。当蓝牙耳机10进入手势操作状态之后,雷达装置101识别的手势位置范围可以变化为第二预设位置范围,即在雷达装置101的电磁波发射方向上至雷达装置101的设定距离X2范围内,该第二预设位置范围包含且大于上述第一预设位置而,从而用户可以更自由、舒适地进行手势操作。例如,进入手势操作状态之后,雷达装置101可以识别距离0-30cm的手势,而用于触发是否进入手势操作状态的第一预设位置范围则为5-15cm。In some embodiments, after the
第二预设手势包括多个手势,每个手势对应着相应的指令,例如控制蓝牙耳机音量、提示进入控制音量状态、切换播放歌曲至下一首、提示进入歌曲切换状态等。The second preset gesture includes a plurality of gestures, and each gesture corresponds to a corresponding instruction, such as controlling the volume of the Bluetooth headset, prompting to enter the volume control state, switching the playing song to the next song, prompting to enter the song switching state, and the like.
图4是第二预设手势中对应音量控制指令手势一种实施例的示意图,保持手掌伸开而拇指张开、且其余四指并拢,对应的指令为:耳机处理器102发送提示音频数据到电声换能器105,例如“进入音量控制状态”,这样,电声换能器105将该音频数据转换为提示音以提示用户。保持手掌伸开而拇指张开、且其余四指并拢,手掌往远离蓝牙耳机10方向平移,对应的指令为:控制音量增加;在优选的实施例中,当拇指合并,对应的指令为:耳机处理器102发送“音量调整结束”音频数据到电声换能器105,这样,电声换能器105将该音频数据转换为提示音以提示用户。保持手掌伸开而拇指张开、且其余四指并拢,手掌朝蓝牙耳机10平移靠近,对应的指令为:控制音量减小。4 is a schematic diagram of an embodiment of the gesture corresponding to the volume control instruction in the second preset gesture, keeping the palm open, the thumb open, and the remaining four fingers close together, the corresponding instruction is: the
图5是第二预设手势中对应音量控制手势另一种实施例的示意图,保持手掌伸开而拇指张开、其余四指并拢且手掌面向蓝牙耳机,对应的指令为:耳机处理器102发送提示音频数据到电声换能器105,例如“进入音量控制状态”。保持手掌伸开而拇指张开、其余四指并拢且手掌面向蓝牙耳机,手掌缓慢向蓝牙耳机10方向旋转,对应的指令为:控制音量增加。保持手掌伸开而拇指张开、且其余四指并拢,手掌缓慢向远离蓝牙耳机10方向旋转,对应的指令为:控制音量减小。5 is a schematic diagram of another embodiment of the corresponding volume control gesture in the second preset gesture, keeping the palm open and the thumb open, the remaining four fingers together and the palm facing the Bluetooth headset, the corresponding command is: the
图6是第二预设手势中对应歌曲切换指令手势一种实施例的示意图,保持手掌伸开且五指张开,对应的指令为:耳机处理器102发送提示“进入歌曲切换状态”音频数据到电声换能器105,这样,电声换能器105将该音频数据转换为提示音以提示用户。保持手掌伸开且五指张开,快速往蓝牙耳机10方向旋转30°-50°之间后,快速往回旋转回到初始位置附近(例如偏离初始位置正负5°内的位置范围),其对应的指令为:切换播放歌曲至下一首。保持手掌伸开且五指张开,快速往远离蓝牙耳机10方向旋转30°-50°之间后,快速往回旋转回到初始位置附近(偏离初始位置正负5°内的位置范围),其对应的指令为:切换播放歌曲至上一首。当拇指合并,对应的指令为:耳机处理器102发送提示“歌曲切换结束”音频数据到电声换能器105,这样,电声换能器105将该音频数据转换为提示音以提示用户。6 is a schematic diagram of an embodiment of the gesture corresponding to the song switching instruction in the second preset gesture, keeping the palm open and the five fingers open, the corresponding instruction is: the
图7是本发明蓝牙耳机更加详细实施例的示意图,其中,雷达装置101包括雷达处理器1011(例如雷达处理芯片)、雷达电路1012、发射天线1013和接收天线1014。雷达处理器1011发射天线1013用于发射指向性的电磁波;当该电磁波遇到用户的手20后被反射至接收天线1014而被接收,电磁波经过雷达电路1012处理后输出与手势相应信息给雷达处理器1012,雷达处理器1012处理这些信息则可以计算出对应的手势。7 is a schematic diagram of a more detailed embodiment of the Bluetooth headset of the present invention, wherein the
图8是本发明蓝牙系统数据交互示意图,移动设备30与蓝牙耳机10建立蓝牙通讯后,移动设备30通过蓝牙通讯模块103将数据包(如数据包1、数据包2等)发送给蓝牙耳机10,当蓝牙耳机10收到数据包后,向移动设备30返回确认包(ACK包),该ACK包可以包含上述指令。当移动设备30接收到该ACK包,并解析出该指令后,进行相应操作,例如在接收到切换歌曲指令后,执行相应操作,然后发送新的数据给蓝牙耳机10。8 is a schematic diagram of data interaction in the Bluetooth system of the present invention. After the
本发明还提供了上述蓝牙耳机手势识别的方法,包括如下步骤:The present invention also provides the above-mentioned method for gesture recognition of the Bluetooth headset, comprising the following steps:
S10、雷达装置101检测手20的手势、以及手20相对于雷达装置101的位置;S10, the
S11、耳机处理器102用于判断雷达装置101检测到的第一手势是否为第一预设手势、手所在的位置是否在第一预设位置范围内、且手停留在其所在位置的时长和手保持第一预设手势持续的时长是否大于第一预设时长且小于第二预设时长,若均为是,则继续判断雷达装置101随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则将第二手势解析为与第二预设手势对应的指令;其中,第一预设手势与第二预设手势不同。S11. The
本发明还提供了上述蓝牙系统的手势识别的方法,包括如下步骤:The present invention also provides a method for gesture recognition of the above-mentioned Bluetooth system, comprising the following steps:
S20、雷达装置101检测手20的手势、以及手20相对于雷达装置101的位置;耳机处理器102用于判断雷达装置101检测到的第一手势是否为第一预设手势、手所在的位置是否在第一预设位置范围内、且手停留在其所在位置的时长和手保持第一预设手势持续的时长是否大于第一预设时长且小于第二预设时长,若均为是,则继续判断雷达装置101随后检测到的第二手势是否为第二预设手势,若是第二预设手势,则将第二手势解析为与第二预设手势对应的指令;其中,第一预设手势与第二预设手势不同。蓝牙通讯模块103将指令发送给移动设备30;S20, the
S21、移动设备30接收指令,并根据指令执行相应操作。S21. The
本领域的技术人员能够理解的是,在不冲突的前提下,上述各优选方案可以自由地组合、叠加。Those skilled in the art can understand that, under the premise of no conflict, the above preferred solutions can be freely combined and superimposed.
应当理解,上述的实施方式仅是示例性的,而非限制性的,在不偏离本发明的基本原理的情况下,本领域的技术人员可以针对上述细节做出的各种明显的或等同的修改或替换,都将包含于本发明的权利要求范围内。It should be understood that the above-mentioned embodiments are only exemplary rather than restrictive, and those skilled in the art can make various obvious or equivalent to the above-mentioned details without departing from the basic principles of the present invention. Modifications or substitutions will be included within the scope of the claims of the present invention.
Claims (14)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010125303.1A CN111736688B (en) | 2020-02-27 | 2020-02-27 | Bluetooth headset, system and gesture recognition method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010125303.1A CN111736688B (en) | 2020-02-27 | 2020-02-27 | Bluetooth headset, system and gesture recognition method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111736688A true CN111736688A (en) | 2020-10-02 |
| CN111736688B CN111736688B (en) | 2025-01-14 |
Family
ID=72645958
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010125303.1A Active CN111736688B (en) | 2020-02-27 | 2020-02-27 | Bluetooth headset, system and gesture recognition method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111736688B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112987925A (en) * | 2021-03-04 | 2021-06-18 | 歌尔科技有限公司 | Earphone and control method and device thereof |
| CN113347526A (en) * | 2021-07-08 | 2021-09-03 | 歌尔科技有限公司 | Sound effect adjusting method and device of earphone and readable storage medium |
| CN113923553A (en) * | 2021-09-28 | 2022-01-11 | 深圳市芯中芯科技有限公司 | Bluetooth headset man-machine interaction method and device based on radar imaging |
| CN114245542A (en) * | 2021-12-17 | 2022-03-25 | 深圳市恒佳盛电子有限公司 | A radar sensor light and its control method |
| CN115484524A (en) * | 2021-06-16 | 2022-12-16 | 开酷科技股份有限公司 | Headphone device with gesture recognition function |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102023787A (en) * | 2009-09-17 | 2011-04-20 | 宏碁股份有限公司 | Method for operating touch screen, method for defining touch gesture and electronic device thereof |
| CN102541319A (en) * | 2010-12-20 | 2012-07-04 | 联想(北京)有限公司 | Electronic equipment and display processing method thereof |
| US20140191986A1 (en) * | 2013-01-04 | 2014-07-10 | Lg Electronics Inc. | Method for controlling a terminal using a double touch gesture and terminal thereof |
| US20150153833A1 (en) * | 2012-07-13 | 2015-06-04 | Softkinetic Software | Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand |
| US20160224036A1 (en) * | 2015-01-30 | 2016-08-04 | Lutron Electronics Co., Inc. | Gesture-based load control via wearable devices |
| CN106055098A (en) * | 2016-05-24 | 2016-10-26 | 北京小米移动软件有限公司 | Air gesture operation method and apparatus |
| US20170366891A1 (en) * | 2015-12-07 | 2017-12-21 | Boe Technology Group Co., Ltd. | Apparatus for controlling an earphone or a media player in communication with the earphone, and controlling method thereof |
| CN108346531A (en) * | 2018-04-10 | 2018-07-31 | 瑞安市华通器具开关有限公司 | A kind of tool switch with gesture identification function |
| US20180224980A1 (en) * | 2017-02-07 | 2018-08-09 | Samsung Electronics Company, Ltd. | Radar-Based System for Sensing Touch and In-the-Air Interactions |
| US10088908B1 (en) * | 2015-05-27 | 2018-10-02 | Google Llc | Gesture detection and interactions |
| US20180353086A1 (en) * | 2017-06-07 | 2018-12-13 | Bragi GmbH | Use of body-worn radar for biometric measurements, contextual awareness and identification |
| CN109524853A (en) * | 2018-10-23 | 2019-03-26 | 珠海市杰理科技股份有限公司 | Gesture identification socket and socket control method |
| CN110505549A (en) * | 2019-08-21 | 2019-11-26 | Oppo(重庆)智能科技有限公司 | The control method and device of earphone |
| US20190391662A1 (en) * | 2018-06-20 | 2019-12-26 | Sony Interactive Entertainment Inc. | Gesture-based user interface for ar and vr with gaze trigger |
| CN110647803A (en) * | 2019-08-09 | 2020-01-03 | 深圳大学 | Gesture recognition method, system and storage medium |
| WO2020019355A1 (en) * | 2018-07-27 | 2020-01-30 | 华为技术有限公司 | Touch control method for wearable device, and wearable device and system |
-
2020
- 2020-02-27 CN CN202010125303.1A patent/CN111736688B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102023787A (en) * | 2009-09-17 | 2011-04-20 | 宏碁股份有限公司 | Method for operating touch screen, method for defining touch gesture and electronic device thereof |
| CN102541319A (en) * | 2010-12-20 | 2012-07-04 | 联想(北京)有限公司 | Electronic equipment and display processing method thereof |
| US20150153833A1 (en) * | 2012-07-13 | 2015-06-04 | Softkinetic Software | Method and system for human-to-computer gesture based simultaneous interactions using singular points of interest on a hand |
| US20140191986A1 (en) * | 2013-01-04 | 2014-07-10 | Lg Electronics Inc. | Method for controlling a terminal using a double touch gesture and terminal thereof |
| US20160224036A1 (en) * | 2015-01-30 | 2016-08-04 | Lutron Electronics Co., Inc. | Gesture-based load control via wearable devices |
| US10088908B1 (en) * | 2015-05-27 | 2018-10-02 | Google Llc | Gesture detection and interactions |
| US20170366891A1 (en) * | 2015-12-07 | 2017-12-21 | Boe Technology Group Co., Ltd. | Apparatus for controlling an earphone or a media player in communication with the earphone, and controlling method thereof |
| CN106055098A (en) * | 2016-05-24 | 2016-10-26 | 北京小米移动软件有限公司 | Air gesture operation method and apparatus |
| US20180224980A1 (en) * | 2017-02-07 | 2018-08-09 | Samsung Electronics Company, Ltd. | Radar-Based System for Sensing Touch and In-the-Air Interactions |
| US20180353086A1 (en) * | 2017-06-07 | 2018-12-13 | Bragi GmbH | Use of body-worn radar for biometric measurements, contextual awareness and identification |
| CN108346531A (en) * | 2018-04-10 | 2018-07-31 | 瑞安市华通器具开关有限公司 | A kind of tool switch with gesture identification function |
| US20190391662A1 (en) * | 2018-06-20 | 2019-12-26 | Sony Interactive Entertainment Inc. | Gesture-based user interface for ar and vr with gaze trigger |
| WO2020019355A1 (en) * | 2018-07-27 | 2020-01-30 | 华为技术有限公司 | Touch control method for wearable device, and wearable device and system |
| CN109524853A (en) * | 2018-10-23 | 2019-03-26 | 珠海市杰理科技股份有限公司 | Gesture identification socket and socket control method |
| CN110647803A (en) * | 2019-08-09 | 2020-01-03 | 深圳大学 | Gesture recognition method, system and storage medium |
| CN110505549A (en) * | 2019-08-21 | 2019-11-26 | Oppo(重庆)智能科技有限公司 | The control method and device of earphone |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112987925A (en) * | 2021-03-04 | 2021-06-18 | 歌尔科技有限公司 | Earphone and control method and device thereof |
| WO2022183641A1 (en) * | 2021-03-04 | 2022-09-09 | 歌尔股份有限公司 | Earphone, and control method and device therefor |
| CN112987925B (en) * | 2021-03-04 | 2022-11-25 | 歌尔科技有限公司 | Earphone and control method and device thereof |
| US12386427B2 (en) | 2021-03-04 | 2025-08-12 | Goertek Inc. | Earphone, earphone control method and earphone control device |
| CN115484524A (en) * | 2021-06-16 | 2022-12-16 | 开酷科技股份有限公司 | Headphone device with gesture recognition function |
| CN113347526A (en) * | 2021-07-08 | 2021-09-03 | 歌尔科技有限公司 | Sound effect adjusting method and device of earphone and readable storage medium |
| CN113923553A (en) * | 2021-09-28 | 2022-01-11 | 深圳市芯中芯科技有限公司 | Bluetooth headset man-machine interaction method and device based on radar imaging |
| CN114245542A (en) * | 2021-12-17 | 2022-03-25 | 深圳市恒佳盛电子有限公司 | A radar sensor light and its control method |
| CN114245542B (en) * | 2021-12-17 | 2024-03-22 | 深圳市恒佳盛电子有限公司 | Radar sensor light and control method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111736688B (en) | 2025-01-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111736688A (en) | Bluetooth headset, system and method for gesture recognition thereof | |
| CN110139262A (en) | Bluetooth communication control method and Related product | |
| EP2820536B1 (en) | Gesture detection based on information from multiple types of sensors | |
| US9019131B2 (en) | Terminal and method for executing function using human body communication | |
| CN109857245B (en) | Gesture recognition method and terminal | |
| CN108900231B (en) | Dynamic antenna adjustment method and related products | |
| CN112098929B (en) | Method, device and system for determining relative angle between intelligent devices and intelligent device | |
| TW201839594A (en) | Mobile terminal, fingerprint recognition control method and device | |
| WO2023284418A1 (en) | Positioning method and apparatus, and electronic device and computer-readable storage medium | |
| US10732724B2 (en) | Gesture recognition method and apparatus | |
| WO2021017945A1 (en) | Electronic device control method and apparatus, electronic device, and storage medium | |
| US11693484B2 (en) | Device control method, electronic device, and storage medium | |
| CN108595003A (en) | Function control method and related equipment | |
| CN108833683B (en) | Dynamic antenna adjustment implementation method and related product | |
| CN112689812B (en) | Gesture recognition method and device based on multiple antennas | |
| CN106101776B (en) | Volume adjusting method, intelligent device and sound box | |
| WO2019165999A1 (en) | Ultrasonic fingerprint collection precision control processing method, storage medium and mobile terminal | |
| TWI687704B (en) | Positioning system and positioning method | |
| CN108810261B (en) | Antenna switching method in call and related product | |
| CN112256135B (en) | Equipment control method and device, equipment and storage medium | |
| CN112615949B (en) | Proximity detection device, terminal, and communication method | |
| CN109725704B (en) | Method and device for controlling application running | |
| CN108282857B (en) | Method for adjusting transmission power and related product | |
| CN110289919A (en) | Signal ensures processing method, device, equipment and storage medium | |
| CN111384980B (en) | Mobile terminal, chip and communication method thereof for communication based on unauthorized frequency band |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 519075 No. 333, Kexing Road, Xiangzhou District, Zhuhai City, Guangdong Province Applicant after: ZHUHAI JIELI TECHNOLOGY Co.,Ltd. Address before: 519085 Complex Building 9 (1-4 floors), No. 107, Shihua West Road, Jida, Zhuhai, Guangdong Applicant before: ZHUHAI JIELI TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |