WO2015188607A1 - Method and apparatus for implementing mutual conversion between sign language information and text information - Google Patents

Abstract

A method and apparatus for implementing mutual conversion between sign language information and text information, and a wearable device. The method comprises: a conversion apparatus receives sign language information sent by a wearable device, the sign language information comprising the distance between a palm and the conversion apparatus, height information of the palm and the relative distance between fingers (S201); the conversion apparatus processes the sign language information to obtain corresponding position information and obtains corresponding text information according to the position information (S202); and the conversion apparatus outputs the text information (S203). In the method for implementing mutual conversion between sign language information and text information, a distance sensor of the wearable device obtains the distance between the palm and the conversion apparatus and the relative distance between fingers, and a height sensor obtains the height information of the palm, so that the amount of information required during the conversion process is reduced, the information processing efficiency and the conversion efficiency are improved, requirements on software and hardware devices are lowered, other devices are not needed, the implementation is easy, and the applicability is high.

Description

Method and device for realizing mutual conversion of sign language information and text information

Cross-reference to related applications

This application claims the priority of the Chinese patent application number "201410253678.0" submitted by Baidu Online Network Technology (Beijing) Co., Ltd. on June 09, 2014, and the invention titled "Method and Apparatus for Realizing Conversion of Sign Language Information and Text Information" right.

Technical field

The present invention relates to the field of artificial intelligence recognition technology, and in particular, to a method, device and wearable device for realizing mutual conversion of sign language information and text information.

Background technique

Sign language is a certain communication tool that uses gestures to measure movements and simulates images or syllables according to changes in gestures. It is the main communication tool for deaf people. At present, the recognition of the opponent language can be divided into wearable based devices and based on traditional vision according to the input method. Based on the identification method of the wearable device, the hand sign recognition is mainly performed by measuring the joint angle information of the hand, the trajectory of the hand movement in the space, and the time series information by sensors or the like on the wearable device. Based on the traditional visual recognition method, the video information or image information of the gesture is collected by the camera to identify.

However, in the process of implementing the present invention, the inventors have found that at least the following problems exist in the prior art: the recognition mode based on the traditional vision needs to be easily affected by the environment by means of a device such as a camera, and the success rate of the recognition is low; The identification method requires a large amount of finger joint information to be acquired by various sensors, and then the finger joint information is processed, which has high requirements on software and hardware devices, low information processing efficiency, and complicated implementation.

Summary of the invention

The present invention aims to solve at least one of the technical problems in the related art to some extent. To this end, an object of the present invention is to provide a method for realizing mutual conversion of sign language information and text information. The method can improve the information processing efficiency, improve the conversion efficiency, reduce the requirements on the hardware and software devices, and does not need to use other devices, and the implementation is simple and the applicability is strong.

A second object of the present invention is to provide another method for realizing mutual conversion of sign language information and text information.

A third object of the present invention is to provide an apparatus for realizing mutual conversion of sign language information and text information.

A fourth object of the present invention is to provide a wearable device.

A fifth object of the present invention is to provide a terminal device.

A sixth object of the invention is to propose an apparatus.

A seventh object of the present invention is to provide a nonvolatile computer storage medium.

An eighth object of the present invention is to provide another non-volatile computer storage medium.

In order to achieve the above object, a method for mutually converting a sign language information and text information according to an embodiment of the present invention includes: a conversion device receiving sign language information sent by a wearable device, wherein the sign language information includes a palm and the conversion device Distance, height information of the palm, and relative distance between the fingers; the conversion device processes the sign language information to obtain corresponding position information, obtains corresponding text information according to the position information; and the conversion device output Textual information.

The method for realizing the mutual conversion of sign language information and text information in the embodiment of the present invention obtains the distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor of the wearable device, and the height sensor obtains the height information of the palm, which is greatly reduced. The amount of information required in the conversion process improves the efficiency of information processing, improves the conversion efficiency, and reduces the requirements for hardware and software devices, and does not require other devices to be simple and highly applicable.

In order to achieve the above object, a method for mutually converting sign language information and text information according to a second aspect of the present invention includes: a wearable device obtaining sign language information, wherein the sign language information includes a distance between a palm and the conversion device a height information of the palm and a relative distance between the fingers; and the wearable device processes the sign language information and transmits the processed sign language information to the converting device, so that the converting device is configured according to the processed The sign language information outputs corresponding text information.

The method for realizing the mutual conversion between sign language information and text information in the embodiment of the invention obtains the distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor, and the height sensor obtains the height information of the palm, thereby greatly reducing the conversion process. The amount of information required increases the efficiency of information processing, improves conversion efficiency, and reduces the requirements for hardware and software devices, and does not require other devices to be simple and highly applicable.

In order to achieve the above object, an apparatus for converting a sign language information and a text information into a mutual conversion according to an embodiment of the present invention includes: a receiving module, configured to receive sign language information sent by a wearable device, where the sign language information includes a palm and the device a distance between the palm, a height information of the palm, and a relative distance between the fingers; an obtaining module, configured to process the sign language information to obtain corresponding position information, obtain corresponding text information according to the position information; and an output module, Used to output the text information.

The device for converting the sign language information and the text information into each other in the embodiment of the invention obtains the distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor, and the height sensor obtains the height information of the palm, thereby greatly reducing the conversion process. The amount of information required increases the efficiency of information processing, improves conversion efficiency, and reduces the requirements for hardware and software devices, and does not require other devices to be simple and highly applicable.

In order to achieve the above object, a wearable device according to an embodiment of the fourth aspect of the present invention includes: an obtaining module, configured to obtain sign language information, wherein the sign language information includes a distance between a palm and a conversion device, a height information of a palm, and a relative distance between the fingers; and a processing module, configured to process the sign language information, and send the processed sign language information to the converting device, so that the converting device outputs the corresponding text according to the processed sign language information information.

In the wearable device of the embodiment of the invention, the distance between the palm and the conversion device and the relative distance between the fingers are obtained by the distance sensor, and the height sensor obtains the height information of the palm, thereby greatly reducing the amount of information required during the conversion process, and improving the number of information. Information processing efficiency, improved conversion efficiency, and reduced requirements for hardware and software devices, without the need for other devices, simple to implement, and strong applicability.

In order to achieve the above object, a terminal device according to an embodiment of the fifth aspect of the present invention includes: one or more processors; a memory; one or more programs, the one or more programs are stored in the memory, when When the one or more processors are executed, the following operations are performed: receiving sign language information sent by the wearable device, where the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; Processing the sign language information to obtain corresponding location information, obtaining corresponding text information according to the location information; and outputting the text information.

In order to achieve the above object, a terminal device of a sixth aspect of the present invention includes: one or more processors; a memory; one or more programs, the one or more programs are stored in the memory, when When the one or more processors are executed, the following operations are performed: obtaining sign language information, wherein the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; The sign language information is processed, and the processed sign language information is transmitted to the conversion device, so that the conversion device outputs the corresponding text information according to the processed sign language information.

In order to achieve the above object, a nonvolatile computer storage medium according to a seventh aspect of the present invention has one or more programs that, when the one or more programs are executed by one device, cause the device to perform the claim 1 The method of converting sign language information and text information into each other as described in any of the above.

In order to achieve the above object, a nonvolatile computer storage medium according to an embodiment of the eighth aspect of the present invention has one or more programs that, when the one or more programs are executed by one device, cause the device to perform the claim 5 Or the method for converting the sign language information and the text information into each other as described in any one of the six.

The additional aspects and advantages of the invention will be set forth in part in the description which follows.

DRAWINGS

The aspects and advantages of the invention will become apparent and readily understood from the following description of the embodiments of the invention

1 is a flow chart of a method of implementing mutual conversion of sign language information and text information in accordance with one embodiment of the present invention.

2 is a diagram showing an example of sign language information in accordance with one embodiment of the present invention.

3 is a flow chart of a method of implementing mutual conversion of sign language information and text information according to another embodiment of the present invention.

4 is a schematic structural diagram of an apparatus for implementing mutual conversion of sign language information and text information according to an embodiment of the present invention.

FIG. 5 is a schematic structural diagram of a wearable device according to an embodiment of the present invention.

detailed description

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

A method, an apparatus, and a wearable device for implementing mutual conversion of sign language information and text information according to an embodiment of the present invention are described below with reference to the accompanying drawings.

1 is a flow chart of a method of implementing mutual conversion of sign language information and text information, which is described from a wearable device, in accordance with one embodiment of the present invention.

As shown in FIG. 1, the method for converting sign language information and text information to each other includes the following steps:

S101. The wearable device obtains sign language information, wherein the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers.

In an embodiment of the present invention, the wearable device can obtain sign language information corresponding to the gesture made by the user through various sensors. Specifically, the wearable device can obtain the relative distance between the left and right palms and the conversion device and the distance between the ten fingers through the distance sensor, and the height information of the left and right palms can be obtained by the height sensor.

More specifically, L can be used to indicate the distance between the left palm and the conversion device, R is the distance between the right palm and the conversion device, LH is the height information of the left palm (ie, the average height of the 5 fingers of the left hand), and RH is the height information of the right palm. (ie the average height of 5 fingers in the right hand). L1 represents the left thumb, L2 represents the left index finger, L3 represents the left middle finger, L4 represents the left hand ring finger, L5 represents the left hand little finger, R1 represents the right hand thumb, R2 represents the right hand index finger, R3 represents the right hand finger, R4 represents the right hand ring finger, and R5 represents the right hand little finger. The distance between 10 fingers can be represented by a matrix vector of 10*10 or 5*5. The matrix vector is used to represent the data, which is convenient for subsequent operations.

S102: The wearable device opponent language information is processed, and the processed sign language information is sent to the conversion device, so that the conversion device outputs the corresponding text information according to the processed sign language information.

In an embodiment of the present invention, the wearable device can amplify the obtained sign language information, then perform encoding and compression, and then perform processing such as storage. After processing the opponent language information, the wearable device can communicate with the conversion device through NFC (Near Field Communication), WIFI (Wireless Fidelity), infrared, acoustic wave, etc., and send the processed sign language information to the conversion device, The conversion device is caused to output the corresponding text information based on the processed sign language information.

The method for realizing the mutual conversion between sign language information and text information in the embodiment of the invention obtains the distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor, and the height sensor obtains the height information of the palm, thereby greatly reducing the conversion process. The amount of information required increases the efficiency of information processing, improves conversion efficiency, and reduces the requirements for hardware and software devices, and does not require other devices to be simple and highly applicable.

2 is a flow chart showing a method of realizing mutual conversion of sign language information and text information according to another embodiment of the present invention, which is described from the side of the conversion device.

As shown in FIG. 2, the method for converting sign language information and text information into each other includes the following steps:

S201. The conversion device receives the sign language information sent by the wearable device, where the sign language information includes a distance between the palm and the conversion device, a height information of the palm, and a relative distance between the fingers.

In an embodiment of the invention, the conversion device can communicate with the wearable device via NFC (Near Field Communication), WIFI (Wireless Fidelity), infrared, acoustic waves, and the like. The conversion device can receive the sign language information sent by the wearable device, wherein the sign language information can include a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers. Specifically, the wearable device can obtain the relative distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor, and the height information of the palm can be obtained by the height sensor.

S202. The conversion device performs processing on the opponent language information to obtain corresponding location information, and obtains corresponding text information according to the location information.

In the embodiment of the present invention, since the arm length, the finger length, the height, and the like of the user are not necessarily the same, it is necessary to collect information of a plurality of users, and then extract features therefrom as sample information, thereby establishing a conversion table. The conversion table may include location information of text information and its sign language information conversion. The location information may be coordinate information corresponding to a gesture made by the user. After the conversion device receives the sign language information sent by the wearable device, the conversion device may process the opponent language information to obtain corresponding coordinate information, and then query and obtain the text information corresponding to the coordinate information in the conversion table.

For example, suppose the distance between the palm and the conversion device is 50 cm, and the data corresponding to the gesture made by the user can be expressed as L, R, LH, RH = (50, 45, 80, 130) and the distance of 10 fingers. The data contained in the matrix is shown in Table 1.

Table 1 Data contained in the distance matrix

R1 R2 R3 R4 R5 L1 60 59 60 60 60 L2 60 59 60 60 60 L3 60 59 60 60 60 L4 60 59 60 60 60 L5 60 59 60 60 60

According to the above coordinate information, the conversion table and its corresponding text information can be queried, and finally the text information "I" can be obtained. As shown in Figure 3. Similarly, in the above manner, the text information "love" and "you" can be obtained according to the coordinate information corresponding to the other two gestures. It should be noted that the above numerical values and units are merely examples.

S203. The conversion device outputs text information.

In an embodiment of the invention, the conversion device may include a display screen through which text information or voice output text information may be output.

Therefore, the sign language information used in the embodiment includes only the distance between the palm and the conversion device, the height information of the palm, and the relative distance between the fingers. Compared with other conversion modes, in this embodiment, The conversion method adopted has a small amount of data. Therefore, the data processing efficiency is high, and the conversion efficiency between the information is high, and is particularly suitable for a scene with high real-time requirements, such as an emergency situation in which a deaf person is in an emergency.

In an embodiment of the present invention, the converting device may further convert the text information input by the user into corresponding sign language information. Specifically, the conversion device can obtain the text to be converted input by the user, and then obtain the position information corresponding to the text to be converted according to the conversion table, and then output the sign language information corresponding to the text to be converted through the display screen according to the position information. For example, when the television program media of the television station needs to add the live program to the sign language expression link, the material (the text to be converted) that the host needs to dictate can be input into the conversion device, and then the corresponding location information is obtained according to the conversion table. According to the location information, the action information of the virtual character is output through the display screen, so that the illiterate deaf and mute can understand the information published by the media, saving the time cost of human translation into the sign language, and enabling the deaf person to be like an ordinary person. Get real-time information in the same time.

The method for realizing the mutual conversion of sign language information and text information in the embodiment of the present invention obtains the distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor of the wearable device, and the height sensor obtains the height information of the palm, which is greatly reduced. The amount of information required in the conversion process improves the efficiency of information processing, improves the conversion efficiency, and reduces the requirements for hardware and software devices, and does not require other devices to be simple and highly applicable.

The above embodiments can also be applied to specific information search scenarios. For example, when a deaf-mute user wants to access the Internet for information, but does not use the traditional input method, at this time, he only needs to select the position of the text input on the computer screen, that is, in the search box, wear the wearable device. Hand sign language operation, send sign language information to the computer, where the computer is the conversion device. The computer obtains the corresponding text information by querying the pre-stored conversion table, and displays the text that the user wants to input in the search box. Deaf-mute users can use this method to enter search terms and search for the required information.

In order to implement the above embodiments, the present invention also provides an apparatus for realizing mutual conversion of sign language information and text information.

As shown in FIG. 4, the apparatus for converting the sign language information and the text information into each other includes: a receiving module 110, an obtaining module 120, and an output module 130.

The receiving module 110 is configured to receive sign language information sent by the wearable device, where the sign language information includes a distance between the palm and the device, a height information of the palm, and a relative distance between the fingers.

In an embodiment of the present invention, the conversion device can pass NFC (Near Field Communication), WIFI (Wireless Fidelity), infrared, Sound waves and the like communicate with the wearable device. The receiving module 110 can receive the sign language information sent by the wearable device, wherein the sign language information can include a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers. Specifically, the wearable device can obtain the relative distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor, and the height information of the palm can be obtained by the height sensor.

The obtaining module 120 is configured to process the counterpart information to obtain corresponding location information, and obtain corresponding text information according to the location information.

In the embodiment of the present invention, since the arm length, the finger length, the height, and the like of the user are not necessarily the same, it is necessary to collect information of a plurality of users, and then extract features therefrom as sample information, so that the establishing module 140 establishes based on the sample information. Conversion table. The conversion table may include location information of text information and its sign language information conversion. The location information may be coordinate information corresponding to a gesture made by the user. After the receiving module 110 receives the sign language information sent by the wearable device, the obtaining module 120 may process the opponent language information to obtain corresponding coordinate information, and then query and obtain the text information corresponding to the coordinate information in the conversion table. For example, suppose the distance between the palm and the conversion device is 50 cm, and the data corresponding to the gesture made by the user can be expressed as L, R, LH, RH = (50, 45, 80, 130) and the distance of 10 fingers. The data contained in the matrix is shown in Table 1.

Table 1 Data contained in the distance matrix

R1 R2 R3 R4 R5 L1 60 59 60 60 60 L2 60 59 60 60 60 L3 60 59 60 60 60 L4 60 59 60 60 60 L5 60 59 60 60 60

According to the above coordinate information, the conversion table and its corresponding text information can be queried, and finally the text information "I" can be obtained, as shown in FIG. Similarly, in the above manner, the text information "love" and "you" can be obtained according to the coordinate information corresponding to the other two gestures. It should be noted that the above numerical values and units are merely examples.

The output module 130 is for outputting text information.

In an embodiment of the invention, the conversion device may include a display screen, and the output module 130 may output text information or voice output text information through the display screen.

Therefore, the sign language information used in the embodiment includes only the distance between the palm and the conversion device, the height information of the palm, and the relative distance between the fingers. Compared with other conversion modes, in this embodiment, The conversion method adopted has a small amount of data. Therefore, the data processing efficiency is high, and the conversion efficiency between the information is high, and is particularly suitable for a scene with high real-time requirements, such as an emergency situation in which a deaf person is in an emergency.

In addition, the means for converting the sign language information and the text information to each other may further include an establishing module 140.

The establishing module 140 is configured to establish a conversion table based on the sample information before the obtaining module 120 obtains the corresponding text information according to the location information, where the conversion table includes the text information and the location information converted by the sign language information.

In an embodiment of the present invention, the converting device may further convert the text information input by the user into corresponding sign language information. Specifically, the obtaining module 120 obtains the text to be converted input by the user, and then obtains position information corresponding to the text to be converted according to the conversion table, and according to the position information, the output module 130 outputs the sign language information corresponding to the text to be converted through the display screen. . For example, when the television program media of the television station needs to add the live program to the sign language expression link, the material (the text to be converted) that the host needs to dictate can be input into the conversion device, and then the corresponding location information is obtained according to the conversion table. According to the location information, the action information of the virtual character is output through the display screen, so that the illiterate deaf-mute person can understand the information published by the media, and the real-time performance is strong, saving the time cost of human translation into sign language, and making the deaf-mute person Get real-time information in the same way as ordinary people.

The device for converting the sign language information and the text information into each other according to the embodiment of the invention obtains the distance between the palm and the conversion device and the relative distance between the fingers through the distance sensor of the wearable device, and the height sensor obtains the height information of the palm, which is greatly reduced. The amount of information required in the conversion process improves the efficiency of information processing, improves the conversion efficiency, and reduces the requirements for hardware and software devices, and does not require other devices to be simple and highly applicable.

In order to implement the above embodiments, the present invention also proposes a wearable device. As shown in FIG. 5, the wearable device includes an obtaining module 210 and a processing module 220.

The obtaining module 210 is configured to obtain sign language information, wherein the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers.

In an embodiment of the present invention, the obtaining module 210 can obtain sign language information corresponding to the gesture made by the user through various sensors. Specifically, the obtaining module 210 can obtain the relative distance between the left and right palms and the conversion device and the distance between the ten fingers through the distance sensor, and the height information of the left and right palms can be obtained by the height sensor.

More specifically, L can be used to indicate the distance between the left palm and the conversion device, R is the distance between the right palm and the conversion device, LH is the height information of the left palm (ie, the average height of the 5 fingers of the left hand), and RH is the height information of the right palm. (ie the average height of 5 fingers in the right hand). L1 represents the left thumb, L2 represents the left index finger, L3 represents the left middle finger, L4 represents the left hand ring finger, L5 represents the left hand little finger, R1 represents the right hand thumb, R2 represents the right hand index finger, R3 represents the right hand finger, R4 represents the right hand ring finger, and R5 represents the right hand little finger. The distance between 10 fingers can be represented by a matrix vector of 10*10 or 5*5. The matrix vector is used to represent the data, which is convenient for subsequent operations.

The processing module 220 is configured to process the opponent language information, and send the processed sign language information to the converting device, so that the converting device outputs the corresponding text information according to the processed sign language information.

In an embodiment of the present invention, the processing module 220 may amplify the obtained sign language information, then perform encoding and compression, and then perform processing such as storage. After the opponent language information is processed, the processing module 220 can communicate with the conversion device through NFC (Near Field Communication), WIFI (Wireless Fidelity), infrared, acoustic wave, etc., and send to the conversion device. The processed sign language information is such that the converting device outputs the corresponding text information according to the processed sign language information.

In the wearable device of the embodiment of the invention, the distance between the palm and the conversion device and the relative distance between the fingers are obtained by the distance sensor, and the height sensor obtains the height information of the palm, thereby greatly reducing the amount of information required during the conversion process, and improving the number of information. Information processing efficiency, improved conversion efficiency, and reduced requirements for hardware and software devices, without the need for other devices, simple to implement, and strong applicability.

In order to achieve the above object, the present invention also proposes a terminal device.

A terminal device according to an embodiment of the present invention includes: one or more processors; a memory; one or more programs, one or more programs are stored in the memory, and when executed by one or more processors, perform the following operations: receiving The sign language information sent by the wearable device, the sign language information includes a distance between the palm and the conversion device, a height information of the palm, and a relative distance between the fingers; the opponent language information is processed to obtain corresponding position information, and the corresponding text is obtained according to the position information. Information; and output text information.

In order to achieve the above object, the present invention also proposes an apparatus.

The device of the embodiment of the present invention comprises: one or more processors; a memory; one or more programs, one or more programs are stored in the memory, and when executed by one or more processors, the following operations are performed: obtaining sign language Information, wherein the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; and processing the opponent language information, and transmitting the processed sign language information to the conversion device to cause the conversion device The corresponding text information is output according to the processed sign language information.

In order to achieve the above object, the present invention also proposes a nonvolatile computer storage medium.

The computer storage medium stores one or more programs, and when the one or more programs are executed by a device, causes the device to perform the method of converting the sign language information and the text information into each other in the embodiment shown in FIG. 1 of the present invention.

In order to achieve the above object, the present invention also proposes another non-volatile computer storage medium.

The computer storage medium stores one or more programs that, when executed by a device, cause the device to perform the method of converting the sign language information and the text information into each other in the embodiment of the present invention.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.

Moreover, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" and "second" may be explicitly stated or At least one such feature is implicitly included. In the description of the present invention, the meaning of "a plurality" is at least two, such as two, three, etc., unless specifically defined otherwise.

Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a particular logical function or process. And the scope of the preferred embodiments of the invention includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in an opposite order depending on the functions involved, in the order shown or discussed. It will be understood by those skilled in the art to which the embodiments of the present invention pertain.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

One of ordinary skill in the art can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The integrated module if When the software function module is implemented in the form and sold or used as a stand-alone product, it can also be stored in a computer readable storage medium.

The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Claims (16)

A method for realizing mutual conversion of sign language information and text information, characterized in that it comprises: The conversion device receives the sign language information sent by the wearable device, the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; The converting device processes the sign language information to obtain corresponding location information, and obtains corresponding text information according to the location information; The conversion device outputs the text information. The method according to claim 1, wherein before the obtaining the corresponding text information according to the location information, the method further comprises: establishing a conversion table based on the sample information, wherein the conversion table includes text information and sign language information thereof Location information of the conversion; The obtaining the corresponding text information according to the location information includes: querying the conversion table according to the location information, and obtaining corresponding text information. The method according to claim 1 or 2, wherein the converting means outputs the text information, comprising: The conversion device outputs the text information or voice output the text information through a display screen. The method according to claim 2 or 3, further comprising: The converting device obtains the text to be converted input by the user, and obtains location information corresponding to the text to be converted based on the conversion table; According to the location information, sign language information corresponding to the text to be converted is output through a display screen. A method for realizing mutual conversion of sign language information and text information, characterized in that it comprises: The wearable device obtains sign language information, wherein the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; The wearable device processes the sign language information, and sends the processed sign language information to the converting device, so that the converting device outputs corresponding text information according to the processed sign language information. The method according to claim 5, wherein the wearable device obtains sign language information, including: The wearable device obtains a distance between the palm and the conversion device and a relative distance between the fingers through the distance sensor, and obtains height information of the palm through the height sensor. An apparatus for realizing mutual conversion of sign language information and text information, comprising: a receiving module, configured to receive sign language information sent by the wearable device, where the sign language information includes a distance between the palm and the device, a height information of the palm, and a relative distance between the fingers; Obtaining a module, configured to process the sign language information to obtain corresponding location information, and obtain the location information according to the location information Corresponding text information; An output module, configured to output the text information. The apparatus according to claim 7, further comprising: an establishing module, configured to: before the obtaining module obtains corresponding text information according to the location information, establish a conversion table based on the sample information, the conversion table Contains location information of text information and its sign language information conversion; The obtaining module is specifically configured to: query the conversion table according to the location information, and obtain corresponding text information. The device according to claim 7 or 8, wherein the output module is specifically configured to: The text information is output through the display screen to output the text information or voice. The device according to claim 8 or 9, wherein the obtaining module is further configured to: obtain a text to be converted input by a user, and obtain location information corresponding to the text to be converted based on the conversion table; The output module is further configured to: output, according to the location information obtained by the obtaining module, sign language information corresponding to the to-be-converted text through a display screen. A wearable device, comprising: Obtaining a module for obtaining sign language information, wherein the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; And a processing module, configured to process the sign language information, and send the processed sign language information to the converting device, so that the converting device outputs the corresponding text information according to the processed sign language information. The wearable device according to claim 11, wherein the obtaining module is specifically configured to: The distance between the palm and the conversion device and the relative distance between the fingers are obtained by the distance sensor, and the height information of the palm is obtained by the height sensor. A terminal device, comprising: One or more processors; Memory One or more programs, the one or more programs being stored in the memory, and when executed by the one or more processors, do the following: Receiving sign language information sent by the wearable device, the sign language information including a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; Processing the sign language information to obtain corresponding location information, and obtaining corresponding text information according to the location information; The text information is output. An apparatus, comprising: One or more processors; Memory One or more programs, the one or more programs being stored in the memory, and when executed by the one or more processors, do the following: Obtaining sign language information, wherein the sign language information includes a distance between the palm and the conversion device, height information of the palm, and a relative distance between the fingers; Processing the sign language information, and transmitting the processed sign language information to the converting device, so that the converting device outputs the corresponding text information according to the processed sign language information. A non-volatile computer storage medium, characterized in that the computer storage medium stores one or more programs, when the one or more programs are executed by a device, causing the device to perform the claim 1 The method of converting sign language information and text information into each other as described in any of the above. A non-volatile computer storage medium, characterized in that the computer storage medium stores one or more programs, and when the one or more programs are executed by a device, causes the device to perform the claim 5 Or the method for converting the sign language information and the text information into each other as described in any one of the six.

Images