JP2005167500A - Multimedia translator, inter-terminal translation system, multimedia translator control method, control program, and recording medium recording the program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a multimedia translator capable of sufficiently communicating with a partner.
A multimedia translator 4 includes a data receiving unit 30 that receives multimedia data, a data analysis unit 31 that extracts information in a predetermined language from multimedia data received by the data receiving unit 30, and a data A character translation unit 35 that translates data of a predetermined language extracted by the analysis unit 31 into another predetermined language, a data combination unit 37 that combines the data translated by the character translation unit 35 with the received multimedia data, and data combination And a data sending unit 38 for sending out the multimedia data combined by the unit 37.
[Selection] Figure 1

Description

  The present invention relates to a multimedia translator that translates multimedia data including at least one of image data, audio data, and character data, each of which is an image, audio, and text. The present invention relates to a control method for a media translator, a control program, and a recording medium on which the program is recorded.

  In recent years, with the advance of IT (information technology), transmission / reception of image data, transmission / reception of audio data, and transmission / reception of data combining voice and images are performed in addition to transmission / reception of character data between communication terminals. A lot of multimedia data can be transmitted and received between communication terminals.

  In addition, with the globalization of IT, multimedia data is actively being exchanged with foreign countries. For this reason, it is desired to output the multimedia data after being translated into a desired language.

  For example, Patent Document 1 below discloses a simultaneous translation system between mobile terminals that uses a mobile phone to perform language translation between mobile phones of different languages for both communicators and can smoothly communicate. Has been described. In this inter-mobile-terminal simultaneous translation system, when the communication form is voice communication, an automatic phrase conversion language translation system that performs speech language conversion is selected, and the system refers to a conversion case accumulation DB (database). Perform language conversion and output the converted information as a voice. On the other hand, when the communication mode is character data transmission / reception, the automatic phrase conversion character translation system is selected, and the language is translated while referring to the conversion case accumulation database.

In voice calls, a telephone interpreting service using a three-party calling function has been started.
JP 2002-44249 A (published February 8, 2002)

  Machine translation is used in the translation system such as Patent Document 1 described above, but the current machine translation has not yet been able to accurately convey subtle nuances, so it is not sufficient to communicate with the other party. It is.

  In addition, when a telephone interpreting service using a three-party calling function of a telephone is used, an interpreter is required, so that the cost burden increases and a time restriction occurs.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a multimedia translator and the like that can sufficiently communicate with the other party.

  In order to solve the above-described problems, a multimedia translator according to the present invention is a multimedia data including at least one of image data, sound data, and character data whose representation forms are images, sounds, and characters, respectively. A multimedia translator that performs translation, a receiving unit that receives the multimedia data, a language information extracting unit that extracts information in a predetermined language from the multimedia data received by the receiving unit, and the language information Translating means for translating information consisting of a predetermined language extracted by the extracting means into another predetermined language, coupling means for coupling the data translated by the translation means to the multimedia data received by the receiving means, and the coupling means And sending means for sending out multimedia data combined with each other.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, the combining unit converts the data translated by the translation unit into a representation form different from the representation form of the data extracted by the language information extraction unit. The converted data is combined with the multimedia data received by the receiving means.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, image data is included in the multimedia data received by the receiving means, and the data to be combined by the combining means with the multimedia data is In the case of image data, the combining means performs data combining so that an image based on data combined with the multimedia data is combined with a caption area in the image based on the image data of the multimedia data. It is a feature.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, the receiving unit further receives translation setting data in which a language to be translated and a translation language are set, and the language information extracting unit includes the receiving unit. From the multimedia data received by the means, the data of the language to be translated set in the translation setting data is extracted. The translation means converts the data extracted by the language information extraction means into the translation setting data. It is characterized by being translated into a set translation language.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, the translation unit converts the information in a predetermined language extracted by the language information extraction unit into data in a character form, and then converts it into another predetermined language. It is characterized by translation.

  Further, an inter-terminal translation system according to the present invention includes a transmission source communication terminal that transmits multimedia data, a multimedia translator configured as described above that translates multimedia data transmitted by the transmission source communication terminal, And a destination communication terminal that receives the multimedia data translated by the multimedia translator.

  Furthermore, the inter-terminal translation system according to the present invention is characterized in that, in the above configuration, the transmission source and transmission destination communication terminals are mobile phone terminals.

  Also, the control method of the multimedia translator according to the present invention translates multimedia data including at least one of image data, audio data, and character data whose expression forms are images, sounds, and characters, respectively. A method for controlling a multimedia translator, which receives the multimedia data, extracts information in a predetermined language from the received multimedia data, and translates the extracted information in the predetermined language into another predetermined language The translated data is combined with the received multimedia data, and the combined multimedia data is sent out.

  A control program according to the present invention is a control program for operating the multimedia translator, and is a control program for causing a computer to function as each means.

  A computer-readable recording medium according to the present invention is characterized in that the control program is recorded.

  As described above, the multimedia translator according to the present invention includes a receiving unit that receives the multimedia data, and a language information extracting unit that extracts information in a predetermined language from the multimedia data received by the receiving unit. Translation means for translating the information of the predetermined language extracted by the language information extraction means into another predetermined language; and coupling means for combining the data translated by the translation means with the multimedia data received by the receiving means; And a sending means for sending out the multimedia data to which the joining means is joined.

  According to the above configuration, the translated data is combined with the original multimedia data and sent out, so the nuances that are difficult to communicate with the translated data can be conveyed with the original multimedia data, so there is sufficient communication with the other party. There is an effect that can be achieved.

  Note that the combining means performs data composition when the data to be combined is in the same expression form.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, the combining unit converts the data translated by the translation unit into a representation form different from the representation form of the data extracted by the language information extraction unit. Then, the converted data is combined with the multimedia data received by the receiving means.

  According to the above configuration, the data translated by the translation unit is converted into an expression form different from the data extracted by the language information extraction unit, that is, the data before translation, and then combined with the original multimedia data. Therefore, the translated data is in a different form from the pre-translation data, so that the combining means does not synthesize the translated data into the pre-translation data and prevents damage to the pre-translation data. There is an effect.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, image data is included in the multimedia data received by the receiving means, and the data to be combined by the combining means with the multimedia data is In the case of image data, the combining means performs data combining so that an image based on data combined with the multimedia data is combined with a caption area in the image based on the image data of the multimedia data. is there.

  According to the above configuration, since the translated language is displayed in the caption area, there is an effect of preventing the information of the original image from being damaged even when the same expression forms of images are combined.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, the receiving unit further receives translation setting data in which a language to be translated and a translation language are set, and the language information extracting unit includes the receiving unit. From the multimedia data received by the means, the data of the language to be translated set in the translation setting data is extracted. The translation means converts the data extracted by the language information extraction means into the translation setting data. It is the structure which translates into the set translation language.

  According to said structure, since translation is performed based on translation setting data, there exists an effect that it can translate into the language which a user desires with respect to the data which a user desires.

  Furthermore, in the multimedia translator according to the present invention, in the above configuration, the translation unit converts the information in a predetermined language extracted by the language information extraction unit into data in a character form, and then converts it into another predetermined language. It is the structure to translate.

  According to said structure, since a translation means should just translate only to the data of a character form, there exists an effect that a translation process can be simplified.

  Further, an inter-terminal translation system according to the present invention includes a transmission source communication terminal that transmits multimedia data, a multimedia translator configured as described above that translates multimedia data transmitted by the transmission source communication terminal, And a destination communication terminal that receives multimedia data translated by the multimedia translator.

  Thereby, the above-mentioned effect can be produced also in the inter-terminal translation system having the above configuration. The transmission source and destination communication terminals may be mobile phone terminals.

  Also, the multimedia translator control method according to the present invention receives the multimedia data, extracts information in a predetermined language from the received multimedia data, and extracts the extracted information in the predetermined language as another predetermined information. This is a method of translating into a language, combining the translated data with the received multimedia data, and sending the combined multimedia data.

  According to the above method, the translated data is combined with the original multimedia data and sent out, so the nuances that are difficult to communicate with the translated data can be conveyed with the original multimedia data, so there is sufficient communication with the other party There is an effect that can be achieved.

  Each means in the multimedia translator can be executed on a computer by a control program.

  Furthermore, the control program can be executed on any computer by storing the control program in a computer-readable recording medium.

[Embodiment 1]
Hereinafter, an embodiment of the present invention will be described with reference to FIGS. FIG. 2 shows a schematic configuration of the inter-terminal translation system according to the present embodiment. As shown in the figure, the inter-terminal translation system 1 is configured such that communication terminals 2 and 2 and a multimedia translator 4 are communicably connected via a communication network 5.

  The multimedia translator 4 receives multimedia data from one communication terminal 2a via the communication network 5, extracts character information and voice information from the received multimedia data, translates them into a predetermined language, and translates the translated characters. Information or audio information is added to the original multimedia data and transmitted to the other communication terminal 2b via the communication network 5. In the present application, the multimedia data means data including at least one of character data, audio data, and image data.

  Since the translation information is added to the multimedia data from one communication terminal 2a and transmitted to the other communication terminal 2b by the multimedia translator 4, it is possible to sufficiently communicate with the other party than before. it can.

  Next, detailed configurations of the communication terminal 2, the multimedia translator 4, and the communication network 5 will be described.

  The communication terminal 2 transmits multimedia data on the communication network 5 and receives multimedia data from the communication network 5. As the communication terminal 2, any device capable of transmitting and receiving multimedia data can be used. For example, a PC (Personal Computer), a PDA (Personal Digital Assistant), a fixed phone, a mobile phone, and a PHS (Personal Handy) -phone System).

  The communication terminal 2 also transmits various translation setting data necessary for the multimedia translator 4 to translate. FIGS. 3A and 3B show information included in the translation setting data and an example thereof. As shown in the figure, the translation setting data includes a transmission source address, a transmission destination address, a communication form, a translated language, a translated language, a translated form, and a translated form.

  The transmission source address is a communication address for identifying the location of the transmission source communication terminal 2a, and the transmission destination address is a communication address for identifying the location of the transmission destination communication terminal 2b. For example, a mail address or an IP (Internet Protocol) address can be used as the source address and the destination address. When a telephone terminal is used as the communication terminal 2, a telephone number can be used as a transmission source address and a transmission destination address.

  The communication form shows the form of communication performed between the communication terminals 2 and 2; bidirectional transmission such as videophone, one-way transmission such as mail transmission, and broadcast transmission such as broadcasting. Selected from. In the case of bidirectional communication, another setting data in which the transmission source address and the transmission destination address are exchanged is created. In the case of broadcast transmission, a plurality of values are set for the transmission destination address.

  The translated language indicates the language to be translated, and the translated language indicates the translated language. The translated language and the translated language are selected from various languages. The translated form indicates the expression form to be translated, and the translated form indicates the translated expression form. The translated form and the translated form are selected from images, sounds, and characters.

  For example, in the case of the translation setting data shown in FIG. 3B, multimedia data may be transmitted from the transmission source address (aaaa@bbb.co.jp) to the transmission destination address (cccc@ddd.co.jp). It is set that Japanese audio data in the multimedia data is translated into English and added to the multimedia data as character data.

  The translation setting data as described above is transmitted to the multimedia translator 4 from the communication terminal 2a as a transmission source together with the multimedia data or before transmission of the multimedia data. When transmitting a plurality of multimedia data, the translation setting data may be transmitted together with each multimedia data, or transmitted together with the first multimedia data or before the transmission of the first multimedia data. May be. Further, the translation language and the translation form of the translation setting data may be selected by the user of the destination communication terminal 2b and transmitted from the destination communication terminal 2b to the multimedia translator 4.

  FIG. 2 shows a schematic configuration of the communication terminal 2. Referring to the figure, the communication terminal 2 is similar to a general camera-equipped mobile phone terminal, the control unit 10, the camera 11, the microphone 12, the operation unit 13, the display 14, the speaker 15, the storage unit 16, and the communication unit 17. It is the structure provided with. The control unit 10 comprehensively controls operations of various configurations of the communication terminal 2.

  The camera unit 11 captures a subject, generates image data, and transmits the generated image data to the control unit 10. Specifically, as the camera unit 11, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) that converts light from a subject into an electric signal, and an electric signal from the image sensor. A configuration including an image processing circuit for converting into digital image data of each color of RGB is given.

  The microphone unit 12 is for inputting voice by converting voice into voice data and transmitting the converted voice data to the control unit 10. Specifically, the microphone unit 12 includes a microphone that converts sound waves into an electrical signal, and an audio input processing circuit that includes an A / D converter, an amplifier, and the like, and converts the electrical signal from the microphone into digital audio data. It is a configuration.

  The operation unit 13 receives various inputs from the user, and includes a number of operation buttons, a touch panel, and a keyboard. The operation unit 13 converts user operation information into operation data and transmits the operation data to the control unit 10.

  The display unit 14 receives image data from the control unit 10 and displays an image based on the received image data. Specifically, the display 14 includes a display element such as a plasma display, a liquid crystal display (LCD), and an EL (Electroluminescence) display, and a driver circuit that drives the display element based on received image data.

  The speaker unit 15 receives audio data from the control unit 10 and outputs audio based on the received audio data. Specifically, the speaker unit 15 includes a D / A converter, an amplifier, and the like, and includes a sound output processing circuit that converts received sound data into an electric signal, and a speaker and an earphone that convert the electric signal into a sound wave. It is a configuration.

  The storage unit 16 includes a storage device such as a ROM (Read Only Memory), a RAM (Random Access Memory), and a hard disk. The contents stored in the storage unit 16 include a control program for performing control operations of various configurations in the control unit 10, an OS (Operating System) program, and other various programs and various data. Furthermore, in this embodiment, the memory | storage part 16 has memorize | stored the communication address of the own terminal.

  The communication unit 17 is for communicating with another communication terminal 2 or the multimedia translator 4 via the communication network 5. The communication unit 17 converts various data received from the control unit 10 into a format suitable for data communication on the communication network 5, and then transmits the data on the communication network 5. The communication unit 17 converts various data received from the communication network 5 into a data format inside the apparatus, and then transmits the data to the control unit 10.

  Examples of the communication network 5 include the Internet, an intranet, an extranet, a LAN (Local Area Network), an ISDN (Integrated Services Digital Network), a value added network, a CATV (Cable Television) communication network, and a virtual dedicated network. A known communication network such as a network (virtual private network), a telephone line network, a mobile communication network, and a satellite communication network can be used.

  Next, the configuration of the multimedia translator 4 will be described. The multimedia translator 4 has the same configuration as an ordinary computer having a communication function. FIG. 2 shows a schematic configuration of the multimedia translator 4. Referring to the figure, the multimedia translator 4 includes a translation processing unit 20, a communication unit 21, and a translation DB 22.

  As described above, the translation processing unit 20 extracts character information and the like from the multimedia data received from the communication unit 21 and translates it into a predetermined language, and adds the translated character information and the like to the original multimedia data for communication. This is transmitted to the unit 21. The function of the translation processing unit 20 is realized by the CPU executing a program stored in a storage device such as a RAM. The detailed configuration of the translation processing unit 20 will be described later.

  The communication unit 21 is for communicating with the communication terminals 2 and 2 via the communication network 5. The communication unit 21 converts various data received from the translation processing unit 20 into a format suitable for data communication on the communication network 5, and then transmits the data to the communication network 5. Further, the communication unit 21 converts various data received from the communication network 5 into a data format inside the apparatus, and then transmits the data to the translation processing unit 20.

  The translation DB 22 stores information necessary for translation by the translation processing unit 20 in a storage device such as a hard disk, and stores dictionary data, history data of language conversion performed in the past, and the like. .

  Next, a detailed configuration of the translation processing unit 20 will be described with reference to FIG. FIG. 1 shows a schematic configuration of the translation processing unit 20. As illustrated, the translation processing unit 20 includes a data receiving unit (receiving unit) 30, a data analyzing unit (language information extracting unit) 31, a setting unit 32, a character recognizing unit (translating unit) 33, a speech recognizing unit (translating unit). ) 34, a character translation unit (translation unit) 35, a data conversion unit (combination unit) 36, a data combination unit (combination unit) 37, and a data transmission unit (transmission unit) 38.

  The data receiving unit 30 receives multimedia data and translation setting data from the communication unit 21 and transmits the received data to the data analysis unit 31.

  The data analysis unit 31 analyzes the data received from the data reception unit 30 and determines whether the data is multimedia data or translation setting data. If it is determined as translation setting data, the data analysis unit 31 transmits the translation setting data to the translation setting unit 32. Thereby, the translation setting part 32 sets various information as shown to Fig.3 (a).

  On the other hand, if the data is determined to be multimedia data, the data analysis unit 31 transmits the multimedia data to the data combining unit 37 and separates the data in the form of translation set by the translation setting unit 32 from the multimedia data. . For example, as shown in FIG. 3B, when the translated form is speech, the data analysis unit 31 separates speech data from the multimedia data.

  Further, according to the representation form of the separated data, the data analysis unit 31 transmits image data to the character recognition unit 33, transmits voice data to the voice recognition unit 34, and transmits character data to the character recognition unit 34. It transmits to the translation part 35.

  The character recognition unit 33 recognizes characters in the language to be translated set by the translation setting unit 32 from the image data received from the data analysis unit 31. Further, the character recognition unit 33 creates character data of the recognized character and transmits it to the character translation unit 35.

  The speech recognition unit 34 recognizes the speech of the language to be translated set by the translation setting unit 32 from the speech data received from the data analysis unit 31. The voice recognition unit 34 creates character data from the recognized voice and transmits it to the character translation unit 35.

  The character translation unit 35 translates character data received from the data analysis unit 31, the character recognition unit 33, and the voice recognition unit 34. Specifically, the character translation unit 35 translates the character data from the translated language set by the translation setting unit 32 to the translation language set by the translation setting unit 32. At this time, the character translation unit 35 can access the translation DB 22 if necessary and refer to dictionary data, history data of language conversion performed in the past, and the like. The character translation unit 35 transmits the translated character data to the data conversion unit 36.

  The data conversion unit 36 converts the character data received from the character translation unit 35 into data in a translation form set by the translation setting unit 32. In addition, the data conversion unit 36 transmits the converted data to the data combining unit 37. Note that the conversion from character data to image data means that a character indicated by a character code is converted to an actual character image. As shown in FIG. 3B, when the translation form is character data, the data conversion unit 36 transmits the character data received from the character translation unit 35 to the data combination unit 37 without converting it. To do.

  The data combiner 37 combines the data received from the data converter 36 with the multimedia data received from the data analyzer 31. In addition, the data combination unit 37 transmits the combined multimedia data to the data transmission unit 38.

  At this time, when the multimedia data includes data having the same expression form as the data from the data conversion unit 36, the data is combined with the multimedia data by combining the data with the same expression form. For example, when the multimedia data includes image data and the data from the data conversion unit 36 is image data, the image data is combined and combined with the multimedia data. . On the other hand, when the multimedia data does not include data having the same representation form as the data from the data conversion unit 36, the data from the data conversion unit 36 is added to the multimedia data to be combined with the multimedia data. Is done.

  The data sending unit 38 adds the transmission destination address set by the translation setting unit 32 to the multimedia data received from the data combining unit 37 and sends the multimedia data to the communication unit 21. As a result, the translated and combined multimedia data is transmitted from the multimedia translator 4 to the destination communication terminal 2b having the destination address. When an error such as a failure in translation occurs, it is desirable that the data sending unit 38 sends an error message to the transmission source address set by the translation setting unit 32.

  The processing operation of the multimedia translator 4 in the inter-terminal translation system 1 having the above configuration will be described with reference to FIG. FIG. 4 shows the processing operation when the multimedia translator 4 receives data from the outside.

  First, when the data receiving unit 30 receives data, the data analyzing unit 31 determines whether the received data is translation setting data or multimedia data (step S10 (hereinafter abbreviated as “S10”). The same goes for the other steps))). If the translation setting data is determined, the translation setting unit 32 is set based on the translation setting data (S11), and the process ends.

  On the other hand, when it is determined that the data is multimedia data, the data analysis unit 31 determines whether the translated form set by the translation setting unit 32 is an image, a voice, or a character (S12). ). When the translated form is an image, the data analysis unit 31 separates the image data from the multimedia data (S13), and for the separated image data, the translated language set in the translation setting unit 32 is used. The character recognition unit 33 recognizes the character and creates recognized character data (S14).

  On the other hand, when the translated form is speech, the data analysis unit 31 separates the speech data from the multimedia data (S15), and the translated speech set by the translation setting unit 32 is set for the separated speech data. The speech of the language is recognized by the speech recognition unit 34, and recognized character data is created (S16). If the translated form is a character, the data analysis unit 31 separates the character data from the multimedia data (S17).

  Next, the character translation unit 35 translates the translated language character data created or separated in steps S14, S16, and S17 into the translation language character data set by the translation setting unit 32 (S18). Next, the translated character data is converted by the data conversion unit 36 into data in the translation form set by the translation setting unit 32 (S19). Then, the converted data is combined with the original multimedia data by the data combining unit 37, and the combined multimedia data is transmitted to the destination communication terminal 2b (S20). Thereafter, the process ends.

  In the inter-terminal translation system 1 as described above, what kind of multimedia data the multimedia translator 4 sends to the multimedia data transmitted from the source communication terminal 2a to the multimedia translator 4 is the destination communication terminal. Whether to transmit to 2b will be described based on the example shown in FIGS. In FIG. 5 to FIG. 7, the voice is indicated by a balloon.

  FIG. 5A shows the contents of one multimedia data transmitted from the communication terminal 2a of the transmission source to the multimedia translator 4. As illustrated, the multimedia data includes image data and audio data.

  On the other hand, FIG. 5 (b) shows that the multimedia translator 4 translates and converts English speech data in the multimedia data shown in FIG. 5 (a) into Japanese image data. The contents of the multimedia data to be transmitted to the communication terminal 2b as the transmission destination are shown by being combined with the multimedia data. That is, by combining a Japanese character image “I live in Tokyo” with the image shown in FIG. This is done to obtain the image shown in FIG.

  As shown in the figure, by displaying English audio content in the image in Japanese characters, if you can understand Japanese even if you do not understand English, you can understand the audio content . However, it is not possible to grasp what emotion the user of the communication terminal 2a of the transmission source has about the content of the sound by using only the characters.

  On the other hand, in this embodiment, as shown in FIG. 5B, since the audio data and the image data in the original multimedia data are also transmitted to the communication terminal 2b of the transmission destination, The emotion of the user of the communication terminal 2a as the transmission source can be read from the facial expression of the person, and more accurate communication than before can be achieved.

  When a Japanese character image is combined with the image shown in FIG. 10A, the Japanese character image is changed so as not to impair the information obtained from the image shown in FIG. It is desirable to perform image composition so that the image is displayed at the end of the display area. In addition, when a subtitle area exists in the display area, it is desirable to perform image composition so that a Japanese character image is displayed in the subtitle area.

  FIG. 6A shows the contents of other multimedia data that the transmission source communication terminal 2 a transmits to the multimedia translator 4. As illustrated, the multimedia data includes only image data, and the image includes a signboard image written in Japanese.

  On the other hand, FIG. 6B shows that the multimedia translator 4 translates and converts the Japanese image data in the multimedia data shown in FIG. 6A into English voice data, and converts the converted voice data into the above-mentioned voice data. The contents of the multimedia data to be transmitted to the communication terminal 2b as the transmission destination are shown by being combined with the multimedia data. That is, by adding the English voice “I live in Tokyo.” To the image shown in FIG. 11A, the contents of the multimedia data shown in FIG.

  On the other hand, FIG. 6C shows that the multimedia translator 4 translates and converts Japanese image data in the multimedia data shown in FIG. 6A into English image data. The contents of the multimedia data to be transmitted to the communication terminal 2b as the transmission destination are shown by being combined with the multimedia data. That is, by adding an English character image “I live in Tokyo.” To the image shown in FIG. 10A, the contents of the multimedia data shown in FIG.

  On the other hand, FIG. 6D shows that the multimedia translator 4 translates and converts Japanese image data in the multimedia data shown in FIG. 6A into English character data. The contents of the multimedia data to be transmitted to the communication terminal 2b as the transmission destination are shown by being combined with the multimedia data. That is, by adding English character data “I live in Tokyo.” To the image data shown in FIG. 11A, the contents of the multimedia data shown in FIG. In this case, English character data can be used as e-mail data, and image data can be used as data attached to the e-mail.

  FIG. 7A shows the contents of other multimedia data transmitted from the communication terminal 2 a of the transmission source to the multimedia translator 4. As shown in the figure, the multimedia data has a form in which image data is attached to an electronic mail composed of English character data.

  On the other hand, FIG. 6B shows that the multimedia translator 4 translates and converts the English character data in the multimedia data shown in FIG. 6A into Japanese image data. The contents of the multimedia data to be transmitted to the communication terminal 2b as the transmission destination are shown by being combined with the multimedia data. That is, by combining a Japanese character image “I live in Tokyo” with the image shown in FIG. This is done to obtain the image shown in FIG.

[Embodiment 2]
Next, another embodiment of the present invention will be described with reference to FIG. In the present embodiment, the inter-terminal translation system 1 is applied to a mobile phone system. In addition, the same code | symbol is attached | subjected to the structure which has the function similar to the structure demonstrated in the said embodiment, and the description is abbreviate | omitted.

  FIG. 8 shows a schematic configuration of the mobile phone system 50 of the present embodiment. As shown in the figure, the mobile phone system 50 includes mobile phone terminals 51 and 51 as communication terminals, wireless base stations 52 and 52 that perform wireless communication with the mobile phone terminals 51 and 51, and the multimedia translator 4. It is a configuration. That is, the multimedia translator 4 is provided in a relay station provided between the radio base stations 52 and 52. Note that the multimedia translator 4 may be provided in the radio base station 52.

  The operation of the mobile phone system 50 having the above configuration will be described. First, when a user of the mobile phone terminal 51 takes a moving image using a camera and a microphone attached to the mobile phone terminal 51, the mobile phone terminal 51 creates moving image data. The moving image data here includes not only moving images but also sounds. Next, the mobile phone terminal 51 transfers the created moving image data to the multimedia translator 4 via the wireless base station 52 in the form of a videophone or attached to an e-mail.

  The translation setting data is created by the user of the mobile phone terminal 51 operating the mobile phone terminal 51. Then, the cellular phone terminal 51 transmits the created translation setting data to the multimedia translator 4 via the radio base station 52 together with the moving image data. In the case of a telephone system, since terminals are connected via a line, the translation setting data does not need to include a transmission source address or a transmission destination address.

  The multimedia translator 4 translates the moving image data based on the received translation setting data. At this time, the translation of the moving image is performed on the still image extracted by extracting a still image every predetermined time or extracting a still image as a key. Then, the multimedia translator 4 transmits the translated video data to the mobile phone terminal 51 of the other party via the radio base station 52.

  In the case of a videophone, since the mobile phone terminals 51 and 51 transmit and receive video data, the multimedia translator 4 transmits video data transmitted from one mobile phone terminal 51 to the other mobile phone terminal 51. Not only that, but also the moving image data transmitted from the other mobile phone terminal 51 to the other mobile phone terminal 51 is also translated.

  In addition, this invention is not limited to said embodiment, A various change is possible in the range shown to the claim.

  For example, in the above-described embodiment, translation is performed only for one of the expression forms among images, sounds, and characters, but it is also possible to perform translation for a plurality of expression forms.

  By the way, in an electronic mail currently used on the Internet or the like, an emoticon (emotion) may be used in order to convey a nuance that is difficult to convey only with characters. This emoticon is often different from country to country as well as language. Therefore, the multimedia translator 4 may translate emoticons.

  The translation processing unit 20 of the multimedia translator 4 may be configured by hardware logic, or may be realized by software using a CPU as follows.

  That is, the multimedia translator 4 has a central processing unit (CPU) that executes instructions of a control program that realizes each function, a read only memory (ROM) that stores the program, and a random access memory (RAM) that expands the program. ), A storage device (recording medium) such as a memory for storing the program and various data. An object of the present invention is a recording medium in which a program code (execution format program, intermediate code program, source program) of a control program of the multimedia translator 4 which is software for realizing the functions described above is recorded so as to be readable by a computer. Can also be achieved by reading the program code recorded on the recording medium and executing it by the computer (or CPU or MPU).

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a disk system including a magnetic disk such as a flexible disk / hard disk and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R, and an IC card. A card system such as an optical card (including a memory card) or a semiconductor memory system such as a mask ROM / EPROM / EEPROM / flash ROM can be used.

  Further, the multimedia translator 4 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a carrier wave or a data signal sequence in which the program code is embodied by electronic transmission.

  The present invention can also be applied to use for translating multimedia data downloaded to a communication terminal from a server or Internet site.

It is a block diagram which shows schematic structure of the multimedia translator in the inter-terminal translation system which is one Embodiment of this invention. It is a block diagram which shows schematic structure of the said inter-terminal translation system. It is a figure which shows the content of the translation setting data used with the said multimedia translator in a table format. It is a flowchart which shows the processing operation of the said multimedia translator. FIG. 4A is a diagram showing the contents of one multimedia data transmitted from the transmission source communication terminal to the multimedia translator, and FIG. 4B shows the multimedia translator connected to the destination communication terminal. It is a figure which shows the content of the multimedia data to transmit. (A) in the figure shows the contents of other multimedia data transmitted from the communication terminal of the transmission source to the multimedia translator, and (b) to (d) in FIG. It is a figure which shows the content of the multimedia data transmitted to a previous communication terminal. FIG. 4A is a diagram showing the contents of other multimedia data transmitted from the transmission source communication terminal to the multimedia translator, and FIG. 4B is a communication terminal to which the multimedia translator is the transmission destination. It is a figure which shows the content of the multimedia data transmitted to. It is a block diagram which shows schematic structure at the time of applying the said inter-terminal translation system to a mobile telephone system.

Explanation of symbols

1 Inter-terminal translation system 2 Communication terminal 4 Multimedia translator 30 Data receiving unit (receiving means)
31 Data analysis unit (language information extraction means)
33 Character recognition part (translation means)
34 Speech recognition unit (translation means)
35 Character translation (translation means)
36 Data converter (combining means)
37 Data combiner (combination means)
38 Data sending part (sending means)
50 Mobile phone system (translation system between terminals)
51 Mobile phone terminal

Claims (10)

A multimedia translator that translates multimedia data including at least one of image data, sound data, and character data, each of which is an image, sound, and character.
Receiving means for receiving the multimedia data;
Language information extracting means for extracting information in a predetermined language from the multimedia data received by the receiving means;
A translation means for translating information consisting of a predetermined language extracted by the language information extraction means into another predetermined language;
Coupling means for coupling the data translated by the translation means to the multimedia data received by the receiving means;
A multimedia translator comprising: sending means for sending out the multimedia data combined by the combining means.   The combining means converts the data translated by the translation means into an expression form different from the expression form of the data extracted by the language information extraction means, and converts the converted data into multimedia data received by the receiving means. The multimedia translator according to claim 1, wherein the multimedia translator is combined.   When the multimedia data received by the receiving means includes image data, and the data to be combined with the multimedia data by the combining means is image data, the combining means includes the multimedia data. 2. The multimedia translator according to claim 1, wherein data combination is performed so that an image based on data combined with the multimedia data is synthesized with a caption area in an image based on the image data. The receiving means further receives translation setting data in which the translated language and the translated language are set,
The language information extracting means is for extracting data of a language to be translated set in translation setting data from the multimedia data received by the receiving means.
The multimedia translator according to claim 1, wherein the translation means translates the data extracted by the language information extraction means into a translation language set in translation setting data.   2. The multimedia translator according to claim 1, wherein the translation unit converts the information in the predetermined language extracted by the language information extraction unit into character form data and then translates the data into another predetermined language. . A communication terminal that transmits multimedia data,
The multimedia translator according to any one of claims 1 to 5, which translates multimedia data transmitted by the communication terminal of the transmission source;
An inter-terminal translation system comprising: a communication terminal as a transmission destination for receiving multimedia data translated by the multimedia translator.   7. The inter-terminal translation system according to claim 6, wherein the source and destination communication terminals are mobile phone terminals. A method for controlling a multimedia translator that translates multimedia data including at least one of image data, sound data, and character data, each of which is an image, sound, and character.
Receive the above multimedia data,
Extract the information in a predetermined language from the received multimedia data,
Translate the information in the extracted language into another language,
Combine the translated data with the received multimedia data,
A method for controlling a multimedia translator, wherein the combined multimedia data is sent out.   A control program for operating the multimedia translator according to any one of claims 1 to 5, wherein the control program causes a computer to function as each of the means.   A computer-readable recording medium on which the control program according to claim 9 is recorded.

Images