WO2004028161A1 - 手話通訳システムおよび手話通訳方法 - Google Patents
手話通訳システムおよび手話通訳方法 Download PDFInfo
- Publication number
- WO2004028161A1 WO2004028161A1 PCT/JP2003/011757 JP0311757W WO2004028161A1 WO 2004028161 A1 WO2004028161 A1 WO 2004028161A1 JP 0311757 W JP0311757 W JP 0311757W WO 2004028161 A1 WO2004028161 A1 WO 2004028161A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sign language
- terminal
- deaf
- video
- language interpreter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/567—Multimedia conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
- H04M2201/38—Displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
- H04M2201/50—Telephonic communication in combination with video communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2203/00—Aspects of automatic or semi-automatic exchanges
- H04M2203/20—Aspects of automatic or semi-automatic exchanges related to features of supplementary services
- H04M2203/2061—Language aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/42025—Calling or Called party identification service
- H04M3/42085—Called party identification service
- H04M3/42102—Making use of the called party identifier
- H04M3/4211—Making use of the called party identifier where the identifier is used to access a profile
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/563—User guidance or feature selection
Definitions
- the present invention provides a sign language interpreting system and a method for enabling a deaf person who can sign language to talk with a non-deaf person who cannot sign language using a telephone.
- a sign language interpreter that can provide videophone administrative services to persons with deafness even if there is no resident who can sign language at government offices, hospitals, police, etc. System and sign language interpretation.
- the videophone terminal used by the deaf and the videophone terminal and sign language interpreter used by the non-deaf person It is necessary to connect the videophone terminals used by each other to each other.
- a multipoint connection device MCU that connects three or more videophone terminals to each other and conducts a video conference, and It was necessary to set up a video conference by connecting the MCU from the videophone terminals of non-deaf and sign language interpreters.
- deaf and non-deaf and sign language interpreters need to consult with the MCU in advance and make reservations with the MCU. It is practically difficult to discuss in advance among deaf people.
- the main object of the present invention is to provide a sign language interpreter system and a sign language interpreter that can respond to emergencies without the need for an aggressor, a non-deaf person, and a sign language interpreter to consult in advance and reserve an MCU. Is to provide a way. Disclosure of the invention
- the sign language interpreting system includes a video phone terminal for a deaf person used by a deaf person who can sign language, a video phone terminal for a non deaf person used by a non deaf person who cannot sign language, A sign language interpreting system for interconnecting a sign language interpreter TV telephone terminal used by a sign language interpreter and providing a sign language interpreter in a video telephone conversation between a deaf person and a non-deaf person, It has a sign language interpreter registration table in which the terminal number of the sign language interpreter TV telephone terminal is registered.
- a function for accepting calls from either the consumer videophone terminal or non-deaf videophone terminal, and a function for prompting the caller videophone terminal that has accepted the call to enter the terminal number of the call destination The function to retrieve the sign language interpreter's terminal number from the sign language interpreter registration table, the function to call the sign language interpreter's videophone terminal based on the retrieved sign language interpreter's terminal number, and the acquired called terminal Connection means having a function of calling a called videophone terminal by a number, and at least a video from a non-deaf videophone terminal and a video from a sign language interpreter videophone terminal for a deaf person's videophone terminal And a function of transmitting at least a video from a videophone terminal for a deaf and a voice from a videophone terminal for a sign language interpreter to a non-deaf videophone terminal.
- Communication means having a function of transmitting at least a video from a video telephone terminal for a deaf and a voice from
- a call from either a deaf or non-deaf terminal automatically connects the other party's terminal with the sign language interpreter's terminal and the video and audio required for sign language interpretation.
- the delegates, non-deaf and sign language interpreters can have videophone conversations via sign language interpreters without prior consultation.
- the sign language interpreter since it has a function to retrieve and call the sign language interpreter's terminal number registered in the sign language interpreter registration table, the sign language interpreter can respond anywhere, as long as it can be called, and it is flexible and efficient A simple sign language interpreting system can be configured.
- the sign language interpreting system according to claim 2 is the sign language interpreting system according to claim 1, wherein selection information for selecting a sign language interpreter is registered in a sign language interpreter registration table, and the connection means is a caller.
- the sign language interpreting system described in claim 3 is the sign language interpreting system described in claim 1 or claim 2.
- the sign language interpreter registration table has a reception flag indicating whether or not a sign language interpreter can be accepted.
- the registered means has a function of retrieving the terminal number of the sign language interpreter that can be accepted by referring to the reception flag in the sign language interpreter registration table.
- a sign language interpreter that can be accepted can be automatically selected and called, thereby eliminating unnecessary calls. Therefore, a more flexible and efficient sign language interpreting system can be configured.
- a sign language interpreting system is the sign language interpreting system according to any one of claims 1 to 3, wherein the connection means has a function of generating a text message to be transmitted to each terminal.
- the communication means has a function of transmitting the generated text message to each terminal.
- the sign language interpreting system is the sign language interpreting system according to claim 4, wherein the connection means has a function of generating a voice message to be transmitted to a non-deaf terminal.
- the communication means has a function of transmitting the generated voice message to the videophone terminal for non-deaf people.
- the sign language interpreting system is the sign language interpreting system according to any one of claims 1 to 5, wherein the connection means registers terms used during a dialogue according to an instruction from each terminal. And a function of extracting a term registered according to a command from each terminal to generate a telop, and the communication means has a function of transmitting the generated telop to each terminal.
- telops By registering terms that are difficult for sign language interpretation in advance, telops can be displayed on the screen of each terminal, and a more rapid and accurate videophone conversation can be realized.
- a sign language interpreting system is the sign language interpreting system according to any one of claims 1 to 6, wherein a communication means is provided for a non-deaf person to a television telephone terminal for a deaf person. It has the function of sending one of the video from the videophone terminal and the video from the videophone terminal for sign language interpreters as the main screen, and transmitting the synthesized video as the other child screen. .
- the image of the non-deaf person and the image of the sign-language interpreter are simultaneously displayed on the screen of the video phone terminal for the deaf by picture-in-picture, so that the deaf person can see the face of the non-deaf person. It can read the sign language of a sign language interpreter.
- the sign language interpreting system according to claim 8 is the sign language interpreting system according to any one of claims 1 to 7, wherein the communication means is provided for a non-deaf person's television telephone terminal.
- the video from the videophone terminal is used as the main screen, and the video from the signing interpreter's videophone terminal is synthesized as the subscreen. It has a sending function.
- the image of the deaf person and the image of the sign language interpreter are simultaneously displayed on the screen of the video phone terminal for non-deaf people in a picture-in-picture manner.
- the expression of the sign language interpreter can be confirmed while watching, and the interpretation of the voice interpreted by the sign language interpreter becomes easy.
- a sign language interpreting system is the sign language interpreting system according to any one of claims 1 to 8, wherein the communication means is for a deaf person to a sign language interpreter television telephone terminal. It has a function of transmitting an image obtained by synthesizing an image from a videophone terminal and an image from a non-deaf person.
- the images of the deaf and non-deaf are simultaneously displayed on the screen of the sign-language interpreter's videophone terminal, so that the sign-language interpreter can read the sign language of the deaf and simultaneously display the expression of the non-deaf It can be confirmed and the voice of non-deaf people can be easily read.
- the sign language interpreting method comprises: a video phone terminal for a deaf person used by a deaf person who can sign language; a video phone terminal for a non deaf person used by a non deaf person who cannot sign language; A method of providing a sign language interpreter in a video phone conversation between a deaf person and a non-deaf person by interconnecting a sign language interpreter videophone terminal used by a sign language interpreter.
- a call from either the video phone terminal for the deaf or the non-deaf video phone terminal automatically connects the terminal of the other party with whom the user wants to talk and the sign language interpreter's terminal to perform sign language interpretation. Necessary video and audio communication is performed, so that deaf persons, non-deaf persons, and sign language interpreters can conduct videophone conversations through sign language interpreters without consultation in advance.
- the sign language interpreter since it has a function to retrieve and call the sign language interpreter's terminal number registered in the sign language interpreter registration table, the sign language interpreter can respond anywhere, as long as it can be called, and it is flexible and efficient A simple sign language interpreting system can be configured.
- FIG. 1 is a system configuration diagram of a sign language interpreting system according to an embodiment of the present invention.
- FIG. 2 is a diagram showing an example of an image displayed on each screen of a deaf person terminal, a non-deaf person terminal, and a sign language interpreter terminal by the sign language interpreting system of the present invention.
- FIG. 3 is a processing flowchart of a control device of the sign language interpreting system according to one embodiment of the present invention.
- FIG. 4 is a diagram showing an example of a sign language interpreter registration table.
- FIG. 5 is a diagram showing an example of a screen for prompting input of a terminal number of a call destination.
- FIG. 6 is a diagram showing an example of a screen for prompting input of sign language interpreter selection conditions.
- FIG. 7 is a diagram showing an example of a screen displaying a candidate list of sign language interpreters.
- FIG. 8 is a system configuration diagram of a sign language interpreting system according to another embodiment of the present invention.
- FIG. 9 is a diagram showing an example of a connection destination table.
- FIG. 10 is a processing flowchart of a control device of a sign language interpreting system according to another embodiment of the present invention.
- FIG. 1 shows a system configuration diagram of a sign language interpreting system according to an embodiment of the present invention.
- This embodiment shows an example of a system configuration in a case where each terminal used by a deaf person, a non-deaf person, and a sign language interpreter is a telephone type videophone terminal connected to a public telephone line.
- reference numeral 100 denotes a sign language interpreting system installed at a sign language interpreting center that provides a sign language interpreting service, and a video telephone terminal for deaf people used by deaf people via a public telephone line 200 ( (Hereinafter referred to as a deaf person's terminal) 3 0 0 and a non-deaf person's videophone terminal (hereinafter referred to as a non-deaf person's terminal) 3 1 0 and a sign language used by a sign language interpreter
- a video telephone terminal for interpreters (hereinafter referred to as a sign language interpreter terminal) is connected to provide a video telephone conversation service between deaf and non-deaf persons via a sign language interpreter. Things.
- the deaf person terminal 300, the non-deaf person terminal 310, and the sign language interpreter terminal 320 are television cameras 300a, 310a, and 320a, respectively, for imaging each user, and a display for displaying received images. Screens 300b, 310b, and 320b, and dial pads 300c, 310c, and 320c for inputting numbers and information are provided.
- the non-deaf terminal 310 and the sign language interpreter terminal 320 are provided with headsets 310d and 320d for inputting and outputting voices to and from the user. Hand-held handsets are used for input and output of voice in ordinary telephone-type terminals.However, in this case, sign language is used, and hands must be able to move freely. The following description assumes that a headset that is fixed to the head is used. Note that a headset is not shown in the deaf person terminal 300, but in the case where an attendant is present or the like, a voice call may be used together using the headset.
- a video telephone terminal connected to a public line for example, there is an ISDN video telephone terminal compliant with IT 11_ Recommendation: ⁇ . 320, but the present invention is not limited to this and uses a unique protocol. You may use a videophone terminal.
- the public telephone line includes a wireless telephone line
- the videophone terminal may be a mobile phone or a mobile terminal having a videophone function.
- the sign language interpreting system 100 includes a deaf terminal line interface (hereinafter, the interface is abbreviated as I ZF) 120 for connecting to a deaf terminal and a non-deaf terminal for connecting to a non-deaf terminal.
- Terminal IZF 140 and a sign language interpreter terminal line I ZF 160 for connection to the sign language interpreter terminal, multiplexing and demultiplexing video, audio, and data signals, respectively.
- the audio codecs for compression and decompression are connected to 126,146,166.
- each line I / F, each multiplexing / demultiplexing device, each video codec, and each audio codec correspond to the protocol used by each terminal.
- the video input of the video codec 124 for the deaf terminal the video output of the video codec 144 for the non-deaf terminal and the video codec 1664 for the sign language interpreter terminal are included.
- a video synthesizing device 128 for synthesizing the output and the output of the telop memory 132 for the deaf terminal is connected.
- Speech codec for deaf terminal 1 2 6 includes voice codec for non-deaf terminal 1 4 6 speech output and speech codec for sign language interpreter terminal 1 6 6
- a speech synthesizer 130 for synthesizing the speech output with the speech synthesizer is connected.
- a deaf person's terminal basically does not perform input / output of voice
- the speech codec 126 and the speech synthesizer 130 for the deaf person terminal can be omitted. It is preferable to provide a voice communication function because there may be a case where it is desired to transmit the environmental sound of the person to the non-deaf person terminal or a case where the deaf person has an attendant.
- the video codec for non-deaf user terminals 144 The video input for the deaf terminal codec 124 and the codec for sign language interpreter terminal video output 164 A video synthesizing device 148 for synthesizing the output and the output of the telop memory for non-deaf person's terminal 152 is connected.
- the speech input of the speech codec for non-deaf terminals 146 includes the speech output of speech codec for deaf terminals 126 and the speech output of speech codec 166 for sign language interpreter terminals. Is connected to the speech synthesizer 150 that synthesizes the sound.
- the display of the sign language interpreter's image can be omitted on non-deaf terminals.
- displaying a sign language interpreter's image makes it easier to interpret the voice interpreted by the sign language interpreter, so it is preferable to be able to synthesize the sign language interpreter's image.
- the video codec for sign language interpreter terminals 164 The video input of 64 includes a video codec for deaf terminals 124 The video output of 24 and the video codec for non-deaf terminals 144 A video synthesizing device 168 for synthesizing the output and the output of the telop memory 172 for the sign language interpreter terminal is connected.
- the speech input of speech codec 166 for sign language interpreter terminals includes the speech output of speech codec 126 for deaf terminals and the speech output of speech codec 146 for non-deaf terminals. Is connected to a speech synthesizer 170 for synthesizing.
- the sign language interpreter terminal can omit the display of images of non-deaf people, but by displaying the images of non-deaf people, it is possible to interpret the voice of the non-deaf people when sign language interpretation is performed. Therefore, it is preferable to be able to synthesize an image of a non-deaf person.
- the sign language interpreter system 100 has a sign language interpreter table 18 2 in which the terminal numbers of the sign language interpreter terminals used by the sign language interpreter are registered, and each line I ZF 120, 140, 16 0, each multiplexing / demultiplexing device 1 2 2, 1 4 2, 1 6 2, each video synthesizing device 1 2, 8, 1 48, 1 68, each audio synthesizing device 1 3 0, 1 5 0, 1 7 0, having a control device 180 connected to each of the telop memories 13 2, 15 2, 17 2, for calling from either a deaf or non-deaf terminal Accepting function, function to prompt the calling terminal to input the terminal number of the callee, function to retrieve the terminal number of the sign language interpreter from the sign language interpreter registration table 18 2, and function to call the retrieved terminal number
- Image synthesizer And a function for switching between video and audio synthesis methods in each audio synthes
- FIG. 2 shows an example of an image displayed on each terminal screen during a TV conversation with the sign language interpreting system of the present invention.
- FIG. 2 (a) shows a screen of a deaf person terminal.
- the image combining device 128 displays an image obtained by synthesizing the image of the sign language interpreter terminal with the image of the non-deaf person terminal.
- the image of the non-deaf person is displayed as a main screen
- the image of the sign language interpreter is displayed as a child screen.
- One picture-in-picture may be displayed, or both may be displayed equally. If a sign language interpreter's image is displayed on a large scale, the sign language interpreted by the sign language interpreter will be more legible. It is preferable that the position of the child screen in the picture-in-picture display can be changed by a command from the terminal so as not to mask the important information of the main screen.
- FIG. 2 (b) shows a screen of a non-deaf terminal, and a video obtained by combining the video of the sign language interpreter terminal with the video of the deaf terminal by the video synthesizing device 148 is displayed.
- the image of the deaf person is displayed as a parent screen, and the image of the sign language interpreter is displayed as a child screen, but the image of the sign language interpreter is omitted and only the image of the deaf person is displayed. You may make it.
- the image of the sign language interpreter By displaying the image of the sign language interpreter on the sub-screen, the sound interpreted by the sign language interpreter becomes more legible.
- FIG. 2 (c) shows a screen of the sign language interpreter terminal, in which an image obtained by combining the image of the non-deaf terminal with the image of the deaf terminal is displayed by the image synthesizing device 168.
- the image of a deaf person is displayed as a main screen and the image of a non-deaf person is displayed as a sub-picture, but the image of the non-deaf person is omitted and only the image of the deaf person is displayed. You may make it.
- Non-deaf child footage When displayed on the screen, the sound of non-deaf people who are subject to sign language interpretation will be more legible.
- the deaf person terminal is provided with a non-deaf sound device 130 so as to be able to cope with the case of transmitting the environmental sound from the deaf person terminal or the presence of an attendant.
- the speech of the signer interpreter terminal and the speech of the sign language interpreter terminal are output, and the speech of the sign language interpreter terminal and the speech of the sign language interpreter terminal are synthesized by the speech synthesizer 150 for the non-deaf person terminal.
- the voice is output, and a voice synthesized by the voice of the non-deaf terminal and the voice of the deaf terminal is output to the sign language interpreter terminal by the voice synthesizer 170.
- the voice synthesizers 130, 150, 170 are omitted, and only the non-deaf person Connect the output of the voice codec 1 4 6 to the input of the voice codec 1 6 6 for the sign language interpreter, and connect the output of the voice codec 1 6 6 for the sign language interpreter to the voice code for the non-deaf person. It may be connected to the input of deck 146.
- the operation of each video synthesizing device 128, 148, 168 and each voice synthesizing device 130, 150, 170 is controlled by the controller 180, and from each terminal.
- the user can change the video display method or audio output method by pressing a predetermined number button on the dial pad. This means that the depressing of the dial pad number button at each terminal is detected as a data signal or tone signal at each demultiplexer 122, 142, 162 and controlled. It can be realized by transmitting it to the device.
- each terminal can be used flexibly, such as selecting and displaying only the necessary video and audio according to the purpose, switching between the main screen and the sub-screen, and changing the position of the sub-screen.
- each video synthesizing device 128, 148, 168 includes a telop memory 1 32 for a deaf terminal and a telop memory 1 for a non-deaf terminal, respectively.
- the telop memory 17 2 for sign language interpreter terminals is connected, and the contents of each telop memory 1 32, 1 52, and 1 72 can be set from the controller 180. .
- the message for each terminal is set in each of the telop memories 13 2, 15 2, 17 2, and each video compositing device 1 28, By issuing a command to select the signal of each telop memory 1 32, 15 2 and 17 2 to 1 48 and 16 8, the necessary message is transmitted to each terminal.
- a three-way call can be established.
- the terms correspond to the dial pad numbers of each terminal in advance, and the terms of the control device 180.
- the sign language interpreter registration table 18 2 of the control device 180 registers the sign language interpreter selection information and the terminal number of the terminal used by each sign language interpreter from an appropriate terminal (not shown). Keep it.
- Fig. 4 shows an example of the registration items registered in the sign language interpreter registration table 182.
- the information for selecting a sign language interpreter is information for selecting a sign language interpreter desired by the user.
- Gender ⁇ Age ⁇ Place of residence 'Specialized field ⁇ Register the level of sign language interpreter.
- the place of residence assumes that the user wants someone who has geographical knowledge about a specific area. Here, the area can be specified by zip code.
- Specialized fields are intended for cases where the content of the dialogue is specialized and the user wants someone who has specialized knowledge in the field or a person who is bright on topics in that field.
- Interpreters specialize in politics, law, business, education, science and technology, medical care, languages, sports and hobbies. It should be noted that, since the fields of specialization are diverse, it is possible to register hierarchically and search at the level desired by the user at the time of selection.
- each interpreter may be registered so that the user can select the desired qualification holder as a sign language interpreter.
- the terminal number is for a telephone-type videophone terminal connected to a public telephone line, the telephone number of the terminal will be registered.
- the sign language interpreter registration table 18 2 is provided with a reception flag indicating whether or not sign language interpreters can be accepted.
- the registered sign language interpreter calls the sign language interpreter center from his / her own terminal and dials. By inputting a command using the pad, the reception flag can be set or reset.
- sign language interpreters registered in the sign language interpreter registration table can set up the reception flag only when sign language interpreters can be accepted, thereby eliminating unnecessary calls. Can be quickly selected.
- FIG. 3 shows a processing flow of the control device 180.
- the Sign Language Interpretation System 100 can apply for a sign language interpreting service from either a deaf or non-deaf terminal, and if applying from a deaf terminal, a line I / F for the deaf terminal Non-deaf if you call the telephone number of the other side and apply from a non-deaf terminal 2003/011757
- the conditions for selecting the sign language interpreter entered by the caller are gender, age classification, and regional 'specialty' sign language level, and the gender and age registered in the sign language interpreter registration table 1 8 2 ⁇ Residential area ⁇ Specialty ⁇ Select the appropriate sign language interpreter based on the level. The area is specified using a postal code, and sign language interpreters are selected in order from the one whose residence is closest to the specified area. You can select any item if you do not need to specify it.
- a sign language interpreter whose reception flag is set is selected from the sign language interpreters corresponding to the selection conditions obtained by referring to the sign language interpreter registration table 18 2.
- a candidate list of sign language interpreters as shown in (1) is displayed to prompt the user to input the selection number of the desired sign language interpreter (S110).
- the selected number of the sign language interpreter input by the caller is obtained (S112), and the terminal number of the selected sign language interpreter is retrieved from the sign language interpreter registration table 182 and called (S11). 1 1 4). If there is a response from the sign language interpreter terminal (S116), the terminal number of the called party is retrieved and called (S118), and if a response is received from the called terminal (S112). 0), sign language P Kasumi 11757
- a caller and a callee may be notified to set a videophone conversation.
- the sign language interpreting system 100 is described as being composed of a line I / F, a multiplexing / separation measure, a video codec, a voice codec, a video synthesis device, a voice synthesis device, a control device, and the like. However, these need not necessarily be configured as individual HZWs, but may be configured so that the functions of each device are realized by software processing using a computer.
- the sign language interpreter terminal 320 is outside the sign language interpreting center like the deaf person terminal 300 and the non-deaf person terminal 310, and the sign language interpreter center is connected to the public telephone line.
- the present invention is not limited to this, and a part or all of the sign language interpreter is provided in the sign language interpreting center and the sign language interpreter is provided. It goes without saying that the interpreting center may provide sign language interpreting services.
- the sign language interpreter can participate in the sign language interpreting service anywhere as long as the terminal has a terminal that can be connected to a public telephone line. 2003/011757
- Sign-language interpreting services can be provided by using the reception flag effectively when time is available. By doing so, it will be possible to operate the sign language interpreting service, which is difficult to secure personnel, efficiently and stably. In particular, although sign language interpreters are increasing in number these days, even those with irregular time can use sign time effectively to provide sign language interpreting services.
- the video signal of the own terminal is not input to the video synthesizing devices 1, 1, 1, and 1, the video signal of the own terminal is also input and synthesized for video confirmation.
- a display function may be provided.
- the video and audio are synthesized for each terminal by the video synthesizing devices 128, 148, 168 and the voice synthesizing devices 130, 150, 170.
- the video and audio of all terminals may be combined and transmitted to each terminal.
- the telop memories 13 2, 15.2, 17 2 are provided, and the character telop is added to each terminal by adding it to the video synthesizing device 1 28, 1 48, 1 68 for each terminal.
- a display function was provided, a telop memory for storing voice information was provided, and a voice message was output to each terminal by adding it to the voice synthesizer 130, 150, 170 for each terminal. May be provided.
- a sign language interpreter it is possible to set up a videophone conversation via a sign language interpreter.
- FIG. 8 shows a system configuration diagram of a sign language interpreting system according to another embodiment of the present invention.
- each terminal used by a deaf person, a non-deaf person, and a sign language interpreter is an IP (Internet Protocol) type videophone terminal connected to the Internet and has a Web browser function.
- IP Internet Protocol
- 400 is a sign language interpreting center that provides a sign language interpreting service.
- Deaf terminal 600 non-deaf terminal 700, sign language interpreter terminal 4 3 1, 4
- a keyboard for information input to a general-purpose processing device (a) such as a personal computer having a video input I / F function, audio input / output I / F function, and network connection function. (B) and mouse (c), Web page and communication server presented from Web server 410
- a dedicated TV phone terminal may be used.
- the video telephone terminal connected to the Internet for example, there is an IP video telephone terminal or the like compliant with H.323 of the ITU-T recommendation, but the present invention is not limited to this, but uses an original protocol.
- a videophone terminal may be used.
- the Internet includes a wireless LAN type
- the videophone terminal may be a mobile phone or a mobile terminal having a videophone function that provides a web access function.
- the sign language interpreting system 400 is provided with a connection destination table 422 for setting each terminal address of a deaf person terminal, a non-deaf person terminal, and a sign language interpreter terminal to be connected, and is registered in the connection destination table 422.
- a communication service that has the function of connecting terminals and synthesizing video and audio received from each terminal and transmitting them to each terminal. It has a sign language interpreter registration table 412 for registering sign language interpreter selection information, a terminal address, and a reception flag as described above, and is accessed from the calling terminal using a Web browser.
- Web server 4 10 having the function of selecting the desired sign language interpreter, and setting the terminal addresses of the caller terminal, the call destination terminal, and the sign language interpreter terminal in the connection destination table 422 of the connection measure 42 0.
- FIG. 9 shows an example of the connection destination table 422.
- the terminal address of the deaf terminal, the terminal address of the non-deaf terminal, and the terminal address of the sign language interpreter terminal are registered as a set in the connection destination table 422.
- the connection destination table 422 is capable of registering a plurality of sets of such terminal addresses according to the processing capacity of the communication server 420, whereby a plurality of sign language interpreting services are provided at the same time.
- the terminal address registered in the connection destination table 422 is an address on the Internet, an IP address is generally used.However, the terminal address is not limited to this, and is assigned by, for example, a directory server. A name or the like may be used.
- the communication server 420 performs bucket communication according to a predetermined protocol with the deaf terminal, the non-deaf terminal, and the sign language interpreter terminal set in the connection destination table 422, Multiplexing and demultiplexing devices 122, 142, 162 in the sign language interpretation system 100 described above, video codecs 124, 144, 164, and audio codecs 122, 146, Equivalent to 16.6, Video Synthesizers 12.8, 14.8, 16.8, and Voice Synthesizers 13.0, 1550, 1700 JP2003 / 011757
- predetermined video and audio communication is performed between the deaf terminal, the non-deaf terminal, and the sign language interpreter terminal in the same manner as in the sign language interpreting system 100 described above, and the deaf person and the deaf person are deaf. Videophone conversations through sign language interpreters will be realized between persons.
- the terms registered in the term registration table 18 4 are obtained by using the controller 180 and the telop memories 13 2, 15 2, 17 2.
- a function was provided during a videophone conversation based on commands from the terminal and displayed as character telops on the terminal.In the present embodiment, a similar function is provided by software processing of the communication server 420. You may. Further, the term specified by each terminal by the Web server 410 may be displayed as a pop-up message to another terminal.
- a telop memory is provided in the communication By writing the term specified from the terminal to the telop memory via the web server 410, the character telop may be displayed on each terminal.
- connection process for connecting the terminal, the non-deaf terminal, and the sign language interpreter terminal was realized by the control device 180.However, in this embodiment, since each terminal has a Web access function, The connection processing is performed by the Web server 410.
- FIG. 10 shows a processing flow of the connection processing by the Web server 410.
- a sign language interpreting service can be applied from either a deaf or non-deaf terminal.
- Deaf or non-deaf people who apply for a sign language interpreter can access the Sign Language Interpretation Center's web server 410 from their own terminal using a web browser and log in to receive the sign language interpreter service. Processing is started. 1757
- the Web server 410 first acquires the terminal address of the caller (S200), and sets it in the connection destination table 4222 (S202). Next, a screen prompting for the input of the terminal address of the call destination similar to that of FIG. 5 is delivered to the caller terminal (S204), and the callee terminal address input by the caller is acquired in response to this screen. Yes (S206). In addition, a screen prompting for input of the sign language interpreter selection condition similar to that of FIG. 6 described above is delivered to the calling terminal (S208), and the sign language interpreter selection condition input by the caller is acquired in response to the screen. (S210).
- a sign language interpreter whose reception flag is set is selected from the sign language interpreters corresponding to the selection conditions acquired from the sign language interpreter registration table 4 1 2, and the caller terminal shown in FIG. 7 is used.
- a similar candidate list is distributed to prompt the user to enter the selection number of the desired sign language interpreter (S2122).
- the selected number of the sign language interpreter input by the caller is acquired, and the terminal address of the selected sign language interpreter is acquired from the sign language interpreter registration table 412 (S2114).
- the call screen is delivered to the sign language interpreter terminal based on the acquired terminal address of the sign language interpreter (S 2 16), and if there is a response to accept the call (S 2 18), the sign language interpreter is referred to.
- connection destination table 422 Is set in the connection destination table 422 (S220).
- a call screen is delivered to the callee terminal based on the obtained callee terminal address (S2222), and if there is a response to accept the call (S2224), The terminal address of the call destination is set in the connection destination table 422 (S226).
- a videophone conversation with a sign language interpreter is started (S228).
- the sign language interpreter terminal is described as being in the sign language interpreting system 400 of the sign language interpreting center.However, the present invention is not limited to this. Even if they are all outside the Sign Language Interpretation Center and connected via the Internet, they can be handled in exactly the same way.
- the videophone terminal used by the deaf / non-deaf / sign language interpreter is a telephone type videophone terminal connected to a public telephone line, and the videophone terminal is connected to the Internet.
- the configuration of the sign language interpreter system has been described separately for the case of an IP type videophone terminal.However, a telephone type videophone terminal and an IP type videophone terminal can communicate with each other by providing a gateway for protocol conversion.
- a sign language interpreting system that can communicate and supports any one of the protocols may be installed so as to support a videophone terminal using another protocol via a gateway.
- the sign language interpreting system can provide sign language interpreting services and provide sign language interpreting services wherever there is a terminal that can be connected to a public telephone line or the Internet. it can.
- Sign language interpreters It is not always necessary to visit the sign language interpreting center, it is possible to participate from homes and facilities and bases with video phone terminals, and it is also possible to provide sign language interpreting services using mobile phones and mobile terminals with video phone functions It is possible.
- the sign language interpreting system or the sign language interpreting method of the present invention it is not necessary for a deaf person, a non-deaf person, and a sign language interpreter to consult with each other in advance and reserve an MCU. This has the effect of being able to respond.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
Claims
Priority Applications (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2004537564A JPWO2004028161A1 (ja) | 2002-09-17 | 2003-09-16 | 手話通訳システムおよび手話通訳方法 |
| CA002499097A CA2499097A1 (en) | 2002-09-17 | 2003-09-16 | Sign language interpretation system and sign language interpretation method |
| EP03797602A EP1542465A4 (en) | 2002-09-17 | 2003-09-16 | SYSTEM AND METHOD FOR INTERPRETATION OF GESTUAL LANGUAGE |
| AU2003264434A AU2003264434B2 (en) | 2002-09-17 | 2003-09-16 | Sign language interpretation system and sign language interpretation method |
| US10/527,916 US20060234193A1 (en) | 2002-09-17 | 2003-09-16 | Sign language interpretation system and a sign language interpretation method |
| HK05112171.1A HK1077689A1 (zh) | 2002-09-17 | 2003-09-16 | 手语翻译系统及手语翻译方法 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2002269850 | 2002-09-17 | ||
| JP2002-269850 | 2002-09-17 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2004028161A1 true WO2004028161A1 (ja) | 2004-04-01 |
Family
ID=32024821
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2003/011757 Ceased WO2004028161A1 (ja) | 2002-09-17 | 2003-09-16 | 手話通訳システムおよび手話通訳方法 |
Country Status (10)
| Country | Link |
|---|---|
| US (1) | US20060234193A1 (ja) |
| EP (1) | EP1542465A4 (ja) |
| JP (1) | JPWO2004028161A1 (ja) |
| KR (1) | KR100679871B1 (ja) |
| CN (1) | CN1682535A (ja) |
| AU (1) | AU2003264434B2 (ja) |
| CA (1) | CA2499097A1 (ja) |
| HK (1) | HK1077689A1 (ja) |
| TW (1) | TW200405988A (ja) |
| WO (1) | WO2004028161A1 (ja) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2426247C2 (ru) * | 2006-09-30 | 2011-08-10 | Хуавэй Текнолоджиз Ко., Лтд. | Система, способ и многоточечный блок управления для реализации многоязычной конференцсвязи |
| JP2013015939A (ja) * | 2011-07-01 | 2013-01-24 | Nec System Technologies Ltd | 理解支援システム、支援端末、理解支援方法およびプログラム |
| CN104463250A (zh) * | 2014-12-12 | 2015-03-25 | 广东工业大学 | 一种基于达芬奇技术的手语识别翻译方法 |
| JP2022117644A (ja) * | 2021-02-01 | 2022-08-12 | 一般財団法人日本財団電話リレーサービス | 電話リレーシステム、及びコミュニケーションプラットフォーム |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2500999A1 (en) * | 2002-09-27 | 2004-04-08 | Ginganet Corporation | A videophone interpretation system and a videophone interpretation method |
| JP4761568B2 (ja) * | 2004-05-12 | 2011-08-31 | 貴司 吉峰 | 会話支援装置 |
| US20070239625A1 (en) * | 2006-04-05 | 2007-10-11 | Language Line Services, Inc. | System and method for providing access to language interpretation |
| CA2565693C (en) * | 2006-10-25 | 2016-01-05 | Universite De Sherbrooke | A method of representing information via sign language |
| CN101539994B (zh) * | 2009-04-16 | 2012-07-04 | 西安交通大学 | 一种手语语音互译系统及手语语音互译方法 |
| CN102044128A (zh) * | 2009-10-23 | 2011-05-04 | 鸿富锦精密工业(深圳)有限公司 | 紧急事件报警系统及方法 |
| TWI469101B (zh) * | 2009-12-23 | 2015-01-11 | Chi Mei Comm Systems Inc | 手語識別系統及方法 |
| DE102010009738A1 (de) * | 2010-03-01 | 2011-09-01 | Institut für Rundfunktechnik GmbH | Anordnung zum Übersetzen von Lautsprache in eine Gebärdensprache für Gehörlose |
| US8817966B2 (en) * | 2010-07-08 | 2014-08-26 | Lisa Marie Bennett Wrench | Method of collecting and employing information about parties to a televideo conference |
| TWI484450B (zh) * | 2011-08-23 | 2015-05-11 | Hon Hai Prec Ind Co Ltd | 手語翻譯系統、手語翻譯裝置及手語翻譯方法 |
| JP6158179B2 (ja) * | 2012-06-29 | 2017-07-05 | テルモ株式会社 | 情報処理装置および情報処理方法 |
| JPWO2014087571A1 (ja) * | 2012-12-07 | 2017-01-05 | テルモ株式会社 | 情報処理装置および情報処理方法 |
| US20150019201A1 (en) * | 2013-07-09 | 2015-01-15 | Stanley F. Schoenbach | Real-time interpreting systems and methods |
| US10600291B2 (en) | 2014-01-13 | 2020-03-24 | Alexis Ander Kashar | System and method for alerting a user |
| US10274908B2 (en) | 2014-01-13 | 2019-04-30 | Barbara Ander | System and method for alerting a user |
| US9852656B2 (en) * | 2014-01-13 | 2017-12-26 | Barbara Ander | Alarm monitoring system |
| CN103810922B (zh) * | 2014-01-29 | 2016-03-23 | 上海天昊信息技术有限公司 | 手语翻译系统 |
| US9276971B1 (en) * | 2014-11-13 | 2016-03-01 | Sorenson Communications, Inc. | Methods and apparatuses for video and text in communication greetings for the audibly-impaired |
| CN104540035B (zh) * | 2015-01-19 | 2018-02-23 | 安徽易辰无障碍科技有限公司 | 一种无障碍视频手语呼叫系统及方法 |
| CN106375307A (zh) * | 2016-08-30 | 2017-02-01 | 安徽易辰无障碍科技有限公司 | 一种抢单式视频云服务无障碍交流方法及系统 |
| CN107231374A (zh) * | 2017-07-08 | 2017-10-03 | 长沙手之声信息科技有限公司 | 基于在线手语翻译的聋人远程聊天方法 |
| US10909333B2 (en) * | 2017-11-07 | 2021-02-02 | Carrier Corporation | Machine interpretation of distress situations using body language |
| CN107819962A (zh) * | 2017-11-09 | 2018-03-20 | 上海市共进通信技术有限公司 | 基于家庭网关实现智能通话功能的系统及方法 |
| US10127833B1 (en) | 2017-11-10 | 2018-11-13 | Sorenson Ip Holdings Llc | Video relay service, communication system, and related methods for providing remote assistance to a sign language interpreter during a communication session |
| CN108766434B (zh) * | 2018-05-11 | 2022-01-04 | 东北大学 | 一种手语识别翻译系统及方法 |
| CN110083250A (zh) * | 2019-05-14 | 2019-08-02 | 长沙手之声信息科技有限公司 | 一种支持手语在线翻译的无障碍会议系统 |
| CN113361505B (zh) * | 2021-08-10 | 2021-12-07 | 杭州一知智能科技有限公司 | 基于对比解耦元学习的非特定人的手语翻译方法和系统 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06337631A (ja) * | 1993-05-27 | 1994-12-06 | Hitachi Ltd | 手話対話における対話制御装置 |
| JP2000152203A (ja) * | 1998-11-12 | 2000-05-30 | Mitsubishi Electric Corp | ビデオ対応コンピュータ・テレフォニー装置 |
| JP2002064634A (ja) * | 2000-08-22 | 2002-02-28 | Nippon Telegr & Teleph Corp <Ntt> | 通訳サービス方法及び通訳サービスシステム |
| JP2002169988A (ja) * | 2000-12-04 | 2002-06-14 | Nippon Telegr & Teleph Corp <Ntt> | 手話通訳提供方法及びシステム |
| JP2002262249A (ja) * | 2001-02-27 | 2002-09-13 | Up Coming:Kk | 対話支援システム及び方法、並びにコンピュータプログラム |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5047952A (en) * | 1988-10-14 | 1991-09-10 | The Board Of Trustee Of The Leland Stanford Junior University | Communication system for deaf, deaf-blind, or non-vocal individuals using instrumented glove |
| JP2779448B2 (ja) * | 1988-11-25 | 1998-07-23 | 株式会社エイ・ティ・アール通信システム研究所 | 手話言語変換装置 |
| JP3289304B2 (ja) * | 1992-03-10 | 2002-06-04 | 株式会社日立製作所 | 手話変換装置および方法 |
| US5659764A (en) * | 1993-02-25 | 1997-08-19 | Hitachi, Ltd. | Sign language generation apparatus and sign language translation apparatus |
| US5982853A (en) * | 1995-03-01 | 1999-11-09 | Liebermann; Raanan | Telephone for the deaf and method of using same |
| US6477239B1 (en) * | 1995-08-30 | 2002-11-05 | Hitachi, Ltd. | Sign language telephone device |
| EP0848552B1 (en) * | 1995-08-30 | 2002-05-29 | Hitachi, Ltd. | Sign language telephone system for communication between persons with or without hearing impairment |
| US5917888A (en) * | 1996-06-28 | 1999-06-29 | Mci Communications Corporation | System and method for enhanced telecommunications relay service with easy extension feature |
| US6240392B1 (en) * | 1996-08-29 | 2001-05-29 | Hanan Butnaru | Communication device and method for deaf and mute persons |
| JPH10262228A (ja) * | 1997-03-18 | 1998-09-29 | Toshiba Corp | 通信システム、多地点制御装置、映像情報表示方法 |
| US6570963B1 (en) * | 2000-10-30 | 2003-05-27 | Sprint Communications Company L.P. | Call center for handling video calls from the hearing impaired |
| US7333507B2 (en) * | 2001-08-31 | 2008-02-19 | Philip Bravin | Multi modal communications system |
| US7774194B2 (en) * | 2002-08-14 | 2010-08-10 | Raanan Liebermann | Method and apparatus for seamless transition of voice and/or text into sign language |
-
2003
- 2003-09-15 TW TW092125372A patent/TW200405988A/zh unknown
- 2003-09-16 WO PCT/JP2003/011757 patent/WO2004028161A1/ja not_active Ceased
- 2003-09-16 US US10/527,916 patent/US20060234193A1/en not_active Abandoned
- 2003-09-16 EP EP03797602A patent/EP1542465A4/en not_active Withdrawn
- 2003-09-16 HK HK05112171.1A patent/HK1077689A1/zh unknown
- 2003-09-16 KR KR1020057002914A patent/KR100679871B1/ko not_active Expired - Fee Related
- 2003-09-16 AU AU2003264434A patent/AU2003264434B2/en not_active Ceased
- 2003-09-16 CA CA002499097A patent/CA2499097A1/en not_active Abandoned
- 2003-09-16 CN CNA038219395A patent/CN1682535A/zh active Pending
- 2003-09-16 JP JP2004537564A patent/JPWO2004028161A1/ja active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06337631A (ja) * | 1993-05-27 | 1994-12-06 | Hitachi Ltd | 手話対話における対話制御装置 |
| JP2000152203A (ja) * | 1998-11-12 | 2000-05-30 | Mitsubishi Electric Corp | ビデオ対応コンピュータ・テレフォニー装置 |
| JP2002064634A (ja) * | 2000-08-22 | 2002-02-28 | Nippon Telegr & Teleph Corp <Ntt> | 通訳サービス方法及び通訳サービスシステム |
| JP2002169988A (ja) * | 2000-12-04 | 2002-06-14 | Nippon Telegr & Teleph Corp <Ntt> | 手話通訳提供方法及びシステム |
| JP2002262249A (ja) * | 2001-02-27 | 2002-09-13 | Up Coming:Kk | 対話支援システム及び方法、並びにコンピュータプログラム |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2426247C2 (ru) * | 2006-09-30 | 2011-08-10 | Хуавэй Текнолоджиз Ко., Лтд. | Система, способ и многоточечный блок управления для реализации многоязычной конференцсвязи |
| US9031849B2 (en) | 2006-09-30 | 2015-05-12 | Huawei Technologies Co., Ltd. | System, method and multipoint control unit for providing multi-language conference |
| JP2013015939A (ja) * | 2011-07-01 | 2013-01-24 | Nec System Technologies Ltd | 理解支援システム、支援端末、理解支援方法およびプログラム |
| CN104463250A (zh) * | 2014-12-12 | 2015-03-25 | 广东工业大学 | 一种基于达芬奇技术的手语识别翻译方法 |
| CN104463250B (zh) * | 2014-12-12 | 2017-10-27 | 广东工业大学 | 一种基于达芬奇技术的手语识别翻译方法 |
| JP2022117644A (ja) * | 2021-02-01 | 2022-08-12 | 一般財団法人日本財団電話リレーサービス | 電話リレーシステム、及びコミュニケーションプラットフォーム |
| JP7489106B2 (ja) | 2021-02-01 | 2024-05-23 | 一般財団法人日本財団電話リレーサービス | 電話リレーシステム、及びコミュニケーションプラットフォーム |
Also Published As
| Publication number | Publication date |
|---|---|
| TW200405988A (en) | 2004-04-16 |
| KR20050083647A (ko) | 2005-08-26 |
| HK1077689A1 (zh) | 2006-02-17 |
| EP1542465A4 (en) | 2007-01-03 |
| CN1682535A (zh) | 2005-10-12 |
| CA2499097A1 (en) | 2004-04-01 |
| JPWO2004028161A1 (ja) | 2006-01-19 |
| KR100679871B1 (ko) | 2007-02-07 |
| AU2003264434A1 (en) | 2004-04-08 |
| AU2003264434B2 (en) | 2007-09-20 |
| EP1542465A1 (en) | 2005-06-15 |
| US20060234193A1 (en) | 2006-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2004028161A1 (ja) | 手話通訳システムおよび手話通訳方法 | |
| KR100695926B1 (ko) | 텔레비전 전화 통역 시스템 및 텔레비전 전화 통역 방법 | |
| US5848134A (en) | Method and apparatus for real-time information processing in a multi-media system | |
| KR100698942B1 (ko) | 텔레비젼 전화 수화 대담 보조 장치 및 그것을 이용한 수화 통역 시스템 | |
| AU2003264435B2 (en) | A videophone sign language interpretation assistance device and a sign language interpretation system using the same. | |
| JP2005056126A (ja) | コミュニケーションサービスシステム | |
| US6937265B2 (en) | Telecommunications installation | |
| JP2004007482A (ja) | 電話会議サーバおよび電話会議システム | |
| JP2003283673A (ja) | 電話会議装置 | |
| JP2008172359A (ja) | Ipインターホンシステム | |
| JPH09149395A (ja) | 通信装置 | |
| JPS61224628A (ja) | 複合通信通訳システム | |
| JPH04294667A (ja) | マルチメディア端末 | |
| JPH04302561A (ja) | マルチメディア通信システム | |
| JP2007058681A (ja) | 電子会議支援装置 | |
| JP2006094272A (ja) | 電話装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 1020057002914 Country of ref document: KR |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2004537564 Country of ref document: JP Ref document number: 2499097 Country of ref document: CA |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 20038219395 Country of ref document: CN Ref document number: 167488 Country of ref document: IL |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2003797602 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2003264434 Country of ref document: AU |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 638/KOLNP/2005 Country of ref document: IN |
|
| WWP | Wipo information: published in national office |
Ref document number: 2003797602 Country of ref document: EP |
|
| WWP | Wipo information: published in national office |
Ref document number: 1020057002914 Country of ref document: KR |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2006234193 Country of ref document: US Ref document number: 10527916 Country of ref document: US |
|
| WWP | Wipo information: published in national office |
Ref document number: 10527916 Country of ref document: US |