WO2019208859A1 - Method for generating pronunciation dictionary and apparatus therefor - Google Patents

Abstract

Disclosed are a method for generating a pronunciation dictionary and an apparatus therefor. Specifically, a method for generating a pronunciation dictionary by a voice recognition device may comprise the steps of: receiving an input of a voice from a user or a machine; recognizing the input voice by using an audio model; generating a pronunciation symbol for the voice on the basis of a result of the recognition; receiving an input of a user vocabulary from the user; and mapping the input user vocabulary to the generated pronunciation symbol, and storing same in the pronunciation dictionary.

Description

Method for generating phonetic dictionary and apparatus therefor

The present invention relates to a method for applying (generating) a user dictionary (ie, a user pronunciation dictionary) in an automatic speech recognition device.

Automatic speech recognition (hereinafter referred to as speech recognition) is a technology that converts speech into text using a computer. This technology has made a rapid improvement in recognition rate in recent years.

However, a problem that occurs throughout language processing also occurs in language processing, which is an unregistered language problem.

Unregistered words are words that the language processing system cannot process. When a vocabulary that cannot be reflected in the system at the time of system development occurs in service, the system needs a function to cope with it. Without proper correspondence to unregistered words, the system's output cannot be guaranteed and even the system may not work.

The default method for dealing with non-registered words is to set a default processing method, and in the worst case, give a fixed answer. For example, in linguistic analysis, a vocabulary is analyzed as a noun, in translation, a vocabulary is unknown (converted to phonetic) in a translation, and in a speech recognition a word unknown is output as a unknown word.

User dictionaries can be applied in a more aggressive way to respond to unregistered words in the service system. That is, the user directly enters the information of the vocabulary and allows the system to refer to it. For example, in linguistic analysis, users can register vocabulary and vocabulary analysis information, and in translation, the original vocabulary and translated vocabulary information, and the system refers to this information during operation and processes unregistered words.

In voice recognition, in order to register a vocabulary, a user must register a vocabulary and a corresponding phonetic symbol.

However, phonetic symbols have different notation or classification criteria for each system, and there is no unified standard. In addition, users who are new to the system need to learn about notation. Or you should have a program that converts vocabulary to phonetic symbols, but most programs that convert vocabulary to phonetic symbols are not 100% accurate.

An object of the present invention is to propose a method for easily and accurately registering a vocabulary and a corresponding phonetic symbol in speech recognition.

Technical problems to be achieved in the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned above will be clearly understood by those skilled in the art from the following description. Could be.

An aspect of the present invention provides a method of generating a pronunciation dictionary by a speech recognition apparatus, the method comprising: receiving a voice from a user or a mechanical device; Recognizing the input voice using an acoustic model; Generating a phonetic symbol for the speech based on the recognized result; Receiving a user vocabulary from a user; And associating the input user vocabulary with the generated phonetic symbol and storing the same in the phonetic dictionary.

Preferably, evaluating the reliability of the recognized result; And when the reliability is less than a preset threshold, requesting the user vocabulary corresponding to the phonetic symbol.

Preferably, selecting a misrecognition and / or unrecognition portion from the recognized result; And requesting the user vocabulary corresponding to the misrecognition and / or unrecognition portion.

Preferably, evaluating the reliability of the recognized result; Generating a vocabulary candidate group that can be inferred from the phonetic symbols when the reliability is smaller than a preset threshold and searching from a text corpus; And after registering the searched vocabulary candidate group in the pronunciation dictionary, recognizing the voice using the acoustic model.

Preferably, the method may further include requesting a user to determine whether to register the searched vocabulary or the vocabulary before registering the pronunciation dictionary.

Preferably, evaluating the reliability of the recognized result; Searching for a vocabulary that can be inferred from the dictionary by storing all inferred phonetic symbols corresponding to each word of a text corpus when the reliability is less than a preset threshold; And after registering the searched vocabulary in the pronunciation dictionary, recognizing the voice by using the acoustic model.

Preferably, the method may further include requesting a user to determine whether to register the searched word or words before registering the pronunciation dictionary.

Preferably, the weight of the acoustic model may be set higher than the weight of the language model to generate the phonetic symbols.

Preferably, candidates of all possible letters or phoneme units may be added to the pronunciation dictionary and the language model used to generate the phonetic symbols.

Preferably, the phonetic dictionary and the language model used to generate the phonetic symbols may consist of all possible letters or phoneme units.

According to another aspect of the present invention, there is provided a method of generating a pronunciation dictionary in a speech recognition apparatus, the method comprising: receiving a speech-text parallel corpus in which speech data and text are corresponded; Recognizing the voice data using an acoustic model; Generating a phonetic symbol and a text result for the speech data based on the recognized result; And updating the phonetic dictionary with respect to differently expressed parts by matching the phonetic-text parallel corpus with the phonetic symbols and the text results.

Preferably, the method may further include learning the acoustic model using the updated pronunciation dictionary and the speech-text parallel corpus.

Another aspect of the invention, the step of receiving text from the user or the machine; Requesting a voice of a corresponding vocabulary from a user of a vocabulary of an input text not included in the pronunciation dictionary; Recognizing the input voice using an acoustic model; Generating a phonetic symbol for the speech based on the recognized result; And associating the input user vocabulary with the generated phonetic symbol and storing the same in the phonetic dictionary.

According to another aspect of the present invention, there is provided a voice recognition apparatus comprising: a voice input unit configured to receive a voice from a user; A vocabulary input unit for receiving a user vocabulary from a user; A memory for storing a pronunciation dictionary comprising a vocabulary and a pronunciation symbol corresponding to the vocabulary; And a processor for controlling the voice input unit, the vocabulary input unit, and the storage unit, wherein the processor receives a voice from a user through the voice input unit, recognizes the input voice using an acoustic model, Generates a phonetic symbol for the voice based on the recognized result using a language model, receives a user vocabulary from a user through the vocabulary input unit, and associates the input user vocabulary with the generated phonetic symbol. Can be stored in the pronunciation dictionary.

According to an embodiment of the present invention, a user may easily and accurately register a vocabulary and a corresponding phonetic symbol in speech recognition.

In addition, according to the embodiment of the present invention, the user does not need to receive a separate education and does not need a separate program.

In addition, according to an embodiment of the present invention, it is applicable to all languages without regard to a specific language.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description. .

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, included as part of the detailed description in order to provide a thorough understanding of the present invention, provide embodiments of the present invention and together with the description, describe the technical features of the present invention.

1 is a block diagram of a speech recognition apparatus according to an embodiment of the present invention.

2 is a diagram illustrating a pronunciation dictionary of a speech recognition apparatus according to an embodiment of the present invention.

3 is a diagram for describing a method of generating a pronunciation dictionary, according to an exemplary embodiment.

4 is a diagram for describing a method of generating a pronunciation dictionary, according to an exemplary embodiment.

5 is a diagram for describing a method of generating a pronunciation dictionary, according to an exemplary embodiment.

6 illustrates a configuration of a voice recognizer according to an embodiment of the present invention.

7 is a diagram illustrating a method of generating a pronunciation dictionary of a speech recognition apparatus according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. The detailed description, which will be given below with reference to the accompanying drawings, is intended to explain exemplary embodiments of the present invention and is not intended to represent the only embodiments in which the present invention may be practiced. The following detailed description includes specific details in order to provide a thorough understanding of the present invention. However, one of ordinary skill in the art appreciates that the present invention may be practiced without these specific details.

In some instances, well-known structures and devices may be omitted or shown in block diagram form centering on the core functions of the structures and devices in order to avoid obscuring the concepts of the present invention.

1 is a block diagram of a speech recognition apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the speech recognition apparatus 100 may include a voice input unit 110 that receives a voice from a user, a vocabulary input unit 120 that receives a vocabulary from a user, various data related to voice (especially a pronunciation dictionary, an acoustic model, And a processor 140 for processing the voice of the input user and storing (updating) the pronunciation dictionary.

The voice input unit 110 may include a microphone, and when a user's uttered voice is input, the voice input unit 110 converts the voice signal into an electrical signal and outputs it to the processor 140.

The vocabulary input unit 120 generates input data for a vocabulary input from a user or a mechanical device and outputs the input data to the processor 140. The vocabulary input unit 120 may be implemented as a keyboard, a key pad, a touch pad (static pressure / capacitance), or the like.

The processor 140 may acquire a voice data of the user by applying a speech recognition algorithm or a speech recognition engine to a signal received from the voice input unit 110.

At this time, the signal input to the processor 140 may be converted into a more useful form for speech recognition, the processor 140 converts the input signal from analog form to digital form and detects the start and end points of the voice. To detect the actual speech section / data included in the speech data. This is called end point detection (EPD).

In addition, the processor 140 may perform Cepstrum, Linear Predictive Coefficient (LPC), Mel Frequency Cepstral Coefficient (MFCC), or Filter Bank energy within the detected interval. A feature vector extraction technique such as Energy) may be applied to extract a feature vector of a signal.

The processor 140 may store information about the end point of the voice data and the feature vector by using the memory 130 that stores the data.

The memory 130 may be a flash memory, a hard disc, a memory card, a read-only memory (ROM), a random access memory (RAM), a memory card, an electrically erasable programmable memory (EPEPROM). A storage medium may include at least one of a read-only memory (PROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk.

In addition, the processor 140 may obtain a recognition result by comparing the extracted feature vector with the trained reference pattern. To this end, an acoustic model for modeling and comparing signal characteristics of speech and a language model for modeling linguistic order relations such as words or syllables corresponding to a recognized vocabulary may be used.

The acoustic model may be further divided into a direct comparison method of setting a recognition object as a feature vector model and comparing it with a feature vector of speech data and a statistical method of statistically processing the feature vector of the recognition object.

The direct comparison method is a method of setting a unit of a word, a phoneme, or the like to be recognized as a feature vector model and comparing how similar the input speech is. As a representative example, a vector quantization method is used. According to the vector quantization method, a feature vector of input speech data is mapped with a codebook, which is a reference model, and encoded into a representative value to compare the code values.

The statistical model method is a method of constructing a unit for a recognition object into a state sequence and using a relationship between state columns. The status column may consist of a plurality of nodes. Methods using the relationship between the state columns again include Dynamic Time Warping (DTW), Hidden Markov Model (HMM), and neural networks.

Dynamic time warping is a method of compensating for differences in the time axis when considering the dynamic characteristics of speech whose length varies over time even if the same person pronounces the same. Assuming a Markov process with probability and observed probability of nodes (output symbols) in each state, we estimate state transition probability and observed probability of the nodes from the training data, and calculate the probability that the voice input from the estimated model will occur. Is a recognition technology.

On the other hand, a language model that models linguistic order relations such as words or syllables may apply acoustic relations between units constituting language to units obtained in speech recognition, thereby reducing acoustic ambiguity and reducing recognition errors. The linguistic model has a model based on a statistical language model and a finite state automata (FSA), and the statistical linguistic model uses a chain probability of words such as Unigram, Bigram, and Trigram.

The processor 140 may use any of the methods described above in recognizing the voice. For example, an acoustic model with a hidden Markov model may be used, or an N-best search method that integrates the acoustic model and the language model. The N-best search method can improve recognition performance by selecting up to N recognition result candidates using acoustic models and language models, and then re-evaluating the ranks of these candidates.

The processor 140 may calculate a confidence score (or may be abbreviated as 'confidence') in order to secure the reliability of the recognition result.

The confidence score is a measure of how reliable the result is for a speech recognition result. It can be defined as a relative value of the phoneme or word that is a recognized result and the probability that the word is spoken from other phonemes or words. have. Therefore, the reliability score may be expressed as a value between 0 and 1, or may be expressed as a value between 0 and 100. If the confidence score is larger than a predetermined threshold, the recognition result may be recognized, and if the confidence score is small, the recognition result may be rejected.

In addition, the reliability score may be obtained according to various conventional reliability score obtaining algorithms.

If the confidence score is greater than the threshold value, but the feedback of the false recognition from the user is received, that is, the false recognition, the processor 140 may perform the voice recognition operation using the acoustic model.

The processor 140 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. Hardware implementations include Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), Processors, and Micros It may be implemented using at least one of an electrical unit such as a controller (microcontrollers), a micro-processor (micro-processor).

According to a software implementation, it may be implemented with a separate software module that performs at least one function or operation, and the software code may be implemented by a software application written in a suitable programming language.

The processor 140 implements the functions, processes, and / or methods proposed in FIGS. 2 to 7 to be described later.

2 is a diagram illustrating a pronunciation dictionary of a speech recognition apparatus according to an embodiment of the present invention.

Referring to FIG. 2, the pronunciation dictionary includes a vocabulary (surface form) 210 and a phonetic symbol 220 corresponding to each vocabulary. For example, the phonetic symbol of the vocabulary of 'computer' may be represented as [K AH M P Y UW T ER].

Although FIG. 2 illustrates English, the present invention is not limited thereto and the present invention may be applied to all languages. In addition, the phonetic symbols representing the vocabulary and the pronunciation of each vocabulary may be expressed in different languages.

3 is a diagram for describing a method of generating a pronunciation dictionary, according to an exemplary embodiment.

When a new word or pronunciation is added to a speech recognizer, a user inputs a vocabulary and a phonetic symbol pair by using a program or a program (which may generate a phonetic symbol different from the actual pronunciation). According to the embodiment of the present invention, the user only needs to input a voice or vocabulary.

Referring to FIG. 3, the user vocabulary for the voice recognizer (ie, the user vocabulary used in the voice recognizer) is composed of a surface layer form and a phonetic symbol of the vocabulary as described above.

The voice recognizer may receive a voice from a user or a mechanical device to generate a phonetic symbol, and the voice recognizer may receive a user vocabulary from a user through a keyboard.

In the case of FIG. 3, the voice recognizer receives a voice from a user or a machine to generate a phonetic symbol [S IH STR AA N], receives a user vocabulary 'SYSTRAN' through a keyboard, and then pronounces the vocabulary 'SYSTRAN'. The process of matching [S IH STR AA N] as a symbol and registering it in a pronunciation dictionary (ie, memory) is illustrated.

Here, as an example of a method in which a speech recognizer generates a phonetic symbol from a voice input from a user or a machine, the speech recognizer minimizes the influence of a language model and maximizes the influence of an acoustic model among a myriad of phonetic candidates. Thus, the candidate with the highest score (or candidates) can be selected. For example, when the scores of the phonetic symbol candidates are derived to generate phonetic symbols, the weight for the acoustic model may be set higher than the weight for the language model. Alternatively, a phonetic symbol may be generated using only an acoustic model among phonetic symbol candidates.

In addition, as another example of how the speech recognizer generates a phonetic symbol, all possible letters or phoneme unit candidates may be added to the phonetic dictionary and the language model. That is, phonetic symbols may be generated using a phonetic dictionary and a language model to which all possible letters or phoneme unit candidates are added.

In addition, as another example of a method in which the speech recognizer generates a phonetic symbol, the phonetic dictionary and the language model may consist of all possible letter or phoneme unit candidates. That is, phonetic symbols may be generated using a phonetic dictionary and language model composed of all possible letters or phoneme unit candidates.

Using the above method, even if the user does not study the phonetic symbols, the voice recognizer can generate phonetic symbols quickly, easily and accurately.

In addition, using the above-described method, the speech recognizer can generate a phonetic symbol as it is, without error, compared to a surface type vocabulary-pronounced symbol conversion program. Can be generated. In addition, the speech recognizer may be applied to a third language to generate phonetic symbols.

4 is a diagram for describing a method of generating a pronunciation dictionary, according to an exemplary embodiment.

4 is an example of the embodiment of FIG. 3 above, the phonetic symbol for the target voice is generated by the voice recognizer and the user only needs to input the corresponding vocabulary.

The voice recognizer may receive a voice from a user or a machine to generate a phonetic symbol. For example, the voice recognizer may receive a voice from a user or a machine, and recognize the input voice using an acoustic model. The speech recognizer may generate a phonetic symbol for the voice based on the recognized result.

In this case, the voice recognizer recognizes the input voice and may automatically or manually (ie, by the user) select a misrecognized and unrecognized portion (that is, a portion that cannot determine the surface type vocabulary corresponding to the input voice). . Then, the surface type vocabulary corresponding to the misrecognition and the unrecognition portion can be directly input from the user or the mechanical device.

The voice recognizer may store the phonetic vocabulary input from a user or a mechanical device and the phonetic symbols secured in a part of a false or unrecognized part of the voice recognizer in the phonetic dictionary.

In FIG. 4, the voice recognizer generates a phonetic symbol [S IH S T R AA N] by receiving a voice from a user or a machine, but illustrates a case in which the surface type vocabulary cannot be determined. In this case, the voice recognizer requests a user of the surface type vocabulary corresponding to the phonetic symbol [S IH STR AA N], and the user uses the surface type vocabulary corresponding to the phonetic symbol [S IH STR AA N] (ie, 'SYSTRAN'). ) Can be input.

The speech recognizer can store the phonetic word 'SYSTRAN' input from the user and the phonetic symbol [S IH STR AA N], which can be obtained from the part of the speech recognition that is misidentified or unrecognized. have.

5 is a diagram for describing a method of generating a pronunciation dictionary, according to an exemplary embodiment.

FIG. 5 is an example opposite to the method of FIG. 4, in which a user recognizes only a voice corresponding to a vocabulary from a user and generates a phonetic symbol in a speech recognizer.

The voice recognizer may receive a user vocabulary from a user through a keyboard.

When the user vocabulary is input from a user or a mechanical device, the voice recognizer determines whether the input user vocabulary exists in the existing pronunciation dictionary by comparing with the existing pronunciation dictionary. In other words, the voice recognizer may receive text from a user or a machine, and determine whether the text is present in a pronunciation dictionary among the vocabulary of the input text.

If the input user vocabulary does not exist in the existing pronunciation dictionary, a procedure of asking the user about the corresponding vocabulary is performed. That is, since a phonetic symbol corresponding to the input user vocabulary must be generated in order to register the vocabulary in the pronunciation dictionary, the voice recognizer may request a voice for the input user vocabulary.

In this case, when the voice recognizer receives a voice of a pronunciation corresponding to the corresponding vocabulary from a user or a machine, the voice recognizer recognizes the user voice using an acoustic model. The voice recognizer may generate a phonetic symbol corresponding to the input voice, and store the phonetic dictionary in correspondence with the input surface type vocabulary and the generated phonetic symbol.

In the case of FIG. 5, since the 'SYSTRAN' does not exist in the existing pronunciation dictionary among the vocabulary input by the user, the voice recognizer may request a voice for the 'SYSTRAN' from the user or the apparatus. When a voice for 'SYSTRAN' is received from a user or a mechanical device, a phonetic symbol [S IH S T R AA N] may be generated from the voice. The input vocabulary 'SYSTRAN' and the generated phonetic symbol [S IH S T R AA N] may be associated with each other and stored in a pronunciation dictionary (ie, a memory).

6 illustrates a configuration of a voice recognizer according to an embodiment of the present invention.

According to the embodiment of FIG. 6, a new vocabulary may be automatically added to a pronunciation dictionary by automatically extracting an unregistered vocabulary from a voice / text pair. Based on this, a new acoustic model can be learned from the updated pronunciation dictionary and the speech / text pair.

Referring to FIG. 6, when a speech recognizer receives a speech-text parallel corpus stored in correspondence with speech data, the speech recognizer recognizes speech data of the input speech-text parallel corpus using an acoustic model and pronounces the speech data from the speech data. Create a symbol. That is, the speech recognizer may generate a phonetic symbol and text result of the speech data from the result recognized using the existing phonetic dictionary and language model. Then, the phonetic symbols generated for the speech-text parallel corpus and the text results may be aligned with each other to generate phonetic symbols for each text. In other words, it is possible to update the phonetic dictionary with respect to differently expressed parts by matching the phonetic symbols and the text results with the speech-text parallel corpus. That is, a new pronunciation dictionary is generated.

Then, the speech recognizer learns the acoustic model using the input speech-text parallel corpus and the newly generated pronunciation dictionary.

In this way, the speech recognizer can obtain an improved pronunciation dictionary and acoustic model.

The new acoustic model obtained as described above may reduce the problem caused by the error of the existing phonetic symbol generator and reduce the learning ambiguity caused by the inconsistency between the text and the voice caused by the user's pronunciation error.

7 is a diagram illustrating a method of generating a pronunciation dictionary of a speech recognition apparatus according to an embodiment of the present invention.

Referring to FIG. 7, the voice recognition apparatus receives a voice from a user or a machine (S701).

The speech recognition apparatus recognizes the input voice using an acoustic model in operation S702.

Here, the speech recognition apparatus may evaluate the reliability of the recognized result. When the reliability is smaller than a preset threshold, the speech recognition apparatus may search for a lexical candidate group inferred by the phonetic symbols from the text corpus. The speech recognition apparatus may register the searched vocabulary candidate group in the pronunciation dictionary and then re-recognize the speech using the acoustic model.

In addition, the speech recognition apparatus may evaluate the reliability of the recognized result. When the reliability is smaller than the preset threshold, the speech recognition apparatus may search for a vocabulary that can be inferred from the dictionary by storing all inferred pronunciation symbols corresponding to each word of the text corpus. The speech recognition apparatus may register the searched vocabulary in the pronunciation dictionary, and then re-recognize the speech using the acoustic model.

The speech recognition apparatus generates a phonetic symbol for the speech based on the recognized result (S703).

In this case, a phonetic dictionary and a language model may be used to generate phonetic symbols. In addition, the weight of the acoustic model may be set higher than the weight for the language model to generate a phonetic symbol.

In addition, candidates of all possible letters or phoneme units may be added to the pronunciation dictionary and the language model used to generate the phonetic symbols.

In addition, the pronunciation dictionary and the language model used to generate the phonetic symbols may be composed of all possible letters or phoneme units.

The speech recognition apparatus receives a user vocabulary from the user (S704).

Here, when the input user vocabulary does not exist in the pronunciation dictionary, the voice recognition apparatus may request the voice corresponding to the user vocabulary. In this case, steps S701 to S703 may be performed after step S704.

In addition, the speech recognition apparatus may evaluate the reliability of the result of the recognition in step S702. In this case, when the reliability is smaller than a preset threshold, the speech recognition apparatus may request the user vocabulary corresponding to the phonetic symbol and receive a user vocabulary from the user.

In addition, the speech recognition apparatus may select a misrecognition and / or unrecognition portion from the recognition result in step S702. The voice recognition apparatus may request the user vocabulary corresponding to the misrecognition and / or unrecognized portion and receive a user vocabulary from a user.

The speech recognition apparatus stores the input user vocabulary and the generated phonetic symbols in the phonetic dictionary (S705).

On the other hand, the speech recognition apparatus may receive a speech-text parallel corpus stored in correspondence with speech data and text. The speech recognition apparatus may recognize the speech data using an acoustic model and generate a phonetic symbol for the speech data based on the recognized result using a pronunciation dictionary and a language model. The speech recognition apparatus may update the pronunciation dictionary by associating a phonetic symbol with respect to the voice data and the text.

In addition, the speech recognition apparatus may learn the acoustic model using the updated pronunciation dictionary and the speech-text parallel corpus.

Embodiments according to the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of a hardware implementation, an embodiment of the present invention may include one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, and the like.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above. The software code may be stored in memory and driven by the processor. The memory may be located inside or outside the processor, and may exchange data with the processor by various known means.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the essential features of the present invention. Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

The present invention can be applied to various speech recognition technologies.

Claims (14)

In the method of generating a pronunciation dictionary by a speech recognition device, Receiving a voice from a user or a machine; Recognizing the input voice using an acoustic model; Generating a phonetic symbol for the speech based on the recognized result; Receiving a user vocabulary from a user; And And storing the input user vocabulary and the generated phonetic symbols in the phonetic dictionary. The method of claim 1, Evaluating the reliability of the recognized result; And And requesting the user vocabulary corresponding to the phonetic symbol when the reliability is less than a preset threshold. The method of claim 1, Selecting a misrecognition and / or unrecognition portion from the recognized result; And Requesting the user vocabulary corresponding to the misrecognition and / or unrecognition portion. The method of claim 1, Evaluating the reliability of the recognized result; Retrieving a lexical candidate group inferred with the phonetic symbols from a text corpus when the reliability is less than a preset threshold; And And registering the searched vocabulary candidate group in the pronunciation dictionary, and re-recognizing the voice using the acoustic model. The method of claim 4, wherein And requesting a user to determine whether to register the searched vocabulary or vocabulary before registering the pronunciation dictionary. The method of claim 1, Evaluating the reliability of the recognized result; Searching for a vocabulary that can be inferred from the dictionary by storing all inferred phonetic symbols corresponding to each word of a text corpus when the reliability is less than a preset threshold; And And registering the searched vocabulary in the pronunciation dictionary, and re-recognizing the voice using the acoustic model. The method of claim 6, And requesting a user to determine whether to register the searched vocabulary or vocabulary before registering the pronunciation dictionary. The method of claim 1, And a weight of the acoustic model is set higher than a weight for the language model to generate the phonetic symbols. The method of claim 1, And a possible phonetic or phonetic unit candidate is added to the pronunciation dictionary and the language model used to generate the phonetic symbols. The method of claim 1, The pronunciation dictionary and the language model used to generate the phonetic symbols consist of all possible letters or phoneme units. In the method of generating a pronunciation dictionary by a speech recognition device, Receiving a speech-text parallel corpus stored in correspondence with speech data and text; Recognizing the voice data using an acoustic model; Generating a phonetic symbol and a text result for the speech data based on the recognized result; And And correlating the speech-text parallel corpus with the phonetic symbols and textual results to update the phonetic dictionary for differently expressed portions. The method of claim 11, Learning the acoustic model using the updated pronunciation dictionary and the speech-text parallel corpus. In the method of generating a pronunciation dictionary by a speech recognition device, Receiving text from a user or a machine; Requesting a voice of a corresponding vocabulary from a user for a vocabulary not included in the pronunciation dictionary among the input vocabulary of the text; Recognizing the input voice using an acoustic model; Generating a phonetic symbol for the speech based on the recognized result; And And storing the input user vocabulary and the generated phonetic symbols in the phonetic dictionary. In the speech recognition device, A voice input unit for receiving a voice from a user or a machine; A vocabulary input unit for receiving a user vocabulary from a user; A memory for storing a pronunciation dictionary comprising a vocabulary and a pronunciation symbol corresponding to the vocabulary; And A processor for controlling the voice input unit, the lexical input unit, and the storage unit, The processor receives a voice from a user or a machine through the voice input unit, recognizes the input voice using an acoustic model, and generates a phonetic symbol for the voice based on the recognized result. And receiving a user vocabulary from the user through the vocabulary input unit, and storing the input user vocabulary and the generated phonetic symbol in the phonetic dictionary.

Images