KR20090115599A - Mobile terminal and its information processing method - Google Patents

Abstract

The present invention provides a mobile terminal capable of automatically detecting and inputting information to be input to a plurality of information fields in a voice command, and using the field information detected in the voice command to specify an information range for voice command recognition. The information processing method relates to a signal input unit for receiving a signal for controlling activation of a voice recognition function or a signal for instructing selection and execution of a specific function or menu, and each of the mobile terminals that can be referred to for voice recognition. A memory constituting information related to a menu or a function in a database, specifying a range of information to be referred to in the database according to the input signal, analyzing contents and contextual information of a voice command with reference to the specified information, and The meaning of the voice command is determined as the analyzed information, and a result value corresponding to the meaning is specified for the terminal. It consists of a control unit that outputs to the component.

Description

MOBILE TERMINAL AND ITS INFORMATION PROCESSING METHOD}

The present invention provides a mobile terminal capable of automatically detecting and inputting information to be input to a plurality of information fields in a voice command, and using the field information detected in the voice command to specify an information range for voice command recognition. The information processing method.

The mobile terminal may be configured to perform various functions.

Examples of such various functions include data and voice communication functions, taking pictures or videos through a camera, storing voices, playing music files through a speaker system, and displaying images or videos. Some mobile terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

In addition, efforts to support and increase the function of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware. As such a design form, a folder form, a slide form, a bar form or a rotation form design is applied to the mobile terminal.

In addition, the mobile terminal is applied with various user interfaces for executing a specific function or service. For example, a function for voice recognition, a touch pad, a keypad, or a pen input is applied. However, the user interface has a problem in that a recognition error rate is high or user satisfaction is low according to each characteristic.

The present invention provides a mobile terminal and a method for processing the information by determining the meaning by the context or content of the voice command in the mobile terminal capable of voice recognition to control a menu related to a specific function or service provided in the terminal. will be.

In addition, the present invention can automatically detect and input information to be input to a plurality of information fields provided in a specific menu in a voice command, and specifies the information range for voice command recognition using the field information detected in the voice command. The present invention relates to a mobile terminal and an information processing method thereof.

Another object of the present invention is to provide a mobile terminal and a method for processing the information, which enable the information range for recognizing a voice command to be specified as an information area related to a specific menu or service area according to the operation state of the terminal.

Another object of the present invention is to provide a mobile terminal and a method for processing information thereof, which can continuously receive a voice command related to the operation until the operation related to a specific function or menu is completed.

In addition, the present invention is to provide a mobile terminal and its information processing method which detects a user's operation by a touch or a button input during a voice command recognition operation and can process information related to a specific function or service.

In addition, the present invention provides a mobile terminal and a method of processing the information by providing help information related to the operation according to the operation state, so that even the first user can process information related to a specific function or menu using a voice command. It is for.

The mobile terminal according to an embodiment of the present invention for realizing the above object is a signal input unit for receiving a signal for controlling the activation of the voice recognition function, or a signal for instructing the selection and execution of a specific function or menu, and the voice recognition Memory for configuring information related to each menu or function of a mobile terminal which can be referred to for a database, and a range of information to be referred to in the database according to the input signal, and by referring to the specified information, And a controller for analyzing contents and contextual information, determining the meaning of the voice command as the analyzed information, and outputting a result value corresponding to the meaning to a specific component of the terminal.

In addition, the present invention for realizing the above-described problem is to receive a signal instructing the selection and execution of a specific function or menu, and to activate the voice recognition function, according to the input signal of the database to be referred to Specifying a range of information, analyzing contents and contextual information of a voice command with reference to the specified information, determining the meaning of the voice command as the analyzed information, and a result value corresponding to the meaning of the determined voice command Is output to a specific component of the terminal.

The mobile terminal according to the present invention configured as described above has the effect of determining the meaning by context or content of a voice command input in natural language and selecting and executing a menu related to a specific function or service.

In addition, the mobile terminal according to the present invention has an effect of automatically detecting and inputting information to be input in a plurality of information fields provided in a specific menu.

In addition, the mobile terminal according to the present invention has the effect of improving the voice recognition rate and reducing the information retrieval time by specifying the information range of the database for voice command recognition using the field information of the keyword detected in the voice command.

In addition, the mobile terminal according to the present invention has an effect of improving the voice recognition rate by specifying the information range for recognizing the voice command in an information area related to a specific menu or service area according to the operation state.

In addition, the mobile terminal according to the present invention by maintaining the activation state of the voice recognition function until the operation associated with a specific function or menu, thereby receiving a continuous voice command related to the operation to effect the operation There is.

In addition, the mobile terminal according to the present invention has an effect of detecting a user's operation by a touch or a button input even when the voice recognition function is activated and processing information related to a specific function or menu.

In addition, the mobile terminal according to the present invention provides the help information related to the operation according to the operation state, so that even the first user can process information related to a specific function or menu using a voice command.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the detailed description of the well-known technology and its configuration which are determined to obscure the gist of the present invention will be omitted. In addition, in describing the present invention with reference to the drawings, components that perform the same function will be described with the same reference numerals.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the drawings.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal can be implemented in various forms. For example, the mobile terminal described herein may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, or the like. have.

The illustrated mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, The interface unit 170 may include a controller 180, a power supply unit 190, and the like. 1 illustrates a mobile terminal having various components. However, not all illustrated components are essential components. The mobile terminal may be implemented by more components than the illustrated components, or the mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more components for wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad has a mutual layer structure with the display unit 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, Video I / O (Input / Output) port, earphone port, etc. may be included.

Here, the identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, a sound output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

Meanwhile, as described above, when the display unit 13 and the touch pad form a mutual layer structure to form a touch screen, the display unit 151 may be used as an input device in addition to the output device. The display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, the alarm unit 153 may output a vibration in response to the key signal input. Through the vibration output as described above, the user can recognize the occurrence of the event. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, It may include at least one type of storage medium of the optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The power supply unit 190 receives an external power source or an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a computer-readable recording medium using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory 160 and executed by the controller 180.

 In the above, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, referring to FIGS. 2 and 3, the mobile terminal related to the present invention will be further described in terms of components according to appearance. Hereinafter, a slider type mobile terminal is described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like for clarity of explanation. Therefore, the present invention is not limited to the slider type mobile terminal, but can be applied to all types of mobile terminals including the above-described type.

2 is a front perspective view of an example of a mobile terminal according to the present invention;

The mobile terminal of the present invention includes a first body 200 and a second body 205 configured to be slidable in at least one direction on the first body 200.

A state in which the first body 200 is disposed to overlap with the second body 205 may be referred to as a closed configuration, and as shown in the drawing, the first body 200 may be referred to as the second body 205. The exposed state of at least a portion of the N may be referred to as an open configuration.

The mobile terminal mainly operates in a standby mode in a closed state, but the standby mode may be released by a user's operation. In addition, although the mobile terminal operates mainly in a call mode or the like in an open state, the mobile terminal may be switched to a standby mode by a user's manipulation or a lapse of a predetermined time.

The case (casing, housing, cover, etc.) forming the exterior of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are embedded in the space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be further disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injecting a synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display module 151, the audio output module 152, the camera 121, or the first user input unit 210 may be disposed on the first body 200, specifically, the first front case 220.

The display module 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually express information.

In addition, since the touch pad is superimposed on the display module 151 in a layer structure, the display module 151 may operate as a touch screen to enable input of information by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented to be suitable for capturing an image or a video of a user or the like.

Like the first body 200, the case forming the exterior of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the second body 205, specifically, on the front face of the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed in at least one of the second front case 230 or the second rear case 235.

The first to third user inputs 210, 215, and 245 may be collectively referred to as a manipulating portion 130, and may be any type as long as the user is tactile in a tactile manner. Can be employed.

For example, the user input unit may be implemented as a dome switch or a touch pad capable of receiving a command or information by a user's push or touch operation, or a wheel or jog method of rotating a key, or a manipulation method such as a joystick. May also be implemented.

In functional terms, the first user input unit 210 is for inputting a command such as start, end, scroll, etc., and the second user input unit 215 is for inputting numbers, letters, symbols, and the like.

In addition, the third user input unit 245 may operate as a hot key for activating a special function in the mobile terminal.

The microphone 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 serves as a passage for allowing the mobile terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 is wired or wirelessly, a connection terminal for connecting with an earphone, a port for short-range communication (for example, an infrared port (IrDA port), a Bluetooth port, a wireless LAN port) wireless LAN port), or at least one of power supply terminals for supplying power to the mobile terminal.

The interface unit 170 may be a card socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) and a memory card for storing information.

The power supply unit 190 for supplying power to the mobile terminal is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled for charging, for example, as a rechargeable battery.

3 is a rear perspective view of the mobile terminal of FIG.

Referring to FIG. 3, a camera 121 may be additionally mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 of the second body 205 has a photographing direction substantially opposite to the camera 121 of the first body 200, and the camera 121 and the camera 121 of the first body 200. And may have different pixels.

For example, the camera 121 of the first body 200 has a low pixel so that it is easy to take a picture of the user's face and transmit it to the counterpart in the case of a video call, and the camera 121 of the second body is generally It is desirable to have a high pixel because the subject is often photographed and not immediately transmitted.

The flash 250 and the mirror 255 may be further disposed adjacent to the camera 121 of the second body 205. The flash 250 illuminates the subject when the subject is photographed by the camera 121 of the second body 205. The mirror 255 allows the user to see the user's face or the like when the user wants to photograph (self-photograph) the user by using the camera 121 of the second body 205.

The sound output module 152 may be further disposed on the second rear case 235.

The sound output module 152 of the second body 205 may implement a stereo function together with the sound output module 152 of the first body 200, and may be used for a call in a speakerphone mode.

In addition, an antenna 260 for receiving a broadcast signal may be disposed on one side of the second rear case 235. The antenna 260 may be installed to be pulled out of the second body 205.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed on the side of the first rear case 225 of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as shown in this drawing.

In the above description, the second camera 121 and the like have been described as being disposed on the second body 205, but the present invention is not limited thereto.

For example, at least one or more of the components 260, 121 to 250, and 152 described as disposed on the second rear case 235, such as the camera 121 of the second body, may be the first body 200. May be mounted on the first rear case 225. In such a case, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state are protected by the second body 205. In addition, even if the camera 121 of the second body is not provided separately, the camera 121 of the first body may be rotatably formed so that the camera 121 of the second body may be photographed up to the photographing direction of the camera 121. .

The terminal 100 illustrated in FIGS. 1 to 3 may operate in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system. It can be configured to.

Hereinafter, referring to FIG. 4, a communication system capable of operating a terminal according to the present invention will be described.

The communication system may use different air interfaces and / or physical layers. For example, a radio interface usable by a communication system may include frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (Code Division). Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE), Global System for Mobile Communications (GSM), etc.) In the following, for convenience of explanation, the description will be limited to CDMA, but the present invention is naturally applicable to all communication systems including the CDMA wireless communication system.

As shown in FIG. 4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275. ), And a mobile switching center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. The BSCs 275 may be coupled to the BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing radially out of BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be called Base Station Transceiver Subsystem ('BTSs'). In this case, the word "base station" may be called the sum of one BSC 275 and at least one BS 270. The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be called a plurality of cell sites.

As shown in FIG. 4, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 4 illustrates several satellite positioning systems (GPS) satellites 300. The satellites 300 help to locate the at least one terminal of the plurality of terminals 100. Although two satellites are shown in FIG. 4, useful location information may be obtained by two or less or more satellites. The GPS module 115 shown in FIG. 1 cooperates with the satellites 300 to obtain desired location information. Here, the location can be tracked using all the techniques that can track the location, not just the GPS tracking technology. In addition, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

During typical operation of a wireless communication system, BS 270 receives a reverse link signal from various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by a particular base station 270 is processed within by the particular base station 270. The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functionality, including the organization of soft handoffs between base stations 270. In addition, the BSC 275 transmits the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. Similarly, PSTN 290 connects with MSC 280, MSC 280 connects with BSCs 275, and BSCs 275 send BSs 270 to transmit a forward link signal to terminals 100. ).

In the present embodiment, the mobile terminal may specify the information range of the database to be referred for recognizing the voice command with information related to a specific function, menu, or service area. The information range of the database to be referred for recognition of the voice command may be configured to be set through an environment setting menu of the terminal, and the set information range may be automatically applied as the voice recognition function is activated.

More specifically, information to be input into a plurality of information fields included in a specific menu such as a schedule or an alarm / morning call may be automatically detected and input by a voice command. For example, by determining the meaning of a voice command, a specific menu (eg, a schedule) is executed, specific field information such as date, day of the week, and time is detected from the voice command, and the field information is associated with the related information of the specific menu. You can type in the fields.

As described above, the recognition rate for the voice command can be improved by specifying the information range or the information search range of the database to be referred for recognition of the voice command, and the resource consumption of the terminal can be reduced by decreasing the information search range. have.

Hereinafter, in the present embodiment, the information range of the database set for the recognition of the voice command is information related to currently displayed menus, information related to sub-menus of a specific menu selected among the menus, or the specific menu. It is assumed that it is specified as information of a format that can be input to a plurality of information fields provided in the description.

5A to 5B are flowcharts illustrating an information processing method using a voice command of a mobile terminal according to the present invention, and the controller 180 of the mobile terminal may receive an activation control signal to start activation of a voice recognition function. (S101). The activation control signal may also be used to terminate activation of the voice recognition function.

The activation control signal may be generated by operating a specific hardware button included in the terminal, a software button displayed on the display unit 151, a touch input, or a specific menu displayed on the display unit 151. Or, it may be generated by a specific sound or sound, near or far wireless signal, or motion information of the body including the user's hand gesture or gesture (Gesture).

The specific sound or sound may include a kind of impact sound having a specific level or more, such as a clapping sound. Sound or sound above the specified level can be detected using a simple sound level detection algorithm (not shown).

The sound level detection algorithm is relatively simpler than the speech recognition algorithm and can consume less resources of the terminal. The sound level detection algorithm (or circuit) may be configured separately from the voice recognition algorithm (or circuit), and may be implemented in a manner in which some functions of the voice recognition algorithm are limited according to an operation mode.

The wireless signal may be input through the wireless communication unit 110, and the gesture or gesture of the user may be input through the sensing unit 140. The wireless communication unit 110, the user input unit 130, and the sensing unit 140 that receive the activation control signal may be collectively referred to as a signal input unit.

When the voice recognition function is activated, the controller 180 analyzes the context or content of the voice command received through the microphone 122 with reference to a specific database, and includes the voice command. You can judge the meaning.

Here, the database referred to for recognizing the meaning of the voice command, the voice recognition function is activated, the information range or information domain (domain) can be specified with information related to a specific function or menu. In addition, it may be specified by the field information that can be input to the information field provided in the specific menu (S102).

For example, the information range may be specified by menus currently output to the display unit 151 or information related to sub-menus of a specific menu selected from the menus. In addition, the information may be specified in a format that can be input to a plurality of information fields provided in a specific menu, such as a schedule or an alarm / morning call.

As described above, by specifying the information range of the database which can be referred to when recognizing the voice command, the recognition rate of the voice command can be further improved. In addition, the database may be composed of information that can be input in sub-menus or specific information fields. The information may be in the form of a keyword and a plurality of information may correspond to one function or menu.

In addition, the database may be configured in plurality according to the characteristics of the information and may be stored in the memory 160. In addition, the information configured in each database can be updated through learning. Also, the information of each database may be specified as information related to a function or menu currently being output to improve the recognition rate of the voice command. In addition, it may be specified by information of a format that can be input in a specific function or an information field of a menu.

The information range may be changed according to a menu step or an operation state.

After the information range setting of the database to be referred to for voice recognition is completed as described above, when a voice command is input, the voice command is recognized in the set information range and the semantic determination operation is started (S103, S104).

The semantic determination operation of the voice command may temporarily start storing the input voice command and immediately after the activation of the voice recognition function is ended. In addition, when the voice is not input for a specific time or more, the meaning may be determined by the voice command input up to that time, and a plurality of voice commands may be continuously input as described above in units of time as described above.

The voice recognition function may be activated until information input is completed in a specific function or an information field provided in a menu.

Meanwhile, even when the voice recognition function is in an activated state, the controller 180 can continuously drive an algorithm for detecting a touch or a button input. Accordingly, the controller 180 may receive or execute a specific menu through a touch or other input means such as a button or a button other than the voice command even when the voice recognition function is activated, or input information into a specific information field ( S109, S110).

The controller 180 may output a result value when the meaning of the voice command is determined (S105). The result value may include a control signal for executing a menu related to a function or service corresponding to the meaning of the voice command or for controlling a specific component of the terminal. In addition, the information related to the recognized voice command may be displayed or may include information data in a format that can be input in a specific information field.

Meanwhile, when outputting or executing the result value, the controller 180 can receive confirmation from the user as to whether the result value is correct (S106). For example, assuming that the result value executes a specific menu, the user can confirm whether or not the specific menu is executed by outputting a message or voice (eg, execute the photo album menu? Yes / No response). If there is no response, launch the Photo Album menu automatically after 5 seconds).

If a positive response is received from the user with respect to the confirmation request or if the response is determined to be a positive response according to a predetermined algorithm, the function or menu may be automatically executed (S107).

In addition, when a user's response is negative, that is, when the meaning of the voice command is not correctly determined, an error processing process may be performed according to a predetermined error processing algorithm (S108). The error processing process selects any one menu by a user after receiving a voice command again or displaying a plurality of menus (or a plurality of menus that can be interpreted in a similar sense) having a specific recognition rate or more. I can run it.

On the other hand, if the executed specific function or menu is a menu composed of a plurality of information fields such as a schedule or an alarm / morning call (S111), the voice command detects field information of a specific format (S112). In operation S114, the detected information is input to a corresponding field of the executed menu.

At this time, the user can confirm whether the detected information is correct information that can be input in a specific information field (eg, a dinner appointment with a friend entered at 7:00 pm on March 8th. Save? Yes / No Please answer, if there is no response, it will be automatically saved after 5 seconds) (S113).

If the voice command does not include information to be input in the information field or if there is an additional information field to be input, the controller 180 may request input to the information field by an error processing algorithm ( Example: The alarm time has been entered, please tell me the date and content) (S117).

As the confirmation request for the received voice command is output as described above, the user may respond (eg, Yes / No) by using voice or other input means, and re-enter the voice command. In addition, field information requested for re-entry may be additionally input. In this case, the other input means may be input by using a hardware button, a software button, or a touch method.

The controller 180 may repeat the above process until the input of information on all the information fields provided in the menu is completed (S115). When the information input for the information field provided in the menu is completed, the executed menu may be terminated (S116). In addition, the controller 180 maintains the activated state of the voice recognition function until all input of the field information is completed, and then terminates the activated state of the voice recognition function when all information input for each field is completed. Can be.

6A is an exemplary diagram for explaining a method of activating a voice recognition function of a mobile terminal according to the present invention.

If the voice recognition function is kept active, resource consumption and power consumption increase according to the continuous operation of the voice recognition algorithm. Therefore, it is necessary to control the start and end of activation of the voice recognition function in order to prevent unnecessary power consumption of the mobile terminal and to reduce resource consumption.

Therefore, in the present invention, the activation can be controlled by receiving an arbitrary button provided in the user input unit 130 (410). The arbitrary button may be a hardware button or may be a software button or an icon 411 displayed on the display unit 151.

The software button includes a menu call button in the standby state.

That is, when the menu call button 411 is input in the standby state, the controller 180 may output a menu list and simultaneously activate the voice recognition function.

In addition, the controller 180 may control activation of the voice recognition function when an arbitrary area (an area where no button or menu icon is displayed) on which the display unit 151 is displayed is touched (420). ).

In addition, the controller 180 may control activation of the voice recognition function when a sound or a sound of a specific level or more is input (430). For example, in the present invention, the voice recognition function can be driven in two modes. That is, it may be driven in a first mode that simply detects a sound or sound above a certain level, and in a second mode that recognizes a voice command and determines the meaning of the voice command. When this is input, the voice command can be recognized by activating the second mode.

In addition, the voice recognition function may control activation when a short distance or long distance wireless signal or motion information of a body including a user's hand gesture or gesture is input (440).

On the other hand, as the voice recognition function is activated as described above, the controller 180 relates to a menu list (not shown) displayed on the display unit 151 for the information range of a specific database which can be referred for voice recognition. Can be specified with information.

If a particular menu is selected or executed in the menu list, the information range of the database may be specified with information related to the selected menu or its submenus. In addition, when the selected and executed specific menu is a menu composed of a plurality of information fields, such as a schedule or a wake-up call / alarm function, the selected menu may be specified as information in a format that can be input in the information field.

In addition, when the specific menu is selected or executed by a voice command or a touch input, the controller 180 may input into submenus of the selected or executed menu or a plurality of information fields included in any one menu. Help information related to the existing information can be output in the form of speech or balloon help.

For example, when the 'multimedia' menu is selected as shown in FIG. 6B, the help information 441 includes information related to submenus (eg, broadcast, camera, text viewer, game, etc.) including messages. Or it may be output as the help information 442 made of voice.

In addition, when the 'Schedule' menu is selected by a voice command or a touch input as shown in FIG. 6C (451), each information field (eg, date, time, content, alarm, repetition, end date, calendar) is selected. ) May be output as the help information 453 composed of a message, or the help information 454 and 456 composed of voice.

Alternatively, as illustrated in FIG. 6D, when a finger approaches for a menu touch to select a specific menu, the lower menu list 461 may be output. When the help information is output to the display unit 151, transparency or contrast may be adjusted according to an access distance. That is, the closer the information is, the more clearly the help information may be displayed.

As described above, the operation mode for outputting the help information may be set with an option related to an environment setting menu. A user who is not familiar with the voice command by the help information can control a menu related to a specific function or service by the voice command.

Meanwhile, the controller 180 may automatically terminate the activation state after maintaining the activation state for a predetermined time. In addition, the controller 180 may maintain the activation state only while a specific button or touch is being input, and then terminate the activation state when the input is released. In addition, the controller 180 may automatically terminate the activation state if a voice is not input for a specific time after the activation state starts. In addition, even if a voice is not input for more than a specific time, the controller 180 may maintain an active state until a specific menu being executed ends.

7A is a flowchart illustrating a voice command recognition method of a mobile terminal according to the present invention.

As the voice recognition function is activated as described above, the controller 180 is provided with a menu list displayed on the display unit 151, or submenus thereof, or a menu thereof, for the information range of a database which can be referred to for voice recognition. Information that can be input in the information field can be specified (S201).

The voice command received after the voice recognition function is activated may be stored in a specific database of the memory 160 (S202 and S203). The voice command may be temporarily stored and automatically deleted when the meaning of the voice command is completed. In addition, when specific information is detected from the voice command and inputted into the information field of the menu, the information may be automatically deleted.

When the voice command is input in a state in which the information range is specified as described above, the controller 180 analyzes the content and context of the voice command within the specified information range of the database using a voice recognition algorithm. In this case, the voice command may be converted into information in text format for analysis, and the converted text format information may be stored in a specific database of the memory 160 (S204). However, it is not necessary to convert the voice command into textual information.

The controller 180 may detect a specific word or keyword included in the voice command for analysis of content and context (S205).

Based on the detected word or keyword, the content or context of the voice command may be analyzed and its meaning may be determined with reference to information stored in a specific database (S206).

The referenced database may have a specific information range, and may execute a function or menu related to the meaning of the voice command determined with reference to the database (S207).

The executed menu may be a menu composed of a plurality of information fields, and by determining a field format of information detected by the voice command (S208), each information may be input into one of the plurality of information fields. There is (S209).

As described above, the information range for speech recognition is specified by information related to specific menus, thereby improving speech recognition speed and recognition rate and reducing resource consumption of the terminal. The recognition rate may correspond to a name set in a specific menu or an appropriate degree of information that can be input in a specific information field.

The recognition rate of the voice command may be determined by the number of pieces of suitable information related to a specific function or menu among information included in the voice command. Therefore, the recognition rate of the voice command may be increased when the voice command includes information (eg, a menu name) that exactly matches a specific function or menu. In addition, the recognition rate can be increased when the voice command includes information of a suitable format that can be input into a specific information field of the executed menu.

FIG. 7B is an exemplary diagram for explaining a method of detecting specific field information in a voice command and inputting the information field when a plurality of information fields are provided in the executed menu.

As shown in FIG. 7B, it is assumed that a natural language voice command (eg, Everyday, set six in the morning) for executing a specific function (or menu) is input while the 'schedule' menu is selected by a voice command or a touch method. do. Accordingly, the controller 180 may specify the information area of the database as information in a format capable of inputting field information related to 'schedule'.

In addition, the voice command detects a meaningful word (eg, everyday, six, morning) in a format that can be entered in each information field (eg, date, time, content, alarm, repetition, end date, calendar), and each information. Enter in the relevant information field. 'Everyday' corresponds to the 'date' field or 'end date' field, 'six' corresponds to the 'time' field, and 'morning' corresponds to the detailed options of the 'time' field (e.g., am) Can correspond.

If there is field information (eg, content, alarm, repetition) that is not input in the first voice command, the controller 180 may request information input of the insufficient field (eg, tell the contents). Tell me how many times do you want to repeat the alarm?). In response to the information input request, the user may continue to input the information by voice.

If the re-input information is correct, the controller 180 enters the information field. In addition, the user may check whether the received information is correct information. When the input of all the information fields of the schedule menu is completed, the schedule information may be automatically stored. The control unit 180 may continue to activate the voice recognition function until the schedule information input is completed.

Meanwhile, in the input voice command (eg, Everyday, set six in the morning), a word having a format that cannot be input in an information field of a schedule function may be determined as a meaningless word. For example, a preposition (in) or an article (the) may be determined as a grammatically meaningless word. Whether the keyword detected in the voice command is a meaningful word is not necessarily determined grammatically, and the criterion may be changed according to a currently executed function, a menu, or a range of information set in a database.

For reference, the natural language is a concept of calling a language that people commonly use from an artificial language, which is an artificially created language, and may be processed using a natural language processing algorithm. Since the natural language may or may not include the exact name associated with a particular menu, it may be difficult to recognize voice commands 100% accurately.

Therefore, if the recognition rate is above a certain value (eg, 80%), it can be determined to be accurate, and if there are a plurality of meanings having the recognition rate (that is, a voice command that can be interpreted as various meanings having a similar recognition rate is inputted). In this case, related menus may be displayed, and at least one function or menu may be executed by the user's selection.

In addition, even when the voice information corresponding to a specific information field is input, if the pronunciation is similar or the information format is not clearly determined, the recognized field information is displayed, and one of them is input by the user's selection. Can be. In displaying the menus or the field information, the recognition rates may be displayed in a relatively high order.

For example, as shown in FIG. 8A, the position of the menu icon having a high recognition rate may be displayed closer to the center of the screen (510), and the menu icon having a high recognition rate may have different sizes, colors, and contrasts. In operation 520, the display may be displayed by highlighting or adjusting transparency. In this case, the recognition rate of the menu or field information having a high user's selection among the plurality of displayed menu icons or field information may be changed higher. That is, the recognition rate may learn the number of times of selection of the menu or field information frequently selected by the user, and change the recognition rate of the selected menu or field information.

In addition, for information to be input in a specific information field, at least one of size, color, contrast, and the like may be differently displayed for more accurate information as shown in FIG. 8B, and may be displayed by highlighting or adjusting transparency. May be 530.

For example, when an arbitrary natural voice command (eg, Wake me up at seven) is input and the voice command does not include correct field information, the controller 180 analyzes the context and content of the voice command. Through it can be determined as a voice command associated with the 'alarm / wake-up call' function, and the information (seven) related to the function can be determined as a time information field. However, the time information field does not include accurate field information on whether 'am' or 'pm'.

Accordingly, the controller 180 may display the help information to select '7 pm' or '7 am' (530). Alternatively, user confirmation information such as 'set to morning 7?' Accordingly, the controller 180 can select and input one of the displayed options from the user. Alternatively, the correct information field can be input by receiving a confirmation or negative response from the user. That is, when the user responds with 'YES', the user may input '7 am' and when the user responds with 'NO', the user may input '7 pm'. An alarm repetition frequency may be set in the same manner as described above (531).

Even when inputting field information included in a specific function as described above, learning is frequently performed on information that is frequently inputted, and thereafter, the possibility of the information being input in the same function increases. Accordingly, when some incorrect field information is input, the field information may be automatically completed and input.

9 is an exemplary view for explaining an information retrieval method using field information included in a voice command of a mobile terminal according to the present invention.

Assume that the mobile terminal is in a standby state.

When a specific menu (eg, recent call menu, phone book menu, multimedia menu) is selected by the user in the standby state, the controller 180 executes the selected menu or displays submenus thereof.

Then, the activation of the voice recognition function is started internally (S301).

When the activation of the voice recognition function is started, the controller 180 sets the information range of the database for recognizing the voice command in accordance with a preset configuration option to increase the recognition rate; Alternatively, the information may be specified as information in a format that can be input in the information field of the executed menu.

In the state where the lower menus are displayed as described above, the controller 180 may select a specific menu by receiving a user's voice command, touch, or button. When a specific menu is selected as described above, the controller 180 can display submenus or information fields.

It is assumed that a natural language voice command (for example, show me yesterday phone calls) is input while the voice recognition function is activated as described above (S302).

The controller 180 detects meaningful words or keywords (eg, show, yesterday, calls) related to a specific function or menu according to the content and context of the voice command. In this case, field information (eg, yesterday) corresponding to each word or keyword may be determined. For example, it is determined whether the keyword is information related to a time field or information related to a date field.

The meaning of the highest recognition rate is determined by analyzing the context and the content of the voice command with reference to a specific database (S303). It is possible to more accurately determine the meaning of the voice command in the database related to the information range of the function or menus (eg, phone book, schedule, morning call) related to the detected word or key field information (S304). .

Therefore, after searching the recent call list (S305), the controller 180 filters the call list using the time field information (eg yesterday) (S306). The filtered call information may be output to the display unit 151 (S307).

As described above, the method of determining the meaning of the voice command using the field information can be usefully applied to a function for which the exact name is not preset.

10 is an exemplary view for explaining the configuration of a database for voice command recognition of a mobile terminal according to the present invention.

The database stores information for determining the meaning of the voice command, and may configure a plurality of databases according to the characteristics of the information. Each database configured according to the characteristics of the information may be updated under continuous learning under the control of the controller 180.

The learning of the database corresponds to a voice that the user pronounces with a word associated therewith. For example, when the user pronounces "birthday" but recognizes "life", the user changes "life" to "birthday". By correcting, it is to learn to be recognized as "birthday" for the same pronunciation from now on.

Through the learning, a plurality of pieces of voice information may correspond to pieces of information in the database.

Each database according to the characteristics of the information may include a first database 161 for storing voice information for recognizing a voice input through a microphone in a phoneme, syllable, or morpheme unit, and a voice command based on the recognized voice information. A second database 162 for storing information (eg, grammar, pronunciation accuracy, sentence structure, etc.) for determining the overall meaning of the information, and a third database for storing information related to menus for functions or services included in the mobile terminal; 163, a fourth database 164 for storing information related to the information field included in the function or menu, or information for determining a word or key field detected by a voice command, and the determined voice command It may include a fifth database (165) for storing the help information to be output to receive the meaning from the user or to receive the field information. have.

Each database may be specified as information related to menus of a specific category according to the information range set for the aforementioned voice command recognition. In addition, each database may store voice (pronounced) information and phoneme, syllable, morpheme, word, keyword, or sentence information corresponding to the voice (pronounced) information.

Accordingly, the controller 180 determines an meaning included in a voice command or determines field information included in the voice command by using at least one of the plurality of databases 161 to 165. According to the determined meaning, a specific function or service may be performed or information may be input in a field provided in a specific menu.

11 is an exemplary view for explaining a method for indicating that a voice command recognition function is performed in a mobile terminal according to the present invention.

As shown in the drawing, the present invention may display an operation state or operation mode to which a voice command recognition function is applied using an indicator 500 or an icon having a specific shape. When outputting the indicator or icon, a specific sound or voice may be output to notify the user.

According to an embodiment of the present invention, the above-described method may be embodied as computer readable code on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include the controller 180 of the terminal.

The mobile terminal of the present invention described above is not limited to the configuration and method of the above-described embodiments, the embodiments are a combination of all or part of the embodiments selectively so that various modifications can be made It may be configured.

1 is a block diagram of a mobile terminal associated with one embodiment of the present invention;

Figure 2 is a front perspective view of an example of a mobile terminal according to the present invention.

3 is a rear perspective view of the mobile terminal of FIG. 2;

4 is an exemplary diagram of a communication system operable by a terminal according to the present invention;

5A and 5B are flowcharts illustrating an example of a method of controlling a menu using voice of a mobile terminal according to the present invention;

6A is an exemplary diagram for explaining a method of activating a voice recognition function of a mobile terminal according to the present invention;

6b to 6d are exemplary views for explaining a method of outputting help information of a mobile terminal according to the present invention.

7A is a flowchart for explaining a voice command recognition method of a mobile terminal according to the present invention;

Figure 7b is an exemplary view for explaining a voice recognition method of a mobile terminal according to the present invention.

8A and 8B are exemplary views for explaining a menu display method according to a voice recognition rate of a mobile terminal according to the present invention;

9 is an exemplary view for explaining a voice command recognition method of a mobile terminal according to the present invention.

10 is an exemplary view for explaining the configuration of a database for voice command recognition of a mobile terminal according to the present invention.

11 is an exemplary view for explaining a method for indicating that a voice command recognition function is performed in a mobile terminal according to the present invention;

Claims (16)

A signal input unit configured to receive a signal for controlling activation of a voice recognition function or a signal for selecting and executing a specific function or menu; A memory for organizing information related to each menu or function of the mobile terminal which can be referred to for voice recognition as a database; The information range to be referred to in the database is specified according to the input signal, the contents and context information of the voice command are analyzed with reference to the specified information, and the meaning of the voice command is determined as the analyzed information. And a controller for outputting a result value corresponding to the meaning to a specific component of the terminal. The method of claim 1, wherein the control unit, Menus currently displayed on the display, or Submenus of a particular menu selected from the displayed menu, or Commands that can be executed in the selected specific menu or submenu, or Field information that can be input in an information field provided in the selected specific menu or sub-menu, or And a range of information to be referred to with information related to data lists output from the selected specific menu or submenu. The method of claim 1, wherein the signal input unit, Even in the activated state of the voice recognition function, Button input, touch input, short or long range wireless signal, or A mobile terminal, characterized in that receiving at least one signal of body information and voice information including a user's approach or gesture or gesture. The method of claim 1, wherein the control unit, A control signal for controlling a function corresponding to the meaning of the voice command or a specific component of the terminal; or Data to be output from a menu corresponding to the meaning of the voice command or a function executed according to the voice command, or And detecting field information inputted in a specific information field included in the menu or function by the voice command and outputting the result as a result value. The method of claim 1, wherein the control unit, Obtaining a recognition rate indicating accuracy of the meaning of the determined voice command, And displaying menus or field information having a relatively high recognition rate differently from other menus or information according to the recognition rate. The method of claim 5, wherein the control unit, For a menu, a function, or field information corresponding to the order of high recognition rate, And at least one of size, position, color, contrast, and highlight information. The method of claim 5, wherein the control unit, By learning the number of times of selection or the number of times of inputting a specific menu selected by the user among the plurality of displayed menus, And adjusting the recognition rate of the selected menu based on the learning information or automatically completing specific field information and inputting it into a related information field. The method of claim 1, wherein the control unit, Confirming the meaning of the determined voice command or outputting a message requesting input of field information to be input in a specific information field; And receiving a user's response by a voice command or a button or a touch, and outputting a result value corresponding to the response to a specific component or an information field. The method of claim 1, wherein the database, A first database for storing voice or pronunciation information for recognizing the input voice command in a phoneme, syllable, or morpheme unit; A second database for storing information related to a word, a keyword, a grammar, or a sentence structure for determining the meaning of the voice command; A third database for storing information related to a menu for a function or service provided in the mobile terminal; A fourth database for storing information related to an information field provided in the function or menu, or information for determining a field of information detected by a voice command; And at least one of a fifth database storing help information to be output in order to receive the meaning of the determined voice command from a user or to receive field information. Receiving a signal instructing selection and execution of a specific function or menu; Activating a voice recognition function; Specifying an information range of a database to be referred for voice recognition according to the input signal; Analyzing contents and contextual information of the voice command with reference to the specified information, and determining the meaning of the voice command as the analyzed information; And outputting a result value corresponding to the meaning of the determined voice command to a specific component of the terminal. The method of claim 10, The signal instructing selection and execution of the specific function or menu is Button or touch input, or Body information and voice commands, including user access, hand gestures, or gestures, The information processing method of the mobile terminal which is input as at least one of them. The method of claim 10, wherein the voice command, The voice information may be converted into a specific format for analyzing the content and the contextual information, and at least one of the specific formats is a text format. The method of claim 10, wherein the information range, Menus currently displayed on the display, or Submenus of a particular menu selected from the displayed menu, or Commands that can be executed in the selected specific menu or submenu, or Field information that can be input in an information field provided in the selected specific menu or sub-menu, or And at least one of information related to data lists output from the selected specific menu or submenu. The method of claim 10, wherein if a specific menu is executed by the voice command, Detecting the field information of a specific format in the voice command, And automatically input the detected field information into a related information field among a plurality of information fields provided in the executed menu. The method of claim 14, wherein the information field provided in the specific menu, The field information to be entered in the information field is not included in the voice command, If there is additional field information to be input, the information processing method of the mobile terminal, characterized in that configured to request the input of the field information. The method of claim 10, wherein the voice command, Among the information stored in the database, The recognition rate indicating the accuracy of the meaning is determined by the number of information related to the context or content of the voice command, The information processing method of the mobile terminal, characterized in that the value for determining the recognition rate can be set differently for each piece of information.

Images