TWI643163B - Simulation training system and method - Google Patents

Abstract

An analog training system includes an electronic device and an analog training server. The electronic device includes a display module, a control module electrically connected to the display module, and an audio input module electrically connected to the control module. The display module displays A simulated situational picture. The simulation training server communicates with the electronic device, and includes a storage unit and a processing unit electrically connected to the storage unit. The storage unit includes a dedicated keyword database storing at least one keyword and a storage of at least one keyword related to the keyword. a voiceprint comparison database of the voiceprint information, wherein the display module displays the simulated situation screen, and receives an audio signal from the audio input module, and the processing unit matches the at least one keyword and the sound according to the text corresponding to the sound signal. The voiceprint information of the signal outputs a score result.

Description

Simulation training system and method

The invention relates to a simulation training system, in particular to a simulation training system applied to disaster medical rescue.

Disaster Medical Rescue Under the traditional teaching methods, trainees often only have the necessary professional knowledge through film and books, and their experience is limited. If the simulation site and physical props are arranged for the students to actually simulate the operation in the classroom, the cost and time cost of the practice is very high, and it is not easy to hold anytime and anywhere.

The prior art further designs the drill for disaster medical rescue as a "serious game". For the students who participate in serious games, the main task in the game is still the actual operational ability, not the training command ability.

No matter the "traditional teaching" or "serious game" mentioned above, there is no way for the trainees to practice the disaster relief as a "commander". Therefore, it is impossible to train the trainees to stably command and dispatch under the pressure of the situation. And operate various operating procedures.

Therefore, in order to solve the above-mentioned teaching difficulties that have not been easy to break through for a long time In the environment, the trainees issued orders in the disaster relief, and measured the on-site command and dispatch ability of the trainees in a quantitative, objective and unified standard, which is the focus of the invention.

Accordingly, it is an object of the present invention to provide an analog training system including an electronic device and an analog training server. The electronic device includes a display module, a control module electrically connected to the display module, and an audio input module electrically connected to the control module, and the display module displays an analog situation image. The simulation training server communicates with the electronic device, and includes a storage unit and a processing unit electrically connected to the storage unit. The storage unit includes a dedicated keyword database storing at least one keyword and a voiceprint comparison database. The pattern comparison database stores at least one voiceprint information related to the keyword, wherein the display module displays the simulated situation screen, and receives an audio signal from the audio input module, and the processing unit matches the text corresponding to the sound signal according to the sound signal. At least one keyword in the special keyword database and a voice information of the voice signal output a score result.

Further, the processing unit outputs the scoring result according to whether the text corresponding to the audio signal conforms to the at least one keyword in the special keyword database, and analyzes the voiceprint information corresponding to the keyword matching the keyword.

In an embodiment, the electronic device further includes a transceiver module electrically connected to the control module, and the simulation training server further includes a transceiver unit electrically connected to the processing unit. The transceiver module communicates with the transceiver unit to transmit the voice signal.

In one embodiment, the electronic device further includes a storage module electrically connected to the control module, the storage module stores a simulation training program, and the storage unit further includes a scene script database stored with the simulation training program.

In one embodiment, the scoring result is an integral value, a fractional value, or a gauge that is generated in accordance with an authentication rule.

In an embodiment, the simulation training system further includes another electronic device, wherein the display modules display the same simulated situational image, and each of the audio input modules receives each of the audio signals, and the processing unit receives the Whether the text corresponding to the sound signal matches the at least one keyword in each of the special keyword databases, and the voiceprint information of the voice signal outputs the score results.

Therefore, another object of the present invention is to provide an analog training method for providing an analog situational picture through an electronic device, and receiving an audio signal according to the analog signal, according to the text corresponding to the audio signal. Whether or not the at least one keyword and the voiceprint of the voice signal are met and a score result is output.

Further, when the voice signal is received, the score result is output according to whether the text corresponding to the voice signal meets at least one keyword and the voiceprint corresponding to the text of the keyword.

The effect of the invention lies in: using the technology of speech recognition to obtain keywords and voiceprint waveforms in the voice input by the student, to quantify, objectively and uniformly standardize The method measures the trainee's on-site command and dispatch capability.

100‧‧‧simulation training system

10‧‧‧Electronic devices

11‧‧‧Display module

12‧‧‧Control Module

13‧‧‧Audio output module

14‧‧‧Audio input module

15‧‧‧ Storage Module

16‧‧‧ transceiver module

20‧‧‧simulation training server

21‧‧‧ storage unit

211‧‧‧ Student Account Database

212‧‧‧Scenario Script Database

213‧‧‧Special Keyword Database

214‧‧‧ voiceprint comparison database

22‧‧‧Processing unit

23‧‧‧ transceiver unit

S10~S40‧‧‧Steps

Other features and effects of the present invention will be apparent from the embodiments of the present invention, wherein: FIG. 1 is a schematic block diagram of an embodiment of the simulation training system of the present invention; and FIG. 2 is a simulation training method of the present invention. A flow chart of an embodiment.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same reference numerals.

1 is an embodiment of a simulation training system 100 according to the present invention. The simulation training system 100 can be applied to a command situation such as a disaster medical rescue, a corporate education training, and the like, such as a military array medicine and a fire drill. , a large number of injuries and treatments, earthquakes and typhoon disasters, air disasters and ship disasters, and even the command simulation of business managers and simulation operations, training students (trainees) in the case of the situational situation pressure, to determine whether the students can Command and dispatch and operate various standard operating procedures in a dangerous situation. In particular, the above-mentioned "military medical science" areas include: advanced life-saving surgery, disaster medicine, disaster search and rescue skills, tactical medicine, field medicine, trauma treatment, radiation prevention and biological protection, aviation physiology and medicine, seabed medicine, etc. Is suitable for application The command situation.

In the present embodiment, the simulation training system 100 is a simulation training applied to "arms medicine", which includes an electronic device 10 and a simulation training server 20.

The electronic device 10 is a Virtual Reality (VR) or Augmented Reality (AR) device, such as HTC VIVE or Google glasses, for the trainee (trainee) to wear on the head to achieve immersion. The sound and light effects of the experience.

The electronic device 10 includes a display module 11 , a control module 12 , an audio output module 13 , an audio input module 14 , a storage module 15 , and a transceiver module 16 . The display module 11 is configured to display an analog scenario screen; the control module 12 is electrically connected to the display module 11 for controlling the operation between the modules; the audio output module 13 is electrically connected to the control module 12 for matching display. The analog image displayed by the module 11 outputs corresponding sound signals, such as background music, popping sound, etc., and the audio input module 14 is electrically connected to the control module 12 for receiving an audio signal sent by the trainee in the simulated situation. That is, the content of the training is usually a series of voice commands; the storage module 15 is electrically connected to the control module 12, and stores a simulation training program for the control module 12 to display, and the display module 11 displays the The simulation screen of the training program is simulated, and the sound of the simulation training program is output through the audio output module 13; the transceiver module 16 is electrically connected to the control module 12 for communicating with the simulation training server 20.

The simulation training server 20 is a background host of a training unit, which is specific In the embodiment, the electronic device 10 may be integrated into the same device. The simulation training server 20 includes a storage unit 21, a processing unit 22 electrically connected to the storage unit 21, and a transceiver unit 23 electrically connected to the processing unit 22.

The storage unit 21 stores a student account database 211, a scene script database 212, a special keyword database 213, and a voiceprint comparison database 214. The student account database 211 stores personal data such as the account number and password of each trainee, and also stores the scores of the trainee's answering process, points, metering, conversion level, and real-time ranking. The scenario script database 212 stores a plurality of scripts associated with the simulation training program for dynamically affecting the simulation training program of the electronic device 10. The special keyword database 213 stores at least one keyword, and the keywords may be changed according to different scenario scripts and applications, and may be a single vocabulary or an instruction, for example, the special keyword database 213 may be a military medical system. The keyword database stores a plurality of keywords related to military medical science, as well as keywords such as folk idioms, proverbs, and abbreviations. The voiceprint comparison database 214 stores a plurality of voiceprint information, including the calmness, fluency, tension, relaxation, urgency, and stuttering, which can reflect the state information of the trainee in the simulated situation.

The processing unit 22 is configured to compare the audio signal received by the audio input module 14 to the dedicated keyword database 213 and the voiceprint comparison database 214, and output a score result according to the comparison result. The transceiver unit 23 communicates with the transceiver module 16 of the electronic device 10 for transmitting the audio signal received by the audio input module 14.

Referring to FIG. 1 and FIG. 2, FIG. 2 is a flowchart of a simulation training method according to the present invention. The simulation training method displays a simulated situation image through the electronic device 10, and receives a simulated situation from the trainee under the simulated situation screen. The sound signal is sent, and a score result is output according to whether the text corresponding to the sound signal meets at least one keyword and the voiceprint corresponding to the text of the keyword. The flow of the simulation training method of the present embodiment will be described in detail below.

In step S10, when the trainee wears the electronic device 10 and performs simulation training, the display module 11 displays a login screen (not shown) for the trainee to log in to the account and password.

In step S20, after the trainee logs in to the account, the control module 12 loads the simulation training program, and controls the display module 11 to display the simulated scenario screen of the scenario script related to the simulated training program, and outputs the same through the audio output module 13. The sound of the simulation training program.

In this embodiment, the processing unit 22 determines which scenario script to use according to the training situation of the trainee, the past score, the background of the trainee, and the like, and the selection method may be through artificial intelligence analysis or manual selection. In the present embodiment, the simulation training system 100 is a simulation training applied to disaster medical rescue, so the scenario script is a disaster scene, so that the trainee can fully feel the tension due to the immersive experience provided by the electronic device 1. The simulated situational picture can collapse many houses after the disaster, and a large number of injuries need to be treated. There will be many computers on the screen. The stylized controlled virtual care and ambulance personnel are all waiting for the command of the trainees.

In order to train the trainees' ability of crisis management and command and dispatch, they become commanders or leaders in various enterprises in disaster medical rescue. Therefore, at the beginning of training (ie, after displaying the simulated situation screen), the audio input mode The group 14 will continue to receive the voice command (audio signal) sent by the trainee, and when receiving the voice signal, the transceiver module 16 will transmit the voice signal to the transceiver unit 23, so that the processing unit 22 compares the voice signal. Whether the corresponding text meets at least one keyword and analyzes the voiceprint signal corresponding to the text corresponding to the keyword, as shown in step S30.

Under the simulation training of the present invention, the virtual medical care and ambulance personnel in the picture perform corresponding actions according to the instructions issued by the trainee, for example, commanding the first team to rescue the injured, the second team searching for the survivor, and the third team. Mobile support, etc. In the process of the trainee issuing the command (sound signal), the processing unit 22 continuously compares the text corresponding to the voice signal with at least one keyword, for example, whether there is a "detection" or a "category" Keywords such as "survivors". In addition, because a good commander or a high-ranking supervisor should be in danger during crisis management, the processing unit 22 will also determine the voiceprint of the trainees when they read the keywords, and then judge that the order is urgent. Still fluent.

In step S40, the processing unit 22 outputs a scoring result according to the comparison and the analysis result, and the scoring result may be an integral value, a fractional value, or a quantification level and the like which are quantified according to a detection rule.

In response to the above step S30, the processing unit 22 determines whether keywords such as "detection", "category", and "survivor" are read in the process of disaster relief, and if so, points can be obtained or higher points can be obtained; If you miss a keyword or read a keyword that is not suitable for use (such as colloquialism, swearing), you will not be able to earn points or earn lower points. The processing unit 22 also compares the voiceprint information when the keywords are pronounced with the voiceprint information in the voiceprint comparison database 214, and obtains a higher score if the voiceprint signal is calm or fluent. Points; if you are nervous or stuttering, you will not be able to earn points or earn lower points. Thus, as the simulation training program of the electronic device 10 continuously executes the scenario of the script, the simulation training server 20 continuously receives the sound signal and continues to perform the integral calculation.

In particular, the processing unit 22 can also compare the voiceprint information of the entire voice signal with the voiceprint information in the voiceprint comparison database 214, that is, not only the voiceprint when comparing the keywords. Information, in the same way, if the voice signal of the voice signal is calm or fluent, it will earn points or obtain higher points; if it is nervous or stuttering, it will not be able to earn points or obtain lower points. In addition, the scoring result is stored in the student account database 211 for the reference of the trainee in the next training, and the scoring result can also be transmitted to the electronic device 10 or other device through the transceiver unit 23, not The examples are limited.

In special applications, the simulation training system 100 can also provide different training modes for selection, such as "practice mode", "test mode", "entertainment mode" and the like. If "practice mode" is selected, a prompt message will be displayed through the display module 11 during the process, so that the trainee can see the prompt message and remind the trainee to read the instructions (keywords) for the purpose of teaching; If you select "Admission Mode", the system will perform the above steps to obtain the score result; if you choose "Entertainment Mode", it is purely game-like, mainly for customs clearance and entertainment. The mode selection may be preset in advance, or after the trainee logs in, the mode selection is performed first and then step S20 is performed.

In another embodiment, the simulation training system 100 can include a plurality of electronic devices 10 for simultaneous examination by a plurality of trainees, that is, each trainee wears an electronic device 10 and is in the same scenario script (same context). Next, the multi-person command scheduling is performed, and the respective processing units 22 output respective scoring results. Furthermore, in another embodiment, the simulation training system 100 can further include a monitoring device (not shown), which is mainly used by the inspector or the appraisal officer to add the script of the simulation training program performed by the trainee. . The internal structure of the monitoring device can be the same as that of the electronic device 10. The audio input module of the monitoring device can be used by the inspector or the appraisal officer to issue a status command to the simulation training server 20, so that the processing unit 22 can use the scenario script database. The preset content of 212 dynamically affects the simulation training program of the electronic device 10, and the purpose thereof is to dynamically cause the test subject to encounter an unexpected situation, and to check whether the trainee can command the voice to correctly send the command correctly.

In summary, the simulation training system and method of the present invention determines whether the text corresponding to the voice signal read by the trainee matches the keyword and the sound. The voiceprint information of the signal to identify whether the trainees can command and dispatch and operate various standard operating procedures during crisis management such as disaster medical rescue, so it is true that the invention can be achieved in a quantitative, objective and unified manner. The purpose of the student's on-site command and dispatch capability is measured.

However, the above is only the embodiment of the present invention, and the scope of the invention is not limited thereto, and all the equivalent equivalent changes and modifications according to the scope of the patent application and the patent specification of the present invention are still The scope of the invention is covered.

Claims (5)

An analog training system includes: an electronic device, comprising: a display module, a control module electrically connected to the display module, and an audio input module electrically connected to the control module, the display module displaying an analog situation And a simulation training server, communicating with the electronic device, comprising: a storage unit and a processing unit electrically connected to the storage unit, the storage unit comprising a dedicated keyword database storing at least one keyword and a sound a comparison database, the voiceprint comparison database stores at least one voiceprint information related to the keyword, wherein the display module displays the simulated situation image, and the audio input module receives an audio signal, The processing unit outputs a scoring result according to whether the text corresponding to the audio signal conforms to the at least one keyword in the special keyword database, and analyzes the voiceprint information corresponding to the text of the keyword, and the scoring result is related to The number of the at least one keyword that the voice signal has, and the emotion indicated by the voiceprint information is calm or tense. The simulation training system of claim 1, wherein the electronic device further comprises a transceiver module electrically connected to the control module, the simulation training server further comprising a transceiver unit electrically connected to the processing unit, the transceiver module The group communicates with the transceiver unit to transmit the voice signal. The simulation training system of claim 1, wherein the electronic device further comprises a storage module electrically connected to the control module, the storage module storing a simulation training program, the storage unit further comprising a storage unit and the storage module Simulated training course A related scenario script database. The simulation training system of claim 1, further comprising another electronic device, wherein the display modules display the same simulated situation picture, and each of the audio input modules receives each of the audio signals, and each processing unit receives the same according to the same Whether the text corresponding to the voice signal conforms to the at least one keyword in each of the special keyword databases, and the voiceprint information of the voice signal outputs the score result. An analog training method is to provide an analog situational image through an electronic device, and receive an audio signal under the simulated context image, according to whether the text corresponding to the audio signal meets at least one keyword, and analyze and match the keyword The voiceprint corresponding to the text outputs a score result, the score result is related to the number of the at least one keyword that the voice signal has, and the emotion indicated by the voiceprint information is calm or nervous.