KR101636360B1 - A virtual maintenance training system using a virtual reality - Google Patents

Abstract

A virtual maintenance training system (VMTs) of an air-guided weapon mechanic using a virtual reality according to the present invention is characterized in that a first control signal associated with three-dimensional position and vibration information on the mechanic's virtual space is transmitted to a position track device and a haptic A controller for receiving from the remote controller and controlling to transmit a three-dimensional image associated with the virtual maintenance training to a task screen; And a virtual control unit coupled to the virtual maintenance control unit, for generating a second control signal for selecting a type of the virtual maintenance training and controlling the environment of the training, and for generating, based on the first control signal and the second control signal, A training control device for performing maintenance training, based on three-dimensional position and vibration information for each of a plurality of mechanics, and for controlling the training environment for each of a plurality of mechanics.

Description

TECHNICAL FIELD [0001] The present invention relates to a virtual maintenance training system using a virtual reality,

The present invention relates to a virtual maintenance training system using a virtual reality and a control apparatus therefor.

Virtual reality refers to a human-computer interface that makes a certain environment or situation computerized and makes the person who uses it behave as if they are interacting with the actual environment and environment. This virtual reality has been applied to the training system and developed into an immersive virtual environment technology in which the trainee participates in a virtual training environment by wearing virtual reality interaction equipment to enhance the immersion effect of the training. This immersive virtual reality technology is applied not only to training but also to design analysis system, so users can immerse themselves in the virtual environment at the design stage of the product and reflect the analysis results to the design to improve the quality of the product .

In this regard, there has conventionally been a flight training method and a flight training system of an aircraft or a fighter in a virtual space. However, there is a problem that the virtual maintenance training system and the virtual maintenance training system for aviation induction weapons for the maintenance of the fighter in case of failure are not yet utilized.

In this regard, when the virtual maintenance training method and the virtual maintenance training system are not used, there is a problem that the component hardware is actually erroneously operated for the cost generation and the failure occurrence training to implement the training equipment in hardware. In addition, there is a problem that the mechanic is exposed to the risk of injury due to handling of the hardware because he is trained in maintenance work using actual air-guided weapon.

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve such problems, and it is an object of the present invention to control the type and environment of virtual maintenance training.

Another object of the present invention is to recognize the operation of a plurality of mechanics performing virtual maintenance training at the same time and to perform virtual maintenance training.

In order to achieve the above object, a virtual maintenance training system (VMTs) of an air-guided weapon mechanic using a virtual reality according to the present invention includes a first control A controller for receiving a signal from the position track device and the haptic remote controller and controlling the transmission of the 3D image associated with the virtual maintenance training to the task screen; And a virtual control unit coupled to the virtual maintenance control unit, for generating a second control signal for selecting a type of the virtual maintenance training and controlling the environment of the training, and for generating, based on the first control signal and the second control signal, A training control device for performing maintenance training, based on three-dimensional position and vibration information for each of a plurality of mechanics, and for controlling the training environment for each of a plurality of mechanics.

According to one embodiment, the first control signal is associated with three-dimensional position and vibration information for each of the plurality of mechanics, and the second control signal is capable of controlling the environment of the training for each of the plurality of mechanics have.

According to one embodiment, the apparatus further comprises a motion sensor for recognizing the operation of the mechanic, the training control device receiving operation information on the operation of the mechanic from the motion sensor, Maintenance training can be carried out.

According to one embodiment, the second control signal controls at least a part of the configuration of the air-guided weapon to be in an abnormal operation, and in response to the abnormal operation, based on the operation information recognized by the motion sensor, Training can be carried out.

According to one embodiment, when the collision with objects on the virtual space is recognized, the vibration information may be displayed as a vibration or a tactile sense in proportion to the magnitude of the collision.

According to one embodiment, the training control device includes: an interface unit receiving the first control signal; And a controller for performing the virtual maintenance training on the basis of the first control signal and the second control signal, wherein the controller includes: a content generation tool module for generating contents of the virtual maintenance training; And a database management module for storing the training scenario configuration module and the content, scenario, check item, and equipment library.

According to one embodiment, the control unit may include a training control module and training exercises for performing the functions associated with the training configuration of the virtual maintenance training, inputting a failure situation, training control, trainee management and training result management, And a training and practice module that performs the functions associated with the interfacing interface.

According to the present invention, training can be performed based on a second control signal for selecting a type of virtual control training and a first control signal associated with the three-dimensional position and vibration information on the mechanic's virtual space and controlling the training environment have.

According to the present invention, the environment of training for each of a plurality of mechanics can be controlled based on three-dimensional position and vibration information for each of a plurality of mechanics.

1 is a diagram showing a detailed configuration of a virtual maintenance training system according to the present invention.
2 is a detailed configuration diagram of a training control apparatus for virtual maintenance training according to the present invention.
3 shows a detailed configuration module of a virtual maintenance training system, in accordance with an embodiment of the present invention.
4 is a conceptual diagram showing the principle of execution of a virtual maintenance training system according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, It will be possible. While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and are herein described in detail. It is to be understood, however, that the invention is not intended to be limited to the particular forms disclosed, but on the contrary, is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

The present invention proposes a virtual maintenance training system of an air-guided weapon mechanic using a virtual reality in order to solve the problem of the maintenance test of the air-guided weapon.

Hereinafter, a virtual maintenance training system and a virtual maintenance training method of an air-guided weapon mechanic using a virtual reality according to the present invention will be described in detail with reference to the drawings.

1 is a diagram showing a detailed configuration of a virtual maintenance training system according to the present invention. 1, the virtual maintenance training system 100 includes a track IR device 110, a task screen 120, a training execution device 130, and a training control device 135.

The virtual maintenance training system 100 further includes a control screen 125, a location / haptic sensor 140, a haptic remote controller 150, a glass appliance 160, a location track device 170 and a motion sensor 180 .

The track IR device 110 interlocks with the task screen 120 displaying a screen related to virtual maintenance training and displays the screen on the task screen 120. [

The task screen 120 receives a three-dimensional image associated with the virtual maintenance training from the training execution device 130 and displays the three-dimensional image. In addition, the task screen 120 may display a screen associated with the training or may display a tool box for performing the training.

The training execution device 130 receives a first control signal from the position track device 170 and the haptic remote controller 150 in association with the three-dimensional position and vibration information on the virtual space of the mechanic. In addition, the training execution unit 130 controls the three-dimensional image associated with the virtual maintenance training to be transmitted to the task screen.

The control screen 125 is connected to the training control device 135 and displays a screen related to the training by a second control signal for selecting the type of virtual maintenance training and controlling the environment of the training.

The training control device 135 is connected to the training execution device 130, and generates a second control signal for selecting a type of virtual maintenance training and controlling the environment of the training. Also, the training control device 135 performs the virtual maintenance training based on the first control signal and the second control signal.

Here, when a plurality of mechanics including a first mechanic and a second mechanic perform training simultaneously, the first control signal is associated with three-dimensional position and vibration information for each of a plurality of mechanics. The second control signal may also control the environment of the training for each of the plurality of mechanics.

The position / haptic sensor 140 receives a first control signal associated with the three-dimensional position and vibration information on the virtual space of the mechanic from the position track device. In addition, the position / haptic sensor 140 may transmit the first control signal to the training execution device 130. [ Here, the position / haptic sensor 140 receives a plurality of first control signals from the haptic remote controllers 150a and 150b of the first mechanic and the second mechanic, and transmits the first control signals to the training execution device 130 ). ≪ / RTI >

The haptic remote controller 150 receives the tactile information or the vibration information applied to the mechanic at the three-dimensional position on the virtual space, and transmits the received tactile information or vibration information to the position / haptic sensor 140.

The glass device 160 causes the first mechanic and the second mechanic to receive the three-dimensional image on the virtual space displayed through the task screen 120. [

The position track device 170 receives information about the three-dimensional position and posture on the virtual space of the first mechanic and the second mechanic. In addition, the position tracker 170 transmits information on the received position and attitude to the track IR device 110. [

 The motion sensor 180 recognizes the operations of the first mechanic and the second mechanic in the three-dimensional position on the virtual space. In addition, the motion sensor 180 transmits the recognized actions to the training execution device 130. [ An example of the motion sensor 180 may be a kinetic sensor.

In addition, the training control device 135 may receive the operation information on the operations from the motion sensor 180, and may perform the virtual maintenance training based on the operation information.

According to the above-described virtual maintenance training system, the track IR device 110 recognizes the operation of a plurality of mechanics, and the task screen 120 displays a screen zoom-in operation based on the recognized operation, / Zoom Out can be performed. In addition, the task screen 120 may display a moving screen based on the recognized operation. For example, when the first mechanic or the second mechanic turns the head or the line to the left / right, the screen may be displayed based on the movement. At this time, when the gaze of the first mechanic or the second mechanic is different, a screen may be displayed based on an average of gaze angles. Also, when the difference of the line of sight is larger than the reference value, the screen may be divided and a plurality of screens may be displayed.

On the other hand, the second control signal described above can be controlled so that at least a part of the configuration of the air-guided weapon is abnormally operated. In addition, the training control device 130 may perform virtual maintenance training based on the operation information recognized by the motion sensor 180 in response to the abnormal operation.

On the other hand, when the collision with the objects in the virtual space is recognized, the vibration information may be displayed in a vibration or tactile sense in proportion to the magnitude of the collision.

2 is a detailed configuration diagram of a training control apparatus for virtual maintenance training according to the present invention. Referring to FIG. 2, the training control device 135 includes an interface 136 and a controller 137. In addition, the training control device 130 may further include a memory unit 138.

The interface 136 receives the first control signal from the position / haptic sensor 140. In addition, the interface unit 136 may receive information about the 3D image associated with the virtual maintenance training from the track IR device 110. [ In addition, the interface unit 136 may receive the operation information related to the operations of the first mechanic and the second mechanic at the three-dimensional position on the virtual space recognized from the motion sensor 180.

The control unit 137 performs virtual maintenance training based on the first control signal and the second control signal. Here, the second control signal may be generated by the control unit 137 to select a type of the virtual maintenance training and to control the environment of the training.

The memory unit 138 stores the received first control signal and the generated second control signal based on a time or an event. The memory unit 138 may provide the control unit 137 with control information related to a specific control signal in response to a request message requesting a control signal based on a specific time or an event from the control unit 132 .

3 illustrates a detailed configuration module of a virtual maintenance training system, in accordance with an embodiment of the present invention. The detailed configuration module may be implemented by a software module or a hardware module of the control unit 137. [ In addition, information related to the virtual maintenance training may be categorized based on the detailed configuration module and stored in the memory unit 138. [

The virtual maintenance training system 300 shown in FIG. 3 may be classified into a plurality of detailed configuration modules as shown.

Meanwhile, FIG. 4 is a conceptual diagram illustrating an execution principle of a virtual maintenance training system according to an embodiment of the present invention. Each of the execution blocks shown in the conceptual diagram may be performed by a software module or a hardware module of the control unit 132. [ Also, at least some of the execution blocks may be categorized based on the detailed configuration module and stored in the memory unit 133. [

The virtual maintenance training system 300 includes an authoring tool module 310 and a training module 350.

The authoring tool module 310 includes a content creation tool module 320, a training scenario configuration module 330, and a database management module 340.

The training module 350 includes a training control module 360 and a training and practice module 370.

The content generation tool module 320 includes a data load module, an authoring function module, a procedure simulation module, and a procedure file storage module.

The training scenario configuration module 330 includes a training content management module and a training scenario management module.

The database management module 340 includes a failure object article management module, a tool bar management module, a maintenance item management module, a other item management module, and a backup and restoration module.

The training control module 360 includes a training situation configuration module, a failure situation input module, a training control module, a trainee management module, and a training result management module.

The training and practice module 370 includes a login module, a training and practice module, a virtual reality environment configuration module, and a device interface module.

3 and 4, the virtual maintenance training performed by the controller 137 and the memory unit 138 may be performed by the detailed configuration modules.

For example, the detailed configuration modules may include a content generation tool module 320, a training scenario configuration module 330, a database management module 340, and a training module 350.

The content generation tool module 320 generates content using two-dimensional / three-dimensional information and stores procedural information on the generated content in the training content database of the database management module 340. The generated content includes content related to a checking operation, a maintenance operation, and a mounting / demounting operation. In addition, the generated content may be generated based on the resource equipment library of the database management module 340 and the information on use of the resource equipment and the maintenance item from the maintenance item database.

The training scenario configuration module 330 generates a training scenario based on the training content from the training content database. The generated training scenario includes scenario basic information and a training process. The generated training scenario information may be stored in the training scenario database of the database management module 340.

The training module 350 generates training result information based on the training scenario database of the database management module 340 and the training scenario information and the failure situation information from the maintenance item database. The exercises performed at this time are login, selection of training scenarios, registration of fault conditions, training execution and completion / storage phases. The generated training result information is information generated in at least a part of the steps. The training result information is stored in the training result database of the database management module 340.

Referring to FIG. 4, the content generation tool module 320 stores information about the 2D / 3D image in the database management module 340. In addition, the stored information is used in the training module 350 when creating a training scenario.

The generated training scenario information is stored in the database management module 340 and the training scenario information is provided to the training execution device 130 or the training control device 135 by accessing the training module 350 .

On the other hand, the virtual maintenance training described above can be performed simultaneously by a plurality of mechanics, and it is also possible to perform different tasks on a plurality of screens. In this case, if the second mechanic is performing the task, it is also possible to display the task performing information by the second mechanic on the screen allocated to the first mechanic.

Accordingly, the present invention selects a type of the first control signal and the virtual maintenance training associated with the three-dimensional position and vibration information on the virtual space of the mechanic, and performs training based on the second control signal for controlling the training environment .

According to the present invention, the environment of training for each of a plurality of mechanics can be controlled based on three-dimensional position and vibration information for each of a plurality of mechanics.

Meanwhile, the controller 137 shown in FIG. 2 may be implemented by hardware, software, or a combination thereof. Further, the detailed configuration module of the control unit 137 may also be implemented by hardware, software, and a combination thereof.

According to a software implementation, not only the procedures and functions described herein, but also each component may be implemented as a separate software module. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in a memory and can be executed by a controller or a processor.

100: Virtual maintenance training system
130: Training execution device 135: Training control device

Claims (7)

In a virtual maintenance training system (VMTs) of an aviation guided weapon mechanic using virtual reality,
And a controller for receiving the first control signal associated with the three-dimensional position and vibration information on the virtual space of the mechanic from the position track device and the haptic remote controller and controlling the transmission of the three-dimensional image associated with the virtual maintenance training to the task screen A training execution device; And
Generating a second control signal for selecting a type of the virtual maintenance training using the first control signal including the three-dimensional position and controlling an environment of the training, connected to the training execution device, And a training control device for performing the virtual maintenance training based on the first control signal and the second control signal,
The training control device includes:
An interface for receiving the first control signal; And
And a controller for performing the virtual maintenance training based on the first control signal and the second control signal,
The control unit may include a content generation tool module for generating the content of the virtual maintenance training, a training scenario configuration module for configuring a scenario of the content based on the first control signal, and a storage unit for storing the content, scenario, A database management module,
Wherein the content generation tool module includes a data load module, an authoring function module, a procedure simulation module, and a procedure file storage module,
Wherein the training scenario configuration module includes a training content management module and a training scenario management module,
Wherein the database management module includes a failure object article management module, a tool block management module, a maintenance item management module, an other item management module, and a backup and restoration module,
Wherein the content generation tool module generates content using the three-dimensional location and stores procedural information on the content in the database management module. The method according to claim 1,
Wherein the first control signal is associated with three-dimensional position and vibration information for each of the plurality of mechanics, and wherein the second control signal controls the environment of the training for each of the plurality of mechanics. delete The method according to claim 1,
Wherein the second control signal controls at least a portion of the configuration of the air-
Wherein the control unit configures a training situation so that a mechanic can detect a failure by using the position track device and the haptic remote controller in response to a failure of a component when a failure situation is input in response to the abnormal operation, , A virtual maintenance training system. delete delete delete

Images