WO2018124549A1 - Simulation device for virtual experience of air leisure-sports and control method thereof - Google Patents

Abstract

Disclosed are a simulation device for virtual experience of air leisure-sports and a control method thereof. A control method according to the present invention comprises the steps of: sensing a user's motion state by using a pre-configured motion sensing unit; determining an angle of a particular part of an arm of the user, an angle of a particular part of a leg, and a relative height of a particular part of an arm on the basis of the sensed motion state of the user; selecting one posture pattern corresponding to the user's posture among a plurality of posture patterns on the basis of determined information; and processing a simulation corresponding to the selected posture pattern.

Description

Simulation device for aviation sports report and control method

The present invention relates to a simulation apparatus for a virtual aviation sports report and a control method thereof, and more particularly, to an apparatus and a control method for recognizing the motion of the aviation sports report virtual experience, and processing a simulation corresponding to the operation. .

Recently, many people are using leisure time to experience various kinds of sports, and one of them is aviation sports.

For example, skydiving is an aviation report that climbs high by using an aircraft or a device, and then jumps with a parachute, freely dropping or performing various movements, unfolding a parachute at a predetermined altitude, and landing safely. wingsuit is an aviation lesports that jumps off a cliff or aircraft in a wingsuit, a special parachute jumpsuit that attaches cloth between hands and feet.

However, these aviation reports basically carry the risk of serious injury or death if the parachute is not extended or hits other objects.

In addition, aviation reports require expensive means to ensure their stability (e.g. aircraft) and high-cost equipment to ensure stability, so significant investments are necessary to enjoy aviation reports.

These risks and the relatively high cost burdens are creating obstacles for more people to experience aviation sports.

Therefore, it is necessary to provide a device or a service that can more safely enjoy the experience according to the aviation report. Conventionally, a technology related to a device that allows a parachute training as shown in Korean Patent No. 10-1473291 is proposed, but the game No simulation device has been proposed to act as an element.

In particular, in order to deal with the human body sensitivity effects, a conventionally complicated algorithm is applied, which raises the system cost or causes the processing delay.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned conventional problems, and an object thereof is to provide a simulation apparatus and a control method for providing a practical aviation sports virtual experience service based on the exact operation of the experiencer at a minimum cost.

In order to achieve the above object, a simulation apparatus for an aviation sports report virtual experience according to the present invention includes: a motion sensing unit for sensing a motion state of an external experience person; A determination unit that determines an angle of a specific portion of the arm of the experienced person, an angle of a specific portion of the leg, and a relative height of the specific portion of the arm based on the operation state detected by the motion detection unit; A posture pattern selecting unit that selects any one posture pattern corresponding to the posture of the experienced person from among a plurality of posture patterns based on the information determined by the determination unit; It includes a simulation processing unit for performing a simulation process corresponding to the posture pattern selected by the posture pattern selection unit.

In addition, in order to achieve the above object, a control method of a simulation apparatus for an aviation sports virtual experience according to the present invention includes: detecting an operation state of an experienced person using a pre-installed motion detection unit; Determining an angle of a specific part of the arm of the experienced person, an angle of a specific part of the leg, and a relative height of the specific part of the arm based on the operation state of the experienced person detected in the step; Selecting one of the posture patterns corresponding to the posture of the experienced person from among a plurality of posture patterns based on the determined information; And performing a simulation process corresponding to the selected posture pattern.

1 is a functional block diagram of a simulation apparatus for aviation sports virtual experience according to an embodiment of the present invention,

FIG. 2 is a diagram illustrating a determination part determined by the simulation apparatus of FIG. 1 for simulation processing based on an operation state of an experienced person.

3 is an example of a pre-stored posture pattern table.

4 to 9 specifically show each posture pattern in the table of FIG. 3 as a character model.

FIG. 10 is an overall control flowchart of a simulation apparatus for an aviation sports virtual experience according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The functional block of the simulation apparatus 100 for aviation sports virtual experience according to an embodiment of the present invention is shown in FIG. 1.

As shown in the figure, the simulation apparatus 100 according to an embodiment of the present invention, the motion detection unit 110, the determination unit 120, the posture pattern selection unit 130, the simulation processing unit 140, posture correction It may be configured to include a notification unit 150, score calculation unit 160.

Here, the motion detection unit 110 performs a function of detecting the operation state of the external experience person, where the external experience person means a person who enjoys the aviation sports virtual experience.

The experienced person may take various actions while standing in front of the simulation apparatus 100 according to the present invention, or may take various actions while hanging on a predetermined structure.

The motion detection unit 110 may be configured in various ways. For example, when a predetermined sensor is mounted on an external user, the motion detection unit 110 may determine an operation state of the corresponding user based on information transmitted from the sensor. If the motion detection unit 110 is provided with a kinect sensor that emits infrared rays and the infrared rays are reflected back from the body of the external experience, the kinect sensor The operation state of the external experience person may be detected based on the information recognized by the.

The determination unit 120 determines an angle of a specific portion of the arm of the corresponding person, an angle of a specific portion of the leg, and a relative height of the specific portion of the arm based on the operation state detected by the motion detection unit 110. Perform the function.

Specifically, the determination unit 120 sets the angle between the straight line connecting the shoulder and elbow and the straight line connecting the elbow and the cuff as the first variable value, and the second variable is the angle between the straight line connecting the pelvis and knee and the straight line connecting the knee and ankle. Value, and the relative height between the cuff and the elbow can be determined as the third variable value.

A diagram of this is shown in FIG. 2.

That is, FIG. 2 (a) shows a body part for calculating the value of the above-mentioned first variable, and FIG. 2 (b) shows a body part for calculating the value of the above-mentioned second variable, FIG. (c) shows the body part for calculating the value of the above-mentioned third variable.

The posture pattern selecting unit 130 performs a function of selecting one posture pattern corresponding to the posture of the experienced person among the plurality of posture patterns based on the information determined by the determination unit 120.

For example, the posture pattern selector 130 stores information on a plurality of posture patterns in advance, and the posture pattern closest to the current posture of the experienced person based on the information determined by the determination unit 120. Can be selected.

For example, assuming that a table as shown in FIG. 3 is stored in the posture pattern selecting unit 130, and as a result of the determination of the determination unit 120, the above-described first variable value is 90 degrees and the second variable value is 125 degrees. When the third variable value is (UP, UP) (that is, the height of the left and right cuffs is higher than the elbow), the posture pattern selecting unit 130 uses the table of FIG. 3 to display the first posture pattern ( STANDARD ARCH) can be selected.

As another example, as a result of the determination by the determination unit 120, the above-described first variable value is 90 degrees, the second variable value is 125 degrees, and the third variable value is (UP, DOWN) (that is, the height of the cuff on the right side). Is higher than the right elbow, and the height of the left cuff is lower than the left elbow), the posture pattern selecting unit 130 may select the third posture pattern using the table of FIG. 3. It is.

3 to 9 specifically illustrate each posture pattern in the table in FIG. 3.

As such, selecting one of the closest posture patterns by storing the plurality of posture patterns in advance and comparing them with the actual posture of the experienced person can improve the processing speed compared to applying a complicated algorithm, and thus occurs during the simulation process. The advantage is that processing delay can be minimized.

In particular, in selecting a posture pattern, if the angle of a specific part of an arm of a participant, the angle of a specific part of a leg, and the relative height of a specific part of an arm are used first, a simulation for aviation sports virtual experience is processed quickly as will be described later. There is also an effect that can be done.

Meanwhile, the simulation processor 140 performs a function of performing a simulation process corresponding to the posture pattern selected by the posture pattern selector 130.

Specifically, the simulation process corresponding to each attitude pattern of FIG. 3 will be described.

(1) STANDARD ARCH: A so-called frog pose, which is judged as the basic attitude of the skydiving before opening the parachute and simulated.

(2) ROTATE LEFT / RIGHT: It judges that it is a rotation movement and handles left turn, right turn, etc. according to the lowering arm.

(3) HEAD DOWN DELTA: Simulates the tracking forward posture, that is, the long-distance posture, and simulates.

(4) FORWARD TRACK / REVERSE TRACK: Simulates forward or backward movement as a high altitude approach posture.

(5) HARD ARCH / DE ARCH: Determining the attitude to reduce or increase the speed of descent, and process the corresponding simulation.

(6) SIDE-SLIP LEFT / RIGHT: It means the posture to move like sliding to the left / right and performs simulation processing accordingly.

In this case, the simulation processing unit 140 performs simulation processing corresponding to each posture, for example, providing an image corresponding to each posture pattern to the head mounted display (HMD) worn by the experienced person. This may be included.

In addition, the simulation processor 140 determines and accumulates the descent speed of the experienced person in consideration of the posture pattern selected by the posture pattern selector 130, and considers the accumulated descent speed and the newly selected posture pattern to perform new simulation processing. Can be performed.

That is, whenever the experiencer performs a specific movement, the cumulative storage of the descent speed, which is one of the simulation processing results according to the corresponding movement, is stored, and when the experiencer takes a new movement, the simulation processing takes into account the cumulatively stored descent speed and the new movement of the experiencer. To do.

Meanwhile, the posture correcting notification unit 150 extracts and guides a difference between the posture pattern selected by the posture pattern selection unit 130 and the actual posture of the experienced person.

As described above, the posture pattern selector 130 selects a posture pattern closest to the posture of the experiencer, which means that the experiencer may not exactly match any one of the stored posture patterns. In this case, the posture correcting notification unit 150 may guide the experienced person to the difference between the posture pattern selected by the posture pattern selection unit 130 and the actual posture of the experienced person so that the experienced person can take a more accurate posture by herself. It is.

As a specific example, the posture correcting notification unit 150 may include an angle (first variable value described above) of a specific part of the arm of the experienced person, an angle (second variable value described above) of a specific part of the experiencer's leg, and The area of the body part corresponding to the variable showing the greatest difference according to the comparison, comparing each value defined in the posture pattern with the relative height (specific value of the third variable) of the specific part of the arm as the value of each variable. You can control to display the posture model image displayed in a specific color.

That is, the posture correcting notification unit 150 may visually indicate a posture (posture necessary for correct operation when compared with a pre-stored posture pattern) to be corrected first by the current experiencer.

Here, the posture correcting notification unit 150 may display the above-described posture model image on a predetermined display unit connected thereto, or transmit the posture model image to the HMD worn by the experienced person so that the experienced person can see through the HMD. It may be.

In particular, the posture correction notification unit 150 controls to display a guide color corresponding to the difference value between the posture pattern selected by the posture pattern selection unit 130 and the actual posture of the experience person, according to the posture change of the experience person. When the difference value changes, the guide color may be dynamically changed to correspond to the change value.

Accordingly, experienced users wearing HMD can intuitively correct their posture while checking the state and change of the guide color.

For example, if the elbow angle is incorrect, a red circle appears in the elbow portion of the posture model image displayed in some areas of the HMD, and as the experiencer adjusts the elbow angle closer to the preset posture pattern, the red circle in the elbow portion Gradually, it can be changed into a blue circle.

When there are several postures to be corrected, the experienced person can easily check the areas to be corrected first with color only, and the corrected parts are displayed in another color so that the experienced person can enjoy his / her virtual flight experience while enjoying the aviation sports report. It is easy to check the accuracy.

The score calculation unit 160 calculates a value corresponding to the difference between the posture pattern selected by the posture pattern selector 130 and the actual posture of the experienced person, and performs the function of reflecting the score of the experienced person.

For example, the score calculation unit 160 may give a higher score as the experienced person takes an accurate posture for each situation, and may rank if there are several experienced people.

This may increase the frequency of use of the simulation apparatus 100 according to the present invention by acting as another competitive factor among the experienced users enjoying the virtual experience.

In other words, the score calculation unit 160 does not base the score calculation on the basis of, for example, how to pass a predetermined course or how quickly the course passes, and how accurate the actual posture of each situation of the experienced person is. By doing so, the experienced practitioner can earn higher scores.

For example, if a simulation course (for example, a moving course in an aviation sports space) is randomly selected, even a trained experienced person may not receive a high score. By using it as an element of your estimates, you can increase your chances of getting a high score.

The overall control process of the simulation apparatus 100 according to an embodiment of the present invention described above will be described with reference to FIG. 10.

First, the simulation apparatus 100 detects an operation state of an experienced person, and various methods, such as a method using Kinect, may be used to detect the operation state.

Subsequently, the simulation apparatus 100 determines a specific part angle of the arm of the participant, an angle of a specific part of the leg, and a relative height of the specific part of the arm by using the sensed operating state of the experienced person, and based on the determined values. Select a posture pattern that is closest to the presenter's current posture.

Thereafter, the simulation apparatus 100 performs a simulation process corresponding to the selected posture pattern.

On the other hand, the process of performing each of the above-described embodiments can be performed by a program or an application stored in a predetermined recording medium (for example, computer readable). Here, the recording medium includes both an electronic recording medium such as a random access memory (RAM), a magnetic recording medium such as a hard disk, an optical recording medium such as a compact disk (CD), and the like.

In this case, the program stored in the recording medium may be executed on hardware such as a computer or a smartphone to perform the above-described embodiments. In particular, at least one of the functional blocks of the simulation apparatus according to the present invention described above may be implemented by such a program or application.

As described above, according to the present invention, the operation of the aviation sports reporter can be recognized more quickly, and simulation processing corresponding thereto can be performed.

In particular, the experienced person can easily check whether or not his posture is the correct posture by the color-based expression even during the experience.

Furthermore, by judging the scores by considering not only the completion of the tasks in the simulation but also the accuracy of the posture of the experienced person, even if the simulation course is randomly selected, the skilled person who can perform the correct movement can receive a higher score. .

Claims (12)

(a) detecting an operation state of the experience person using a pre-installed motion detection unit; (b) determining an angle of a specific part of the arm of the experienced person, an angle of a specific part of the leg, and a relative height of the specific part of the arm based on the operation state of the experienced person sensed in step (a); (c) selecting one of the posture patterns corresponding to the experiencer's posture among a plurality of posture patterns based on the information determined in the step (b); and (d) performing a simulation process corresponding to the posture pattern selected in step (c). The method of claim 1, In the step (d) the simulation process, (d1) determining and accumulating and storing the descent speed of the experienced person in consideration of the posture pattern selected in step (c); and (d2) performing a new simulation process in consideration of the cumulatively stored descent speed and the newly selected posture pattern in step (d1). The method of claim 1, and (e) extracting and guiding a difference between the posture pattern selected in step (c) and the actual posture of the experienced person. The method of claim 3, (f) calculating a value corresponding to the difference between the posture pattern selected in the step (c) and the actual posture of the experienced person, and reflecting the result in the score of the corresponding experienced person. Control method of the simulation device for. The method of claim 3, In step (e), (e1) each value defined in the posture pattern using the angle of a specific part of the arm of the experienced person, the angle of a specific part of the leg of the experienced person, and the relative height of the specific part of the arm of the experienced person as respective variables. Comparing with; and (e2) displaying the posture model image in which the body part region corresponding to the parameter having the greatest difference according to the comparison of the step (e1) is displayed in a predetermined specific color. Control method of the simulation apparatus for the. The method of claim 3, The guidance in the step (e) is to display the guide color corresponding to the difference between the posture pattern selected in the step (c) and the actual posture of the experience person, If the difference value of the step (e) is changed according to the change of the posture of the experiencer, the step of changing the guide color so as to correspond to the changing difference value control of the simulation apparatus for the aviation sports virtual experience Way. A motion detector for detecting a motion state of an external experiencer; A determination unit that determines an angle of a specific portion of the arm of the experienced person, an angle of a specific portion of the leg, and a relative height of the specific portion of the arm based on the operation state detected by the motion detection unit; A posture pattern selecting unit that selects any one posture pattern corresponding to the posture of the experienced person from among a plurality of posture patterns based on the information determined by the determination unit; And a simulation processing unit for performing a simulation process corresponding to the posture pattern selected by the posture pattern selection unit. The method of claim 7, wherein The simulation processor determines and accumulates the descent speed of the experienced person in consideration of the posture pattern selected by the posture pattern selector, and performs a new simulation process in consideration of the accumulated and stored descent speed and the newly selected posture pattern. Features simulation device for aviation sports virtual experience. The method of claim 7, wherein And a posture correction notification unit for extracting and guiding a difference between the posture pattern selected by the posture pattern selection unit and the actual posture of the experienced person. The method of claim 9, And a score calculator which calculates a value corresponding to a difference between the posture pattern selected by the posture pattern selection unit and the actual posture of the experienced person and reflects the score of the experienced person. . The method of claim 9, The posture correcting notification unit may be defined in the posture pattern using angles of specific portions of the arm of the experienced person, angles of the specific portion of the leg of the experienced person, and relative heights of specific portions of the arm of the experienced person, respectively. Simulation for aviation sports virtual experience, which compares each value and controls to display the posture model image in which the body part area corresponding to the variable having the greatest difference is displayed in a specific color according to the comparison. Device. The method of claim 9, The posture correcting notification unit controls to display a guide color corresponding to a difference value between the posture pattern selected by the posture pattern selection unit and the actual posture of the experienced person, and when the difference value changes according to the posture change of the experienced person, And a simulation apparatus for aviation sports virtual experience, wherein the guide color is changed to correspond to a difference value.

Images