KR102816781B1 - Augmented reality game system and method for rehabilitation of patients with spinal disease - Google Patents

Abstract

The present invention discloses an augmented reality game system and method for rehabilitation of patients with spinal diseases.
An augmented reality game system for the rehabilitation of a patient with a spinal disease according to one embodiment of the present invention comprises: a server providing a rehabilitation program for the rehabilitation of a patient with a spinal disease in the form of an augmented reality game app; a rehabilitation configuration determining unit determining whether to use a rehabilitable body part and an auxiliary exercise device based on the patient's location; an active rehabilitation stage determining unit activating at least one mission stage among a plurality of stages of the augmented reality game; and a mission clear reaction providing unit providing a reaction upon completion of the mission stage; wherein each stage of the augmented reality game includes at least one spinal rehabilitation motion utilizing the rehabilitable body part with or without utilizing the auxiliary exercise device, and the mission stage activated by the active rehabilitation stage determining unit is characterized in that it varies depending on the patient's location.
The augmented reality game system and method for rehabilitation of patients with spinal diseases of the present invention can efficiently perform a rehabilitation program through mission stages configured differently depending on the patient's position.

Description

{AUGMENTED REALITY GAME SYSTEM AND METHOD FOR REHABILITATION OF PATIENTS WITH SPINAL DISEASE}

The present invention relates to the field of rehabilitation of patients with spinal diseases, and more specifically, to an augmented reality game system and method for rehabilitation of patients with spinal diseases, which enables posture correction and spinal rehabilitation of patients without being restricted by location by configuring mission stages of an augmented reality game for rehabilitation in various ways depending on the location of the patient.

Rehabilitation Exercise is an exercise that helps restore the function of a person whose function has been impaired due to injury, disease, or neurological disorder. The goal of musculoskeletal rehabilitation exercise is to restore the maximum pain-free movement, restore the balance of the body, and restore pain-free movement. At this time, it is safe to perform an exercise program designated by a specialist because performing exercise without proper exercise prescription or guidance can worsen symptoms.

However, visiting the hospital every time to perform a rehabilitation exercise program is a huge burden on the patient in terms of time and cost.

Accordingly, there is a need for a device or method that allows patients with spinal diseases to perform a rehabilitation exercise program efficiently regardless of location.

Patent Publication No. 10-2447195 (2022.09.21)

The present invention provides an augmented reality game system and method for the rehabilitation of patients with spinal diseases, which enables posture correction and spinal rehabilitation of patients regardless of their location by configuring mission stages of an augmented reality game for rehabilitation in various ways according to the location of the patient.

The tasks of the present invention are not limited to the tasks mentioned above, and other tasks not mentioned will be clearly understood by those skilled in the art from the description below.

An augmented reality game system for rehabilitation of a spinal disease patient according to one embodiment of the present invention,

A server that provides a rehabilitation program for patients with spinal disease in the form of an augmented reality game app;

A rehabilitation configuration decision unit that determines whether to use rehabilitable body parts and assistive exercise equipment based on the patient's position;

An active rehabilitation stage determining unit that activates at least one mission stage among multiple stages of the augmented reality game; and

Including a mission clear reaction providing unit that provides a reaction upon completion of the above mission stage;

Each stage of the augmented reality game includes at least one spinal rehabilitation movement utilizing the rehabilitable body part with or without utilizing the assistive exercise device, and the mission stage activated in the active rehabilitation stage determination unit is characterized in that it varies depending on the position of the patient.

Preferably,

The above rehabilitation composition determination unit detects the patient's posture using a wearable sensor attached to the patient and determines whether the patient's posture is one that worsens the patient's spinal disease.

The above active rehabilitation stage determining unit is characterized by including a correction stage including a correction movement necessary to correct the patient's posture in the activated mission stage.

Preferably,

The above active rehabilitation stage determining unit is characterized in that it is configured to adjust the number of repetitions and the repetition cycle so that the correction stage is repeatedly performed while the patient maintains a posture that worsens the spinal disease.

Preferably,

An image processing unit for collecting and processing images of the patient's rehabilitation exercises;

A rehabilitation motion range calculation unit that extracts at least one spatial coordinate of each joint from the rehabilitation motion image of the patient at regular time intervals to calculate the rehabilitation motion range of the patient; and

Further comprising an excess counting unit for counting the number of times the patient's rehabilitation exercise range exceeds the patient's limited rehabilitation exercise range diagnosed in advance by a doctor;

The above active rehabilitation stage determining unit is characterized by deactivating a mission stage that includes a number of operations exceeding a threshold.

Preferably,

The above active rehabilitation stage determining unit is characterized by adjusting the difficulty of the mission stage, the number of items constituting the mission stage, and the size of the items based on the type of the rehabilitable body part and the assistive exercise device determined according to the position of the patient.

Preferably,

The above rehabilitation configuration determining unit, the active rehabilitation stage determining unit and the mission clear reaction providing unit are configured in the patient's mobile terminal,

The location of the patient is characterized in that it is detected by a location sensor mounted on the patient's mobile terminal.

Preferably,

The above mission clear reaction providing unit is characterized by providing a change in the characteristics of the items constituting the above mission stage or providing micro-stimulation to the patient's rehabilitation body part.

An augmented reality game method for rehabilitation of a spinal disease patient according to another embodiment of the present invention,

Step of downloading a rehabilitation program in the form of an app of an augmented reality game for rehabilitation of a patient's spinal disease from a server;

A rehabilitation configuration determination step for determining whether to use rehabilitable body parts and assistive exercise equipment based on the patient's position;

An active rehabilitation stage determination step for activating at least one mission stage among multiple stages of the augmented reality game; and

A mission clear reaction providing step that provides a reaction upon completion of the above mission stage; including,

Each stage of the augmented reality game includes at least one spinal rehabilitation movement utilizing the rehabilitable body part with or without utilizing the assistive exercise device, and the mission stage activated in the active rehabilitation stage determination unit is characterized in that it varies depending on the position of the patient.

Preferably,

The above rehabilitation composition determination step includes a step of detecting the patient's posture using a wearable sensor attached to the patient and determining whether the patient's posture is a posture that worsens the patient's spinal disease.

The above active rehabilitation stage determination step is characterized by including a correction stage including a correction movement necessary to correct the patient's posture in the activated mission stage.

Preferably,

The above active rehabilitation stage determination step includes a step of adjusting the number of repetitions and repetition cycle so that the patient repeatedly performs the correction stage while maintaining a posture that aggravates the spinal disease.

Preferably,

The above active rehabilitation stage determination step is:

An image processing step of collecting and processing a video of the patient's rehabilitation exercises;

A rehabilitation movement range calculation step for calculating the rehabilitation movement range of the patient by extracting at least one spatial coordinate of each joint from the rehabilitation movement image of the patient at regular time intervals;

An excess counting step for counting the number of times the patient's rehabilitation range of motion exceeds the patient's limited rehabilitation range of motion diagnosed in advance by a doctor; and

Includes a step of disabling a mission stage that includes a number of operations exceeding a threshold.

Preferably,

The above active rehabilitation stage determination step includes a step of adjusting the difficulty of the mission stage, the number of items constituting the mission stage, and the size of the items based on the type of the rehabilitable body part and the assistive exercise device determined according to the position of the patient.

Preferably,

The above rehabilitation configuration determination step, the active rehabilitation stage determination step and the mission clear reaction provision step are performed by at least one processor of the patient's mobile terminal,

The location of the patient is characterized in that it is detected by a location sensor mounted on the patient's mobile terminal.

Preferably,

The above mission clear reaction providing step includes a step of changing the characteristics of the items constituting the above mission stage or providing micro-stimulation to the patient's rehabilitation body part.

Specific details of other embodiments are included in the detailed description and drawings.

The augmented reality game system and method for rehabilitation of patients with spinal diseases of the present invention can efficiently perform a rehabilitation program through mission stages configured differently depending on the patient's position.

The augmented reality game system and method for rehabilitation of patients with spinal diseases of the present invention configures rehabilitation parts of the body differently depending on the patient's position, and configures various items of the mission stage, thereby enabling the patient to easily perform the rehabilitation program.

However, the effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

FIG. 1 is a drawing schematically illustrating the configuration of an augmented reality game system for rehabilitation of a spinal disease patient according to one embodiment of the present invention.
FIG. 2a is a drawing schematically illustrating the configuration of a patient terminal of the augmented reality game system for rehabilitation of patients with spinal diseases of the present invention.
FIG. 2b is a diagram conceptually illustrating the operation of the active rehabilitation stage determination unit of the present invention.
FIG. 3 is a diagram schematically illustrating an image processing process for performing rehabilitation motion recognition using artificial intelligence according to one embodiment of the present invention.
FIG. 4 is a diagram schematically illustrating a preprocessing process of an image processing unit of a patient terminal according to one embodiment of the present invention.
Figure 5 is a drawing schematically illustrating a process of calculating a patient's rehabilitation exercise range by the rehabilitation exercise range calculation unit of the present invention.
FIG. 6 is a drawing illustrating a flow chart of an augmented reality game method for rehabilitation of a spinal disease patient of the present invention.
FIG. 7 is a diagram illustrating an exemplary computing device that may implement devices and/or systems according to various embodiments of the present invention.

The advantages and features of the present invention, and the methods for achieving them, will become clearer with reference to the embodiments described in detail below together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and the present embodiments are provided only to make the disclosure of the present invention complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

The embodiments described herein will be described with reference to cross-sectional and/or plan views, which are ideal illustrations of the present invention. In the drawings, the thicknesses of the components are exaggerated for the purpose of effectively explaining the technical contents. Accordingly, the components illustrated in the drawings have a schematic nature, and the shapes of the components illustrated in the drawings are intended to illustrate specific forms of the components and are not intended to limit the scope of the invention. Although the terms first, second, third, etc. have been used to describe various components in various embodiments of the present specification, these components should not be limited by these terms. These terms are only used to distinguish one component from another. The embodiments described and illustrated herein also include complementary embodiments thereof.

The terminology used herein is for the purpose of describing embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless the context clearly dictates otherwise. The terms "comprises" and/or "comprising" as used herein do not exclude the presence or addition of one or more other components, steps, operations, and/or elements to the mentioned components, steps, operations, and/or elements.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with a meaning that can be commonly understood by a person of ordinary skill in the art to which the present invention belongs. In addition, terms defined in commonly used dictionaries shall not be ideally or excessively interpreted unless explicitly specifically defined.

Hereinafter, with reference to the drawings, the concept of the present invention and embodiments thereof will be described in detail.

FIG. 1 is a diagram schematically illustrating the configuration of an augmented reality game system for rehabilitation of a spinal disease patient according to one embodiment of the present invention.

An augmented reality game system for rehabilitation of a spinal disease patient according to one embodiment of the present invention includes a patient terminal (110) and a server (120).

As shown in Fig. 1, the patient terminal (110) downloads a rehabilitation program for the patient's spinal disease rehabilitation from the server (120).

The rehabilitation program of the present invention is provided in the form of an augmented reality game app.

The augmented reality game of the present invention comprises a plurality of stages, each stage including at least one spinal rehabilitation movement utilizing a body part that can be rehabilitated with or without the use of an assistive exercise device.

The rehabilitation program of the present invention is configured to perform rehabilitation by utilizing specific body parts to rehabilitate a patient's spinal disease.

Multiple stages of the augmented reality game can be configured identically depending on the location of the patient's spinal disease.

Even though the augmented reality game of the present invention includes stages configured identically according to the spinal disease site, depending on the patient's severe condition and location, the mission stage activated among the multiple stages may vary, and the number of items, difficulty, and size of items constituting each mission stage may be configured differently, so that each spinal rehabilitation movement of the mission stage actually performed by each patient may be configured differently. The patient's location may be detected by a location sensor (e.g., a GPS sensor) mounted on the patient's mobile terminal (110).

As illustrated in Figure 1, the patient terminal (110) can periodically transmit mission completed stage information to the server (120).

The server (120) can notify the patient terminal (110) of a message urging performance of a stage where the mission has not been completed.

Additionally, the server (120) can transmit to the doctor information on stages where missions have been completed, stages where missions have not been completed, and information on rehabilitation program performance such as the number of missions completed for each stage, thereby utilizing the information as rehabilitation diagnosis information for the patient.

FIG. 2a is a drawing schematically illustrating the configuration of a patient terminal of the augmented reality game system for rehabilitation of patients with spinal diseases of the present invention.

The patient terminal of the present invention includes a rehabilitation configuration determination unit (112) that determines whether to use a rehabilitable body part and an assistive exercise device based on the patient's location, an active rehabilitation stage determination unit (114) that activates at least one mission stage among a plurality of stages of an augmented reality game, and a mission clear reaction provision unit (116) that provides a reaction upon completion of the mission stage.

The active rehabilitation stage determination unit (114) of the present invention can configure the activated mission stage differently depending on the patient's position.

As an example, a mission stage could be configured to have the patient perform simple neck stretches while riding public transportation such as a bus or subway.

As another example, the patient may be configured to perform mission stages involving relatively difficult rehabilitation movements using at least one assistive exercise device while remaining at home.

In one embodiment, the rehabilitation configuration determination unit (112) may pre-store a matching table that matches rehabilitable body parts according to the patient's position. The matching table may additionally match auxiliary exercise equipment according to the patient's position. The matching table may be pre-set and stored by the patient.

The rehabilitation composition decision unit (112) can detect the patient's posture using a wearable sensor attached to the patient and determine whether the patient's posture is one that worsens the patient's spinal disease.

Additionally, the active rehabilitation stage determination unit (114) of the present invention may include a correction stage that includes a correction movement necessary to correct the patient's posture in the activated mission stage.

For example, if it is detected that a patient is looking at a smartphone with his head down for a long time, the active rehabilitation stage determination unit (114) can activate a correction stage that includes movement of an item that can move the patient's gaze upward to correct the patient's cervical posture.

As a further example, if a patient sits on a chair for a long time in a posture that worsens scoliosis, the active rehabilitation stage determination unit (114) can add a correction stage to the mission stage that can straighten the patient's spine.

In one embodiment, the active rehabilitation stage determination unit (114) can be configured to adjust the number of repetitions and the repetition cycle so that the patient repeatedly performs the correction stage while maintaining a posture that worsens the spinal disorder.

In one embodiment, the patient terminal (110) may further include an image processing unit that collects and processes a rehabilitation exercise image of the patient, a rehabilitation exercise range calculation unit that extracts at least one spatial coordinate of each joint from the rehabilitation exercise image of the patient at regular time intervals to calculate the rehabilitation exercise range of the patient, and an excess counting unit that counts the number of times the rehabilitation exercise range of the patient exceeds the patient's limited rehabilitation exercise range diagnosed in advance by a doctor.

In one embodiment, the active rehabilitation stage determination unit (114) can deactivate a mission stage that includes a number of motions exceeding a threshold. Repeatedly exceeding the rehabilitation range of motion can be inferred to mean that the patient's rehabilitation motion is not correct, and excessive rehabilitation motions can worsen spinal disease in the patient, so measures are taken to prevent the patient from performing the rehabilitation motions.

In one embodiment, the active rehabilitation stage determination unit (114) is characterized by adjusting the difficulty of the mission stage, the number of items constituting the mission stage, and the size of the items based on the type of rehabilitable body part and assistive exercise equipment determined according to the patient's position.

In one embodiment, the mission clear reaction providing unit (116) is characterized by providing a change in the characteristics of an item constituting a mission stage or providing micro-stimulation to a patient's rehabilitation body part.

For example, a game item may be displayed on the screen and a patient may be made to perform a mission stage including a motor action of reaching out and grabbing the item, and when the patient performs the mission stage and grabs the item, the mission clear reaction providing unit (116) may be configured to cause the item to burst. As the item bursts on the patient terminal (110), the patient may recognize that he or she has successfully performed the mission stage.

In another embodiment, when a patient completes a mission stage, the mission clear reaction provider (116) can be configured to provide microstimulation to a muscle area rehabilitated in the corresponding mission stage so that the patient recognizes that the corresponding muscle area has been exercised.

FIG. 2b is a diagram conceptually illustrating the operation of the active rehabilitation stage determination unit of the present invention.

The active rehabilitation stage determining unit (114) of the present invention activates at least one mission stage among multiple stages of the augmented reality game.

The active rehabilitation stage determination unit (114) of the present invention can configure the activated mission stage differently depending on the patient's position.

As illustrated in Fig. 2b, the rehabilitation program downloaded from the server (120) may consist of a total of n stages.

The active rehabilitation stage determination unit (114) can activate stages 2, 4, and n when the patient is located at location 1.

However, when the patient is located at location 2, the active rehabilitation stage determination unit (114) can activate stages 1, 3, 4, and n-2.

Each mission stage can be configured differently depending on the location of the patient, on an instantaneous basis, as the patient's location changes.

FIG. 3 is a diagram schematically illustrating an image processing process for performing rehabilitation motion recognition using artificial intelligence according to one embodiment of the present invention.

Based on artificial intelligence, gesture recognition technology relies on input data.

Each input data has its own strengths and weaknesses in identifying actions, depending on its format. For example, RGB images are good at recognizing actions by extracting the color appearance of people in a video. However, they do not provide clues about the 3D structure of the image and are sensitive to lighting changes.

In this way, using a single modality in human gesture recognition does not guarantee optimal recognition because most of them have limited fields of view, cannot overcome occlusion, and are sensitive to illumination changes.

Therefore, the present invention uses a multi-mode motion recognition technology that combines an RGB image (310), a depth image (320), and a skeleton image (330).

Multi-mode gesture recognition technology provides more powerful gesture recognition, is insensitive to changes in lighting, and ensures good recognition in various environments.

First, the artificial intelligence combines the RGB image (310) with the depth image (320) and the skeleton image (330) to create an image in real time and stores it over time (340).

After preprocessing the input data, artificial intelligence performs cropping of the subject based on feature expression and motion classification (350). In this process, the shape of the human skeleton can be utilized and the subject can be cropped efficiently from the image using 2D skeletal coordinates.

Artificial intelligence uses a unique convolutional neural network (CNN) to extract features for each motion image and transform them to create a final image (360).

Each RGB image, depth image, and skeleton image has its own unique format differences, so combining them can greatly improve recognition performance.

Motion recognition is based on CNN (Convolution Neural Network) and vector values of input image data. is defined as , where n represents the number of input samples.

The output image of each convolution layer is as shown in Equation (1).

Equation (1)

은 계층의 인덱스에 해당하고,

는 시그모이드 활성화 함수이다.

는

번째 특징에 해당하는 편향이고,

은 필터 크기이다.

은

번째 특징 맵과

번째 필터 인덱스에 대한 가중치를 나타낸다.Here,

corresponds to the index of the silver layer,

is the sigmoid activation function.

Is

The bias corresponding to the th feature,

is the filter size.

silver

The second feature map and

Indicates the weight for the th filter index.

FIG. 4 is a diagram schematically illustrating a preprocessing process of an image processing unit of a patient terminal according to one embodiment of the present invention.

The patient terminal (110) of the present invention includes an image processing unit.

The image processing unit receives real-time images from the camera, performs image preprocessing, and generates RGB images, depth images, and skeleton images to be used in artificial intelligence.

The human body is a three-dimensional structure, but the real-time images coming from the camera are two-dimensional images that must be converted into three-dimensional images for artificial intelligence to perform rehabilitation movement recognition.

To accurately recognize body parts, the user must be recognized in three dimensions.

Therefore, the image processing unit of the present invention converts a real-time user image into a virtual 3D object by using a back-projection matrix algorithm that changes a 2D image of a camera into a 3D image.

In order to change a 2D image into a 3D image, you basically need to know the relationship between the 2D image and the 3D space. This can be obtained by using a camera backprojection matrix consisting of several camera parameters (e.g., internal parameters and external parameters), and by using this, you can obtain the information necessary to backproject a point in a 2D image into a 3D space. In this way, the camera backprojection matrix plays a key role in the task of obtaining 3D information.

The backprojection matrix converts the rehabilitation motion images from real-time images input from the camera into virtual three-dimensional images.

The virtual 3D user image generated by the image processing unit is transferred to the artificial intelligence so that the artificial intelligence can recognize the user's rehabilitation movements.

Figure 5 is a drawing schematically illustrating a process of calculating a patient's rehabilitation exercise range by the rehabilitation exercise range calculation unit of the present invention.

The rehabilitation exercise range calculation unit of the present invention extracts at least one spatial coordinate (510) of each joint from the patient's rehabilitation exercise image at regular time intervals to calculate the patient's rehabilitation exercise range.

The rehabilitation exercise range calculation unit of the present invention uses a technology that analyzes the patient's rehabilitation movements to guide a safe exercise range. After measuring the user's current exercise range of motion for each exercise content through image-based posture estimation, if an excessive movement is performed that exceeds the individual exercise goal entered by the doctor, the corresponding mission stage can be deactivated.

The rehabilitation exercise range calculation unit of the present invention extracts at least one spatial coordinate of each joint at regular time intervals from the user's rehabilitation exercise image information captured by a camera of the patient's mobile terminal or a separately installed webcam.

It automatically measures the range of motion based on each patient's different pain threshold and provides doctors with information on the patient's health status, thereby helping determine the level of rehabilitation and exercise goals for each patient.

The rehabilitation exercise range calculation unit of the present invention can be configured to prevent damage caused by excessive movement through a personalized service that automatically recognizes excessive movement that exceeds the safe exercise range of each patient set by a doctor when performing rehabilitation exercise and provides real-time guidance to prevent damage to the rehabilitation area.

FIG. 6 is a drawing illustrating a flow chart of an augmented reality game method for rehabilitation of a spinal disease patient of the present invention.

An augmented reality game method for rehabilitation of a patient with spinal disease according to another embodiment of the present invention includes a step (S610) of downloading a rehabilitation program in the form of an app of an augmented reality game for rehabilitation of a patient with spinal disease from a server.

At step S620, a rehabilitation configuration determination step is included to determine whether to use rehabilitable body parts and assistive exercise equipment based on the patient's position.

At step S630, an active rehabilitation stage determination step is included that activates at least one mission stage among a plurality of stages of the augmented reality game.

At step S640, a mission clear reaction providing step is included, which provides a reaction upon completion of the mission stage.

Each stage of the augmented reality game of the present invention includes at least one spinal rehabilitation movement utilizing a rehabilitable body part, with or without the use of an assistive exercise device.

The mission stage activated in the active rehabilitation stage determination unit of the present invention varies depending on the patient's position.

In one embodiment, the rehabilitation configuration determination step includes detecting the patient's posture using a wearable sensor attached to the patient and determining whether the patient's posture is a posture that worsens the patient's spinal condition.

In one embodiment, the active rehabilitation stage determination step is characterized by including a correction stage that includes a corrective motion necessary to correct the patient's posture in the mission stage being activated.

In one embodiment, the active rehabilitation stage determination step includes adjusting the number of repetitions and the repetition frequency so that the patient repeatedly performs the correction stage while maintaining a posture that worsens the spinal disorder.

In one embodiment, the active rehabilitation stage determination step includes an image processing step of collecting and processing a rehabilitation motion image of the patient, a rehabilitation motion range calculation step of extracting at least one spatial coordinate of each joint from the rehabilitation motion image of the patient at regular time intervals to calculate a rehabilitation motion range of the patient, an excess counting step of counting the number of times the rehabilitation motion range of the patient exceeds a limited rehabilitation motion range of the patient diagnosed in advance by a doctor, and a step of deactivating a mission stage including a number of operations exceeding a threshold.

In one embodiment, the active rehabilitation stage determination step includes adjusting the difficulty of the mission stage, the number of items constituting the mission stage, and the size of the items based on the type of the rehabilitable body part and the assistive exercise device determined according to the patient's position.

In one embodiment, the rehabilitation configuration determination step, the active rehabilitation stage determination step, and the mission clear reaction provision step are performed by at least one processor of the patient's mobile terminal.

In one embodiment, the patient's location is characterized by being detected by a location sensor mounted on the patient's mobile terminal.

In one embodiment, the mission clear reaction providing step includes a step of applying a change to a characteristic of the item constituting the mission stage or applying microstimulation to a rehabilitation body part of the patient.

FIG. 7 is a diagram illustrating an exemplary computing device that may implement devices and/or systems according to various embodiments of the present invention.

An exemplary computing device (700) that can implement devices according to some embodiments of the present disclosure will be described in more detail with reference to FIG. 7.

A computing device (700) may include one or more processors (710), a bus (750), a communication interface (770), a memory (730) for loading a computer program (791) executed by the processor (710), and a storage (790) for storing the computer program (791). However, only components related to the embodiment of the present disclosure are illustrated in FIG. 7.

Accordingly, a person skilled in the art will appreciate that the present disclosure may further include general components other than those illustrated in FIG. 7.

The processor (710) controls the overall operation of each component of the computing device (700). The processor (710) may be configured to include a CPU (Central Processing Unit), an MPU (Micro Processor Unit), an MCU (Micro Controller Unit), a GPU (Graphics Processing Unit), or any other form of processor (710) well known in the technical field of the present disclosure. In addition, the processor (710) may perform operations for at least one application or program for executing a method according to embodiments of the present disclosure. The computing device (700) may be equipped with one or more processors (710). The computing device (700) may refer to artificial intelligence (AI).

The memory (730) stores various data, commands, and/or information. The memory (730) can load one or more programs (791) from the storage (790) to execute a method according to embodiments of the present disclosure. The memory (730) may be implemented as a volatile memory such as RAM, but the technical scope of the present disclosure is not limited thereto.

The bus (750) provides a communication function between components of the computing device (700). The bus (750) may be implemented as various types of buses such as an address bus, a data bus, and a control bus.

The communication interface (770) supports wired and wireless Internet communication of the computing device (700). In addition, the communication interface (770) may support various communication methods other than Internet communication. To this end, the communication interface (770) may be configured to include a communication module well known in the technical field of the present disclosure.

According to some embodiments, the communication interface (770) may be omitted.

Storage (790) can non-temporarily store one or more programs (791) and various data.

Storage (790) may be configured to include non-volatile memory such as Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), flash memory, a hard disk, a removable disk, or any form of computer-readable recording medium well known in the art to which the present disclosure pertains.

The computer program (791) may include one or more instructions that cause the processor (710) to perform methods/operations according to various embodiments of the present disclosure when loaded into the memory (730). That is, the processor (710) may perform methods/operations according to various embodiments of the present disclosure by executing the one or more instructions.

Although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and various modifications may be made by those skilled in the art without departing from the gist of the present invention as claimed in the claims. Furthermore, such modifications should not be understood individually from the technical idea or prospect of the present invention.

Claims (14)

A server that provides a rehabilitation program for the rehabilitation of a patient's spinal disease in the form of an augmented reality game app; and
A patient terminal for downloading and executing the rehabilitation program from the server; wherein the patient terminal comprises:
A rehabilitation configuration decision unit that determines whether to use rehabilitable body parts and assistive exercise equipment based on the patient's position;
An active rehabilitation stage determining unit that activates at least one mission stage among a plurality of stages of the augmented reality game;
A mission clear reaction providing unit that provides a reaction upon completion of the above mission stage;
An image processing unit for collecting and processing images of the patient's rehabilitation exercises;
A rehabilitation movement range calculation unit that extracts at least one spatial coordinate of each joint from the rehabilitation movement image of the patient at regular time intervals to calculate the rehabilitation movement range of the patient; and
Including an excess counting unit that counts the number of times the patient's rehabilitation exercise range exceeds the patient's limited rehabilitation exercise range diagnosed in advance by a doctor;
Each stage of the augmented reality game includes at least one spinal rehabilitation movement utilizing the rehabilitable body part with or without utilizing the assistive exercise device, and the mission stage activated in the active rehabilitation stage determination unit varies depending on the position of the patient.
The above mission clear reaction providing unit changes the characteristics of the items that make up the above mission stage or provides micro-stimulation to the patient's rehabilitation body parts.
An augmented reality game system for rehabilitation of patients with spinal diseases, characterized in that the active rehabilitation stage determining unit deactivates a mission stage that includes a number of operations exceeding a threshold. In claim 1,
The above rehabilitation composition determination unit detects the patient's posture using a wearable sensor attached to the patient and determines whether the patient's posture is a posture that worsens the patient's spinal disease.
An augmented reality game system for rehabilitation of patients with spinal diseases, characterized in that the active rehabilitation stage determining unit includes a correction stage including a correction movement necessary to correct the patient's posture in the activated mission stage. In claim 2,
An augmented reality game system for rehabilitation of a spinal disease patient, characterized in that the active rehabilitation stage determining unit is configured to adjust the number of repetitions and the repetition cycle so that the correction stage is repeatedly performed while the patient maintains a posture that worsens the spinal disease. delete In claim 1,
An augmented reality game system for rehabilitation of patients with spinal diseases, characterized in that the active rehabilitation stage determining unit adjusts the difficulty of the mission stage, the number of items constituting the mission stage, and the size of the items based on the types of the rehabilitable body parts and the assistive exercise equipment determined according to the position of the patient. In claim 5,
The above rehabilitation configuration determining unit, the active rehabilitation stage determining unit and the mission clear reaction providing unit are configured in the patient's mobile terminal,
An augmented reality game system for rehabilitation of patients with spinal diseases, characterized in that the location of the patient is detected by a location sensor mounted on the patient's mobile terminal. delete Step of downloading a rehabilitation program in the form of an app of an augmented reality game for rehabilitation of a patient's spinal disease from a server;
A rehabilitation configuration determination step for determining whether to use rehabilitable body parts and assistive exercise equipment based on the patient's position;
An active rehabilitation stage determination step for activating at least one mission stage among multiple stages of the augmented reality game; and
A mission clear reaction providing step that provides a reaction upon completion of the above mission stage; including,
Each stage of the augmented reality game includes at least one spinal rehabilitation movement utilizing the rehabilitable body part with or without utilizing the assistive exercise device, and the mission stage activated in the active rehabilitation stage determination unit varies depending on the position of the patient.
The above mission clear reaction providing step includes a step of changing the characteristics of an item constituting the above mission stage or providing micro-stimulation to a rehabilitation body part of the patient.
The above active rehabilitation stage determination step is:
An image processing step of collecting and processing a video of the patient's rehabilitation exercises;
A rehabilitation movement range calculation step for calculating the rehabilitation movement range of the patient by extracting at least one spatial coordinate of each joint from the rehabilitation movement image of the patient at regular time intervals;
An excess counting step for counting the number of times the patient's rehabilitation range of motion exceeds the patient's limited rehabilitation range of motion diagnosed in advance by a doctor; and
An augmented reality game method for rehabilitation of a patient with a spinal disorder, comprising the step of disabling a mission stage that includes a number of movements exceeding a threshold. In claim 8,
The above rehabilitation composition determination step includes a step of detecting the patient's posture using a wearable sensor attached to the patient and determining whether the patient's posture is a posture that worsens the patient's spinal disease.
An augmented reality game method for rehabilitation of a patient with a spinal disease, characterized in that the above active rehabilitation stage determination step includes a correction stage including a correction movement necessary to correct the patient's posture in the activated mission stage. In claim 9,
An augmented reality game method for rehabilitation of a patient with a spinal disease, wherein the step of determining the active rehabilitation stage includes a step of adjusting the number of repetitions and the repetition cycle so that the patient repeatedly performs the correction stage while maintaining a posture that worsens the spinal disease. delete In claim 8,
An augmented reality game method for rehabilitation of a patient with spinal disease, wherein the step of determining the active rehabilitation stage includes a step of adjusting the difficulty of the mission stage, the number of items constituting the mission stage, and the size of the items based on the types of the rehabilitable body parts and the assistive exercise equipment determined according to the position of the patient. In claim 12,
The above rehabilitation configuration determination step, the active rehabilitation stage determination step and the mission clear reaction providing step are performed by at least one processor of the patient's mobile terminal,
An augmented reality game method for rehabilitation of patients with spinal diseases, characterized in that the location of the patient is detected by a location sensor mounted on the patient's mobile terminal.


delete

Images