WO2021141186A1 - Multi-type cognitive rehabilitation training system and method - Google Patents

Abstract

A multi-type cognitive rehabilitation training system and method are disclosed. A multi-type cognitive rehabilitation training system according to an embodiment of the present invention comprises a manager terminal for communicating with user terminals, which correspond to users participating in a group cognitive rehabilitation training, and controlling accesses of the users and execution of training content with respect to the user terminals, wherein the users participating in the group cognitive rehabilitation training can be managed by the manager terminal in an integrated manner.

Description

Multi-type cognitive rehabilitation training system and method

The present invention relates to a multi-type cognitive rehabilitation training system and method.

The computer-based cognitive training program is a software therapy tool that increases and improves cognitive functions by consistently and repeatedly training the cognitive areas that have been specially reduced due to cognitive impairment.

The reason for the low use of cognitive training programs using computer software is the lack of scientific and technical programs exclusively for cognitive concentration training based on literature.

In general, clinically used special education software, learning software, or game machine, which are easily available for treatment, selected some programs that can be applied to brain injury patients and customized to the patient.

Currently, a one-on-one customized training system is being developed, but in the case of a group-type training system, the development is insignificant.

The present invention is implemented in a multi-type capable of cognitive rehabilitation training for a plurality of trainees, so that a small number of occupational therapists (OTs) can efficiently control the group and perform simultaneous or individual training. Provide a multi-type cognitive rehabilitation training system and method it is to do

Objects other than the present invention will be easily understood through the following description.

According to one aspect of the present invention, as a multi-type cognitive rehabilitation training system for group cognitive rehabilitation training, it communicates with user terminals corresponding to users participating in group cognitive rehabilitation training, and the user's access to the user terminals And it includes a manager terminal for controlling the execution of the training content, there is provided a multi-type cognitive rehabilitation training system, characterized in that the integrated management for users participating in group cognitive rehabilitation training is performed by the manager terminal.

The manager terminal includes a multi-user management unit for integrated management of users participating in group cognitive rehabilitation training, wherein the multi-user management unit includes a group login management module for managing access to users participating in group cognitive rehabilitation training and ; It may include an automatic matching module for automatically matching the users and the user terminals to change the difficulty level and change the team for the training content.

The multi-user management unit may further include an auto-run module for maintaining the group training by conducting training on behalf of the evacuees when one or more of the users deviate midway.

The multi-user management unit may further include a monitoring module for monitoring at least one of the user terminal status of the users, training time information and biometric information, and user status information.

When the training content is 2D training content, the user terminal may include: a camera for photographing a user's face; an image analysis unit that analyzes the video of the face captured by the camera and measures a change in green luminance of the face surface; A biometric information monitoring unit for detecting a user's pulse and estimating a stress index based on the green luminance change may be included.

When the training content is 3D training content, the user terminal is a VR device that is a head-mounted display capable of playing the 3D training content, and the VR device includes: an eye tracker installed on the front to measure the user's eye movement; and an IR sensor that is installed on the earphone provided on the side and measures the user's pulse wave and oxygen saturation.

The user terminal may further include a bio-information monitoring unit for determining the user's stress index based on the pulse wave and the oxygen saturation level or for diagnosing Alzheimer's disease based on the eye movement.

The manager terminal may further include an access control unit for synchronizing a training time by correcting a time difference caused by an access network for users belonging to the same training group.

Allocating, by the access control unit, a default CPU occupancy rate to the user terminals; performing a test game to obtain a pre-correction response time corresponding to the user terminals; and repeatedly adjusting the CPU occupancy based on the pre-correction response time to correct the time difference of the post-correction response time within an error range, but when the pre-correction response time is relatively long, the CPU occupancy In case the response time before the correction is relatively short, the CPU occupancy may be lowered.

The user terminal may include a camera for photographing the user's face, and the user terminal may automatically log in to the multi-type cognitive rehabilitation training service by recognizing the user's face through the camera.

Meanwhile, according to another aspect of the present invention, as a multi-type cognitive rehabilitation training method performed in a multi-type cognitive rehabilitation training system for group cognitive rehabilitation training, user terminals are matched for users participating in group cognitive rehabilitation training, and group login is performed. managing; selecting group training content for the group cognitive rehabilitation training; controlling the user terminals to execute the group training content in the user terminals; There is provided a multi-type cognitive rehabilitation training method comprising the step of integrally monitoring the users during the execution of the group training content.

Other aspects, features and advantages other than those described above will become apparent from the following drawings, claims, and detailed description of the invention.

According to an embodiment of the present invention, cognitive rehabilitation training for a plurality of trainees is implemented as a multi-type, so that a small number of occupational therapists (OTs) can effectively control the group while performing simultaneous or individual training.

1 is a block diagram of a multi-type cognitive rehabilitation training system according to an embodiment of the present invention;

2 is a block diagram of a manager terminal included in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention;

3 is a flowchart of a multi-type cognitive rehabilitation training method according to an embodiment of the present invention;

4 is a flowchart of a method for synchronizing training time points of the same group of users in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention;

5 is a table showing before and after correction of CPU occupancy and response time;

6 to 12 are exemplary screens related to the group training user management program,

13 is a conceptual diagram of a VR device for using 3D group training content applied to a multi-type cognitive rehabilitation training system according to an embodiment of the present invention;

14 to 17 are diagrams illustrating a face recognition process executed in a user terminal;

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

When a component is referred to as being “connected” or “connected” to another component, it is understood that the other component may be directly connected or connected to the other component, but other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

The terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In this specification, terms such as "comprises" or "have" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

In addition, the components of the embodiment described with reference to each drawing are not limitedly applied only to the embodiment, and may be implemented to be included in other embodiments within the scope of maintaining the technical spirit of the present invention, and also Even if the description is omitted, it is natural that a plurality of embodiments may be re-implemented as a single integrated embodiment.

In addition, in the description with reference to the accompanying drawings, the same components regardless of the reference numerals are given the same or related reference numerals, and the overlapping description thereof will be omitted. In describing the present invention, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

In addition, terms such as “…unit”, “…unit”, “…module”, “…group”, etc. described in the specification mean a unit that processes at least one function or operation, which is hardware or software or hardware and software. It can be implemented by combining

1 is a configuration diagram of a multi-type cognitive rehabilitation training system according to an embodiment of the present invention, FIG. 2 is a configuration block diagram of a manager terminal included in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention, FIG. 6 12 to 12 are exemplary screens related to a group training user management program.

The multi-type cognitive rehabilitation training system 10 according to an embodiment of the present invention provides group training for users who require cognitive rehabilitation training (users, trainers, hereinafter collectively referred to as 'users') to lead cognitive function improvement It is characterized by being able to To this end, a plurality of user terminals are implemented so that they can be easily managed in one manager terminal operated by an occupational therapist (OT, manager, hereinafter collectively referred to as 'manager').

1, the multi-type cognitive rehabilitation training system 10 according to this embodiment includes a plurality of user terminals (200-1 to N, hereinafter may be collectively referred to as '200') and the manager terminal 100. can

The user terminal 200 is a terminal assigned to a user requiring cognitive rehabilitation training, and may be a computing device of a smartphone, tablet, PC, etc. in which cognitive rehabilitation training contents in the form of software or programs can be executed.

A camera 210 for monitoring the user's cognitive rehabilitation training situation may be connected to the user terminal 200 .

Alternatively, the user terminal 200 may be connected to a VR device 220 capable of executing 3D training content for realistic cognitive rehabilitation training. For example, the VR device 220 may be a head mounted display (HMD).

Through the user terminal 200, the user accesses (login) the service for cognitive rehabilitation training. In addition, when the training content selected by the manager's group management is executed in the user terminal 200 , it may be visually and/or aurally output through an output device provided in the user terminal 200 . For example, if the output device is a display device, a visual screen may be displayed, and if the output device is an audio device, an auditory sound may be output.

Some user terminals 200 - 1 and 200 - 2 are used by users located in a designated training space, and may be connected to the manager terminal 100 through an internal network.

Some users may want to participate in group training remotely in a situation where they cannot come to the designated training space. In this case, the user terminal 200-N used by the user may be connected to the manager terminal 100 through an external network. have.

The manager terminal 100 is a terminal operated by the manager, and may be one of a smartphone, a tablet, a PC, etc. equipped with a program (group training user management program) for managing users individually or in groups. have. Example screens related to the group training user management program are shown in FIGS. 6 to 12 .

Referring to FIG. 2 , the manager terminal 100 may include a multi-user management unit 110 and an access control unit 120 .

The multi-user management unit 110 individually and integrally manages a plurality of users to provide cognitive rehabilitation training for a plurality of users.

Most of the users who are subject to cognitive rehabilitation training are the elderly or brain-damaged patients who find it difficult to access (login) itself. Accordingly, the multi-user management unit 110 may include a group login management module 111 that enables the manager terminal 100 to control access to a user corresponding to each user terminal 200 .

In the group training user management program executed in the manager terminal 100 , user management, PC management, individual, and group screens may be implemented in a tab form.

In the user management screen, information about a user corresponding to a group training target can be registered, changed, or deleted. In addition, on the user management screen, the manager can control login or logout for a specific user. Based on the user information input through the user management screen, with respect to the plurality of user terminals 200, a user using each user terminal 200 may be matched and training may be performed.

On the PC management screen, a plurality of user terminals 200 managed by the manager terminal 100 are displayed (see FIGS. 6 and 7 ). In the drawing, ten user terminals are indicated by PC1 to PC10.

The connection status icon of the corresponding user terminal 200 is displayed at the upper left of the PC item 510 . For example, the connection status icon may be green when the connection is in progress, yellow when the connection is waiting, and red when the connection is unavailable.

In addition, a search interface for searching for a user registered through the user management screen may be provided on one side of the PC management screen.

With respect to the searched user, the assigned user terminal 200 may be matched. Referring to FIG. 7 , by matching the first user terminal PC1 allocated to the Hong Gil-dong user, information about the user matched with the PC item may be displayed. The user information displayed on the PC item may include one or more of name, gender, date of birth, and access time.

When matching the user and the user terminal, the user may be matched by dragging and dropping the icon for the user searched on the right side of the screen into the PC item corresponding to the user terminal (see User Kim Young-hee and PC2 item in FIG. 7 ). Through this, the manager can intuitively match the user and the user terminal.

On the personal screen, training contents executable by the user terminal selected from among the user terminals managed by the manager terminal 100 (eg, boat driving, chilgyo-nori, object search, fruit counting game, etc.) may be displayed (see FIG. 8 ). ). The manager terminal 100 may select and execute training content necessary for the user matched with the corresponding user terminal.

In addition, an execution screen of the training content currently being executed in the corresponding user terminal may be displayed. The display of the execution screen may be, for example, a pop-up window method.

Through this, the manager can check the training screen of the user through the manager terminal 100 for any user without going directly to the location where the user terminal 200 is located.

On the group screen, a room item 520 for a plurality of users to perform group training together is displayed (see FIGS. 9 and 10 ). In each room, group training content to be executed (eg, a game) and users participating in the corresponding group training may be displayed. When the room item 520 is selected, a room interface 521 capable of selecting content, selecting participants, and adjusting a team may be displayed.

When the user icon 530 is selected (eg, click, touch, etc.), the running game information and training monitoring information corresponding to the user may be checked. Through this, it is possible to monitor the progress of individual training for individual users during the group training process.

11 shows a case where one user for group training is registered, and FIG. 12 shows a case where a plurality of users for group training are registered. One user is matched for each PC item, and brief information about each user is displayed, so the manager can monitor the individual training progress in an integrated way.

Referring back to FIG. 2 , the multi-user management unit 110 may further include an automatic matching module 113 . In the past, managers had to go to each user's computer one by one to change the difficulty level and change the team. However, in this embodiment, the manager terminal 100 through the automatic matching module 113 can easily adjust the details of cognitive rehabilitation training such as difficulty change and team change for each user through individual screens or group screens. .

In addition, the multi-user management unit 110 may further include an auto-run module 115 . The auto-run module 115 enables automatic training progress even in a state where at least one of the users participating in the group training has no training-related action.

In the past, if even one person left the group during group training, the training itself was stopped. In the case of cognitive rehabilitation training, there are many cases where users leave their seats or lose interest and give up during training in a situation where most of them are elderly, and in this case, the group was broken and training of all group participants was dropped. In this embodiment, in order to prevent this, the auto-run module 115 automatically replaces the action of the mid-way runner with a predefined standard action so that the group for training is maintained even in a situation where more than one person departs midway, so that training through the training content is performed. can make it run smoothly.

In addition, the multi-user management unit 110 may further include a monitoring module 117 . The monitoring module 117 may check the power state of the corresponding terminal based on terminal information provided from each user terminal 200 . When the user terminal is a smartphone or tablet to which power is not supplied at all times, it is possible to check the power state in the manager terminal 100 (see FIG. 7 ), thereby preventing user departure due to a power problem in advance.

In addition, the monitoring module 117 may provide training time information such as usage time and accumulated training time for each user.

In addition, the monitoring module 117 is provided in the user terminal 200 or measured using a device linked to the user's biometric information and / or user status information based on the biometric information (stress index, Alzheimer's diagnosis, etc.) to the user terminal Received from 200, it can be stored and managed in response to each user.

In addition, the manager terminal 100 may further include an access control unit 120 in addition to the multi-user management unit 110 .

The access control unit 120 may synchronize training time points by correcting a time difference caused by an access network for user terminals belonging to the same training group.

For example, as shown in FIG. 1 , although the first user and the second user are connected through an internal network, when the N-th user is connected through an external network, the response time of the N-th user is relatively low due to network circumstances. can be long The access control unit 120 may compensate for this difference in response time so that group training can be performed smoothly regardless of the user's location. The time difference correction will be described in more detail later.

3 is a flowchart of a multi-type cognitive rehabilitation training method according to an embodiment of the present invention.

Each step of the multi-type cognitive rehabilitation training method according to this embodiment may be performed in each component of the multi-type cognitive rehabilitation training system 10 described above, in particular, the manager terminal 100 .

Referring to FIG. 3 , first, the manager terminal 100 matches multi-users for each user terminal 200 within the PC item managed by the manager terminal 100 (step S310 ). Multi-user means users participating in group training. The matching relationship between the multi-user and the user terminal may be displayed as a PC item as described above.

When the matching is completed, the manager terminal 100 selects content for group training (step S320). The group training content may include 2D training content or 3D training content. When the user terminal is equipped with a general display device, 2D training content can be selected, and when the user terminal is equipped with a VR device, 3D training content can be selected.

When the group training content is selected, the manager terminal 100 controls to execute the group training content for the user terminals belonging to the training group (step S330).

When the group training content is executed for each user terminal, the user terminal state, the training situation, etc. are monitored for each of the multi-users (step S340). The monitoring results may be converted into training results for each multi-user and stored in a database.

In a situation where group training is in progress, management may be performed individually for each of the multi-users participating in the group training (step S350). As shown in FIG. 8 , it is possible to check the currently running training content through the personal screen check. As shown in Fig. 9, by selecting a user icon, it is also possible to individually monitor the running game information and the training state.

4 is a flowchart of a training time synchronization method of the same group of users in a multi-type cognitive rehabilitation training system according to an embodiment of the present invention, and FIG. 5 is a table showing before and after correction of CPU occupancy and response time.

The access control unit 120 of the manager terminal 100 described above corrects the difference in training timing that may occur depending on the actual location so that effective group training can be performed for the same group users, so that all group members receive training at the same place. A similar situation can be provided.

For example, a home user (user N in FIG. 1 ) may access the manager terminal 100 through the Internet. Other users (User 1, User 2, and J in FIG. 1) may access the manager terminal 100 through their own network.

In this case, the home user may be given an ID assigned by the manager terminal 100 and participate in group training through the manager terminal 100 .

The manager terminal 100 divides the internal CPU to provide capacity to be used by home users (step S410). Default CPU share can be assigned to home users and internal users.

By correcting the time difference between users caused by the communication time difference, it is possible to make it appear to be used in real time. To this end, the time difference with other internal users can be corrected by identifying the signal input by the home user during group training and processing it first.

In addition, a test game may be provided for time synchronization between the home user and the internal user (step S420).

In the process of the test game, a response time before correction for each user is acquired (step S430).

If the response time is out of the specified error range, the CPU occupancy corresponding to the response time before correction is adjusted (step S440). When the response time is relatively long, the CPU occupancy can be increased, and when the response time is relatively short, the CPU occupancy can be decreased.

While repeatedly adjusting the CPU occupancy rate, the time difference may be corrected by making the response time difference for each user within the error range (step S450).

Referring to FIG. 5 , it is assumed that A is a home user accessing through an external remote network, B and C are internal users in a group training site, and they all belong to the same training group. The required error range in this example is 0.5 seconds.

Before adjustment, A's response time is 5 seconds, B's response time is 3.5 seconds, and C's response time is 2 seconds. In this case, there is a problem in that smooth group training is difficult because A and C have a time difference of 3 seconds.

Therefore, by adjusting the CPU occupancy, A's CPU occupancy can be raised to 50%, B's CPU occupancy can be changed to 35%, and C's occupancy can be changed to 15%. In this case, CPU occupancy can be adjusted similarly to the length of response time.

After adjusting the CPU occupancy, the response time becomes 2.8 seconds for A, 2.5 seconds for B, and 2.5 seconds for C, so the time difference of up to 0.3 seconds can be included within the error range.

Here, the time required for the calculation may be included in the loading time before the execution of the training content.

When using 2D training content during group training in the multi-type cognitive rehabilitation training system 10 according to the present embodiment, the camera 210 may be used for monitoring and analyzing biometric information for each user who is a group training participant.

The user terminal 200 may include a biometric information monitoring unit and an image analysis unit 202 connected to the camera 210 .

A user's face is photographed using the camera 210, and the image analysis unit 202 analyzes the captured video in real time.

After recognizing the user's face in the video, the image analysis unit 202 enlarges a part of the skin of the face surface. Since the face recognition method is obvious to those skilled in the art to which the present invention pertains, a detailed description thereof will be omitted.

When a skin color change is detected through an enlarged image analysis, the biometric information monitoring unit 204 may measure a heartbeat according to the skin color change and determine the user's stress index based on this.

Here, the skin color change may be a green luminance change of the face surface. Hemoglobin has the property of easily absorbing green light. The pulse can be detected by capturing the green luminance change.

The image analysis unit 202 calculates the average luminance of each color by dividing the image into RGB components for each frame in the video of the photographed face. Then, noise common to each color is removed and only the green luminance waveform is extracted.

Since the change in the luminance of green increases the amount of hemoglobin at the time of heartbeat, the absorption rate will increase, so the biometric information monitoring unit 204 may estimate the heart rate based on this.

In the case of the stress index, if the heart rate is out of the normal range of 60 to 90, it can be judged as stress. That is, when bradycardia of 60 or less or tachycardia of 90 or more continues for a certain period of time, it can be determined as a stress state.

When measuring heart rate, LED can be used in addition to image analysis using a camera. An LED light emitting unit and a phototransistor light receiving unit may be disposed at a portion touched by a user's finger. Hemoglobin contained in blood can detect a pulse from the LED reflected light irradiated to the finger by using the property of easily absorbing green wavelength light.

13 is a conceptual diagram of a VR device for using 3D group training contents applied to a multi-type cognitive rehabilitation training system according to an embodiment of the present invention.

In the case of the multi-type cognitive rehabilitation training system 10 according to the present embodiment, the VR device 220 for executing the 3D group training content may be provided in the user terminal 200 -N. Here, the VR device 220 is a head mounted display as shown in FIG. 13 , and the 3D group training content may be VR (Virtual Reality) or AR (Augmented Reality) based cognitive rehabilitation training content. have.

The VR device 220 may include a display on which 3D group training content is reproduced inside the front side. The user may perform 3D group training by wearing the VR device 220 and gazing at the inner display.

An eye tracker 222 for measuring the user's eye movement may be installed on the front of the VR device 220 .

In addition, the IR sensor 224 may be installed on the side of the VR device 220 . The IR sensor 224 is mounted on the user's ear, and can measure the user's pulse wave and oxygen saturation.

The biometric information monitoring unit 204 may determine the user's stress index based on the pulse wave and oxygen saturation measured by the IR sensor 224 or diagnose Alzheimer's based on the eye movement measured by the eye tracker 222 . .

The light irradiated from the IR sensor 224 may pass through the ear blood vessel, and the transmitted light may be detected by the receiver. Some of the light is absorbed by the tissues and the skin and blood filled arteries, increasing the absorbance. Absorbance is lower when the artery is empty.

Since the measurement at the IR sensor 224 is only a variable in the blood being ejected, fixation elements (ie, skin and tissue) may be excluded from the calculation. In the case of blood, both oxygenated and coral-depleted blood can be measured, so two wavelengths of light can be detected. Since the pulse oximeter (pulse oximeter) has a significantly higher IR absorption rate of oxygen-rich hemoglobin with respect to oxidized hemoglobin than that of low-oxygen hemoglobin, oxygen saturation can be judged by comparing the two values.

The eye tracker 222 measures the user's eye movement. After having the user gaze at the central gaze point, when the surrounding gaze point appears, the user can quickly move the gaze to the changed gaze point to examine the quick view. Alzheimer's patients can be classified as suspected of Alzheimer's if the delay time is increased during the rapid viewing process, and the delay time of the rapid viewing is accumulated and lengthened at the continuously presented gaze points based on this.

In addition, the reverse quick viewing test may be performed by instructing the user to move the eye in a direction opposite to the presented target. In this case, compared with normal people, Alzheimer's patients have lower accuracy in reverse fast viewing, and if errors persist because they do not correct well after making errors, they can be classified as suspected of Alzheimer's.

In this way, during group training using 3D training contents, biometric information for individual users can be monitored using the IR sensor 224, the eye tracker 222, and the like, and stress index measurement or Alzheimer's disease diagnosis can be performed.

In the present embodiment, recognition of a user connected using an arbitrary user terminal 200 may be performed through automatic face recognition. To this end, the user terminal 200 may be provided with a camera 210 as shown in FIG. 1 .

When user A sits in a designated seat, the camera 210 of the user terminal 200 disposed in the seat automatically recognizes and stores the face. In addition, when the manager inputs information such as a user's name, the face and personal information are matched and finally stored.

Thereafter, when user A sits at an arbitrary seat without a normal login, login may be performed through the automatic face recognition function. After logging in, you can participate in multi-training or view standard training data.

The face recognition performed by the image analyzer 202 may be implemented by applying the ResNet algorithm. The face recognition solution itself follows the ResNet algorithm, but if the user is a child in a growing stage and the face changes over time, the next step can be taken for a stable face recognition login.

Face recognition is first performed on user B (step S600).

The face of user B, who reconnected after a certain period of time, is photographed while recognizing and updated with the latest face information (step S710).

By updating and storing the face information with the latest information every time it is accessed, it is possible to minimize face recognition errors that occur due to face changes during growth. The update period of the face information may be set according to the age of the user, and when the user is in the growth stage, the update period may be set relatively short.

14 to 17 illustrate a face recognition process executed in a user terminal.

Referring to FIG. 14 , when a user wants to access an arbitrary user terminal, the user's face is recognized. For more accurate face recognition, simple personal information about the user may also be input. The personal information input together may include at least one of gender, name, and date of birth.

When a user's face is recognized for the first time, the manager inputs user personal information such as name, date of birth, and diagnosis name after face recognition is performed, so that the user can be additionally stored by matching the recognized face information (refer to FIGS. 15 and 16 ) ).

17 illustrates a main login screen after a user is added. There are individual tabs and group tabs on the main login screen, allowing you to select individual cognitive rehabilitation training or group cognitive rehabilitation training to perform training.

The above-described multi-type cognitive rehabilitation training method may be implemented in the form of a recording medium including instructions executable by a computer, such as an application or program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer-readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above-described multi-type cognitive rehabilitation training method may be executed by an application basically installed in the terminal (which may include a program included in a platform or operating system basically mounted on the terminal), and the user may use an application store server, an application or It may be executed by an application (ie, a program) installed directly on the master terminal through an application providing server such as a web server related to the corresponding service. In this sense, the aforementioned multi-type cognitive rehabilitation training method may be implemented as an application (ie, program) installed by default in the terminal or directly installed by the user and recorded in a computer-readable recording medium such as a terminal.

Although described above with reference to the embodiments of the present invention, those skilled in the art can variously modify the present invention within the scope without departing from the spirit and scope of the present invention described in the claims below. and may be changed.

Claims (11)

As a multi-type cognitive rehabilitation training system for group cognitive rehabilitation training, A manager terminal that communicates with user terminals corresponding to users participating in group cognitive rehabilitation training, and controls access of the users to the user terminals and execution of training content, Multi-type cognitive rehabilitation training system, characterized in that the integrated management for users participating in the group cognitive rehabilitation training by the manager terminal is performed. According to claim 1, The manager terminal includes a multi-user management unit for integrated management of users participating in group cognitive rehabilitation training, The multi-user management unit, a group login management module for managing access to users participating in group cognitive rehabilitation training; Multi-type cognitive rehabilitation training system, characterized in that it includes an automatic matching module for automatically matching the users and the user terminals to change the difficulty and change the team for the training content. 3. The method of claim 2, The multi-user management unit multi-type cognitive rehabilitation training system, characterized in that, when one or more of the users deviate midway, the auto-run module further comprises an auto-run module for maintaining the group training by conducting training on behalf of the defectors. 3. The method of claim 2, The multi-user management unit multi-type cognitive rehabilitation training system, characterized in that it further comprises a monitoring module for monitoring at least one of the user terminal status, training time information and biometric information of the users, and user status information. 5. The method of claim 4, When the training content is 2D training content, The user terminal is a camera for photographing a user's face; an image analysis unit that analyzes the video of the face captured by the camera and measures a change in green luminance of the face surface; Multi-type cognitive rehabilitation training system, characterized in that it comprises a biometric information monitoring unit for detecting the user's pulse and estimating the stress index based on the green luminance change. 5. The method of claim 4, When the training content is 3D training content, The user terminal is a VR device that is a head mounted display capable of playing the 3D training content, The VR device includes: an eye tracker installed on the front side to measure the user's eye movement; And installed on the earphone provided on the side, multi-type cognitive rehabilitation training system, characterized in that it comprises at least one of the IR sensor for measuring the user's pulse wave and oxygen saturation. 7. The method of claim 6, The user terminal, multi-type cognitive rehabilitation training system, characterized in that it further comprises a bio-information monitoring unit to determine the stress index of the user based on the pulse wave and the oxygen saturation or diagnose Alzheimer's based on the eye movement. According to claim 1, The manager terminal, multi-type cognitive rehabilitation training system, characterized in that it further comprises an access control unit for synchronizing the training time by correcting the time difference caused by the access network for users belonging to the same training group. 9. The method of claim 8, The connection control unit, allocating a default CPU occupancy rate to the user terminals; performing a test game to obtain a pre-correction response time corresponding to the user terminals; and Performing the step of repeatedly adjusting the CPU occupancy based on the response time before the correction so that the time difference of the response time after the correction is within an error range, When the response time before correction is relatively long, the CPU occupancy is raised, and when the response time before correction is relatively short, the multi-type cognitive rehabilitation training system, characterized in that it is adjusted in such a way as to lower the CPU occupancy. According to claim 1, The user terminal includes a camera for photographing the user's face, Multi-type cognitive rehabilitation training system, characterized in that the user terminal automatically logs in to the multi-type cognitive rehabilitation training service by recognizing the face of the user through the camera. As a multi-type cognitive rehabilitation training method performed in a multi-type cognitive rehabilitation training system for group cognitive rehabilitation training, Matching user terminals for users participating in group cognitive rehabilitation training, and managing group login; selecting group training content for the group cognitive rehabilitation training; controlling the user terminals to execute the group training content in the user terminals; Multi-type cognitive rehabilitation training method comprising the step of integrally monitoring the users during the execution of the group training content.

Images