[go: up one dir, main page]

WO2025236473A1 - Rehabilitation training method and apparatus for unilateral spatial neglect, device, and storage medium - Google Patents

Rehabilitation training method and apparatus for unilateral spatial neglect, device, and storage medium

Info

Publication number
WO2025236473A1
WO2025236473A1 PCT/CN2024/116246 CN2024116246W WO2025236473A1 WO 2025236473 A1 WO2025236473 A1 WO 2025236473A1 CN 2024116246 W CN2024116246 W CN 2024116246W WO 2025236473 A1 WO2025236473 A1 WO 2025236473A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
unilateral
neglect
attention
steady
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/116246
Other languages
French (fr)
Chinese (zh)
Inventor
胡楠
黄凤珊
欧秀君
陈艳
叶明福
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Second Affiliated Hospital of Guangzhou Medical University
Original Assignee
Second Affiliated Hospital of Guangzhou Medical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Second Affiliated Hospital of Guangzhou Medical University filed Critical Second Affiliated Hospital of Guangzhou Medical University
Publication of WO2025236473A1 publication Critical patent/WO2025236473A1/en
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00Electrotherapy; Circuits therefor
    • A61N1/18Applying electric currents by contact electrodes
    • A61N1/32Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/36014External stimulators, e.g. with patch electrodes
    • A61N1/36025External stimulators, e.g. with patch electrodes for treating a mental or cerebral condition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/168Evaluating attention deficit, hyperactivity
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/377Electroencephalography [EEG] using evoked responses
    • A61B5/378Visual stimuli
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/384Recording apparatus or displays specially adapted therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00Electrotherapy; Circuits therefor
    • A61N1/02Details
    • A61N1/04Electrodes
    • A61N1/0404Electrodes for external use
    • A61N1/0408Use-related aspects
    • A61N1/0456Specially adapted for transcutaneous electrical nerve stimulation [TENS]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61NELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N1/00Electrotherapy; Circuits therefor
    • A61N1/18Applying electric currents by contact electrodes
    • A61N1/32Applying electric currents by contact electrodes alternating or intermittent currents
    • A61N1/36Applying electric currents by contact electrodes alternating or intermittent currents for stimulation
    • A61N1/36014External stimulators, e.g. with patch electrodes
    • A61N1/3603Control systems

Definitions

  • This invention belongs to the field of brain-computer interface technology, specifically relating to a method, device, equipment, and storage medium for unilateral spatial neglect rehabilitation training based on brain-computer interface.
  • Unilateral spatial neglect is a common functional impairment following stroke, often manifesting as an inability to pay attention to stimuli on the side opposite the lesion, resulting in visual, auditory, and tactile neglect.
  • the patient's vision, eye movements, and visual field are normal, but due to attention deficit, the patient often "ignores" objects on the side opposite the damaged brain region.
  • USN is essentially a complex cognitive impairment that not only affects spatial attention but also significantly impacts rehabilitation adherence and the recovery of other functions such as cognition and motor function.
  • unilateral neglect has been listed as an independent risk factor for predicting stroke prognosis.
  • Brain-computer interface (BCI) technology is a human-computer interaction technology that establishes a direct communication and control channel between the brain and a computer or other electronic devices. It can enhance the interaction between patients with motor dysfunction and the outside world, and its research and application in the fields of neuroengineering, rehabilitation, and brain science are becoming increasingly widespread.
  • BCI is divided into invasive and non-invasive types. Among them, the non-invasive BCI system based on steady-state visual evoked potentials (SSVEP) and motor imagery is currently the most widely researched and applied.
  • SSVEP steady-state visual evoked potentials
  • SSVEP-based BCI systems typically determine the focus target by obtaining frequency information from EEG signals induced by periodic visual stimuli.
  • Motor imagery refers to the activation of specific brain regions even when a person imagines their limbs or muscles moving without actual physical movement.
  • Motor imagery-based BCI systems can read the user's subjective motor awareness and determine their motor intentions by identifying specific EEG changes induced by different tasks, thus achieving peripheral control at the central level.
  • the purpose of this invention is to provide a method, device, equipment, and storage medium for rehabilitation training of unilateral spatial neglect, which can ensure the effectiveness of training, improve training results, and facilitate promotion for patients with unilateral spatial neglect.
  • the first aspect of this invention discloses a unilateral spatial neglect rehabilitation training method, comprising:
  • At least two target pattern symbols on the display are controlled to move within the space that is ignored by the user's visual perception on one side, with a specific movement direction and a specific movement speed; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbol is any pattern symbol among a plurality of pattern symbols;
  • a transcutaneous electrical nerve stimulation signal is emitted from an electrical stimulator placed on the user's neck, with the stimulator located on the side that the user is ignoring.
  • the method before controlling at least two target pattern symbols on the display to move within a spatial range that is ignored by the user's unilateral visual perception in a specific direction and at a specific speed, the method further includes:
  • the critical line for unilateral visual neglect by the user is determined based on the maximum displacement, and the spatial range for unilateral visual neglect by the user is determined based on the critical line.
  • the method before controlling at least two target pattern symbols on the display to move within a spatial range that is ignored by the user's unilateral visual perception in a specific direction and at a specific speed, the method further includes:
  • a specific movement speed is determined based on the average eye movement speed.
  • determining whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal includes:
  • the first steady-state visual evoked potential signal is decoded and classified to obtain a first classification label
  • the user's classification accuracy is obtained by comparing the first category label with the preset label
  • determining whether a user has focused their attention to complete a training task based on the second steady-state visual evoked potential signal includes:
  • the second steady-state visual evoked potential signal is decoded and classified to obtain a second classification label
  • the second category label is the same as the prompt label corresponding to the target pattern symbol, it is determined that the user has focused their attention to complete the training task.
  • a second aspect of the present invention discloses a unilateral spatial neglect rehabilitation training device, comprising:
  • the test unit is used to control multiple pattern symbols to flash randomly at different flashing frequencies at multiple positions on the display.
  • the first acquisition unit is used to acquire the first steady-state visual evoked potential signal of the user's gaze at the display;
  • the first judgment unit is used to determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal.
  • the training unit is used to control at least two target pattern symbols on the display to move within a space that is visually ignored on one side of the user's side, with a specific movement direction and a specific movement speed, when it is determined that the user's attention is sufficiently focused; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbols are any pattern symbols from a plurality of pattern symbols;
  • the second acquisition unit is used to acquire the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol;
  • the second judgment unit is used to determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal.
  • An electrical stimulation unit is used to control an electrical stimulator placed on the user's neck to emit transcutaneous electrical stimulation signals when the user is determined to be concentrating on completing a training task.
  • the electrical stimulator is located on the side that the user ignores.
  • the apparatus further includes:
  • the first acquisition unit is used to acquire the maximum displacement of the user's eyeball during the process of reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move within a space that is ignored by the user's unilateral visual perception, in a specific moving direction and at a specific moving speed.
  • the range determination unit is used to determine the critical line for unilateral visual neglect by the user based on the maximum displacement, and to determine the spatial range for unilateral visual neglect by the user based on the critical line.
  • the apparatus further includes:
  • the second acquisition unit is used to acquire the average eye movement speed of the user's eyeballs during the process of reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move within a space that is ignored by the user's unilateral vision in a specific moving direction and at a specific moving speed.
  • a velocity determination unit is used to determine a specific movement speed based on the average eye movement speed.
  • a third aspect of the present invention discloses an electronic device, including a memory storing executable program code and a processor coupled to the memory; the processor calls the executable program code stored in the memory to execute the unilateral spatial neglect rehabilitation training method disclosed in the first aspect.
  • the fourth aspect of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to perform the unilateral spatial neglect rehabilitation training method disclosed in the first aspect.
  • a first steady-state visual evoked potential signal is acquired when the user gazes at the display, determining whether the user's attention is sufficiently focused; when the user's attention is sufficiently focused, at least two target pattern symbols on the display are controlled to move within the user's unilateral visual neglected space range in a specific direction and at a specific speed; wherein, the specific movement direction is from the healthy side to the neglected side, and the target pattern symbols are any pattern symbols from multiple pattern symbols; then, a second steady-state visual evoked potential signal is acquired when the user gazes at the target pattern symbols, determining whether the user has concentrated their attention to complete the training task; when the user has concentrated their attention to complete the training task, a transcutaneous electrical nerve stimulation signal is emitted from an electrical stimulator placed on the user's neck, wherein the electrical stimulator is located on the neglected side of the user, thereby determining whether the subject's attention is sufficiently focused before training, and immediately issuing
  • Figure 1 is a flowchart of a unilateral spatial neglect rehabilitation training method disclosed in an embodiment of the present invention
  • Figure 2 is an architectural diagram of a unilateral spatial neglect rehabilitation training system disclosed in an embodiment of the present invention
  • Figure 3 is a schematic diagram of a unilateral spatial neglect rehabilitation training device disclosed in an embodiment of the present invention.
  • Figure 4 is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present invention.
  • Test unit 302. First acquisition unit; 303. First judgment unit; 304. Training unit; 305. Second acquisition unit; 306. Second judgment unit; 307. Electrical stimulation unit; 401. Memory; 402. Processor.
  • a component when a component is considered “fixed” to another component, it can be directly fixed to the other component or there can be an intervening component; when a component is considered “connected” to another component, it can be directly connected to the other component or there can be an intervening component; when a component is considered “mounted” on another component, it can be directly mounted on the other component or there can be an intervening component; when a component is considered “placed” on another component, it can be directly placed on the other component or there can be an intervening component.
  • This invention discloses a unilateral spatial neglect rehabilitation training method, which can be implemented through computer programming.
  • the execution subject of this method can be an electronic device such as a computer, laptop, or tablet, or a unilateral spatial neglect rehabilitation training device embedded in an electronic device; this invention does not limit this.
  • the method includes the following steps 110-150:
  • a unilateral spatial neglect rehabilitation training system is provided, as shown in Figure 2.
  • the training system includes a computer, an electroencephalogram (EEG) device, an LED display screen, and a transcutaneous electrical nerve stimulator (TENS).
  • the computer is communicatively connected to the EEG device, the LED display screen, and the TNS.
  • the EEG device is designed as a cap to be worn on the user's head.
  • the LED display screen is positioned within the user's field of vision and outputs optomotor stimulation signals.
  • the TNS includes electrodes positioned on the user's neck near the trapezius muscle on the side of the user's visual neglect and outputs electrical stimulation signals.
  • the computer has an embedded program for executing the unilateral spatial neglect rehabilitation training method provided by this invention.
  • determining whether the user's attention is sufficiently focused may include the following steps S11 ⁇ S13 (not shown):
  • the process involves decoding and classifying the first SSVEP signal, comparing the resulting first classification label with a preset label to determine the user's classification accuracy in assessing attentional concentration.
  • a classification accuracy of 80% or higher is considered sufficient to indicate adequate user concentration for further training.
  • a classification accuracy less than 80% indicates insufficient user concentration, precluding further training and ending the process.
  • the specific SSVEP signal decoding method is as follows:
  • a filter bank canonical correlation analysis (FBCCA) decoding method is employed, including filter bank analysis, canonical correlation analysis (CCA) processing, and target recognition.
  • the SSVEP signal is decomposed into N sub-band components using different bandpass filters.
  • different sub-band components correspond to harmonics of different flicker frequencies of the SSVEP signal, and the number of sub-band components is the harmonic number of the SSVEP signal.
  • the sine and cosine reference signals for each sub-band component are calculated.
  • the number of sampling points sampling frequency ⁇ sampling time.
  • the sampling frequency is typically 1000 Hz, and the sampling time is set independently based on the experiment.
  • Each sub-band component ...
  • the correlation vector consists of several correlation coefficients. for:
  • EEG signal characteristics of SSVEP signals It is a vector with one row and k columns, where k is the index of the target. EEG signal features are extracted.
  • an artificial neural network model from machine learning was used to perform binary classification of SSVEP EEG signal features, that is, to classify the EEG signal features...
  • Input a pre-trained artificial neural network model, and obtain classification labels (vectors) based on the model's prediction results.
  • the maximum value corresponding to The value is the classification label obtained from the classification, and the flashing frequency corresponding to this classification label is the frequency of the target stimulus.
  • control at least two target pattern symbols on the display to move within a space that is ignored by the user's single-sided vision, with a specific movement direction and a specific movement speed.
  • the specific movement direction is from the healthy side to the ignored side, that is, from the side that is not ignored by the user to the side that is ignored by the user;
  • the target pattern symbol is any pattern symbol among multiple pattern symbols.
  • the method Before performing step 130, the method also includes the following steps S21-S23 (not shown):
  • a video electronystagmography (EEG) device can be used to measure the speed and maximum displacement of the user's eyes while reading sample text. Measuring the maximum displacement is to determine the threshold at which the user's vision is ignored. When measuring the maximum displacement of the user's eyes, the average eye movement speed from the start of movement to reaching the threshold is calculated based on the user's eye movement speed while reading the sample text.
  • EEG video electronystagmography
  • the user's preset neglected side can be obtained. For example, if the user's clinical symptoms indicate left-sided visual-spatial neglect, the user's preset neglected side can be determined as the left and the healthy side as the right, based on human-computer interaction.
  • a single line of moving example text is moved from the right healthy side towards the neglected side.
  • the user sits facing the monitor, keeping their line of sight at the same level as the screen.
  • a video electronystagmography (VEOG) device is used to measure the user's eye movement speed and displacement as they read a single line of moving example text on the computer screen to determine the user's visual neglect threshold.
  • the vertical line on the monitor that represents the maximum displacement and is perpendicular to the movement path of the single line of moving example text is the threshold line.
  • the critical line divides the display vertically into two parts, and the part closer to the user's preset neglected side is defined as the spatial range that the user visually ignores on one side. For example, if the user's preset neglected side is the left side, and the critical line divides the display vertically into left and right parts, then the left part of the display is defined as the spatial range that the user visually ignores on one side.
  • the measured average eye movement speed can be directly used as the specific movement speed of the visual stimulus symbol in subsequent brain-computer interface training, or the average eye movement speed can be calculated according to a certain proportion to obtain the specific movement speed, for example, 80%, 90% or 110% of the average eye movement speed can be taken as the specific movement speed.
  • step 130 the method of controlling at least two target pattern symbols on the display to move within the space neglected by the user's unilateral vision in a specific direction and at a specific speed is as follows: controlling at least two target pattern symbols on the display to move at a uniform speed from the healthy side to the neglected side within the space. For example, moving at an eye movement speed of 30-120°/s.
  • the design of the stimulus interface is completed using MATLAB software programming.
  • the display simultaneously shows two pattern symbols with a diameter of 5cm, arranged vertically at the boundary line of the user's visual neglect.
  • One pattern symbol is fixed, while the other pattern symbol moves at a constant speed from the healthy side to the neglected side. After moving to the boundary of the display, it starts to cycle continuously from the origin.
  • the speed and range of the pattern symbol movement are set according to the user's average eye movement speed and the neglected spatial range.
  • the vertical arrangement order of the two pattern symbols appears randomly.
  • the specific implementation method for determining whether a user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal is as follows: the second steady-state visual evoked potential signal is decoded and classified to obtain a second classification label; when the second classification label is the same as the prompt label corresponding to the target pattern symbol, it is determined that the user has focused their attention to complete the training task.
  • the method for decoding and classifying the second steady-state visual evoked potential signal is described above for the method for decoding and classifying the first steady-state visual evoked potential signal, and will not be repeated here.
  • the electrical stimulator placed on the user's neck is controlled to emit a transcutaneous electrical stimulation signal, wherein the electrical stimulator is located on the side that the user ignores.
  • the user is ensured to be awake, able to receive test questions at an auditory or visual level, and in a relaxed state with their eyes looking straight ahead at the display.
  • the patient is instructed to follow the movement of a bright spot with their eyes while keeping their head still.
  • a relatively quiet testing environment is selected to begin the test task.
  • the audio version of the test instructions is played, and simultaneously, the user interface "Please look at the moving pattern symbol" is displayed on the display.
  • a 2-second wait is set, and then the display shows a fixed and moving pattern symbol interface for 5 seconds. The user is instructed to look at the pattern symbol to fully experience the target motion stimulus.
  • the user's EEG signals during the test are recorded using an EEG recording device and transmitted in real time to the computer.
  • the stimulation device determines the target pattern symbol selected by the user using relevant algorithms and then provides transcutaneous electrical nerve stimulation (TENS) on the neglected side of the neck to provide somatosensory feedback to the subject.
  • TENS transcutaneous electrical nerve stimulation
  • the Neuroscan Synamps2 EEG recording system is used for EEG signal acquisition and recording. The placement of its 64-electrode caps conforms to the improved international 10-20 standard. A 1920 ⁇ 1080 resolution display with a 60 Hz refresh rate is used to present the stimulation interface.
  • audio and video recording equipment is used, and the recording devices are kept on throughout the test to save the entire audio or video file, as well as the recorded EEG signals.
  • the user interactive stimulation interface is coded using the Psychtoolbox software under MATLAB.
  • the network environment is set up by establishing a local area network connection between the stimulation end computer and the acquisition end device.
  • the TCP/IP protocol is set up to realize the real-time transmission of EEG data from the acquisition end to the stimulation end device.
  • electrode caps are fitted to the user and connected to the amplifier section of the EEG recorder. Conductive paste is applied to the corresponding electrode positions to reduce the impedance to below 10k ⁇ and maintain stability.
  • the test stimulation interface is then displayed to establish the data transmission environment. Simultaneously, the data acquisition unit begins recording the user's EEG data during the test task.
  • the sampling rate is set to 1000 Hz, and a 50 Hz notch filter is used to remove power frequency interference.
  • the computer identifies the attention success signal based on the EEG signal and issues an instruction to the TENS device to control the electrical stimulator to emit a transcutaneous electrical nerve stimulation signal.
  • the frequency of the transcutaneous electrical nerve stimulation signal is set to 100Hz
  • the pulse duration is set to 100us
  • the average intensity is set to 0.5uA/mm.
  • voice prompts or manual guidance can be provided. Finally, the number of times the user has completed the attention tracking task and the user's personal information are displayed on the interface to complete the test.
  • the visuomotor training method is transformed based on SSVEP-BCI, requiring only user gaze to complete. This allows the user to perceive neglected visuospatial spaces through training their visual tracking function, and simultaneously perceive neglected limb sensations through somatosensory stimulation provided by TENS. Providing stimulation simultaneously at both the central and peripheral levels forms a closed loop for neurorehabilitation, ensuring the effectiveness of the training.
  • This invention ensures the effectiveness of attention by decoding user attention based on SSVEP and motor imagery-BCI.
  • it uses the BCI system to connect visual-motor stimulation technology and TENS stimulation to form a closed-loop training mode, integrating active and passive attention.
  • the closed-loop BCI can train both channels simultaneously, improving the training effect.
  • this embodiment of the invention discloses a unilateral spatial neglect rehabilitation training device, including a testing unit 301, a first acquisition unit 302, a first judgment unit 303, a training unit 304, a second acquisition unit 305, a second judgment unit 306, and an electrical stimulation unit 307, wherein...
  • Test unit 301 is used to control multiple pattern symbols to flash randomly at multiple positions on the display at different flashing frequencies
  • the first acquisition unit 302 is used to acquire the first steady-state visual evoked potential signal of the user looking at the display.
  • the first judgment unit 303 is used to determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal.
  • Training unit 304 is used to control at least two target pattern symbols on the display to move within the space ignored by the user's visual attention on one side, with a specific movement direction and a specific movement speed, when the first judgment unit 303 determines that the user's attention is sufficiently focused; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbol is any pattern symbol among a plurality of pattern symbols;
  • the second acquisition unit 305 is used to acquire the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol;
  • the second judgment unit 306 is used to determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal.
  • the electrical stimulation unit 307 is used to control the electrical stimulator placed on the user's neck to emit a transcutaneous nerve electrical stimulation signal when the second judgment unit 306 determines that the user is concentrating on completing the training task, wherein the electrical stimulator is located on the side that the user ignores.
  • the training device also includes the following units (not shown):
  • the first acquisition unit is used to acquire the maximum displacement of the user's eyeball during the process of reading a single line of moving example text on the display before the training unit 304 controls at least two target pattern symbols on the display to move in a specific direction and at a specific speed within a space ignored by the user's unilateral vision.
  • the range determination unit is used to determine the critical line for unilateral visual neglect by the user based on the maximum displacement, and to determine the spatial range for unilateral visual neglect by the user based on the critical line.
  • the training device also includes the following units (not shown):
  • the second acquisition unit is used to acquire the average eye movement speed of the user's eyeballs during the process of reading a single line of moving example text on the display before the training unit 304 controls at least two target pattern symbols on the display to move in a specific direction and at a specific speed within a space that is ignored by the user's unilateral vision.
  • a velocity determination unit is used to determine a specific movement speed based on the average eye movement speed.
  • the first determination unit 303 includes the following sub-units (not shown):
  • the first decoding subunit is used to decode and classify the first steady-state visual evoked potential signal to obtain a first classification label
  • the comparison subunit is used to compare the first classification label with the preset label to obtain the user's classification accuracy.
  • the first decision subunit is used to determine whether the user's attention is sufficiently focused when the classification accuracy reaches a specified percentage.
  • the second break unit 306 includes the following sub-units (not shown):
  • the second decoding subunit is used to decode and classify the second steady-state visual evoked potential signal to obtain a second classification label
  • the second judgment subunit determines that the user has focused their attention to complete the training task when the second classification label is the same as the prompt label corresponding to the target pattern symbol.
  • an embodiment of the present invention discloses an electronic device, including a memory 401 storing executable program code and a processor 402 coupled to the memory 401.
  • the processor 402 calls the executable program code stored in the memory 401 to execute the unilateral spatial neglect rehabilitation training method described in the above embodiments.
  • This invention also discloses a computer-readable storage medium storing a computer program that causes a computer to execute the unilateral spatial neglect rehabilitation training method described in the above embodiments.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Psychiatry (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Psychology (AREA)
  • Artificial Intelligence (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Developmental Disabilities (AREA)
  • Social Psychology (AREA)
  • Hospice & Palliative Care (AREA)
  • Child & Adolescent Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Ophthalmology & Optometry (AREA)
  • Physiology (AREA)
  • Educational Technology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Fuzzy Systems (AREA)
  • Evolutionary Computation (AREA)
  • Neurology (AREA)
  • Rehabilitation Tools (AREA)

Abstract

A rehabilitation training method and apparatus for unilateral spatial neglect, a device, and a storage medium. The method comprises: controlling multiple graphic symbols to flicker randomly at different flickering frequencies; collecting a first SSVEP signal when a user gazes; when it is determined that the user's attention is sufficiently focused, control at least two target graphic symbols to move in a specific movement direction and at a specific movement speed within the user's unilateral visual neglect space range; then acquiring a second SSVEP signal when the user gazes; and when it is determined that the user is focusing attention on completing a training task, control an electrical stimulator placed on the user's neck to send a transcutaneous electrical nerve stimulation signal. Thus, whether a subject's attention is sufficiently focused can be determined before training, and when it is determined that the subject is effectively gazing at the training content, an instruction is issued to provide an electrical stimulation signal, thereby forming a closed loop; the effectiveness of training can be ensured, the training effect can be improved, and popularization in patients with unilateral spatial neglect is facilitated.

Description

单侧空间忽略康复训练方法及装置、设备、存储介质Unilateral spatial neglect rehabilitation training methods, devices, equipment, and storage media 技术领域Technical Field

本发明属于脑机接口技术领域,具体涉及一种基于脑机接口的单侧空间忽略康复训练方法及装置、设备、存储介质。This invention belongs to the field of brain-computer interface technology, specifically relating to a method, device, equipment, and storage medium for unilateral spatial neglect rehabilitation training based on brain-computer interface.

背景技术Background Technology

单侧空间忽略(Unilateral Space Neglect, USN)是脑卒中后常见的功能障碍,患者常表现为无法注意病灶对侧的刺激,出现视觉、听觉、触觉忽略等问题。临床上约28.6%的脑卒中患者会出现不同程度的单侧空间忽略症状,其中最常见的是右侧优势半球损伤后出现的左侧视觉忽略。通常表现为患者的视觉、眼球运动及视野均正常,但由于注意力障碍,患者常常对损伤脑区对侧的事物“视而不见”。USN本质上是一种复杂的认知功能障碍,其不仅影响患者的空间注意力,更严重影响患者的康复的依从性及认知、运动等其他功能的恢复,目前单侧忽略已被列为预测脑卒中预后的独立危险因素之一。Unilateral spatial neglect (USN) is a common functional impairment following stroke, often manifesting as an inability to pay attention to stimuli on the side opposite the lesion, resulting in visual, auditory, and tactile neglect. Clinically, approximately 28.6% of stroke patients experience varying degrees of unilateral spatial neglect, with the most common being left-sided visual neglect following damage to the right dominant hemisphere. Typically, the patient's vision, eye movements, and visual field are normal, but due to attention deficit, the patient often "ignores" objects on the side opposite the damaged brain region. USN is essentially a complex cognitive impairment that not only affects spatial attention but also significantly impacts rehabilitation adherence and the recovery of other functions such as cognition and motor function. Currently, unilateral neglect has been listed as an independent risk factor for predicting stroke prognosis.

脑机接口(Brain-computer Interface,BCI)技术是一种能在大脑与计算机或其它电子设备间建立直接通讯和控制通道的人机交互技术,可以增强运动功能障碍患者与外界的交互作用,在神经工程、康复和脑科学领域研究及应用越来越广泛。根据获取脑电信号方式的差异,BCI分为有创和无创,其中,基于稳态视觉诱发电位(Steady-State Visual Evoked Potentials,SSVEP)和运动想象是目前研究和应用最广泛的无创BCI系统。Brain-computer interface (BCI) technology is a human-computer interaction technology that establishes a direct communication and control channel between the brain and a computer or other electronic devices. It can enhance the interaction between patients with motor dysfunction and the outside world, and its research and application in the fields of neuroengineering, rehabilitation, and brain science are becoming increasingly widespread. Based on the different methods of acquiring EEG signals, BCI is divided into invasive and non-invasive types. Among them, the non-invasive BCI system based on steady-state visual evoked potentials (SSVEP) and motor imagery is currently the most widely researched and applied.

基于SSVEP的BCI系统通常通过从周期性视觉刺激诱导的脑电图信号中获得的频率信息来确定聚焦目标。而运动想象是指人在想象自己肢体或肌肉运动但没有实际运动输出时,人的特定脑区仍会有激活。基于运动想象的BCI系统,可读取使用者主观运动意识,通过识别不同任务诱发的具有特异性的脑电变化从而判断使用者的运动意图,从中枢层面实现对外周的控制。SSVEP-based BCI systems typically determine the focus target by obtaining frequency information from EEG signals induced by periodic visual stimuli. Motor imagery, on the other hand, refers to the activation of specific brain regions even when a person imagines their limbs or muscles moving without actual physical movement. Motor imagery-based BCI systems can read the user's subjective motor awareness and determine their motor intentions by identifying specific EEG changes induced by different tasks, thus achieving peripheral control at the central level.

现有应用于USN康复训练的BCI系统,多为单纯基于运动想象的BCI系统,即通过捕捉被试者是否成功想象设定内容,来执行预设程序给予反馈。对于被试注意力和理解力的要求非常高,训练效果不佳,且无法针对于单侧空间忽略患者进行推广。Existing BCI systems used in USN rehabilitation training are mostly based solely on motor imagery. This means they execute a pre-set procedure and provide feedback based on whether the subject successfully imagines the set content. This places very high demands on the subject's attention and comprehension, resulting in poor training effectiveness and making it unsuitable for widespread application to patients with unilateral spatial neglect.

发明内容Summary of the Invention

本发明的目的在于提供一种单侧空间忽略康复训练方法及装置、设备、存储介质,可以保证训练的有效性,提高训练效果,方便针对于单侧空间忽略患者进行推广。The purpose of this invention is to provide a method, device, equipment, and storage medium for rehabilitation training of unilateral spatial neglect, which can ensure the effectiveness of training, improve training results, and facilitate promotion for patients with unilateral spatial neglect.

本发明第一方面公开一种单侧空间忽略康复训练方法,包括:The first aspect of this invention discloses a unilateral spatial neglect rehabilitation training method, comprising:

控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁;Control multiple patterns and symbols to flash randomly at different flashing frequencies at multiple positions on the display;

采集用户注视显示器的第一稳态视觉诱发电位信号,根据所述第一稳态视觉诱发电位信号判断用户的注意力是否足够集中;Collect the first steady-state visual evoked potential signal of the user looking at the display, and determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal;

当判定用户的注意力足够集中时,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动;其中,特定移动方向为由健康侧向忽略侧移动,所述目标图案符号为多个图案符号中任意图案符号;When it is determined that the user's attention is sufficiently focused, at least two target pattern symbols on the display are controlled to move within the space that is ignored by the user's visual perception on one side, with a specific movement direction and a specific movement speed; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbol is any pattern symbol among a plurality of pattern symbols;

获取用户注视目标图案符号时的第二稳态视觉诱发电位信号,根据所述第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务;Acquire the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol, and determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal;

当判定用户集中注意力完成训练任务时,控制置于用户颈部的电刺激器发出经皮神经电刺激信号,其中,电刺激器位于用户忽略的一侧。When the user is determined to have focused attention on completing the training task, a transcutaneous electrical nerve stimulation signal is emitted from an electrical stimulator placed on the user's neck, with the stimulator located on the side that the user is ignoring.

在一些实施例中,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,所述方法还包括:In some embodiments, before controlling at least two target pattern symbols on the display to move within a spatial range that is ignored by the user's unilateral visual perception in a specific direction and at a specific speed, the method further includes:

获取用户阅读显示器上单行移动示例文字过程中眼球的最大位移;Get the maximum displacement of the user's eyeball while reading a single line of moving sample text on the monitor;

根据所述最大位移确定用户单侧视觉忽略的临界线,根据所述临界线确定用户单侧视觉忽略的空间范围。The critical line for unilateral visual neglect by the user is determined based on the maximum displacement, and the spatial range for unilateral visual neglect by the user is determined based on the critical line.

在一些实施例中,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,所述方法还包括:In some embodiments, before controlling at least two target pattern symbols on the display to move within a spatial range that is ignored by the user's unilateral visual perception in a specific direction and at a specific speed, the method further includes:

获取用户阅读显示器上单行移动示例文字过程中眼球的平均眼动速度;Obtain the average eye movement velocity of the user's eyes while reading a single line of moving sample text on the monitor;

根据所述平均眼动速度,确定特定移动速度。A specific movement speed is determined based on the average eye movement speed.

在一些实施例中,根据所述第一稳态视觉诱发电位信号判断用户的注意力是否足够集中,包括:In some embodiments, determining whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal includes:

对所述第一稳态视觉诱发电位信号进行解码并分类,获得第一分类标签;The first steady-state visual evoked potential signal is decoded and classified to obtain a first classification label;

将所述第一分类标签与预设标签进行对比,得到用户的分类正确率;The user's classification accuracy is obtained by comparing the first category label with the preset label;

当分类正确率达到指定比例时,判定用户的注意力足够集中。When the classification accuracy reaches a specified percentage, it is determined that the user's attention is sufficiently focused.

在一些实施例中,根据所述第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务,包括:In some embodiments, determining whether a user has focused their attention to complete a training task based on the second steady-state visual evoked potential signal includes:

对所述第二稳态视觉诱发电位信号进行解码并分类,获得第二分类标签;The second steady-state visual evoked potential signal is decoded and classified to obtain a second classification label;

当第二分类标签与目标图案符号对应的提示标签相同时,判定用户集中注意力完成训练任务。When the second category label is the same as the prompt label corresponding to the target pattern symbol, it is determined that the user has focused their attention to complete the training task.

本发明第二方面公开一种单侧空间忽略康复训练装置,包括:A second aspect of the present invention discloses a unilateral spatial neglect rehabilitation training device, comprising:

测试单元,用于控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁;The test unit is used to control multiple pattern symbols to flash randomly at different flashing frequencies at multiple positions on the display.

第一采集单元,用于采集用户注视显示器的第一稳态视觉诱发电位信号;The first acquisition unit is used to acquire the first steady-state visual evoked potential signal of the user's gaze at the display;

第一判断单元,用于根据所述第一稳态视觉诱发电位信号判断用户的注意力是否足够集中;The first judgment unit is used to determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal.

训练单元,用于在判定用户的注意力足够集中时,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动;其中,特定移动方向为由健康侧向忽略侧移动,所述目标图案符号为多个图案符号中任意图案符号;The training unit is used to control at least two target pattern symbols on the display to move within a space that is visually ignored on one side of the user's side, with a specific movement direction and a specific movement speed, when it is determined that the user's attention is sufficiently focused; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbols are any pattern symbols from a plurality of pattern symbols;

第二采集单元,用于获取用户注视目标图案符号时的第二稳态视觉诱发电位信号;The second acquisition unit is used to acquire the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol;

第二判断单元,用于根据所述第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务;The second judgment unit is used to determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal.

电刺激单元,用于在判定用户集中注意力完成训练任务时,控制置于用户颈部的电刺激器发出经皮神经电刺激信号,其中,电刺激器位于用户忽略的一侧。An electrical stimulation unit is used to control an electrical stimulator placed on the user's neck to emit transcutaneous electrical stimulation signals when the user is determined to be concentrating on completing a training task. The electrical stimulator is located on the side that the user ignores.

在一些实施例中,所述装置还包括:In some embodiments, the apparatus further includes:

第一获取单元,用于在所述训练单元以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,获取用户阅读显示器上单行移动示例文字过程中眼球的最大位移;The first acquisition unit is used to acquire the maximum displacement of the user's eyeball during the process of reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move within a space that is ignored by the user's unilateral visual perception, in a specific moving direction and at a specific moving speed.

范围确定单元,用于根据所述最大位移确定用户单侧视觉忽略的临界线,根据所述临界线确定用户单侧视觉忽略的空间范围。The range determination unit is used to determine the critical line for unilateral visual neglect by the user based on the maximum displacement, and to determine the spatial range for unilateral visual neglect by the user based on the critical line.

在一些实施例中,所述装置还包括:In some embodiments, the apparatus further includes:

第二获取单元,用于在所述训练单元以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,获取用户阅读显示器上单行移动示例文字过程中眼球的平均眼动速度;The second acquisition unit is used to acquire the average eye movement speed of the user's eyeballs during the process of reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move within a space that is ignored by the user's unilateral vision in a specific moving direction and at a specific moving speed.

速度确定单元,用于根据所述平均眼动速度,确定特定移动速度。A velocity determination unit is used to determine a specific movement speed based on the average eye movement speed.

本发明第三方面公开一种电子设备,包括存储有可执行程序代码的存储器以及与所述存储器耦合的处理器;所述处理器调用所述存储器中存储的所述可执行程序代码,用于执行第一方面公开的单侧空间忽略康复训练方法。A third aspect of the present invention discloses an electronic device, including a memory storing executable program code and a processor coupled to the memory; the processor calls the executable program code stored in the memory to execute the unilateral spatial neglect rehabilitation training method disclosed in the first aspect.

本发明第四方面公开一种计算机可读存储介质,所述计算机可读存储介质存储计算机程序,其中,所述计算机程序使得计算机执行第一方面公开的单侧空间忽略康复训练方法。The fourth aspect of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to perform the unilateral spatial neglect rehabilitation training method disclosed in the first aspect.

本发明的有益效果在于,通过控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁,采集用户注视显示器的第一稳态视觉诱发电位信号,判断用户的注意力是否足够集中;当用户的注意力足够集中时,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动;其中,特定移动方向为由健康侧向忽略侧移动,目标图案符号为多个图案符号中任意图案符号;然后获取用户注视目标图案符号时的第二稳态视觉诱发电位信号,判断用户是否集中注意力完成训练任务;当用户集中注意力完成训练任务时,控制置于用户颈部的电刺激器发出经皮神经电刺激信号,其中,电刺激器位于用户忽略的一侧,从而可以在训练之前确定被试者是否注意力足够集中,以及在确保被试者有效注视训练内容后,立刻发出指令给予经皮神经电刺激信号,以刺激用户颈部,形成闭环,可以保证训练的有效性,提高训练效果,方便针对于单侧空间忽略患者进行推广。The beneficial effects of this invention are as follows: By controlling multiple pattern symbols to randomly flash at different frequencies at multiple positions on the display, a first steady-state visual evoked potential signal is acquired when the user gazes at the display, determining whether the user's attention is sufficiently focused; when the user's attention is sufficiently focused, at least two target pattern symbols on the display are controlled to move within the user's unilateral visual neglected space range in a specific direction and at a specific speed; wherein, the specific movement direction is from the healthy side to the neglected side, and the target pattern symbols are any pattern symbols from multiple pattern symbols; then, a second steady-state visual evoked potential signal is acquired when the user gazes at the target pattern symbols, determining whether the user has concentrated their attention to complete the training task; when the user has concentrated their attention to complete the training task, a transcutaneous electrical nerve stimulation signal is emitted from an electrical stimulator placed on the user's neck, wherein the electrical stimulator is located on the neglected side of the user, thereby determining whether the subject's attention is sufficiently focused before training, and immediately issuing an instruction to deliver a transcutaneous electrical nerve stimulation signal to stimulate the user's neck after ensuring that the subject effectively gazes at the training content, forming a closed loop, which can ensure the effectiveness of training, improve training results, and facilitate promotion for patients with unilateral spatial neglect.

附图说明Attached Figure Description

此处的附图,示出了本发明所述技术方案的具体实例,并与具体实施方式构成说明书的一部分,用于解释本发明的技术方案、原理及效果。The accompanying drawings illustrate specific examples of the technical solutions described in this invention and, together with the detailed embodiments, form part of the specification, serving to explain the technical solutions, principles, and effects of this invention.

除非特别说明或另有定义,不同附图中,相同的附图标记代表相同或相似的技术特征,对于相同或相似的技术特征,也可能会采用不同的附图标记进行表示。Unless otherwise specified or defined, the same reference numerals in different figures represent the same or similar technical features, and different reference numerals may be used to represent the same or similar technical features.

图1是本发明实施例公开的一种单侧空间忽略康复训练方法的流程图;Figure 1 is a flowchart of a unilateral spatial neglect rehabilitation training method disclosed in an embodiment of the present invention;

图2是本发明实施例公开的一种单侧空间忽略康复训练系统的架构图;Figure 2 is an architectural diagram of a unilateral spatial neglect rehabilitation training system disclosed in an embodiment of the present invention;

图3是本发明实施例公开的一种单侧空间忽略康复训练装置的结构示意图;Figure 3 is a schematic diagram of a unilateral spatial neglect rehabilitation training device disclosed in an embodiment of the present invention;

图4是本发明实施例公开的一种电子设备的结构示意图。Figure 4 is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present invention.

附图标记说明:Explanation of reference numerals in the attached figures:

301、测试单元;302、第一采集单元;303、第一判断单元;304、训练单元;305、第二采集单元;306、第二判断单元;307、电刺激单元;401、存储器;402、处理器。301. Test unit; 302. First acquisition unit; 303. First judgment unit; 304. Training unit; 305. Second acquisition unit; 306. Second judgment unit; 307. Electrical stimulation unit; 401. Memory; 402. Processor.

具体实施方式Detailed Implementation

除非特别说明或另有定义,本文所使用的所有技术和科学术语与所属技术领域的技术人员通常理解的含义相同。在结合本发明的技术方案以现实的场景的情况下,本文所使用的所有技术和科学术语也可以具有与实现本发明的技术方案的目的相对应的含义。本文所使用的“第一、第二…”仅仅是用于对名称的区分,不代表具体的数量或顺序。本文所使用的术语“和/或”包括一个或多个相关的所列项目的任意的和所有的组合。Unless otherwise specified or defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. When combined with the technical solutions of the invention in a real-world scenario, all technical and scientific terms used herein may also have meanings corresponding to the purpose of achieving the technical solutions of the invention. The terms "first," "second," etc., used herein are merely for distinguishing names and do not represent a specific number or order. The term "and/or," as used herein, includes any and all combinations of one or more of the associated listed items.

需要说明的是,当元件被认为“固定于”另一个元件,它可以是直接固定在另一个元件上,也可以是存在居中的元件;当一个元件被认为是“连接”另一个元件,它可以是直接连接到另一个元件,也可以是同时存在居中元件;当一个元件被认为是“安装在”另一个元件,它可以是直接安装在另一个元件,也可以是同时存在居中元件。当一个元件被认为是“设在”另一个元件,它可以是直接设在另一个元件,也可以是同时存在居中元件。It should be noted that when a component is considered "fixed" to another component, it can be directly fixed to the other component or there can be an intervening component; when a component is considered "connected" to another component, it can be directly connected to the other component or there can be an intervening component; when a component is considered "mounted" on another component, it can be directly mounted on the other component or there can be an intervening component; when a component is considered "placed" on another component, it can be directly placed on the other component or there can be an intervening component.

除非特别说明或另有定义,本文所使用的“所述”、“该”为相应位置之前所提及或描述的技术特征或技术内容,该技术特征或技术内容与其所提及的技术特征或技术内容可以是相同的,也可以是相似的。此外,本文所使用的术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其他步骤或单元。Unless otherwise specified or defined, the terms "described" or "the" as used herein refer to the technical features or technical content mentioned or described prior to the relevant section, which may be the same as or similar to the technical features or technical content mentioned herein. Furthermore, the terms "comprising" and "having," and any variations thereof, as used herein, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the steps or units listed, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such processes, methods, products, or apparatus.

本发明实施例公开一种单侧空间忽略康复训练方法,该方法可以通过计算机编程实现。该方法的执行主体可为如计算机电脑、笔记本电脑、平板电脑等电子设备,或内嵌于电子设备中的单侧空间忽略康复训练装置,本发明对此不作限定。为了便于理解本发明,下面将参照说明书附图对本发明的具体实施例进行更详细的描述。This invention discloses a unilateral spatial neglect rehabilitation training method, which can be implemented through computer programming. The execution subject of this method can be an electronic device such as a computer, laptop, or tablet, or a unilateral spatial neglect rehabilitation training device embedded in an electronic device; this invention does not limit this. To facilitate understanding of this invention, specific embodiments will be described in more detail below with reference to the accompanying drawings.

如图1所示,该方法包括以下步骤110~150:As shown in Figure 1, the method includes the following steps 110-150:

110、控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁。110. Control multiple patterns and symbols to flash randomly at different flashing frequencies at multiple positions on the display.

在本发明实施例中,提供一种单侧空间忽略康复训练系统,如图2所示,该训练系统包括计算机、脑电装置、LED显示屏和经皮神经电刺激器,其中计算机分别与脑电装置、LED显示屏和经皮神经电刺激器通信连接,脑电装置设置为帽状可佩戴于用户的头部,LED显示屏设置于用户的视线范围内,用于输出视动刺激信号,经皮神经电刺激器包括电极,设置于用户的颈部上靠近用户视觉忽略一侧的斜方肌上,用于输出电刺激信号。计算机内嵌设有计算机执行程序,用于执行本发明所提供的单侧空间忽略康复训练方法。In this embodiment of the invention, a unilateral spatial neglect rehabilitation training system is provided, as shown in Figure 2. The training system includes a computer, an electroencephalogram (EEG) device, an LED display screen, and a transcutaneous electrical nerve stimulator (TENS). The computer is communicatively connected to the EEG device, the LED display screen, and the TNS. The EEG device is designed as a cap to be worn on the user's head. The LED display screen is positioned within the user's field of vision and outputs optomotor stimulation signals. The TNS includes electrodes positioned on the user's neck near the trapezius muscle on the side of the user's visual neglect and outputs electrical stimulation signals. The computer has an embedded program for executing the unilateral spatial neglect rehabilitation training method provided by this invention.

120、采集用户注视显示器的第一稳态视觉诱发电位信号,根据第一稳态视觉诱发电位信号判断用户的注意力是否足够集中。120. Collect the first steady-state visual evoked potential signal of the user's gaze at the display, and determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal.

本发明实施例中,在进行康复训练之前,需要先对用户注意力是否集中进行测定。具体的,在屏幕中设置多个图案符号(例如圆点、三角形符号等等),为每个图案符号分配不同的闪烁频率,图案符号所在位置不变均为固定,在控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁的过程中,每次随机在其中一个图案符号的位置处令图案符号变为红色,以提示用户集中注意力注视该图案符号,感受其闪烁。以此类推,所有图案符号均提示过后,系统自动将采集后第一SSVEP信号进行处理,并根据第一SSVEP信号判断用户的注意力是否足够集中。具体的,判断用户的注意力是否足够集中,可以包括以下未图示的步骤S11~S13:In this embodiment of the invention, before rehabilitation training, it is necessary to measure whether the user's attention is focused. Specifically, multiple pattern symbols (such as dots, triangles, etc.) are set on the screen, and each pattern symbol is assigned a different flashing frequency. The positions of the pattern symbols remain fixed. While controlling the multiple pattern symbols to flash randomly at multiple positions on the display at different flashing frequencies, each time a pattern symbol is randomly turned red at one of its positions, it prompts the user to focus their attention on that pattern symbol and feel its flashing. This process is repeated until all pattern symbols have been indicated. After all the pattern symbols have been indicated, the system automatically processes the first SSVEP signal collected and determines whether the user's attention is sufficiently focused based on the first SSVEP signal. Specifically, determining whether the user's attention is sufficiently focused may include the following steps S11~S13 (not shown):

S11、对第一稳态视觉诱发电位信号进行解码并分类,获得第一分类标签。S11. Decode and classify the first steady-state visual evoked potential signal to obtain the first classification label.

S12、将第一分类标签与预设标签进行对比,得到用户的分类正确率。S12. Compare the first category label with the preset label to obtain the user's classification accuracy.

S13、当分类正确率达到指定比例时,判定用户的注意力足够集中。S13. When the classification accuracy reaches a specified percentage, it is determined that the user's attention is sufficiently focused.

其中,对第一SSVEP信号进行解码分类处理,并将得到的第一分类标签与预设标签进行对比,得出用户关于注意力是否集中测定的分类正确率,一般认为分类正确率大于或等于80%,即可证明用户的注意力足够集中,说明其注意力集中程度可以进行后续的训练。否则,若分类正确率小于80%,则说明用户的注意力不足够集中,无法进行后续的训练,则结束本流程。The process involves decoding and classifying the first SSVEP signal, comparing the resulting first classification label with a preset label to determine the user's classification accuracy in assessing attentional concentration. Generally, a classification accuracy of 80% or higher is considered sufficient to indicate adequate user concentration for further training. Conversely, a classification accuracy less than 80% indicates insufficient user concentration, precluding further training and ending the process.

具体的SSVEP信号解码方法如下:The specific SSVEP signal decoding method is as follows:

采用滤波器组典型相关分析(filter bank canonical correlation analysis,FBCCA)解码方法,包括滤波器组分析、典型相关分析(CCA)处理和目标识别。首先,使用不同的带通滤波器将SSVEP信号分解成N个子带成分 。其中,不同子带成分对应SSVEP信号的不同闪烁频率的谐波,子带成分的数目即为SSVEP信号的谐波数。其次,根据每个子带成分对应的闪烁频率,计算每个子带成分的正余弦参考信号 ,以及计算每个子带成分对应的相关向量 。其中 代表数量,相关向量 由对应于第 个闪烁频率 个相关系数组成。   A filter bank canonical correlation analysis (FBCCA) decoding method is employed, including filter bank analysis, canonical correlation analysis (CCA) processing, and target recognition. First, the SSVEP signal is decomposed into N sub-band components using different bandpass filters. Here, different sub-band components correspond to harmonics of different flicker frequencies of the SSVEP signal, and the number of sub-band components is the harmonic number of the SSVEP signal. Next, based on the flicker frequency corresponding to each sub-band component, the sine and cosine reference signals for each sub-band component are calculated. And calculate the correlation vector corresponding to each sub-band component. .in Represents quantity, related vector From the corresponding number Each flashing frequency of It consists of several correlation coefficients.

正余弦参考信号 与闪烁频率 的关系为: Sine and cosine reference signals With flicker frequency The relationship is:

;

其中 表示谐波的数量, 表示谐波中采样点的数量,采样点的数量=采样频率×采样时间,一般采样频率为1000 Hz,采样时间根据实验自主设定。每个子带成分的 个相关系数组成的相关向量 为: in Indicates the number of harmonics, This indicates the number of sampling points in the harmonics. The number of sampling points = sampling frequency × sampling time. The sampling frequency is typically 1000 Hz, and the sampling time is set independently based on the experiment. Each sub-band component... The correlation vector consists of several correlation coefficients. for:

;

其中 代表 的相关系数。每个子带成分的相关向量的平方乘以相应的权重系数的和构成了整体SSVEP信号对应的脑电信号特征 in represent and The correlation coefficient. The sum of the squares of the correlation vectors of each sub-band component multiplied by the corresponding weight coefficients constitutes the EEG signal features corresponding to the overall SSVEP signal. .

;

其中 表示第 个子带成分,每个子带成分的相关系数所对应的权重系数 可以表示为: in Indicates the first Each subband component, and the weighting coefficient corresponding to the correlation coefficient of each subband component. It can be represented as:

;

为常数。 and It is a constant.

最后,SSVEP信号的脑电信号特征 是一个一行k列的向量,k为目标的索引。提取得到脑电信号特征 之后,使用机器学习中的人工神经网络模型实现对SSVEP脑电信号特征的二分类,也即,将脑电信号特征 输入预训练的人工神经网络模型,根据模型预测结果获得分类标签(向量 中最大值对应的 值即为分类得到的分类标签),该分类标签对应的闪烁频率即为所求的目标刺激的频率 Finally, the EEG signal characteristics of SSVEP signals It is a vector with one row and k columns, where k is the index of the target. EEG signal features are extracted. Next, an artificial neural network model from machine learning was used to perform binary classification of SSVEP EEG signal features, that is, to classify the EEG signal features... Input a pre-trained artificial neural network model, and obtain classification labels (vectors) based on the model's prediction results. The maximum value corresponding to The value is the classification label obtained from the classification, and the flashing frequency corresponding to this classification label is the frequency of the target stimulus. :

;

130、当判定用户的注意力足够集中时,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动。130. When it is determined that the user's attention is sufficiently focused, control at least two target pattern symbols on the display to move within a space that is ignored by the user's single-sided vision, with a specific movement direction and a specific movement speed.

其中,特定移动方向为由健康侧向忽略侧移动,即,由不被用户忽略的一侧移动至被用户忽略的一侧;目标图案符号为多个图案符号中任意图案符号。The specific movement direction is from the healthy side to the ignored side, that is, from the side that is not ignored by the user to the side that is ignored by the user; the target pattern symbol is any pattern symbol among multiple pattern symbols.

在执行步骤130之前,方法还包括以下未图示的步骤S21~S23:Before performing step 130, the method also includes the following steps S21-S23 (not shown):

S21、获取用户阅读显示器上单行移动示例文字过程中眼球的最大位移和平均眼动速度。S21. Obtain the maximum displacement and average eye movement speed of the eyeball during the user's reading of a single line of moving sample text on the monitor.

具体的,可以使用视频眼震电图仪测量用户阅读示例文字时眼球的运动速度和最大位移。其中,测量最大位移是为了测定用户视觉忽略的临界线,当测定用户眼球的最大位移时,则根据用户阅读示例文字时眼球的运动速度计算眼球从开始移动至到达临界线时的平均运动速度作为平均眼动速度。Specifically, a video electronystagmography (EEG) device can be used to measure the speed and maximum displacement of the user's eyes while reading sample text. Measuring the maximum displacement is to determine the threshold at which the user's vision is ignored. When measuring the maximum displacement of the user's eyes, the average eye movement speed from the start of movement to reaching the threshold is calculated based on the user's eye movement speed while reading the sample text.

一般在测定前,可先获取用户预设的被忽略侧,如根据临床症状反应已知用户是左侧视觉空间忽略,那么可基于人机交互方式获取用户预设的被忽略侧为左侧,健康侧为右侧。在测定时,单行移动示例文字右健康侧向被忽略侧的方向移动。具体在测试时,用户坐位,正对显示器,保持视线与屏幕在同一水平。使用视频眼震电图仪(Visual Eyes)测量用户阅读电脑显示屏上单行移动示例文字的眼动速度、位移,以测定用户视觉忽略的临界线。显示器上位于最大位移、且与单行移动示例文字的移动路径相垂直的纵线,则为临界线。Before the measurement, the user's preset neglected side can be obtained. For example, if the user's clinical symptoms indicate left-sided visual-spatial neglect, the user's preset neglected side can be determined as the left and the healthy side as the right, based on human-computer interaction. During the measurement, a single line of moving example text is moved from the right healthy side towards the neglected side. Specifically, during the test, the user sits facing the monitor, keeping their line of sight at the same level as the screen. A video electronystagmography (VEOG) device is used to measure the user's eye movement speed and displacement as they read a single line of moving example text on the computer screen to determine the user's visual neglect threshold. The vertical line on the monitor that represents the maximum displacement and is perpendicular to the movement path of the single line of moving example text is the threshold line.

S22、根据最大位移确定用户单侧视觉忽略的临界线,根据临界线确定用户单侧视觉忽略的空间范围。S22. Determine the critical line for unilateral visual neglect by the user based on the maximum displacement, and determine the spatial range for unilateral visual neglect by the user based on the critical line.

其中,临界线将显示器纵向划分为两部分,靠近用户预设的被忽略侧的一部分则确定为用户单侧视觉忽略的空间范围。例如,若用户预设的被忽略侧为左侧,临界线将显示器纵向划分为左、右两部分,则显示器的左部分则确定为用户单侧视觉忽略的空间范围。The critical line divides the display vertically into two parts, and the part closer to the user's preset neglected side is defined as the spatial range that the user visually ignores on one side. For example, if the user's preset neglected side is the left side, and the critical line divides the display vertically into left and right parts, then the left part of the display is defined as the spatial range that the user visually ignores on one side.

S23、根据平均眼动速度,确定特定移动速度。S23. Determine a specific movement speed based on the average eye movement speed.

在本发明实施例中,可以直接将测定的平均眼动速度作为后续脑机接口训练中视觉刺激符号的特定移动速度,也可以按照一定比例对平均眼动速度进行计算,得到特定移动速度,例如,取平均眼动速度的80%、90%或者110%作为特定移动速度。In this embodiment of the invention, the measured average eye movement speed can be directly used as the specific movement speed of the visual stimulus symbol in subsequent brain-computer interface training, or the average eye movement speed can be calculated according to a certain proportion to obtain the specific movement speed, for example, 80%, 90% or 110% of the average eye movement speed can be taken as the specific movement speed.

具体的,在步骤130中,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动的方式具体为:控制显示器上的至少两个目标图案符号由健康侧向忽略侧在空间范围内匀速移动。例如,以30-120°/s的眼动(眼球运动)速度移动。Specifically, in step 130, the method of controlling at least two target pattern symbols on the display to move within the space neglected by the user's unilateral vision in a specific direction and at a specific speed is as follows: controlling at least two target pattern symbols on the display to move at a uniform speed from the healthy side to the neglected side within the space. For example, moving at an eye movement speed of 30-120°/s.

在本发明实施例中,使用MATLAB软件编程完成对刺激界面的设计。具体的,显示器同时显示2个直径为5cm的图案符号,纵向排列于用户视觉忽略的临界线,其中一个图案符号固定不动,另一个图案符号匀速从健侧移向被忽略侧移动,移动至显示器边界后从原点开始不断循环,根据获得的用户的平均眼动速度和忽略的空间范围设置图案符号移动的速度和范围,两个图案符号的纵向排列顺序随机出现。In this embodiment of the invention, the design of the stimulus interface is completed using MATLAB software programming. Specifically, the display simultaneously shows two pattern symbols with a diameter of 5cm, arranged vertically at the boundary line of the user's visual neglect. One pattern symbol is fixed, while the other pattern symbol moves at a constant speed from the healthy side to the neglected side. After moving to the boundary of the display, it starts to cycle continuously from the origin. The speed and range of the pattern symbol movement are set according to the user's average eye movement speed and the neglected spatial range. The vertical arrangement order of the two pattern symbols appears randomly.

140、获取用户注视目标图案符号时的第二稳态视觉诱发电位信号,根据第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务。140. Obtain the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol, and determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal.

其中,根据第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务的具体实施方式为:对第二稳态视觉诱发电位信号进行解码并分类,获得第二分类标签;当第二分类标签与目标图案符号对应的提示标签相同时,判定用户集中注意力完成训练任务。The specific implementation method for determining whether a user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal is as follows: the second steady-state visual evoked potential signal is decoded and classified to obtain a second classification label; when the second classification label is the same as the prompt label corresponding to the target pattern symbol, it is determined that the user has focused their attention to complete the training task.

其中,对第二稳态视觉诱发电位信号进行解码并分类的方式请参阅上述对第一稳态视觉诱发电位信号进行解码并分类的方式,在此不作赘述。The method for decoding and classifying the second steady-state visual evoked potential signal is described above for the method for decoding and classifying the first steady-state visual evoked potential signal, and will not be repeated here.

150、当判定用户集中注意力完成训练任务时,控制置于用户颈部的电刺激器发出经皮神经电刺激信号,其中,电刺激器位于用户忽略的一侧。150. When it is determined that the user is concentrating on completing the training task, the electrical stimulator placed on the user's neck is controlled to emit a transcutaneous electrical stimulation signal, wherein the electrical stimulator is located on the side that the user ignores.

具体的,在BCI训练开始前,保证用户处于清醒状态,听觉或视觉水平上能够接收测试问题,身体处于放松状态,眼睛平视显示器端,患者被要求眼球尽量跟随亮点移动,保持头部不动。选择较为安静的测试环境开始测试任务。首先播放测试指令语音版本,同时在显示器端呈现用户交互界面“请注视移动的图案符号”,播放的语音指令结束后,设置2 s等待时间,然后显示器出现固定和移动图案符号界面5s,令用户注视图案符号,充分感受目标运动刺激,并使用脑电信号记录装置记录下用户在测试期间的脑电信号,并将记录的脑电信号实时传输至计算机端,刺激设备端,通过使用相关算法确定用户选择注视的目标图案符号后,给予忽略侧颈部经皮神经电刺激(Transcutaneous Electrical Nerve Stimulation,TENS),为被试者提供体感反馈。Specifically, before BCI training begins, the user is ensured to be awake, able to receive test questions at an auditory or visual level, and in a relaxed state with their eyes looking straight ahead at the display. The patient is instructed to follow the movement of a bright spot with their eyes while keeping their head still. A relatively quiet testing environment is selected to begin the test task. First, the audio version of the test instructions is played, and simultaneously, the user interface "Please look at the moving pattern symbol" is displayed on the display. After the audio instructions finish playing, a 2-second wait is set, and then the display shows a fixed and moving pattern symbol interface for 5 seconds. The user is instructed to look at the pattern symbol to fully experience the target motion stimulus. The user's EEG signals during the test are recorded using an EEG recording device and transmitted in real time to the computer. The stimulation device determines the target pattern symbol selected by the user using relevant algorithms and then provides transcutaneous electrical nerve stimulation (TENS) on the neglected side of the neck to provide somatosensory feedback to the subject.

其中,用户注视电脑屏幕中移动的图案符号,使用脑电信号记录装置记录下用户在测试期间的脑电信号,并使用相关算法确定用户注意目标图案符号的情况。在硬件设备部分,采用Neuroscan公司的Synamps2脑电记录仪系统用于脑电信号采集与记录,其所包括的64导电极帽的脑电电极摆放位置满足改进的国际10-20标准。采用分辨率为1920 × 1080 、刷新率为60 Hz的显示器用于刺激界面呈现。除此之外,还需用到录音和录像设备,测试全程均保持录音或录像设备开启,保存全程音频或视频文件以及记录的脑电信号。In this test, the user gazes at a moving pattern on a computer screen, and an EEG recording device records the user's EEG signals during the test. Algorithms are then used to determine the user's level of attention to the target pattern. For the hardware, the Neuroscan Synamps2 EEG recording system is used for EEG signal acquisition and recording. The placement of its 64-electrode caps conforms to the improved international 10-20 standard. A 1920 × 1080 resolution display with a 60 Hz refresh rate is used to present the stimulation interface. In addition, audio and video recording equipment is used, and the recording devices are kept on throughout the test to save the entire audio or video file, as well as the recorded EEG signals.

在编程和数据传输环境部分,用户交互刺激界面的展示由MATLAB软件下的Psychtoolbox心理学工具箱编码完成,通过建立刺激端计算机与采集端设备的局域网连接完成网络环境的搭建,TCP/IP协议的设置用于实现脑电数据从采集端到刺激端设备的实时传输。In the programming and data transmission environment section, the user interactive stimulation interface is coded using the Psychtoolbox software under MATLAB. The network environment is set up by establishing a local area network connection between the stimulation end computer and the acquisition end device. The TCP/IP protocol is set up to realize the real-time transmission of EEG data from the acquisition end to the stimulation end device.

在数据采集与传输过程中,为用户佩戴好电极帽,将电极帽与脑电记录仪的放大器段相连,在相应的电极位置涂抹导电膏使阻抗降至10kΩ以下并能够保持稳定后,展示测试刺激界面,建立数据传输环境,同时数据采集端开始记录用户在测试任务期间的脑电数据。记录时设置采样率为1000 Hz,50 Hz陷波用于去除工频干扰。During data acquisition and transmission, electrode caps are fitted to the user and connected to the amplifier section of the EEG recorder. Conductive paste is applied to the corresponding electrode positions to reduce the impedance to below 10kΩ and maintain stability. The test stimulation interface is then displayed to establish the data transmission environment. Simultaneously, the data acquisition unit begins recording the user's EEG data during the test task. The sampling rate is set to 1000 Hz, and a 50 Hz notch filter is used to remove power frequency interference.

最后,根据用户是否完成注意力集中任务,给予用户反馈。Finally, provide feedback to the user based on whether they have completed the attention-focusing task.

当用户能够集中注意力完成注视任务时,计算机根据脑电信号识别注意成功信号,并对TENS器发出指令,以控制电刺激器发出经皮神经电刺激信号,该经皮神经电刺激信号的频率设定为100Hz,脉冲时间设定为100us,平均强度设定为0.5uA/mm。When the user is able to concentrate on completing the gaze task, the computer identifies the attention success signal based on the EEG signal and issues an instruction to the TENS device to control the electrical stimulator to emit a transcutaneous electrical nerve stimulation signal. The frequency of the transcutaneous electrical nerve stimulation signal is set to 100Hz, the pulse duration is set to 100us, and the average intensity is set to 0.5uA/mm.

如判定用户无法集中注意力完成训练任务时,可给予语音提示或人工引导。最后将用户完成注意力追踪任务的次数和用户个人信息同时呈现在界面中以完成该次测试。If it is determined that the user is unable to concentrate on completing the training task, voice prompts or manual guidance can be provided. Finally, the number of times the user has completed the attention tracking task and the user's personal information are displayed on the interface to complete the test.

综上所述,实施本发明实施例,基于SSVEP-BCI将视动训练方法进行转化,仅需用户注视即可完成,既能通过训练用户的视觉追踪功能感知忽略的视空间,同时可以通过TENS提供的体感刺激感知忽略的肢体感觉。从中枢和外周水平同时提供刺激,形成了神经康复的闭合环路,保证了训练的有效性。In summary, by implementing the embodiments of the present invention, the visuomotor training method is transformed based on SSVEP-BCI, requiring only user gaze to complete. This allows the user to perceive neglected visuospatial spaces through training their visual tracking function, and simultaneously perceive neglected limb sensations through somatosensory stimulation provided by TENS. Providing stimulation simultaneously at both the central and peripheral levels forms a closed loop for neurorehabilitation, ensuring the effectiveness of the training.

本发明通过基于SSVEP和运动想象-BCI的对用户注意力的解码可以保障注意的有效性,同时使用BCI系统将视动刺激技术和TENS刺激连接,形成闭环训练模式,将主动和被动注意力整合,闭环的BCI可以双通道同时训练,提高训练效果。This invention ensures the effectiveness of attention by decoding user attention based on SSVEP and motor imagery-BCI. At the same time, it uses the BCI system to connect visual-motor stimulation technology and TENS stimulation to form a closed-loop training mode, integrating active and passive attention. The closed-loop BCI can train both channels simultaneously, improving the training effect.

如图3所示,本发明实施例公开一种单侧空间忽略康复训练装置,包括测试单元301、第一采集单元302、第一判断单元303、训练单元304、第二采集单元305、第二判断单元306、电刺激单元307,其中,As shown in Figure 3, this embodiment of the invention discloses a unilateral spatial neglect rehabilitation training device, including a testing unit 301, a first acquisition unit 302, a first judgment unit 303, a training unit 304, a second acquisition unit 305, a second judgment unit 306, and an electrical stimulation unit 307, wherein...

测试单元301,用于控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁;Test unit 301 is used to control multiple pattern symbols to flash randomly at multiple positions on the display at different flashing frequencies;

第一采集单元302,用于采集用户注视显示器的第一稳态视觉诱发电位信号;The first acquisition unit 302 is used to acquire the first steady-state visual evoked potential signal of the user looking at the display.

第一判断单元303,用于根据所述第一稳态视觉诱发电位信号判断用户的注意力是否足够集中;The first judgment unit 303 is used to determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal.

训练单元304,用于在第一判断单元303判定用户的注意力足够集中时,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动;其中,特定移动方向为由健康侧向忽略侧移动,所述目标图案符号为多个图案符号中任意图案符号;Training unit 304 is used to control at least two target pattern symbols on the display to move within the space ignored by the user's visual attention on one side, with a specific movement direction and a specific movement speed, when the first judgment unit 303 determines that the user's attention is sufficiently focused; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbol is any pattern symbol among a plurality of pattern symbols;

第二采集单元305,用于获取用户注视目标图案符号时的第二稳态视觉诱发电位信号;The second acquisition unit 305 is used to acquire the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol;

第二判断单元306,用于根据所述第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务;The second judgment unit 306 is used to determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal.

电刺激单元307,用于在第二判断单元306判定用户集中注意力完成训练任务时,控制置于用户颈部的电刺激器发出经皮神经电刺激信号,其中,电刺激器位于用户忽略的一侧。The electrical stimulation unit 307 is used to control the electrical stimulator placed on the user's neck to emit a transcutaneous nerve electrical stimulation signal when the second judgment unit 306 determines that the user is concentrating on completing the training task, wherein the electrical stimulator is located on the side that the user ignores.

作为一种可选的实施方式,训练装置还包括以下未图示的单元:As an optional implementation, the training device also includes the following units (not shown):

第一获取单元,用于在训练单元304以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,获取用户阅读显示器上单行移动示例文字过程中眼球的最大位移;The first acquisition unit is used to acquire the maximum displacement of the user's eyeball during the process of reading a single line of moving example text on the display before the training unit 304 controls at least two target pattern symbols on the display to move in a specific direction and at a specific speed within a space ignored by the user's unilateral vision.

范围确定单元,用于根据所述最大位移确定用户单侧视觉忽略的临界线,根据临界线确定用户单侧视觉忽略的空间范围。The range determination unit is used to determine the critical line for unilateral visual neglect by the user based on the maximum displacement, and to determine the spatial range for unilateral visual neglect by the user based on the critical line.

作为一种可选的实施方式,训练装置还包括以下未图示的单元:As an optional implementation, the training device also includes the following units (not shown):

第二获取单元,用于在训练单元304以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,获取用户阅读显示器上单行移动示例文字过程中眼球的平均眼动速度;The second acquisition unit is used to acquire the average eye movement speed of the user's eyeballs during the process of reading a single line of moving example text on the display before the training unit 304 controls at least two target pattern symbols on the display to move in a specific direction and at a specific speed within a space that is ignored by the user's unilateral vision.

速度确定单元,用于根据所述平均眼动速度,确定特定移动速度。A velocity determination unit is used to determine a specific movement speed based on the average eye movement speed.

进一步可选的,所述第一判断单元303包括以下未图示的子单元:Further optionally, the first determination unit 303 includes the following sub-units (not shown):

第一解码子单元,用于对所述第一稳态视觉诱发电位信号进行解码并分类,获得第一分类标签;The first decoding subunit is used to decode and classify the first steady-state visual evoked potential signal to obtain a first classification label;

对比子单元,用于将所述第一分类标签与预设标签进行对比,得到用户的分类正确率;The comparison subunit is used to compare the first classification label with the preset label to obtain the user's classification accuracy.

第一判定子单元,用于在分类正确率达到指定比例时,判定用户的注意力足够集中。The first decision subunit is used to determine whether the user's attention is sufficiently focused when the classification accuracy reaches a specified percentage.

进一步可选的,所述第二断单元306包括以下未图示的子单元:Further optionally, the second break unit 306 includes the following sub-units (not shown):

第二解码子单元,用于对所述第二稳态视觉诱发电位信号进行解码并分类,获得第二分类标签;The second decoding subunit is used to decode and classify the second steady-state visual evoked potential signal to obtain a second classification label;

第二判定子单元,当第二分类标签与目标图案符号对应的提示标签相同时,判定用户集中注意力完成训练任务。The second judgment subunit determines that the user has focused their attention to complete the training task when the second classification label is the same as the prompt label corresponding to the target pattern symbol.

如图4所示,本发明实施例公开一种电子设备,包括存储有可执行程序代码的存储器401以及与存储器401耦合的处理器402;As shown in Figure 4, an embodiment of the present invention discloses an electronic device, including a memory 401 storing executable program code and a processor 402 coupled to the memory 401.

其中,处理器402调用存储器401中存储的可执行程序代码,执行上述各实施例中描述的单侧空间忽略康复训练方法。The processor 402 calls the executable program code stored in the memory 401 to execute the unilateral spatial neglect rehabilitation training method described in the above embodiments.

本发明实施例还公开一种计算机可读存储介质,其存储计算机程序,其中,该计算机程序使得计算机执行上述各实施例中描述的单侧空间忽略康复训练方法。This invention also discloses a computer-readable storage medium storing a computer program that causes a computer to execute the unilateral spatial neglect rehabilitation training method described in the above embodiments.

以上实施例的目的,是对本发明的技术方案进行示例性的再现与推导,并以此完整的描述本发明的技术方案、目的及效果,其目的是使公众对本发明的公开内容的理解更加透彻、全面,并不以此限定本发明的保护范围。The purpose of the above embodiments is to reproduce and derive the technical solution of the present invention by way of example, and to fully describe the technical solution, purpose and effect of the present invention. The purpose is to enable the public to have a more thorough and comprehensive understanding of the disclosure of the present invention, and not to limit the scope of protection of the present invention.

以上实施例也并非是基于本发明的穷尽性列举,在此之外,还可以存在多个未列出的其他实施方式。在不违反本发明构思的基础上所作的任何替换与改进,均属本发明的保护范围。The above embodiments are not an exhaustive list based on the present invention, and there may be many other embodiments not listed. Any substitutions and improvements made without departing from the concept of the present invention are within the protection scope of the present invention.

Claims (10)

一种单侧空间忽略康复训练方法,其特征在于,包括:A unilateral spatial neglect rehabilitation training method, characterized by comprising: 控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁;Control multiple patterns and symbols to flash randomly at different flashing frequencies at multiple positions on the display; 采集用户注视显示器的第一稳态视觉诱发电位信号,根据所述第一稳态视觉诱发电位信号判断用户的注意力是否足够集中;Collect the first steady-state visual evoked potential signal of the user looking at the display, and determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal; 当判定用户的注意力足够集中时,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动;其中,特定移动方向为由健康侧向忽略侧移动,所述目标图案符号为多个图案符号中任意图案符号;When it is determined that the user's attention is sufficiently focused, at least two target pattern symbols on the display are controlled to move within the space that is ignored by the user's visual perception on one side, with a specific movement direction and a specific movement speed; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbol is any pattern symbol among a plurality of pattern symbols; 获取用户注视目标图案符号时的第二稳态视觉诱发电位信号,根据所述第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务;Acquire the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol, and determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal; 当判定用户集中注意力完成训练任务时,控制置于用户颈部的电刺激器发出经皮神经电刺激信号,其中,电刺激器位于用户忽略的一侧。When the user is determined to have focused attention on completing the training task, a transcutaneous electrical nerve stimulation signal is emitted from an electrical stimulator placed on the user's neck, with the stimulator located on the side that the user is ignoring. 如权利要求1所述的单侧空间忽略康复训练方法,其特征在于,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,所述方法还包括:The unilateral spatial neglect rehabilitation training method as described in claim 1, characterized in that, before controlling at least two target pattern symbols on the display to move within the spatial range of unilateral visual neglect by the user in a specific direction and at a specific speed, the method further includes: 获取用户阅读显示器上单行移动示例文字过程中眼球的最大位移;Get the maximum displacement of the user's eyeball while reading a single line of moving sample text on the monitor; 根据所述最大位移确定用户单侧视觉忽略的临界线,根据所述临界线确定用户单侧视觉忽略的空间范围。The critical line for unilateral visual neglect by the user is determined based on the maximum displacement, and the spatial range for unilateral visual neglect by the user is determined based on the critical line. 如权利要求2所述的单侧空间忽略康复训练方法,其特征在于,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,所述方法还包括:The unilateral spatial neglect rehabilitation training method as described in claim 2, characterized in that, before controlling at least two target pattern symbols on the display to move within the spatial range of unilateral visual neglect by the user in a specific direction and at a specific speed, the method further includes: 获取用户阅读显示器上单行移动示例文字过程中眼球的平均眼动速度;Obtain the average eye movement velocity of the user's eyes while reading a single line of moving sample text on the monitor; 根据所述平均眼动速度,确定特定移动速度。A specific movement speed is determined based on the average eye movement speed. 如权利要求1所述的单侧空间忽略康复训练方法,其特征在于,根据所述第一稳态视觉诱发电位信号判断用户的注意力是否足够集中,包括:The unilateral spatial neglect rehabilitation training method as described in claim 1, characterized in that, judging whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal includes: 对所述第一稳态视觉诱发电位信号进行解码并分类,获得第一分类标签;The first steady-state visual evoked potential signal is decoded and classified to obtain a first classification label; 将所述第一分类标签与预设标签进行对比,得到用户的分类正确率;The user's classification accuracy is obtained by comparing the first category label with the preset label; 当分类正确率达到指定比例时,判定用户的注意力足够集中。When the classification accuracy reaches a specified percentage, it is determined that the user's attention is sufficiently focused. 如权利要求1至4任一项所述的单侧空间忽略康复训练方法,其特征在于,根据所述第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务,包括:The unilateral spatial neglect rehabilitation training method as described in any one of claims 1 to 4, characterized in that determining whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal includes: 对所述第二稳态视觉诱发电位信号进行解码并分类,获得第二分类标签;The second steady-state visual evoked potential signal is decoded and classified to obtain a second classification label; 当第二分类标签与目标图案符号对应的提示标签相同时,判定用户集中注意力完成训练任务。When the second category label is the same as the prompt label corresponding to the target pattern symbol, it is determined that the user has focused their attention to complete the training task. 一种单侧空间忽略康复训练装置,其特征在于,包括:A unilateral spatial neglect rehabilitation training device, characterized in that it comprises: 测试单元,用于控制多个图案符号在显示器上的多个位置以不同的闪烁频率随机闪烁;The test unit is used to control multiple pattern symbols to flash randomly at different flashing frequencies at multiple positions on the display. 第一采集单元,用于采集用户注视显示器的第一稳态视觉诱发电位信号;The first acquisition unit is used to acquire the first steady-state visual evoked potential signal of the user's gaze at the display; 第一判断单元,用于根据所述第一稳态视觉诱发电位信号判断用户的注意力是否足够集中;The first judgment unit is used to determine whether the user's attention is sufficiently focused based on the first steady-state visual evoked potential signal. 训练单元,用于在判定用户的注意力足够集中时,以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动;其中,特定移动方向为由健康侧向忽略侧移动,所述目标图案符号为多个图案符号中任意图案符号;The training unit is used to control at least two target pattern symbols on the display to move within a space that is visually ignored on one side of the user's side, with a specific movement direction and a specific movement speed, when it is determined that the user's attention is sufficiently focused; wherein, the specific movement direction is from the healthy side to the ignored side, and the target pattern symbols are any pattern symbols from a plurality of pattern symbols; 第二采集单元,用于获取用户注视目标图案符号时的第二稳态视觉诱发电位信号;The second acquisition unit is used to acquire the second steady-state visual evoked potential signal when the user gazes at the target pattern symbol; 第二判断单元,用于根据所述第二稳态视觉诱发电位信号判断用户是否集中注意力完成训练任务;The second judgment unit is used to determine whether the user has focused their attention to complete the training task based on the second steady-state visual evoked potential signal. 电刺激单元,用于在判定用户集中注意力完成训练任务时,控制置于用户颈部的电刺激器发出经皮神经电刺激信号,其中,电刺激器位于用户忽略的一侧。An electrical stimulation unit is used to control an electrical stimulator placed on the user's neck to emit transcutaneous electrical stimulation signals when the user is determined to be concentrating on completing a training task. The electrical stimulator is located on the side that the user ignores. 如权利要求6所述的单侧空间忽略康复训练装置,其特征在于,还包括:The unilateral spatial neglect rehabilitation training device as described in claim 6, characterized in that it further comprises: 第一获取单元,用于在所述训练单元以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,获取用户阅读显示器上单行移动示例文字过程中眼球的最大位移;The first acquisition unit is used to acquire the maximum displacement of the user's eyeball during the process of reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move within a space that is ignored by the user's unilateral visual perception, in a specific moving direction and at a specific moving speed. 范围确定单元,用于根据所述最大位移确定用户单侧视觉忽略的临界线,根据所述临界线确定用户单侧视觉忽略的空间范围。The range determination unit is used to determine the critical line for unilateral visual neglect by the user based on the maximum displacement, and to determine the spatial range for unilateral visual neglect by the user based on the critical line. 如权利要求7所述的单侧空间忽略康复训练装置,其特征在于,还包括:The unilateral spatial neglect rehabilitation training device as described in claim 7, characterized in that it further comprises: 第二获取单元,用于在所述训练单元以特定移动方向、以特定移动速度,控制显示器上的至少两个目标图案符号在用户单侧视觉忽略的空间范围内移动之前,获取用户阅读显示器上单行移动示例文字过程中眼球的平均眼动速度;The second acquisition unit is used to acquire the average eye movement speed of the user's eyeballs during the process of reading a single line of moving example text on the display before the training unit controls at least two target pattern symbols on the display to move within a space that is ignored by the user's unilateral vision in a specific moving direction and at a specific moving speed. 速度确定单元,用于根据所述平均眼动速度,确定特定移动速度。A velocity determination unit is used to determine a specific movement speed based on the average eye movement speed. 一种电子设备,其特征在于,包括存储有可执行程序代码的存储器以及与所述存储器耦合的处理器;所述处理器调用所述存储器中存储的所述可执行程序代码,用于执行权利要求1至5任一项所述的单侧空间忽略康复训练方法。An electronic device, characterized in that it includes a memory storing executable program code and a processor coupled to the memory; the processor calls the executable program code stored in the memory to execute the unilateral spatial neglect rehabilitation training method according to any one of claims 1 to 5. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储计算机程序,其中,所述计算机程序使得计算机执行权利要求1至5任一项所述的单侧空间忽略康复训练方法。A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, wherein the computer program causes a computer to perform the unilateral spatial neglect rehabilitation training method according to any one of claims 1 to 5.
PCT/CN2024/116246 2024-05-14 2024-09-02 Rehabilitation training method and apparatus for unilateral spatial neglect, device, and storage medium Pending WO2025236473A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202410597574.5A CN118356580B (en) 2024-05-14 2024-05-14 Unilateral spatial neglect rehabilitation training method, device, equipment, and storage medium
CN202410597574.5 2024-05-14

Publications (1)

Publication Number Publication Date
WO2025236473A1 true WO2025236473A1 (en) 2025-11-20

Family

ID=91878086

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/116246 Pending WO2025236473A1 (en) 2024-05-14 2024-09-02 Rehabilitation training method and apparatus for unilateral spatial neglect, device, and storage medium

Country Status (2)

Country Link
CN (1) CN118356580B (en)
WO (1) WO2025236473A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118356580B (en) * 2024-05-14 2024-09-03 广州医科大学附属第二医院 Unilateral spatial neglect rehabilitation training method, device, equipment, and storage medium
CN119405276B (en) * 2024-11-12 2025-08-05 嘉兴市第二医院 A system for assessing and treating unilateral spatial neglect

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120042252A (en) * 2010-10-25 2012-05-03 연세대학교 산학협력단 Rehabilitation training system with functional electrical stimulation based on steady-state visually evoked potentials
CN204855981U (en) * 2015-07-17 2015-12-09 无锡市精神卫生中心 Correction glasses are neglectd to unilateral
WO2019212150A1 (en) * 2018-05-04 2019-11-07 계명대학교 산학협력단 Gamified rehabilitation system combining brain stimulation maximizing mirror neuron activation and brain-computer interface (bci) technology, and control method thereof
CN113274032A (en) * 2021-04-29 2021-08-20 上海大学 Cerebral apoplexy rehabilitation training system and method based on SSVEP + MI brain-computer interface
CN114779980A (en) * 2022-06-17 2022-07-22 成都中医药大学 Cognitive perception unilateral neglect disorder training system, operation method and storage medium
CN118356580A (en) * 2024-05-14 2024-07-19 广州医科大学附属第二医院 Unilateral spatial neglect rehabilitation training method, device, equipment, and storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101314570B1 (en) * 2011-10-12 2013-10-07 서울대학교산학협력단 Brain-Machine Interface(BMI) Devices and Methods For Precise Control
KR101607893B1 (en) * 2014-12-15 2016-04-11 고려대학교 산학협력단 Apparatus for generating sssep and operating method thereof
KR102142535B1 (en) * 2018-05-04 2020-08-10 계명대학교 산학협력단 Game-based rehabilitation system combine functional electrical stimulation and brain-computer interface technique to maximize activation of mirror nerve cell and its control method
CN110537929B (en) * 2019-08-23 2022-11-04 杭州曼安智能科技有限公司 SSVEP-based attention assessment method, training method and brain-computer interface
RU2741215C1 (en) * 2020-02-07 2021-01-22 Общество с ограниченной ответственностью "АйТи Юниверс" Neurorehabilitation system and neurorehabilitation method
CN216535928U (en) * 2021-10-18 2022-05-17 广州医科大学附属第二医院 A constraint device that is used for single oxygen compression chamber to treat patient
US20240090810A1 (en) * 2022-09-21 2024-03-21 University Of Pittsburgh-Of The Commonwealth System Of Higher Education System and method for providing neurofeedback from steady-state visual evoked potentials to target affect-biased attention for treating therapeutic outcomes such as anxiety and depression

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120042252A (en) * 2010-10-25 2012-05-03 연세대학교 산학협력단 Rehabilitation training system with functional electrical stimulation based on steady-state visually evoked potentials
CN204855981U (en) * 2015-07-17 2015-12-09 无锡市精神卫生中心 Correction glasses are neglectd to unilateral
WO2019212150A1 (en) * 2018-05-04 2019-11-07 계명대학교 산학협력단 Gamified rehabilitation system combining brain stimulation maximizing mirror neuron activation and brain-computer interface (bci) technology, and control method thereof
CN113274032A (en) * 2021-04-29 2021-08-20 上海大学 Cerebral apoplexy rehabilitation training system and method based on SSVEP + MI brain-computer interface
CN114779980A (en) * 2022-06-17 2022-07-22 成都中医药大学 Cognitive perception unilateral neglect disorder training system, operation method and storage medium
CN118356580A (en) * 2024-05-14 2024-07-19 广州医科大学附属第二医院 Unilateral spatial neglect rehabilitation training method, device, equipment, and storage medium

Also Published As

Publication number Publication date
CN118356580A (en) 2024-07-19
CN118356580B (en) 2024-09-03

Similar Documents

Publication Publication Date Title
Pfurtscheller et al. 15 years of BCI research at Graz University of Technology: current projects
Trejo et al. Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials
WO2025236473A1 (en) Rehabilitation training method and apparatus for unilateral spatial neglect, device, and storage medium
CN105938397B (en) Mixing brain-computer interface method based on stable state of motion visual evoked potential Yu default stimuli responsive
CN112244774A (en) Brain-computer interface rehabilitation training system and method
CN101339455B (en) Brain-computer interface system based on the N170 component of the specific wave for face recognition
EP2111156A1 (en) A system and method for processing brain signals in a bci system
CN114469641B (en) Functional electrical stimulation mirror training method for movement disorders based on electromyography recognition
CN114173663A (en) Nerve rehabilitation system and nerve rehabilitation method
CN108958486A (en) Mood brain machine interface system based on recognition of face brain electricity N170 ingredient
Rahman et al. A blockchain-based non-invasive cyber-physical occupational therapy framework: BCI perspective
CN116088686A (en) Electroencephalogram tracing motor imagery brain-computer interface training method and system
CN113713333A (en) Dynamic virtual induction method and system for lower limb rehabilitation full training process
WO2023082972A1 (en) Visual enhancement method, apparatus and system based on flexible electrode probe
Wang et al. Relationship between pistol players' psychophysiological state and shot performance: Activation effect of EEG and HRV
KR102142535B1 (en) Game-based rehabilitation system combine functional electrical stimulation and brain-computer interface technique to maximize activation of mirror nerve cell and its control method
Smith Electroencephalograph based brain computer interfaces
WO2023278217A1 (en) Systems and methods for mental exercises and improved cognition
Zhang et al. ATVR: an attention training system using multitasking and neurofeedback on virtual reality platform
CN120340775A (en) A dynamic adaptive cognitive and mental health intervention system and method for the middle-aged and elderly
Guerrero-Mendez et al. Analysis of EEG rhythms during four-direction first-person reach-to-grasp kinesthetic motor imagery tasks from the same limb
CN114129850A (en) Training device for improving special attention of children
CN118538376A (en) Intelligent interaction method and system for autism teaching
WO2020139108A1 (en) Method for conducting cognitive examinations using a neuroimaging system and a feedback mechanism
CN116560491A (en) Brain-computer interface-based motion control method and related equipment