WO2015098155A1 - 操作教示装置および経頭蓋磁気刺激装置 - Google Patents
操作教示装置および経頭蓋磁気刺激装置 Download PDFInfo
- Publication number
- WO2015098155A1 WO2015098155A1 PCT/JP2014/067432 JP2014067432W WO2015098155A1 WO 2015098155 A1 WO2015098155 A1 WO 2015098155A1 JP 2014067432 W JP2014067432 W JP 2014067432W WO 2015098155 A1 WO2015098155 A1 WO 2015098155A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- subject
- head
- magnetic stimulation
- information
- dimensional shape
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N2/00—Magnetotherapy
- A61N2/004—Magnetotherapy specially adapted for a specific therapy
- A61N2/006—Magnetotherapy specially adapted for a specific therapy for magnetic stimulation of nerve tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
- A61B5/1077—Measuring of profiles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
- A61B5/1079—Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N2/00—Magnetotherapy
- A61N2/004—Magnetotherapy specially adapted for a specific therapy
- A61N2/008—Magnetotherapy specially adapted for a specific therapy for pain treatment or analgesia
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N2/00—Magnetotherapy
- A61N2/02—Magnetotherapy using magnetic fields produced by coils, including single turn loops or electromagnets
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30016—Brain
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30244—Camera pose
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/03—Recognition of patterns in medical or anatomical images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
Definitions
- the present invention relates to an operation teaching device and a transcranial magnetic stimulation device using such an operation teaching device.
- transcranial magnetic stimulation therapy In recent years, interest in transcranial magnetic stimulation therapy has increased as a treatment method for many patients with neurological diseases for which drug treatment is not always effective.
- treatment and / or alleviation of symptoms can be achieved by applying magnetic stimulation to a specific part of the brain (for example, nerve in the brain) by a magnetic field generation source placed on the scalp surface of the patient.
- a magnetic field generation source placed on the scalp surface of the patient.
- this is a relatively new treatment that is non-invasive and requires less burden on the patient. It is expected to spread.
- transcranial magnetic stimulation therapy As a specific method of such transcranial magnetic stimulation therapy, an electric current is passed through a coil located near the surface of the patient's scalp to locally generate a small pulsed magnetic field, and the principle of electromagnetic induction is used for intracranial A method is known in which an eddy current is generated in a brain to stimulate a nerve in the brain immediately below the coil (see, for example, Patent Document 1).
- Patent Document 1 it is confirmed that refractory neuropathic pain is effectively reduced by transcranial magnetic stimulation treatment performed by such a method, and more accurate local stimulation realizes a higher pain reduction effect.
- the optimal stimulation site varies slightly depending on the individual patient.
- transcranial magnetic stimulation therapy practitioners use the positioning function of the optical tracking system while referring to the three-dimensional information in the skull obtained by MRI images, It is possible to guide the treatment coil to accurately apply magnetic stimulation.
- infrared reflective markers are installed at a fixed position (for example, a bed on which a patient lies) associated with a patient's head and a treatment coil.
- the current position of the treatment coil is estimated from the positional relationship between the two obtained by detecting these markers, and the optimal stimulation site on the patient's head is referred to while referring to the three-dimensional information in the skull obtained from the MRI image.
- the treatment coil is guided. Accordingly, accurate alignment between the patient's head and the MRI image is required. For this reason, accurate alignment with the MRI image is performed by designating eyes, ears, nose, and the like using a calibration marker while the patient's head is fixed to the bed.
- the transcranial magnetic stimulation device including the above-described conventional coil positioning device or system is generally assumed to be used in a relatively large hospital or research institution where skilled specialists are present. And the operation is complicated and skill is required to use. For this reason, it is generally difficult for a patient, their family, or a nearby doctor who is not necessarily specialized to operate and treat. Therefore, patients who undergo transcranial magnetic stimulation therapy must either go to a large hospital with specialized doctors who are skilled at each treatment or be hospitalized, and continue to receive treatment repeatedly. However, the actual situation was that a large burden was imposed on various aspects.
- the present invention reduces the burden on the patient due to head restraint when performing transcranial magnetic stimulation therapy, and also provides an operation teaching device useful for simplifying handling and operation, and such operation.
- the basic object of the present invention is to provide a transcranial magnetic stimulation device using a teaching device.
- the operation teaching device is an operation teaching device used for operation teaching when performing an operation of moving and / or rotating an object in order to adjust to a predetermined position and direction.
- a TOF (time-of-flight) distance image camera means for obtaining three-dimensional shape information of the object, and
- a light receiving intensity of the light received by the light receiving means received by the reflected light reflected from the object is an operation teaching device used for operation teaching when performing an operation of moving and / or rotating an object in order to adjust to a predetermined position and direction.
- Extraction means for extracting a characteristic region from the three-dimensional shape information using a luminance image of the target object obtained from the information; and (c) the target object at the predetermined position and direction.
- Generating means for calculating a deviation between the three-dimensional shape information and the three-dimensional shape information including the feature region of the object at the current position and direction, and generating information for the operation teaching; It is characterized by having.
- the operation teaching apparatus is (a) receiving light from a light emitting means through reflection by the object in each pixel of a photographed image obtained by irradiating the surface of the object with projection light.
- TOF time-of-flight
- range image configured to obtain three-dimensional shape information of the target object from information on the propagation distance of the projection light reaching the means, and to be able to move and / or rotate.
- Camera means (b) with respect to the distance image camera; (A) the three-dimensional shape information of the object at a relatively predetermined position and direction; and (B) the current position and direction.
- a first indicator indicating the predetermined relative position and direction
- the current relative based on the three-dimensional shape information of the object in Is an index indicating the target position and relative direction.
- a transcranial magnetic stimulation apparatus is a transcranial magnetic stimulation apparatus for applying a magnetic stimulation to a specific part in a subject's head using a magnetic field generating means outside the head.
- the three-dimensional shape information of the subject's head is obtained from the information on the propagation distance of the projection light from the light emitting means to the light receiving means after being reflected by the surface of the subject's head.
- the characteristic region is preferably a nose region or an ear region of the subject.
- a transcranial magnetic stimulation device is a transcranial magnetic stimulation device for applying magnetic stimulation to a specific part in a subject's head using magnetic field generation means outside the head.
- a light emitting means provided in each pixel of a captured image provided integrally with the magnetic field generating means and capable of moving and / or rotating and irradiating the surface of the subject's head with projection light
- a distance-of-flight (TOF) distance image camera that obtains three-dimensional shape information of the subject's head from information on the propagation distance of the projection light that reaches the light receiving means through reflection from the surface of the subject's head
- TOF distance-of-flight
- the operation teaching apparatus by using the TOF type distance image camera means, the three-dimensional shape information of the object can be obtained in real time, and the extraction means is provided. Thus, a characteristic region can be extracted from the three-dimensional shape information. Then, by providing the generation means, the three-dimensional shape information including the feature region of the object at a predetermined position and direction, and the feature region of the object at the current position and direction. Deviations from the included three-dimensional shape information can be calculated to generate information for the operation teaching.
- the object can be easily and reliably adjusted to a predetermined position and direction by a simple operation of moving and / or rotating the object. Further, since the deviation of the three-dimensional shape information including the feature region extracted by the extracting means is calculated, information for operation teaching can be obtained at a relatively high speed.
- the three-dimensional shape information of the object can be obtained in real time by using the TOF type distance image camera means.
- the person who operates can intuitively know in which direction the object of the moving operation should be moved from the display of the first index and the second index. Can be operated easily.
- the three-dimensional shape information of the subject's head can be obtained in real time by using the TOF type distance image camera means.
- the TOF type distance image camera means and the magnetic field generating means are integral and can move and / or rotate, the relative relationship between the position and direction between them is always unchanged, and the position and direction are changed again. There is no need to match.
- a characteristic region can be extracted from the three-dimensional shape information of the subject's head.
- the generating means by providing the generating means, the three-dimensional shape information including the feature region of the subject head at the position and direction of performing magnetic stimulation on the specific part in the subject head, and the current position Teaching to change the relative position and direction of the magnetic field generating means and the subject head by calculating a deviation from the three-dimensional shape information including the feature region of the subject head in the direction Information can be generated. Therefore, in order to guide the magnetic field generating means outside the head to a position and direction corresponding to a specific part in the subject's head, an operation of relative movement and / or rotation between the magnetic field generating means and the subject's head.
- the magnetic field generating means and the subject's head are moved according to the information for operation teaching.
- the magnetic field generating means can be easily and reliably adjusted to the relative position and direction corresponding to the specific part of the subject's head by a simple operation that is relatively moved and / or rotated. Thereby, when performing transcranial magnetic stimulation therapy, the test subject's burden by head restraint can be reduced. Further, since the deviation of the three-dimensional shape information including the characteristic area extracted by the extracting means is calculated, information for operation teaching can be obtained at a relatively high speed.
- the user of the apparatus has a special skill as in the prior art only by relatively moving and / or rotating the magnetic field generating means and the subject's head according to the information for the operation instruction. It is possible to perform a required operation without the need for performance. That is, the subject or his / her family or a nearby doctor who is not necessarily specialized can be operated and used relatively easily. In addition, since it is not necessary to use a large-scale and expensive device as in the past, the cost burden is small, and it is easy to secure installation space at the subject's individual home or at a relatively small clinic or clinic. . As described above, according to the present invention, it is possible to provide a magnetic stimulation device that is simple and easy to handle and operate, and that is smaller and less expensive. Thus, the subject can perform daily activities at home or in a nearby clinic. Thus, it is possible to perform transcranial magnetic stimulation therapy continuously and repeatedly.
- a characteristic region extracted from the three-dimensional shape information of the subject's head can be extracted from the subject's nose region or ear region, so that a particularly characteristic region can be extracted from the face shape of the subject's head. It is possible to increase the accuracy of the deviation calculation by the generating means.
- the three-dimensional shape information of the subject's head can be obtained in real time by using the TOF type distance image camera means.
- the TOF type distance image camera means and the magnetic field generating means are integral and can move and / or rotate, the relative relationship between the position and direction between them is always unchanged, and the position and direction are changed again. There is no need to match.
- the person who performs the operation can move the subject of the moving operation such as the subject's head or the TOF distance image camera means in any direction from the display of the first index and the second index.
- the magnetic field generating means When the magnetic field generating means is deviated from the relative position and direction corresponding to the specific part of the subject's head, the magnetic field generating means and the display according to the display of the first index and the second index
- the magnetic field generating means can be easily and surely adjusted to the relative position and direction corresponding to the specific part of the subject's head by a simple operation that only moves and / or rotates relative to the subject's head. Can do. Thereby, when performing transcranial magnetic stimulation therapy, the test subject's burden by head restraint can be reduced.
- the user of the apparatus simply moves and / or rotates the magnetic field generating means and the subject's head according to the display of the first index and the second index. Thus, a required operation can be performed without requiring special skill.
- the subject or his / her family or a nearby doctor who is not necessarily specialized can be operated and used relatively easily.
- the cost burden is small, and it is easy to secure installation space at the subject's individual home or at a relatively small clinic or clinic.
- the subject can perform daily activities at home or in a nearby clinic.
- FIG. 1 is a schematic configuration diagram of a transcranial magnetic stimulation device according to an embodiment of the present invention.
- 3 is a flowchart for explaining a process of acquiring alignment data in a “correct posture” before performing magnetic stimulation treatment by the apparatus of FIG. 1. It is a flowchart for demonstrating the flow of the magnetic stimulation treatment performed using the apparatus of FIG. It is a figure which shows an example of the surface shape data measured with the TOF camera with which the apparatus of FIG. 1 is provided. It is a figure which shows an example of the face shape data extracted from the surface shape data of FIG.
- FIG. 6 is a diagram illustrating an example of alignment data in a “correct posture” extracted from the face shape data of FIG. 5. It is a figure which shows an example of the data for alignment in "current attitude
- FIG. 1 It is a figure which shows the nose area
- FIG. 1 is an explanatory diagram schematically showing the outline of the configuration of the transcranial magnetic stimulation apparatus according to the present embodiment.
- the transcranial magnetic stimulation apparatus 1 is for performing treatment by applying magnetic stimulation to a specific site (optimal stimulation site) in the head 2h of the subject 2.
- a transcranial magnetic stimulation device 1 (hereinafter simply referred to as “device” as appropriate) has an image monitor unit 10, a device body unit 20, and a magnetic stimulation coil 30 (hereinafter referred to as “device”) as its main components.
- a “treatment coil” or simply abbreviated as “coil”), a TOF camera 40 and a helmet 50 are provided.
- the TOF camera 40 is a TOF (time-of-flight) distance image camera, and the object from the light-emitting means in each pixel of a photographed image obtained by irradiating the surface of the object with projection light.
- the three-dimensional shape information of the object can be obtained from the information of the propagation distance of the projection light that reaches the light receiving means through reflection by the object surface.
- the TOF camera 40 measures the distance to all objects in the field of view, that is, the surface shape of the object reflected in the camera field of view, by measuring the time until the projected light is reflected back to the object and returns. It is a camera that can be acquired in real time, and the measured surface shape data is output as point cloud data.
- MESA Imaging, Inc. of Zurich, Switzerland has introduced a device named “SR4000” in the market.
- a subject to be measured is photographed by an imaging means using a solid-state imaging device such as a CCD, and light projected from the light projecting means to the subject is reflected to each pixel of the solid-state imaging device ( The time from the projection until reaching the pixel is detected by the light phase difference between the projection light and the pixel arrival light, and as a result, within each pixel in the imaging screen The distance of the subject point imaged on is calculated.
- the three-dimensional shape of the object surface can be measured in real time even at a short distance.
- the three-dimensional shape of the surface of the object can be obtained in real time, and at the same time, a reflected luminance image can be obtained in real time from the information on the received light intensity received by the light receiving means for the projection light reflected from the surface of the object.
- the TOF camera 40 is fixed to one end of a holding arm 52 having predetermined strength and rigidity, and the other end of the holding arm 52 is fixed to the helmet 50. That is, the TOF camera 40 is integrally fixed to the helmet 50 via the holding arm 52. Further, the magnetic stimulation coil 30 is also integrally fixed at a predetermined location on the surface of the helmet 50. Therefore, when the helmet 50 moves, the magnetic stimulation coil 30 and the TOF camera 40 move together, and the relative relationship between the position and direction between the both 30 and 40 is always constant.
- the optimal stimulation site of the subject head 2h and the magnetic stimulation coil 30 depend on the wearing condition (that is, the posture of the helmet 50 attached to the head 2h).
- the relative relationship between the position and direction (with the TOF camera 40) is determined. Accordingly, the subject 2 can adjust the relative position and direction (of the TOF camera 40) of the magnetic stimulation coil 30 corresponding to the optimal stimulation site of the subject head 2h by adjusting the wearing state of the helmet 50. .
- the position between the TOF camera 40 and the face of the subject 2 is determined from the measured face shape.
- the relative relationship of directions can be estimated.
- the relative relationship between the position and the direction represents the wearing posture of the subject 2 wearing the helmet 50.
- the magnetic stimulation coil 30 is fixed at a specific position of the helmet 50, and the relative relationship between the position and direction between the magnetic stimulation coil 30 and the TOF camera 40 is always constant.
- the wearing posture of the TOF camera 40 and the helmet 50 for obtaining the position and direction of the face of the subject 2 when the magnetic stimulation coil 30 stimulates the correct portion (optimum stimulation portion) of the brain of the subject 2 is defined as “correct posture”. Record the correct posture.
- the current wearing posture of the helmet 50 representing the relative relationship between the position and direction between the TOF camera 40 and the face of the subject 2 is measured as the “current posture”. To do. Then, as will be described later, the distance between the “correct posture” and the “current posture” is calculated, and if this distance exceeds the specified range, the TOF camera 40 and the subject 2 are not subjected to magnetic stimulation treatment. The direction to be changed is indicated on the monitor screen 12 of the image monitor unit 10 with respect to the relative relationship between the position and the posture of the image monitor unit 10.
- Subject 2 follows the instructions on monitor screen 12 and adjusts the degree of wearing of helmet 50 to change the relative relationship between the position and direction between TOF camera 40 and subject 2, and measures the “current posture” again. To do. By repeating this operation until the distance between the “correct posture” and the “current posture” becomes a value within the specified range, the magnetic stimulation coil 30 can be guided to the correct position.
- the image monitor unit 10 includes a monitor screen 12 such as a CRT screen or a liquid crystal screen, and has a function of displaying image information.
- a monitor screen 12 such as a CRT screen or a liquid crystal screen
- an image display unit of a personal computer may be used.
- the monitor screen 12 of the image monitor unit 10 is connected to the face of the TOF camera 40 and the subject 2.
- the direction to be changed is displayed with respect to the relative relationship between the position and the posture.
- the practitioner (not shown) of the magnetic stimulation treatment is watching the display on the monitor screen 12 so that the distance between the “correct posture” and the “current posture” is within the specified range.
- An appropriate magnetic stimulation treatment is performed after adjusting the relative relationship between the position and the direction of the face.
- the apparatus main body unit 20 is configured to hold the following components integrally or partly separately, and each held configuration includes the following. Each of these components is divided into a plurality of components for convenience of explanation. Needless to say, these components may be realized as execution software installed in a personal computer.
- the image display control unit 21 included in the apparatus main body unit 20 performs display control of various images to be displayed on the image monitor unit 10 based on an input from the teaching information generation unit 23 or the like.
- the magnetic stimulation coil control unit 22 controls on / off of the magnetic flux generation current applied to the magnetic stimulation coil 30 and the current.
- the magnetic stimulation coil 30 is applied close to the optimal stimulation site in the subject's head 2h, and the magnetic stimulation coil control unit 22 is operated by operating an operation unit (not shown) to apply a magnetic flux having a predetermined strength.
- an induced current can be generated in the brain of the subject's head 2h, and magnetic stimulation treatment can be performed to apply magnetic stimulation to the optimal stimulation site.
- the teaching information generating unit 23 holds the alignment data based on the face shape data acquired in advance in the “correct posture” so that it can be read out. This “positioning data” will be described later.
- the face shape data in this “correct posture” and the alignment data based on the face shape data are stored in a readable manner in a memory device attached to the teaching information control unit 23 or attached to the outside of the apparatus main unit 20. May be.
- face shape data in the “current posture” is input to the teaching information generation unit 23 from the TOF camera 40, and alignment data is acquired based on the face shape data in the “current posture”.
- the alignment data in the “current posture” and the alignment data in the “correct posture” are aligned, and the distance between the “correct posture” and the “current posture”. Is calculated. If the distance exceeds the specified range, the distance between the “correct posture” and the “current posture” regarding the relative relationship between the position and direction between the TOF camera 40 and the face of the subject 2 is Teaching information for teaching the direction to be changed is generated so as to be within the specified range, and the teaching information data is output to the image monitor unit 10.
- the above-described image display control unit 21, magnetic stimulation coil control unit 22, and teaching information generation unit 23 are each configured with necessary control circuits, arithmetic circuits, and the like.
- the control by the apparatus may be realized as execution software installed in a personal computer.
- the apparatus is recorded by a programmed computer or recorded on a recording medium.
- the computer that reads and executes the program executes necessary control and calculation for control described later.
- a program for executing necessary control and calculation to be described later using a computer, and further, at least a part of data necessary for such control and calculation are linked to be communicable with the apparatus, for example.
- the computer is used to perform necessary control and computation by downloading necessary programs and data each time in response to a request from the device side. You can also.
- the basic operation of the transcranial magnetic stimulation apparatus 1 having the configuration shown in FIG. 1 will be specifically described.
- the procedure and method for processing data such as a specific calculation method for image processing will be mainly described. Therefore, the functions of the components of the apparatus 1 described above with reference to FIG. It may not be directly mentioned as an action. However, even in that case, since the functions and operations described here are realized as the functions and operations of the transcranial magnetic stimulation apparatus 1 shown in FIG. 1, it is easy to determine which configuration of the apparatus 1 corresponds. It can be specified.
- FIG. 2 is a flowchart for explaining a process of acquiring alignment data in the “correct posture”. This step is preferably performed, for example, at the time of initial medical care performed by a specialized doctor or the like in a hospital.
- step # 13 the TOF camera 40 is operated via the teaching information generation unit 23 by a trigger input from the doctor (switch not shown: ON).
- the face shape data at that time is measured (step # 14).
- the TOF camera is a camera that can measure the surface shape data of an object in the field of view in real time, and the measured surface shape data is output as point cloud data, for example, as shown in FIG.
- the point cloud data thus obtained includes data other than the object such as the background and noise. For this reason, masking using distance information and reliability information of camera sensitivity and noise removal by time averaging of data are performed. By these processes, for example, data of only the face shape as shown in FIG. 5 can be extracted.
- position alignment data for performing alignment with the above “current posture” is acquired (step # 15).
- an ICP algorithm (a method for obtaining a rigid transformation parameter that minimizes the distance between corresponding points by iterative calculation, as will be described later), is how much the “correct posture” differs from the “current posture”. )
- the face shape data acquired in step # 14 is used as it is, it takes a long time to calculate because the number of data is too large. There is a problem that it is easy to fall into a solution.
- the nose and its surrounding area (hereinafter referred to as “nose area”), which is a particularly characteristic area in the face, are used as characteristic areas, and the face shape data obtained in step # 14. Only the shape data of the nose region, which is a characteristic region, is extracted, and the extracted shape data of the nose region is acquired as alignment data in the “correct posture”.
- An example of the alignment data is shown in FIG.
- a characteristic region may be an ear and its peripheral region (hereinafter referred to as “ear region”).
- the alignment data in the “correct posture” obtained in this way is stored in a readable manner in the teaching information control unit 23, a memory device attached thereto, or a memory device attached outside the device main unit 20. (Step # 16), the process of acquiring the alignment data in the “correct posture” ends.
- the shape data of the nose region when only the shape data of the nose region is extracted from the face shape data of the subject 2, it is automatically extracted using the face recognition function implemented by OpenCV, which is an image processing library.
- OpenCV which is an image processing library.
- the TOF camera 40 can obtain a three-dimensional surface shape in real time and a monochrome reflected luminance image in real time. By performing face recognition processing on this reflected luminance image, the nose region can be detected as shown in FIG. Thereafter, a process of extracting only the area surrounded by the circle in FIG. 8 is performed on the face shape point group in FIG. 5, and point cloud data in which only the nose peripheral area is extracted as shown in FIG. 9 is obtained. be able to.
- ICP Intelligent Closest Point Algorithm
- the ICP algorithm is a method proposed by Besl et al. In 1992 (PJ Besl and ND McKay: “A Method for Registration of 3-D Shapes”, IEEE Trans. Pattern Anal. Int. vol. 14, No. 2, pp. 239-256 (1992-2)), which is a technique for obtaining a rigid transformation parameter that minimizes the distance between corresponding points by iterative calculation. It is possible to match points of unknown points with high accuracy.
- the ICP algorithm is implemented using the function of the software library VTK (Visualization Tool Kit), and the following rotation matrix R and translation vector t are obtained as rigid body transformation parameters by executing the ICP algorithm. .
- VTK Visualization Tool Kit
- the ICP algorithm by aligning the nose region shape point group measured at the time of the “correct posture” and the nose region shape point group measured at the “current posture”, the “correct posture” and the “current posture” How much the “posture” is different (deviation) is calculated.
- a translation parameter (rigid transformation parameter) of the translation vector t and the rotation matrix R that indicates how much the point cloud of the “current posture” is moved to match the point cloud of the “correct posture”. It can be done.
- the rigid body transformation parameters obtained here represent how much the “current posture” and “correct posture” are misaligned. Therefore, in order to bring the “current posture” closer to the “correct posture” from the obtained rigid body transformation parameters, the direction to be changed in the relative relationship between the position and the direction between the TOF camera 40 and the face of the subject 2. Is calculated and displayed on the monitor screen 12 of the image monitor unit 10, for example, as shown in FIG.
- the red circle C1 corresponds to the TOF camera 40
- the green circle C2 corresponds to the face (characteristic region) of the subject 2
- a line segment L12 connecting both C1 and C2 Indicates the directions to be moved with respect to each other. Accordingly, the relative relationship between the position and direction between the TOF camera 40 and the face of the subject 2 is set so that the line segment L12 in the monitor screen 12 is shortened and finally the two circles C1 and C2 overlap. That is, it is only necessary to change the wearing posture of the helmet 50.
- Equation 1 The Euclidean distance d between the two points r 1 and r 2 in the three-dimensional space can be expressed as the following equation (Equation 1).
- a distance d (a i , B) between each point a i of the point group A and the point group B is obtained.
- the alignment rigid body transformation parameters can be obtained by the following procedure.
- (I) The closest point m i with the point group B at each point a i of the point group A is obtained.
- (Ii) A rigid transformation parameter that minimizes the error E is obtained.
- (Iii) The point group A is converted using the obtained parameters (R, t).
- (Iv) If the error E is less than or equal to the threshold value, the iterative calculation is terminated. In other cases, the process returns to (i) and the same steps are repeated.
- the above-described rigid body transformation parameter determination method is merely an example, and the point where the distance is the minimum and the error calculation method shown in Equation 4 are converted to another method. It is possible. Any other method may be used as long as the degree of coincidence of the position and orientation (6 degrees of freedom) of the rigid body in the three-dimensional space, that is, the magnitude of the error can be evaluated numerically. The same applies to the following description.
- This magnetic stimulation treatment can also be performed as a home treatment performed by the subject 2 himself or his family at home.
- the alignment data for the “correct posture” obtained in the process described in the flowchart of FIG. 2 is provided in or attached to the teaching information control unit 23 of the transcranial magnetic stimulation apparatus 1. It is assumed that the data is stored in a readable manner in a memory device or a memory device attached outside the device main unit 20.
- the subject 2 wears the helmet 50 in Step # 21, and then in Step # 22, the face shape data in the wearing state (that is, in the “current posture”) is obtained. It is measured.
- the measurement of the face shape data in the “current posture” is performed in the same manner as the measurement of the face shape data in the “correct posture” performed in step # 14 of FIG.
- the surface shape data (point cloud data) measured by the TOF camera is subjected to masking using distance information and reliability information of camera sensitivity and noise removal processing based on the time average of the data to extract only face shape data.
- the alignment data for performing the alignment with the above-mentioned “correct posture” is acquired (step # 23).
- the acquisition of the alignment data in the “current posture” is performed in the same manner as the acquisition of the alignment data in the “correct posture” performed in step # 15 in FIG. That is, only the shape data of the nose region, which is a characteristic region, is extracted from the face shape data obtained in step # 22, and the extracted shape data of the nose region is acquired as alignment data for the “current posture”. .
- An example of the alignment data in the “current posture” is shown in FIG.
- the “correct posture” read from the memory device in the teaching information control unit 23 or attached thereto, or the memory device attached outside the device main unit 20 or the like. are aligned with the alignment data for the “current posture” (step # 24). That is, the distance between the “correct posture” and the “current posture” is calculated (step # 25), and it is determined whether or not the calculated distance is equal to or less than a specified value (step # 26). When the calculated distance exceeds the specified value (step # 26: NO), the relative relationship between the position and direction between the TOF camera 40 and the face of the subject 2 is changed without performing magnetic stimulation treatment. The power direction is indicated on the monitor screen 12 of the image monitor unit 10 (step # 27).
- the position of the TOF camera 40 in the current posture as seen from a certain point on the head 2h is indicated by a red circle C1, for example, and the position of the TOF camera 40 in the correct posture as seen from the same point on the head of the subject 2 is also shown.
- a green circle C2 is indicated by a green circle C2 (see FIG. 10).
- the direction of the line segment L12 connecting the two indexes C1 and C2 is the moving direction in which the relative position of the face of the TOF camera 40 and the subject 2 should be moved in order to bring the “current posture” closer to the “correct posture”.
- the length of the line segment L12 indicates the movement distance to be moved.
- the reason why the two indices C1 and C2 are displayed in a circle is that the position of the TOF camera 40 in the three-dimensional space is expressed. That is, when the TOF camera 40 is close to the head 2h of the subject 2, for example, the circles of the indicators C1 and C2 are also displayed large. If the TOF camera 40 (or the helmet 50 to which the TOF camera 40 is integrally fixed) is adjusted by shifting it in the front-rear direction, etc., the two indicators C1 and C2 will have the same size, depending on the position of the alignment. As a result, the position of the TOF camera in the “current posture” can be matched with the position of the TOF camera 40 in the “correct posture”.
- the specific operation of the alignment is that the head 2h of the subject 2 is stopped at the current position, the index C2 is moved, and the TOF camera 40 (in other words, the helmet) is displayed so that the size of the index C1 overlaps with the index C1. 50) is carried out.
- the helmet 50 integrated with the TOF camera 40 is stopped at the current position and the face (head) of the subject 2 is moved, the index C1 can be brought closer to the index C2.
- the red circle C1 in the display screen moves with the movement of the face.
- the face is moved so that the red circle C1 moves and approaches the green circle C2.
- the red circle C1 in the display screen moves in the same manner as the TOF camera 40 moves, so that the red line on the line segment L12 is also displayed.
- the operation is performed so that the circle C1 moves and approaches the green circle C2.
- these operations may be used in combination.
- the green circle C2 corresponding to the “correct posture” is displayed in the center of the display screen 12 in this embodiment, while the red circle C1 corresponding to the “current posture” is the TOF camera viewed from the subject 2.
- the position and direction of 40 the position and size of the display on the screen 12 change, and when the “current posture” matches the “correct posture”, the circle C1 is located at the center of the screen 12 like the circle C2. Since the display is performed, the display method (mode) of the circle C1 is changed by changing the relative position and direction of the current TOF camera 40 and the face, so that the display position and the display size in the screen 12 are changed. Will change. Further, when the “current posture” approaches the “correct posture” in accordance with the movement operation, the display position and display size in the screen 12 which is the display mode of the circle C1 approaches the circle C2.
- the display color and shape of the indicator C1 may approach the indicator C2.
- the operation teaching is not limited to the screen display, but may be performed by other transmission means such as voice.
- the “movement” used above is an operation of changing the relative position and direction of the face of the subject 2 and the TOF camera 40, that is, either or both of the face of the subject 2 and the TOF camera 40, It is used including position movement and rotation operations.
- the subject 2 or his / her family member, etc. has the TOF camera 40 and the subject 2 face so that the line segment L12 in the monitor screen 12 is shortened and the two circles C1 and C2 are finally overlapped.
- the relative relationship between the position and the direction between them that is, how the helmet 50 is worn) is changed.
- the circle C1 and the circle C2 are finally overlapped so as to be in the “correct posture”.
- a mode of displaying “correct answer posture” may be used.
- step # 28 the data in the “current posture” is measured again.
- step # 26 the distance between the “correct posture” and the “current posture” is equal to or less than a specified value (step # 26: YES)
- step # 26 when the distance between the “correct posture” and the “current posture” is equal to or less than a specified value (step # 26: YES) and the magnetic stimulation coil 30 is guided to the correct position, as shown in FIG.
- a specified value for example, a single yellow circle C3 indicating the end of the guiding process is displayed, and the guiding process ends (step # 29).
- magnetic stimulation treatment is performed with the magnetic stimulation coil 30 guided to the correct position and direction (step # 30). That is, the subject 2 himself or his family activates the magnetic stimulation coil control unit 22 to apply a magnetic flux having a predetermined intensity from the magnetic stimulation coil 30 to generate an induced current in the brain of the head 2 h of the subject 2. And apply magnetic stimulation to the optimal stimulation site.
- the transcranial magnetic therapy apparatus 1 Since the transcranial magnetic therapy apparatus 1 according to the embodiment of the present invention performs the operation teaching as described above, the person who performs the operation moves the subject 2 and the object to be moved such as the TOF camera 40 in which direction. Since it can be intuitively grasped from the display screen 12 whether it should be moved, the operation becomes easy, and the barrier when the transcranial magnetic stimulation apparatus 1 is used for treatment at home or in a practitioner's outpatient is small and spreads widely. Is effective.
- Step # 31: NO the magnetic stimulation treatment is continuously performed and the magnetic stimulation treatment is completed.
- Step # 31: YES the operation of the device 1 is stopped.
- the three-dimensional shape information of the subject's head 2h can be obtained in real time.
- the TOF camera 40 and the magnetic stimulation coil 30 are integral and can move and / or rotate, the relative relationship between the positions and directions of the 40 and 30 is always unchanged. There is no need to match.
- a characteristic region (for example, nose region) of the face shape is extracted from the three-dimensional shape information of the subject's head 2h, and alignment data for the “correct posture” and “current posture” is acquired. Based on this, the deviation between the “correct posture” and the “current posture” is calculated, teaching information for changing the relative position and direction between the magnetic stimulation coil 30 and the subject head 2h is generated, and the image monitor It can be displayed on the monitor screen 12 of the unit 10.
- the burden of the test subject 2 by head restraint can be reduced.
- the characteristic area of the face shape is extracted from the 3D shape information of the subject's head 2h and the deviation of the 3D shape information is calculated, information for operation teaching can be obtained at a relatively high speed.
- the user of the device 1 adjusts the wearing posture of the helmet 50 in accordance with the operation teaching information displayed on the monitor screen 12 so that the magnetic stimulation coil 30 and the subject head 2h are relatively positioned. It is possible to perform a required operation only by moving and / or rotating to a position without requiring special skill as in the prior art. That is, the subject 2 or his / her family or a nearby doctor who is not necessarily specialized can be operated and used relatively easily. In addition, since it is not necessary to use a large-scale and expensive device as in the past, the cost burden is small, and it is easy to secure installation space at the subject's individual home or at a relatively small clinic or clinic. . As described above, according to the present invention, it is possible to provide a transcranial magnetic stimulation apparatus 1 that is easy to handle and operate, and that is smaller and less expensive. Transcranial magnetic stimulation therapy can be performed continuously and repeatedly at a clinic or the like.
- FIG. 14 is a schematic configuration diagram showing an experimental apparatus used for this accuracy evaluation.
- FIG. 15 is an enlarged view showing a part of FIG.
- a straight holding rod 61 is fixed to the top of the helmet 50, and this fixed portion is coupled to the terminal portion of the arm-shaped support member 65. That is, the entire helmet 50 and the holding rod 61 are supported by the support member 65.
- a TOF camera 40 is attached to one side of the holding rod 61 (the front side of the subject 2) via a joint 62 that can be slid along the rod 61 and an articulated holding arm 63. That is, the TOF camera 40 is integrally fixed to the helmet 50 via the holding arm 63, the joint 62, and the holding rod 61.
- a weight (balancer) 64 is attached to the other side of the holding rod 61 (the back side of the subject 2) in order to balance the weight of the TOF camera 40.
- the TOF camera 40 includes a light receiving unit 42 at the center of the front surface thereof, and a plurality of light emitting units 44 are provided around the light receiving unit 42.
- the TOF camera 40 used in the apparatus 1 shown in FIG. 1 has the same configuration.
- the image monitor unit 10 and the apparatus main body unit 20 are depicted as separate bodies. However, as shown in FIG. 10 and 20 are preferably integrated to form a so-called personal computer (PC) 70.
- PC personal computer
- the transcranial magnetic stimulation apparatus 1 becomes compact, requires a small installation space, and is more suitable for use at home.
- the TOF camera 40 is connected to the apparatus main unit 20 of the personal computer 70 so as to be able to exchange signals.
- Polaris Vira manufactured by NDI was used in order to accurately measure the relative position and posture relationship between the subject 2 and the helmet 50.
- the Polaris system is a high-performance optical 3D measurement system that can measure the three-dimensional position of the infrared reflective marker with high accuracy.
- polaris markers 68 and 69 were attached to the subject 2 and the helmet 50, respectively, and the accuracy of guidance was examined from the relationship between the relative positions and postures of the two markers 68 and 69.
- the subject 2 is put on the helmet 50 and the “correct posture” is set.
- this “correct posture” the shape of the nose region of the subject 2 is measured with the TOF camera 40, and the relationship between the relative positions and directions of the polaris markers 68 and 69 is measured with Polaris.
- the subject 2 puts on the helmet 50 again and performs the same measurement on the “current posture”.
- the face of the subject 2 and the camera are moved until the “current posture” matches the “correct posture”.
- the positional relationship between the markers after the guidance is completed is measured by Polaris.
- Such a trial is repeated 10 times, and the distance between the two polaris markers 68 and 69 and the change angle of the direction are measured.
- the wearing posture of the subject 2 and the helmet 50 after the guidance is “ The accuracy was evaluated based on whether or not it was within the target range compared to the “correct posture”.
- the effective accuracy when performing magnetic stimulation treatment is about 6 mm in diameter inside the skull, and the posture change angle when performing magnetic stimulation is about 5 degrees. Therefore, the target accuracy is set such that the distance error is 6 mm or less and the angle error is 5 degrees or less.
- the experimental results are shown in FIG. 16 (distance between markers) and FIG. 17 (posture change angle between markers). As can be seen from these graphs, the distance error and the angle error are both within the target accuracy (6 mm diameter and 5 degrees) throughout the trial. The distance error was 1.54 mm on average and 1.40 standard deviation. Further, the angle error was an average of 2.04 degrees and a standard deviation of 1.02 degrees.
- the above explanation was all about the case where the magnetic stimulation coil is used for transcranial magnetic stimulation therapy to relieve neuropathic pain by applying magnetic stimulation to the brain nerve of the subject.
- the invention is not limited to such a case, and can be effectively applied to other magnetic stimulation applications.
- the present invention reduces the burden on the patient due to head restraint when performing transcranial magnetic stimulation therapy, and uses the operation teaching device as an operation teaching device useful for simplifying handling and operation.
- the transcranial magnetic stimulation device can be effectively used.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Theoretical Computer Science (AREA)
- Medical Informatics (AREA)
- Multimedia (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Surgery (AREA)
- Molecular Biology (AREA)
- Heart & Thoracic Surgery (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Dentistry (AREA)
- Medicinal Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Hospice & Palliative Care (AREA)
- Pain & Pain Management (AREA)
- Neurology (AREA)
- Remote Sensing (AREA)
- Mathematical Optimization (AREA)
- Algebra (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Radar, Positioning & Navigation (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
Abstract
Description
この特許文献1においては、かかる方法で施した経頭蓋磁気刺激治療により難治性の神経障害性疼痛が有効に軽減され、更に、より正確な局所刺激がより高い疼痛軽減効果を実現することが確認されている。但し、最適刺激部位は個々の患者によって微妙に異なることも明らかにされている。
かかる治療用コイルの位置決めについては、例えば赤外線を用いた光学式トラッキングシステムを利用して患者頭部に対する治療用コイルの位置決めを行う構成のものが公知であり(例えば、特許文献2,3参照)、既に一部には市販され臨床応用されている。
従って、経頭蓋磁気刺激治療を受ける患者は、やはり、治療の度に熟練した専門医師等が居る大規模な病院まで通うか、若しくは入院せざるを得ず、継続反復して治療を受けるためには、様々な面で大きな負担が強いられるのが実情であった。
従って、予め定められた位置及び方向に合わせるために、対象物の移動及び/又は回転の操作を行うに際して、対象物が予め定められた位置及び方向からずれた場合でも、前記操作教示のための情報に従って、対象物を移動及び/又は回転操作するだけの簡単な操作で、対象物を容易かつ確実に予め定められた位置及び方向に合わせることができる。また、抽出手段によって抽出した特徴領域を含む3次元形状情報の偏差を算出するので、比較的高速で操作教示のための情報を得ることができる。
従って、頭部外にある磁場発生手段を被験者頭部内にある特定部位に対応した位置及び方向に導くために、前記磁場発生手段と被験者頭部との相対的な移動及び/又は回転の操作を行うに際して、前記磁場発生手段が被験者頭部の前記特定部位に対応した相対的な位置及び方向からずれた場合でも、前記操作教示のための情報に従って、前記磁場発生手段と被験者頭部とを相対的に移動及び/又は回転させるだけの簡単な操作で、前記磁場発生手段を被験者頭部の前記特定部位に対応した相対的な位置及び方向に、容易かつ確実に合わせることができる。これにより、経頭蓋磁気刺激療法を実施するに際して、頭部拘束による被験者の負担を軽減することができる。また、抽出手段によって抽出した特徴的領域を含む3次元形状情報の偏差を算出するので、比較的高速で操作教示のための情報を得ることができる。
以上のように、当該装置の使用者は、前記操作教示のための情報に従って、前記磁場発生手段と被験者頭部とを相対的に移動及び/又は回転させるだけで、従来のように特別な熟練性を要することもなく、所要の操作を行うことができる。つまり、被験者あるいはその家族、又は必ずしも専門ではない近所のかかりつけの医師などでも、比較的容易に操作して使用することができる。また、従来のような大掛かりで高価な装置を用いる必要がないので、コスト負担が小さくて済み、しかも被験者個人の自宅や比較的小規模な医院や診療所等でも設置スペースの確保が容易である。このように、本発明によれば、取り扱いや操作が簡単で、且つ、より小型で安価な磁気刺激装置を提供することができ、これにより、被験者が、自宅や近所のかかりつけの医院などで日常的に継続反復して経頭蓋磁気刺激療法を行うことが可能になる。
従って、頭部外にある磁場発生手段を被験者頭部内にある特定部位に対応した位置及び方向に導くために、前記磁場発生手段と被験者頭部との相対的な移動及び/又は回転の操作を行うに際して、前記磁場発生手段が被験者頭部の前記特定部位に対応した相対的な位置及び方向からずれた場合でも、前記第一の指標及び第二の指標の表示に従って、前記磁場発生手段と被験者頭部とを相対的に移動及び/又は回転させるだけの簡単な操作で、前記磁場発生手段を被験者頭部の前記特定部位に対応した相対的な位置及び方向に、容易かつ確実に合わせることができる。これにより、経頭蓋磁気刺激療法を実施するに際して、頭部拘束による被験者の負担を軽減することができる。
以上のように、当該装置の使用者は、前記第一の指標及び第二の指標の表示に従って、前記磁場発生手段と被験者頭部とを相対的に移動及び/又は回転させるだけで、従来のように特別な熟練性を要することもなく、所要の操作を行うことができる。つまり、被験者あるいはその家族、又は必ずしも専門ではない近所のかかりつけの医師などでも、比較的容易に操作して使用することができる。また、従来のような大掛かりで高価な装置を用いる必要がないので、コスト負担が小さくて済み、しかも被験者個人の自宅や比較的小規模な医院や診療所等でも設置スペースの確保が容易である。このように、本発明によれば、取り扱いや操作が簡単で、且つ、より小型で安価な磁気刺激装置を提供することができ、これにより、被験者が、自宅や近所のかかりつけの医院などで日常的に継続反復して経頭蓋磁気刺激療法を行うことが可能になる。
図1は、本実施形態に係る経頭蓋磁気刺激装置の構成の概要を模式的に示す説明図である。この経頭蓋磁気刺激装置1は、被験者2の頭部2h内の特定部位(最適刺激部位)に磁気刺激を加えて治療を行なうためのものである。
図1に示すように、経頭蓋磁気刺激装置1(以下、適宜、単に「装置」と略称する)は、その主要な構成として、画像モニタ部10,装置本体ユニット20,磁気刺激コイル30(以下、適宜、「治療用コイル」、或いは、単に「コイル」と略称する),TOFカメラ40及びヘルメット50を備えている。
装置本体ユニット20に含まれる画像表示制御部21は、教示情報生成部23からの入力などに基づいて、画像モニタ部10に表示させるべき各種の画像の表示制御を行うものである。また、磁気刺激コイル制御部22は、磁気刺激コイル30に印加する磁束生成電流のオン/オフおよび電流を制御するものである。
そして、「正解姿勢」に到達してステップ#13での判定結果がYESになると、医師からのトリガー入力(図示しないスイッチ:ON)により、教示情報生成部23を介してTOFカメラ40が作動し、その時点での(つまり「正解姿勢」での)顔形状データが計測される(ステップ#14)。
前記TOFカメラ40は、3次元表面形状をリアルタイムに得ると同時に、モノクロの反射輝度画像をリアルタイムに得ることができる。この反射輝度画像に対して顔認識処理を行うことで、図8に示すように鼻領域を検出することができる。その後、図5の顔形状点群に対して、図8の円で囲まれている領域のみを抽出する処理を行うこと、図9に示すように鼻周辺領域のみを抽出した点群データを得ることができる。
本実施形態では、前述のように、「正解姿勢」と「現在姿勢」とがどれだけ異なっているかをICPアルゴリズムによる位置合わせを用いて求めるようにしている。次に、このICPアルゴリズムについて、その概略を説明する。
ICPアルゴリズムとは、1992年にBesl等により提案された手法で(P.J.Besl and N.D.McKay:”A Method for Registration of 3-D Shapes”,IEEE Trans.Pattern Anal.Machine Intell,vol. 14,No.2,pp.239-256(1992-2))、反復計算により対応点間の距離を最小化するような剛体変換パラメータを求める手法であり、この手法によれば、対応が未知の点群どうしを高精度に一致させることができる。
このICPアルゴリズムを用いて、「正解姿勢」の時点で計測した鼻領域形状点群と、「現在姿勢」で計測した鼻領域形状点群の位置合わせを行うことにより、「正解姿勢」と「現在姿勢」がどれだけ異なっているか(ずれているか)を算出する。その結果、「現在姿勢」の点群をどちらにどれだけ動かせば「正解姿勢」の点群と一致するかを表す平行移動ベクトルtと回転行列Rの変換パラメータ(剛体変換パラメータ)を得ることができるのである。
(i)点群Aの各点aiにおける点群Bとの最近点miを求める。
(ii)誤差Eを最小にする剛体変換パラメータを求める。
(iii)点群Aを求められたパラメータ(R,t)を用いて変換する。
(iv)誤差Eが閾値以下であれば反復計算を終了する。それ以外の場合には、(i)に戻って、同様のステップを繰り返して実行する。
そして、2つの指標C1,C2を結ぶ線分L12の向きは、「現在姿勢」を「正解姿勢」に近づけるために、TOFカメラ40、被験者2の顔の相対的な位置を移動させるべき移動方向を、線分L12の長さは同じく移動させるべき移動距離を示している。
あるいは、TOFカメラ40と一体になったヘルメット50を現状の位置に止めておき、被験者2の顔(頭)を動かせば指標C1を指標C2に近づけることができるので、同様に位置合わせの操作として実施される。
あるいは、TOFカメラ40を動かして「正解姿勢」に近づけようとする場合、TOFカメラ40の移動に伴い同様にして表示画面内の赤色の円形C1が移動するので、同じく線分L12上を赤色の円形C1が移動して緑色の円形C2へ近づくように操作を行う。あるいはこれらの操作を併用してもよい。
更に、「現在姿勢」が移動操作に応じて「正解姿勢」に近づくと、円形C1の表示の態様である画面12内の表示位置や表示の大きさが円形C2に近づくことになる。
なお、上記に用いた「移動」とは、被験者2の顔と、TOFカメラ40との相対的な位置および方向を変化させる動作、すなわち被験者2の顔とTOFカメラ40いずれか一方あるいは双方の、位置の移動、および回転の操作を含めて用いている。
なお、上記の実施態様では、「正解姿勢」となるように指標としての円形C1と円形C2を最終的に重ねているが、円形C1と円形C2を重ねずに、ある特定の位置関係によって「正解姿勢」を表示する態様であってもよい。
このようにして磁気刺激コイル30が正しい位置及び方向に誘導された状態で、磁気刺激治療が行われる(ステップ#30)。すなわち、被験者2自身あるいはその家族等は、前記磁気刺激コイル制御部22を作動させて、磁気刺激コイル30から所定強度の磁束を印加して被験者2の頭部2hの脳内に誘起電流を生じさせ、最適刺激部位に磁気刺激を加える。
また、操作の対象物が被験者2の顔、TOFカメラ40と複数あるよう構成したので、被験者2の疾患の病態、すなわち脳卒中などの後遺症から肢体の運動能力がどのくらい低下しているか、利き手がどちらであるか、介助者が存在するか、などの諸条件に合わせて、顔とTOFカメラ40のどちらを移動させるか、あるいは双方を移動させるか、選択が可能であるため操作性に大きな自由度が生じて、同様に治療装置使用の障壁を小さなものとして普及拡大を促進する効果がある。
2 被験者
2h 被験者の頭部
10 画像モニタ部
12 モニタ画面
20 装置本体ユニット
21 画像表示制御部
22 磁気刺激コイル制御部
23 教示情報生成部
30 磁気刺激コイル
40 TOFカメラ
42 受光部
44 発光部
50 ヘルメット
68,69 ポラリス用マーカ
70 パーソナルコンピュータ
Claims (6)
- 予め定められた位置及び方向に合わせるため、対象物の移動及び/又は回転の操作を行う際の、操作教示に用いる操作教示装置であって、
前記対象物の表面を投射光で照射して得られた撮影画像の各画素における、発光手段から前記対象物による反射を経て受光手段に至る前記投射光の伝播距離の情報から、当該対象物の3次元形状情報を得る、TOF(タイム・オブ・フライト)式距離画像カメラ手段と、
前記対象物から反射された投射光を前記受光手段が受光した受光強度の情報から得られた当該対象物の輝度画像を用いて、前記3次元形状情報中から特徴的領域を抽出する抽出手段と、
前記予め定められた位置及び方向での前記対象物の前記特徴領域を含む前記3次元形状情報と、現在の位置及び方向での前記対象物の前記特徴領域を含む前記3次元形状情報との偏差を算出して、前記操作教示のための情報を生成する生成手段と、を備えることを特徴とする操作教示装置。 - 対象物の表面を投射光で照射して得られた撮影画像の各画素における、発光手段から前記対象物による反射を経て受光手段に至る前記投射光の伝播距離の情報から当該対象物の3次元形状情報を得るとともに、移動及び/又は回転の操作が可能に構成された、TOF(タイム・オブ・フライト)式の距離画像カメラ手段と、
前記距離画像カメラに対して、(A)相対的に予め定められた位置及び方向にある前記対象物の、前記3次元形状情報と、(B)現在の位置及び方向にある前記対象物の、前記3次元形状情報と、に基づいて、
(1)前記予め定められた相対的位置及び相対的方向を示す、第一の指標、及び、
(2)前記現在の相対的位置及び相対的方向を示す指標であって、前記予め定められた相対的位置及び相対的方向に近づくよう前記対象物又は前記距離画像カメラを相対的に移動させる操作を行うと、表示の態様が前記第一の指標の表示の態様に近づく、第二の指標、
を生成する生成手段と、を備えることを特徴とする操作教示装置。 - 被験者頭部内にある特定部位に対し、頭部外にある磁場発生手段を用いて磁気刺激を加えるための経頭蓋磁気刺激装置であって、
前記磁場発生手段と一体で且つ移動及び/又は回転可能に設けられたカメラ手段であって、前記被験者頭部の表面を投射光で照射して得られた撮影画像の各画素における、発光手段から前記被験者頭部の表面による反射を経て受光手段に至る該投射光の伝播距離の情報から、当該被験者頭部の3次元形状情報を得る、TOF(タイム・オブ・フライト)式距離画像カメラ手段と、
前記被験者頭部の表面から反射された投射光を前記受光手段が受光した受光強度の情報から得られた当該被験者頭部の輝度画像を用いて、前記3次元形状情報中から特徴的領域を抽出する抽出手段と、
前記特定部位への磁気刺激を行う位置及び方向での前記被験者頭部の前記特徴領域を含む前記3次元形状情報と、現在の位置及び方向での前記被験者頭部の前記特徴領域を含む前記3次元形状情報との偏差を算出して、前記磁場発生手段と被験者頭部との相対的な位置および方向を変更操作するための教示情報を生成する生成手段と、を備えることを特徴とする経頭蓋磁気刺激装置。 - 前記特徴的領域が前記被験者の鼻領域であることを特徴とする、請求項3に記載の経頭蓋磁気刺激装置。
- 前記特徴的領域が前記被験者の耳領域であることを特徴とする、請求項3に記載の経頭蓋磁気刺激装置。
- 被験者頭部内にある特定部位に対し、頭部外にある磁場発生手段を用いて磁気刺激を加えるための経頭蓋磁気刺激装置であって、
前記磁場発生手段と一体で且つ移動及び/又は回転可能に設けられ、前記被験者頭部の表面を投射光で照射して得られた撮影画像の各画素における、発光手段から前記被験者頭部の表面による反射を経て受光手段に至る該投射光の伝播距離の情報から、当該被験者頭部の3次元形状情報を得る、TOF(タイム・オブ・フライト)式の距離画像カメラ手段と、
(A)前記磁場発生手段が前記特定部位への磁気刺激を行う位置及び方向にあるときの被験者頭部の、前記3次元形状情報と、(B)前記磁場発生手段が現在の位置及び方向にあるときの被験者頭部の、前記3次元形状情報とに基づいて、
(1)前記磁場発生手段が前記特定部位への磁気刺激を行うときの、目標となる位置及び方向を示す、第一の指標、及び、
(2)前記磁場発生手段が現在の位置及び方向にあるときの、現在の位置及び方向を示す指標であって、前記特定部位への磁気刺激を行うときの位置及び方向に近づくよう当該磁場発生手段の移動操作を行うと、表示の態様が前記第一の指標の表示の態様に近づく、第二の指標、
を生成する生成手段と、を備えたことを特徴とする経頭蓋磁気刺激装置。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015554587A JP6550660B2 (ja) | 2013-12-24 | 2014-06-30 | 操作教示装置および経頭蓋磁気刺激装置 |
| US15/107,303 US10675479B2 (en) | 2013-12-24 | 2014-06-30 | Operation teaching device and transcranial magnetic stimulation device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2013-265132 | 2013-12-24 | ||
| JP2013265132 | 2013-12-24 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015098155A1 true WO2015098155A1 (ja) | 2015-07-02 |
Family
ID=53478047
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2014/067432 Ceased WO2015098155A1 (ja) | 2013-12-24 | 2014-06-30 | 操作教示装置および経頭蓋磁気刺激装置 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US10675479B2 (ja) |
| JP (1) | JP6550660B2 (ja) |
| WO (1) | WO2015098155A1 (ja) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107149723A (zh) * | 2017-06-20 | 2017-09-12 | 深圳市瀚翔生物医疗电子股份有限公司 | 经颅磁刺激治疗仪定位系统及方法 |
| WO2020145004A1 (ja) * | 2019-01-10 | 2020-07-16 | 日本電気株式会社 | 撮影ガイド装置 |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11291852B2 (en) * | 2018-02-06 | 2022-04-05 | The Board Of Trustees Of The Leland Stanford Junior University | Accurate patient-specific targeting of cranial therapy using a brain atlas |
| US11017548B2 (en) * | 2018-06-21 | 2021-05-25 | Hand Held Products, Inc. | Methods, systems, and apparatuses for computing dimensions of an object using range images |
| CN109260593B (zh) * | 2018-09-27 | 2020-09-08 | 武汉资联虹康科技股份有限公司 | 一种经颅磁刺激治疗方法及设备 |
| US11497924B2 (en) * | 2019-08-08 | 2022-11-15 | Realize MedTech LLC | Systems and methods for enabling point of care magnetic stimulation therapy |
| CN114225223B (zh) * | 2021-12-31 | 2025-06-10 | 湖南华医电磁医学研究院有限公司 | 一种经颅磁刺激装置、经颅磁刺激系统和方法 |
| CN119745503A (zh) * | 2024-10-24 | 2025-04-04 | 华南理工大学 | 一种经颅磁导航体表可视化与自主调整系统 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012121341A1 (ja) * | 2011-03-09 | 2012-09-13 | 国立大学法人大阪大学 | 画像データ処理装置および経頭蓋磁気刺激装置 |
| WO2013054004A1 (en) * | 2011-10-14 | 2013-04-18 | Nexstim Oy | Method and apparatus for determining effects of transcranial magnetic stimulation to a brain |
| WO2013062021A1 (ja) * | 2011-10-24 | 2013-05-02 | 帝人ファーマ株式会社 | 経頭蓋磁気刺激システム |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FI114613B (fi) | 2001-10-17 | 2004-11-30 | Nexstim Oy | Menetelmä ja laite magneettistimulaation annoslaskentaa varten |
| FI20021050A7 (fi) | 2002-05-31 | 2003-12-01 | Nexstim Oy | Aivojen magneettistimulaation kohdennusmenetelmä ja -laitteisto |
| EP2008687B1 (en) | 2006-04-18 | 2019-11-13 | Osaka University | Transcranial magnetic stimulation head fixing tool and transcranial magnetic stimulator |
| US9135502B2 (en) * | 2009-05-11 | 2015-09-15 | Universitat Zu Lubeck | Method for the real-time-capable, computer-assisted analysis of an image sequence containing a variable pose |
| US9122053B2 (en) * | 2010-10-15 | 2015-09-01 | Microsoft Technology Licensing, Llc | Realistic occlusion for a head mounted augmented reality display |
| US9852652B2 (en) * | 2012-11-22 | 2017-12-26 | Atheer, Inc. | Method and apparatus for position and motion instruction |
| AU2014231351A1 (en) * | 2013-03-15 | 2015-11-05 | Neuhorizon Medical Corporation | Device and method for transcranial magnetic stimulation coil positioning with data integration |
-
2014
- 2014-06-30 JP JP2015554587A patent/JP6550660B2/ja active Active
- 2014-06-30 WO PCT/JP2014/067432 patent/WO2015098155A1/ja not_active Ceased
- 2014-06-30 US US15/107,303 patent/US10675479B2/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012121341A1 (ja) * | 2011-03-09 | 2012-09-13 | 国立大学法人大阪大学 | 画像データ処理装置および経頭蓋磁気刺激装置 |
| WO2013054004A1 (en) * | 2011-10-14 | 2013-04-18 | Nexstim Oy | Method and apparatus for determining effects of transcranial magnetic stimulation to a brain |
| WO2013062021A1 (ja) * | 2011-10-24 | 2013-05-02 | 帝人ファーマ株式会社 | 経頭蓋磁気刺激システム |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107149723A (zh) * | 2017-06-20 | 2017-09-12 | 深圳市瀚翔生物医疗电子股份有限公司 | 经颅磁刺激治疗仪定位系统及方法 |
| WO2020145004A1 (ja) * | 2019-01-10 | 2020-07-16 | 日本電気株式会社 | 撮影ガイド装置 |
| JPWO2020145004A1 (ja) * | 2019-01-10 | 2021-10-28 | 日本電気株式会社 | 撮影ガイド装置 |
| US12223639B2 (en) | 2019-01-10 | 2025-02-11 | Nec Corporation | Photographing guide device |
Also Published As
| Publication number | Publication date |
|---|---|
| US20170128737A1 (en) | 2017-05-11 |
| JPWO2015098155A1 (ja) | 2017-03-23 |
| US10675479B2 (en) | 2020-06-09 |
| JP6550660B2 (ja) | 2019-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6550660B2 (ja) | 操作教示装置および経頭蓋磁気刺激装置 | |
| EP3858432B1 (en) | Transcranial magnetic stimulation-based diagnosis and treatment apparatus | |
| US11395707B2 (en) | Surgical robot for stereotactic surgery and method for controlling stereotactic surgery robot | |
| ES2550455T3 (es) | Método y aparato para corregir un error en el registro conjunto de sistemas de coordenadas usados para representar objetos visualizados durante la estimulación guiada del cerebro | |
| US10286222B2 (en) | Magnetic stimulator | |
| JP5702861B2 (ja) | 解剖学的表面の支援型自動データ収集方法 | |
| US10548681B2 (en) | Surgical robot system for stereotactic surgery and method for controlling stereotactic surgery robot | |
| JP6161004B2 (ja) | 画像データ処理装置および経頭蓋磁気刺激装置 | |
| US20170296292A1 (en) | Systems and Methods for Surgical Imaging | |
| CN111729200B (zh) | 基于深度相机和磁共振的经颅磁刺激自动导航系统和方法 | |
| CN110327016A (zh) | 基于光学影像与光学治疗的智能型微创诊疗一体化系统 | |
| US20130231555A1 (en) | Image guided surgery apparatus and system | |
| CN114288559B (zh) | 经颅磁刺激导航方法、系统及计算机设备 | |
| CN114279435A (zh) | 定位导航方法和可读存储介质 | |
| US20240325088A1 (en) | Augmented Reality-Driven Guidance for Interventional Procedures | |
| CN114733073A (zh) | 一种基于电磁导航定位的经颅磁刺激方法、系统及电子设备 | |
| Leuze et al. | Landmark-based mixed-reality perceptual alignment of medical imaging data and accuracy validation in living subjects | |
| JP6795744B2 (ja) | 医療支援方法および医療支援装置 | |
| CN116328191A (zh) | 一种基于混合现实空间注册的经颅磁刺激治疗方法 | |
| CN115137988A (zh) | 一种医疗导航方法 | |
| CN114870262A (zh) | 经颅磁定位系统及方法 | |
| CN119454235A (zh) | 一种用于经颅磁刺激导航中快速配准的定位方法及系统 | |
| Shin et al. | Development of stereo camera module using webcam for navigation Transcranial Magnetic Stimulation system | |
| Yasumuro et al. | Coil positioning system for repetitive transcranial magnetic stimulation treatment by ToF camera ego-motion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14875402 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2015554587 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 15107303 Country of ref document: US |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14875402 Country of ref document: EP Kind code of ref document: A1 |