NL2035281B1 - Method and system for annotating X-ray fluoroscopy images - Google Patents
Method and system for annotating X-ray fluoroscopy images Download PDFInfo
- Publication number
- NL2035281B1 NL2035281B1 NL2035281A NL2035281A NL2035281B1 NL 2035281 B1 NL2035281 B1 NL 2035281B1 NL 2035281 A NL2035281 A NL 2035281A NL 2035281 A NL2035281 A NL 2035281A NL 2035281 B1 NL2035281 B1 NL 2035281B1
- Authority
- NL
- Netherlands
- Prior art keywords
- heart
- tissue
- ray fluoroscopy
- anatomical
- image
- Prior art date
Links
- 238000000034 method Methods 0.000 title description 27
- 238000002594 fluoroscopy Methods 0.000 title description 25
- 210000001519 tissue Anatomy 0.000 description 65
- 210000002216 heart Anatomy 0.000 description 52
- 238000011282 treatment Methods 0.000 description 19
- 238000005259 measurement Methods 0.000 description 14
- 210000005241 right ventricle Anatomy 0.000 description 13
- 210000005240 left ventricle Anatomy 0.000 description 11
- 230000000694 effects Effects 0.000 description 8
- 238000001574 biopsy Methods 0.000 description 7
- 210000005003 heart tissue Anatomy 0.000 description 6
- 210000004204 blood vessel Anatomy 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 5
- 210000003205 muscle Anatomy 0.000 description 5
- 210000000056 organ Anatomy 0.000 description 5
- 238000002560 therapeutic procedure Methods 0.000 description 5
- 239000000463 material Substances 0.000 description 4
- 231100000241 scar Toxicity 0.000 description 4
- 230000011218 segmentation Effects 0.000 description 4
- 238000010009 beating Methods 0.000 description 3
- 239000008280 blood Substances 0.000 description 3
- 210000004369 blood Anatomy 0.000 description 3
- 230000017531 blood circulation Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 210000004165 myocardium Anatomy 0.000 description 3
- 210000005245 right atrium Anatomy 0.000 description 3
- 210000003462 vein Anatomy 0.000 description 3
- 210000003484 anatomy Anatomy 0.000 description 2
- 230000008081 blood perfusion Effects 0.000 description 2
- 210000004375 bundle of his Anatomy 0.000 description 2
- 210000005242 cardiac chamber Anatomy 0.000 description 2
- 230000000747 cardiac effect Effects 0.000 description 2
- 208000010125 myocardial infarction Diseases 0.000 description 2
- 230000010412 perfusion Effects 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 230000000638 stimulation Effects 0.000 description 2
- 210000002620 vena cava superior Anatomy 0.000 description 2
- 230000035899 viability Effects 0.000 description 2
- 206010006580 Bundle branch block left Diseases 0.000 description 1
- 206010006578 Bundle-Branch Block Diseases 0.000 description 1
- 206010018691 Granuloma Diseases 0.000 description 1
- 206010018852 Haematoma Diseases 0.000 description 1
- 206010019280 Heart failures Diseases 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 210000000709 aorta Anatomy 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 210000001992 atrioventricular node Anatomy 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000002591 computed tomography Methods 0.000 description 1
- 238000002586 coronary angiography Methods 0.000 description 1
- 210000004351 coronary vessel Anatomy 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 210000002837 heart atrium Anatomy 0.000 description 1
- 230000004217 heart function Effects 0.000 description 1
- 239000007943 implant Substances 0.000 description 1
- 238000002513 implantation Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 210000005246 left atrium Anatomy 0.000 description 1
- 201000001715 left bundle branch hemiblock Diseases 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 230000002861 ventricular Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/503—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of the heart
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/032—Transmission computed tomography [CT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/46—Arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/46—Arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/466—Displaying means of special interest adapted to display 3D data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/486—Diagnostic techniques involving generating temporal series of image data
- A61B6/487—Diagnostic techniques involving generating temporal series of image data involving fluoroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5294—Devices using data or image processing specially adapted for radiation diagnosis involving using additional data, e.g. patient information, image labeling, acquisition parameters
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
- A61B2090/367—Correlation of different images or relation of image positions in respect to the body creating a 3D dataset from 2D images using position information
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/504—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of blood vessels, e.g. by angiography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/507—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for determination of haemodynamic parameters, e.g. perfusion CT
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
- A61B6/5247—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Radiology & Medical Imaging (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Pathology (AREA)
- High Energy & Nuclear Physics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Pulmonology (AREA)
- Theoretical Computer Science (AREA)
- Cardiology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
Method and device for annota ng X-ray fluoroscopy images, comprising the steps of: - Providing a 3D anatomical surface model of at least a part of a person’s heart; - Determining at least one local anatomic surface property for posi ons on a surface in said part; - Obtaining an X-ray fluoroscopy image from said at least part of said persons heart; - Determining corresponding landmarks in the 3D anatomical surface model and the X-ray fluoroscopy image; wherein - The step of genera ng an annotated image comprises: Annota ng, such that said corresponding landmarks coincide, the X-ray fluoroscopy image with a visible indica on represen ng the determined at least one local anatomic surface property.
Description
Method and system for annotating X-ray fluoroscopy images
The present invention relates to a method and system for annotating X-ray images, in particular X-ray fluoroscopy images, and more in particular for annotating real-time or live generated - and thus moving - fluoroscopy images.
Xray fluoroscopy is a technique that is commonly used during invasive medical treatments since it allows images to be generated of an area of interest of a patient, while allowing medical personnel to have access to the patient.
One of the invasive treatments it is used for is the placement of pacemakers and in particular during the step of positioning and placing pacemaker electrodes, it may provide useful information with respect to the electrodes actual position relative to the heart. These electrodes, and in fact in general the metal and plastics materials they are composed of, are well visible in the X-ray images.
According to the prior art, this electrode is often to be positioned in the apex of the right ventricle.
The electrode is inserted into the superior vena cava at a distance from the heart and guided through the vein into the heart. For finding this location during invasive treatment it is nowadays common to use a combination of X-ray fluoroscopy and detecting or sensing physical resistance, when putting the electrode, guided by its wire, into position. This is possible since the superior vena cava connects to the heart at the right top side, and the wire can be inserted through the right atrium and the right ventricle to the apex, which is its lowermost point. When this point is reached, an increased resistance is felt, and on X-ray fluoroscopy it can be seen that the wire no longer propagates but tends to curve. Additionally, when the wire is further inserted, it can be seen that it starts to bend, which is also an indication that tissue is reached and further positioning should be done by screwing.
Alternatively or additionally, it is possible to detecting the influence of a signal fed through the electrode on a patient’ s heart pace when it has reached the apex. Such influence may be determined by known technical means, such as the use of an electro-cardiogram.
Anew method for implanting a pacemaker into the heart has recently been proposed, wherein instead of placing a pacemaker electrode in the apex of the right ventricle, the electrode is now suggested to be placed in the tissue of the septum which divides the left and right ventricle of the heart. This method is referred to as Conduction System Pacing.
Currently there are a limited number of clinical studies showing that there this new location prevents ‘pacing induced heart failure’, a deterioration of the cardiac function which could occur after a period of right ventricle apex pacing. Moreover the new location also seems to repair left ventricular 1 dyssynchrony since the native conduction system of the heart can be re-activated after a so-called left bundle branch block.
The new method is currently performed and studied with all existing equipment, and leads to a lot of different approaches by different doctors. The standard equipment used to implant a pacemaker is X-
Ray fluoroscopy. An X-Ray method which allows real-time imaging of the beating heart. On these images the pacemaker wires are clearly visible but the tissue contrast is almost or even totally absent, making it impossible to distinguish the tissue from the blood or visualize tissue characteristics like myocardial infarction.
During the pacemaker implantation the experienced doctors navigate based on the electrical signals measured by electrocardiograms (ECG) that are altered by the (active) pacemaker wire, while in the heart. Not all doctors are able to do this and therefore every doctor follows its own strategy, creating a lot of diversity and disabling standardization and the definition of guidelines.
Although in early publications (Conduction System Pacing for Cardiac Resynchronisation, Arrhythm
Electrophysiol Rev. 2021 Apr; 10(1): 51-58} it is was assumed that the exact location of the electrode in the septum was not that important, during first practical attempts it is found that in some patients it is impossible to penetrate the tissue, while in others the septum is easily penetrated by a pacemaker screw, which is present at the leading end of the electrode and serves for fixation of the electrode once its correct position is found. This may be caused because the tissue constitution of the septum varies between individuals.
According to an aspect of the present invention, it is found that providing information about the septum tissue during invasive treatment can take away the practical disadvantages of performing the newly proposed treatment.
Tissue however, is poorly visible on X-ray fluoroscopy in general, and in case of the septum which is surrounded by other tissue such as the left and right ventricle walls, practically invisible.
The publication of the international patent application WO2017200385A1 by the same inventors, which is herein incorporated by reference, describes a method and device for verifying the position of an interventional device. In this publication, methods and devices are disclosed for annotating X-ray fluoroscopy images with information of amongst others tissue and organ information.
However, for enabling a practical implementation of Conduction System Pacing more detailed information seems to be required. Also for similar purposes, like the positioning of leadless pace makers or taking a biopsy, the same considerations apply. 2
It is therefore a goal of the present invention to provide a method and device for providing annotated
X-ray images that are in particular useful for Conduction System Pacing. When performed on or with suitable instruments and/or technologies, the method according to the invention may serve as a medical instrument.
In afirst aspect, the present invention proposes a method and system for annotating X-ray fluoroscopy images, comprising the steps of: - Providing a 3D anatomical surface model of at least a part of a person's heart; - Determining at least one local anatomic surface property for positions on a surface in said part; - Obtaining an X-ray fluoroscopy image from said at least part of said persons heart; - Determining corresponding landmarks in the 3D anatomical surface model and the X-ray fluoroscopy image;
Wherein the step of generating an annotated image comprises: - Annotating, such that said corresponding landmarks coincide, the X-ray fluoroscopy image with a visible indication representing the determined at least one local anatomic surface property.
A 3D anatomical surface model is known in the art as a model that defines the tissue surfaces that form inner or outer boundaries for a part of the human body, for instance the heart. A 3D anatomical surface model of the heart thus inter alia defines the inner walls of the atria the ventricles, as well as the outer walls thereof, in a three dimensional space. The 3D surface model may be a combined epicardial and endocardial model, i.e. the 3D surface model comprises both internal and external surfaces of a region of interest of the heart, which region preferably comprises both the left and the right ventricle and more preferably comprises the complete heart. The landmarks may comprise anatomical landmarks, and preferably wherein the anatomical landmarks comprise at least landmarks onthe heart such as the left or right atrium, left or right ventricle, aorta, sinus coronarius, coronary arteries and/or combinations thereof. In particular the landmarks may comprise at least one of the right atrium, the right ventricle or the left ventricle.
A well known and suitable example of an X-ray image is a so called Röntgen image, while X-ray fluoroscopy is a study of moving body structures that can be seen as an X-ray movie. A continuous X- ray beam is passed through the body part being examined. The beam is transmitted to a TV-like monitor so that the body part and its motion can be seen in detail. In a further aspect, an angiogram 3 can be made by the addition of a contrast fluid in the blood, which allows to follow (blood) movements.
The mentioned landmarks may be anatomic landmarks, such as {parts of) blood vessels, (parts of) valves and (parts of) the hearts chambers as well as (parts of} ribs and the spine which can be seen in the X-ray image, or external landmarks, such as markers positioned outside the persons body, for instance objects recognizable on an X-ray image, on the chest. The markers may also be pace maker wires (pre)positioned in a persons veins and thus indicate a known location with respect to the heart.
An annotated image according to the invention may also be referred to in the art as a combined image, or an image provided with an extra visible layer. At least one local anatomic surface property of said part of said persons heart means that for at least one point on the surface in the part of the heart this property is known, but preferably this is the case for multiple surface points, and more preferably for all points constituting the surface of said part of the heart. The at least part of the heart may herein of comprise the entire heart.
The step of providing a 3D anatomical surface model of at least a part of a person’s heart may be done prior to obtaining an X-ray fluoroscopy image, in particular when it is to be based on measurements. As described in the aforementioned WO2017200385A1, this can for instance be done by means of a CT scan, an MRI. These types of measurement usually require encapsulation of a person in a measurement device and are for that reason alone already not suitable to be done during invasive treatment. The method according to the invention is — when performed on or with suitable devices — intended to be applied as a technical support during invasive treatments, such as the application of a pacemaker or electrode thereof, of the taking of a biopsy. That means, that the annotated image according to the invention is also displayed on suitable display means, such as a monitor screen or augmented or virtually reality means such as a head set. The annotation may be depicted on separately displayed X-ray (fluoroscopy) video provided to a doctor, which may be a snapshot of an X-ray {fluoroscopy} image.
Alternatively, the step of providing a 3D anatomical surface model may be performed by means of calculations based on the X-ray image or (anatomic) markers therein. This can be done, for instance by computer aided modelling, or by selecting a 3D surface model from a database, based on similarities of the actual X-ray image with saved X-ray images from earlier scans or based on personal data of the person that is scanned, such as size, weight, age and gender. Although heart tissue may not be visible in an X-ray image, a contour of the heart may be determined based on the shape of the lungs. With the contour and its location, a 3D model of the heart may be constructed. 4
In both cases, the 3D surface model may as an additional method step be computer-animated, in order to move along with the persons beating and thus moving heart, as visible in the X-ray image. As an alternative, the 3D surface model may be recalculated or redetermined in real time, in order to reflect the movement of the beating heart.
In general, according to the invention the step of providing a 3D anatomical surface model comprises calculating said model based on data obtained from a CT, MRI or Ultrasound scan of said persons heart or a combination of at least two of these technologies, which has appeared to provide more detailed information about the heart muscle, such as its thickness or providing a model generated or selected from a database based on patient information or information about the persons heart derived from the X-ray fluoroscopy imaging. It may further comprise repeatedly determining corresponding landmarks in the anatomical surface model and the X-ray fluoroscopy image; and repeatedly generating an annotated image wherein at least part of the 3D anatomical surface model is annotated in the X-ray fluoroscopy image, such that said corresponding landmarks coincide in order to obtain a moving annotated image.
The local anatomic surface property that is annotated onto the X-ray image may be selected in accordance with the medical treatment to be performed on the person. Possible annotations are: - a surface material such as regular tissue, scar tissue, muscle tissue or conductive tissue like
His, left bundle branch and right bundle branch tissue; - a surface material such as a granuloma or a (local) lesion; - a direction in which the surface locally extends, or a direction related thereto, such as a direction perpendicular to the direction in which the surface locally extends or a direction in which an interventional device may be positioned; - a border of a tissue forming the surface; - athickness of a tissue forming the surface; - across section of a tissue forming the surface in a plane intersecting the persons heart; - an electric activity, blood flow or density of blood vessels of a tissue forming the surface.
A surface material such as regular tissue, scar tissue or muscle tissue can be determined by postprocessing of medical image data and/or local measurements performed on the tissue either determined through measurement of local electrical activity of the tissue or the result of local stimulation of the tissue of which the effect is measured through another measurement device. The postprocessing of the medical image data includes, but is not limited to segmentation of anatomical structures like cardiac chambers and cardiac tissue, and the assessment of local tissue characteristics in the segmented cardiac tissue, and parameters derived from the segmentation of the cardiac 5 chambers of cardiac tissue. The tissue characteristics can be useful to distinguish healthy from diseased tissue and so target a therapy or a biopsy to respectively healthy and suspect tissue.
A direction in which the surface locally extends, or a direction related thereto, such as a direction perpendicular to the direction in which the surface locally extends can be determined by creation of a 3D surface model based on the segmentation of anatomical structures like cardiac chambers and cardiac tissue. The direction perpendicular to the surface is based on the local extent of the 3D surface model. Secondary directions that are relevant for the therapy can be determined based on the direction of the surface or the direction perpendicular to the surface and other surface characteristics. The direction property is of interest to allow the alignment of the interventional device and a local direction in order to obtain the highest chance for a successful therapy and reduce the risk of a hazardous situation like a tissue perforation.
This may for instance be the case when a pacemaker with a bipolar lead is to be positioned in a septum of a persons heart. Such lead comprises a top and a ring electrode, with a fixed distance between them, for instance a centimetre. The bipolar electrode should be positioned in such way that the tip and the ring electrodes are in contact with the left bundle branch and right bundle branch respectively. Since these may be at a smaller distance from each other than the distance between the electrodes, the only way to touch both electrodes is to position the pace maker at an angle with the septum tissue surface. Such angle can be calculated based on the ratio of the distance between the electrodes and the thickness of the septum, and then be annotated as a guidance.
Athickness of a tissue forming the surface can be determined by a local distance between two surfaces constituting the inner and the outer surface of the tissue of interest; Similar to tissue characteristics a local tissue thickness can be used to distinguish healthy from diseased tissue and so target a therapy or a biopsy to respectively healthy and suspect tissue. Moreover the tissue thickness can aid the calculation of the optimal direction of the interventional device.
Across section of a tissue forming the surface in a plane intersecting the persons heart can be determined by defining a direction in an organ or tissue, and defining a plane perpendicular to the defined organ or tissue axis such that the intersection between the plane and the organ or tissue segmentation(s) forms a line or an area that is at the location of the planned intervention, in the direction that is relevant for the planned intervention. The cross-section provides insight into the depth of the intervention with respect to the organ or tissue of which the cross section is made
An electric activity can be measured by local measurements performed on the surface of the tissue either determined through measurement of local electrical activity of the tissue or the result of local stimulation of the surface of the tissue of which the effect is measured through another 6 measurement device measuring the resulting effect on the body surface electrocardiogram. This method allows assessment of the location of the interventional device with respect to the different aspects of the conduction system like the HIS bundle, left bundle branch and right bundle branch or normal myocardium.
Blood flow or perfusion can be measured by perfusion imaging using contrast enhanced imaging techniques using either a nuclear labeling technique or a tissue perfusion technique. The blood flow or perfusion provides insight into the viability of the tissue and allows to distinguish healthy from diseased tissue and so target a therapy or a biopsy to respectively healthy and suspect tissue.
The location, size and density of blood vessels can be measured by an angiographic imaging technique. The annotation of the location, size and density of blood vessels prevents that interventions are done in an area in which the risk for a perforation of the blood vessels, and as a consequence hematoma creation is too high.
The visible indication that is used as the annotation, may be a color indication, a mark indication such as a dot or a line or a ruler or an arrow, or a readable indication such as a character. Evidently, combinations of the mentioned annotation types are also thinkable. Herein, it is possible to indicate different annotations with a different annotation type, such as indicating cross section with a colored line and directions with arrows. Moreover, according to an embodiment of the invention, also the surfaces from the 3D anatomical surface model themselves are annotated. This provides the opportunity to combine annotations and to provide for instance a 3D surface model with indications of a direction perpendicular to a surface, surfaces with their corresponding thickness or indications where muscles or scar tissue are located. In some invasive treatments, besides exact locations, exact directions or depths are relevant, and a combination of the 3D surface model with annotations provides a solution for this need. The person performing the invasive treatment may then use the 3D surface model and the annotations as a guidance and take decisions based on the annotated X-ray image.
In a more advanced embodiment, the method according to the invention comprises providing a value, for instance in a lookup table or database, indicating the suitability of anatomic surface properties for one or more specific invasive treatments such as the positioning of a pacemaker electrode or taking a biopsy. Then, based on said value, the suitability of the local anatomic surface for said one or more specific invasive treatments may be determined and the step of generating an annotated image comprises annotating an indication representing the suitability.
As an example, for an invasive treatment where scar tissue and muscles tissue are to be avoided, these may be indicated in red, while suitable tissue is marked in green. The same may go for a 7 direction in which the surface is approached while performing invasive treatment. A correct direction or position of the interventional device or a direction or position of the interventional device that is at least within a certain threshold from an intended direction or position may be indicated with a different marking or color than an incorrect direction. In this case, the annotation provides a {preferably real-time) feedback on the positioning of the treatment device. It is further thinkable that annotations other than visible ones are used, such as a sound when a suitable location and direction are used or the other way round: when a location and direction are not found suitable.
In yet another embodiment, the method according to the invention comprises obtaining further data of the persons heart, such as data from earlier invasive treatments such as their position on the surface or successfulness, measurement data such as an electrocardiogram; and/or measurement data such as an angiography, in particular a coronary angiography; wherein the step of generating an annotated image comprises annotating a visible indication representing said further measurement data. An electrocardiogram may provide information about the conductivity of the tissue of the heart, including the muscle tissue, and provide information about the effects of for instance heart attacks that have taken place and their results. An angiogram may provide information about n about the vascularization and viability of the tissue’.
In a further embodiment, the method according to the invention comprises providing a value, for instance in a lookup table or database, representing the suitability of anatomic surface properties combined in view of said further measurement data, for one or more specific invasive treatments such as the positioning of a pacemaker electrode or taking a biopsy, and based on said value, determining the suitability of the local anatomic surface in view of said further measurement data for said one or more specific invasive treatments, wherein the step of generating an annotated image comprises providing an annotation representing the suitability.
In an embodiment, the present invention relates to a method adapted for providing annotated images suitable for Conduction System Pacing. Herein, the 3D anatomical surface model of a person's heart comprises at least the septum between the left and the right ventricle; and the step of providing a 3D anatomical surface model comprises determining a surface property of said septum; and the step of generating a combined image comprises annotating an indication of said surface property of the septum in the X-ray fluoroscopy image.
Being located centrally in the lower part of the heart, between the left and the right ventricle, and being surrounded by heart muscle tissue, the septum is not visible on X-Ray images of the heart.
Without an indication of its location, it is difficult to position and to place an electrode and a lot of trial and error is involved in placing a pacemaker electrode. Moreover, such trial and error, comprising 8 attempts for placing the electrode at the correct position against the septum and subsequently to fixate it by screwing, may leave damaged tissue at those locations where an unsuccessful attempt was made, or worse: may result in a pierced septum.
For that reason, according to the invention, the surface property which is annotated may be one of the group of: - across section of a tissue forming the surface of said at least part of the left ventricle including the septum; - a thickness of a tissue forming the septum surface; - a border of a tissue forming the septum; - a direction in which the septum surface locally extends, or a direction related thereto, such as perpendicular to the direction in which the surface locally extends.
This information enables a person performing an invasive treatment for placing a pace maker electrode for Conduction System Pacing in a patients septum, and to directly place it at the correct location and to apply it in the correct direction. The electrode may be guided by guiding tools, which allows to bring the electrode in a certain position and additionally to control its direction prior to screwing. As a result, with the aid of the method according to the present invention, applying
Conduction System Pacing technology has become easier and more reliable, with a severely reduced chance on unsuccessful attempts and damaging heart tissue.
The invention also generally relates to a device or system configured for performing at least a number of the method steps described above.
More specifically the invention relates to a device or system for providing a 3D anatomical surface model of at least a part of a person's heart comprising a data processor configured for: - determining at least one local anatomic surface property for positions on a surface in said part; - receiving or obtaining an X-ray fluoroscopy image from said at least part of said persons heart; - Determining corresponding landmarks in the 3D anatomical surface model and the X-ray fluoroscopy image; - Annotating, such that said corresponding landmarks coincide, the X-ray fluoroscopy image with a visible indication representing the determined at least one local anatomic surface property.
The invention will now be elucidated into more detail with reference to the following figures. Herein: 9
- Figure 1 shows a schematical view of a person's heart with a pace maker wire; - Figure 2 shows a cross section of the left and right ventricle; - Figure 3 shows a prior art X-ray image of a person's heart with pace maker wires; - Figure 4 shows an annotated X-ray image according to the invention; - Figure 5 shows an annotated X-ray image according to the invention; - Figures 6 A-B show annotated X-ray images according to the invention;
Figure 1 shows a perspective cross section 1 of a person's heart 2 with a pace maker electrode 4 lead by a wire 3. The electrode is screwed in the septum 5, which is the tissue between the left ventricle 6 and the right ventricle 7. As visible in detail A, the electrode 4 is positioned at a location where the so called HIS bundle 8 coming from the AV node 9 is split into a left bundle branch 8A and a right bundle branch 8B and it connects to both. This may be an intentional placement of the electrode for
Conduction System Pacing, when there's reason to believe that both left and right bundles should be paced.
Figure 2 shows a second cross section of the heart 2 from figure 1, taken along the line B-B’, with various positions of the electrode 4 and its wire 4 in the septum 5. From top to bottom of the figure an attempt V can be seen wherein the electrode is too close to a vein, an attempt W wherein the electrode is not screwed far enough in the septum, an attempt X wherein the electrode extends through the septum, a correct placement Y and an attempt Z wherein the electrode is placed under a wrong angle.
Figure 3 shows a standard X-Ray image 10 of a person's heart according to the prior art. In the picture, pace maker wires 3 and electrodes 4 can be distinguished, but no tissue of the heart is visible. From this image it becomes clear that the information needed for positioning an electrode correctly as shown in figure 2 cannot be derived from an X-ray image alone.
Figure 4 shows an annotated X-ray image according to the invention, wherein 3D surfaces of parts of the heart are depicted. A first annotation is formed by the different colors that are used for different parts of the persons heart. Furthermore, additional annotations, indicated with self-explanatory text in the picture, are added to the X-ray images.
Figure 5 shows an annotated X-ray image of the process of placing a pace maker electrode. In this case, a left ventricle epicardium is depicted, which shows the inner and outer surface of the left ventricle, at a selected cross section of the heart. in other words: the wall of tissue forming the left ventricle is located between these two rings. The septum forms part of this wall and as explained in figure 2, the electrode should be positioned in a specific position and orientation with respect to the 10 septum. The annotated left ventricle epicardium allows shows this position to a cardiologist while putting the electrode in place, and allows to do so first time right.
Figures 6A and 6B show a set-up 11 for performing the method according to the invention. An X-Ray tube 12 is used to irradiate a person's heart 2 while a projection 13 thereof is analyzed. The projection also comprises an annotation, formed by a projection 14’ of a vector 14 indicating a desired orientation of the electrode 4 for screwing it into the septum 5. The alignment in the image plane can be seen in the projection. The difference in projection length between the vector 14’ and a projection 4’ of the electrode is a measure of the difference in orientation in the third dimension, which is the dimension perpendicular to the plane of the two dimensional figure 6A, 6B. Agreement in projection length between the vector and the electrode as shown in figure 6B is a measure of the corresponding orientation in the third dimension.
This may for instance be used when a pacemaker with a bipolar lead is to be positioned in a septum of a person’s heart. Such lead comprises a top and a ring electrode, with a fixed distance between them, for instance a centimetre. The bipolar electrode should be positioned in such way that the tip and the ring electrodes are in contact with the left bundle branch and right bundle branch respectively. Since these may be at a smaller distance from each other than the distance between the electrodes, the only way to touch both electrodes is to position the pace maker at an angle with the septum tissue surface. Such angle can be calculated based on the ratio of the distance between the electrodes and the thickness of the septum, and then be annotated as a guidance.
When applying the method, additional information, such as information from an ECG, may be used, to determine that the target tissue issue is actually reached. 11
Claims (16)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| NL2035281A NL2035281B1 (en) | 2023-07-06 | 2023-07-06 | Method and system for annotating X-ray fluoroscopy images |
| PCT/EP2024/068874 WO2025008460A1 (en) | 2023-07-06 | 2024-07-04 | Method and system for annotating x-ray fluoroscopy images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| NL2035281A NL2035281B1 (en) | 2023-07-06 | 2023-07-06 | Method and system for annotating X-ray fluoroscopy images |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| NL2035281B1 true NL2035281B1 (en) | 2025-01-13 |
Family
ID=88413528
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| NL2035281A NL2035281B1 (en) | 2023-07-06 | 2023-07-06 | Method and system for annotating X-ray fluoroscopy images |
Country Status (2)
| Country | Link |
|---|---|
| NL (1) | NL2035281B1 (en) |
| WO (1) | WO2025008460A1 (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120296196A1 (en) * | 2011-05-20 | 2012-11-22 | Jan Boese | Method for assisting a person performing a minimally invasive intervention with a catheter involving a puncture of a septum and x-ray device |
| US20160022375A1 (en) * | 2014-07-24 | 2016-01-28 | Robert Blake | System and method for cardiac ablation |
| WO2017200385A1 (en) | 2016-05-19 | 2017-11-23 | Umc Utrecht Holding B.V. | Method of verifying a position of an interventional device |
| US20200138521A1 (en) * | 2017-07-13 | 2020-05-07 | Pie Medical Imaging Bv | Methods and systems for guidance in cardiac resynchronization therapy |
| US20210015389A1 (en) * | 2019-07-20 | 2021-01-21 | Medtronic, Inc. | Method and apparatus for implantation of a pacing electrode |
| US20230044399A1 (en) * | 2020-04-19 | 2023-02-09 | Xact Robotics Ltd. | Data analysis based methods and systems for optimizing insertion of a medical instrument |
-
2023
- 2023-07-06 NL NL2035281A patent/NL2035281B1/en active
-
2024
- 2024-07-04 WO PCT/EP2024/068874 patent/WO2025008460A1/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120296196A1 (en) * | 2011-05-20 | 2012-11-22 | Jan Boese | Method for assisting a person performing a minimally invasive intervention with a catheter involving a puncture of a septum and x-ray device |
| US20160022375A1 (en) * | 2014-07-24 | 2016-01-28 | Robert Blake | System and method for cardiac ablation |
| WO2017200385A1 (en) | 2016-05-19 | 2017-11-23 | Umc Utrecht Holding B.V. | Method of verifying a position of an interventional device |
| US20200138521A1 (en) * | 2017-07-13 | 2020-05-07 | Pie Medical Imaging Bv | Methods and systems for guidance in cardiac resynchronization therapy |
| US20210015389A1 (en) * | 2019-07-20 | 2021-01-21 | Medtronic, Inc. | Method and apparatus for implantation of a pacing electrode |
| US20230044399A1 (en) * | 2020-04-19 | 2023-02-09 | Xact Robotics Ltd. | Data analysis based methods and systems for optimizing insertion of a medical instrument |
Non-Patent Citations (1)
| Title |
|---|
| "Conduction System Pacing for Cardiac Resynchronisation", ARRHYTHM ELECTROPHYSIOL REV., vol. 10, no. 1, April 2021 (2021-04-01), pages 51 - 58 |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2025008460A1 (en) | 2025-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8515527B2 (en) | Method and apparatus for registering 3D models of anatomical regions of a heart and a tracking system with projection images of an interventional fluoroscopic system | |
| US9463072B2 (en) | System and method for patient specific planning and guidance of electrophysiology interventions | |
| US7499743B2 (en) | Method and system for registration of 3D images within an interventional system | |
| KR101061670B1 (en) | Methods and apparatus for visual support of electrophysiological application of the catheter to the heart | |
| Berger et al. | Single-beat noninvasive imaging of cardiac electrophysiology of ventricular pre-excitation | |
| JP4441322B2 (en) | Cardiac CT system and method for planning and treatment of biventricular pacing using an epicardial lead | |
| US9277970B2 (en) | System and method for patient specific planning and guidance of ablative procedures for cardiac arrhythmias | |
| US8050739B2 (en) | System and method for visualizing heart morphology during electrophysiology mapping and treatment | |
| US7327872B2 (en) | Method and system for registering 3D models of anatomical regions with projection images of the same | |
| US10485510B2 (en) | Planning and guidance of electrophysiology therapies | |
| US10335238B2 (en) | System and method for non-invasively estimating electrophysiological maps and measurements from cardio-thoracic 3D images and electrocardiography data | |
| JP7528082B2 (en) | Methods, devices and systems for planning intracavity probe procedures - Patents.com | |
| JP2020526348A (en) | Cardiac resynchronization therapy | |
| US9622821B2 (en) | System and method for structure-function fusion for surgical interventions | |
| JP2014532509A (en) | Method and system for sensing and analyzing cardiac mechanisms | |
| JP2008523920A (en) | Method and system for treating heart failure using 4D imaging | |
| US7797030B2 (en) | Clinical tool for structure localization | |
| CN106725448A (en) | System and method for being mapped to electrophysiology information on complex geometric shapes | |
| US20230149089A1 (en) | Guidance of arrhythmia ablation using a patient's heart digital twin | |
| Sánchez et al. | Enhancing premature ventricular contraction localization through electrocardiographic imaging and cardiac digital twins | |
| JP5122743B2 (en) | System for aligning 3D images within an interventional system | |
| US20220117507A1 (en) | System and method for processing measurement data from electrocardiogram electrodes | |
| JP7244108B2 (en) | Cardiac Mapping and Model Synthesis Methods | |
| NL2035281B1 (en) | Method and system for annotating X-ray fluoroscopy images | |
| US20230178211A1 (en) | Method and System for Cardiac Pacing Therapy Guidance |