US20150087968A1 - Medical navigation system with wirelessly connected, touch-sensitive screen - Google Patents
Medical navigation system with wirelessly connected, touch-sensitive screen Download PDFInfo
- Publication number
- US20150087968A1 US20150087968A1 US14/387,722 US201314387722A US2015087968A1 US 20150087968 A1 US20150087968 A1 US 20150087968A1 US 201314387722 A US201314387722 A US 201314387722A US 2015087968 A1 US2015087968 A1 US 2015087968A1
- Authority
- US
- United States
- Prior art keywords
- image
- display
- body part
- control unit
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/12—Arrangements for detecting or locating foreign bodies
-
- A61B19/56—
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/25—User interfaces for surgical systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/032—Transmission computed tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2051—Electromagnetic tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2063—Acoustic tracking systems, e.g. using ultrasound
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2074—Interface software
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/25—User interfaces for surgical systems
- A61B2034/258—User interfaces for surgical systems providing specific settings for specific users
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/374—NMR or MRI
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
- A61B2090/3762—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
Definitions
- the invention relates to a medical system comprising an instrument, a position acquisition apparatus for the instrument and a data processing and image generating apparatus.
- the position data acquired thus can, for example, be assigned to a tomographic image of an object or body part.
- the data processing and image generating apparatus is then able to generate an image of a body part from currently recorded or stored data representing a respective body part, which image reproduces a view of the body part together with a representation of the Position and orientation of the instrument in such a way that an observer can gather the position and orientation of the instrument in the body part from the image of the body part.
- the position data typically reproduce a position and orientation of a respective instrument in relation to a reference coordinate system and can therefore be transformed into a coordinate system underlying the image data by the data processing and image generating apparatus.
- medical systems are known and serve for so-called navigation of surgical instruments, which are typically guided by hand. Therefore, an operator is able also to identify the position of the instrument guided by him in a reproduction, for example a tomographic reproduction, of his patient and is therefore able to guide the instrument to a target region or a target position in a targeted manner.
- the employed position acquisition systems can be optical, ultrasound-based or electromagnetic position acquisition apparatuses.
- electromagnetic position acquisition apparatuses in which a field generator generates an alternating electromagnetic field and position sensors comprising coils are provided on the instrument. Currents which depend on the alignment of a respective coil in relation to the alternating electromagnetic field are induced in the coils by the alternating electromagnetic field of the generator. If a movable instrument is equipped with such position sensors in the form of sensor coils, it is possible to determine a location and position of the instrument relative to a reference sensor, which e.g. may likewise comprise coils.
- the reference sensor for example as a patient localizer, is securely connected to a body part of a patient (or else of a different object).
- the position and orientation of an instrument is typically acquired using such a position acquisition apparatus and the position of the instrument is subsequently displayed in slice images of the body part obtained by tomography.
- the position data supplied by the position sensor of the instrument must be transformed into coordinates of the tomographic image of the patient.
- the position of the instrument, and preferably the orientation thereof as well, can then be depicted in slice images, or else perspective representations, of the body part of a patient.
- the invention is based on the object of improving such a system, especially in view of the operability by the operator.
- a medical system comprising an instrument, a data processing and image generating apparatus and an image display and control unit.
- the position acquisition apparatus is embodied to acquire a position and orientation of the instrument in relation to a reference coordinate system.
- the data processing and image generating apparatus is embodied to generate an image of a body part from currently recorded or stored data representing a body part, which image reproduces a view of the body part together with a representation of the position, and preferably also the orientation, of the instrument in such a way that an observer can gather the position and orientation of the instrument in the body part from the image of the body part.
- the image display and control unit is wirelessly connected to the data processing and image generating apparatus, and comprises a display and input unit with a closed surface. On the closed surface of the display and input unit, control elements and a respective view of the body part are displayed during operation of the image display and control unit, together with a representation of the position, and preferably also the orientation, of the instrument.
- the image display and control unit is embodied to accept user inputs via displayed control elements and to transmit control signals to the data processing and image generating apparatus as a function of the respectively accepted user inputs.
- the display and input unit can be a touchscreen, i.e. a touch-sensitive screen, which also permits inputs via the screen.
- the display and input unit can also easily be used in an operating theater as a result of such a display and input unit being closed, as it is not so susceptible to contamination.
- the image display and control unit is moreover connected wirelessly to the data processing and image generating apparatus, the image display and control unit can be placed or installed at in each case the most expedient location by the operator, or else it can be operated hands-free.
- the operator can enter control inputs directly from the operation site or directly compare images on the image display and control unit with what is in front of his eyes in the case of a patient.
- the medical system is preferably embodied in such a way that the display and control unit displays a respective view of a body part with a 1:1 scale such that distances in a depicted slice plane of a body part are at least approximately identical to a distance along the slice plane in the body part itself.
- This not only permits a comparison between what the operator has in front of his eyes in the case of the patient and corresponding images, it also allows the operator to guide his instrument particularly precisely since the distances to be gathered from the image display on the display and control unit precisely correspond to those by which he may, optionally, need to move the instrument in order, for example, to arrive at a specific target position.
- the data processing and image generating apparatus in addition to a respective position, and preferably also an orientation, of the instrument, it is particularly preferable for the data processing and image generating apparatus to be furthermore embodied to display in a respective view of a body part and a marking of a further position and/or of a target region or target volume in the body part.
- the data processing and image generating apparatus is embodied to access different data representing a respective body part, for example data obtained by computed tomography or data obtained by magnetic resonance imaging. Moreover, the data processing and image generating apparatus is accordingly embodied to generate an image, as desired, which image is based on data obtained by computed tomography or data obtained by magnetic resonance imaging.
- the image display and control unit is preferably embodied to display one or more control elements, which serve for the selection to be made between various data representing a respective body part and, hence, the corresponding image display.
- the image display and control unit is embodied to generate a control signal when an appropriate control element is actuated, which control signal causes the data processing and image generating apparatus to generate an image on the basis of the correspondingly selected data representing a body part of the patient.
- the data processing and image generating apparatus is preferably embodied to store a displayed image in such a way that it can be recalled at a later time.
- This is therefore advantageous because, typically, the position of the instrument in the body part, and possibly the body part as well, change or move over time such that, typically, a currently reproduced image differs from an image reproduced at an earlier time. Therefore, it may be helpful to store an image at specific times, for example within the meaning of a screenshot.
- the image display and control unit also preferably comprises a corresponding control element, wherein the image display and control unit generates a control signal when said control element is actuated, which control signal causes the data processing and image generating apparatus to store a respectively currently displayed image when the control element is actuated.
- the data processing and image generating apparatus may be embodied to store an image sequence in the style of a film.
- the image display and control unit also preferably comprises a corresponding control element, wherein the image display and control unit generates a control signal when said control element is actuated, which control signal causes the data processing and image generating apparatus to record an image sequence within the meaning of a film.
- the display of the control element for triggering the recording of an image sequence is modified in the case of the actuation which starts the recording of an image sequence.
- the operator can himself identify that an image sequence is currently being recorded.
- the image display and control apparatus is furthermore preferably embodied for a second actuation of the control element for recording image sequences to again stop the recording of a respective image sequence.
- the image display and control unit once again generates the original display of this control element prior to triggering the recording of an image sequence in the case of the respective second actuation of the control element.
- FIG. 1 shows a medical system comprising an instrument, a position acquisition apparatus for this instrument, a data processing and image generating apparatus and an image display and, control unit;
- FIG. 2 shows a medical instrument and an associated position acquisition apparatus comprising a field generator for an alternating electromagnetic field, and a position sensor fixed with respect to the patient;
- FIG. 3 shows an example of an image generated by the data processing and image generating apparatus and displayed on the image display and control unit, together with control elements likewise displayed on the image display and control unit;
- FIG. 4 shows a display of control elements displayed on the image display and control unit.
- FIG. 1 shows the components of a medical system, specifically an instrument 16 , a field generator 12 as part of a position acquisition apparatus and a data processing and image generating apparatus 20 , which is connected to the field generator 12 and the instrument 16 via cables 22 and 24 , respectively.
- FIG. 1 shows an image display and control unit 30 , which can easily be held by one or two hands and is wirelessly connected to the data processing and image generating apparatus 20 .
- FIG. 2 shows, by way of a sketch, the head 10 of a patient in a side view.
- a position sensor which is fixed with respect to the patient, representing a reference position sensor 14 or patient localizer is fastened to the head 10 of the patient.
- the movable instrument 16 comprises a proximal end with a handle 18 and a distal end with an instrument position sensor.
- the reference position sensor 14 and the instrument position sensor respectively comprise one or more electrical coils as sensor coils.
- the alternating electromagnetic field emanating from the field generator 12 during operation respectively induces a current in the coils, the amplitude of which current depends on the relative position and alignment of a respective sensor coil in relation to the field generator 12 .
- position values of an instrument acquired by means of a position acquisition system, for instrument navigation within the meaning of a respectively current position of an instrument being displayed in slice images of a body part obtained e.g. by tomography
- the position values supplied by the position sensor of the instrument must be transformed into a model coordinate system underlying a tomographic image.
- a transformation prescription required for this is obtained in a manner known per se by means of a registration method.
- a surface of a body part is, to this end, scanned by means of a pointing or scanning instrument, and position values obtained in the process are transferred with the smallest possible error to a model surface derived from a tomograghic or topographic image.
- the scalings, rotations and/or translations or the like, which are required for this transfer which is as accurate as possible, finally result in the transformation prescription.
- the data processing and image generating apparatus 20 can also be at a distance from the operation site, for example as part of a central data center.
- the instrument 16 may be a surgical instrument or a microscope, endoscope or different movable instrument.
- the instrument 16 need not necessarily be movable by hand, but may also be controlled by a robot.
- the image display and control unit 30 is embodied as an independent unit, which communicates wirelessly at least with the data processing and image generating apparatus 20 , but can, for example, additionally also communicate with the instrument 16 in order to be able to control, in particular, the instrument 16 remotely by means of the image display and control unit 30 .
- the instrument 16 is an endoscope
- the alignment of the endoscope optical unit can be controlled by means of the image display and control unit 30 to the extent that said optical unit can be aligned by remote control.
- the display and control unit 30 can be embodied to control the focus control of the microscope or the overriding or setting of the autofocus control of the microscope remotely.
- the display and input unit 32 of the image display and control unit 30 displays both at least one view 36 of a body part and one or more control elements 34 , and also information icons 38 .
- the view 36 of a body part can be generated a data of a body part obtained from the data processing and image generating unit 20 by way of e.g. computed tomography or magnetic resonance imaging.
- the depicted view can also be a respectively current endoscope or microscope recording.
- both views displayed from data obtained by tomography and views recorded by means of an optical instrument, such as an endoscope or a microscope are displayed simultaneously.
- the view of a respective body part is preferably displayed with a scale of 1:1 such that distances on the plane of the display and input unit 32 of the image display and control unit 30 correspond to distances in the respective plane of the body part.
- Both the position of a respective instrument 16 and also e.g. planning information, which is a result of preceding operation planning, are preferably displayed in the respective views of a body part.
- planning information can be the marking of a target region or a target volume in the respectively depicted view 36 of the body part.
- Other planning information can relate to the position and alignment of implants such as e.g. screws. If these are depicted in the view 36 of the body part, an operator can precisely align the real implant during the operation on the basis of the depicted planning information in the view 36 of the body part.
- Control elements 34 depicted on the display and input unit 32 can be gathered from FIGS. 3 and 4 in an exemplary manner.
- a first control element 34 . 1 and a second control element 34 . 2 serve for selecting the data representing a respective body part.
- actuating the first control element 34 . 1 a user can cause the view 36 of the body part from data obtained by computed tomography to be displayed.
- actuating the second control element 34 . 2 a user can cause the view 36 to be generated from data obtained by magnetic resonance imaging.
- actuating a respective control element 34 . 1 or 34 . 2 triggers the transmission of a corresponding control signal from the image display and control unit 30 to the data processing and image generating unit. The latter then generates corresponding views 36 of the body part and transmits these to the image display and control unit 30 , on the display and input unit 32 of which the corresponding view 36 is then depicted.
- a third control element 34 . 3 enables snapshots to be recorded, either of a respectively current view 36 of the body part only or else of the whole display, including the control elements, depicted on the display and input unit 32 . If the third control element 34 . 3 is actuated by a user, the image display and control unit 30 generates a control signal which prompts the data processing and image generating apparatus 20 to store a corresponding view in such a way that it can be recalled at a later time.
- a fourth control element 34 . 4 enables the recording of an image sequence to be triggered, which, in the style of a film, is stored either on the image display and control unit 30 itself or else on the data processing and image generating apparatus 20 .
- the recording of such an image sequence is started with a respective first actuation of the fourth control element 34 . 4 , while pressing the fourth control element 34 . 4 a second time stops the recording of the image sequence again.
- the display of the fourth control element 34 . 4 is modified after the first actuation thereof such that a user immediately knows that an image sequence is currently being recorded. If this recording of an image sequence is stopped again by a respective second actuation of the fourth control element 34 . 4 , the fourth control element 34 . 4 is once again depicted in its original display format shown in FIGS. 3 and 4 .
- control elements 34 . 6 and 34 . 7 serve, for example, for setting the contrast (control element 34 . 6 ) and brightness (control element 34 . 7 ) of the displayed view.
- An eighth control element enables a reset. By actuating the eighth control element 34 . 8 , the original settings are restored.
- positions can be marked in the depicted view 36 of the body part.
- a tenth control element 34 . 10 enables switching between different display scales, wherein a display scale of 1:1 is preferred.
- the image display and control unit 30 allows switching between various instruments that are connected wirelessly to the image display and control unit 30 , for example switching between endoscope and surgical instrument.
- switching between various instruments can also be brought about automatically by an operator picking up a respective instrument.
- the respective instrument currently in use is displayed on the display and input unit 32 by an information icon such as the icon 38 . 1 .
- a particularly advantageous application emerges to the extent that, for example, the attention can be focused on image points or positions, determined by the endoscope, in a two-dimensional plane or in a three-dimensional space (i.e., for example, these can be brought into the center of the endoscope image).
- a respective position can be stored by actuating a corresponding control element, either on the display and input unit 32 of the image display and control unit 30 or else on the endoscope itself.
- a plurality of such positions can subsequently be connected to one another in a polygonal train which, for example, describes a body cavity or else a cavity—more precisely: the contour thereof—artificially created by an operation (e.g. after removing a tumor).
- a polygonal train can then serve as a template for cutting out body tissue parts, which for example should serve for filling the artificially created cavity and are taken from a different position of the body of a patient.
- the image display and control unit 30 itself also allows a use to mark individual positions or else trace out depicted contours on the view 36 of a body part, for example by means of an input stylus, in order thus to generate the corresponding position data for generating a template.
- a further function offered by the image display and control unit 30 lies in the sensing of landmarks on the view 36 of the body part in order thus, for example, to bring various displays, such as e.g. an endoscopic recording and a view generated from data obtained by tomography, in line, to corresponding landmarks are assigned to one another in the various representations.
- Basic settings for various users of an image display and control unit 30 and/or basic settings for various image display and control units 30 can be stored either on a respective image display and control unit 30 or else on a corresponding data processing and image generating apparatus 20 , in particular if the latter is implemented in the form of a central server or data center. This renders it possible, particularly on a central data processing and image generating apparatus 20 as well, to store basic settings for various users such that respectively different image display and control units 30 , even with different operating systems, can be used without a user having to adapt himself to in each case very different representation manners or pre-settings. Rather, the representation manners and pre-settings can respectively be realized to be the same, or at least similar, on various image display and control units, independently of a respectively specific image display and control unit 30 and the specific operating systems thereof.
- data can be stored in a respective image display and control unit 30 , which data either partly or completely describe a respective medical system. These can include instrument descriptions, as well as descriptions of the position acquisition apparatus or else of the data processing and image generating apparatus.
- data can be stored permanently in a respective image display and control unit 30 , or else can only be transmitted with the start of a respective application, for example from a corresponding data processing and image generating apparatus 20 to a respective image display and control unit 30 . In the latter case, different image display and control units 20 of different types or with different equipment can also, in particular, easily be replaced for one another.
- data which describe individual image display and control units 30 can also be stored in a respective data processing and image generating apparatus 20 .
- the complete data processing and image generating apparatus 20 can also be integrated in a respective image display and control unit 30 .
- the image display and control unit 30 can be kept quite simple and, secondly, all essential information is kept available centrally and therefore kept available for other users or image display and control units 30 as well.
- the whole representation on a respective display and input unit 32 of an image display and control unit 30 including the positions and display formats of the control elements, is predetermined by a corresponding data processing and image generating apparatus 20 , it may be sufficient for a respective image display and control unit 30 only to generate one control signal when a corresponding, depicted control element on the display and input unit is touched, which control signal reflects the respectively touched position on the display and input unit 32 .
- This information is then sufficient for the data processing and image generating apparatus 20 to identify which control element was actuated on the image display and control unit 30 or which position was marked on the displayed view 36 of a body part.
- the data processing and image generating apparatus 20 also need not be in the direct vicinity of a user or operator, but may for example be realized in a central data center, a user or operator can, within his work surroundings, concentrate fully on his instruments and optionally resort to the image display and control unit for support. Since the latter optionally may also serve as remote control for the corresponding instruments of the user or operator (see above), this greatly simplifies the work of the user and operator at his workplace—for example in the operating theater.
- an image display and control unit 30 described here permits instrument-centered work of the user or operator, during which the latter can wholly concentrate on his instruments and is largely unburdened from further technical burdens.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Medical Informatics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biomedical Technology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- Human Computer Interaction (AREA)
- Robotics (AREA)
- General Physics & Mathematics (AREA)
- Biophysics (AREA)
- High Energy & Nuclear Physics (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Optics & Photonics (AREA)
- Pulmonology (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
- The invention relates to a medical system comprising an instrument, a position acquisition apparatus for the instrument and a data processing and image generating apparatus.
- Using such a medical system, it is possible, for example, to acquire the position and orientation of a medical instrument, and the position data acquired thus can, for example, be assigned to a tomographic image of an object or body part. The data processing and image generating apparatus is then able to generate an image of a body part from currently recorded or stored data representing a respective body part, which image reproduces a view of the body part together with a representation of the Position and orientation of the instrument in such a way that an observer can gather the position and orientation of the instrument in the body part from the image of the body part. The position data, recorded for this purpose by the position acquisition apparatus, typically reproduce a position and orientation of a respective instrument in relation to a reference coordinate system and can therefore be transformed into a coordinate system underlying the image data by the data processing and image generating apparatus. In principle, such medical systems are known and serve for so-called navigation of surgical instruments, which are typically guided by hand. Therefore, an operator is able also to identify the position of the instrument guided by him in a reproduction, for example a tomographic reproduction, of his patient and is therefore able to guide the instrument to a target region or a target position in a targeted manner. By way of example, the employed position acquisition systems can be optical, ultrasound-based or electromagnetic position acquisition apparatuses. By way of example, electromagnetic position acquisition apparatuses are known, in which a field generator generates an alternating electromagnetic field and position sensors comprising coils are provided on the instrument. Currents which depend on the alignment of a respective coil in relation to the alternating electromagnetic field are induced in the coils by the alternating electromagnetic field of the generator. If a movable instrument is equipped with such position sensors in the form of sensor coils, it is possible to determine a location and position of the instrument relative to a reference sensor, which e.g. may likewise comprise coils. Here, the reference sensor, for example as a patient localizer, is securely connected to a body part of a patient (or else of a different object).
- For navigation in body parts of a patient, the position and orientation of an instrument is typically acquired using such a position acquisition apparatus and the position of the instrument is subsequently displayed in slice images of the body part obtained by tomography. In order for this to work, the position data supplied by the position sensor of the instrument must be transformed into coordinates of the tomographic image of the patient. The position of the instrument, and preferably the orientation thereof as well, can then be depicted in slice images, or else perspective representations, of the body part of a patient.
- It is helpful to the operator if, for this, he is able to select the representation most expedient in each case; if, for example, he is able to select different slice planes in order to be able in each case to select a representation that is useful to him. Therefore, provision is made for equipping such position acquisition apparatuses or data processing and image generating apparatuses with input means which, for example, allow the selection of a display format.
- The invention is based on the object of improving such a system, especially in view of the operability by the operator.
- According to the invention, this object is achieved by a medical system comprising an instrument, a data processing and image generating apparatus and an image display and control unit. Of these, the position acquisition apparatus is embodied to acquire a position and orientation of the instrument in relation to a reference coordinate system. The data processing and image generating apparatus is embodied to generate an image of a body part from currently recorded or stored data representing a body part, which image reproduces a view of the body part together with a representation of the position, and preferably also the orientation, of the instrument in such a way that an observer can gather the position and orientation of the instrument in the body part from the image of the body part. Here, according to the invention, the image display and control unit is wirelessly connected to the data processing and image generating apparatus, and comprises a display and input unit with a closed surface. On the closed surface of the display and input unit, control elements and a respective view of the body part are displayed during operation of the image display and control unit, together with a representation of the position, and preferably also the orientation, of the instrument. The image display and control unit is embodied to accept user inputs via displayed control elements and to transmit control signals to the data processing and image generating apparatus as a function of the respectively accepted user inputs.
- By way of example, the display and input unit can be a touchscreen, i.e. a touch-sensitive screen, which also permits inputs via the screen. The display and input unit can also easily be used in an operating theater as a result of such a display and input unit being closed, as it is not so susceptible to contamination.
- Since the image display and control unit is moreover connected wirelessly to the data processing and image generating apparatus, the image display and control unit can be placed or installed at in each case the most expedient location by the operator, or else it can be operated hands-free. Thus, the operator can enter control inputs directly from the operation site or directly compare images on the image display and control unit with what is in front of his eyes in the case of a patient.
- In order to simplify the last aspect in particular, the medical system is preferably embodied in such a way that the display and control unit displays a respective view of a body part with a 1:1 scale such that distances in a depicted slice plane of a body part are at least approximately identical to a distance along the slice plane in the body part itself. This not only permits a comparison between what the operator has in front of his eyes in the case of the patient and corresponding images, it also allows the operator to guide his instrument particularly precisely since the distances to be gathered from the image display on the display and control unit precisely correspond to those by which he may, optionally, need to move the instrument in order, for example, to arrive at a specific target position.
- In this context, in addition to a respective position, and preferably also an orientation, of the instrument, it is particularly preferable for the data processing and image generating apparatus to be furthermore embodied to display in a respective view of a body part and a marking of a further position and/or of a target region or target volume in the body part.
- Preferably, the data processing and image generating apparatus is embodied to access different data representing a respective body part, for example data obtained by computed tomography or data obtained by magnetic resonance imaging. Moreover, the data processing and image generating apparatus is accordingly embodied to generate an image, as desired, which image is based on data obtained by computed tomography or data obtained by magnetic resonance imaging. In this context, the image display and control unit is preferably embodied to display one or more control elements, which serve for the selection to be made between various data representing a respective body part and, hence, the corresponding image display. The image display and control unit is embodied to generate a control signal when an appropriate control element is actuated, which control signal causes the data processing and image generating apparatus to generate an image on the basis of the correspondingly selected data representing a body part of the patient.
- Moreover, the data processing and image generating apparatus is preferably embodied to store a displayed image in such a way that it can be recalled at a later time. This is therefore advantageous because, typically, the position of the instrument in the body part, and possibly the body part as well, change or move over time such that, typically, a currently reproduced image differs from an image reproduced at an earlier time. Therefore, it may be helpful to store an image at specific times, for example within the meaning of a screenshot. In this respect, the image display and control unit also preferably comprises a corresponding control element, wherein the image display and control unit generates a control signal when said control element is actuated, which control signal causes the data processing and image generating apparatus to store a respectively currently displayed image when the control element is actuated.
- Similarly, it may be desirable for the data processing and image generating apparatus to be embodied to store an image sequence in the style of a film. In order to trigger this, the image display and control unit also preferably comprises a corresponding control element, wherein the image display and control unit generates a control signal when said control element is actuated, which control signal causes the data processing and image generating apparatus to record an image sequence within the meaning of a film.
- In accordance with a particularly preferred embodiment variant, the display of the control element for triggering the recording of an image sequence is modified in the case of the actuation which starts the recording of an image sequence. Thus, on the basis of the display of the control element, the operator can himself identify that an image sequence is currently being recorded. The image display and control apparatus is furthermore preferably embodied for a second actuation of the control element for recording image sequences to again stop the recording of a respective image sequence. Preferably, the image display and control unit once again generates the original display of this control element prior to triggering the recording of an image sequence in the case of the respective second actuation of the control element.
- The invention is now intended to be explained in more detail on the basis of an exemplary embodiment, with reference being made to the figures. In detail:
-
FIG. 1 shows a medical system comprising an instrument, a position acquisition apparatus for this instrument, a data processing and image generating apparatus and an image display and, control unit; -
FIG. 2 shows a medical instrument and an associated position acquisition apparatus comprising a field generator for an alternating electromagnetic field, and a position sensor fixed with respect to the patient; -
FIG. 3 shows an example of an image generated by the data processing and image generating apparatus and displayed on the image display and control unit, together with control elements likewise displayed on the image display and control unit; and -
FIG. 4 shows a display of control elements displayed on the image display and control unit. -
FIG. 1 shows the components of a medical system, specifically aninstrument 16, afield generator 12 as part of a position acquisition apparatus and a data processing andimage generating apparatus 20, which is connected to thefield generator 12 and theinstrument 16 via cables 22 and 24, respectively. Moreover, figure shows an image display andcontrol unit 30, which can easily be held by one or two hands and is wirelessly connected to the data processing andimage generating apparatus 20. -
FIG. 2 shows, by way of a sketch, thehead 10 of a patient in a side view. Thefield generator 12 for generating an alternating electromagnetic field, which is to be acquired in the region of the head of the patient, is situated in the vicinity of thehead 10. A position sensor, which is fixed with respect to the patient, representing areference position sensor 14 or patient localizer is fastened to thehead 10 of the patient. Themovable instrument 16 comprises a proximal end with ahandle 18 and a distal end with an instrument position sensor. Thereference position sensor 14 and the instrument position sensor respectively comprise one or more electrical coils as sensor coils. The alternating electromagnetic field emanating from thefield generator 12 during operation respectively induces a current in the coils, the amplitude of which current depends on the relative position and alignment of a respective sensor coil in relation to thefield generator 12. Thus, it is possible, in a manner known per se, to determine the relative position and alignment (orientation) of the instrument position sensor in relation to the reference position sensor. - In order to use position values of an instrument, acquired by means of a position acquisition system, for instrument navigation within the meaning of a respectively current position of an instrument being displayed in slice images of a body part obtained e.g. by tomography, the position values supplied by the position sensor of the instrument must be transformed into a model coordinate system underlying a tomographic image. A transformation prescription required for this is obtained in a manner known per se by means of a registration method. By way of example, a surface of a body part is, to this end, scanned by means of a pointing or scanning instrument, and position values obtained in the process are transferred with the smallest possible error to a model surface derived from a tomograghic or topographic image. The scalings, rotations and/or translations or the like, which are required for this transfer which is as accurate as possible, finally result in the transformation prescription.
- The data processing and
image generating apparatus 20 can also be at a distance from the operation site, for example as part of a central data center. - The
instrument 16 may be a surgical instrument or a microscope, endoscope or different movable instrument. Theinstrument 16 need not necessarily be movable by hand, but may also be controlled by a robot. The image display andcontrol unit 30 is embodied as an independent unit, which communicates wirelessly at least with the data processing andimage generating apparatus 20, but can, for example, additionally also communicate with theinstrument 16 in order to be able to control, in particular, theinstrument 16 remotely by means of the image display andcontrol unit 30. By way of example, if theinstrument 16 is an endoscope, the alignment of the endoscope optical unit can be controlled by means of the image display andcontrol unit 30 to the extent that said optical unit can be aligned by remote control. If theinstrument 16 is a microscope, the display andcontrol unit 30 can be embodied to control the focus control of the microscope or the overriding or setting of the autofocus control of the microscope remotely. - As can be gathered from
FIG. 3 , the display andinput unit 32 of the image display andcontrol unit 30 displays both at least oneview 36 of a body part and one or more control elements 34, and also information icons 38. As already described above, theview 36 of a body part can be generated a data of a body part obtained from the data processing andimage generating unit 20 by way of e.g. computed tomography or magnetic resonance imaging. Additionally or alternatively, the depicted view can also be a respectively current endoscope or microscope recording. Preferably, both views displayed from data obtained by tomography and views recorded by means of an optical instrument, such as an endoscope or a microscope, are displayed simultaneously. The view of a respective body part is preferably displayed with a scale of 1:1 such that distances on the plane of the display andinput unit 32 of the image display andcontrol unit 30 correspond to distances in the respective plane of the body part. - Both the position of a
respective instrument 16 and also e.g. planning information, which is a result of preceding operation planning, are preferably displayed in the respective views of a body part. By way of example, such planning information can be the marking of a target region or a target volume in the respectively depictedview 36 of the body part. Other planning information can relate to the position and alignment of implants such as e.g. screws. If these are depicted in theview 36 of the body part, an operator can precisely align the real implant during the operation on the basis of the depicted planning information in theview 36 of the body part. - Control elements 34 depicted on the display and
input unit 32 can be gathered fromFIGS. 3 and 4 in an exemplary manner. By way of example, a first control element 34.1 and a second control element 34.2 serve for selecting the data representing a respective body part. - Thus, by actuating the first control element 34.1, a user can cause the
view 36 of the body part from data obtained by computed tomography to be displayed. By actuating the second control element 34.2, a user can cause theview 36 to be generated from data obtained by magnetic resonance imaging. In each case, actuating a respective control element 34.1 or 34.2 triggers the transmission of a corresponding control signal from the image display andcontrol unit 30 to the data processing and image generating unit. The latter then generates correspondingviews 36 of the body part and transmits these to the image display andcontrol unit 30, on the display andinput unit 32 of which thecorresponding view 36 is then depicted. - A third control element 34.3 enables snapshots to be recorded, either of a respectively
current view 36 of the body part only or else of the whole display, including the control elements, depicted on the display andinput unit 32. If the third control element 34.3 is actuated by a user, the image display andcontrol unit 30 generates a control signal which prompts the data processing andimage generating apparatus 20 to store a corresponding view in such a way that it can be recalled at a later time. - Similarly, a fourth control element 34.4 enables the recording of an image sequence to be triggered, which, in the style of a film, is stored either on the image display and
control unit 30 itself or else on the data processing andimage generating apparatus 20. The recording of such an image sequence is started with a respective first actuation of the fourth control element 34.4, while pressing the fourth control element 34.4 a second time stops the recording of the image sequence again. The display of the fourth control element 34.4 is modified after the first actuation thereof such that a user immediately knows that an image sequence is currently being recorded. If this recording of an image sequence is stopped again by a respective second actuation of the fourth control element 34.4, the fourth control element 34.4 is once again depicted in its original display format shown inFIGS. 3 and 4 . - Further control elements 34.6 and 34.7 serve, for example, for setting the contrast (control element 34.6) and brightness (control element 34.7) of the displayed view.
- An eighth control element enables a reset. By actuating the eighth control element 34.8, the original settings are restored.
- Using a ninth control element 34.9, positions can be marked in the depicted
view 36 of the body part. A tenth control element 34.10 enables switching between different display scales, wherein a display scale of 1:1 is preferred. - Moreover, the image display and
control unit 30 allows switching between various instruments that are connected wirelessly to the image display andcontrol unit 30, for example switching between endoscope and surgical instrument. - However, switching between various instruments can also be brought about automatically by an operator picking up a respective instrument. In this case, the respective instrument currently in use is displayed on the display and
input unit 32 by an information icon such as the icon 38.1. - From the interaction between the image display and
control unit 30 and aninstrument 16 in the form of an endoscope, a particularly advantageous application emerges to the extent that, for example, the attention can be focused on image points or positions, determined by the endoscope, in a two-dimensional plane or in a three-dimensional space (i.e., for example, these can be brought into the center of the endoscope image). A respective position can be stored by actuating a corresponding control element, either on the display andinput unit 32 of the image display andcontrol unit 30 or else on the endoscope itself. A plurality of such positions can subsequently be connected to one another in a polygonal train which, for example, describes a body cavity or else a cavity—more precisely: the contour thereof—artificially created by an operation (e.g. after removing a tumor). Such a polygonal train can then serve as a template for cutting out body tissue parts, which for example should serve for filling the artificially created cavity and are taken from a different position of the body of a patient. - Instead of generating a polygonal train from individual body positions driven to by means of the endoscope, provision can also be made for continuous tracking of the alignment, of the endoscope in order thus to generate a continuously recorded template. However, incorrect alignments of the endoscope while recording the template would also be recorded in the process.
- Moreover, the image display and
control unit 30 itself also allows a use to mark individual positions or else trace out depicted contours on theview 36 of a body part, for example by means of an input stylus, in order thus to generate the corresponding position data for generating a template. - A further function offered by the image display and
control unit 30 lies in the sensing of landmarks on theview 36 of the body part in order thus, for example, to bring various displays, such as e.g. an endoscopic recording and a view generated from data obtained by tomography, in line, to corresponding landmarks are assigned to one another in the various representations. - Provision can also be made for the image display and
control unit 30 to be able to be connected to various instruments and/or data processing andimage generating apparatuses 20 such that a plurality of operations can be tracked by means of a single image display andcontrol unit 30 by switching between different data processing andimage generating apparatuses 20. - Basic settings for various users of an image display and
control unit 30 and/or basic settings for various image display andcontrol units 30 can be stored either on a respective image display andcontrol unit 30 or else on a corresponding data processing andimage generating apparatus 20, in particular if the latter is implemented in the form of a central server or data center. This renders it possible, particularly on a central data processing andimage generating apparatus 20 as well, to store basic settings for various users such that respectively different image display andcontrol units 30, even with different operating systems, can be used without a user having to adapt himself to in each case very different representation manners or pre-settings. Rather, the representation manners and pre-settings can respectively be realized to be the same, or at least similar, on various image display and control units, independently of a respectively specific image display andcontrol unit 30 and the specific operating systems thereof. - Moreover, it is possible for data to be stored in a respective image display and
control unit 30, which data either partly or completely describe a respective medical system. These can include instrument descriptions, as well as descriptions of the position acquisition apparatus or else of the data processing and image generating apparatus. Such data can be stored permanently in a respective image display andcontrol unit 30, or else can only be transmitted with the start of a respective application, for example from a corresponding data processing andimage generating apparatus 20 to a respective image display andcontrol unit 30. In the latter case, different image display andcontrol units 20 of different types or with different equipment can also, in particular, easily be replaced for one another. - Conversely, data which describe individual image display and
control units 30, optionally also individually for different users of a respective image display andcontrol unit 30, can also be stored in a respective data processing andimage generating apparatus 20. - In one extreme case, the complete data processing and
image generating apparatus 20 can also be integrated in a respective image display andcontrol unit 30. - Conversely, it is also possible for all essential information to be stored in the data processing and
image generating apparatus 20 such that, firstly, the image display andcontrol unit 30 can be kept quite simple and, secondly, all essential information is kept available centrally and therefore kept available for other users or image display andcontrol units 30 as well. By way of example, if the whole representation on a respective display andinput unit 32 of an image display andcontrol unit 30, including the positions and display formats of the control elements, is predetermined by a corresponding data processing andimage generating apparatus 20, it may be sufficient for a respective image display andcontrol unit 30 only to generate one control signal when a corresponding, depicted control element on the display and input unit is touched, which control signal reflects the respectively touched position on the display andinput unit 32. This information is then sufficient for the data processing andimage generating apparatus 20 to identify which control element was actuated on the image display andcontrol unit 30 or which position was marked on the displayedview 36 of a body part. - By virtue of, thus, all essential functionalities of the image display and
control unit 30 being in fact provided and executed by the data processing andimage generating apparatus 20, it is possible to provide simultaneous powerful functionalities and provide simple, in particular small and light, image display andcontrol units 30. Since, as explained above, the data processing andimage generating apparatus 20 also need not be in the direct vicinity of a user or operator, but may for example be realized in a central data center, a user or operator can, within his work surroundings, concentrate fully on his instruments and optionally resort to the image display and control unit for support. Since the latter optionally may also serve as remote control for the corresponding instruments of the user or operator (see above), this greatly simplifies the work of the user and operator at his workplace—for example in the operating theater. - In particular, an image display and
control unit 30 described here permits instrument-centered work of the user or operator, during which the latter can wholly concentrate on his instruments and is largely unburdened from further technical burdens. -
- 10 Patient head
- 12 Field generator
- 14 Position sensor fixed with respect to the patient
- 16 Movable instrument
- 18 Handle of the movable instrument
- 20 Data processing and image generating apparatus
- 22 Connecting cable
- 24 Instrument cable
- 30 Image display and control unit
- 32 Display and input, unit
- 34 Control element
- 36 View of a body part
- 38 Information icon
Claims (17)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102012205165A DE102012205165A1 (en) | 2012-03-29 | 2012-03-29 | Medical system with a position detection device for detecting the position and orientation of an instrument |
| DE102012205165.1 | 2012-03-29 | ||
| PCT/EP2013/056802 WO2013144334A1 (en) | 2012-03-29 | 2013-03-28 | Medical navigation system with wirelessly connected, touch-sensitive screen |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2013/056802 A-371-Of-International WO2013144334A1 (en) | 2012-03-29 | 2013-03-28 | Medical navigation system with wirelessly connected, touch-sensitive screen |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US17/724,394 Continuation US20230065741A1 (en) | 2012-03-29 | 2022-04-19 | Medical navigation system with wirelessly connected, touch-sensitive screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20150087968A1 true US20150087968A1 (en) | 2015-03-26 |
| US11337661B2 US11337661B2 (en) | 2022-05-24 |
Family
ID=48049997
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/387,722 Active 2035-11-29 US11337661B2 (en) | 2012-03-29 | 2013-03-28 | Medical navigation system with wirelessly connected, touch-sensitive screen |
| US17/724,394 Pending US20230065741A1 (en) | 2012-03-29 | 2022-04-19 | Medical navigation system with wirelessly connected, touch-sensitive screen |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US17/724,394 Pending US20230065741A1 (en) | 2012-03-29 | 2022-04-19 | Medical navigation system with wirelessly connected, touch-sensitive screen |
Country Status (5)
| Country | Link |
|---|---|
| US (2) | US11337661B2 (en) |
| EP (1) | EP2830526B1 (en) |
| CN (1) | CN104349739A (en) |
| DE (1) | DE102012205165A1 (en) |
| WO (1) | WO2013144334A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150305691A1 (en) * | 2014-04-24 | 2015-10-29 | Siemens Aktiengesellschaft | Method and magnetic resonance apparatus for image monitoring of a medical interventional procedure |
| US11357574B2 (en) | 2013-10-31 | 2022-06-14 | Intersect ENT International GmbH | Surgical instrument and method for detecting the position of a surgical instrument |
| US11430139B2 (en) | 2019-04-03 | 2022-08-30 | Intersect ENT International GmbH | Registration method and setup |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE202013012313U1 (en) | 2013-07-17 | 2016-02-25 | Fiagon Gmbh | Device for connecting a medical instrument to a position detection system and medical pointer instrument |
| US11202010B2 (en) * | 2017-03-29 | 2021-12-14 | Sony Olympus Medical Solutions Inc. | Control device, external device, medical observation system, control method, display method, and program |
| US10145747B1 (en) * | 2017-10-10 | 2018-12-04 | Auris Health, Inc. | Detection of undesirable forces on a surgical robotic arm |
| WO2019083805A1 (en) * | 2017-10-23 | 2019-05-02 | Intuitive Surgical Operations, Inc. | Systems and methods for presenting augmented reality in a display of a teleoperational system |
| DE102022103302A1 (en) | 2022-02-11 | 2023-08-17 | Marcel Sieler | projection display |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040263535A1 (en) * | 2003-04-25 | 2004-12-30 | Rainer Birkenbach | Visualization device and method for combined patient and object image data |
| US20060264749A1 (en) * | 2004-11-24 | 2006-11-23 | Weiner Allison L | Adaptable user interface for diagnostic imaging |
| US20070016034A1 (en) * | 2005-07-15 | 2007-01-18 | Brenda Donaldson | Integrated physiology and imaging workstation |
| US20070034731A1 (en) * | 2005-08-01 | 2007-02-15 | Tony Falco | System and method for detecting drifts in calibrated tracking systems |
| US20070070194A1 (en) * | 2005-09-29 | 2007-03-29 | Fujinon Corporation | Electronic endoscope system |
| US20070111726A1 (en) * | 2005-11-15 | 2007-05-17 | Sony Ericsson Mobile Communications Ab | User profiles for mobile terminals |
| US20080077158A1 (en) * | 2006-06-16 | 2008-03-27 | Hani Haider | Method and Apparatus for Computer Aided Surgery |
| US20110015523A1 (en) * | 2008-10-31 | 2011-01-20 | Olympus Medical Systems Corp. | Ultrasound observation apparatus |
| US20110118557A1 (en) * | 2009-11-18 | 2011-05-19 | Nellcor Purifan Bennett LLC | Intelligent User Interface For Medical Monitors |
| US20150182297A1 (en) * | 2011-12-22 | 2015-07-02 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Multi-user touch-based control of a remote catheter guidance system (RCGS) |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE20220584U1 (en) * | 2002-06-15 | 2004-04-01 | Joimax Gmbh | Display and control device for use in keyhole surgery for controlling the recording, display and storage of optical information has a combined display and operating unit |
| US20040044295A1 (en) * | 2002-08-19 | 2004-03-04 | Orthosoft Inc. | Graphical user interface for computer-assisted surgery |
| US20050020909A1 (en) * | 2003-07-10 | 2005-01-27 | Moctezuma De La Barrera Jose Luis | Display device for surgery and method for using the same |
| JP2006000538A (en) * | 2004-06-21 | 2006-01-05 | Olympus Corp | Operating theater controlling system |
| CN100484591C (en) * | 2005-04-18 | 2009-05-06 | 史荣 | Method for positioning radioactive treatment |
| DE102006003610B4 (en) * | 2006-01-25 | 2012-06-06 | Siemens Ag | Device for interventional therapy |
| DE502006002276D1 (en) * | 2006-10-26 | 2009-01-15 | Brainlab Ag | Integrated medical tracking system |
| US7937163B2 (en) * | 2008-03-04 | 2011-05-03 | Olympus Medical Systems Corp. | Medical control device and its system |
| US20110178389A1 (en) * | 2008-05-02 | 2011-07-21 | Eigen, Inc. | Fused image moldalities guidance |
| EP2179703B1 (en) * | 2008-10-21 | 2012-03-28 | BrainLAB AG | Integration of surgical instrument and display device for supporting image-based surgery |
| US8641621B2 (en) * | 2009-02-17 | 2014-02-04 | Inneroptic Technology, Inc. | Systems, methods, apparatuses, and computer-readable media for image management in image-guided medical procedures |
| KR20120008059A (en) * | 2009-04-20 | 2012-01-25 | 인비져니어 메디컬 테크놀로지스, 인코포레이티드 | Imaging system |
| US9888973B2 (en) * | 2010-03-31 | 2018-02-13 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Intuitive user interface control for remote catheter navigation and 3D mapping and visualization systems |
| US8827948B2 (en) * | 2010-09-17 | 2014-09-09 | Hansen Medical, Inc. | Steerable catheters |
-
2012
- 2012-03-29 DE DE102012205165A patent/DE102012205165A1/en not_active Withdrawn
-
2013
- 2013-03-28 WO PCT/EP2013/056802 patent/WO2013144334A1/en not_active Ceased
- 2013-03-28 US US14/387,722 patent/US11337661B2/en active Active
- 2013-03-28 EP EP13714616.3A patent/EP2830526B1/en active Active
- 2013-03-28 CN CN201380022627.0A patent/CN104349739A/en active Pending
-
2022
- 2022-04-19 US US17/724,394 patent/US20230065741A1/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040263535A1 (en) * | 2003-04-25 | 2004-12-30 | Rainer Birkenbach | Visualization device and method for combined patient and object image data |
| US20060264749A1 (en) * | 2004-11-24 | 2006-11-23 | Weiner Allison L | Adaptable user interface for diagnostic imaging |
| US20070016034A1 (en) * | 2005-07-15 | 2007-01-18 | Brenda Donaldson | Integrated physiology and imaging workstation |
| US20070034731A1 (en) * | 2005-08-01 | 2007-02-15 | Tony Falco | System and method for detecting drifts in calibrated tracking systems |
| US20070070194A1 (en) * | 2005-09-29 | 2007-03-29 | Fujinon Corporation | Electronic endoscope system |
| US20070111726A1 (en) * | 2005-11-15 | 2007-05-17 | Sony Ericsson Mobile Communications Ab | User profiles for mobile terminals |
| US20080077158A1 (en) * | 2006-06-16 | 2008-03-27 | Hani Haider | Method and Apparatus for Computer Aided Surgery |
| US20110015523A1 (en) * | 2008-10-31 | 2011-01-20 | Olympus Medical Systems Corp. | Ultrasound observation apparatus |
| US20110118557A1 (en) * | 2009-11-18 | 2011-05-19 | Nellcor Purifan Bennett LLC | Intelligent User Interface For Medical Monitors |
| US20150182297A1 (en) * | 2011-12-22 | 2015-07-02 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Multi-user touch-based control of a remote catheter guidance system (RCGS) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11357574B2 (en) | 2013-10-31 | 2022-06-14 | Intersect ENT International GmbH | Surgical instrument and method for detecting the position of a surgical instrument |
| US20150305691A1 (en) * | 2014-04-24 | 2015-10-29 | Siemens Aktiengesellschaft | Method and magnetic resonance apparatus for image monitoring of a medical interventional procedure |
| US11430139B2 (en) | 2019-04-03 | 2022-08-30 | Intersect ENT International GmbH | Registration method and setup |
Also Published As
| Publication number | Publication date |
|---|---|
| EP2830526B1 (en) | 2019-05-15 |
| US20230065741A1 (en) | 2023-03-02 |
| WO2013144334A1 (en) | 2013-10-03 |
| DE102012205165A1 (en) | 2013-10-02 |
| EP2830526A1 (en) | 2015-02-04 |
| CN104349739A (en) | 2015-02-11 |
| US11337661B2 (en) | 2022-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230065741A1 (en) | Medical navigation system with wirelessly connected, touch-sensitive screen | |
| CN108735290B (en) | Medical imaging device and method for supporting a person using a medical imaging device | |
| US12357392B2 (en) | Navigational aid | |
| US20220079686A1 (en) | 3d navigation system and methods | |
| JP5190510B2 (en) | Multifunctional robotized platform for neurosurgery and position adjustment method | |
| CA3011314C (en) | Methods and systems for providing visuospatial information | |
| CA2976516C (en) | Navigational feedback for intraoperative waypoint | |
| KR101152177B1 (en) | Method and System for Automatic Leading Surgery Position and Apparatus Having Surgery Position Leading Function | |
| US7725162B2 (en) | Surgery system | |
| JP6129307B2 (en) | Dedicated user interface for interstitial intervention under MR guidance | |
| EP3860492A1 (en) | Feature identification | |
| CN113786152B (en) | Endoscope lens tracking method and endoscope system | |
| US20190231436A1 (en) | Anatomical model for position planning and tool guidance of a medical tool | |
| KR20170125360A (en) | A method and apparatus for using a physical object to manipulate corresponding virtual objects in a virtual environment, | |
| US20070038065A1 (en) | Operation of a remote medical navigation system using ultrasound image | |
| JP2018126498A (en) | Robot navigation for robotic surgical system | |
| US10846883B2 (en) | Method for calibrating objects in a reference coordinate system and method for tracking objects | |
| CN105596005A (en) | System for providing visual guidance for steering a tip of an endoscopic device towards one or more landmarks and assisting an operator in endoscopic navigation | |
| EP3695412A1 (en) | Medical guidance system and method using localized plane | |
| CN108433809A (en) | Equipment for being arranged during surgical procedure and retrieving reference point | |
| JP7323672B2 (en) | Computer-assisted surgical navigation system for spinal procedures | |
| CN109549706A (en) | A kind of surgical operation auxiliary system and its application method | |
| JP2022517807A (en) | Systems and methods for medical navigation | |
| US20220175485A1 (en) | Method for operating a visualization system in a surgical application, and visualization system for a surgical application | |
| JP4717683B2 (en) | Medical image display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: FIAGON GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KRUGER, TIMO;MUCHA, DIRK;ROSE, ANDREAS;AND OTHERS;SIGNING DATES FROM 20141012 TO 20141103;REEL/FRAME:034215/0718 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
| AS | Assignment |
Owner name: FIAGON GMBH, GERMANY Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE THE NAME OF ASSIGNOR TIMO KRUGER TO TIMO KRUEGER PREVIOUSLY RECORDED ON REEL 034215 FRAME 0718. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:KRUEGER, TIMO;MUCHA, DIRK;ROSE, ANDREAS;AND OTHERS;SIGNING DATES FROM 20141012 TO 20141103;REEL/FRAME:057909/0412 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| AS | Assignment |
Owner name: INTERSECT ENT GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FIAGON GMBH;REEL/FRAME:059137/0308 Effective date: 20220124 Owner name: INTERSECT ENT GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FIAGON GMBH;REEL/FRAME:059137/0218 Effective date: 20220124 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| AS | Assignment |
Owner name: FIAGON GMBH, GERMANY Free format text: CHANGE OF NAME;ASSIGNOR:INTERSECT ENT GMBH;REEL/FRAME:065710/0229 Effective date: 20220531 |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |