[go: up one dir, main page]

WO2009070161A1 - Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits - Google Patents

Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits Download PDF

Info

Publication number
WO2009070161A1
WO2009070161A1 PCT/US2007/085667 US2007085667W WO2009070161A1 WO 2009070161 A1 WO2009070161 A1 WO 2009070161A1 US 2007085667 W US2007085667 W US 2007085667W WO 2009070161 A1 WO2009070161 A1 WO 2009070161A1
Authority
WO
WIPO (PCT)
Prior art keywords
site
light
images
tool
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2007/085667
Other languages
English (en)
Inventor
Eric Seibel
Michael Kimmey
Richard Johnston
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Washington
Original Assignee
University of Washington
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Washington filed Critical University of Washington
Priority to JP2010535939A priority Critical patent/JP2011504783A/ja
Priority to EP07854804A priority patent/EP2224841A4/fr
Priority to PCT/US2007/085667 priority patent/WO2009070161A1/fr
Publication of WO2009070161A1 publication Critical patent/WO2009070161A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064—Constructional details of the endoscope body
    • A61B1/00071—Insertion part of the endoscope body
    • A61B1/0008—Insertion part of the endoscope body characterised by distal tip features
    • A61B1/00097—Sensors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00172—Optical arrangements with means for scanning
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B17/28—Surgical forceps
    • A61B17/29—Forceps for use in minimally invasive surgery
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/30—Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361—Image-producing devices, e.g. surgical cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B17/068—Surgical staplers, e.g. containing multiple staples or clamps
    • A61B17/072—Surgical staplers, e.g. containing multiple staples or clamps for applying a row of staples in a single action, e.g. the staples being applied simultaneously
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/00017—Electrical control of surgical instruments
    • A61B2017/00022—Sensing or detecting at the treatment site
    • A61B2017/00057—Light
    • A61B2017/00061—Light spectrum
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/373—Surgical systems with images on a monitor during operation using light, e.g. by using optical scanners

Definitions

  • an exemplary novel imaging system has been developed to provide imaging of a site, thereby facilitating use of one or more tools or components at the site by enabling the site to be remotely viewed while the one or more tools or components are being used at the site.
  • an initial application of an exemplary embodiment of the system is in the medical field for use in imaging an internal site within a patient's body, the system is clearly not limited to such an application, since as noted above, this novel technology can be employed in many other fields and applications that are unrelated to medical technology.
  • the imaging system includes a plurality of imaging devices that are coupled to at least one elongate flexible shaft.
  • the at least one elongate flexible shaft conveys signals between the plurality of imaging devices and a proximal end of each of the elongate flexible shafts, and the signals are usable to image the site.
  • at least one of the plurality of imaging devices includes a scanning device from which light is emitted in a predefined scanning pattern directed to illuminate one or more parts of the site.
  • the plurality of imaging devices also includes a plurality of light receivers that receive and respond to light from the site, each light receiver producing an output signal that is usable to produce at least a portion of an image corresponding to the light that was received.
  • the system also includes means for combining output signals from the light receivers, to produce an overall image that differs from at least the portion of the image produced using the output signal from only one of the light receivers.
  • the overall image provides a view of the site that facilitates use of the one or more tools or other components at the site.
  • the plurality of imaging devices are configured to be coupled to an existing tool or other component. Also, in some embodiments, at least one of the imaging devices is disposed at a distal end of the tool, so that for a plurality of different images of the site, at least portions of the different images, relative to the distal end of the tool or other component, are represented by the output signals produced by the plurality of light receivers. The means for combining the output signals then produces an overall image corresponding to a portion of the overall image viewed from the distal end of the tool or other component.
  • At least one of the imaging devices can be disposed at a position that is proximate to, but proximal of a distal end of the tool, so that at least portions of a plurality of different images of the site, relative to the position proximal of the distal end of the tool or other component, are represented by the output signals produced by the plurality of imaging devices.
  • the means for combining the output signals can then produce an overall image corresponding to a portion of the overall image viewed at the position proximal of the distal end of the tool or other component.
  • the means for combining can include an interface configured to couple with the proximal end of the flexible shaft.
  • the interface is used for receiving the output signals from the plurality of imaging devices.
  • Also included in the means for combining is a memory that stores machine instructions, and a processor that is coupled with the interface and the memory.
  • the processor executes the machine instructions to graphically combine at least portions of a plurality of different images represented by the output signals produced by the plurality of imaging devices, to produce the overall image of the site, which can then be presented to a user on a display.
  • Each of the output signals produced by the plurality of imaging devices can represent a different image of at least a portion of the site.
  • the output signals produced by the plurality of imaging devices can also represent at least portions of images corresponding to views from disparate positions, as noted above. These views are usable to produce either a stereo view of the site or separate perspective images of the site.
  • the plurality of imaging devices can produce output signals in response to different wavebands of light.
  • the output signals can be employed to produce different images of the site on a display, each at one of the different wavebands.
  • the different images can include one or more images selected from the group consisting of: a deep tissue infrared image, a shallow tissue ultraviolet image, a backscatter color image, a fluorescent image, a pseudo-color image, images at different spatial resolutions, and images at different temporal resolutions.
  • the plurality of imaging devices are disposed on a plurality of tools or components.
  • the tools or other components in this exemplary system are: a cutting tool, a grasping tool, a suturing tool, a clamping tool, a stapling tool, a needle probe, a catheter, a therapeutic or diagnostic energy source tool, a tool for absorbing energy from tissue, a tool for infusing a fluid, a tool for removing a fluid, and a component for introducing other tools to the site.
  • Each scanning device can include a cantilevered light guide having a proximal end that is coupled to an optical fiber disposed within the elongate flexible shaft and a distal end that is free to be moved in the predefined scanning pattern. Light emitted from the distal end in the predefined scanning pattern illuminates the site.
  • the optical fiber is configured to couple to a light source and to convey light from the light source to the cantilevered light guide.
  • a scanning driver can be coupled to receive a drive signal supplied through electrical leads extending through the elongate flexible shaft.
  • the scanning driver In response to the drive signal, the scanning driver produces a driving force that causes the cantilevered light guide to move in a desired scanning pattern, so that light exiting the cantilevered light guide is directed toward the site and illuminates the site as the distal end of the cantilevered light guide moves in the desired scanning pattern.
  • the cantilevered light guide includes a cantilevered optical fiber having a distal end that is driven to move in the desired scanning pattern when scanning.
  • Each light receiver can include either a light sensor that produces the output signal, an optical fiber that conveys the light received from the site, so that the light is conveyed toward a proximal end of the elongate flexible shaft, a charge coupled device (CCD) array, or a complementary metal-oxide-semiconductor (CMOS) array.
  • CMOS complementary metal-oxide-semiconductor
  • At least one scanning device can include a confocal scanning device that includes an optical fiber disposed within the elongate flexible shaft.
  • the optical fiber is then configured so that a proximal end of the optical fiber is able to couple to a light source and to convey light from the light source to a distal end of the optical fiber.
  • the optical fiber also couples to one of the light receivers that responds to light from the site and conveys light both to and from the site.
  • a scanning driver drives the confocal scanning device to scan at least a portion of the site in the predefined scanning pattern.
  • a lens focuses light emitted from the confocal scanning device to a spot on the site and focuses light received from the spot onto the confocal scanning device, so that substantially only light emitted from the confocal scanning device produces the light received from the spot.
  • At least one scanning device includes a pivotal reflective surface that is coupled to an optical fiber disposed within the elongate flexible shaft and pivotally mounted to reflect light conveyed by the optical fiber. Also included is a scanning driver that is coupled to receive a drive signal supplied through electrical leads extending through the elongate flexible shaft. In response to the drive signal, the scanning driver produces a driving force that causes the pivotal reflective surface to move in the predefined scanning pattern, so that light reflected from the pivotal reflective surface is directed toward the site, scanning the site with the light.
  • Another aspect of this novel technology is directed to a method for imaging a site to facilitate use of one or more tools or components at the site by enabling the site to be remotely viewed while the tool is being used.
  • the method includes steps that are generally consistent with the functions performed by the components of the system discussed above.
  • Still another aspect of the technology disclosed herein is directed to a system and a method for providing imaging capability to a plurality of tools or other components for use in imaging a site from a plurality of disparate positions at which the plurality of tools or components are disposed.
  • the system includes at least one scanning device.
  • Each scanning device is configured to be supported proximate a distal end of one of a plurality of the tools or components used at the site and is coupled to an elongate flexible shaft employed for conveying light between a proximal end of the elongate flexible shaft and the scanning device.
  • the light is directed in a predefined scanning pattern by the scanning device to illuminate at least part of the site.
  • a plurality of light receivers are configured to be supported proximate the distal ends of each of a plurality of tools or components, so that a position and an orientation of each of the plurality of light receivers are dependent upon a disposition of the tool or component by which the light receiver is supported.
  • Each light receiver receives light from the site for use in producing an image of at least a portion of the site.
  • the corresponding method includes steps that are generally consistent with the functions performed by the elements of the system.
  • FIGURE 1 is a functional block diagram illustrating components of an exemplary system having a single base station suitable for imaging using multiple probes, and including a functional interface that, depending upon the embodiment desired, can provide different alternative functions in connection with the probes;
  • FIGURE 2 is a schematic diagram of an exemplary approach for providing serial switching of light from a single source, so that the light is delivered sequentially to a plurality of different probes, for imaging purposes;
  • FIGURE 3 is a schematic diagram of an exemplary configuration for providing parallel illumination to a plurality of probes using light of the same wavelengths from three different wavelength sources;
  • FIGURE 4 is a schematic diagram illustrating an exemplary configuration for splitting optical signals of different wavelengths between a plurality of different probes used to image a site;
  • FIGURE 5 is a more detailed functional block diagram of an exemplary system for imaging a site with scanning devices disposed at the distal ends of a plurality of tools, catheters, and/or conduits;
  • FIGURE 6 is a schematic illustration showing how separable signals for two scan illuminators are used in a synchronous - frame sequential scheme for imaging a site;
  • FIGURE 7 is a schematic illustration showing how separable signals for two scan illuminators are used in an asynchronous or synchronous scheme for imaging a site;
  • FIGURE 8A is a schematic diagram illustrating how an internal site can be imaged in a multi-perspective view using detectors disposed on the distal ends of a plurality of spaced-apart instruments or tools;
  • FIGURE 8B is a cross-sectional view of a distal portion of an exemplary tool showing how light entering a side window is conveyed through a multimode optical fiber to a proximal end of the tool;
  • FIGURE 9A is a schematic diagram illustrating how an internal site that includes otherwise obscured areas can be imaged using detectors disposed on the distal ends of a plurality of spaced-apart instruments or tools;
  • FIGURE 9B is a schematic diagram of a distal end of an exemplary forceps tool, illustrating the disposition of a scanned illuminator and a light collection optical fiber;
  • FIGURE 10 is a schematic view of a portion of a stomach and duodenum, showing how an exemplary mothertool is used for imaging forward, while a childtool with distal imaging capability is advanced through a side port of the mothertool and advanced through a lumen leading to the bile duct and major pancreatic duct;
  • FIGURE HA is a schematic view of a stomach, showing how a motherscope with forward imaging and a childtool with imaging capability are used to image a region of interest (ROI) along a wall of the stomach;
  • ROI region of interest
  • FIGURE HB is a schematic view of exemplary images of a ROI along the wall of the stomach, as displayed to the user of the motherscope and childtool of FIGURE 1 IA;
  • FIGURE 12 is a cross-sectional view of an exemplary scanning fiber distal tip for use in imaging a site at a distal end of a tool, catheter, or conduit;
  • FIGURE 13 is a schematic cross-sectional side view of a conduit provided with distal imaging and used to convey a forceps tool having distal imaging, to image multiple views of an internal site;
  • FIGURE 14A illustrates a central forward-viewing scanning fiber endoscope (SFE) having a plurality of side-viewing SFEs and a track for conveying a tool to a distal end of the configuration;
  • SFE central forward-viewing scanning fiber endoscope
  • FIGURE 14B illustrates a central forward- viewing scanning fiber endoscope (SFE) having a plurality of side-viewing SFEs as well as a plurality of conduits with optional side ports for conveying one or more tools with imaging capability to an internal site;
  • SFE central forward- viewing scanning fiber endoscope
  • FIGURE 15 is a schematic illustration of a distal end of a conduit that can convey one or more tools to a site, which has a plurality of scanning devices mounted around its circumference so that any two or more opposite pairs of scanning devices can be employed for stereographic viewing to provide an image with depth information of a site at which one or more tools are being used;
  • FIGURE 16A is a schematic elevational view of a distal portion of an exemplary embodiment of an array of confocal imaging devices, showing details of one of the confocal imaging devices;
  • FIGURE 16B is a schematic elevational view of a distal surface or end of a tool that includes the array of confocal imaging devices of FIGURE 16 A;
  • FIGURE 17 is a cut-away view of a distal end of an alternative exemplary embodiment of an array of imaging devices that uses a common lens assembly for focusing light onto a site and receiving light from the site for all of the confocal imaging devices in the array;
  • FIGURE 18A is a schematic view of the distal end of an exemplary
  • FIGURE 18B is a schematic view of the distal end of the 2x2 array of the confocal imaging devices of FIGURE 18 A, at a later time B (or after a displacement of the array has occurred), showing that the vertical displacement has caused an overlap of the scanned areas, which can produce images that can more readily be stitched together to form an overall image of the site;
  • FIGURE 19A illustrates four exemplary overlapping images of a pancreatic carcinoma;
  • FIGURE 19B illustrates an exemplary (simulated) result of stitching together the four images of FIGURE 19A to produce an overall image of the site in which the pancreatic carcinoma is readily evident;
  • FIGURE 2OA is a schematic illustration of an existing tool, i.e., a tissue stapler tool, illustrating how an imaging device is coupled to the existing tool with a sheath, to enable imaging of a site where the tool is being used;
  • FIGURE 2OB is a cross-sectional view of the example of
  • FIGURE 2OA
  • FIGURE 2OC is a cross-sectional view of an alternative exemplary embodiment illustrating how two imaging devices can be coupled with a sheath to the existing tool illustrated in FIGURE 2OA.
  • FIGURE 1 illustrates an exemplary system that includes a single base station 20 that is used for imaging with multiple probes, which can be imaging devices disposed on one or more tools, or other components that are used at the site being imaged.
  • Base station 20 includes a computer 22, which can be a general purpose personal computer or may be a more dedicated computing device specifically designed for the purpose of supporting the system for imaging with a plurality of probes.
  • Computer 22 is coupled to a keyboard 24 that is used for input of text and control actions by a user, and to a pointing device 26, which can be mouse, trackball, or other type of device for controlling a position of a cursor and making selections on a graphic display, as input to computer 22.
  • first monitor 28 and a second monitor 30 which can be used for displaying the images produced in response to output signals produced by a plurality of SFE probes 36 (labeled also as probes A, B, C, and D). It will be understood, that this system in not limited to only four such probes, but may include either more or fewer SFE probes, or may use other types of imaging devices.
  • Computer 22 is in bi-directional communication with an SFE scanner/controller and light sources/detectors box 32 via one or more optical fibers 38. Further details of the configuration of box 32 are discussed below.
  • the SFE scanner/controller and light sources/detectors are also in communication with a functional interface 34 through which signals are conveyed to and from the plurality of SFE probes.
  • Functional interface 34 is controlled by computer 22, which enables it to carry out one of at least four alternative functions, depending upon the particular configuration being used for the imaging system, as explained in detail below. These alternative functions include the use of the functional controller for serial switching of Red, Green, and Blue (RGB) laser light produced by the SFE light sources in box 32 between the plurality of SFE probes used in the system.
  • RGB Red, Green, and Blue
  • serial switching is carried out, for example, using a MEMS (or galvanometer controlled) mirror switch, as explained below in connection with FIGURE 2.
  • MEMS or galvanometer controlled mirror switch
  • all light received from the site being imaged using the plurality of SFE probes can be conveyed through collection optical fibers that extend from the distal ends of the SFE probes and are ganged together for group RGB light detection within box 32.
  • Functional interface 34 can alternatively be employed for carrying out the function of parallel probe illumination using multiple beamsplitters, as illustrated in detail in FIGURE 3, which is discussed below.
  • this parallel probe illumination mode the same wavebands of light are used for all SFE probes, and either frame sequential or pixel sequential time multiplexing will be applied in providing the light to each of the plurality of SFE probes.
  • FIGURE 3 illustrates an exemplary configuration showing how this mode can be implemented, as discussed in detail below.
  • a third alternative functionality provided by functional interface 34 is splitting optical signals. This mode of operation, separate RGB illumination fibers encompass different wavebands for multi-probe use. The light signals received from a site are then simultaneously split into separate wavebands before being detected. Further details are provided in connection with an example of this configuration shown in FIGURE 4. [0057] Finally, the functions performed by functional interface 34 can include the modulation of the light supplied to each different scanning device from the one or more light sources, so that the light supplied to each different scanning device is modulated differently than the light supplied to any other scanning device.
  • the light received by one or more light receivers that are associated with a specific scanning device can be detected, producing output signals that are also demodulated with the matching demodulation, so that light modulated with a different demodulation will be filtered out.
  • the modulation/demodulation that is applied by functional interface 34 can be either amplitude modulation (AM) demodulation or frequency modulation (FM) demodulation, enabling the demodulation function to readily discriminate at a specified carrier frequency between the output signals produced by detecting the light from different light receivers, so that crosstalk between the different channels of imaging devices is avoided.
  • AM amplitude modulation
  • FM frequency modulation
  • RGB light (or more generally, light of the same waveband) from a source (not shown) is conveyed through an input optical fiber 42 and is emitted along a path 44 directed toward a lens 46.
  • Lens 46 focuses the light onto a MEMS mirror 48, which is coupled by a rotating shaft 50 to a rotational driver (not shown), so that the light is sequentially directed toward successive reflectors 52a, 52b, 52c, and 52d.
  • the light is reflected by each of the reflectors in succession toward a lens 54, which focuses the light into one of optical fibers 56.
  • optical fibers 56 there are four optical fibers 56, each of which conveys the light entering it from one of lenses 54 to one of probes A, B, C, or D.
  • the light is being reflected into the optical fiber that is coupled at its distal end to an SFE disposed on one of the tools or other components disposed at a site.
  • SFE senor disposed on one of the tools or other components disposed at a site.
  • only one of the probes is energized at a time, determined by controlling rotation of the MEMS mirror switch. It should be noted that it may be necessary to white balance each probe before it is used, to compensate for variations in coupling efficiency in serial switching configuration 40.
  • a galvanometer- controlled mirror can be used in place of a MEMS mirror 48.
  • an exemplary configuration 60 illustrates how a plurality of probes 76 (identified as A - X) can be simultaneously supplied with light of the same wavelength.
  • red light 62 from a source that is not shown enters from the left and is partially reflected by a frustrated total internal reflection (FTIR) cube beam splitter 68.
  • FTIR frustrated total internal reflection
  • the red light that is not reflected continues onto the left and is in turn also partially reflected. This process is repeated for each of the probes, until reaching a mirror or prism 70 for the last probe (i.e., for probe X), which reflects or redirects all of the remaining light downwardly toward a dichroic longpass beam splitter 72.
  • FTIR frustrated total internal reflection
  • Dichroic longpass beam splitter 72 is selected to transmit red light, but to reflect green light that has not been reflected by other dichroic longpass beam splitters that are in the path of green light 64 (entering from the left as shown in this Figure). Each preceding dichroic longpass beam splitter in this path reflects part of the green light downwardly, while transmitting red light that has been reflected downwardly from above. Thus, it will be apparent the dichroic longpass beam splitters 72 have the following characteristics: ⁇ cut > ⁇ green and ⁇ cut ⁇ ⁇ re d.
  • blue light 66 entering is partially reflected downwardly by each of a series of dichroic longpass beam splitters 74 that have been selected to partially reflect the blue light but to transmit red and green light that has been reflected downwardly from above.
  • the combined RGB light is transmitted toward lenses 78a and 78b, which focus the RGB light into singlemode optical fibers coupled to the probes 76 (A - X). These probes thus simultaneously receive RGB light from the three sources. It will be understood that additional or fewer different wavebands of light may be similarly simultaneously provided to either more or fewer probes.
  • RGB light 82 that includes different wavebands is directed toward an optical grating or prism 84, which reflects each different waveband along a different path toward photomultiplier tube (PMT) detection ports 86.
  • PMT photomultiplier tube
  • RGB light 82 includes red light covering the wavelength range 635 nm - 670 nm (such as might be produced using laser diodes (not shown)), green light with wavelengths of 514 nm, 532 nm, and 543 nm (which can be produced using an Argon-ion laser, doubled 1064 nm laser, or He-Ne laser), and blue light with wavelengths of 440 - 450 nm, or 468 - 478 nm (produced, for example, by using NichiaTM blue laser diodes). Blue light with a wavelength of 440 nm is thus received at a PMT detection port 88, while blue light with a wavelength of 450 nm is received at a PMT detection port 90.
  • RGB light 82 includes red light covering the wavelength range 635 nm - 670 nm (such as might be produced using laser diodes (not shown)), green light with wavelengths of 514 nm, 532 nm, and 543 nm (which
  • green light at wavelengths of 532 nm and 543 nm are received respectively, at PMT detection ports 92 and 94, while red light at wavelengths of 635 nm and 650 nm are received respectively, at PMT detections ports 96 and 98.
  • this approach can be employed to use a single optical fiber (for example, an optical fiber having a distal end disposed to receive the light from a site) to convey multiple wavebands of light that are then split optically into different wavebands for input into different channels.
  • the light that is thus split can also (or alternatively) include non-visible light, such as infrared or ultraviolet light.
  • the optical frequency of light emitted from laser diodes can be tuned by varying the environmental conditions, such as temperature, of the laser diode. For example cooling the laser diode below room temperature can typically shift the optical frequency by over 10 nm, providing at least two laser wavelengths for each laser diode in operation.
  • FIGURE 5 illustrates an exemplary system 100 that is usable to provide imaging of a site at multiple locations disposed at the distal ends of one or more tools or other components.
  • one or more light sources 102 i.e., numbering from 1 - N
  • the light provided to each scan illuminator by light sources 102 can be of the same waveband, or different wavebands, and can be controlled to be provided simultaneously, or serially to the scan illuminators.
  • the one or more tools or other components are positioned at the site to be imaged, for example, where the tools or other components are to be used, so that light conveyed through optical fibers 104 can be used for a scanned illumination of the site.
  • An initial application of this system would provide for imaging on medical tools or components that are disposed at an internal site within a patient's body; however, it is not intended that system 100 be limited to a medical application.
  • a modulator 106 is provided in the exemplary system of FIGURE 5 and is used to modulate light sources 102, based upon signals supplied by a scan controller 110 in response to commands from a computer 118.
  • the modulator acts as an optical switch to allow frame-to-pixel multiplexing by one or more scanning devices.
  • Direct modulation of laser diode light sources is one exemplary method of multiplexing among different scanning devices.
  • Laser diodes that can range in wavelength from ultraviolet, across the visible spectrum to infrared, can be directly modulated by switching their electrical power at rates above that of pixel sampling rates, e.g., greater than 20 million samples per second (>20 MHz).
  • laser diodes at can be directly modulated at rates above 50 MHz, and suitable laser diodes are available from Nichia (Japan).
  • suitable laser diodes are available from Nichia (Japan).
  • green GaN-based laser diodes were announced by Rohm (Kyoto, Japan) as producing light with a wavelength of 532 nm, and with high modulation rates to match that of blue laser diodes.
  • schemes for doubling the frequency of infrared laser diodes to achieve wavelengths of approximately 1064 nm have been prototyped by companies developing lasers for HDTV laser projection displays, which require the green light to be modulated at >50 MHz.
  • red laser diodes which produce light at wavelengths of about 630-670 nm can be directly modulated at >50 MHz and are available from many manufacturers, such as Sony and Sanyo (Japan).
  • the high modulation rates (>50MHz) of the laser diode light sources enable optical switching or multiplexing at pixel rates.
  • FIGURE 12 An exemplary forward viewing endoscope having a sub-millimeter scan illuminator and using a resonantly vibrating single optical fiber with a distal projection lens system and a ring of collection optical fibers surrounding the scanning fiber is illustrated in FIGURE 12 and discussed in detail below.
  • FIGURE 12 To provide pixel-rate multiplexing between two scanning fiber endoscopes using the same RGB laser wavelengths, pixels must be sampled between the two devices at twice the normal rate, i.e., at approximately 40 million samples per second.
  • the modulation rate of each light source can be significantly greater than the pixel sampling rates of a single imaging device.
  • a constant modulation rate of greater than 50 MHz can be used for the carrier frequency of the laser light sources, while the variation of the amplitude or AM (amplitude modulation) can occur as this beam of light is swept across the tissue.
  • AM amplitude modulation
  • the amplitude of this carrier wave can be employed to generate the image signal.
  • each imaging device can have its own carrier frequency specific channels or bands, which is analogous to the provision of different channels or stations in the radio transmission and reception arts. Since lasers emitting light in the ultraviolet to infrared wavelengths can be modulated at above the pixel rates, many cycles of laser illumination can be contained within one image pixel for AM signal detection without crosstalk from another probe imaging the same area.
  • computer 118 also is used for generating images based upon electrical signals that are received from optical detectors 108, and for scan calibration, colorimetry, and brightness control of light sources 102.
  • computer 118 can produce control signals that are applied to bend the tip of a catheter, endoscope, or other tool that is being introduced to the site to be imaged, to facilitate introducing the device to the site around corners through a bifurcated lumen or other passage.
  • Scan controller 110 also produces the scan actuator drive signals that are applied to each scan actuator (drive) 112 that is disposed at the distal end of the one or more tools or other components, to drive an optical fiber or mirror MEMS scanning device (not shown) to scan the site with light emitted in a desired predefined scanning pattern, such as a raster scan, helical scan, Lissajous pattern scan, etc.
  • a desired predefined scanning pattern such as a raster scan, helical scan, Lissajous pattern scan, etc.
  • a temperature control 114 is coupled to scan controller 110 and receives a temperature signal from each temperature sensor 116 disposed at the scanning illuminator, so that the scan controller can compensate for the temperature measured at the site.
  • a single temperature sensor 116 may be sufficient to monitor the temperature at the site, since temperature corrections can be applied to each scanning device used to image the site based upon the temperature thus sensed.
  • optical detectors 108 which can optionally be synchronized with the control of light sources 102, using a signal input from modulator 106.
  • the intent in providing such synchronization is to ensure that the optical fibers only provide an input signal corresponding to the light directed to the site by a specific one of the different scan illuminators, which may be of a different waveband than the light provided by a different one of the scan illuminators.
  • the electrical output signals from the optical detectors corresponds only to the light received from the site when the site was illuminated by only the specific scan illuminator.
  • the optical detectors can comprise PMTs, photodiodes, phototransistors, charge coupled arrays, or other light sensitive devices.
  • computer 118 can employ the electrical signals received from optical detectors 108 to produce displays of the images of the site on a display 1 monitor 28 (and/or on an optional display 2 touch screen or other monitor 30).
  • the data used to produce these images and other relevant data collected during the imaging of the site can be stored for later retrieval, use, and processing in a data storage 122, which may comprise a local or remote hard drive or optical storage media, for example.
  • FIGURE 6 illustrates a timing diagram and configuration 130 showing how different scan illuminators 140 and 142 can be energized to illuminate a site at different times, so that the light received from the site that is detected and used to produce images is synchronized with the source of the illumination of the site and not a mix of reflected light from the site for two different illumination light sources.
  • scan illuminator A in FIGURE 6 is controlled so that the illuminator produces a scanning light beam during successive time intervals 132 and then returns to a rest state during a time interval 134.
  • scan illuminator B which has been off and in a rest state, begins scanning for a time interval 136, and thereafter returns to its rest state during a time interval 138.
  • only one of the scan illuminators is actively scanning a site at a time.
  • FIGURE 6 illustrates scanning light 144 being emitted from a distal end 140 of scan illuminator A at a time T x , which is at a mid-spiral point 146 in a full helical scanning spiral scan 150 that scanning light 148 will produce at the end of time interval 132.
  • Scan illuminator B is at about a mid-point in its rest interval at time T x and is thus not providing any illumination of the site at that point in time.
  • FIGURE 7 An alternative approach for controlling scan illuminators A and B so that they produce separable light signals 166 and 168 (which can be asynchronous or synchronous) is illustrated in an exemplary configuration 160 in FIGURE 7.
  • a helical scanner 162 is provided with pulses 174 of light while producing a spiral scan 170 of a site.
  • a helical scanner 164 is provided with pulses 176 of light while producing a spiral scan 172.
  • the signal that energizes the light sources used for producing the respective spiral scans by these two scan illuminators can be synchronized with the detection of light from the site and can be pixel sequential. This approach reduces the photo-toxicity by spreading out tissue light exposure over time.
  • the pulse sequence for the light pulses used for each of the scan illuminators is shown in the lower portion of the Figure. Advantages of Imaging a Site from Multiple Positions
  • FIGURE 8A illustrates an example 180 showing the use of the present novel approach in laparoscopic surgery, wherein a multi-perspective view provided by imaging from a plurality of spaced-apart locations on the distal ends of a plurality of medical tools is useful in more effectively viewing the site on which the medical tools are being used.
  • the resulting shadowing of tissue 180 provided in the images of the site that is illuminated in this example by a single central scanner illuminator 184 included in the distal end of an endoscope 182 improves the perspective view of the tissue, so that details of the site are more evident.
  • the field of view (FOV) of the central scanner illuminator illuminates tissue 186 with light in a desired scanning pattern.
  • FOV field of view
  • a forceps tool 190 includes a return optical fiber 192 in its central core that also receives light from tissue 186 illuminated by the central scanner illuminator in the endoscope. The light reflected from the site enters the distal end of this return optical fiber in the forceps tool, between the open ends of forceps grippers 194a and 194b.
  • a third position for imaging the site is disposed on a cutting tool 196, which includes windows 198 that receive light reflected from tissue 186, but at a different angle than either return optical fiber 192 and the ring of optical fibers in the endoscope.
  • the light passing through windows 198 in the cutting tool is conveyed proximally through multimode optical fibers 200 (only one shown), as illustrated in the cross-sectional view of a portion of cutting tool 196 in FIGURE 8B.
  • the light enters windows 198 from the side of the cutting tool and is internally reflected multiple times at the interface between the cleaved distal end of multimode optical fiber 200 and the air, polymer, or metal interface in the cutting tool.
  • FIGURE 9A An advantage of imaging a site with a plurality of scan illuminators and detecting the light from a plurality of disparate locations on the distal ends of tools or components is illustrated in an example 210 shown in FIGURE 9A.
  • endoscope 182 extends through an abdominal wall 212.
  • Central scan illuminator 184 in the endoscope scans a portion 214 of tissue adjacent to the distal end of the endoscope with light in a desired scan pattern, and the ring of optical fibers 188 receive and convey light reflected from portion 214 of the tissue.
  • tissue at the internal site forms a ridge or hump, so that another portion 216 of the tissue is outside the FOV of the scan illuminator of endoscope 182, and another portion 218 of the tissue is hidden by the overhanging shape of the tissue ridge or hump, which is in a deep shadow relative to the FOV illumination of the central scan illuminator of endoscope 182.
  • two forceps tools 190a and 190b also extend through the abdominal wall, on opposite sides of endoscope 182.
  • Each of these forceps tools include a central scan illuminator 193 that illuminates the tissue, but from different directions and from positions that are on each side of the central scan illuminator in endoscope 182.
  • an object of interest such as a tumor 220, which is expected to interfere with the light from right forceps tool 190b illuminating a portion 218 of the tissue.
  • this light interference may result from an increased light absorption compared to the light absorption of surrounding tissue that can be detected by right forceps tool 190b or by another tool with imaging capability.
  • the increased absorption contrast may be detected from the backscattered optical signal to right forceps tool 190b illuminating portion 218 of the tissue.
  • the increased absorption contrast may be detected from the side scattered optical signal to endoscope 182, or be detected from the transmitted optical signal to left forceps tool 190a through portion 216 of the tissue.
  • the tools with imaging capability are sharing optical signals, to provide the user with enhanced shadowing from different perspectives and enabling both imaging in reflection and transmission within the same region of the body.
  • the illumination fields of view do not overlap directly, it may not be necessary to employ any method for reducing crosstalk.
  • FIGURE 9B As shown therein, the distal ends of scan illuminator 193 and of return optical fiber 192 that receives and collects light from a site are disposed between grippers 194a and 194b.
  • the forceps tool can image a site on which the forceps tool is being used to grip tissue or other material.
  • FIGURE 10 Another medical example 230 is provided in FIGURE 10, which schematically illustrates a motherscope 232 designed for being passed down an esophagus into a stomach 234 and passing then into a duodenum 236 of a patient.
  • Motherscope 232 includes a forward viewing scan illuminator and corresponding optical fibers for receiving light illuminated in the forward FOV ahead of a distal end 238 of the motherscope.
  • a side-viewing scan illuminator 240 is also provided at the distal end of the motherscope to scan toward the side, generally orthogonal to the longitudinal axis of the motherscope.
  • a return optical fiber that receives light reflected from tissue at the side of the distal end of the motherscope that was illuminated by the side-viewing scan illuminator.
  • the motherscope uses its imaging capability to assist an operator in advancing the distal end of the motherscope into the duodenum and for locating an opening 250 from the duodenum into a bile duct 246 and one main pancreatic duct 248.
  • Adjacent to side- viewing scan illuminator 240 is disposed a side port 241 through which extends a daughterscope 242 comprising a forceps tool that includes grippers 244a and 244b.
  • a forward-viewing scan illuminator Disposed on the distal end of daughterscope 242, between the two grippers (but not visible in this Figure) is a forward-viewing scan illuminator, generally configured as shown for forceps tool 190 in FIGURE 9B.
  • the FOV of this forward-viewing scan illuminator can be employed to assist the operator in advancing the forceps tool at the distal end of the daughterscope into either of the bile duct or the major pancreatic duct, to take a tissue sample, or for some other purpose.
  • the multiple imaging capability of the motherscope and daughterscope thereby greatly facilitate completing tasks of this nature by providing more complete imaging capability than might be accomplished with only a single image device.
  • FIGURE 1 IA illustrates an example 260 of a motherscope 262 having a forward-viewing scan illuminator 266 with a FOV 268 at its distal end, and a return optical fiber for receiving light from tissue and other objects within the FOV of the forward-viewing scan illuminator.
  • Motherscope 262 has been advanced into stomach 264 of a patient in this example.
  • a daughterscope 270 having forceps tool 272 at its distal end is also provided with a forward- viewing scan illuminator having a FOV 274 directed toward a region of interest (ROI) 276.
  • the forceps tool can thus readily image the ROI and selectively take a tissue sample where desired.
  • the forward-viewing scan illuminator on motherscope 262 and the forward-viewing scan illuminator on daughterscope 270 image the wall of the stomach at different distance from the ROI.
  • the forward- viewing scan illuminator on daughterscope 270 can have more highly focused light at the more closely located ROI 276 compared to motherscope 262, enabling a return optical fiber (not visible in this Figure) to receive reflected light to produce an image with greater spatial resolution than that produced in response to the light received from the return optical fiber in the motherscope, but with less depth of focus (DOF). Accordingly, providing these two scan illuminators with different characteristics of FOV and DOF can enhance the capability of the overall system to perform certain tasks.
  • daughterscope 270 can illuminate with light that causes fluorescence signals to be emitted from a site, and such signals are typically much weaker than backscattered laser illumination. Fluorescence signals can be used to form diagnostic images of the ROI, to gather information on the health of the tissue using a different mode of optical interrogation of the tissue. Simply positioning daughterscope 270 closer to ROI 276 than motherscope 262 will significantly increase the collection efficiency of the optical signal, since intension decays by (1/R) 2 , where R is the separation distance between distal tip of the daughterscope and the ROI.
  • daughterscope 270 may provide stereo, depth-enhanced viewing of the ROI or deeper tissue imaging using light at infrared optical frequencies and optional biomarker enhancement of tissue specific image contrast mechanisms.
  • FIGURE 1 IB illustrates the images of ROI 276 that are displayed to the user using the signals from motherscope 262 and daughterscope 270.
  • motherscope image 274 gastric rugae or folds 278 of the mucosa lining the stomach are displayed at low resolution with simple color imaging of the backscattered light.
  • an insert image provided by the extended daughterscope at a much closer separation distance R yielding a magnified view of gastric folds 278.
  • the contrast is enhanced by a topically applied fluorescence dye (e.g., acriflavine hydrochloride) that provides high-contrast fluorescence labeling of Helicobacter pylori or other bio-specific cells of interest that are not visible in the motherscope image.
  • fluorescence dye e.g., acriflavine hydrochloride
  • the motherscope image no longer has an unobstructed view of ROI 276.
  • the daughterscope view could be minimized and stitched into the obstructed part of the motherescope view using techniques described below.
  • Scanning fiber illuminator 300 includes a flexible single mode optical fiber 304 that passes through a patterned tube of piezoelectric material 306, which serves to drive a distal end 310 of the optical fiber to move in a desired scanning pattern.
  • Distal end 310 extends distally beyond the patterned tube of piezoelectric material and is cantilevered from it, adjacent to a distal end of the tool or other component on which the scanning fiber illuminator is mounted or supported.
  • the patterned tube of piezoelectric material is held in place by a piezo attachment collar 308.
  • Quadrant electrodes 314 are plated onto the patterned tube of piezoelectric material and can be selectively energized with an applied voltage in order to generate two axes of motion in distal end 310 of optical fiber 304.
  • Lead wires 316 carry electrical voltage signals to each of the quadrant electrodes to energize the piezoelectric material relative to each axis of motion and also convey temperature control signal to a temperature control (not shown).
  • the two axes in which the distal end of the optical fiber are driven are generally orthogonal to each other.
  • An amplified sine wave applied to one axis and a cosine wave applied to the other axis of the patterned tube of piezoelectric material can generate a circular scan, although those of ordinary skill in the art will understand that a variety of different scan patterns can be produced by appropriately moving distal end 310 of optical fiber 304.
  • An appropriate modulation of the amplitudes of the electrical voltage signals applied to the quadrant electrodes can create a desired area-filling two dimensional pattern for imaging with light emitted from distal end 310 of the optical fiber.
  • a few examples of the various scan patterns that can be achieved include a linear scan, a raster scan, a sinusoidal scan, a toroidal scan, a spiral scan, and a propeller scan.
  • the distal end of the optical fiber is driven so that it moves at about its resonant (or near-resonant) frequency, which enables a greater scan amplitude to be achieved for the given drive signals applied.
  • MEMS scanner (not shown) that has a scanning beam used to optically scan an internal site with light to produce an image of the internal site that might instead be used.
  • An example of a MEMS scanner for imaging is shown in commonly assigned U.S. Patent No. 6,975,898, the disclosure and specification of which are specifically hereby incorporated herein by reference.
  • a reflective mirror can also be driven to scan a site with light conveyed to the distal end of a tool or other component, as will be known to those of ordinary skill.
  • Light emitted from distal end 310 as it moves in the desired scan pattern travels through lenses 318, 320, and 322 and is directed at a site forward of the scanning fiber illuminator.
  • the overall diameter of the scanning fiber illuminator is typically 1.0 mm or less.
  • Light reflected or scattered by the site illuminated with the scanning light is then detected and used to provide the imaging function.
  • an annular ring 302 of return optical fibers is disposed around the distal end of the scanning fiber illuminator and has a typical outer diameter that is less than 2.0 mm. Light from the site passes into distal ends 324 of the return optical fibers and is conveyed proximally to detectors in a base station, as discussed above.
  • a side-viewing illuminator can employ a reflective surface or mirror (not shown) and can then readily image a site at one or more sides of the scanning fiber illuminator.
  • FIGURE 13 An exemplary configuration 340 is illustrated in FIGURE 13.
  • a catheter or conduit 342 is hollow and a forceps tool 346 is passed through the internal lumen formed within the catheter or conduit.
  • a flexible cable 348 extends centrally through an interior of the forceps tool and conveys light and other signals between a proximal end of the forceps tool (not shown) and a scan illuminator 350 that is disposed at the distal end of the forceps tool, between grippers 356a and 356b.
  • a return optical fiber (not separately shown) that receives light from the site illuminated within an FOV 352 of scan illuminator 350.
  • the light emitted by scan illuminator 350 is directed toward tissue 354a, along a portion of a body lumen 344 in which the configuration has been inserted.
  • the FOV of scan illuminator 350 is forwardly directed relative to the forceps tool and limits the portions of the walls of body lumen 344 that can be seen in the resulting image.
  • catheter or conduit 342 also includes scan illuminators 360 and 366.
  • Flexible cables 358 and 364 extend along opposite sides of the outer surface of the catheter or conduit. A distal end of flexible cable 358 is coupled to scan illuminator 360, while a distal end of flexible cable 364 is coupled to scan illuminator 366. Included within these flexible cables are optical fibers for conveying light and other signals bi-directionally between the scan illuminators and the proximal ends of the flexible cables.
  • the scan illuminator uses the light from a proximal source (not shown), the scan illuminator emits light in a desired scan pattern that has a FOV 362 directed to a side of body lumen 344, illuminating tissue 354b that is disposed there.
  • scan illuminator 366 emits light in a desired scan pattern that has a FOV 368 directed to illuminate tissue 354c disposed on an opposite side wall of the body lumen.
  • the light received from tissue 354b and 354c is conveyed through return optical fibers within flexible cables 358 and 364, respectively, and is used for producing images of the these different locations that enable a user to more effectively maneuver forceps tool 346 to take a sample of tissue from a desired ROI.
  • Use of multiple images of the interior surface of the body lumen clearly provides much more visual information than using only a single image of a single portion of the body lumen.
  • exemplary configuration 370 includes a central scanning fiber endoscope (SFE) 372 having forward imaging capability at its distal end 376, and a plurality of SFEs 374a, 374b, and 374c with side imaging capability arrayed around the central SFE.
  • SFE central scanning fiber endoscope
  • SFEs 374a, 374b, and 374c respectively include side ports 378a, 378b, and 378c through which light is emitted in a desired scanning pattern, so that they provide respective FOVs 382a, 382b, and 382c that are directed in different directions radially around the central SFE.
  • These side- viewing SFEs also each include return optical fibers (not shown) that convey light received from the portion of the site illuminated within their respective FOVs.
  • Central SFE 372 scans light in a desired scanning pattern over a forward FOV 380 and includes a return optical fiber (not shown) that receives light from the portion of a site illuminated by the light in FOV 380.
  • a guide wire or track 384 extends down at least one side of central SFE 372 and can be employed for advancing any of a number of additional tools or other components toward the distal end of configuration 370.
  • the additional tool or other component may have imaging capability and may include a scan illuminator, or may include only a scan illuminator or a return optical fiber, or may have neither.
  • exemplary configuration 390 is similar to that of configuration 370, except that it includes conduits 392a and 392b, which do not have imaging capability in this exemplary embodiment and are provided, for example, to convey a fluid to a site or to withdraw fluid from a site, or for carrying out other functions.
  • exemplary configuration 390 also includes oval conduit 394a and 394b, which are disposed around central SFE 372, at opposite sides. These oval conduits can optionally each include a side port (such as side port 396, which is shown on oval conduit 394a).
  • the side port can enable another tool or component that is advanced through an interior of the oval conduit to be directed outwardly toward a site, to carry out a desired task such as removing a tissue sample from the site.
  • exemplary configurations 370 and 390 provide good protection from surrounding objects (or tissue), but the shape also limits the size of tools that can be advanced along guidewire 384 or through the oval conduits.
  • FIGURE 15 illustrates an exemplary embodiment of a conduit 400 having a central lumen 406 through which one or more tools can be advanced to a site at which the one or more tools will be used.
  • a plurality of imaging devices 404 are arranged around the circumference of conduit 400. Any two imaging devices, which will typically be disposed at opposite sides of conduit 400 (not necessarily) can be selectively activated to produce a stereo image of the site.
  • imaging devices 402a and 402b are activated to scan a site (not shown in this Figure) with two spaced-apart fields of view 408 and 410.
  • the images produced by receiving the light from the site that has been illuminated in the two disparate fields of view can be employed to provide a stereoscopic view of the site, just as the binary vision provided by two spaced-apart eyes does.
  • Different imaging devices 404 can be employed to change the orientation of the stereoscopic image relative to conduit 400, corresponding to the vergence angle of the viewer, or to compensate for rotation of the conduit with respect to the tissue, or to avoid obstruction of the view from specific tools being extended.
  • Imaging devices 402a, 402b, and the other imaging devices 404 can be confocal imaging devices (like those described below in connection with FIGURES 16A, 16B, and 17), or instead can employ imaging devices 404 comprising adjacent light receiver optical fibers, which receive the light from the site illuminated by the disparate fields of view 408 and 410. Light received is conveyed proximally through optical fibers to light sensor (not shown), which produces corresponding electrical signals that can be employed to produce the images used to form the stereoscopic image of the site.
  • FIGURES 16A and 16B illustrate an exemplary embodiment showing an array 420 of nine confocal imaging devices; however, it must be emphasized that either more or fewer confocal imaging devices can be used in a tool or other component.
  • confocal imaging devices have a relatively small FOV, which would limit their usefulness if only a single such device were used to image a site where one or more tools or other components were to be used.
  • FOV field-ray
  • the user can view the image to facilitate the use of the one or more tools or other components at a site.
  • FIGURE 16A illustrates only three confocal imaging devices 422a
  • each confocal imaging device includes at least one lens 424 at its distal end, used to focus light emitted by the confocal imaging devices when scanning a site, such as tissue 430, and to focus light received from the site and conveyed proximally through an optical fiber 436.
  • Light from a source (not shown) is conveyed from the proximal end of optical fiber 436, which passes through a scanning driver 434, so that the distal end of optical fiber 436 is cantilevered from the scanning driver.
  • Scanning driver 434 can be a piezoelectric device having the capability of driving the cantilevered portion of optical fiber 436 to vibrate at or near its resonant frequency in two orthogonal directions when energized by driving signals supplied through leads 438.
  • the scanning driver is itself cantilevered from a cylindrical mount 432 within the confocal imaging device.
  • Confocal imaging devices 422a, 422b, and 422c respectively scan regions 428a, 428b, and 428c with focused scanning spots of light 426a, 426b, and 426c on tissue 430 (or other types of surfaces on a site being imaged).
  • the light returned from the scanning focused spots of light is generally free of crosstalk with the light from others of the confocal imaging devices, because it is produced by light focused on different regions of the site and the light from that specific confocal imaging device is focused back into the core of the cantilevered optical fiber, substantially free of light from the other confocal imaging devices.
  • the scanning of regions 428a, 428b, and 428c is carried out using a desired scanning pattern, such as a helical scan, raster scan, Lissajous scan, or other suitable area scanning pattern, produced by applying appropriate drive signals to the scanning driver through leads 438.
  • a desired scanning pattern such as a helical scan, raster scan, Lissajous scan, or other suitable area scanning pattern, produced by applying appropriate drive signals to the scanning driver through leads 438.
  • FIGURE 16B illustrates the distal surface or end of a tool 450 that includes array 420, showing the nine lenses 424 used by each of the confocal imaging devices comprising the array in this exemplary embodiment.
  • stereo non- confocal imaging devices 452a and 452b can be provided at each side of array 420, as well as stereo non-confocal imaging devices 454a and 454b, which are disposed at the upper and lower portions of the distal end of the tool.
  • tip bending anchors can instead be anchored at the locations of one or both pairs of the stereo non-confocal imaging devices to bend or deflect the distal end of the tool in a desired direction.
  • Tool 450 includes at least one track 456 that is disposed on its outer surface and is configured to guide another tool or component to a site to which tool 450 has been advanced.
  • Track 456 is generally T-shaped and extends longitudinally along tool 450 from about the proximal end of the tool to about its distal end.
  • FIGURE 17 illustrates a tool 460 that uses this approach and shows the cantilevered distal end of optical fiber 436 being deflected in the desired scanning pattern.
  • Tool 460 can include a track (not shown) like that of tool 450, to guide another tool or component to a site to which tool 460 has been advanced.
  • tool 460 is configured to vary the depth of the confocal scanning by providing a relative motion between a lens barrel 464 in which lenses 466, 468, and 470 are mounted and a more proximal housing 462 in which the array of confocal imaging devices are mounted, so that the relative motion is along the longitudinal z axis of the tool (as indicated by the arrows).
  • the depth of confocal scanning with tissue can be varied as the array of confocal imaging devices scan their respective regions on the site, to provide three-dimensional scanning of the tissue (or other material comprising the site).
  • the lenses focus the light for all of the confocal imaging devices of the array, along generally parallel channels, while the focal plane of the array is adjusted along the z axis, using a linear driver (not shown).
  • a linear driver not shown
  • the scanning optical fibers in the various confocal imaging devices can be offset in z distance from the lenses, and/or their orientation can be adjusted, and/or different wavelengths of light can be used to image by each so that the light beams from different confocal imaging devices are focused at different z axis positions.
  • more than one depth plane image can be acquired while operating the array of confocal imaging devices at the same time.
  • FIGURE 18A illustrates an exemplary array 500 comprising four confocal imaging device 502a, 502b, 502c, and 502d, which are generally like the confocal imaging devices discussed above. These four confocal imaging devices emit light that is focused by lenses 504 and respectively scan regions 506a, 506b, 506c, and 506d on a site 508. As shown in FIGURE 18A, at a time A, there is no overlap between these four scanned regions on the site. The scanning of these regions can occur at 1/30 th of a second, which is the time required to fully acquire the four images of the site corresponding to these scanned regions in one exemplary embodiment of the confocal imaging devices.
  • a vertical displacement of the array occurs at a time B, as shown in the example of FIGURE 18B.
  • This displacement can be caused by motion of the array due to a user hand-holding it and scanning to cover a larger area of tissue, or moving inadvertently, or because of movement of the site relative to the array.
  • the site may move relative to the array due to a patient's respiration, muscle contraction or body movement, cardiovascular motion, or other physiological causes.
  • the task of producing an overall image of the site based on combining the four images of the site requires that there be at least some overlap of the original scanned regions 506a -506d at time A with scanned regions 506a' - 506d' at time B.
  • This overlap between adjacent images can be accentuated by a user intentionally panning the distal end of array 500 over the site, so that appropriate software (discussed below) can be employed to stitch the resulting overlapping images together to form an overall image of the site.
  • FIGURE 19A illustrates four exemplary overlapping endoscopic images 600a, 600b, 600c, and 60Od of a pancreatic carcinoma (derived from an image in the online "Atlas of Gastroenterological Endoscopy," A. Freytag, T. Deist (2003)) that might represent four overlapping images produced by four scanning devices like those discussed above. These overlapping images can be stitched together using stitching software like that discussed above, to produce an overall image 602 as shown in FIGURE 19B. Many other examples of images illustrating the capabilities of such software are provided on the website for the AUTOSTITCHTM software noted above. Examples Illustrating Adding Imaging Devices to Existing Tool
  • FIGURES 2OA - 2OC illustrate one exemplary approach 700 that can be employed for adding an imaging device to an existing tool.
  • the existing tool is a medical stapler 702, or might be an endoscopic linear cutter tool, such as the model /60TM produced by Power Medical InterventionsTM.
  • the medical stapler includes a movable jaw 704 that pivots around a pivot point 708 toward a fixed jaw 706.
  • a sleeve 710 is slipped over the imaging device and its optical fiber (not separately shown).
  • Sleeve 710 can be formed of a heat shrink tubing so that after being slipped over both the imaging device and medical stapler proximal portion, the sheath can be heated causing it to shrink around both the medical stapler and the imaging device, thereby coupling imaging device 712 to medical stapler 702.
  • a distal end 714 and the portion of imaging device 702 extending beyond sheath 710 can coupled to fixed jaw 706 using a biocompatible adhesive, such as cyanoacrylate, or other suitable adhesive.
  • distal end 714 is canted upward slightly to direct a FOV 716 of the imaging device distally of the medical stapler (or linear cutter).
  • This arrangement is even more useful if the existing tool is an endoscopic linear cutter, since the FOV will image the site toward which the linear cutter is being advanced to perform its cutting operation.
  • FIGURE 2OB illustrates a cross-sectional view of this exemplary embodiment, showing how the sheath has been shrunk to couple imaging device 712 to the existing medical stapler (or endoscopic linear cutter).
  • An alternative exemplary embodiment 720 shown in FIGURE 2OC illustrates how two imaging devices 712 can similarly be coupled to each side of existing medical stapler (or linear cutting device) 702, using a sheath 722 that has been slipped over both imaging devices and the existing tool and then heated to shrink the sheath tight around the configuration.
  • This exemplary embodiment would be particularly useful if the existing tool is the medical stapler, if the distal ends of the imaging devices are positioned more proximally of the fixed and movable jaws so that the site being stapled is visible in the images produced by the imaging devices, with stereo viewing as an option.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Endoscopes (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)

Abstract

Un ou plusieurs illuminateurs de balayage et une pluralité de récepteurs optiques sont fournis sur l'extrémité distale d'un outil ou autre composant, de telle sorte qu'une pluralité d'images d'un site peuvent être fournies en réponse à des signaux de sortie émis par la pluralité de récepteurs optiques. Les signaux de sortie de la pluralité de récepteurs optiques sont combinés pour produire une image globale du site ou une pluralité de différentes images de positions disparates. Les images de la pluralité d'images peuvent être visualisées séparément pour produire une vue stéréo ou en perspective, ou peuvent être produites en utilisant différentes longueurs d'onde de lumière pour fournir des informations plus précises à propos du site et qui facilitent l'utilisation d'un ou de plusieurs outils ou composants au niveau de ce site. L'illuminateur (les illuminateurs) de balayage et la pluralité de récepteurs optiques peuvent être configurés pour être ajoutés à un outil ou composant existant.
PCT/US2007/085667 2007-11-27 2007-11-27 Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits Ceased WO2009070161A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2010535939A JP2011504783A (ja) 2007-11-27 2007-11-27 医療用器具、カテーテル、および導管の遠位端への撮像能力の追加
EP07854804A EP2224841A4 (fr) 2007-11-27 2007-11-27 Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits
PCT/US2007/085667 WO2009070161A1 (fr) 2007-11-27 2007-11-27 Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2007/085667 WO2009070161A1 (fr) 2007-11-27 2007-11-27 Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits

Publications (1)

Publication Number Publication Date
WO2009070161A1 true WO2009070161A1 (fr) 2009-06-04

Family

ID=40678875

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/085667 Ceased WO2009070161A1 (fr) 2007-11-27 2007-11-27 Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits

Country Status (3)

Country Link
EP (1) EP2224841A4 (fr)
JP (1) JP2011504783A (fr)
WO (1) WO2009070161A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010142602A (ja) * 2008-12-22 2010-07-01 Hoya Corp 内視鏡装置
WO2013126576A1 (fr) * 2012-02-22 2013-08-29 Boston Scientific Scimed, Inc. Dispositif d'imagerie et procédés d'utilisation de celui-ci
EP3297516A4 (fr) * 2015-05-19 2019-02-13 Singapore Health Services Pte Ltd Dispositif d'éclairage
US11047671B1 (en) 2020-01-30 2021-06-29 Veravanti Inc. Forward looking RGB/optical coherence tomography duplex imager
US11363945B2 (en) 2013-06-19 2022-06-21 The General Hospital Corporation Omni-directional viewing apparatus
US11402573B2 (en) 2013-01-15 2022-08-02 Magic Leap, Inc. Ultra-high resolution scanning fiber display
US12385733B2 (en) 2020-01-30 2025-08-12 Soham Inc. Synchronizing an optical coherence tomography system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SMT202000624T1 (it) * 2010-03-05 2021-01-05 Massachusetts Gen Hospital Apparecchio per fornire radiazione elettromagnetica a un campione
JP5750666B2 (ja) * 2011-11-24 2015-07-22 オリンパス株式会社 内視鏡装置
EP2989959A4 (fr) 2013-06-03 2016-12-21 Olympus Corp Endoscope à balayage
JP6128664B2 (ja) * 2015-10-28 2017-05-17 国立大学法人 千葉大学 パノラマ画像作成プログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010055462A1 (en) * 2000-06-19 2001-12-27 Seibel Eric J. Medical imaging, diagnosis, and therapy using a scanning single optical fiber system
US20030023141A1 (en) * 1997-08-21 2003-01-30 Paul Stelzer Minimally invasive surgery device
US20050215854A1 (en) * 2004-03-29 2005-09-29 Olympus Corporation Medical procedure support system and method

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998038907A1 (fr) * 1997-03-06 1998-09-11 Massachusetts Institute Of Technology Instrument d'analyse a balayage optique de tissu vivant
US6294775B1 (en) * 1999-06-08 2001-09-25 University Of Washington Miniature image acquistion system using a scanning resonant waveguide
DE60119930T2 (de) * 2000-07-10 2007-01-18 University Health Network, Toronto Verfahren und vorrichtung zur hochauflösenden kohärenten optischen abbildung
JP2002263055A (ja) * 2001-03-12 2002-09-17 Olympus Optical Co Ltd 内視鏡先端フード
JP4047567B2 (ja) * 2001-10-05 2008-02-13 オリンパス株式会社 手術用システム
US7252634B2 (en) * 2002-11-05 2007-08-07 Pentax Corporation Confocal probe having scanning mirrors mounted to a transparent substrate in an optical path of the probe
JP4145627B2 (ja) * 2002-11-05 2008-09-03 Ｈｏｙａ株式会社 走査型共焦点プローブ
JP4242633B2 (ja) * 2002-11-27 2009-03-25 オリンパス株式会社 判別方法及び判別装置
US7448995B2 (en) * 2003-06-23 2008-11-11 Microvision, Inc. Scanning endoscope
JP4535697B2 (ja) * 2003-07-23 2010-09-01 オリンパス株式会社 生体組織の光散乱観測内視鏡装置
JP4446045B2 (ja) * 2004-01-20 2010-04-07 Ｈｏｙａ株式会社 対象物内部処置装置及び対象物内部処置システム
JP2004065965A (ja) * 2003-07-30 2004-03-04 Olympus Corp 光走査プローブ装置
CN101247753A (zh) * 2005-06-06 2008-08-20 德州系统大学董事会 使用光谱分辨带宽的光学相干层析成像（oct）
JP4761882B2 (ja) * 2005-08-10 2011-08-31 オプティスキャン ピーティーワイ リミテッド 走査型共焦点内視鏡システムおよび該システムの画像表示範囲調整方法
WO2007084915A2 (fr) * 2006-01-17 2007-07-26 University Of Washington Imagerie optique non linéaire à balayage par fibre optique et endoscope de spectroscopie
US7435217B2 (en) * 2006-04-17 2008-10-14 Microvision, Inc. Scanned beam imagers and endoscopes with positionable light collector
FR2901029B1 (fr) * 2006-05-12 2012-12-21 Mauna Kea Technologies Dispositif et procede d'endoscopie pour une observation simultanee de plusieurs zones d'interet.

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030023141A1 (en) * 1997-08-21 2003-01-30 Paul Stelzer Minimally invasive surgery device
US20010055462A1 (en) * 2000-06-19 2001-12-27 Seibel Eric J. Medical imaging, diagnosis, and therapy using a scanning single optical fiber system
US20050215854A1 (en) * 2004-03-29 2005-09-29 Olympus Corporation Medical procedure support system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2224841A4 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010142602A (ja) * 2008-12-22 2010-07-01 Hoya Corp 内視鏡装置
WO2013126576A1 (fr) * 2012-02-22 2013-08-29 Boston Scientific Scimed, Inc. Dispositif d'imagerie et procédés d'utilisation de celui-ci
US11402573B2 (en) 2013-01-15 2022-08-02 Magic Leap, Inc. Ultra-high resolution scanning fiber display
US11363945B2 (en) 2013-06-19 2022-06-21 The General Hospital Corporation Omni-directional viewing apparatus
EP3297516A4 (fr) * 2015-05-19 2019-02-13 Singapore Health Services Pte Ltd Dispositif d'éclairage
US11047671B1 (en) 2020-01-30 2021-06-29 Veravanti Inc. Forward looking RGB/optical coherence tomography duplex imager
US11530910B2 (en) 2020-01-30 2022-12-20 Veravanti Inc. Forward looking RGB/optical coherence tomography duplex imager
US12385733B2 (en) 2020-01-30 2025-08-12 Soham Inc. Synchronizing an optical coherence tomography system

Also Published As

Publication number Publication date
EP2224841A1 (fr) 2010-09-08
JP2011504783A (ja) 2011-02-17
EP2224841A4 (fr) 2012-04-18

Similar Documents

Publication Publication Date Title
US7791009B2 (en) Eliminating illumination crosstalk while using multiple imaging devices with plural scanning devices, each coupled to an optical fiber
US20090137893A1 (en) Adding imaging capability to distal tips of medical tools, catheters, and conduits
WO2009070160A1 (fr) Suppression d'interférences d'éclairage lors de la formation d'image à l'aide de plusieurs dispositifs de formation d'image
EP2224841A1 (fr) Ajout d'une capacité d'imagerie à des extrémités distales d'outils médicaux, de cathéters, et de conduits
US6600861B2 (en) Fiber bundle and endoscope apparatus
US5558619A (en) Endoscope system with automatic control according to movement of an operator
US6975898B2 (en) Medical imaging, diagnosis, and therapy using a scanning single optical fiber system
EP1464165B1 (fr) Dispositif d'imagerie et procedes associes
US20050038322A1 (en) Imaging endoscope
US8537203B2 (en) Scanning beam with variable sequential framing using interrupted scanning resonance
CN104023614B (zh) 立体内窥镜装置、立体内窥镜系统和立体内窥镜机器人
US8911357B2 (en) Optical structure observation apparatus and structure information processing method of the same
US20030167007A1 (en) Apparatus and method for spectroscopic examination of the colon
JP3947275B2 (ja) 内視鏡
US20110077463A1 (en) Optical probe and endoscope apparatus
JP2007526014A (ja) 走査内視鏡
CN109068970B (zh) 内窥镜装置
EP3955036B1 (fr) Méthode d'opération d'un dispositif à balayage de faisceau comprenant une mémoire de configuration
KR102571259B1 (ko) 의료용 내시경
JP2002221486A (ja) 光断層イメージング装置
JP2004073667A (ja) 光断層内視鏡装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07854804

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2010535939

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2007854804

Country of ref document: EP