CN102036599B

CN102036599B - Imaging system for combined full-color reflectance and near-infrared imaging

Info

Publication number: CN102036599B
Application number: CN2009801178437A
Authority: CN
Inventors: J.芬格勒; P.维斯特维克; A.E.拜利; P.科特尔
Original assignee: Novadaq Technologies ULC
Current assignee: Stryker Corp
Priority date: 2008-03-18
Filing date: 2009-03-18
Publication date: 2013-06-19
Anticipated expiration: 2029-03-18
Also published as: US20110063427A1; KR20100129768A; RU2010142292A; JP5852979B2; JP2013163027A; EP3117765B1; JP2017136373A; BRPI0906187A2; JP5231625B2; US20160100763A1; JP2016064150A; HK1157169A1; RU2510235C2; EP2268194A1; US9642532B2; JP6088629B2; JP2011528918A; EP2268194B1; KR101517264B1; MX2010010292A

Abstract

An imaging system for acquiring NIR and full-color images includes: a light source for providing visible light and NIR light to an observed area such as living tissue; light and the combined red reflected light/detected NIR light of one or more image sensor cameras. A controller in signal communication with the light source and the camera is configured to control the light source to sequentially illuminate the area under observation with temporally continuous blue/green illumination light and with red illumination light and NIR excitation light. At least one of the red illumination light and the NIR excitation light is periodically turned on and off synchronously with the acquisition of red and NIR light images in the camera.

Description

Be used for the panchromatic reflection of combination and the imaging system of near infrared imaging

Technical field

The present invention is directed to medical imaging, especially for being used for from obtain the system and method for visible images and near infrared light image such as the observed zone of biological tissue, particularly for the described system and method that uses in splanchnoscopy.

Background technology

At the document that is used for various clinical practices, near-infrared (NIR) imaging has been described.Usually, this type of imaging pattern utilization absorbs NIR and/or fluorescigenic contrast agent (for example indocyanine green) in NIR.This type of contrast agent can be attached to target molecule (for example antibody) to be used for disease detection.Can contrast agent be introduced in tissue so that organizational structure and function (for example blood/the lymph fluid in vascular/bile flows) imaging to being not easy to see with standard visual light imaging technology with vein or subcutaneous mode.

Be independent of clinical practice, endoscope's NIR imaging device generally includes a plurality of imaging patterns as actual characteristic.For example, the doctor of endoscope utilizes the visible spectrum color to carry out visual and navigates the two, and provides the endoscopic imaging equipment of NIR imaging that coloured image simultaneously is provided usually.This concurrent imaging device can be implemented as for example as follows:

The spectral separation of-a kind of conventional configuration using visible light and NIR light wherein use to be used for the independent sensor of different color (for example red, green and blue) and NIR band or use and to have and contain the panchromatic and NIR picture signal that the single color sensor to the integrated filtering device of the transparent component of the light filter of different band (for example red, green, blueness and NIR) obtains.Therefore, the colored and NIR imaging device of this type of multi-mode is provided for each sensor special or the sensor pixel in two kinds of imaging patterns.Disadvantageously, this increases the number of the imageing sensor in multisensor embodiment, perhaps when on same sensor, the particular sensor pixel is exclusively used in the NIR imaging and other pixel is damaged image resolution ratio when being used for colour imaging.

The single monochrome image sensor of-another conventional configuration using comes visible light and the imaging in succession of NIR light.Therefore, with the irradiation object in succession of the light in red, green, blueness and NIR bands of a spectrum, wherein obtain independent picture frame and generate synthetic colored and NIR image by the picture frame that obtains for each bands of a spectrum.Yet the method is that the different time obtains in the situation of picture frame in succession and may produces tedious correction of motion artefacts (being color fringe and " rainbow effect ") in synthetic colored and NIR image.Can be by obtaining or frame rate increases to greater than for example and alleviates these pseudomorphisms 15 frame/seconds (fps) (for example reaching 90 fps and even 180 fps).Due to high data rate, for high-definition image (for example, 2 mega pixels) or have great dynamic range (〉 10 bits) image be difficult to realize high frame rate, so limited images size and/or resolution.

Therefore, expectation provides a kind of system and method that obtains for panchromatic visible images and NIR light image the time, and it is eliminated above-mentioned shortcoming and does not damage image resolution ratio and/or introduce tedious correction of motion artefacts.

Summary of the invention

According to an aspect of the present invention, a kind of method be used to obtaining NIR image and full-colour image comprises step: with the continuous observed zone of blue/green rayed, and with red light and NIR rayed this observed zone, wherein, at least one in periodically opening and closing red light and NIR light.Blueness, green, redness and the NIR light that will return from observed zone are directed to one or more sensors, and described one or more sensors are configured to detect respectively the red light of blue light, green light and combination/NIR light.According to determining respectively red spectrum component and NIR spectral components with the picture signal of the red light of the combination of the redness of switching and NIR phototiming/NIR light.Reproduce and show the panchromatic reflected image in observed zone from blue, green and red light, and similarly reproduce and show the NIR image from NIR light.

According to a further aspect in the invention, a kind of imaging system be used to obtaining NIR image and full-colour image comprises: the light source that visible light and NIR light are provided to observed zone; Photographing unit with one or more imageing sensors of the redness that is configured to detect respectively the blueness returned from observed zone and green light and combination and NIR light; And carry out with described photographing unit the controller that signal is communicated by letter with described light source.Described controller is configured to control described light source to shine continuously tissue with blue/green light and with red light and NIR rayed observed zone, wherein, with photographing unit in redness and the NIR image obtain synchronously at least one in the described red light of periodically opening and closing and described NIR light.

Described controller also is configured to determine respectively red spectrum component and NIR spectral components according to the red light of expression combination and the sensor signal of NIR light.Described imaging system also comprises display, and this display receives corresponding to the picture signal of blue light, green light and the independent red spectrum component of determining and reproduces thus the panchromatic visible images in observed zone.Described display also receives the NIR spectral components of determining separately and reproduces thus the NIR image in observed zone.

Described video imaging system can use three sensor color cameras, this three sensors color camera is configured to the imaging and to the imaging intermittently of red wave band continuously of blue and green wave band, and continuous high-quality monochrome information and the fully continuous complete colourity high-quality video image with the observed zone of generation such as biological tissue is provided thus.In this type of configuration, described red image sensor can be by time division multiplex to obtain red image and NIR image the two (being that the red image sensor is alternately and in extremely rapid succession to the red light that is used for the required color information of coloured image and the two imaging of NIR light that is used for the required image information of NIR image).This type of time division multiplex can be associated be used to NIR irradiation (being used for the excitation of fluorescence) being provided and being used for the light source (and synchronous with it) of the red light of colour imaging.Then, utilize image to process and suitably separate the picture signal that obtains with result.

Embodiments of the invention can comprise one or more in following characteristics.Can alternately shine observed zone with red light and NIR light, wherein, the persistent period of red light can be different from, preferably be longer than with light-struck persistent period of NIR.Can switch irradiation with video field speed or frame rate.

Can according to comprise corresponding red spectrum component or NIR spectral components, on the time adjacent picture field to by described image capture sensor and lack the red spectrum component or interpolation is carried out in the field of NIR spectral components.In one embodiment, can deduct from the red light/NIR light of combination in the situation that do not exist NIR spectral components that red light obtains to obtain independent red spectrum component.This is advantageous particularly when the NIR signal that detects has the suitable intensity of intensity with danger signal.

In one embodiment, described light source can be included in the illumination apparatus of the visible light of launching constant intensity basically in the continuous spectrum scope and NIR light and be arranged on described illumination apparatus and observed zone between to be used for transmission continuous blue/green light and a plurality of movable light filter of discontinuous red light and NIR light in time in time.In one embodiment, described one or more imageing sensor comprises the single image sensor, described single image sensor has a plurality of pixels, and each pixel can respond the red reflex light of the blue reflected light that returns from observed zone, green reflected light and combination/NIR fluorescence.In one embodiment, described single image sensor comprises mosaic blue/green/redness of being arranged on before described sensor pixel-NIR filter array.

in another embodiment, described light source can be included in launches the visible light of constant intensity and the illumination apparatus of NIR light basically in the continuous spectrum scope, be used for visible light and NIR light are separated into the first dichroic device of blue/green and red light and NIR light, be used for the red light that to have separated and NIR light and be transformed into the shade device of discontinuous red light and discontinuous NIR light in time, and be used for described blue/green light, described discontinuous red light in time and described discontinuous NIR light in time make up to be transmitted to the second dichroic device in observed zone.

In another embodiment, described light source can comprise the green of launching constant intensity basically and blue light the first illumination apparatus, produce the red light that is switched the second illumination apparatus, produce the 3rd illumination apparatus of the NIR exciting light that is switched and be used for the red light that is switched and the NIR light that is switched and green and blue light are made up to be transmitted to the dichroic device in observed zone.Can produce the described red light that is switched and NIR light by the continuous strength light beam that interrupts red light and NIR light with chopper or chopper.Perhaps, can be by producing the described red light that is switched and NIR light with described the second illumination apparatus of electrical way opening and closing and described the 3rd illumination apparatus.

Described imageing sensor can adopt interlacing scan or line by line scan.

Described imaging system can comprise endoscope.

Description of drawings

The following drawings illustrates and should be understood to indicative explaination of the present invention rather than be interpreted as by any way to have restrictive some illustrative embodiment of the present invention.

Fig. 1 illustrates endoscopic system according to an embodiment of the invention;

Fig. 2 a～2d illustrates the various exemplary embodiments of the multi-mode light source that will use together with the endoscopic system of Fig. 1;

Fig. 3 a illustrates the exemplary dichroic prism that 3 sensor color cameras adopt;

Fig. 3 b illustrates the optical transmission scope of the spectral components that is separated by the dichroic prism of Fig. 3 a;

Fig. 3 c illustrates and stops that exciting light enters the optical transmission scope of the notch filter of photographing unit;

Fig. 4 illustrates for carrying out Continuous irradiation with green/blue light and replacing the sequential chart of the first embodiment of irradiation with redness/NIR light;

Fig. 5 illustrates for carrying out Continuous irradiation with green/blue light and replacing the sequential chart of the second embodiment of irradiation with redness/NIR light;

Fig. 6 illustrates for carrying out Continuous irradiation with green/blue/NIR light and replacing the sequential chart of the 3rd embodiment of irradiation with red light; And

Fig. 7 illustrates the corresponding light spectral sensitivity of exemplary cmos sensor with stacking imaging layer and these layers.

The specific embodiment

Usually obtain color video frequency image with three sensor color cameras, in three sensor color cameras, that independent redness, green and blue image sensor provide is red, when green and blue pixel information in abutting connection with array.Become panchromatic video image next life by making up from the image information of whole three sensors.Color (being that realistic colour reproduces) true to nature is of crucial importance in medical imaging is used, and provides complete color information with whole three sensors.

Yet, for the relative importance of the color in the video image of understanding tissue and spatial information, consider that aspect brightness and colourity the information in this type of video image is useful.Brightness refers to the lightness information in image, and this information provides the spatial detail that makes the beholder can identify shape just.Therefore, the room and time resolution of brightness is crucial for the perception of video image quality.Colourity refers to the color information in video image.A characteristic of human vision be the small detail that is not easy the colourity of perceptual image feature change and such variation therefore with the small detail of brightness change compare in the net assessment of picture quality so crucial.Just because of this reason, the Video coding of chrominance information is usually double sampling.

In the video image of the tissue that obtains with visible light, the CONSTRUCTED SPECIFICATION major part of tissue is comprised in the blueness and green wavelength region of imaging.Blue and green light trends towards being reflected from tissue surface, and red light trends towards in tissue by the height scattering.As a result, there is considerably less fine structure details in the red light that arrives the red image sensor.From color science also known human vision receive most of spatial information-be that green light information disproportionately contributes to brightness from the green portion of visible spectrum.The normalized form that calculates brightness for the color component according to Gamma correction is Y'=0.2126 R'+ 0.7152 G'+ 0.0722 B'.For this reason, the space of the red component of the video image of human tissue and/or temporal interpolation also affect the perception to the small detail in those images indistinctively.

Be similar to red light, NIR light trends towards being scattered in tissue, thereby impels the NIR characteristics of image to be diffused ground rather than clearly restriction.And, because the NIR image highlights interested zone (namely wherein having located the zone of contrast agent) but total volume visualization or navigation information are not provided, expect that therefore NIR endoscopic imaging equipment provides continuous coloured image and stack or the demonstration side by side of NIR image information.In such demonstration, NIR light also can be less to the spatial information contribution that is presented to the observer.

The exemplary embodiment of the schematically illustrated NIR endoscopic imaging system 10 of Fig. 1, it comprises: multi-mode light source 11, it provides visible illumination and NIR to shine the two, and the irradiation guiding piece that shines the two for example optical fiber cable 17 by being suitable for transmitting color and NIR is connected to endoscope 12; Color camera 13, it is installed to described endoscopic images guiding piece, here be illustrated as have the blueness of being respectively used to, three different sensors 34,36 of green and redness/NIR imaging, 38(referring to Fig. 3 a); And controller of camera 14, it is connected to photographing unit 13 and light source 11, is used for controlling irradiation and Image Acquisition and making them synchronous.Controller 14 can also be processed the visible and NIR image that obtains and be connected on the monitor 15 of controller 14 by cable 19 in order to for example be presented at.Can obtain in real time image with the optional frame rate such as video rate.

Fig. 2 a～2d illustrates the schematic diagram of the exemplary embodiment of various light sources 11.Shown light source is constructed to supply under normal colour imaging pattern and produces the visible illumination light of continuous spectral distribution basically.Described light source may be arc light, Halogen light, one or more Solid Source (for example LED, semiconductor laser) or their any combination, and described light source is can be aspect spectrum filtered or be shaped (such as with band pass filter, IR light filter etc.).Can for example use the rotating filtering wheel side by side or in turn to produce continuous spectrum as primary colors (RGB).

In system according to the present invention, the light source that will use and be described in more detail below together with system of the present invention is configured to provide continuous, unbroken irradiation in the blueness of visible spectrum and green portion and discontinuous redness and/or NIR light.The blueness of visible spectrum and green portion can from the transmitting optics that produced by continuous source filter out, or directly produced by narrow-band source (for example blueness and green LED).Can also produce red and NIR light by arc light, Halogen light, Solid Source (for example red and NIR LED or laser instrument) or their any combination.

Forward now Fig. 2 to, in one embodiment, light source 11 comprises and produces visible and the photoemissive illumination apparatus 202 of NIR, collimating lens 204, also filter wheel or the reciprocating type light filter keeper 208 of transmit green and blue light continuously of transmits red and NIR light alternately.Perhaps, can use tunable electro-optic or acousto-optic filter.Focused on photoconduction 17 by lens 206 through the light that filters.

Schematically for example understand another embodiment of light source 11b in Fig. 2 b.As seen light source 11b comprises generation and the photoemissive illumination apparatus 202 of NIR and collimating lens 204.Dichroic mirror 212 transmit green/blue light also arrives another dichroic mirror 214 with redness/NIR luminous reflectance, and this dichroic mirror 214 is transmitted to NIR reflecting mirror 215 and reflection red light, perhaps vice-versa with NIR light.Can further be with logical the optical filtering by 213 pairs of green/blue light of light filter.For example it can be combined into single chopper wheel by

chopper wheel

219a, 219b(for the redness of reflection and NIR light) copped wave and produce discontinuous irradiation in time, this irradiation is reflected subsequently mirror 216,217 reflections and by dichroic mirror 218, itself and green/blue light is made up.As previously mentioned, this combined light is focused on photoconduction 17 by lens 206 subsequently.

Schematically in another embodiment of illustrational light source 11c, illumination apparatus 202a produces green and the blue light emission that is collimated by collimating lens 204a in Fig. 2 c.Similarly,

independent illumination apparatus

202b, 202c produce respectively by redness and the NIR light emission of corresponding

collimating lens

204b and 204c collimation.As in the embodiment of Fig. 2 b, it also can be combined into single chopper wheel by for

example chopper wheel

219a, 219b(for red and NIR light) copped wave and produce discontinuous irradiation in time, should shine by dichroic mirror 222,228 subsequently and green/blue is shone and made up.As previously mentioned, this combined light is focused on photoconduction 17 by lens 206 subsequently.

As previously mentioned, schematically in another embodiment of illustrational light source 11d, illumination apparatus 202a produces green and the blue light emission that is collimated by collimating lens 204a in Fig. 2 d.Yet, from different in the embodiment of Fig. 2 c, independent illumination apparatus 202d, 202e are switched to produce redness and the NIR light emission with controlled timing here with electrical way.For example, red and NIR light source 202d, 202e can be solid state light emitters, such as LED or semiconductor laser, and can be with the switch of the suitable preferred electron described light source of opening and closing rapidly.Described with reference to Fig. 2 c as mentioned, red and NIR shines by corresponding

collimating lens

204b and 204c collimation and by dichroic mirror 222,228, itself and green/blue irradiation is made up.As previously mentioned, this combined light is focused on photoconduction 17 by lens 206 subsequently.

Redness alternately and NIR irradiation are synchronizeed with the Image Acquisition of three sensor camera, so that synchronously obtain red image and NIR image by photographing unit with redness and the NIR irradiation of endoscope.

Fig. 3 a illustrates in greater detail three sensor camera 13 of Fig. 1, particularly is used for redness/NIR, green and blue light are directed to respectively three different imageing sensors 34,36 and 38 optical beam-splitter.For the NIR fluorescent applications, photographing unit comprises also that preferably excitation band stops light filter 32.Described beam splitter can for example be made of a plurality of dichroic prisms, cube separator, plate separator or membrane separator.Fig. 3 b illustrates the spectral composition that receives from the endoscope according to Fig. 3 a.Fig. 3 c illustrates transmission stops the light of light filter 32 by the excitation band that is implemented as notch filter spectral composition 31, and described notch filter stops other wavelength that excitation optical transmission but transmission are visible and the NIR spectral region is interior.The transmissison characteristic of this light filter 32 can be designed to also stop the interference visible spectrum, may make the deteriorated NIR wavelength of not expecting of coloured image.

Fig. 4 illustrates for example sequential chart of the first exemplary embodiment of colored when three sensor camera and NIR imaging pattern of use.In the present embodiment, camera sensor utilizes interlacing to read form, and its representative is for the favourable combination of the room and time resolution of the flow display of motion.The illustrational any light source of Fig. 2 a～2d can use together with the present embodiment.This light source provides continuous blue/green irradiation and the redness that replaces and NIR irradiation.Alternately expose each field on imageing sensor, first (field) namely having even number line replaces with second (field) with odd-numbered line.In the sequential chart of Fig. 4 of the full motion that 30 fps are shown, a field duration (16.7 ms) provides the NIR irradiation, and the back is the redness irradiation of two field duration (33.3ms).In other words, shine sample or tissue with full spectrum color (RGB) during two field duration (33.3 ms), and shine sample or tissue with GB and NIR during the 3rd field duration.For the panchromatic visual picture of reconstruct, and utilize the red information that between adjacent field, the field of NIR irradiation, interpolation is omitted.Blue and green image information is available all the time, thereby best and continuous monochrome information are provided.The NIR image is by each the 6th generation in each field, wherein, and to the row space interpolation of advancing of omitting.When showing the fluorescence field, an image is upgraded in every three fields, wherein between even number line and odd-numbered line, the image that shows is carried out interpolation.

In all figure, use substituting or using interchangeably with it of term " IR " conduct " NIR ".

In case treated colored and NIR view data, signal be output to video-frequency monitor and can be shown as two independent, views (colour, a fluorescence) simultaneously or be shown as the colour of combination and fluorescence image signal (for example by distribute for fluorescence signal with tissue in the color that contrasts of the color formation that naturally exists).

Fig. 5 illustrates the sequential chart of the second exemplary embodiment of while colour and NIR imaging pattern.In the present embodiment, the camera sensor utilization sensor of lining by line scan is read form, wherein, reads complete frame (G/B/R and G/B/NIR replace) during each field duration.The illustrational any light source of Fig. 2 a～2d can use together with the present embodiment.This light source provides continuous blue/green irradiation and the redness that replaces and NIR irradiation.In the sequential chart of Fig. 5, a field duration (16.7 ms) provides the NIR irradiation, and the back is the redness irradiation of a field duration (16.7 ms).In other words, shine sample or tissue with full spectrum color (RGB) during a field duration (16.7 ms), and shine sample or tissue with GB and NIR during the 3rd field duration.In this case, in a frame, total visible light spectrum coloured image is available at each pixel place.In the frame that replaces, blue and green information directly obtains, and red information is interpolated between consecutive frame.Be different from the embodiment of Fig. 4, do not require spatial interpolation.Can be to realize that with the similar mode of mode described in formerly embodiment further image processes and show.

Fig. 6 illustrates the sequential chart of the 3rd exemplary embodiment, and wherein, green/blue irradiation and NIR irradiation are all continuous, and only have red irradiation modulated.With similar in the embodiment of Fig. 4, each field alternately is exposed on imageing sensor, and first (field) namely having even number line replaces with second (field) with odd-numbered line.In the sequential chart of Fig. 6 of the full motion that 30 fps are shown, a field duration (16.7 ms) provides (NIR+GB) irradiation (red irradiation is switched off), the back be two field duration (33.3ms) (NIR+RGB).If it is little comparing the NIR picture signal with the red reflex signal, it will can not affect overall visible (RGB) image significantly, can be in the situation that do not proofread and correct by conventional Color Image Processing and generate coloured image thereby make.In addition, deduct from (NIR+R) view data the NIR contribution that obtains when being switched off in redness irradiation by the room and time interpolation the red image passage, to obtain red image signal, as second in the sequential chart of Fig. 6 to as shown in last column.Perhaps, can be used for the RGB of alternate frame and (RGB+IR) Image Acquisition with having with the sensor of reading at those similar progressive scanning picture sensors of Fig. 5 illustrated.

(do not illustrate in the accompanying drawings) in a further exemplary embodiment, green/blue irradiation and red irradiation are continuous, and the NIR irradiation is modulated.If red and NIR picture signal roughly has identical amplitude, can use best this timing.In the present embodiment, light source provides the intermittent irradiation that does not interrupt shining and having NIR light with total visible light spectrum.Described sequential chart is basically identical with the sequential chart shown in Fig. 6, and wherein NIR and red irradiation are exchanged.Intermittent NIR irradiation by synchronously with the interlacing camera scenario under consistent every a field in two fields and progressive scan cameras.For each field that the NIR irradiation wherein is provided, the red image sensor will obtain (R+NIR) picture signal.Can be by carrying out the interpolation of danger signal value and deduct red image signal from (R+NIR) signal to extract the NIR picture signal from (R+NIR) picture signal with " only red " back picture field from suitable front.Because red and NIR picture signal have similar amplitude, so such interpolation and subtraction will provide quite accurate NIR image signal value.By with blue and green video signal in combination with red image signal obtain and process coloured image through the value of interpolation.Then, can show as described above or record colour and the NIR image information that result obtains.

In any previous embodiment, can also operate the NIR endoscopic imaging system so that light source provides the Continuous irradiation with total visible light spectrum or NIR spectrum, and photographing unit obtaining corresponding coloured image in a continuous manner or NIR(absorbs or fluorescence) image to be to provide high spatial resolution.Can show and/or record subsequently the gained video image of each independent irradiation/imaging pattern-colour or NIR-.

By realizing colored and NIR imaging as described in the aforementioned embodiment, can be in the situation that do not damage image resolution ratio and/or introduce tedious correction of motion artefacts and obtain with video rate and show panchromatic visible light and NIR light image.In addition, if any residual color fringe (for example in the situation that redness or the discontinuous of NIR image obtain) occurs in the rapid movement of crossing over the visual field due to sharpened edge, can by omit with the additional treatments time of minimum (redness/NIR) temporal interpolation of video field is alleviated these relatively small effects.

Although in conjunction with the preferred embodiment that illustrates and describe in detail, the present invention is disclosed, to its various modifications and improve and will be easy to become it will be apparent to those skilled in the art that.For example, as the single direct trichroism RGB sensor image sensor with stacking Pixel Design that independent imageing sensor is respectively used to G/B and R/NIR or single color sensor is used for substituting of RGB image and NIR fluoroscopic image, can use to realize in the CMOS technology and can buy from the Foveon company in San Jose city.Schematically for example understand sensors with auxiliary electrode were in Fig. 7.It should be understood that and by adding the NIR sensitive layer, this sensor design to be extended to four colors.Therefore, red, green, blueness and NIR image are acquired at the different depth place of imageing sensor.In the situation that 4 layers of sensor, red and the multiplexing of NIR irradiation will be unnecessary.Yet, in the situation that 3 layers of sensor are described for the conventional photographing unit of 3 sensors as mentioned, still need to carry out multiplexing to red and NIR irradiation.For fluorescence imaging is used, also will need suitable barrier filter to stop the NIR exciting light.

Although illustrate and described the present invention in conjunction with the currently preferred embodiments that illustrate and describe in detail, but the details shown in the present invention is not intended to be confined to is because can carry out various modifications and structure modify in the situation that break away from never in any form the spirit and scope of the present invention.Selecting and describing embodiment is in order to explain that thereby principle of the present invention and practical application are to make those skilled in the art to utilize best the present invention and various embodiment with the various modifications of the specific use that is suitable for expecting.

Set forth in the claim of enclosing and be used as new things and advocate that right and expectation are subject to the content of patent certificate protection, and it comprises the equivalent of wherein said element.

Claims

1. method that is used for obtaining NIR and full-colour image comprises step:

Shine continuously observed zone with blue and green light,

With red light and NIR rayed observed zone, wherein, at least one in the described red light of opening and closing and NIR light periodically,

Red reflex light and the NIR fluorescence of blue and green reflected light and combination are directed to one or more sensors, described one or more sensor is configured to detect respectively blue reflected light, green reflected light and red reflex light and NIR fluorescence, wherein, with the red light that is switched and the NIR phototiming ground described red reflex light of detection and NIR fluorescence

Determine respectively red reflex light spectral components and NIR fluorescence spectrum component according to the red reflex light of combination and the picture signal of NIR fluorescence,

Reach according to described blueness and green reflected light the full-colour image that the red reflex light spectral components of determining separately shows observed zone, and

Show the NIR image according to NIR fluorescence spectrum component.

2. method according to claim 1, wherein, alternately shine observed zone with red light and NIR light.

3. method according to claim 2, wherein, red light-struck persistent period is different from light-struck persistent period of NIR.

4. method according to claim 3, wherein, red light-struck lasting longer than light-struck persistent period of NIR.

5. method according to claim 2, wherein, red light-struck persistent period is substantially equal to light-struck persistent period of NIR.

6. method according to claim 1, wherein, shine continuously observed zone and use the observed zone of irradiation, NIR photoperiodism ground with red light.

7. method according to claim 1, wherein, shine continuously observed zone and periodically shine observed zone with red light with NIR light.

8. method according to claim 1, wherein, with video rate switch described red light or NIR light or they both.

9. method according to claim 2, wherein, from adjacent in time picture field, the picture field that lacks red reflex light spectral components or NIR fluorescence spectrum component is carried out interpolation, described adjacent picture field in time comprises corresponding red reflex light spectral components or NIR fluorescence spectrum component.

10. method according to claim 7 wherein, deducts from the red reflex light of combination and NIR fluorescence and does not exist the NIR fluorescence spectrum component that obtains in red light-struck situation to obtain independent red reflex light spectral components.

11. method according to claim 1 wherein, mainly draws the spatial information in observed zone from blue reflected light and green reflected light.

12. an imaging system that is used for obtaining NIR image and full-colour image comprises:

Light source, it provides visible light and NIR light to observed zone,

Photographing unit, it has and is configured to detect respectively the red reflex light of the blue reflected light that returns from observed zone, green reflected light and combination and one or more imageing sensors of NIR fluorescence,

Controller, it carries out signal with described light source and described photographing unit and communicates by letter to be used for

Shine continuously observed zone with blue and green light,

With red light and NIR rayed observed zone, wherein, at least one in described red light and NIR light be by periodically opening and closing, and

Determine respectively red reflex light spectral components and NIR fluorescence spectrum component with the redness that is switched and NIR phototiming ground according to red reflex light and the NIR fluorescence of combination, and

Display, it receives corresponding to the picture signal of blue reflected light, green reflected light and the independent red reflex light spectral components of determining and reproduces thus the panchromatic reflected image in observed zone, and described display also receives the NIR fluorescence spectrum component of determining separately and also reproduces thus the NIR image in observed zone.

13. imaging system according to claim 12 wherein, is alternately shone observed zone by the light source with red light and NIR light.

14. imaging system according to claim 12, wherein, described light source comprises

Illumination apparatus, it launches visible light and the NIR light of constant intensity basically on the continuous spectrum scope, and

A plurality of light filters, it is arranged between described illumination apparatus and observed zone so that transmission blueness and green light and upper discontinuous red light of time and upper discontinuous NIR light of time continuous in time.

15. imaging system according to claim 12, wherein, described light source comprises

Illumination apparatus, it launches visible light and the NIR light of constant intensity basically on the continuous spectrum scope,

The first dichroic device, it is used for visible light and NIR light are separated into blue and green and red light and NIR light,

Shade device, its red light and NIR light that is used for having separated is transformed into upper discontinuous red light of time and upper discontinuous NIR light of time, and

The second dichroic device, it is used for described blueness and green light, upper discontinuous red light of described time and upper discontinuous NIR light of described time are made up to be transmitted to observed zone.

16. imaging system according to claim 12, wherein, described light source comprises

The first illumination apparatus, it launches green and the blue light of constant intensity basically,

The second illumination apparatus, the red light that its generation is switched,

The 3rd illumination apparatus, the NIR light that its generation is switched, and

The dichroic device, its be used for will the described red light that is switched and the described NIR light that is switched and described green and blue light make up in order to be transmitted to observed zone.

17. imaging system according to claim 16 wherein, produces the described red light that is switched and NIR light by the continuous strength light beam that interrupts red light and NIR light with chopper or chopper.

18. imaging system according to claim 16, wherein, by producing the described red light that is switched and NIR light with described the second illumination apparatus of electrical way opening and closing and described the 3rd illumination apparatus.

19. imaging system according to claim 12, wherein, described imageing sensor adopts interlacing scan.

20. imaging system according to claim 12, wherein, described imageing sensor adopts and lines by line scan.

21. imaging system according to claim 12, also comprise the dichroic prism assembly, the different exit facets that it separates red reflex light and the NIR fluorescence of the blue reflected light that returns from observed zone, green reflected light and combination and separated light is directed to the dichroic prism assembly in the spectrum mode, wherein, described one or more imageing sensor comprises three imageing sensors, and each is installed on different exit facets.

22. imaging system according to claim 12, wherein, described one or more imageing sensor comprises the single image sensor, described single image sensor has a plurality of pixels, and each pixel can respond the red reflex light of the blue reflected light that returns from observed zone, green reflected light and combination and NIR fluorescence.

23. imaging system according to claim 22, wherein, described single image sensor comprises that the mosaic that is arranged on before described sensor pixel is blue, green, redness-NIR filter array.

24. imaging system according to claim 12, wherein, described one or more imageing sensor comprises the single image sensor with a plurality of stack layers, and each layer has can be to the red reflex light of the blue reflected light that returns from observed zone, green reflected light and combination and a plurality of pixels that respond NIR fluorescence.

25. imaging system according to claim 12, wherein, described imaging system is configured to endoscope.