CN116687323A - A method for acquiring multispectral images by a multispectral stroboscopic light source black and white image sensor - Google Patents

Abstract

The invention discloses a method for acquiring multi-spectral images by a black-and-white image sensor of a multi-spectral strobe light source. The present invention can realize multiple images in one machine by switching the frequency of the light source, and extract multiple images such as synthetic color images, monochrome images, fluorescent images, and infrared images at the same time. Images can be combined freely, displayed independently or simultaneously. Therefore, by adopting the solution provided by the present invention, the cost input of endoscopic equipment can be effectively saved. At the same time, there is no special requirement for the driving mode of the light source, only an independent switching circuit is added to each single-color light source to facilitate and quickly switch colors to form a strobe light source. The use of stroboscopic light sources can effectively reduce the temperature of the endoscope, which has great advantages for the medical endoscope industry with temperature requirements.

Description

A method for acquiring multispectral images by a multispectral stroboscopic light source black and white image sensor

technical field

The invention relates to the technical field of endoscope imaging, in particular to a method for acquiring multispectral images by a black and white image sensor with a multispectral frequency light source.

Background technique

The current imaging technology basically uses a white light source for irradiation, and then obtains a color image through a color image sensor, and distinguishes the color of the acquired image through the color film integrated on the image sensor. The imaging technology that uses black and white image sensors for image acquisition is generally used for infrared auxiliary monitoring, or auxiliary imaging in multi-eye cameras to optimize image details. Image information acquired by a black and white image sensor does not contain color information.

Some application fields have limitations on size and hope to have higher resolution, such as the field of endoscopy, but the existing technical conditions may not be able to achieve higher resolution under the required size, such as a certain A color image sensor with a size of 1mm*1mm and a resolution of only 400*400. One pixel is actually composed of red pixels*1, blue pixels*1, and green pixels*2; if it is replaced with a black and white image sensor, Under the same area and the same technical conditions, it can achieve 800*800 resolution, the number of pixels has quadrupled, and the details will be richer.

Please refer to Figure 1. In order to obtain higher resolution, the existing endoscope technology will use 3-chip technology, that is, use optical elements to split white light into three paths of red, green and blue, and irradiate three black and white image sensors respectively. Then use algorithms to synthesize color images, the optical design is complicated, the overall cost is high, and the volume is large, so it cannot be used in the field of endoscopes for front-end imaging.

Please refer to Figure 2. At the same time, existing endoscopes generally use white light sources, and some companies use narrow-band filters to achieve NBI technology; in some inspections, light sources need to be switched to achieve fluorescence effects. These designs require complex The optical path is very expensive; the fluorescent effect requires the doctor to manually switch the light source when using it, and the display after switching becomes a fluorescent image, and it is impossible to compare and observe ordinary images at the same time.

Existing technologies for realizing multispectral images rely on multispectral image sensors, or multiple sensors acquire images separately and then synthesize them. At the same time, the existing multi-spectral sensor is similar to the design of the color image sensor, but the three-color film is replaced by a multi-color film, so that multiple color images can be obtained at the same time, and the resolution is sacrificed while obtaining multi-spectrum. Therefore, it is usually used for material spectrum identification and cannot be used in the field of endoscopy. Moreover, the design and manufacture cost of the multi-color film is relatively high, and the image sensor needs to be customized, which is incompatible with common ordinary sensors.

Therefore, there are defects in the prior art and need to be improved.

Contents of the invention

The purpose of the present invention is to overcome the deficiencies of the prior art and provide a method for acquiring multispectral images by a black and white image sensor with multispectral strobe light sources.

The technical scheme of the present invention is as follows: provide a kind of multi-spectral stroboscopic light source black-and-white image sensor to acquire multi-spectral image method, it is characterized in that, comprises the following steps:

Step 1: Set the combination of light source strobe;

Step 2: Extend the endoscope to the position where the image needs to be acquired, start the light source, and irradiate according to the set stroboscopic parameters;

Step 3: The drive unit controls the light source to turn on the monochromatic light source 1 to the monochromatic light source n in turn for irradiation. When each monochromatic light source is irradiated, the black and white image of the current monochromatic light source is respectively obtained through the black and white image sensor, and is irradiated. When the time reaches the set duration, the current monochromatic light source is turned off, and the next monochromatic light source is turned on in sequence;

Step 4: The black-and-white image sensor transmits the received images to the control unit, and the control unit converts the black-and-white images acquired under each monochromatic light source into a color image corresponding to the color of the monochromatic light source;

Step 5: the control unit identifies whether the user needs to adjust the combination of light sources;

Step 6: According to the set requirements, the image of the required color is extracted separately from the converted image, or the converted color images are synthesized, and then the required image is output to the display unit for display.

Further, the specific steps of the step 3 are:

Step 3.1: The light source turns on the monochromatic light source 1 for irradiation, the black and white image sensor acquires the black and white image when the monochromatic light source 1 is irradiated, and when the irradiation time reaches the set duration, the monochromatic light source 1 is turned off;

Step 3.2: The light source turns on the monochromatic light source 2 for irradiation, the black and white image sensor acquires the black and white image when the monochromatic light source 2 is irradiated, and when the irradiation time reaches the set duration, the monochromatic light source 2 is turned off;

Step 3.3: The light source turns on the monochromatic light source n for irradiation, and the black and white image sensor acquires the black and white image when the monochromatic light source n is irradiated. When the irradiation time reaches the set time, the monochromatic light source n is turned off, and the first group of strobe combined irradiation is completed. and image acquisition.

Further, the specific steps of step 5 are: the control unit will identify whether the user chooses to adjust the combination of light sources, if not, continue to cycle open the original light source scheme; if adjustment is required, adjust the light source according to user needs plan.

Further, the black-and-white image sensor adopts a CCD image sensor or a CIS (image sensor.

Further, the light source is composed of several single-color LED lamps.

By adopting the above scheme, the present invention can realize multiple images in one machine by switching the frequency of the light source, and simultaneously extract multiple images such as synthetic color images, monochrome images, fluorescent images, infrared images, etc., only by combining the spectrum emitted by the switched light source, Images of various colors can be freely combined, displayed independently or simultaneously. Therefore, by adopting the solution provided by the present invention, the cost input of endoscopic equipment can be effectively saved. At the same time, there is no special requirement for the driving mode of the light source, only an independent switching circuit is added to each single-color light source to facilitate and quickly switch colors to form a strobe light source. The use of stroboscopic light sources can effectively reduce the temperature of the endoscope, which has great advantages for the medical endoscope industry with temperature requirements.

Description of drawings

FIG. 1 is a schematic diagram of a prior art process.

Fig. 2 is a schematic diagram of the second prior art process.

Fig. 3 is a schematic flow chart of the present invention.

Fig. 4 is a flow chart of the software part of the present invention.

Fig. 5 is a block diagram of the hardware connection of the present invention.

Figure 6 shows the original black and white image captured by the black and white image sensor and the converted monochrome image.

Figure 7 is a full-spectrum image of monochrome image synthesis.

FIG. 8 is a comparison chart of image sharpness acquired by a black and white image sensor and a color image sensor.

Detailed ways

The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

Please refer to Fig. 3 to Fig. 5, the present invention provides a kind of multi-spectral stroboscopic light source black-and-white image sensor to acquire multi-spectral image method, it is characterized in that, comprises the following steps:

Step 1: Set the combination mode of light source strobe.

Step 2: Extend the endoscope to the position where the image needs to be acquired, start the light source, and irradiate according to the set stroboscopic parameters.

Step 3: The drive unit controls the light source to turn on the monochromatic light source 1 to the monochromatic light source n in turn for irradiation. When each monochromatic light source is irradiated, the black and white image of the current monochromatic light source is respectively obtained through the black and white image sensor, and is irradiated. When the time reaches the set duration, the current monochromatic light source is turned off, and the next monochromatic light source is turned on in sequence. The specific steps are:

Step 3.1: The light source turns on the monochromatic light source 1 for irradiation, the black and white image sensor acquires the black and white image when the monochromatic light source 1 is irradiated, and when the irradiation time reaches the set duration, the monochromatic light source 1 is turned off.

Step 3.2: The light source turns on the monochromatic light source 2 for irradiation, the black and white image sensor acquires the black and white image when the monochromatic light source 2 is irradiated, and when the irradiation time reaches the set duration, the monochromatic light source 2 is turned off.

Step 3.3: The light source turns on the monochromatic light source n for irradiation, and the black and white image sensor acquires the black and white image when the monochromatic light source n is irradiated. When the irradiation time reaches the set time, the monochromatic light source n is turned off, and the first group of strobe combined irradiation is completed. and image acquisition.

Step 4: The black-and-white image sensor transmits the received images to the control unit, and the control unit converts the black-and-white images acquired under each monochromatic light source into a color image corresponding to the color of the monochromatic light source. The images acquired by the black-and-white image sensor are shown in the three images in the first row of Figure 6, and each black-and-white image is converted into a monochrome image of the corresponding color of the light source as shown in the three images in the second row of Figure 6.

Step 5: The control unit recognizes and judges the converted image. The specific steps are: the control unit will identify whether the user chooses to adjust the combination of light sources. If not, continue to cycle and open the original light source scheme; Adjust the light source scheme according to user needs.

Step 6: According to the set requirements, extract the image of the required color from the converted image separately, or synthesize the converted color images, as shown in Figure 7, and then output the required image to the display unit for further processing. show.

The black and white image sensor adopts CCD image sensor or CIS image sensor.

The CCD image sensor is a semiconductor device with many neatly arranged capacitors on it, which can sense light and convert optical images into digital signals.

CIS (CMOS Image Sensor) image sensor adopts CMOS process photosensitive element for photosensitive imaging. Compared with CCD image sensor, its structure is simpler, and it has the advantages of small size, light weight, and low production cost. Please refer to Figure 8. The left picture is a black and white CIS The partially enlarged schematic diagram of the image captured by the image sensor. The right picture is the partially enlarged schematic diagram of the image captured by the color CIS image sensor. It can be seen that the resolution of the black and white CIS image sensor is higher than that of the color CIS image when other conditions remain unchanged. sensor, therefore, the present invention uses a black and white image sensor to obtain clearer image information.

The light source is composed of several monochromatic LED lamps to ensure good monochromaticity of the light source.

The method provided by the present invention irradiates the area where the image needs to be obtained with light of different colors, obtains the corresponding image on the black and white image sensor, then converts the obtained image into a monochrome image of the corresponding color, and then converts the obtained monochrome image The color images are synthesized and compared to synthesize a full-spectrum image. According to different application scenarios, images with different color temperatures need to be modulated. You can use a combination of monochromatic lights of different colors for stroboscopic shooting, or add different numbers of spectra on the original basis. These operations can be performed through the same LED light source. Convenient.

However, in the prior art, if the spectrum needs to be expanded, it is generally necessary to change the light source and add a narrow-band camera, which is cumbersome to operate and high in cost.

The present invention provides an embodiment, and the light source provides three colors of light: red, green and blue. Red, green, and blue are the three primary colors of light. Through the combination of red, green, and blue lights, colors in the full spectrum range can be displayed. When working, extend the endoscope to the position where the image needs to be acquired, turn on the red, green and blue light sources in turn, and capture images under different color light sources through the black and white image sensor, and then capture the black and white images captured by the black and white image sensor The image is converted into a monochrome image of the corresponding color, and then the images of different light source colors are synthesized into a full-spectrum image, and the control system recognizes and judges the results of monochrome and multicolor images, and then outputs them to the display unit for display.

The structure of the endoscope used in the present invention is a common light guide line, without complex and expensive components such as beam splitters and filters, and by switching the frequency of the light source, multiple images can be realized in one machine, and simultaneously extracted To synthesize multiple images such as color images, monochrome images, fluorescent images, and infrared images, you only need to switch the spectral combination emitted by the light source, and the images of various colors can be combined freely, and can also be displayed independently or simultaneously. Therefore, by adopting the solution provided by the present invention, the cost input of endoscopic equipment can be effectively saved. At the same time, there is no special requirement for the driving mode of the light source, only an independent switching circuit is added to each single-color light source to facilitate and quickly switch colors to form a strobe light source. The use of stroboscopic light sources can effectively reduce the temperature of the endoscope, which has great advantages for the medical endoscope industry with temperature requirements.

The present invention sacrifices the frame rate of the image sensor to improve the image quality. For example, a black-and-white image sensor with a refresh rate of 120 Hz can obtain a 40 Hz color image when there are only three colors of red, green and blue light; if it is red, green and blue + IR (infrared) In the case of four-color light, only 30Hz images can be obtained. As the number of spectra increases, the frame rate of the image will drop, and it will cause the misalignment of various colors in the picture. Therefore, this product is not suitable for high-speed video scenes. For applications where high speed is necessary, higher frame rate sensors can be used, or frame interpolation techniques can be used. However, for the field of medical endoscopy, the requirement for image clarity is higher than that for frame rate, so the present invention has clinical needs in the medical field.

The above are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention. Inside.

Claims (5)

1. A method for acquiring multispectral images by a multispectral stroboscopic light source black-and-white image sensor is characterized by comprising the following steps:

step 1: setting a combination mode of stroboscopic light sources;

step 2: extending the endoscope to a position where the image acquisition is required, starting a light source, and irradiating according to the set stroboscopic parameters;

step 3: the driving unit controls the light sources to turn on the monochromatic light sources 1 to n in sequence for irradiation, when each monochromatic light source irradiates, a black-and-white image of the current monochromatic light source irradiated is obtained through the black-and-white image sensor respectively, when the irradiation time reaches a set duration, the current monochromatic light source is turned off, and the next monochromatic light source is turned on in sequence;

step 4: the black-and-white image sensor respectively transmits the received images to the control unit, and the control unit converts the black-and-white images acquired under each monochromatic light source into color images corresponding to the colors of the monochromatic light sources;

step 5: the control unit identifies whether a user needs to adjust the light source combination mode;

step 6: the image of the desired color is extracted from the converted image alone or the converted color image is synthesized according to the set requirement, and then the desired image is output to the display unit to be displayed.

2. The method for obtaining a multispectral image by using the multispectral strobe light source black-and-white image sensor according to claim 1, wherein the specific steps of the step 3 are as follows:

step 3.1: the method comprises the steps that a light source is turned on a monochromatic light source 1 to irradiate, a black-and-white image sensor obtains a black-and-white image when the monochromatic light source 1 irradiates, and when the irradiation time reaches a set duration, the monochromatic light source 1 is turned off;

step 3.2: the light source is turned on the monochromatic light source 2 to irradiate, a black-and-white image sensor acquires a black-and-white image when the monochromatic light source 2 irradiates, and when the irradiation time reaches a set duration, the monochromatic light source 2 is turned off;

step 3.3: the light source is turned on to irradiate the monochromatic light source n, the black-and-white image sensor acquires a black-and-white image when the monochromatic light source n irradiates, and when the irradiation time reaches a set duration, the monochromatic light source n is turned off to complete the irradiation and image acquisition of the first group of stroboscopic combination.

3. The method for obtaining a multispectral image by using the multispectral strobe light source black-and-white image sensor according to claim 1, wherein the specific steps of the step 5 are as follows: the control unit can identify whether a user selects a combination mode for adjusting the light sources, and if not, the control unit continuously and circularly turns on the originally set light source scheme; and if the adjustment is needed, adjusting the light source scheme according to the user requirement.

4. The method for obtaining multispectral images by using the multispectral stroboscopic light source black-and-white image sensor according to claim 1, wherein the black-and-white image sensor adopts a CCD image sensor or a CIS image sensor.

5. The method for obtaining multispectral images by using the multispectral stroboscopic light source black-and-white image sensor according to claim 1, wherein the light source is composed of a plurality of monochromatic LED lamps.