WO2024133601A1 - Procédé d'imagerie en temps réel - Google Patents
Procédé d'imagerie en temps réel Download PDFInfo
- Publication number
- WO2024133601A1 WO2024133601A1 PCT/EP2023/087152 EP2023087152W WO2024133601A1 WO 2024133601 A1 WO2024133601 A1 WO 2024133601A1 EP 2023087152 W EP2023087152 W EP 2023087152W WO 2024133601 A1 WO2024133601 A1 WO 2024133601A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- polarimetric
- series
- measurements
- light
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/303—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the vagina, i.e. vaginoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
- A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
- A61B1/00186—Optical arrangements with imaging filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
Definitions
- the present invention relates to the field of polarimetric imaging, and more particularly but not exclusively polarimetric imaging applied to colposcopy.
- State of the art Colposcopy consists of examining the cervix using a device called a colposcope.
- the colposcope allows remote observation of the cervix without any contact between the optics or other components of the colposcope and the tissue to be explored.
- the colposcope includes an illumination system allowing the cervix to be illuminated through a speculum inserted into the vagina and the cervix to be observed from a distance. Illumination is traditionally carried out using white light.
- a green filter can be added to the lighting system and used optionally to highlight the areas most absorbed by hemoglobin.
- the optical system of the colposcope can be connected to a color camera which allows color images and videos to be recorded (or monochromatic following the use of the green filter) on a computer's hard drive.
- the image of the cervix can be displayed in real time on the computer screen.
- the optical system of the colposcope is also connected to eyepieces which allow direct observation of the cervix by the user with, for example, stereoscopic vision.
- the colposcope may comprise a head mounted on an articulated arm, and may comprise two eyepieces, more precisely a left eyepiece and a right eyepiece, communicating with two respective light entry ports present on the front of the head, oriented towards the area to be examined, used to directly visualize the area of interest, and next to these two entry ports, a light output port used to illuminate the area of interest; the light is produced, for example, by a lamp placed outside the head and conveyed to the latter by a light guide comprising a bundle of silica optical fibers.
- polarimetric Mueller imaging consists of measuring the Mueller matrix of a target sample and can provide various useful information on the nature of the sample, in particular by making it possible to analyze its optical anisotropy and its diffusion properties. the light.
- Mueller polarimetry imaging is of interest for the ex vivo and in vivo study of various biological tissues and in particular the cervix.
- Patent EP 1738 682 describes means for implementing a polarimetric image in colposcopy. Indeed, the knowledge provided by polarimetric information can make it possible to improve the quality of medical diagnosis, for different types of pathologies and in particular for the early detection of cervical cancer.
- Mueller polarimetric imaging is a technique that allows the complete polarimetric characterization of a sample through the measurement of its Mueller matrix.
- a Mueller polarimeter is generally composed of a light source, a polarization state generator (PSG), a polarization state analyzer (PSA) and a detector.
- a Mueller polarimeter can provide a point measurement.
- a photodetector can be used as a detector.
- a point Mueller polarimeter only one Mueller matrix is measured.
- a Mueller polarimeter can advantageously work as an imager.
- a CCD or CMOS camera is used as a detector. Each pixel of the camera is the equivalent of a photodetector for a point Mueller polarimeter.
- a Mueller matrix is measured for each pixel.
- Polarimetric Mueller imaging generally requires the acquisition of several intensity images to measure the Mueller matrix of a sample. This is a technique that can be slow, particularly if the intensity images needed to obtain the Mueller matrix are acquired consecutively.
- an imaging Mueller polarimeter In the case of an imaging Mueller polarimeter, the measurement of light intensity is done simultaneously for all the pixels of the camera used. For each pixel, the light signal is transformed into photoelectrons.
- the modality with which the electrical signal produced by the photoelectrons is processed, as well as the number of pixels in the region of interest (ROI) of the selected sensor determine the number of images acquired per second (“frames per second » or FPS). If multiple wavelengths must be acquired to explore biological tissue at different depths, Mueller polarimetric imaging may require even more time if these wavelengths are acquired in succession, which is the case for most multispectral Mueller polarimeters currently used. However, multispectral analysis is crucial for exploring biological tissue at different depths.
- step 1) For biomedical applications, step 1) must be accomplished in a maximum time of the order of a second to reduce the blurring effects due to involuntary movements of patients (breathing, heartbeat, etc.) during the measurement. Steps 2) and 3) should ideally be accomplished very quickly to return useful images to practitioners as soon as possible after the measurement, with a maximum delay of a few seconds. Step 2) can be generally quick and can be accomplished quite easily, especially if the matrices A -1 and W -1 were calculated previously. Step 3) can on the contrary be quite slow and require high computing power, in particular if it requires for example the calculation of the eigenvalues of the matrix M, which can often be the case for the decompositions of the Mueller matrices or other algebraic treatments.
- Polarized cameras are generally monochromatic. Several cameras are therefore necessary to reconstruct a color image, which significantly increases the size of the system. In addition, the images obtained with the different cameras are difficult to superimpose pixel by pixel. In addition, very fine optical adjustments, quite complex to implement, are necessary to obtain images, acquired with the different cameras, superimposable pixel by pixel. Additionally, with these cameras, each pixel is divided into 4 sub-pixels, of which two sub-pixels correspond to two different linear polarization states.
- the other two pixels generally correspond to the same linear polarization state between them, which is different from the polarization states corresponding to the first two pixels mentioned above.
- Pixels divided into four subpixels can produce a loss of image resolution. This loss of Resolution can be recovered by digital methods, which can however generate artifacts in the images, or by fairly complex calculation methods, which can considerably increase the image acquisition time.
- the matrix B must be acquired within a maximum delay of the order of approximately one second and the relevant polarimetric parameters, calculated during the post-processing step, must be restored with a maximum delay of a few seconds.
- the first limitation is the speed of acquisition of the intensity images necessary to obtain the intensity matrix B and therefore the Mueller matrix M.
- the second limitation is linked to obtaining the main polarimetric parameters of M with a process of post treatment.
- Most decompositions of Mueller matrices require the calculation of the eigenvalues of the Mueller matrix M, which represents a computational process that can hardly be parallelized and accomplished in real time. Indeed, in a conventional white light imaging system, for smooth real-time tracking of an image, the flow should generally be at least 8 FPS if the target moves very slowly.
- Certain polarimetric imaging methods make it possible to reduce the number of measurements but do not allow the acquisition of complete Mueller polarimetry images (4x4).
- Others rely on relatively complex specialized sensors such as polarized cameras, which allow faster acquisition but which may, at present, have other significant limitations described above. Real-time imaging becomes difficult to accomplish if a multispectral approach is required and if different wavelengths are acquired in succession.
- a second challenge is carrying out step 1) above simultaneously for several wavelengths of the visible/near infrared spectrum to allow the practitioner to explore the microstructure of the tissue at different depths.
- a third challenge is to also provide reference color imaging in real time, which is necessary to clearly identify the area analyzed with polarimetry, thus allowing the practitioner to have well-known spatial landmarks, which would not be possible. possible with monochromatic light intensity images or by directly displaying polarimetric images.
- This step can make it possible, among other things, to: 1) select the most relevant polarimetric and non-polarimetric parameters; 2) determine the most relevant combination of polarimetric and non-polarimetric parameters for diagnosis; 3) merge together, using, for example, different types of image processing algorithms, the polarimetric images (e.g.
- the elements of the Mueller matrix and/or the polarimetric parameters obtained after the use of algebraic processing such as the decompositions of Mueller matrices) and non-polarimetric (e.g. color image and/or monochromatic intensity images) of interest at different wavelengths in a single image or in a limited number of images to provide practitioners with simplified and optimized information for diagnosis which is not directly observable in conventional images or in initial non-fused polarimetric images; 4) merge together the polarimetric images obtained for different wavelength ranges to obtain color polarimetric images.
- Another challenge may be the restitution of the combined images substantially in real time.
- a final challenge is to have a Mueller polarimeter that is very compact and easily adaptable, ergonomically, to different existing imaging systems, such as, for example, a colposcope or an endoscope or even a microscope (or an exoscope). for neurosurgery, or easily usable for the creation of a new ergonomic and space-saving imaging system to be used in medical practice depending on the intended application.
- Presentation of the invention Consequently, there is a need to benefit from efficient polarimetric imaging systems, in particular polarimetric colposcopes, in order to allow a multispectral and/or color visualization, as well as comfortable multispectral polarimetric and/or color visualization of the area examined, particularly in real time.
- the subject of the invention is a multispectral and/or color polarimetric imaging system, in particular polarimetric colposcopy, comprising: - a system of illumination comprising at least one light source, this illumination system emitting in at least two, better still at least three, spectral bands, - a polarization state generator (PSG) placed downstream of the light source and upstream of a target to be imaged, - a polarization state analyzer (PSA) placed downstream of the target to be imaged, - a multi-sensor camera comprising at least two, better at least three, sensors, to respectively record at least two, better at least three, images in said spectral bands.
- a system of illumination comprising at least one light source, this illumination system emitting in at least two, better still at least three, spectral bands
- PSG polarization state generator
- PSA polarization state analyzer
- the polarimetric imaging system can be wide field (macroscopic) or microscopic, and work in transmission or reflection, in free space or not. It is also possible to have an endoscope between the target and the PSA and a liquid guide between the PSG and the target, as described in EP2021/052647. Preferably, it has a wide field and works in reflection, particularly in free space (such as a colposcope).
- the imaging system can also be used for other biomedical applications, for example brain surgery or endoscopy, and non-biomedical applications, for example in the field of cosmetics or microelectronics.
- parallax effects between the different types of images produced by the camera, for example between color images (conventional RGB images) and polarimetric images, since the same camera is used for produce color images and polarimetric images and the system produces images of the same size on each of the sensors and positioned identically on each of the sensors, thus allowing their pixel-to-pixel superimposability.
- Parallax effects could also be limited by combining several cameras, however the alignment of several cameras can be complicated and time-consuming, the solution proposed previously makes it possible to limit parallax effects more easily and thanks to the use of a single camera .
- the spectral bands are three in number and range, for example, from 445 nm to 475 nm for the first, from 510 nm to 550 nm for the second, and from 600 nm to 660 nm for the third, being for example centered respectively on 460 nm, 530 nm and 630 nm.
- the camera is a bi-CCD, bi-CMOS, tri-CCD, tri-CMOS, 4-CMOS or 4-CCD camera, preferably tri-CCD, tri-CMOS, 4-CCD or 4-CMOS.
- the spectral bands are three in number and respectively in the red or near infrared, green and blue.
- the spectral bands are preferably visible and near infrared
- the spectral bands are blue, green, and red/near infrared
- the spectral bands are blue, green, red and near infrared.
- a multi-sensor camera provides an independent intensity image in gray levels for each sensor, these gray level images can be used on the one hand to measure the coefficients of the intensity matrix B in the case of Mueller polarimetry and on the other hand they can be combined to reconstruct a color image of the observed area.
- the camera can include at least two, better three, dichroic prisms, to separate the wavelengths to the different sensors.
- a tri-CCD camera for example, has three dichroic prisms, to separate the wavelengths to the different sensors.
- the sensor for detecting blue can be fixed on the first prism
- the sensor for detecting red can be fixed on the second prism
- itself can be fixed on the first prism
- the sensor for detecting green can be fixed on the second prism.
- the polarization state generator comprises electrically controllable liquid crystal polarization modulators, which allows for relatively fast switching, good compactness, suitable bandwidth and not disrupting superimposability. images. Liquid crystals also enable the implementation of full-field polarimetric imaging for the analysis of surfaces on a macroscopic scale as well as microscopic polarimetric imaging.
- the polarization state generator comprises, for example, rotating waveplates, as well as rotating polarizers and/or coupled systems of rotating waveplates and rotating polarizers.
- the polarization state generator can include systems coupling rotating waveplates and fixed polarizers, or even fixed waveplates and rotating polarizers or even rotating delay blades and rotating polarizers.
- the polarization state generator can also be produced using spatially separated polarization systems (polarizers, delay plates, etc.), which make it possible to produce different polarization states of light.
- the polarization state generator can also be produced using spatially separated polarization systems (polarizers, delay plates, etc.), which make it possible to produce different polarization states of light.
- Spatially separated polarization systems can also be fixed or modulated over time with a liquid crystal system or rotating systems. In this configuration, the light beam can be deflected using rapid switching systems to consecutively pass through the different polarization systems before illuminating the target.
- the polarization state analyzer preferably comprises electrically controllable liquid crystal depolarization modulators.
- the polarization state analyzer comprises, for example, rotating wave plates, as well as rotating polarizers or even systems coupling wave plates and polarizers according to all the combinations described above for the generator.
- polarization states Preferably, the liquid crystal polarization modulators are ferroelectric liquid crystal modulators, which allows a high switching frequency, with a control voltage of a few volts.
- the liquid crystal polarization modulators are nematic liquid crystal modulators.
- the polarization state analyzer can also be carried out using spatially separated polarization systems (polarizers, delay plates, etc.), which make it possible to produce different polarization states of the light.
- the polarization systems are spatially separated and can also be fixed or adjustable over time with a liquid crystal system or rotating systems.
- the light beam can be deflected using rapid switching systems to consecutively pass through the different polarization systems before illuminating the target, in particular before joining the detector.
- the light source is preferably a white light source, in particular a xenon lamp.
- a lamp makes it possible to emit in a wide spectrum and to produce both good multispectral and/or color images, as well as multispectral polarimetric and/or color images.
- it is a halogen type lamp, at least one LED or a source of any other type, incoherent or coherent (laser).
- the illumination system may include a single-band, dual-band, or even better tri-band dichroic filter, downstream of the light source placed before the target to be analyzed or placed after the target to be analyzed and before the detector.
- This filter can block UV and IR, for example, and let white light through, including the red, green and blue bands of the visible spectrum.
- This filter can be removable, in particular mounted on a filter wheel, in order to allow, for example, acquisition in the IR or near IR, or even near UV.
- the illumination system may include a dual-band, better tri-band, or at least a single-band filter.
- a quad-band filter can be used with a 4-CMOS or 4-CCD camera, for example, to enable simultaneous acquisition of blue, green, red and near-infrared images. It is also possible not to use any spectral filter.
- the illumination system may include several light sources emitting respectively in the spectral bands of interest, for example blue, green and red, or blue and yellow LEDs.
- the imaging system may include a polarimetric system according to another aspect of the invention, as defined below.
- the imaging system may include a filter wheel placed directly upstream of the camera, as well as possibly a linear polarizing filter of the analyzer, as described below. Alternatively, the filter wheel is placed directly downstream of the source.
- the filter wheel can carry a tri-band filter, as mentioned above, to allow for example the acquisition of images at wavelengths in spectral ranges centered around 460nm, 530nm and 630nm by the camera, as well as one or more filters monochromatic dichroics, to allow for example the acquisition of images in spectral ranges around 650nm and 700nm.
- the sensor intended to image red can also be used to image near infrared.
- the filter wheel can allow selection of different spectral ranges in blue, green and red/near infrared by changing the tri-band filter, removing the filter, replacing the type of filter used, e.g. replacing a tri-band filter by at least one monochromatic filter.
- the filter wheel can allow certain wavelength ranges to be explored in more detail.
- the imaging system may include a processor to generate a Mueller polarimetric image of the target in each of the spectral bands.
- Mueller polarimetric image we must understand an image comprising at least one piece of information extracted from the Mueller matrix, for example a polarimetric property such as diatenuation, polarisance, birefringence, depolarization, etc., as well as any information at least partially deduced from the knowledge of one of these properties.
- a polarimetric property such as diatenuation, polarisance, birefringence, depolarization, etc.
- polarimetric parameters particularly useful for diagnosis may include the linear phase delay, the degree of randomness of the azimuth of the slow (or fast) axis of the linear phase delay , the combined image of linear phase retardance and slow (or fast) axis azimuth of linear phase retardance, depolarization, linear correlation between depolarization and linear phase retardance, in particular at 530 nm.
- the processor can be configured to superimpose at least partially, on an image corresponding to the non-polarimetric observation by the camera (for example the basic color image), an image containing at least one polarimetric information. This polarimetric information can be displayed in false color.
- the system can be arranged to carry out, in particular with each of the camera sensors and in parallel for all the different sensors, successive real series of measurements on a given sample corresponding to the acquisition, for example, of at least 9 (Mueller polarimetry 3x3), in particular 12 (Mueller polarimetry 3x4), better still 16 (Mueller polarimetry 4x4) coefficients of the intensity matrix B , the processor being arranged to: - generate series of n additional measurements, also called “artificial" series, from a grouping of measurements coming from a series ⁇ of n measurements of a given rank, and at minus a series of a different rank, in particular of the next rank, and a permutation P( ⁇ ) of the measurements within each artificial series so as to respect the predefined order of the n measurements within each series, then - generate a stream of polarimetric images at a frequency higher than that which would be possible with said real series of measurements without the series of artificial measurements, from the polarimetric images produced from the real series of
- the processor can be arranged to decompose the Mueller matrix into a non-depolarizing component and a depolarizing component.
- the depolarizing component and the non-depolarizing component can have several forms.
- the parameters ⁇ and ⁇ are the weights of the components ⁇ ⁇ and ⁇ ⁇ of the Mueller matrix M, respectively. According to this model, the measured intensity matrix ⁇ can be written as the sum of a polarizing contribution and a non-depolarizing contribution.
- the frame rate is increased, which improves the comfort of viewing the images, and allows polarimetric imaging in real time, for example with a flow of at least 8 images per second of polarimetric images.
- Increasing the frame rate makes it possible to artificially increase the number of images per second without changing the exposure time necessary for acquisition, and therefore offers the possibility of obtaining images in real time.
- the frequency of 8 frames per second is sufficient if the object observed is static or moves slowly. If the object is moving faster, the required frame rate may be higher.
- the processor can be arranged to, before carrying out the permutation P, carry out a spatial registration of the images corresponding to the measurements in order to take into account possible movements of the zones observed in the field of view of the camera. In this way we limit the risk of blur in the polarimetric images, and we increase the precision of the polarimetric information.
- the processor can be arranged to decompose the Mueller matrix into a non-depolarizing component and a depolarizing component.
- the depolarizing component and the non-depolarizing component can have several forms.
- the processor can be arranged to calculate the depolarization by performing the following calculation: D epolarization
- the system can be arranged to generate the parallel display of at least one non-polarimetric image in at least one of the spectral bands, in particular the color image of the observed area, and at least one polarimetric image.
- the invention also relates to a method for learning an artificial intelligence system, for example comprising at least one convolutional neural network, in which the artificial intelligence system can receive non-polarimetric color images as input. and/or multispectral, as well as color polarimetric and/or multispectral images.
- This imaging method is advantageously applied to polarimetric imaging, for example to polarimetric colposcopy, and better, to multispectral and/or color polarimetric colposcopy as defined above.
- This process can be applied to colposcopy, microscopy, exoscopy for the brain, endoscopy, preferably polarimetric colposcopy, and better, multispectral polarimetric colposcopy.
- the result is then a Mueller matrix or a physical property calculated from this matrix.
- the series of measurements are then polarimetric measurements.
- the invention makes it possible, according to this aspect, to artificially increase the flow of images and to enable, or improve, imaging in real time despite the number of measurements to be carried out and the calculations necessary to generate the desired images.
- the invention makes it possible, in other words, to artificially increase the number of images per second, while maintaining a fixed number of acquisitions.
- real time we must understand with a delay between acquisition and visualization which is relatively small, for example 2 or 3 seconds, and compatible with a visualization of the information generated by the practitioner during the examination; for example, the delay between the moment when the measurements are carried out and when the information resulting from these measurements is displayed is less than or equal to 2s, better 1s.
- the generated result stream can be greater than 8 per second.
- the imaging to which this method is applied is advantageously polarimetric imaging and the series of n measurements can then correspond to the measurements of the coefficients of the intensity matrix B used to calculate the Mueller matrix.
- the series of measurements can correspond to the acquisition, for example, of at least 9, notably 12, better still 16, coefficients of the intensity matrix B.
- B AMW
- W ⁇ S ⁇ ,S ⁇ ,S ⁇ ,S ⁇ ⁇
- the measured intensity matrix ⁇ can be written as the sum of a polarizing contribution and a non-depolarizing contribution.
- a spatial registration of the images corresponding to the different intensity measurements which represent the components of the matrix B is carried out in order to take into account possible movements of the areas observed in the camera's field of view.
- the method of increasing the image rate is general and can be applied for example to systems using multi-sensor CCD and CMOS cameras, as well as monochromatic or polarized CCD and CMOS cameras.
- a system of polarimetric imaging preferably that defined above
- PSG polarization state generator
- PSA polarization analyzer polarization states
- the parameters q and p are the weights of the two components of the Mueller matrix.
- the processor can be arranged to calculate the depolarization by performing, for example, the following calculation: D epolarization Such an additive decomposition of the Mueller matrix makes it possible to parallelize the calculations and extract useful parameters more quickly.
- the Mueller matrix and relevant polarimetric parameters can be obtained for a single range of wavelengths or simultaneously for several wavelength ranges, in particular at least two, in particular in the visible and the infrared.
- Such a process thus makes it possible to reconstruct the image, in particular the color image, in time real from the combination of non-normalized and non-polarized intensity coefficients m ⁇ , of the three Mueller matrices obtained simultaneously in the spectral ranges corresponding to the blue, green and red part of the visible spectrum.
- Such a process makes it possible to avoid calculating the eigenvalues (“eigenvalues”) of the Mueller matrix, which is costly in terms of calculation time, and makes it possible to extract the desired parameters with much shorter calculations.
- the invention also relates to an observation system with two ports of input, in particular a binocular system, for example colposcopy, comprising a head comprising an optical system having a light output port making it possible to illuminate an area to be examined and left and right entry ports directed towards the area to be observed, the observation system further comprising a polarimetric system comprising a polarization state generator arranged in front of the output port and a polarization state analyzer of which at least part of the optical elements is arranged in front of one of the ports input, this analyzer comprising at least one optical element held by at least one support applying to only part of the contour of the optical element.
- a binocular system for example colposcopy
- the optical element can only partially overlap this other input port, without obscuring this input port by the support which would hinder observation.
- the optical element is, for example, a liquid crystal polarization modulator.
- This aspect of the invention takes advantage of the fact that the free edge of the optical element, which is preferably circular in outline, although partially superimposed on the entry port, remains substantially transparent in the eyepiece associated with this port. entry due to distance focusing, which is typically of the order of 20 to 40cm, therefore much greater than the distance separating the input port from the optical element, which is at most a few cm.
- optical elements of the analyzer are relatively transparent, apart from possibly the linear polarizer which can be placed in front of the camera downstream of the return prism towards the eyepiece, these elements do not cause any significant loss brightness for the observer. It is thus possible to use a conventional colposcope head or a head of another observation system with two input ports, in particular a binocular observation system, by attaching all or part of the polarimetric system to it on the front face. , which limits the manufacturing costs of the system and makes it easy to add a polarimetric imaging function to the observation system.
- Each support of an optical element of the analyzer can extend, for example, over an angular extent of between 180° and 300° in contact with the optical element, preferably having a general C shape open in one direction.
- the polarimetric system may also include at least one other support for maintaining at least one optical element of the polarization state generator placed in front of the light output port of the colposcope head.
- This other support may have a general C shape open upwards, which limits the size of the state generator in the vertical direction and makes it possible not to encroach on the input ports present near the output port opposite. front of the colposcope head.
- Each support may comprise a succession of support parts holding together optical elements of the polarization state generator (or the analyzer), and two supports serving to hold two consecutive optical elements may share an intermediate support part.
- the polarimetric system can thus comprise at least two consecutive support pieces assembled against each other, each of these support pieces having on one side a housing for receiving a respective optical element and one of the support pieces serving to retain the optical element from the other part.
- the polarization state generator and the analyzer preferably each comprise similar optical elements which are placed in opposite orders relative to the direction of propagation of the light.
- the generator thus comprises for example, in the direction of propagation of the light, a linear polarizing filter, a quarter-wave liquid crystal polarization modulator QFLC, a half-wave plate QWP, and a half-wave liquid crystal polarization modulator - HFLC wave.
- the analyzer can then include, in the direction of propagation of the light, a half-wave liquid crystal polarization modulator HFLC, a half-wave QWP plate, and a quarter-wave liquid crystal polarization modulator QFLC.
- the polarizer associated with the analyzer is preferably arranged after returning the light from the input port towards the associated eyepiece, upstream of the camera used to collect the intensity images used to generate the Mueller matrix, which makes it possible to limit the difference in brightness between the images delivered to the observer by the left and right eyepieces, as mentioned above.
- the housings receiving the electrically controllable optical elements may include at least one passage for an electric cable. This passage may include a channel which matches the shape of the contour of the element, in particular a semi-circular channel.
- the C-shaped optical element supports allow, before tightening, manual rotation of the optical elements around their axis, in order to make orientation adjustments.
- the optical elements of the generator are preferably oriented perpendicular to the direction of propagation of the light leaving the head of the observation system.
- the mounting of the optical elements of the generator is preferably carried out at an angle relative to those of the analyzer, so as to orient them perpendicular to the axis of propagation of the light leaving the exit port. This helps limit parasitic reflections.
- the polarimetric system includes a fan configured to blow air onto the optical element of the polarization state generator closest to the light output port of the observation system head. This ensures better and faster stabilization of the temperature, and limits the corresponding drifts.
- the polarimetric system may include a movable filter holder in front of the analyzer, allowing the system to be calibrated.
- This filter holder is for example fixed on one of the support parts used to hold the optical elements.
- the filter holder can be movable in a horizontal direction, generally perpendicular to the direction of observation.
- the filter holder can take, for example, four positions, three of which are for placing a predefined optical element in front of the analyzer, and the last for releasing the field.
- the movement of the filter holder is preferably motorized, and controlled by the aforementioned controller.
- the system may include a housing protecting the supports and the filter holder.
- the invention also relates to a polarimetry system intended to be attached to a head of an observation system, in particular a head of a colposcope, comprising an optical system having a light output port making it possible to illuminate a area to be examined and left and right input ports directed towards the area to be observed, the polarimetric system comprising a polarization state generator placed in front of the output port and a polarization state analyzer of which at least part optical elements are placed in front of one of the input ports, this analyzer comprising at least one optical element held by at least one support applying to only part of the contour of the optical element.
- This can make it possible to provide a free edge for this optical element, this free edge being arranged so as to partially overlap with the other input port.
- the polarimetry system may include fixing means on the head of the observation system. These fixing means may include screws, screwed into the head frame, for example under the exit window. Alternatively, the fixing is carried out differently, for example, by tightening.
- the polarimetry system may have all or part of the characteristics given above.
- the invention also relates to a polarimetry system intended to be attached to a head of an observation system, in particular a colposcope head, comprising an optical system having a light output port allowing to illuminate an area to be examined and at least one input port, the polarimetric system comprising a polarization state generator (PSG) placed in front of the output port and a polarization state analyzer (PSA) of which at least part of the optical elements are placed in front of the input port, at least one of the analyzer and the generator comprising optical elements held by at least one support, each support comprising a succession of parts maintaining between them optical elements of the polarization state generator or the analyzer, at least two supports serving to hold two consecutive optical elements sharing an intermediate support part, each of these parts preferably having on one side a housing for receive a respective optical element and one of the parts serving to retain the optical element of the other part.
- PSG polarization state generator
- PSA polarization state analyzer
- Such a polarimetry system is particularly compact, because it includes support parts which serve as housing for receiving an optical component and as a closing cover for the following support part.
- Such a system is also modular, because it is easy to replace support parts with others. It may have any of the characteristics of the observation system, in particular the colposcope, described elsewhere.
- the polarimetry system may in particular comprise an analyzer comprising at least one optical element held by at least one support applying to only part of the contour of the optical element so as to provide a free edge to this optical element, this free edge being arranged so as to partially overlap with the other input port, the polarimetry system comprising means for fixing on the head of the observation system described elsewhere.
- the invention also relates to a colposcopy system comprising: - an illumination system comprising o at least one light source, o a liquid light guide, to be connected at one end to the light source, this light guide having, preferably, a core diameter less than or equal to 5mm, - a colposcope head, comprising an optical system having a port input to connect to the other end of the liquid light guide, and a light output port to illuminate an area to be observed, the optical system preferably comprising between the entry port and the exit port an aspherical lens and a return prism.
- This configuration of the illumination system makes it possible to obtain a well-collimated light beam at a working distance preferably around 30 cm.
- the choice for the light guide of a liquid guide and for the core diameter of a diameter preferably less than or equal to 5mm makes it possible to reduce the divergence of the illumination beam and its size, and to increase the the intensity of the light in the center of the area to be observed, that is to say the cervix, and thus reduce parasitic reflections on the surrounding surfaces (vaginal wall, speculum, etc.), and by therefore significantly improve the quality of the images acquired.
- the liquid light guide provides illumination with satisfactory uniformity, including greater uniformity than that obtained with the silica fiber bundles typically used in colposcope illumination systems.
- the internal diameter of the liquid optical guide is between 2.5 and 3.5 mm.
- the illumination system may include an adapter configured to receive the optical guide and be mounted on the source with the possibility of adjustment in the three directions X, Y and Z relative to the source.
- Ergonomic colposcopy system According to another of its aspects, independently or in combination with the above, the invention also relates to a colposcopy system comprising: - a rolling base, - a mat carried by the rolling base, - at least a reference reflector carried by the mast, used for the calibration of a polarimetry system, - a colposcope head carried by an articulated arm connected to the base.
- the colposcopy system may also include: - a workstation comprising a computer, carried by the rolling base, - a keyboard carried by an articulated arm connected to the mat, and - a screen carried by an articulated arm connected to the mast at a height greater than that of the arm supporting the keyboard.
- a workstation comprising a computer, carried by the rolling base
- a keyboard carried by an articulated arm connected to the mat
- - a screen carried by an articulated arm connected to the mast at a height greater than that of the arm supporting the keyboard.
- the system comprises a box housing the light source(s), placed on the workstation, as well as a controller which makes it possible to control the various electro-optical and electronic components of the polarimetric system such as the controllable liquid crystal filters.
- the reference reflector can be placed in a light shield cap, at the top of the mast.
- This reflector is for example articulated around a vertical axis, and comprises for example on one side a frosted metal wall, for example aluminum, and on the opposite side a reference surface having known spectral properties.
- the rotating assembly of the reflector allows one of the faces to be easily replaced by the other without moving the head of the colposcope, which facilitates calibration operations.
- the head is for example placed approximately 30cm from the reflector, by maneuvering the articulated arm carrying the head.
- the colposcopy system advantageously includes a pedal which allows the user to trigger a predefined action, for example to start a polarimetric acquisition.
- the colposcope head may also have a button to trigger another predefined action, for example starting and stopping video recording.
- FIG. 1 shows a multispectral polarimetric imaging system 1 according to the invention, for example a polarimetric Mueller colposcope, it being understood that this aspect of the invention is not limited to a colposcope.
- the system 1 comprises an optical illumination system 2 for illuminating a target T, for example the cervix, and an optical system 3 for direct observation of the target and/or reconstruction of the image of the target T on an electronic medium.
- the lighting and observation of the target T are done through a polarimetry system 4 which includes a polarization state generator (PSG) through which the light coming from the illumination system and a polarization state analyzer (PSA) passed through by the light coming from the target T.
- PSG polarization state generator
- PSA polarization state analyzer
- the PSG and the PSA comprise liquid crystal polarization modulators, in particular chosen from those whose control frequency can be at least 60 Hz.
- the modulators ferroelectric liquid crystal polarization are preferred.
- the system 1 also includes an acquisition system comprising a multi-sensor camera 5, constituted for example by a tri-CCD or tri-CMOS camera, having for example sensors dedicated respectively to the field of red, green and blue of the visible spectrum.
- System 1 includes computer means 6 for, among other things, managing the acquisition of intensity images for each sensor, controlling the operation of the liquid crystal polarization modulators, synchronizing the camera acquisitions with the modulation of the liquid crystals, process the images obtained by each of the sensors of camera 5 and calibrate the system for each of the chosen spectral bands, as will be detailed later.
- These computing means 6 comprise for example one or more processors, one or more microcontrollers, specialized circuits such as FPGA, or microcomputers, and associated human-machine hardware interfaces, and can be programmed to acquire images of intensity in the different spectral bands of interest, for example red, green and blue in the example considered, then the calculation, for all or part of the pixels of the images, of the Mueller matrices in these different spectral bands, and the calculation and display of the polarimetric parameters of interest.
- the calculations and the different types of image processing for the processing and post-processing stages of the Mueller matrices can be carried out very quickly using a graphics card (GPU) or several graphics cards.
- GPU graphics card
- Different types of programming languages can be used for calculations and image processing, as well as for image acquisition management.
- Different types of programming languages C, C++, Python, etc.
- image calculation and processing can be used for image acquisition management.
- Using the same programming language for image acquisition and for the image processing and post-processing phase could completely eliminate the delay between image acquisition and real-time restitution.
- the computer means 6 can thus include a controller making it possible to control the PSG and the PSA and to process the images coming from the camera, said controller comprising for example one or more FPGAs, and a workstation comprising a computer equipped where appropriate with at least one graphics card, and a man-machine interface comprising for example a screen, a keyboard, and one or more buttons or control pedals, as described below.
- the illumination system is capable of emitting in each of the observation spectral bands. In the case where the spectral bands are in red, green and blue respectively, the illumination system may include a white light source such as a xenon source associated with spectral filters, or a set of LED diodes emitting respectively in red, green and blue, or LED diodes emitting in blue and yellow.
- the camera of the acquisition system being multi-sensor, preferably a tri-CCD or tri-CMOS RGB camera, it can acquire several images at the same time without significant loss of light and without interference problems (“cross talking”). between channels.
- the image obtained on each of the sensors can be an intensity image in gray levels for the corresponding spectral band.
- the grayscale intensity images from the different sensors are perfectly superimposable by construction, which simplifies the reconstruction of the final images after processing, in particular the addition of polarimetric information to the color images or the combination of polarimetric images at different wavelengths.
- Images obtained by the multispectral polarimetric imaging system, applied to Mueller polarimetry in the different spectral bands, in particular in red R, green G and blue B, can be generated by calculation in the different spectral bands, as illustrated in Figure 1. These images can, if necessary, be combined to generate an RGB color image of Mueller polarimetry. At the same time, the intensity images acquired by the three camera sensors can be combined to form an RGB color image. This image is useful to allow the practitioner to clearly identify the area where the polarimetric analysis is carried out.
- the determination of the Mueller matrices for each of the spectral bands R, G and B makes it possible to calculate in each of these bands intensity images reflecting the value of a polarimetry parameter (for example the retardance) for each of the pixels of the image, as illustrated in Figure 2.
- a polarimetry parameter for example the retardance
- This or these retardance and/or depolarization images can be merged with the color image to generate an I image in which the hue and/or contrast of certain areas is modified in order to provide additional information to the practitioner, helping with diagnosis. .
- CMOS complementary metal-oxide-semiconductor
- a multispectral illumination source in particular a xenon lamp
- a tri-CCD or tri-CCD camera CMOS makes it possible to obtain a particularly compact and efficient imaging system, well suited to colposcopy in particular.
- the fact of being able to generate multimode images perfectly aligned spatially relative to each other facilitates deep learning, for example by means of a convolutional neural network 7, as illustrated in Figure 3, this network receiving conventional images as input color, monochromatic intensity images and polarimetric images for the selected wavelength ranges and outputting one or more simplified images to aid in diagnosis, for example in the form of increased contrast.
- the computer means 6 can be configured to allow all or part of the following displays: - a multi-mode display in parallel (FIG.
- the Mueller matrix can be processed according to different known methods in order to calculate polarimetric properties, namely depolarization, linear phase retardance, etc.
- 16 successive measurements can be carried out for each pixel of the image, for each of the sensors of the multi-sensor camera, corresponding to the different coefficients of the intensity matrix B
- the Mueller matrix is the classic 4x4 matrix, i.e. the complete Mueller matrix, but we do not depart from the scope of the invention by using an incomplete 3x3, 3x4, or other version.
- the invention can also be used for simplified polarimetric imaging techniques such as Stockes polarimetric imaging or others.
- the invention makes it possible to increase a flow of results obtained for a physical quantity (or a set of physical quantities) X relating to a physical object O per unit of time from consecutive series ⁇ of n real measurements, called original series, succeeding one another in a predefined order at each given time interval, generating additional series, called artificial series, original series.
- These measurements can be the 16 intensity measurements of matrix B in the case of Mueller polarimetry, but this aspect of the invention is more general and can apply to other types of imaging different from Mueller polarimetric imaging.
- physical property or set of physical properties whose determination requires several successive measurements to be carried out.
- X can be obtained for an array of points (imaging).
- This table can be two-dimensional (2D) or three-dimensional (3D). This is the case for 2D or 3D imaging.
- 2D imaging each measurement point corresponds to one pixel.
- 3D imaging each measurement point corresponds to a voxel.
- These measured values are for example the coefficients of the intensity matrix B in the case of Mueller polarimetry.
- the measurements can be successive intensity values of each pixel of an image recorded by a given sensor of the camera of the acquisition system, and the method which has just been described can be applied to each pixel of this image. However, this image can change over time, for example due to the movements of the target.
- the image registration function can involve any suitable image registration algorithm; an example of a registration function is described in the article M. Irani and S.Peleg “Improving Resolution by Image Registration”, 1991, CVGIP Graphical models and image processing, Elsevier.
- the registration function can seek to determine the registration values a in x and b in y between two images, so as to minimize a loss function between them.
- the procedure described above can also be used in a more general case where the object O can be deformed. If Td is the characteristic time of the deformation, Td>>Tn is preferable. If Tx is the characteristic duration of a change in the property materialized by the result X, it is also preferable to have Tx>>Tn.
- Figure 10 illustrates the application of the permutation function P( ⁇ ) to the series ⁇ [.
- the function G here corresponds to the calculation which makes it possible to obtain from the intensity matrix B the Mueller matrix M.
- the registration function R can be applied by taking as a reference image, for example, that corresponding to the first image of a sequence of 16 consecutive images (in the case of a 4x4 Mueller matrix).
- Te + Tf + Tg ⁇ Ti in order to have real-time imaging, with Te the duration necessary for the permutation P, Tf the duration necessary for the application of the registration function R, Tg the time required to calculate M, Ti the duration of a single measurement.
- the coefficients of the non-normalized and non-polarized intensity m ⁇ ⁇ Mueller matrices obtained in the blue, green and red parts of the visible spectrum respectively, using the aforementioned method, can be combined together to produce the color image of the target in real time.
- Post-processing of the Mueller matrices The conventional calculation of the Mueller Matrix can involve, for example, a so-called Lu-Chipman decomposition, as described in the article S.-Y. Lu and R.A.
- the Stokes vector S n/a is associated with the non-depolarized component coming from of the surface layer of the tissue
- the Stokes vector S d is associated with the depolarized component of light, coming from the volume of the tissue.
- Figure 11 also represents the two Mueller matrices Mnd and Md respectively related to the non-depolarized and depolarized components of the light.
- the factors q and p aim to estimate the proportions of undepolarized and depolarized light, and must be determined.
- the intensity matrix B can be formulated as the sum of the contributions from undepolarized and polarized light.
- Depolarization can be calculated using the following formula: D epolarization
- This decomposition method saves significant time since it does not require the calculation of eigenvalues and eigenvectors, which is time-consuming.
- this method is matrix, which allows an algorithm to perform multiple calculations in parallel and not in series, which is a significant saving of time and memory.
- the different polarimetric parameters can thus be obtained more quickly, which is very advantageous in the case of real-time polarimetric imaging.
- Figure 12 polarimetric images obtained on one side via a classic Lu-Chipman decomposition, and on the other via the additive decomposition described above.
- the three corresponding top images are obtained by additive decomposition as described above and correspond respectively to the display of the linear phase retardance * (left image), the azimuth of the linear phase retardance) (image of the middle) and depolarization (right image), while the bottom three images represent the same parameters obtained via the Lu-Chipman decomposition.
- the imaging system according to the invention can be arranged to carry out a colposcopy examination, for example using a colposcopy system 10 as illustrated in Figure 13.
- This system 10 comprises a colposcope 20 having a head 21 carried by an articulated arm 22, itself carried by a rolling base 31.
- a vertical mat 30 is also carried by the rolling base 31.
- the colposcope 20 is connected to an illumination system comprising a light source 50 housed in a connected housing at the head 21 by a flexible optical guide 51, not visible in Figure 13 but apparent in Figure 14, the housing housing the source 50 resting for example on a workstation 60 comprising a computer.
- the colposcopy system 10 comprises a screen 40 connected to the computer 60, which is advantageously a touch screen, preferably liquid-tight. This screen is carried by the mast 30, as well as a keyboard 41, connected to the computer 60.
- a controller 70 is connected to the computer 60 to control in particular the operation of a polarimetric system 90 carried by the head 21. This controller 70 can also be connected to an acquisition system 110, in particular to the camera 5.
- the colposcopy system 10 comprises at least one reflector 81 housed in a support carried by the mat 30 and used for calibrating the polarimetry system. It is covered by a light shield cap 80, preferably carried by the mast 30, particularly at its top.
- This reflector 81 is for example articulated around a vertical axis of rotation, and comprises for example on one side a frosted metal wall 82, for example made of aluminum, and on the opposite side a reference surface 83 having known spectral properties, for example example a substrate with a neutral colored surface with high Lambertian reflection called “spectralon”.
- the rotary mounting of the reflector 81 makes it possible to easily replace one of the faces with the other without moving the head 21 of the colposcope, which facilitates calibration operations.
- the head 21 is for example placed approximately 30 cm from the reflector 81, by operating the articulated arm carrying the head.
- the colposcopy system 10 advantageously comprises a pedal 100 visible in Figure 13 which allows the user to trigger a predefined action, for example to start a polarimetric acquisition.
- the head 21 of the colposcope may also include a button 101, as illustrated in Figure 16, making it possible to trigger another predefined action, for example starting and stopping video recording.
- the polarimetric system 90 illustrated in Figure 19, includes the polarization state generator PSG and the polarization state analyzer PSA, almost all of the optical elements of which are illustrated in Figure 20.
- the state generator polarization PSG comprises a succession of four optical elements placed on the path of the light exiting through a window 210 of the head 21 of the colposcope, namely in the direction going from the outside towards the exit window 210, a first polarization modulator half-wave liquid crystal polarization at 510nm HFLC 191, a quarter-wave plate at 633 nm QWP 192, a second quarter-wave liquid crystal polarization modulator at 510nm QFLC 193, and a fixed linear polarizer 194.
- PSA polarization state analyzer comprises a succession of three optical elements placed on the path of the light reaching one of the input ports 211a and 211b associated respectively with the left and right eyepieces, in this case the input port 211b associated with the right eyepiece for the practitioner.
- a first half-wave liquid crystal polarization modulator at 510 nm HFLC 221
- a quarter-wave plate at 633nm QWP 222
- a second polarization modulator quarter-wave liquid crystal polarization at 510nm QFLC 223.
- the analyzer also includes a linear polarizer filter 224 similar to the polarizer 194 of the PSG, arranged downstream of the camera 5 within the acquisition system 110, as illustrated in the Figure 36.
- Each optical component 191, 192 or 193 of the PSG has a circular shape in the example illustrated and is held between two support pieces placed one on top of the other, one having a housing 233 to receive the element and the other serving to hold the element in its housing. All these support parts have a C-shaped upper part open upwards and leave the upper edge of each optical element clear.
- the polarizer 194 has a square or rectangular outline, and is housed in a support 265 provided with a slide open upwards.
- the optical element 191 is placed between a first support part 261 and a second support part 262 which has a housing 233 receiving the element 191, the support part 261 forming the retaining cover.
- the support piece 262 serves as a cover for a third support piece 263 having a housing 233 receiving the optical element 192, as visible in Figure 21.
- This third support piece 263 serves as a cover for a fourth support piece 264 having a housing 233 receiving the optical element 193.
- the different support pieces can be superimposed and are fixed together with the support 265 through the base of the PSA on the front face of the head 21 of the colposcope by screws 242, as illustrated in Figure 19.
- the optical elements 221, 222 and 223 of the PSA also have a circular shape and are held by support parts 251, 252, 253 and 254 superimposed on each other.
- Each support part 251 to 254 has a base 255 provided with holes for the passage of screws 242 used for fixing on the front face of the head 21, and an upper part 256 in the general shape of a C oriented substantially at 45° towards the bottom, the upper part 256 connecting via an upright 257 to the base 255, as illustrated in Figure 22.
- the support parts 252 to 254 each have a housing 258 accommodating a respective optical element.
- the optical element 221 is held between the support pieces 251 and 252, the support piece 251 serving as a cover, that the optical element 222 is held between the support pieces 252 serving as a cover and 253, and that the element 223 is held between the support parts 253 serving as cover and 254.
- the support part 252 carries in the upper part two branches 270 for fixing a filter holder 310 shown in Figure 34.
- This filter holder 310 carries in the example considered three filters 311, 312 and 313 which are respectively a phase retarder L30 whose fast axis is oriented at 30° relative to the linear polarizer P0, a linear polarizer P90 whose axis transmission is oriented at 90° relative to the polarizer P0, and a polarizer P0 whose transmission axis is oriented at 0° relative to a reference.
- the filter holder 310 also includes a clear area placed in front of the PSA once the calibration is completed to allow image acquisition.
- the filter holder 310 is movable in translation in the example considered, in a generally horizontal direction.
- An electronic circuit 320 allows the computer 60 to know the position of the filter holder, and therefore the filter which is active if applicable.
- the filter holder 310 can be motorized or moved manually, during calibration, so as to successively place the different filters 311 to 313 in front of the PSA. Calibration can be carried out using the so-called eigenvalue method (ECM for “Eigenvalue Calibration Method”).
- ECM eigenvalue Calibration Method
- the housing 233 is open laterally so as to allow the exit of the control wires of the optical element received therein through a passage 233a.
- the housing 233 also has, opposite the passage 233a, a clearance 233b to receive the control wire at the level of its connection to the optical element.
- the wire follows the contour of the optical element in a semi-circular channel 233c which matches the profile of the optical element.
- Figure 23 is a schematic and partial section of the light source 50.
- the choice of these filters makes it possible to obtain a relatively high transmittance, around 90% in the approximately 400-750 nm range.
- the optical guide 51 is held at one end 51a in the axis of the lamp 52 by means of a tip 56.
- the optical guide 51 is received at its other end 51b in the axis of an aspherical lens 180 of the colposcope, so as to give an image of the liquid guide approximately 30 cm from the head of the colposcope.
- the lens 180 is placed in front of a prism 181 which reflects the light towards the exit window of the colposcope.
- the optical guide 51 can be maintained if necessary using a set of supports 191 and 192 whose position relative to the body of the colposcope head is adjustable respectively in X and in Y, so as to allow to precisely adjust the position of the end 51b in the axis of the lens 180.
- liquid guide 51 whose core has a diameter of 3mm, because this allows, as illustrated in Figure 31, to benefit from more intense lighting in the center of the area illuminated by the colposcope, compared to a conventional guide whose core is 5mm in diameter.
- the liquid guide with a diameter of 3 mm makes it possible to obtain higher illumination, compared to that obtained with a liquid guide of 5 mm in diameter, on a surface of 3 cm in diameter corresponding approximately to the diameter of the neck uterine.
- the acquisition system 110 is fixed, as can be seen in particular in Figures 36 to 38, on the head 21 of the colposcope and receives the light reaching one of the eyepieces (the same as the one in front of which the PSA is placed) thanks to one or more return prisms integrated into the head 21.
- the camera 5 is equipped with a lens 415, and a filter wheel 411 carrying in the example considered three filters 421, 422 and 423. It is acts for example a tri-band filter adapted to the camera 5, a bandpass filter centered on 650 nm and for example 40nm of spectral width, and a bandpass filter centered on 700 nm and 50nm of spectral width.
- the filter wheel 411 is rotated by a motor 410.
- Camera 5 can include, as illustrated in Figure 39, three dichroic prisms, to separate the wavelengths to the different sensors.
- the camera comprises for example dichroic prisms 605, 604 and 606, the sensor 603 for the detection of blue being fixed on the prism 605, the sensor 601 for the detection of red being fixed on the prism 604, itself fixed on the prism 605, and the sensor 602 for detecting green being fixed to the prism 606, itself fixed to the prism 604.
- the user can proceed in a manner known per se to the polarimetric calibration using the two faces of the reflector 81 and the different filters of the filter holder 310. Then, the head 21 can be positioned so as to image the cervix after dilation of the vagina with the use of a speculum.
- the practitioner can start recording a video by pressing button 300 and/or trigger polarimetric acquisition by pressing pedal 100. Pressing the pedal triggers polarimetric acquisition by stopping the video recording, which resumes automatically after the end of polarimetric acquisition. Pressing the button again stops video recording.
- the invention is not limited to the example which has just been described. In particular, it is possible to modify the optical system of the colposcope, for example by removing the eyepieces, with observation being carried out only on screen.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biophysics (AREA)
- Physics & Mathematics (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Optics & Photonics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Signal Processing (AREA)
- Gynecology & Obstetrics (AREA)
- Reproductive Health (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
Description
Claims
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23836838.5A EP4637505A1 (fr) | 2022-12-20 | 2023-12-20 | Procédé d'imagerie en temps réel |
| CN202380092175.7A CN120603530A (zh) | 2022-12-20 | 2023-12-20 | 实时成像方法 |
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR2213891A FR3143739B1 (fr) | 2022-12-20 | 2022-12-20 | Système d’observation à deux ports d’entrée équipé d’un système polarimétrique |
| FR2213889A FR3143740B1 (fr) | 2022-12-20 | 2022-12-20 | Imagerie multispectrale polarimétrique |
| FRFR2213890 | 2022-12-20 | ||
| FR2213890A FR3143316B1 (fr) | 2022-12-20 | 2022-12-20 | Procédé d’imagerie en temps réel |
| FRFR2213889 | 2022-12-20 | ||
| FRFR2213891 | 2022-12-20 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024133601A1 true WO2024133601A1 (fr) | 2024-06-27 |
Family
ID=89507616
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2023/087152 Ceased WO2024133601A1 (fr) | 2022-12-20 | 2023-12-20 | Procédé d'imagerie en temps réel |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4637505A1 (fr) |
| CN (1) | CN120603530A (fr) |
| WO (1) | WO2024133601A1 (fr) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1738682A1 (fr) | 2005-07-01 | 2007-01-03 | Ecole Polytechnique | Systeme d'imagerie polarimetrique electronique pour appareil de colposcopie |
| US20090076368A1 (en) * | 2007-04-11 | 2009-03-19 | Forth Photonics Ltd. | Integrated imaging workstation and a method for improving, objectifying and documenting in vivo examinations of the uterus |
| US20100268069A1 (en) * | 2009-04-16 | 2010-10-21 | Rongguang Liang | Dental surface imaging using polarized fringe projection |
| EP3120134B1 (fr) * | 2014-03-18 | 2018-01-31 | Centre National de la Recherche Scientifique (CNRS) | Dispositif et méthode de caractérisation polarimétrique déportée |
| CN111568378A (zh) * | 2020-05-13 | 2020-08-25 | 郑州光超医疗科技有限公司 | 一种用于妇科检查的光学相干层析成像设备 |
| US10791983B2 (en) * | 2017-03-24 | 2020-10-06 | The Florida International University Board Of Trustees | Optical imaging for preterm birth assessment |
| US20220370002A1 (en) * | 2019-07-16 | 2022-11-24 | Ecole Polytechnique | Method and apparatus for quantifying the progression of a pregnancy |
-
2023
- 2023-12-20 CN CN202380092175.7A patent/CN120603530A/zh active Pending
- 2023-12-20 EP EP23836838.5A patent/EP4637505A1/fr active Pending
- 2023-12-20 WO PCT/EP2023/087152 patent/WO2024133601A1/fr not_active Ceased
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1738682A1 (fr) | 2005-07-01 | 2007-01-03 | Ecole Polytechnique | Systeme d'imagerie polarimetrique electronique pour appareil de colposcopie |
| US8214024B2 (en) * | 2005-07-01 | 2012-07-03 | Ecole Polytechnique | Electronic polarimetric imaging system for a colposcopy device and an adapter housing |
| US20090076368A1 (en) * | 2007-04-11 | 2009-03-19 | Forth Photonics Ltd. | Integrated imaging workstation and a method for improving, objectifying and documenting in vivo examinations of the uterus |
| US20100268069A1 (en) * | 2009-04-16 | 2010-10-21 | Rongguang Liang | Dental surface imaging using polarized fringe projection |
| EP3120134B1 (fr) * | 2014-03-18 | 2018-01-31 | Centre National de la Recherche Scientifique (CNRS) | Dispositif et méthode de caractérisation polarimétrique déportée |
| US10791983B2 (en) * | 2017-03-24 | 2020-10-06 | The Florida International University Board Of Trustees | Optical imaging for preterm birth assessment |
| US20220370002A1 (en) * | 2019-07-16 | 2022-11-24 | Ecole Polytechnique | Method and apparatus for quantifying the progression of a pregnancy |
| CN111568378A (zh) * | 2020-05-13 | 2020-08-25 | 郑州光超医疗科技有限公司 | 一种用于妇科检查的光学相干层析成像设备 |
Non-Patent Citations (4)
| Title |
|---|
| BUCKLEY COLMAN ET AL: "Design of an endomicroscope including a resonant fiber-based microprobe dedicated to endoscopic polarimetric imaging for medical diagnosis", BIOMEDICAL OPTICS EXPRESS, vol. 11, no. 12, 10 November 2020 (2020-11-10), United States, pages 7032, XP055867661, ISSN: 2156-7085, Retrieved from the Internet <URL:https://www.osapublishing.org/DirectPDFAccess/9366C1E7-96F9-4F2C-900C4A9611FBDEE2_442530/boe-11-12-7032.pdf?da=1&id=442530&seq=0&mobile=no> DOI: 10.1364/BOE.403157 * |
| M. IRANIS.PELEG: "CVGIP Graphical models and image processing", 1991, ELSEVIER, article "Improving Resolution by Image Registration" |
| M.B.A HAGHIGHATA AGHAGOLZADETHH. SEYEDARABI: "A non-reference image fusion metric based on mutual information of image features", COMPUTERS & ELECTRICAL ENGINEERING, vol. 37, no. 5, September 2011 (2011-09-01), pages 744 - 756, XP028101125, DOI: 10.1016/j.compeleceng.2011.07.012 |
| S.-Y. LUR.A. CHIPMAN: "Interprétation of Mueller matrices based on polar décomposition", JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A, vol. 13, no. 5, May 1996 (1996-05-01), pages 1106, XP055152032, DOI: 10.1364/JOSAA.13.001106 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN120603530A (zh) | 2025-09-05 |
| EP4637505A1 (fr) | 2025-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11092795B2 (en) | Systems and methods for coded-aperture-based correction of aberration obtained from Fourier ptychography | |
| US12332117B2 (en) | Method and system for joint demosaicking and spectral signature estimation | |
| CA2894133C (fr) | Systemes d'imagerie chirurgicale | |
| CN106572792B (zh) | 用于多光谱成像的方法和部件 | |
| US9746662B2 (en) | Endoscope observation system | |
| US20160262626A1 (en) | Device for non-invasive detection of predetermined biological structures | |
| US20030040668A1 (en) | Endoscope apparatus | |
| US20130012794A1 (en) | Rapid multi-spectral imaging methods and apparatus and applications for cancer detection and localization | |
| US9095255B2 (en) | Method and device for locating function-supporting tissue areas in a tissue region | |
| FR2785170A1 (fr) | Procede et dispositif pour generer des donnees destinees au diagnostic du degre de lesion du tissu epidermique d'un patient | |
| EP1738682B1 (fr) | Système d'imagerie polarimétrique électronique pour appareil de colposcopie | |
| CN120615175A (zh) | 用于显微外科手术的可视化布置 | |
| JP2023519479A (ja) | 標的の偏光測定特徴付けの為のシステム | |
| WO2024133601A1 (fr) | Procédé d'imagerie en temps réel | |
| JP7584983B2 (ja) | 医用画像処理装置及びその制御方法、並びにプログラム | |
| FR3143740A1 (fr) | Imagerie multispectrale polarimétrique | |
| FR3143316A1 (fr) | Procédé d’imagerie en temps réel | |
| FR3143739A1 (fr) | Système d’observation à deux ports d’entrée équipé d’un système polarimétrique | |
| JPH06154228A (ja) | 光断層イメージング装置 | |
| CN110115557B (zh) | 一种高光谱内窥成像装置及成像方法 | |
| US20230324668A1 (en) | Operating microscope having at least two camera devices | |
| US20110213204A1 (en) | Endoscope system and imaging device thereof | |
| Roth et al. | Compact hybrid real-time hyperspectral imaging system with high effective spatial, spectral, and temporal resolution | |
| Zeng | White Light Endoscopy | |
| de ROODE et al. | MULTISPECTRAL DETECTORS: Multispectral system evaluates treatments in dermatology An advanced multispectral dermatascope can be used to study changes in the macroscopic structure of the skin. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23836838 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023836838 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202380092175.7 Country of ref document: CN |
|
| WWP | Wipo information: published in national office |
Ref document number: 202380092175.7 Country of ref document: CN |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023836838 Country of ref document: EP |