US20200132975A1 - Miniaturized microscope for phase contrast and multicolor fluorescence imaging - Google Patents
Miniaturized microscope for phase contrast and multicolor fluorescence imaging Download PDFInfo
- Publication number
- US20200132975A1 US20200132975A1 US16/171,707 US201816171707A US2020132975A1 US 20200132975 A1 US20200132975 A1 US 20200132975A1 US 201816171707 A US201816171707 A US 201816171707A US 2020132975 A1 US2020132975 A1 US 2020132975A1
- Authority
- US
- United States
- Prior art keywords
- microlens array
- wavelength
- microscope
- biological sample
- filter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0032—Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/44—Raman spectrometry; Scattering spectrometry ; Fluorescence spectrometry
- G01J3/4406—Fluorescence spectrometry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/0008—Microscopes having a simple construction, e.g. portable microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0036—Scanning details, e.g. scanning stages
- G02B21/0044—Scanning details, e.g. scanning stages moving apertures, e.g. Nipkow disks, rotating lens arrays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
- G02B21/08—Condensers
- G02B21/086—Condensers for transillumination only
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/18—Arrangements with more than one light path, e.g. for comparing two specimens
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
- G02B21/241—Devices for focusing
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/34—Microscope slides, e.g. mounting specimens on microscope slides
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/32—Fiducial marks and measuring scales within the optical system
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N2021/6417—Spectrofluorimetric devices
- G01N2021/6421—Measuring at two or more wavelengths
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N2021/6463—Optics
- G01N2021/6478—Special lenses
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/02—Mechanical
- G01N2201/022—Casings
- G01N2201/0221—Portable; cableless; compact; hand-held
Definitions
- the subject matter disclosed herein relates to a microscope, in particular, a miniaturized microscope that enables both phase contrast and multicolor fluorescence imaging.
- Microscopes are used for acquiring information regarding one or more properties or aspects of biological samples.
- Certain types of microscopes e.g., fluorescent microscopes
- CCD charge coupled device
- certain microscopes utilize bulky and expensive components (e.g., high precision actuators for autofocusing).
- the traditional fluorescent microscopes are bulky, slow, and costly. Due to these attributes, the utilization of these microscopes is limited to laboratory settings, which makes it difficult for them to be utilized in the field. Even further, these microscopes may be limited in their functionality (i.e., the types of imaging that may be utilized or having a limited field of view).
- a microscope in a first embodiment, includes an illumination source configured to provide illumination beams to image a portion of a biological sample.
- the microscope also includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of the portion of the biological sample utilizing parallel point scanning.
- the microscope further includes a detector configured to simultaneously acquire multiple point images at different locations of the portion of the biological sample.
- a microscope in accordance with another embodiment, includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning.
- the optical unit includes a first microlens array.
- the optical unit also includes an edge long-pass filter disposed on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength.
- the optical unit further includes a second microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength.
- the optical unit still further includes an absorption filter and an interference notch filter located downstream of the first and second microlens array and the microarray phase plate, wherein the absorption filter and the interference notch filter are configured to be transparent to the beam at the first wavelength and block excitation beams of different wavelengths while only allowing emitted fluorescent beams at the second and third wavelengths to pass.
- the optical unit even further includes a third microlens array and a fourth microlens array located downstream of the absorption filter and the interference notch filter, wherein the third microlens array and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths.
- the first, second, third, and fourth microlens arrays are focally aligned.
- the method also includes disposing an edge long-pass filter on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength.
- the method further includes optically aligning a second microlens array with the first microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength.
- the method yet further includes disposing an absorption filter and an interference notch filter downstream of the first and second microlens array, wherein the absorption filter and the interference notch filter are transparent to the beam at the first wavelength and filter the emitted fluorescent beams at the second and third wavelengths.
- the method still further includes optically aligning a third microlens array, a fourth microlens array, and a pinhole array disposed between the third and fourth microlens array with the first and second microlens arrays downstream of the absorption filter and the interference notch filter, wherein the third microlens array, the pinhole array, and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths.
- FIG. 1 is a block diagram of a microscopy imaging system, in accordance with aspects of the present disclosure
- FIG. 2 is schematic diagram of a microscope in a trans-illumination configuration, in accordance with aspects of the present disclosure
- FIG. 3 is a schematic diagram of a microscope in a total internal reflection-illumination configuration, in accordance with aspects of the present disclosure
- FIG. 4 is a schematic diagram of a microscope in an epi-illumination configuration, in accordance with aspects of the present disclosure
- FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing a microscope on a specimen, in accordance with aspects of the present disclosure.
- FIG. 6 is a schematic diagram illustrating alignment target focusing utilizing a microscope, in accordance with aspects of the present disclosure.
- the present disclosure relates to a miniaturized, multi-functional microscope.
- the microscope is designed for both phase contrast and multicolor fluorescence imaging.
- the microscope may be handheld or fit within the hand.
- the optical elements together have a total thickness of the less than 5 millimeters (mm).
- the microscope and its associated components e.g., power supply, piezo-driven scanner, etc.
- This hand held form factor of the microscope may enable it to be utilized in the field (e.g., for point-of-care applications).
- the microscope includes a plurality of microlens arrays that may be utilized in a parallel point scanning configuration that enables individual spots of a biological sample (e.g., cells or tissue) to be imaged simultaneously, which provides a short acquisition time (e.g., of a few minutes) and a scalable field of view (FOV).
- a biological sample e.g., cells or tissue
- FOV scalable field of view
- FIG. 1 is a block diagram of a microscopy imaging system 10 .
- the system 10 includes a microscope 12 (miniaturized, multi-functional microscope). As described in greater detail below, the microscope 12 may be utilized in a variety of configurations such as a trans-illumination configuration, a total internal reflection (TIR)-illumination configuration, and/or an epi-illumination configuration.
- the microscope 12 includes one or more illumination sources 14 .
- Non-limiting examples of the illumination sources 14 includes a laser source, a light emitting diode (LED), an incandescent lamp, an arc lamp, or combinations thereof.
- the illumination source 14 provides illumination beams at the biological sample (e.g., cells, tissues, etc.).
- the biological sample may be a solid sample, fluidic sample, sample with a regular surface, sample with irregular surface, sample with a regular volume, sample with an irregular volume, or a combination thereof.
- the biological sample may be disposed between a pair of slides and/or within a fluidic chamber.
- the illumination source 14 may provide single or multiple wavelength illumination beams.
- the microscope 12 may include other devices associated with the illumination source 14 such as a collimator (e.g., to collimate the light) and/or a homogenizer (e.g. to homogenize the light).
- the microscope 14 also includes an optical unit 16 for imaging the biological sample.
- the optical unit 16 is configured for both phase contrast and multicolor fluorescent imaging. Phase contrast imaging and multicolor fluorescent imaging may be performed simultaneously or sequentially. Besides various filters for the phase contrast and multicolor fluorescent imaging, the optical unit 16 , includes a plurality of microlens arrays disposed in a parallel point scanning configuration. This enables individual spots of the biological sample to be point scanned simultaneously.
- the microscope 14 also includes a detector array 18 to acquire point images for each of the individual spots of the biological sample.
- the detector array 18 e.g., imager chip
- the detector array 18 may include a charge-coupled sensor array, complementary metal-oxide semiconductor (CMOS) imager chip, avalanche photodiode array, or other detection device).
- CMOS complementary metal-oxide semiconductor
- the detector array 18 detects the light that has passed through the biological sample and/or the fluorescent signal emitted from the biological sample.
- the system 10 includes a micro-motion control assembly 20 (e.g., piezo-driven scanner) that moves the biological sample (i.e., the stage or any device supporting the biological sample) during imaging.
- the piezo-driven scanner may move the biological sample in the x-direction, y-direction, and/or the z-direction in response to voltage signals.
- the piezo-driven scanner steps the biological sample over a distance of two adjacent microlens elements during the acquisition of individual point images. For example, the biological sample is stepped a distance of a fraction of the pitch between two neighboring lens elements in the microlens array.
- the image resolution is directly correlated to the step size of the piezo stage that moves the biological sample (assuming the spots generated by the microlens array are not the limiting factor).
- the pitch between two neighboring lens elements may be 30 ⁇ m.
- step size of 1 ⁇ m in x- and y-direction could be used to generate a point-scanning image with about 1 ⁇ m resolution (assuming the illumination/imaging spots from each microlens are smaller than 1 ⁇ m in diameter).
- An entire image can be captured when stepping the distance between the pitch of two neighboring microlens elements in small steps in the x- and in the y-direction.
- stepping technique one can fill all the empty spots in a unit cell (e.g., by stepping in circles with decreasing diameters until the entire unit cell has been scanned).
- a microlens array scanning is done in parallel and all unit cells are scanned at the same time.
- the field of view for the microscope depends on the lateral extend (size) of the microlens array, the pitch between two neighboring microlens array elements is proportional to the number of steps required to fully scan an entire unite cell, and the step size of the piezo stage determines the image resolution.
- Complete images are acquired when stitching together each of the individual spots at each position (e.g., like a mosaic picture).
- a final image or images e.g., phase contrast images and/or multicolor fluorescence images
- the size of both the microlens array and the detector array 18 determine the FOV.
- the FOV may be scaled up by utilizing a larger microlens array and a larger detector array 18 without increasing the image acquisition time.
- the resolution of the images depends on the numerical aperture (NA) of the microlenses and the step size of the piezo-driven scanner.
- the image acquisition time depends on the pitch between each lens element.
- the current embodiments may have a resolution of approximately 2 micrometers ( ⁇ m), a FOV of 2.54 centimeters (cm) (1 inch) by 2.54 cm (1 inch), and an image acquisition time of a few minutes.
- the system 10 also includes a fluidic control unit 22 .
- the fluidic control unit 22 may regulate providing and/or removing different fluids that the biological sample is disposed within.
- the system 10 includes a computing device 24 (e.g., laptop computer).
- the computing device 24 includes a memory 26 and a processor 28 configured to execute instructions stored on the memory 22 .
- the memory 26 may store instructions for controlling components of the system 10 (e.g., microscope 12 , fluidic control unit 22 , micro-motion control assembly 20 , etc.).
- the computing device 24 may receive the different images acquired by the detector array 18 for the individual spots and assemble these individual images to generate images (e.g., phase contrast images and/or multicolor fluorescent images) of portions of the biological sample.
- the system 10 also includes a power supply 30 to provide power to one or more components of the system 10 (e.g., computing device 24 , microscope 12 , fluidic control unit 22 , and/or micro-motion control assembly 20 ).
- the processor 28 may include multiple processors, one or more “general-purpose” microprocessors, one or more special-purpose microprocessors, and/or one or more application specific integrated circuits (ASIC), or some combination thereof.
- the processor 28 may include one or more reduced instruction set (RISC) processor, advanced RISC machine (ARM) processor, performance optimization with enhanced RISC (PowerPC) processor, field-programmable gate array (FPGA) integrated circuit, graphics processing unit (GPU), or any other suitable processing device.
- RISC reduced instruction set
- ARM advanced RISC machine
- PowerPC field-programmable gate array
- GPU graphics processing unit
- the memory 26 may include a volatile memory, such as random access memory (RAM), nonvolatile memory, such as read-only memory (ROM), flash memory, or any combination thereof.
- RAM random access memory
- ROM read-only memory
- the memory 26 may store a variety of information that may be used for various purposes.
- the memory 26 may store processor-executable instructions (e.g., firmware or software) for the processor 28 to execute, such as instructions for different components of the system 10 .
- the storage device(s) e.g., nonvolatile storage
- FIG. 2 is schematic diagram of the microscope 12 in a trans-illumination configuration.
- the optical unit 16 includes an overall thickness 31 of less than 5 mm.
- the optical unit 16 includes a first microlens array 32 , a second microlens array 34 , a third microlens array 36 , and a fourth microlens array 38 .
- a more compact and simpler version of this trans-illumination configuration could be realized by eliminating elements 36 , 80 , and 38 at the cost of increased optical cross-talk.
- the microlens arrays 32 , 34 , 68 , 38 are focally aligned with each other. In the trans-illumination configuration a collimated and homogenized excitation beam 40 is directed onto the first microlens array 32 .
- excitation wavelengths may be utilized with the microscope 12 (e.g., emitted from the illumination source 14 ). As depicted, three different wavelengths are described. For example, a wavelength of 405 nanometers (nm) (indicated by solid arrows 42 ) is utilized for phase contrast imaging and wavelengths 550 nm (indicated by dashed arrows 44 ) and 650 nm (indicated by dotted arrows 46 ) are utilized for excitation in fluorescence imaging. These beams 42 , 44 , 46 are collimated and homogenized. A larger number of individual wavelengths could be utilized to image a larger number of fluorescent labels. For simplicity, we limit the description of this disclosed embodiments to three individual wavelengths.
- the microlens array 32 forms small spots that are used for the excitation of the biological sample.
- the focal plane or the (fractional) Talbot planes may be utilized to generate the desired spot pattern.
- a different microlens array has to be utilized to create excitation spots that match the pitch of the microlens array 32 on the light collection side.
- Talbot plane illumination may be useful when a larger working distance between the microlens array 32 and the biological sample is desired.
- the spot quality may degrade with increasing Talbot plane distance.
- the Talbot plane distance is strongly dependent on the wavelength of the excitation light. Thus, the z-height of the sample has to be adjusted when different illumination wavelengths are utilized.
- the focal plane is the preferred illumination plane when a smaller working distance can be tolerated.
- a working distance of approximately 100 ⁇ m is typical for microlens arrays with a NA of 0.15.
- an edge-long-pass filter 48 is disposed on a backside 50 (i.e., side that encounters illumination beams first) of the first microlens array 32 .
- the edge-long pass filter 48 may be disposed on a separate transparent substrate.
- the edge-long pass filter 48 is opaque at the wavelength (e.g., 405 nm) utilized for phase contrast imaging and transparent for the 550 and 650 wavelengths (e.g., wavelengths longer than the wavelength utilized for phase contrast imaging and longer than the cutoff wavelength of the edge-long pass filter 48 ) utilized for fluorescence imaging.
- the edge-long pass filter 48 serves as a condenser annulus 52 for the 405 nm excitation beam 42 .
- each lens element of the microlens array 32 is associated with a respective condenser annulus 52 .
- the condenser annulus 52 includes a central portion 54 that blocks the center portion of the 405 nm excitation beam 42 .
- the portion of the 405 nm excitation beam 42 that passes through an annulus portion 56 of the microlens element is focused onto a biological sample 58 (e.g., cells).
- the biological sample 58 is disposed between a pair of glass slides 60 .
- Chrome apertures 62 e.g., annular chrome apertures
- the second microlens array 34 is disposed beneath biological sample 58 .
- a portion 66 of the 405 nm excitation beam 42 is diffracted and phase altered by the sample 58 and a portion 68 of the beam 42 remains undiffracted and passes through the sample 58 .
- Chrome apertures 70 e.g., annular chrome apertures
- the chrome apertures 62 , 70 reduce bleed-through or cross-talk between adjacent channels (i.e., microlens elements) during fluorescence imaging.
- the second microlens array 34 collimates the diffracted and phase altered transmitted beam 66 .
- a microarray phase plate 74 is disposed beneath (i.e., downstream of) the second microlens array 34 .
- the phase plate 74 retards the phase altered transmitted beam 66 by 90 degrees, while enabling the undiffracted light 68 to transmit without retardation.
- An absorption filter 76 and an interference notch filter 78 are disposed beneath the phase plate 74 .
- the absorption filter 76 is disposed between the phase plate 74 and the interference notch filter 78 .
- Both the absorption filter 76 and the interference notch filter 78 are transparent to wavelengths below 550 nm. Thus, the filters 76 , 78 are transparent to the beams portions 66 , 68 .
- the optical unit 16 may include more than one notch filter, where each notch filter is specific for a different wavelength. In certain embodiments, the optical unit 16 may utilize a single notch filter that may include portions specific for a first wavelength and portions specific for a second wavelength different from the first wavelength (e.g., in a checkerboard pattern).
- the third microlens array 36 and the fourth microlens array 38 are disposed beneath the filters 76 , 78 with the microlens array 36 being adjacent the interference notch filter 78 .
- a pinhole array 80 is disposed in the focal plane between the third and fourth microlens arrays 36 , 38 .
- the microscope 12 may not include the third and fourth microlens arrays 36 , 38 and the pinhole array 80 if a more compact and simpler assembly is desired.
- the beam portions 66 , 68 are spatially filtered by the microlens arrays 36 , 38 and the pinhole array 80 .
- the pinhole array 80 blocks any stray light (e.g., to reduce cross-talk between adjacent lenslets).
- phase contrast image For each illuminated spot of the biological sample 58 .
- phase contrast point images are detected by the detector array 18 .
- the individually acquired point images are then combined by the computing device 24 to form a complete image (e.g., phase contrast image) after scanning the biological sample step-by-step (via the piezo-driven scanner 20 ) to fill in the blank spots in a unit cell the size of the pitch between microlens array elements in the x- and y-direction to acquire the complete phase contrast image of the biological sample 58 .
- excitation beams 44 , 46 of 550 nm and 650 nm (which may be utilized to excite Cy3 or Cy5 dyes, respectively) are utilized as examples. Different wavelengths for fluorescent imaging may be utilized. In addition, a different number of wavelengths (e.g., more than two) may be utilized for fluorescent imaging. As depicted, the beams 44 , 46 pass through the edge long-pass filter 48 described above. The first microlens array 32 focuses the excitations beams 44 , 46 on the biological sample 58 to form illumination spots. As mentioned above, either the focal plane or fractional Talbot planes may be used for spot illumination of the biological sample 58 .
- the chrome apertures 62 , 70 reduce bleed-through and/or cross talk, thus, increasing the signal-to noise ratio (SNR) of the point images.
- Fluorescent light 82 , 84 (for the 550 nm and 650 nm wavelengths, respectively) is emitted from the excited fluorophores.
- the second microlens array 34 collects the emitted fluorescent light 82 , 84 , which then passes through both the absorption filter 76 and the interference notch filter 78 .
- the absorption filter 76 removes any stray light caused by scattering of the excitation beams 44 , 46 .
- the absorption filter 76 filters out stray light that impinges on the filter 76 at oblique incidence.
- the excitation beams 44 , 46 that impinge at normal incidence at the biological sample 58 are filtered out by the interference notch filter 78 with high optical density (OD).
- the absorption filter 76 and the interference notch filter 78 may include OD values of +3 and +6, respectively.
- the emitted and filtered fluorescent light 82 , 84 is then spatially filtered by the microlens arrays 36 , 38 and the pinhole array 36 described above.
- the fluorescent signals are then detected by the detector array 18 and combined to form a complete fluorescent image upon scanning of the entire biological sample 58 .
- fine adjustment in the z-direction may be utilized to keep the sample 58 in focus.
- the focal depth of the microlens arrays 32 , 34 , 36 , 38 tends to be fairly large (e.g., due to the low NA of the lenslets), thus, z-adjustment during scanning may be less critical.
- FIG. 3 is schematic diagram of the microscope 12 in a total internal reflection (TIR)-illumination configuration.
- the microscope 12 is as described in FIG. 2 .
- the only difference is that the fluorescence excitation beams 44 , 46 (550 nm and 650 nm, respectively) are coupled to a waveguide structure 86 .
- the waveguide structure 86 is formed between the two glass slides 60 and surrounds a high refractive index fluid.
- the inner surfaces of the glass slides 60 may be coated with a low refractive index film to increase the acceptance angle of the waveguide structure 86 .
- a prism 88 e.g., transparent prism
- the TIR captured excitation light 90 (shown for only the 550 nm wavelength) travels down the fluidic channel 92 (formed by the waveguide structured 86 ) to illuminate the biological sample 58 .
- the TIR-illumination configuration improves the SNR compared to the trans-illumination configuration.
- the majority of the excitation light remains inside the waveguide structure 86 and is not detected by the detector array 18 . This enables a reduction in the filter requirements and may simplify the detection side of the microscope architecture.
- the excitation scheme in the TIR-illumination configuration is more complicated.
- the flood exposure of the entire sample 58 in the TIR-illumination configuration may increase bleaching effects of the fluorescent dyes.
- dye bleaching is minimized since the only spots of the biological sample 58 that are illuminated are those that currently being imaged.
- FIG. 4 is schematic diagram of the microscope 12 in an epi-illumination configuration.
- the microscope 12 is as described in FIG. 2 .
- the only difference is a dichroic mirror 94 is disposed between the second microlens array 34 and the phase plate 74 .
- the dichroic mirror 94 is high reflective for the excitation beams 44 , 46 .
- the dichroic mirror 94 reflects the excitation beam (only excitation beam 44 is shown for simplicity) toward the biological sample 58 , while the dichroic mirror is transparent to the light emitted by the biological sample 58 .
- the epi-illumination configuration combines the advantages of both the trans-illumination and the TIR-illumination configurations.
- the biological sample 58 is spot-illuminated to avoid excess bleaching of the fluorescent dyes, while improving the SNR by taking the detector array 18 out the direct path of illumination.
- the epi-illumination configuration results in a more complicated and more spacious optical design.
- FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing the microscope 12 on a specimen.
- FIG. 5 depicts a microfluidic flow cell 96 (e.g., cells of the biological sample or specimen) having a sample area 98 to be imaged.
- the specimen needs to be brought into focus for the two microlens arrays utilized for illumination and detection.
- fluorescence and phase contrast labels or targets 100 are placed on each corner of the sample.
- the piezo-driven scanner then steps the sample in the z-direction until a maximum intensity in fluorescent signal or a maximum contrast in phase contrast image is detected.
- FIG. 6 depicts the utilization of the target 100 when utilizing the microscope in the trans-illumination configuration.
- the alignment target 100 may include a tissue stained with a fluorescent target 102 (e.g., a dye such as Cy5) to maximize the intensity of the fluorescence signal.
- a micro patterned phase retarder (or waveplate) 104 and missing retarder (or waveplate) 106 may be utilized to generate a high contrast phase image that maximizes contrast.
- the microscope may fit within the hand.
- the microscope may perform both phase contrast and multicolor fluorescence imaging in conjunction with point scanning.
- the microscope may include multiple microlens arrays in parallel point scanning configuration. Multiple individual spots may be imaged simultaneously.
- the microscope may have a large (and scalable) FOV and fast image acquisition time. Due to the size and portability of the microscope, it can be utilized in point-of-care diagnostics (e.g., at home, on the battle field, by first responders, etc.).
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- Health & Medical Sciences (AREA)
- Immunology (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Microscoopes, Condenser (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Abstract
Description
- The subject matter disclosed herein relates to a microscope, in particular, a miniaturized microscope that enables both phase contrast and multicolor fluorescence imaging.
- Microscopes are used for acquiring information regarding one or more properties or aspects of biological samples. Certain types of microscopes (e.g., fluorescent microscopes) require sophisticated and expensive optical lenses, one or more motion control stages, and a charge coupled device (CCD) camera. Further, certain microscopes utilize bulky and expensive components (e.g., high precision actuators for autofocusing). As a result, the traditional fluorescent microscopes are bulky, slow, and costly. Due to these attributes, the utilization of these microscopes is limited to laboratory settings, which makes it difficult for them to be utilized in the field. Even further, these microscopes may be limited in their functionality (i.e., the types of imaging that may be utilized or having a limited field of view).
- A summary of certain embodiments disclosed herein is set forth below. It should be understood that these aspects are presented merely to provide the reader with a brief summary of these certain embodiments and that these aspects are not intended to limit the scope of this disclosure. Indeed, this disclosure may encompass a variety of aspects that may not be set forth below.
- In a first embodiment, a microscope is provided. The microscope includes an illumination source configured to provide illumination beams to image a portion of a biological sample. The microscope also includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of the portion of the biological sample utilizing parallel point scanning. The microscope further includes a detector configured to simultaneously acquire multiple point images at different locations of the portion of the biological sample.
- In accordance with another embodiment, a microscope is provided. The microscope includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning. The optical unit includes a first microlens array. The optical unit also includes an edge long-pass filter disposed on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength. The optical unit further includes a second microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength. The optical unit still further includes an absorption filter and an interference notch filter located downstream of the first and second microlens array and the microarray phase plate, wherein the absorption filter and the interference notch filter are configured to be transparent to the beam at the first wavelength and block excitation beams of different wavelengths while only allowing emitted fluorescent beams at the second and third wavelengths to pass. The optical unit even further includes a third microlens array and a fourth microlens array located downstream of the absorption filter and the interference notch filter, wherein the third microlens array and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths. The first, second, third, and fourth microlens arrays are focally aligned.
- In accordance with a third embodiment, a method of manufacturing an optical unit for a microscope configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning is provided. The method includes providing a first microlens array. The method also includes disposing an edge long-pass filter on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength. The method further includes optically aligning a second microlens array with the first microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength. The method yet further includes disposing an absorption filter and an interference notch filter downstream of the first and second microlens array, wherein the absorption filter and the interference notch filter are transparent to the beam at the first wavelength and filter the emitted fluorescent beams at the second and third wavelengths. The method still further includes optically aligning a third microlens array, a fourth microlens array, and a pinhole array disposed between the third and fourth microlens array with the first and second microlens arrays downstream of the absorption filter and the interference notch filter, wherein the third microlens array, the pinhole array, and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths.
- These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
-
FIG. 1 is a block diagram of a microscopy imaging system, in accordance with aspects of the present disclosure; -
FIG. 2 is schematic diagram of a microscope in a trans-illumination configuration, in accordance with aspects of the present disclosure; -
FIG. 3 is a schematic diagram of a microscope in a total internal reflection-illumination configuration, in accordance with aspects of the present disclosure; -
FIG. 4 is a schematic diagram of a microscope in an epi-illumination configuration, in accordance with aspects of the present disclosure; -
FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing a microscope on a specimen, in accordance with aspects of the present disclosure; and -
FIG. 6 is a schematic diagram illustrating alignment target focusing utilizing a microscope, in accordance with aspects of the present disclosure. - One or more specific embodiments will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
- The present disclosure relates to a miniaturized, multi-functional microscope. The microscope is designed for both phase contrast and multicolor fluorescence imaging. The microscope may be handheld or fit within the hand. The optical elements together have a total thickness of the less than 5 millimeters (mm). The microscope and its associated components (e.g., power supply, piezo-driven scanner, etc.) are portable (e.g., within a handheld case). This hand held form factor of the microscope may enable it to be utilized in the field (e.g., for point-of-care applications). The microscope includes a plurality of microlens arrays that may be utilized in a parallel point scanning configuration that enables individual spots of a biological sample (e.g., cells or tissue) to be imaged simultaneously, which provides a short acquisition time (e.g., of a few minutes) and a scalable field of view (FOV).
- Turning to the figures,
FIG. 1 is a block diagram of amicroscopy imaging system 10. Thesystem 10 includes a microscope 12 (miniaturized, multi-functional microscope). As described in greater detail below, themicroscope 12 may be utilized in a variety of configurations such as a trans-illumination configuration, a total internal reflection (TIR)-illumination configuration, and/or an epi-illumination configuration. Themicroscope 12 includes one or more illumination sources 14. Non-limiting examples of theillumination sources 14 includes a laser source, a light emitting diode (LED), an incandescent lamp, an arc lamp, or combinations thereof. Theillumination source 14 provides illumination beams at the biological sample (e.g., cells, tissues, etc.). The biological sample may be a solid sample, fluidic sample, sample with a regular surface, sample with irregular surface, sample with a regular volume, sample with an irregular volume, or a combination thereof. The biological sample may be disposed between a pair of slides and/or within a fluidic chamber. Theillumination source 14 may provide single or multiple wavelength illumination beams. Themicroscope 12 may include other devices associated with theillumination source 14 such as a collimator (e.g., to collimate the light) and/or a homogenizer (e.g. to homogenize the light). - The
microscope 14 also includes anoptical unit 16 for imaging the biological sample. As described in greater detail below, theoptical unit 16 is configured for both phase contrast and multicolor fluorescent imaging. Phase contrast imaging and multicolor fluorescent imaging may be performed simultaneously or sequentially. Besides various filters for the phase contrast and multicolor fluorescent imaging, theoptical unit 16, includes a plurality of microlens arrays disposed in a parallel point scanning configuration. This enables individual spots of the biological sample to be point scanned simultaneously. - The
microscope 14 also includes adetector array 18 to acquire point images for each of the individual spots of the biological sample. The detector array 18 (e.g., imager chip) may include a charge-coupled sensor array, complementary metal-oxide semiconductor (CMOS) imager chip, avalanche photodiode array, or other detection device). Thedetector array 18 detects the light that has passed through the biological sample and/or the fluorescent signal emitted from the biological sample. - The
system 10 includes a micro-motion control assembly 20 (e.g., piezo-driven scanner) that moves the biological sample (i.e., the stage or any device supporting the biological sample) during imaging. In particular, the piezo-driven scanner may move the biological sample in the x-direction, y-direction, and/or the z-direction in response to voltage signals. Specifically, the piezo-driven scanner steps the biological sample over a distance of two adjacent microlens elements during the acquisition of individual point images. For example, the biological sample is stepped a distance of a fraction of the pitch between two neighboring lens elements in the microlens array. The image resolution is directly correlated to the step size of the piezo stage that moves the biological sample (assuming the spots generated by the microlens array are not the limiting factor). For example, the pitch between two neighboring lens elements may be 30 μm. As step size of 1 μm in x- and y-direction could be used to generate a point-scanning image with about 1 μm resolution (assuming the illumination/imaging spots from each microlens are smaller than 1 μm in diameter). An entire image can be captured when stepping the distance between the pitch of two neighboring microlens elements in small steps in the x- and in the y-direction. Using this stepping technique, one can fill all the empty spots in a unit cell (e.g., by stepping in circles with decreasing diameters until the entire unit cell has been scanned). By using a microlens array, scanning is done in parallel and all unit cells are scanned at the same time. The field of view for the microscope (or the scanning area) depends on the lateral extend (size) of the microlens array, the pitch between two neighboring microlens array elements is proportional to the number of steps required to fully scan an entire unite cell, and the step size of the piezo stage determines the image resolution. The number of scanning steps are directly proportional to the total imaging time (e.g., total imaging time=number of scanning steps*dwell time per point scan). Complete images are acquired when stitching together each of the individual spots at each position (e.g., like a mosaic picture). A final image or images (e.g., phase contrast images and/or multicolor fluorescence images) may be generated based on the assembly of the individual point images. - The size of both the microlens array and the
detector array 18 determine the FOV. For example, the FOV may be scaled up by utilizing a larger microlens array and alarger detector array 18 without increasing the image acquisition time. The resolution of the images depends on the numerical aperture (NA) of the microlenses and the step size of the piezo-driven scanner. The image acquisition time depends on the pitch between each lens element. In certain embodiments, the current embodiments may have a resolution of approximately 2 micrometers (μm), a FOV of 2.54 centimeters (cm) (1 inch) by 2.54 cm (1 inch), and an image acquisition time of a few minutes. - In certain embodiments, the
system 10 also includes afluidic control unit 22. Depending on the biological sample, thefluidic control unit 22 may regulate providing and/or removing different fluids that the biological sample is disposed within. Thesystem 10 includes a computing device 24 (e.g., laptop computer). Thecomputing device 24 includes amemory 26 and aprocessor 28 configured to execute instructions stored on thememory 22. In certain embodiments, thememory 26 may store instructions for controlling components of the system 10 (e.g.,microscope 12,fluidic control unit 22,micro-motion control assembly 20, etc.). Thecomputing device 24 may receive the different images acquired by thedetector array 18 for the individual spots and assemble these individual images to generate images (e.g., phase contrast images and/or multicolor fluorescent images) of portions of the biological sample. Thesystem 10 also includes apower supply 30 to provide power to one or more components of the system 10 (e.g.,computing device 24,microscope 12,fluidic control unit 22, and/or micro-motion control assembly 20). - The
processor 28 may include multiple processors, one or more “general-purpose” microprocessors, one or more special-purpose microprocessors, and/or one or more application specific integrated circuits (ASIC), or some combination thereof. For example, theprocessor 28 may include one or more reduced instruction set (RISC) processor, advanced RISC machine (ARM) processor, performance optimization with enhanced RISC (PowerPC) processor, field-programmable gate array (FPGA) integrated circuit, graphics processing unit (GPU), or any other suitable processing device. - The
memory 26 may include a volatile memory, such as random access memory (RAM), nonvolatile memory, such as read-only memory (ROM), flash memory, or any combination thereof. Thememory 26 may store a variety of information that may be used for various purposes. For example, thememory 26 may store processor-executable instructions (e.g., firmware or software) for theprocessor 28 to execute, such as instructions for different components of thesystem 10. The storage device(s) (e.g., nonvolatile storage) may include ROM, flash memory, a hard drive, or any other suitable optical, magnetic, or solid-state storage medium, or a combination thereof. -
FIG. 2 is schematic diagram of themicroscope 12 in a trans-illumination configuration. Theoptical unit 16 includes anoverall thickness 31 of less than 5 mm. Theoptical unit 16 includes afirst microlens array 32, asecond microlens array 34, athird microlens array 36, and afourth microlens array 38. A more compact and simpler version of this trans-illumination configuration could be realized by eliminating 36, 80, and 38 at the cost of increased optical cross-talk. Theelements 32, 34, 68, 38 are focally aligned with each other. In the trans-illumination configuration a collimated andmicrolens arrays homogenized excitation beam 40 is directed onto thefirst microlens array 32. Multiple excitation wavelengths may be utilized with the microscope 12 (e.g., emitted from the illumination source 14). As depicted, three different wavelengths are described. For example, a wavelength of 405 nanometers (nm) (indicated by solid arrows 42) is utilized for phase contrast imaging and wavelengths 550 nm (indicated by dashed arrows 44) and 650 nm (indicated by dotted arrows 46) are utilized for excitation in fluorescence imaging. These 42, 44, 46 are collimated and homogenized. A larger number of individual wavelengths could be utilized to image a larger number of fluorescent labels. For simplicity, we limit the description of this disclosed embodiments to three individual wavelengths.beams - The
microlens array 32 forms small spots that are used for the excitation of the biological sample. The focal plane or the (fractional) Talbot planes may be utilized to generate the desired spot pattern. In embodiments, utilizing the fractional Talbot planes, a different microlens array has to be utilized to create excitation spots that match the pitch of themicrolens array 32 on the light collection side. Talbot plane illumination may be useful when a larger working distance between themicrolens array 32 and the biological sample is desired. However, the spot quality may degrade with increasing Talbot plane distance. The Talbot plane distance is strongly dependent on the wavelength of the excitation light. Thus, the z-height of the sample has to be adjusted when different illumination wavelengths are utilized. This is not the case when utilizing the focal plane of themicrolens array 32. In this case, the focal distance stays relatively constant for different excitation wavelengths, eliminating the need for extensive adjustments in z-height. In addition, the generated spot pattern will be sharper compared to the spots generated in fractional Talbot planes. Thus, the focal plane is the preferred illumination plane when a smaller working distance can be tolerated. A working distance of approximately 100 μm is typical for microlens arrays with a NA of 0.15. - With regards to phase contrast imaging, an edge-long-
pass filter 48 is disposed on a backside 50 (i.e., side that encounters illumination beams first) of thefirst microlens array 32. In certain embodiments, the edge-long pass filter 48 may be disposed on a separate transparent substrate. The edge-long pass filter 48 is opaque at the wavelength (e.g., 405 nm) utilized for phase contrast imaging and transparent for the 550 and 650 wavelengths (e.g., wavelengths longer than the wavelength utilized for phase contrast imaging and longer than the cutoff wavelength of the edge-long pass filter 48) utilized for fluorescence imaging. The edge-long pass filter 48 serves as acondenser annulus 52 for the 405nm excitation beam 42. In particular, each lens element of themicrolens array 32 is associated with arespective condenser annulus 52. Thecondenser annulus 52 includes acentral portion 54 that blocks the center portion of the 405nm excitation beam 42. The portion of the 405nm excitation beam 42 that passes through anannulus portion 56 of the microlens element is focused onto a biological sample 58 (e.g., cells). As depicted, thebiological sample 58 is disposed between a pair of glass slides 60. Chrome apertures 62 (e.g., annular chrome apertures) are disposed on a front side 64 (i.e., side opposite the edge long-pass filter 48) to minimize unwanted bleed through of light from the excitation source. - The
second microlens array 34 is disposed beneathbiological sample 58. Aportion 66 of the 405nm excitation beam 42 is diffracted and phase altered by thesample 58 and aportion 68 of thebeam 42 remains undiffracted and passes through thesample 58. Chrome apertures 70 (e.g., annular chrome apertures) are disposed on aside 72 of themicrolens array 34 facing thebiological sample 58. The chrome apertures 62, 70 reduce bleed-through or cross-talk between adjacent channels (i.e., microlens elements) during fluorescence imaging. Thesecond microlens array 34 collimates the diffracted and phase altered transmittedbeam 66. Amicroarray phase plate 74 is disposed beneath (i.e., downstream of) thesecond microlens array 34. Thephase plate 74 retards the phase altered transmittedbeam 66 by 90 degrees, while enabling the undiffracted light 68 to transmit without retardation. Anabsorption filter 76 and aninterference notch filter 78 are disposed beneath thephase plate 74. Theabsorption filter 76 is disposed between thephase plate 74 and theinterference notch filter 78. Both theabsorption filter 76 and theinterference notch filter 78 are transparent to wavelengths below 550 nm. Thus, the 76, 78 are transparent to thefilters 66, 68. In certain embodiments, thebeams portions optical unit 16 may include more than one notch filter, where each notch filter is specific for a different wavelength. In certain embodiments, theoptical unit 16 may utilize a single notch filter that may include portions specific for a first wavelength and portions specific for a second wavelength different from the first wavelength (e.g., in a checkerboard pattern). - The
third microlens array 36 and thefourth microlens array 38 are disposed beneath the 76, 78 with thefilters microlens array 36 being adjacent theinterference notch filter 78. Apinhole array 80 is disposed in the focal plane between the third and 36, 38. In certain embodiments, thefourth microlens arrays microscope 12 may not include the third and 36, 38 and thefourth microlens arrays pinhole array 80 if a more compact and simpler assembly is desired. The 66, 68 are spatially filtered by thebeam portions 36, 38 and themicrolens arrays pinhole array 80. Thepinhole array 80 blocks any stray light (e.g., to reduce cross-talk between adjacent lenslets). The beam portions constructively and destructively interfere to form a phase contrast image for each illuminated spot of thebiological sample 58. These phase contrast point images are detected by thedetector array 18. The individually acquired point images are then combined by thecomputing device 24 to form a complete image (e.g., phase contrast image) after scanning the biological sample step-by-step (via the piezo-driven scanner 20) to fill in the blank spots in a unit cell the size of the pitch between microlens array elements in the x- and y-direction to acquire the complete phase contrast image of thebiological sample 58. - With regard to multicolor fluorescent imaging, as mentioned above, excitation beams 44, 46 of 550 nm and 650 nm (which may be utilized to excite Cy3 or Cy5 dyes, respectively) are utilized as examples. Different wavelengths for fluorescent imaging may be utilized. In addition, a different number of wavelengths (e.g., more than two) may be utilized for fluorescent imaging. As depicted, the
44, 46 pass through the edge long-beams pass filter 48 described above. Thefirst microlens array 32 focuses the excitations beams 44, 46 on thebiological sample 58 to form illumination spots. As mentioned above, either the focal plane or fractional Talbot planes may be used for spot illumination of thebiological sample 58. As mentioned above, the 62, 70 reduce bleed-through and/or cross talk, thus, increasing the signal-to noise ratio (SNR) of the point images.chrome apertures Fluorescent light 82, 84 (for the 550 nm and 650 nm wavelengths, respectively) is emitted from the excited fluorophores. Thesecond microlens array 34 collects the emitted 82, 84, which then passes through both thefluorescent light absorption filter 76 and theinterference notch filter 78. Theabsorption filter 76 removes any stray light caused by scattering of the excitation beams 44, 46. In particular, theabsorption filter 76 filters out stray light that impinges on thefilter 76 at oblique incidence. The excitation beams 44, 46 that impinge at normal incidence at thebiological sample 58 are filtered out by theinterference notch filter 78 with high optical density (OD). In certain embodiments, theabsorption filter 76 and theinterference notch filter 78 may include OD values of +3 and +6, respectively. The emitted and filtered 82, 84 is then spatially filtered by thefluorescent light 36, 38 and themicrolens arrays pinhole array 36 described above. The fluorescent signals are then detected by thedetector array 18 and combined to form a complete fluorescent image upon scanning of the entirebiological sample 58. During the scanning process, fine adjustment in the z-direction may be utilized to keep thesample 58 in focus. However, the focal depth of the 32, 34, 36, 38 tends to be fairly large (e.g., due to the low NA of the lenslets), thus, z-adjustment during scanning may be less critical.microlens arrays -
FIG. 3 is schematic diagram of themicroscope 12 in a total internal reflection (TIR)-illumination configuration. In general, themicroscope 12 is as described inFIG. 2 . The only difference is that the fluorescence excitation beams 44, 46 (550 nm and 650 nm, respectively) are coupled to awaveguide structure 86. Thewaveguide structure 86 is formed between the two glass slides 60 and surrounds a high refractive index fluid. The inner surfaces of the glass slides 60 may be coated with a low refractive index film to increase the acceptance angle of thewaveguide structure 86. A prism 88 (e.g., transparent prism) is utilized to couple the excitation beams 44, 46 to thewaveguide structure 86. Thus, unlike the configuration inFIG. 2 , the 44, 46 do not pass through thebeams microlens array 32. The TIR captured excitation light 90 (shown for only the 550 nm wavelength) travels down the fluidic channel 92 (formed by the waveguide structured 86) to illuminate thebiological sample 58. The TIR-illumination configuration improves the SNR compared to the trans-illumination configuration. The majority of the excitation light remains inside thewaveguide structure 86 and is not detected by thedetector array 18. This enables a reduction in the filter requirements and may simplify the detection side of the microscope architecture. However, the excitation scheme in the TIR-illumination configuration is more complicated. In addition, the flood exposure of theentire sample 58 in the TIR-illumination configuration may increase bleaching effects of the fluorescent dyes. In the trans-illumination configuration, dye bleaching is minimized since the only spots of thebiological sample 58 that are illuminated are those that currently being imaged. -
FIG. 4 is schematic diagram of themicroscope 12 in an epi-illumination configuration. In general, themicroscope 12 is as described inFIG. 2 . The only difference is adichroic mirror 94 is disposed between thesecond microlens array 34 and thephase plate 74. Thedichroic mirror 94 is high reflective for the excitation beams 44, 46. In particular, thedichroic mirror 94 reflects the excitation beam (onlyexcitation beam 44 is shown for simplicity) toward thebiological sample 58, while the dichroic mirror is transparent to the light emitted by thebiological sample 58. The epi-illumination configuration combines the advantages of both the trans-illumination and the TIR-illumination configurations. Thebiological sample 58 is spot-illuminated to avoid excess bleaching of the fluorescent dyes, while improving the SNR by taking thedetector array 18 out the direct path of illumination. However, the epi-illumination configuration results in a more complicated and more spacious optical design. -
FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing themicroscope 12 on a specimen.FIG. 5 depicts a microfluidic flow cell 96 (e.g., cells of the biological sample or specimen) having asample area 98 to be imaged. The specimen needs to be brought into focus for the two microlens arrays utilized for illumination and detection. In certain embodiments to achieve focusing of the specimen, fluorescence and phase contrast labels or targets 100 (e.g., alignment targets) are placed on each corner of the sample. The piezo-driven scanner then steps the sample in the z-direction until a maximum intensity in fluorescent signal or a maximum contrast in phase contrast image is detected. This position in the z-direction then correlates with the optimum focal point for the miniaturized microscope system.FIG. 6 depicts the utilization of thetarget 100 when utilizing the microscope in the trans-illumination configuration. As depicted, thealignment target 100 may include a tissue stained with a fluorescent target 102 (e.g., a dye such as Cy5) to maximize the intensity of the fluorescence signal. A micro patterned phase retarder (or waveplate) 104 and missing retarder (or waveplate) 106 may be utilized to generate a high contrast phase image that maximizes contrast. - Technical effects of the disclosed embodiments include providing a portable, miniaturized microscope that performs multiple imaging functions. The microscope may fit within the hand. The microscope may perform both phase contrast and multicolor fluorescence imaging in conjunction with point scanning. Indeed, the microscope may include multiple microlens arrays in parallel point scanning configuration. Multiple individual spots may be imaged simultaneously. Thus, the microscope may have a large (and scalable) FOV and fast image acquisition time. Due to the size and portability of the microscope, it can be utilized in point-of-care diagnostics (e.g., at home, on the battle field, by first responders, etc.).
- This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.
Claims (20)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/171,707 US10634890B1 (en) | 2018-10-26 | 2018-10-26 | Miniaturized microscope for phase contrast and multicolor fluorescence imaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/171,707 US10634890B1 (en) | 2018-10-26 | 2018-10-26 | Miniaturized microscope for phase contrast and multicolor fluorescence imaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US10634890B1 US10634890B1 (en) | 2020-04-28 |
| US20200132975A1 true US20200132975A1 (en) | 2020-04-30 |
Family
ID=70327027
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US16/171,707 Active 2038-11-06 US10634890B1 (en) | 2018-10-26 | 2018-10-26 | Miniaturized microscope for phase contrast and multicolor fluorescence imaging |
Country Status (1)
| Country | Link |
|---|---|
| US (1) | US10634890B1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024090068A1 (en) * | 2022-10-26 | 2024-05-02 | ソニーセミコンダクタソリューションズ株式会社 | Fluorescence detection device and plate for fluorescence detection device |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3581919B1 (en) * | 2018-06-15 | 2022-03-23 | IMEC vzw | An imaging apparatus and a method for imaging an object |
| JP7066914B2 (en) * | 2019-03-12 | 2022-05-13 | 株式会社日立ハイテク | Defect detection device, defect detection method, and defect observation device equipped with this |
| EP4055517A1 (en) * | 2019-11-08 | 2022-09-14 | Leica Instruments (Singapore) Pte Ltd | System, microscope system, methods and computer programs for training or using a machine-learning model |
| CN113367717B (en) * | 2021-05-26 | 2022-11-22 | 中国科学院深圳先进技术研究院 | Cone beam X-ray fluorescence imaging method, system, terminal and storage medium |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6133986A (en) | 1996-02-28 | 2000-10-17 | Johnson; Kenneth C. | Microlens scanner for microlithography and wide-field confocal microscopy |
| WO2002075370A2 (en) | 2001-03-19 | 2002-09-26 | Weinstein Ronald S | Miniaturized microscope array digital slide scanner |
| US7864369B2 (en) | 2001-03-19 | 2011-01-04 | Dmetrix, Inc. | Large-area imaging by concatenation with array microscope |
| US20040023415A1 (en) | 2002-03-05 | 2004-02-05 | Konstantin Sokolov | Biospecific contrast agents |
| US6934079B2 (en) | 2002-05-03 | 2005-08-23 | Max-Planck-Gesellschaft zur Förderung der Wissen-schaften e. V. | Confocal microscope comprising two microlens arrays and a pinhole diaphragm array |
| JPWO2004036284A1 (en) | 2002-09-30 | 2006-02-16 | 独立行政法人科学技術振興機構 | Confocal microscope, fluorescence measuring method and polarization measuring method using confocal microscope |
| DE102004034970A1 (en) * | 2004-07-16 | 2006-02-02 | Carl Zeiss Jena Gmbh | Scanning microscope and use |
| WO2008048612A2 (en) | 2006-10-17 | 2008-04-24 | Hnuphotonics | Miniature microscope camera |
| EP2389606B1 (en) * | 2009-01-24 | 2019-08-28 | Ecole Polytechnique Federale De Lausanne (EPFL) EPFL-TTO | High-resolution microscopy and photolithography devices using focusing micromirrors |
| WO2011053828A2 (en) | 2009-10-30 | 2011-05-05 | The Regents Of The University Of Michigan | Targeted dual-axes confocal imaging apparatus with vertical scanning capabilities |
| US8435738B2 (en) * | 2011-09-25 | 2013-05-07 | Theranos, Inc. | Systems and methods for multi-analysis |
| US20160069919A1 (en) * | 2011-09-25 | 2016-03-10 | Theranos, Inc. | Systems and methods for multi-analysis |
| US20130162800A1 (en) * | 2011-12-22 | 2013-06-27 | General Electric Company | Quantitative phase microscopy for label-free high-contrast cell imaging using frequency domain phase shift |
| US20150087902A1 (en) | 2012-03-30 | 2015-03-26 | Trustees Of Boston University | Phase Contrast Microscopy With Oblique Back-Illumination |
| DE102016218452A1 (en) * | 2016-09-26 | 2018-03-29 | Carl Zeiss Smt Gmbh | Method for determining a distance of a first structural element on a substrate from a second structural element |
-
2018
- 2018-10-26 US US16/171,707 patent/US10634890B1/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024090068A1 (en) * | 2022-10-26 | 2024-05-02 | ソニーセミコンダクタソリューションズ株式会社 | Fluorescence detection device and plate for fluorescence detection device |
Also Published As
| Publication number | Publication date |
|---|---|
| US10634890B1 (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10634890B1 (en) | Miniaturized microscope for phase contrast and multicolor fluorescence imaging | |
| JP6282706B2 (en) | High resolution microscope and method for 2D or 3D positioning of an object | |
| US8582203B2 (en) | Optical arrangement for oblique plane microscopy | |
| US12105271B2 (en) | Microscope and method for microscopic image recording with variable illumination | |
| US5847400A (en) | Fluorescence imaging system having reduced background fluorescence | |
| US11221472B2 (en) | Optical group for detection light for a microscope, method for microscopy, and microscope | |
| US7619732B2 (en) | Method and microscope for high spatial resolution examination of samples | |
| US10649186B2 (en) | Mobile microscope | |
| JP2012212155A (en) | Method and apparatus for fluorescent confocal microscopy | |
| JP2018517178A (en) | Configuration and method for light sheet microscopy | |
| JP2022107604A (en) | High-throughput hyperspectral imaging system | |
| JP6090607B2 (en) | Confocal scanner, confocal microscope | |
| JP2016212154A (en) | Scanning microscope system | |
| JP5415854B2 (en) | Spectroscopic apparatus and scanning microscope apparatus | |
| EP3074807B1 (en) | Optical arrangement for imaging a sample | |
| EP2733514B1 (en) | Microscopy apparatus for structured illumination of a specimen | |
| US20240111141A1 (en) | Light sheet microscope | |
| CN120359447A (en) | Microscope | |
| US11073477B2 (en) | Epi-cone shell light-sheet super-resolution system and microscope | |
| US12326548B2 (en) | Confocal scanner, confocal scanner system, and confocal microscope system | |
| JP6024576B2 (en) | Light source unit for confocal microscope | |
| JP2005091615A (en) | Microscope | |
| JP2015018104A (en) | Laser scanning confocal microscope and pinhole plate | |
| CN115097618A (en) | Fluorescence microscopic imaging light path, optical imaging system and cell analyzer | |
| CN118746551A (en) | A spinning disk line scanning confocal imaging system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: GENERAL ELECTRIC COMPANY, NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KASTEN, ANSAS MATTHIAS;CHALLENER, WILLIAM ALBERT;KARP, JASON HARRIS;AND OTHERS;SIGNING DATES FROM 20181018 TO 20181025;REEL/FRAME:047326/0040 |
|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
| AS | Assignment |
Owner name: GE PRECISION HEALTHCARE LLC, WISCONSIN Free format text: NUNC PRO TUNC ASSIGNMENT;ASSIGNOR:GENERAL ELECTRIC COMPANY;REEL/FRAME:071225/0218 Effective date: 20250505 |