[go: up one dir, main page]

US20200132975A1 - Miniaturized microscope for phase contrast and multicolor fluorescence imaging - Google Patents

Miniaturized microscope for phase contrast and multicolor fluorescence imaging Download PDF

Info

Publication number
US20200132975A1
US20200132975A1 US16/171,707 US201816171707A US2020132975A1 US 20200132975 A1 US20200132975 A1 US 20200132975A1 US 201816171707 A US201816171707 A US 201816171707A US 2020132975 A1 US2020132975 A1 US 2020132975A1
Authority
US
United States
Prior art keywords
microlens array
wavelength
microscope
biological sample
filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US16/171,707
Other versions
US10634890B1 (en
Inventor
Ansas Matthias Kasten
William Albert Challener
Jason Harris Karp
Sudeep Mandal
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GE Precision Healthcare LLC
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Electric Co filed Critical General Electric Co
Priority to US16/171,707 priority Critical patent/US10634890B1/en
Assigned to GENERAL ELECTRIC COMPANY reassignment GENERAL ELECTRIC COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHALLENER, WILLIAM ALBERT, MANDAL, SUDEEP, KARP, JASON HARRIS, Kasten, Ansas Matthias
Application granted granted Critical
Publication of US10634890B1 publication Critical patent/US10634890B1/en
Publication of US20200132975A1 publication Critical patent/US20200132975A1/en
Assigned to GE Precision Healthcare LLC reassignment GE Precision Healthcare LLC NUNC PRO TUNC ASSIGNMENT (SEE DOCUMENT FOR DETAILS). Assignors: GENERAL ELECTRIC COMPANY
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0032Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/44Raman spectrometry; Scattering spectrometry ; Fluorescence spectrometry
    • G01J3/4406Fluorescence spectrometry
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6428Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/0008Microscopes having a simple construction, e.g. portable microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0036Scanning details, e.g. scanning stages
    • G02B21/0044Scanning details, e.g. scanning stages moving apertures, e.g. Nipkow disks, rotating lens arrays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/06Means for illuminating specimens
    • G02B21/08Condensers
    • G02B21/086Condensers for transillumination only
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/18Arrangements with more than one light path, e.g. for comparing two specimens
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/241Devices for focusing
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/34Microscope slides, e.g. mounting specimens on microscope slides
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365Control or image processing arrangements for digital or video microscopes
    • G02B21/367Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/32Fiducial marks and measuring scales within the optical system
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N2021/6417Spectrofluorimetric devices
    • G01N2021/6421Measuring at two or more wavelengths
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N2021/6463Optics
    • G01N2021/6478Special lenses
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2201/00Features of devices classified in G01N21/00
    • G01N2201/02Mechanical
    • G01N2201/022Casings
    • G01N2201/0221Portable; cableless; compact; hand-held

Definitions

  • the subject matter disclosed herein relates to a microscope, in particular, a miniaturized microscope that enables both phase contrast and multicolor fluorescence imaging.
  • Microscopes are used for acquiring information regarding one or more properties or aspects of biological samples.
  • Certain types of microscopes e.g., fluorescent microscopes
  • CCD charge coupled device
  • certain microscopes utilize bulky and expensive components (e.g., high precision actuators for autofocusing).
  • the traditional fluorescent microscopes are bulky, slow, and costly. Due to these attributes, the utilization of these microscopes is limited to laboratory settings, which makes it difficult for them to be utilized in the field. Even further, these microscopes may be limited in their functionality (i.e., the types of imaging that may be utilized or having a limited field of view).
  • a microscope in a first embodiment, includes an illumination source configured to provide illumination beams to image a portion of a biological sample.
  • the microscope also includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of the portion of the biological sample utilizing parallel point scanning.
  • the microscope further includes a detector configured to simultaneously acquire multiple point images at different locations of the portion of the biological sample.
  • a microscope in accordance with another embodiment, includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning.
  • the optical unit includes a first microlens array.
  • the optical unit also includes an edge long-pass filter disposed on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength.
  • the optical unit further includes a second microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength.
  • the optical unit still further includes an absorption filter and an interference notch filter located downstream of the first and second microlens array and the microarray phase plate, wherein the absorption filter and the interference notch filter are configured to be transparent to the beam at the first wavelength and block excitation beams of different wavelengths while only allowing emitted fluorescent beams at the second and third wavelengths to pass.
  • the optical unit even further includes a third microlens array and a fourth microlens array located downstream of the absorption filter and the interference notch filter, wherein the third microlens array and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths.
  • the first, second, third, and fourth microlens arrays are focally aligned.
  • the method also includes disposing an edge long-pass filter on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength.
  • the method further includes optically aligning a second microlens array with the first microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength.
  • the method yet further includes disposing an absorption filter and an interference notch filter downstream of the first and second microlens array, wherein the absorption filter and the interference notch filter are transparent to the beam at the first wavelength and filter the emitted fluorescent beams at the second and third wavelengths.
  • the method still further includes optically aligning a third microlens array, a fourth microlens array, and a pinhole array disposed between the third and fourth microlens array with the first and second microlens arrays downstream of the absorption filter and the interference notch filter, wherein the third microlens array, the pinhole array, and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths.
  • FIG. 1 is a block diagram of a microscopy imaging system, in accordance with aspects of the present disclosure
  • FIG. 2 is schematic diagram of a microscope in a trans-illumination configuration, in accordance with aspects of the present disclosure
  • FIG. 3 is a schematic diagram of a microscope in a total internal reflection-illumination configuration, in accordance with aspects of the present disclosure
  • FIG. 4 is a schematic diagram of a microscope in an epi-illumination configuration, in accordance with aspects of the present disclosure
  • FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing a microscope on a specimen, in accordance with aspects of the present disclosure.
  • FIG. 6 is a schematic diagram illustrating alignment target focusing utilizing a microscope, in accordance with aspects of the present disclosure.
  • the present disclosure relates to a miniaturized, multi-functional microscope.
  • the microscope is designed for both phase contrast and multicolor fluorescence imaging.
  • the microscope may be handheld or fit within the hand.
  • the optical elements together have a total thickness of the less than 5 millimeters (mm).
  • the microscope and its associated components e.g., power supply, piezo-driven scanner, etc.
  • This hand held form factor of the microscope may enable it to be utilized in the field (e.g., for point-of-care applications).
  • the microscope includes a plurality of microlens arrays that may be utilized in a parallel point scanning configuration that enables individual spots of a biological sample (e.g., cells or tissue) to be imaged simultaneously, which provides a short acquisition time (e.g., of a few minutes) and a scalable field of view (FOV).
  • a biological sample e.g., cells or tissue
  • FOV scalable field of view
  • FIG. 1 is a block diagram of a microscopy imaging system 10 .
  • the system 10 includes a microscope 12 (miniaturized, multi-functional microscope). As described in greater detail below, the microscope 12 may be utilized in a variety of configurations such as a trans-illumination configuration, a total internal reflection (TIR)-illumination configuration, and/or an epi-illumination configuration.
  • the microscope 12 includes one or more illumination sources 14 .
  • Non-limiting examples of the illumination sources 14 includes a laser source, a light emitting diode (LED), an incandescent lamp, an arc lamp, or combinations thereof.
  • the illumination source 14 provides illumination beams at the biological sample (e.g., cells, tissues, etc.).
  • the biological sample may be a solid sample, fluidic sample, sample with a regular surface, sample with irregular surface, sample with a regular volume, sample with an irregular volume, or a combination thereof.
  • the biological sample may be disposed between a pair of slides and/or within a fluidic chamber.
  • the illumination source 14 may provide single or multiple wavelength illumination beams.
  • the microscope 12 may include other devices associated with the illumination source 14 such as a collimator (e.g., to collimate the light) and/or a homogenizer (e.g. to homogenize the light).
  • the microscope 14 also includes an optical unit 16 for imaging the biological sample.
  • the optical unit 16 is configured for both phase contrast and multicolor fluorescent imaging. Phase contrast imaging and multicolor fluorescent imaging may be performed simultaneously or sequentially. Besides various filters for the phase contrast and multicolor fluorescent imaging, the optical unit 16 , includes a plurality of microlens arrays disposed in a parallel point scanning configuration. This enables individual spots of the biological sample to be point scanned simultaneously.
  • the microscope 14 also includes a detector array 18 to acquire point images for each of the individual spots of the biological sample.
  • the detector array 18 e.g., imager chip
  • the detector array 18 may include a charge-coupled sensor array, complementary metal-oxide semiconductor (CMOS) imager chip, avalanche photodiode array, or other detection device).
  • CMOS complementary metal-oxide semiconductor
  • the detector array 18 detects the light that has passed through the biological sample and/or the fluorescent signal emitted from the biological sample.
  • the system 10 includes a micro-motion control assembly 20 (e.g., piezo-driven scanner) that moves the biological sample (i.e., the stage or any device supporting the biological sample) during imaging.
  • the piezo-driven scanner may move the biological sample in the x-direction, y-direction, and/or the z-direction in response to voltage signals.
  • the piezo-driven scanner steps the biological sample over a distance of two adjacent microlens elements during the acquisition of individual point images. For example, the biological sample is stepped a distance of a fraction of the pitch between two neighboring lens elements in the microlens array.
  • the image resolution is directly correlated to the step size of the piezo stage that moves the biological sample (assuming the spots generated by the microlens array are not the limiting factor).
  • the pitch between two neighboring lens elements may be 30 ⁇ m.
  • step size of 1 ⁇ m in x- and y-direction could be used to generate a point-scanning image with about 1 ⁇ m resolution (assuming the illumination/imaging spots from each microlens are smaller than 1 ⁇ m in diameter).
  • An entire image can be captured when stepping the distance between the pitch of two neighboring microlens elements in small steps in the x- and in the y-direction.
  • stepping technique one can fill all the empty spots in a unit cell (e.g., by stepping in circles with decreasing diameters until the entire unit cell has been scanned).
  • a microlens array scanning is done in parallel and all unit cells are scanned at the same time.
  • the field of view for the microscope depends on the lateral extend (size) of the microlens array, the pitch between two neighboring microlens array elements is proportional to the number of steps required to fully scan an entire unite cell, and the step size of the piezo stage determines the image resolution.
  • Complete images are acquired when stitching together each of the individual spots at each position (e.g., like a mosaic picture).
  • a final image or images e.g., phase contrast images and/or multicolor fluorescence images
  • the size of both the microlens array and the detector array 18 determine the FOV.
  • the FOV may be scaled up by utilizing a larger microlens array and a larger detector array 18 without increasing the image acquisition time.
  • the resolution of the images depends on the numerical aperture (NA) of the microlenses and the step size of the piezo-driven scanner.
  • the image acquisition time depends on the pitch between each lens element.
  • the current embodiments may have a resolution of approximately 2 micrometers ( ⁇ m), a FOV of 2.54 centimeters (cm) (1 inch) by 2.54 cm (1 inch), and an image acquisition time of a few minutes.
  • the system 10 also includes a fluidic control unit 22 .
  • the fluidic control unit 22 may regulate providing and/or removing different fluids that the biological sample is disposed within.
  • the system 10 includes a computing device 24 (e.g., laptop computer).
  • the computing device 24 includes a memory 26 and a processor 28 configured to execute instructions stored on the memory 22 .
  • the memory 26 may store instructions for controlling components of the system 10 (e.g., microscope 12 , fluidic control unit 22 , micro-motion control assembly 20 , etc.).
  • the computing device 24 may receive the different images acquired by the detector array 18 for the individual spots and assemble these individual images to generate images (e.g., phase contrast images and/or multicolor fluorescent images) of portions of the biological sample.
  • the system 10 also includes a power supply 30 to provide power to one or more components of the system 10 (e.g., computing device 24 , microscope 12 , fluidic control unit 22 , and/or micro-motion control assembly 20 ).
  • the processor 28 may include multiple processors, one or more “general-purpose” microprocessors, one or more special-purpose microprocessors, and/or one or more application specific integrated circuits (ASIC), or some combination thereof.
  • the processor 28 may include one or more reduced instruction set (RISC) processor, advanced RISC machine (ARM) processor, performance optimization with enhanced RISC (PowerPC) processor, field-programmable gate array (FPGA) integrated circuit, graphics processing unit (GPU), or any other suitable processing device.
  • RISC reduced instruction set
  • ARM advanced RISC machine
  • PowerPC field-programmable gate array
  • GPU graphics processing unit
  • the memory 26 may include a volatile memory, such as random access memory (RAM), nonvolatile memory, such as read-only memory (ROM), flash memory, or any combination thereof.
  • RAM random access memory
  • ROM read-only memory
  • the memory 26 may store a variety of information that may be used for various purposes.
  • the memory 26 may store processor-executable instructions (e.g., firmware or software) for the processor 28 to execute, such as instructions for different components of the system 10 .
  • the storage device(s) e.g., nonvolatile storage
  • FIG. 2 is schematic diagram of the microscope 12 in a trans-illumination configuration.
  • the optical unit 16 includes an overall thickness 31 of less than 5 mm.
  • the optical unit 16 includes a first microlens array 32 , a second microlens array 34 , a third microlens array 36 , and a fourth microlens array 38 .
  • a more compact and simpler version of this trans-illumination configuration could be realized by eliminating elements 36 , 80 , and 38 at the cost of increased optical cross-talk.
  • the microlens arrays 32 , 34 , 68 , 38 are focally aligned with each other. In the trans-illumination configuration a collimated and homogenized excitation beam 40 is directed onto the first microlens array 32 .
  • excitation wavelengths may be utilized with the microscope 12 (e.g., emitted from the illumination source 14 ). As depicted, three different wavelengths are described. For example, a wavelength of 405 nanometers (nm) (indicated by solid arrows 42 ) is utilized for phase contrast imaging and wavelengths 550 nm (indicated by dashed arrows 44 ) and 650 nm (indicated by dotted arrows 46 ) are utilized for excitation in fluorescence imaging. These beams 42 , 44 , 46 are collimated and homogenized. A larger number of individual wavelengths could be utilized to image a larger number of fluorescent labels. For simplicity, we limit the description of this disclosed embodiments to three individual wavelengths.
  • the microlens array 32 forms small spots that are used for the excitation of the biological sample.
  • the focal plane or the (fractional) Talbot planes may be utilized to generate the desired spot pattern.
  • a different microlens array has to be utilized to create excitation spots that match the pitch of the microlens array 32 on the light collection side.
  • Talbot plane illumination may be useful when a larger working distance between the microlens array 32 and the biological sample is desired.
  • the spot quality may degrade with increasing Talbot plane distance.
  • the Talbot plane distance is strongly dependent on the wavelength of the excitation light. Thus, the z-height of the sample has to be adjusted when different illumination wavelengths are utilized.
  • the focal plane is the preferred illumination plane when a smaller working distance can be tolerated.
  • a working distance of approximately 100 ⁇ m is typical for microlens arrays with a NA of 0.15.
  • an edge-long-pass filter 48 is disposed on a backside 50 (i.e., side that encounters illumination beams first) of the first microlens array 32 .
  • the edge-long pass filter 48 may be disposed on a separate transparent substrate.
  • the edge-long pass filter 48 is opaque at the wavelength (e.g., 405 nm) utilized for phase contrast imaging and transparent for the 550 and 650 wavelengths (e.g., wavelengths longer than the wavelength utilized for phase contrast imaging and longer than the cutoff wavelength of the edge-long pass filter 48 ) utilized for fluorescence imaging.
  • the edge-long pass filter 48 serves as a condenser annulus 52 for the 405 nm excitation beam 42 .
  • each lens element of the microlens array 32 is associated with a respective condenser annulus 52 .
  • the condenser annulus 52 includes a central portion 54 that blocks the center portion of the 405 nm excitation beam 42 .
  • the portion of the 405 nm excitation beam 42 that passes through an annulus portion 56 of the microlens element is focused onto a biological sample 58 (e.g., cells).
  • the biological sample 58 is disposed between a pair of glass slides 60 .
  • Chrome apertures 62 e.g., annular chrome apertures
  • the second microlens array 34 is disposed beneath biological sample 58 .
  • a portion 66 of the 405 nm excitation beam 42 is diffracted and phase altered by the sample 58 and a portion 68 of the beam 42 remains undiffracted and passes through the sample 58 .
  • Chrome apertures 70 e.g., annular chrome apertures
  • the chrome apertures 62 , 70 reduce bleed-through or cross-talk between adjacent channels (i.e., microlens elements) during fluorescence imaging.
  • the second microlens array 34 collimates the diffracted and phase altered transmitted beam 66 .
  • a microarray phase plate 74 is disposed beneath (i.e., downstream of) the second microlens array 34 .
  • the phase plate 74 retards the phase altered transmitted beam 66 by 90 degrees, while enabling the undiffracted light 68 to transmit without retardation.
  • An absorption filter 76 and an interference notch filter 78 are disposed beneath the phase plate 74 .
  • the absorption filter 76 is disposed between the phase plate 74 and the interference notch filter 78 .
  • Both the absorption filter 76 and the interference notch filter 78 are transparent to wavelengths below 550 nm. Thus, the filters 76 , 78 are transparent to the beams portions 66 , 68 .
  • the optical unit 16 may include more than one notch filter, where each notch filter is specific for a different wavelength. In certain embodiments, the optical unit 16 may utilize a single notch filter that may include portions specific for a first wavelength and portions specific for a second wavelength different from the first wavelength (e.g., in a checkerboard pattern).
  • the third microlens array 36 and the fourth microlens array 38 are disposed beneath the filters 76 , 78 with the microlens array 36 being adjacent the interference notch filter 78 .
  • a pinhole array 80 is disposed in the focal plane between the third and fourth microlens arrays 36 , 38 .
  • the microscope 12 may not include the third and fourth microlens arrays 36 , 38 and the pinhole array 80 if a more compact and simpler assembly is desired.
  • the beam portions 66 , 68 are spatially filtered by the microlens arrays 36 , 38 and the pinhole array 80 .
  • the pinhole array 80 blocks any stray light (e.g., to reduce cross-talk between adjacent lenslets).
  • phase contrast image For each illuminated spot of the biological sample 58 .
  • phase contrast point images are detected by the detector array 18 .
  • the individually acquired point images are then combined by the computing device 24 to form a complete image (e.g., phase contrast image) after scanning the biological sample step-by-step (via the piezo-driven scanner 20 ) to fill in the blank spots in a unit cell the size of the pitch between microlens array elements in the x- and y-direction to acquire the complete phase contrast image of the biological sample 58 .
  • excitation beams 44 , 46 of 550 nm and 650 nm (which may be utilized to excite Cy3 or Cy5 dyes, respectively) are utilized as examples. Different wavelengths for fluorescent imaging may be utilized. In addition, a different number of wavelengths (e.g., more than two) may be utilized for fluorescent imaging. As depicted, the beams 44 , 46 pass through the edge long-pass filter 48 described above. The first microlens array 32 focuses the excitations beams 44 , 46 on the biological sample 58 to form illumination spots. As mentioned above, either the focal plane or fractional Talbot planes may be used for spot illumination of the biological sample 58 .
  • the chrome apertures 62 , 70 reduce bleed-through and/or cross talk, thus, increasing the signal-to noise ratio (SNR) of the point images.
  • Fluorescent light 82 , 84 (for the 550 nm and 650 nm wavelengths, respectively) is emitted from the excited fluorophores.
  • the second microlens array 34 collects the emitted fluorescent light 82 , 84 , which then passes through both the absorption filter 76 and the interference notch filter 78 .
  • the absorption filter 76 removes any stray light caused by scattering of the excitation beams 44 , 46 .
  • the absorption filter 76 filters out stray light that impinges on the filter 76 at oblique incidence.
  • the excitation beams 44 , 46 that impinge at normal incidence at the biological sample 58 are filtered out by the interference notch filter 78 with high optical density (OD).
  • the absorption filter 76 and the interference notch filter 78 may include OD values of +3 and +6, respectively.
  • the emitted and filtered fluorescent light 82 , 84 is then spatially filtered by the microlens arrays 36 , 38 and the pinhole array 36 described above.
  • the fluorescent signals are then detected by the detector array 18 and combined to form a complete fluorescent image upon scanning of the entire biological sample 58 .
  • fine adjustment in the z-direction may be utilized to keep the sample 58 in focus.
  • the focal depth of the microlens arrays 32 , 34 , 36 , 38 tends to be fairly large (e.g., due to the low NA of the lenslets), thus, z-adjustment during scanning may be less critical.
  • FIG. 3 is schematic diagram of the microscope 12 in a total internal reflection (TIR)-illumination configuration.
  • the microscope 12 is as described in FIG. 2 .
  • the only difference is that the fluorescence excitation beams 44 , 46 (550 nm and 650 nm, respectively) are coupled to a waveguide structure 86 .
  • the waveguide structure 86 is formed between the two glass slides 60 and surrounds a high refractive index fluid.
  • the inner surfaces of the glass slides 60 may be coated with a low refractive index film to increase the acceptance angle of the waveguide structure 86 .
  • a prism 88 e.g., transparent prism
  • the TIR captured excitation light 90 (shown for only the 550 nm wavelength) travels down the fluidic channel 92 (formed by the waveguide structured 86 ) to illuminate the biological sample 58 .
  • the TIR-illumination configuration improves the SNR compared to the trans-illumination configuration.
  • the majority of the excitation light remains inside the waveguide structure 86 and is not detected by the detector array 18 . This enables a reduction in the filter requirements and may simplify the detection side of the microscope architecture.
  • the excitation scheme in the TIR-illumination configuration is more complicated.
  • the flood exposure of the entire sample 58 in the TIR-illumination configuration may increase bleaching effects of the fluorescent dyes.
  • dye bleaching is minimized since the only spots of the biological sample 58 that are illuminated are those that currently being imaged.
  • FIG. 4 is schematic diagram of the microscope 12 in an epi-illumination configuration.
  • the microscope 12 is as described in FIG. 2 .
  • the only difference is a dichroic mirror 94 is disposed between the second microlens array 34 and the phase plate 74 .
  • the dichroic mirror 94 is high reflective for the excitation beams 44 , 46 .
  • the dichroic mirror 94 reflects the excitation beam (only excitation beam 44 is shown for simplicity) toward the biological sample 58 , while the dichroic mirror is transparent to the light emitted by the biological sample 58 .
  • the epi-illumination configuration combines the advantages of both the trans-illumination and the TIR-illumination configurations.
  • the biological sample 58 is spot-illuminated to avoid excess bleaching of the fluorescent dyes, while improving the SNR by taking the detector array 18 out the direct path of illumination.
  • the epi-illumination configuration results in a more complicated and more spacious optical design.
  • FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing the microscope 12 on a specimen.
  • FIG. 5 depicts a microfluidic flow cell 96 (e.g., cells of the biological sample or specimen) having a sample area 98 to be imaged.
  • the specimen needs to be brought into focus for the two microlens arrays utilized for illumination and detection.
  • fluorescence and phase contrast labels or targets 100 are placed on each corner of the sample.
  • the piezo-driven scanner then steps the sample in the z-direction until a maximum intensity in fluorescent signal or a maximum contrast in phase contrast image is detected.
  • FIG. 6 depicts the utilization of the target 100 when utilizing the microscope in the trans-illumination configuration.
  • the alignment target 100 may include a tissue stained with a fluorescent target 102 (e.g., a dye such as Cy5) to maximize the intensity of the fluorescence signal.
  • a micro patterned phase retarder (or waveplate) 104 and missing retarder (or waveplate) 106 may be utilized to generate a high contrast phase image that maximizes contrast.
  • the microscope may fit within the hand.
  • the microscope may perform both phase contrast and multicolor fluorescence imaging in conjunction with point scanning.
  • the microscope may include multiple microlens arrays in parallel point scanning configuration. Multiple individual spots may be imaged simultaneously.
  • the microscope may have a large (and scalable) FOV and fast image acquisition time. Due to the size and portability of the microscope, it can be utilized in point-of-care diagnostics (e.g., at home, on the battle field, by first responders, etc.).

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Microscoopes, Condenser (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Abstract

A microscope is provided. The microscope includes an illumination source configured to provide illumination beams to image a portion of a biological sample. The microscope also includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of the portion of the biological sample utilizing parallel point scanning. The microscope further includes a detector configured to simultaneously acquire multiple point images at different locations of the portion of the biological sample.

Description

    BACKGROUND
  • The subject matter disclosed herein relates to a microscope, in particular, a miniaturized microscope that enables both phase contrast and multicolor fluorescence imaging.
  • Microscopes are used for acquiring information regarding one or more properties or aspects of biological samples. Certain types of microscopes (e.g., fluorescent microscopes) require sophisticated and expensive optical lenses, one or more motion control stages, and a charge coupled device (CCD) camera. Further, certain microscopes utilize bulky and expensive components (e.g., high precision actuators for autofocusing). As a result, the traditional fluorescent microscopes are bulky, slow, and costly. Due to these attributes, the utilization of these microscopes is limited to laboratory settings, which makes it difficult for them to be utilized in the field. Even further, these microscopes may be limited in their functionality (i.e., the types of imaging that may be utilized or having a limited field of view).
  • BRIEF DESCRIPTION
  • A summary of certain embodiments disclosed herein is set forth below. It should be understood that these aspects are presented merely to provide the reader with a brief summary of these certain embodiments and that these aspects are not intended to limit the scope of this disclosure. Indeed, this disclosure may encompass a variety of aspects that may not be set forth below.
  • In a first embodiment, a microscope is provided. The microscope includes an illumination source configured to provide illumination beams to image a portion of a biological sample. The microscope also includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of the portion of the biological sample utilizing parallel point scanning. The microscope further includes a detector configured to simultaneously acquire multiple point images at different locations of the portion of the biological sample.
  • In accordance with another embodiment, a microscope is provided. The microscope includes an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning. The optical unit includes a first microlens array. The optical unit also includes an edge long-pass filter disposed on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength. The optical unit further includes a second microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength. The optical unit still further includes an absorption filter and an interference notch filter located downstream of the first and second microlens array and the microarray phase plate, wherein the absorption filter and the interference notch filter are configured to be transparent to the beam at the first wavelength and block excitation beams of different wavelengths while only allowing emitted fluorescent beams at the second and third wavelengths to pass. The optical unit even further includes a third microlens array and a fourth microlens array located downstream of the absorption filter and the interference notch filter, wherein the third microlens array and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths. The first, second, third, and fourth microlens arrays are focally aligned.
  • In accordance with a third embodiment, a method of manufacturing an optical unit for a microscope configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning is provided. The method includes providing a first microlens array. The method also includes disposing an edge long-pass filter on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength. The method further includes optically aligning a second microlens array with the first microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength. The method yet further includes disposing an absorption filter and an interference notch filter downstream of the first and second microlens array, wherein the absorption filter and the interference notch filter are transparent to the beam at the first wavelength and filter the emitted fluorescent beams at the second and third wavelengths. The method still further includes optically aligning a third microlens array, a fourth microlens array, and a pinhole array disposed between the third and fourth microlens array with the first and second microlens arrays downstream of the absorption filter and the interference notch filter, wherein the third microlens array, the pinhole array, and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
  • FIG. 1 is a block diagram of a microscopy imaging system, in accordance with aspects of the present disclosure;
  • FIG. 2 is schematic diagram of a microscope in a trans-illumination configuration, in accordance with aspects of the present disclosure;
  • FIG. 3 is a schematic diagram of a microscope in a total internal reflection-illumination configuration, in accordance with aspects of the present disclosure;
  • FIG. 4 is a schematic diagram of a microscope in an epi-illumination configuration, in accordance with aspects of the present disclosure;
  • FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing a microscope on a specimen, in accordance with aspects of the present disclosure; and
  • FIG. 6 is a schematic diagram illustrating alignment target focusing utilizing a microscope, in accordance with aspects of the present disclosure.
  • DETAILED DESCRIPTION
  • One or more specific embodiments will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
  • The present disclosure relates to a miniaturized, multi-functional microscope. The microscope is designed for both phase contrast and multicolor fluorescence imaging. The microscope may be handheld or fit within the hand. The optical elements together have a total thickness of the less than 5 millimeters (mm). The microscope and its associated components (e.g., power supply, piezo-driven scanner, etc.) are portable (e.g., within a handheld case). This hand held form factor of the microscope may enable it to be utilized in the field (e.g., for point-of-care applications). The microscope includes a plurality of microlens arrays that may be utilized in a parallel point scanning configuration that enables individual spots of a biological sample (e.g., cells or tissue) to be imaged simultaneously, which provides a short acquisition time (e.g., of a few minutes) and a scalable field of view (FOV).
  • Turning to the figures, FIG. 1 is a block diagram of a microscopy imaging system 10. The system 10 includes a microscope 12 (miniaturized, multi-functional microscope). As described in greater detail below, the microscope 12 may be utilized in a variety of configurations such as a trans-illumination configuration, a total internal reflection (TIR)-illumination configuration, and/or an epi-illumination configuration. The microscope 12 includes one or more illumination sources 14. Non-limiting examples of the illumination sources 14 includes a laser source, a light emitting diode (LED), an incandescent lamp, an arc lamp, or combinations thereof. The illumination source 14 provides illumination beams at the biological sample (e.g., cells, tissues, etc.). The biological sample may be a solid sample, fluidic sample, sample with a regular surface, sample with irregular surface, sample with a regular volume, sample with an irregular volume, or a combination thereof. The biological sample may be disposed between a pair of slides and/or within a fluidic chamber. The illumination source 14 may provide single or multiple wavelength illumination beams. The microscope 12 may include other devices associated with the illumination source 14 such as a collimator (e.g., to collimate the light) and/or a homogenizer (e.g. to homogenize the light).
  • The microscope 14 also includes an optical unit 16 for imaging the biological sample. As described in greater detail below, the optical unit 16 is configured for both phase contrast and multicolor fluorescent imaging. Phase contrast imaging and multicolor fluorescent imaging may be performed simultaneously or sequentially. Besides various filters for the phase contrast and multicolor fluorescent imaging, the optical unit 16, includes a plurality of microlens arrays disposed in a parallel point scanning configuration. This enables individual spots of the biological sample to be point scanned simultaneously.
  • The microscope 14 also includes a detector array 18 to acquire point images for each of the individual spots of the biological sample. The detector array 18 (e.g., imager chip) may include a charge-coupled sensor array, complementary metal-oxide semiconductor (CMOS) imager chip, avalanche photodiode array, or other detection device). The detector array 18 detects the light that has passed through the biological sample and/or the fluorescent signal emitted from the biological sample.
  • The system 10 includes a micro-motion control assembly 20 (e.g., piezo-driven scanner) that moves the biological sample (i.e., the stage or any device supporting the biological sample) during imaging. In particular, the piezo-driven scanner may move the biological sample in the x-direction, y-direction, and/or the z-direction in response to voltage signals. Specifically, the piezo-driven scanner steps the biological sample over a distance of two adjacent microlens elements during the acquisition of individual point images. For example, the biological sample is stepped a distance of a fraction of the pitch between two neighboring lens elements in the microlens array. The image resolution is directly correlated to the step size of the piezo stage that moves the biological sample (assuming the spots generated by the microlens array are not the limiting factor). For example, the pitch between two neighboring lens elements may be 30 μm. As step size of 1 μm in x- and y-direction could be used to generate a point-scanning image with about 1 μm resolution (assuming the illumination/imaging spots from each microlens are smaller than 1 μm in diameter). An entire image can be captured when stepping the distance between the pitch of two neighboring microlens elements in small steps in the x- and in the y-direction. Using this stepping technique, one can fill all the empty spots in a unit cell (e.g., by stepping in circles with decreasing diameters until the entire unit cell has been scanned). By using a microlens array, scanning is done in parallel and all unit cells are scanned at the same time. The field of view for the microscope (or the scanning area) depends on the lateral extend (size) of the microlens array, the pitch between two neighboring microlens array elements is proportional to the number of steps required to fully scan an entire unite cell, and the step size of the piezo stage determines the image resolution. The number of scanning steps are directly proportional to the total imaging time (e.g., total imaging time=number of scanning steps*dwell time per point scan). Complete images are acquired when stitching together each of the individual spots at each position (e.g., like a mosaic picture). A final image or images (e.g., phase contrast images and/or multicolor fluorescence images) may be generated based on the assembly of the individual point images.
  • The size of both the microlens array and the detector array 18 determine the FOV. For example, the FOV may be scaled up by utilizing a larger microlens array and a larger detector array 18 without increasing the image acquisition time. The resolution of the images depends on the numerical aperture (NA) of the microlenses and the step size of the piezo-driven scanner. The image acquisition time depends on the pitch between each lens element. In certain embodiments, the current embodiments may have a resolution of approximately 2 micrometers (μm), a FOV of 2.54 centimeters (cm) (1 inch) by 2.54 cm (1 inch), and an image acquisition time of a few minutes.
  • In certain embodiments, the system 10 also includes a fluidic control unit 22. Depending on the biological sample, the fluidic control unit 22 may regulate providing and/or removing different fluids that the biological sample is disposed within. The system 10 includes a computing device 24 (e.g., laptop computer). The computing device 24 includes a memory 26 and a processor 28 configured to execute instructions stored on the memory 22. In certain embodiments, the memory 26 may store instructions for controlling components of the system 10 (e.g., microscope 12, fluidic control unit 22, micro-motion control assembly 20, etc.). The computing device 24 may receive the different images acquired by the detector array 18 for the individual spots and assemble these individual images to generate images (e.g., phase contrast images and/or multicolor fluorescent images) of portions of the biological sample. The system 10 also includes a power supply 30 to provide power to one or more components of the system 10 (e.g., computing device 24, microscope 12, fluidic control unit 22, and/or micro-motion control assembly 20).
  • The processor 28 may include multiple processors, one or more “general-purpose” microprocessors, one or more special-purpose microprocessors, and/or one or more application specific integrated circuits (ASIC), or some combination thereof. For example, the processor 28 may include one or more reduced instruction set (RISC) processor, advanced RISC machine (ARM) processor, performance optimization with enhanced RISC (PowerPC) processor, field-programmable gate array (FPGA) integrated circuit, graphics processing unit (GPU), or any other suitable processing device.
  • The memory 26 may include a volatile memory, such as random access memory (RAM), nonvolatile memory, such as read-only memory (ROM), flash memory, or any combination thereof. The memory 26 may store a variety of information that may be used for various purposes. For example, the memory 26 may store processor-executable instructions (e.g., firmware or software) for the processor 28 to execute, such as instructions for different components of the system 10. The storage device(s) (e.g., nonvolatile storage) may include ROM, flash memory, a hard drive, or any other suitable optical, magnetic, or solid-state storage medium, or a combination thereof.
  • FIG. 2 is schematic diagram of the microscope 12 in a trans-illumination configuration. The optical unit 16 includes an overall thickness 31 of less than 5 mm. The optical unit 16 includes a first microlens array 32, a second microlens array 34, a third microlens array 36, and a fourth microlens array 38. A more compact and simpler version of this trans-illumination configuration could be realized by eliminating elements 36, 80, and 38 at the cost of increased optical cross-talk. The microlens arrays 32, 34, 68, 38 are focally aligned with each other. In the trans-illumination configuration a collimated and homogenized excitation beam 40 is directed onto the first microlens array 32. Multiple excitation wavelengths may be utilized with the microscope 12 (e.g., emitted from the illumination source 14). As depicted, three different wavelengths are described. For example, a wavelength of 405 nanometers (nm) (indicated by solid arrows 42) is utilized for phase contrast imaging and wavelengths 550 nm (indicated by dashed arrows 44) and 650 nm (indicated by dotted arrows 46) are utilized for excitation in fluorescence imaging. These beams 42, 44, 46 are collimated and homogenized. A larger number of individual wavelengths could be utilized to image a larger number of fluorescent labels. For simplicity, we limit the description of this disclosed embodiments to three individual wavelengths.
  • The microlens array 32 forms small spots that are used for the excitation of the biological sample. The focal plane or the (fractional) Talbot planes may be utilized to generate the desired spot pattern. In embodiments, utilizing the fractional Talbot planes, a different microlens array has to be utilized to create excitation spots that match the pitch of the microlens array 32 on the light collection side. Talbot plane illumination may be useful when a larger working distance between the microlens array 32 and the biological sample is desired. However, the spot quality may degrade with increasing Talbot plane distance. The Talbot plane distance is strongly dependent on the wavelength of the excitation light. Thus, the z-height of the sample has to be adjusted when different illumination wavelengths are utilized. This is not the case when utilizing the focal plane of the microlens array 32. In this case, the focal distance stays relatively constant for different excitation wavelengths, eliminating the need for extensive adjustments in z-height. In addition, the generated spot pattern will be sharper compared to the spots generated in fractional Talbot planes. Thus, the focal plane is the preferred illumination plane when a smaller working distance can be tolerated. A working distance of approximately 100 μm is typical for microlens arrays with a NA of 0.15.
  • With regards to phase contrast imaging, an edge-long-pass filter 48 is disposed on a backside 50 (i.e., side that encounters illumination beams first) of the first microlens array 32. In certain embodiments, the edge-long pass filter 48 may be disposed on a separate transparent substrate. The edge-long pass filter 48 is opaque at the wavelength (e.g., 405 nm) utilized for phase contrast imaging and transparent for the 550 and 650 wavelengths (e.g., wavelengths longer than the wavelength utilized for phase contrast imaging and longer than the cutoff wavelength of the edge-long pass filter 48) utilized for fluorescence imaging. The edge-long pass filter 48 serves as a condenser annulus 52 for the 405 nm excitation beam 42. In particular, each lens element of the microlens array 32 is associated with a respective condenser annulus 52. The condenser annulus 52 includes a central portion 54 that blocks the center portion of the 405 nm excitation beam 42. The portion of the 405 nm excitation beam 42 that passes through an annulus portion 56 of the microlens element is focused onto a biological sample 58 (e.g., cells). As depicted, the biological sample 58 is disposed between a pair of glass slides 60. Chrome apertures 62 (e.g., annular chrome apertures) are disposed on a front side 64 (i.e., side opposite the edge long-pass filter 48) to minimize unwanted bleed through of light from the excitation source.
  • The second microlens array 34 is disposed beneath biological sample 58. A portion 66 of the 405 nm excitation beam 42 is diffracted and phase altered by the sample 58 and a portion 68 of the beam 42 remains undiffracted and passes through the sample 58. Chrome apertures 70 (e.g., annular chrome apertures) are disposed on a side 72 of the microlens array 34 facing the biological sample 58. The chrome apertures 62, 70 reduce bleed-through or cross-talk between adjacent channels (i.e., microlens elements) during fluorescence imaging. The second microlens array 34 collimates the diffracted and phase altered transmitted beam 66. A microarray phase plate 74 is disposed beneath (i.e., downstream of) the second microlens array 34. The phase plate 74 retards the phase altered transmitted beam 66 by 90 degrees, while enabling the undiffracted light 68 to transmit without retardation. An absorption filter 76 and an interference notch filter 78 are disposed beneath the phase plate 74. The absorption filter 76 is disposed between the phase plate 74 and the interference notch filter 78. Both the absorption filter 76 and the interference notch filter 78 are transparent to wavelengths below 550 nm. Thus, the filters 76, 78 are transparent to the beams portions 66, 68. In certain embodiments, the optical unit 16 may include more than one notch filter, where each notch filter is specific for a different wavelength. In certain embodiments, the optical unit 16 may utilize a single notch filter that may include portions specific for a first wavelength and portions specific for a second wavelength different from the first wavelength (e.g., in a checkerboard pattern).
  • The third microlens array 36 and the fourth microlens array 38 are disposed beneath the filters 76, 78 with the microlens array 36 being adjacent the interference notch filter 78. A pinhole array 80 is disposed in the focal plane between the third and fourth microlens arrays 36, 38. In certain embodiments, the microscope 12 may not include the third and fourth microlens arrays 36, 38 and the pinhole array 80 if a more compact and simpler assembly is desired. The beam portions 66, 68 are spatially filtered by the microlens arrays 36, 38 and the pinhole array 80. The pinhole array 80 blocks any stray light (e.g., to reduce cross-talk between adjacent lenslets). The beam portions constructively and destructively interfere to form a phase contrast image for each illuminated spot of the biological sample 58. These phase contrast point images are detected by the detector array 18. The individually acquired point images are then combined by the computing device 24 to form a complete image (e.g., phase contrast image) after scanning the biological sample step-by-step (via the piezo-driven scanner 20) to fill in the blank spots in a unit cell the size of the pitch between microlens array elements in the x- and y-direction to acquire the complete phase contrast image of the biological sample 58.
  • With regard to multicolor fluorescent imaging, as mentioned above, excitation beams 44, 46 of 550 nm and 650 nm (which may be utilized to excite Cy3 or Cy5 dyes, respectively) are utilized as examples. Different wavelengths for fluorescent imaging may be utilized. In addition, a different number of wavelengths (e.g., more than two) may be utilized for fluorescent imaging. As depicted, the beams 44, 46 pass through the edge long-pass filter 48 described above. The first microlens array 32 focuses the excitations beams 44, 46 on the biological sample 58 to form illumination spots. As mentioned above, either the focal plane or fractional Talbot planes may be used for spot illumination of the biological sample 58. As mentioned above, the chrome apertures 62, 70 reduce bleed-through and/or cross talk, thus, increasing the signal-to noise ratio (SNR) of the point images. Fluorescent light 82, 84 (for the 550 nm and 650 nm wavelengths, respectively) is emitted from the excited fluorophores. The second microlens array 34 collects the emitted fluorescent light 82, 84, which then passes through both the absorption filter 76 and the interference notch filter 78. The absorption filter 76 removes any stray light caused by scattering of the excitation beams 44, 46. In particular, the absorption filter 76 filters out stray light that impinges on the filter 76 at oblique incidence. The excitation beams 44, 46 that impinge at normal incidence at the biological sample 58 are filtered out by the interference notch filter 78 with high optical density (OD). In certain embodiments, the absorption filter 76 and the interference notch filter 78 may include OD values of +3 and +6, respectively. The emitted and filtered fluorescent light 82, 84 is then spatially filtered by the microlens arrays 36, 38 and the pinhole array 36 described above. The fluorescent signals are then detected by the detector array 18 and combined to form a complete fluorescent image upon scanning of the entire biological sample 58. During the scanning process, fine adjustment in the z-direction may be utilized to keep the sample 58 in focus. However, the focal depth of the microlens arrays 32, 34, 36, 38 tends to be fairly large (e.g., due to the low NA of the lenslets), thus, z-adjustment during scanning may be less critical.
  • FIG. 3 is schematic diagram of the microscope 12 in a total internal reflection (TIR)-illumination configuration. In general, the microscope 12 is as described in FIG. 2. The only difference is that the fluorescence excitation beams 44, 46 (550 nm and 650 nm, respectively) are coupled to a waveguide structure 86. The waveguide structure 86 is formed between the two glass slides 60 and surrounds a high refractive index fluid. The inner surfaces of the glass slides 60 may be coated with a low refractive index film to increase the acceptance angle of the waveguide structure 86. A prism 88 (e.g., transparent prism) is utilized to couple the excitation beams 44, 46 to the waveguide structure 86. Thus, unlike the configuration in FIG. 2, the beams 44, 46 do not pass through the microlens array 32. The TIR captured excitation light 90 (shown for only the 550 nm wavelength) travels down the fluidic channel 92 (formed by the waveguide structured 86) to illuminate the biological sample 58. The TIR-illumination configuration improves the SNR compared to the trans-illumination configuration. The majority of the excitation light remains inside the waveguide structure 86 and is not detected by the detector array 18. This enables a reduction in the filter requirements and may simplify the detection side of the microscope architecture. However, the excitation scheme in the TIR-illumination configuration is more complicated. In addition, the flood exposure of the entire sample 58 in the TIR-illumination configuration may increase bleaching effects of the fluorescent dyes. In the trans-illumination configuration, dye bleaching is minimized since the only spots of the biological sample 58 that are illuminated are those that currently being imaged.
  • FIG. 4 is schematic diagram of the microscope 12 in an epi-illumination configuration. In general, the microscope 12 is as described in FIG. 2. The only difference is a dichroic mirror 94 is disposed between the second microlens array 34 and the phase plate 74. The dichroic mirror 94 is high reflective for the excitation beams 44, 46. In particular, the dichroic mirror 94 reflects the excitation beam (only excitation beam 44 is shown for simplicity) toward the biological sample 58, while the dichroic mirror is transparent to the light emitted by the biological sample 58. The epi-illumination configuration combines the advantages of both the trans-illumination and the TIR-illumination configurations. The biological sample 58 is spot-illuminated to avoid excess bleaching of the fluorescent dyes, while improving the SNR by taking the detector array 18 out the direct path of illumination. However, the epi-illumination configuration results in a more complicated and more spacious optical design.
  • FIG. 5 is a top view of a schematic diagram of a fluorescence and phase contrast labeling scheme for focusing the microscope 12 on a specimen. FIG. 5 depicts a microfluidic flow cell 96 (e.g., cells of the biological sample or specimen) having a sample area 98 to be imaged. The specimen needs to be brought into focus for the two microlens arrays utilized for illumination and detection. In certain embodiments to achieve focusing of the specimen, fluorescence and phase contrast labels or targets 100 (e.g., alignment targets) are placed on each corner of the sample. The piezo-driven scanner then steps the sample in the z-direction until a maximum intensity in fluorescent signal or a maximum contrast in phase contrast image is detected. This position in the z-direction then correlates with the optimum focal point for the miniaturized microscope system. FIG. 6 depicts the utilization of the target 100 when utilizing the microscope in the trans-illumination configuration. As depicted, the alignment target 100 may include a tissue stained with a fluorescent target 102 (e.g., a dye such as Cy5) to maximize the intensity of the fluorescence signal. A micro patterned phase retarder (or waveplate) 104 and missing retarder (or waveplate) 106 may be utilized to generate a high contrast phase image that maximizes contrast.
  • Technical effects of the disclosed embodiments include providing a portable, miniaturized microscope that performs multiple imaging functions. The microscope may fit within the hand. The microscope may perform both phase contrast and multicolor fluorescence imaging in conjunction with point scanning. Indeed, the microscope may include multiple microlens arrays in parallel point scanning configuration. Multiple individual spots may be imaged simultaneously. Thus, the microscope may have a large (and scalable) FOV and fast image acquisition time. Due to the size and portability of the microscope, it can be utilized in point-of-care diagnostics (e.g., at home, on the battle field, by first responders, etc.).
  • This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.

Claims (20)

1. A microscope, comprising:
an illumination source configured to provide illumination beams to image a portion of a biological sample;
an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of the portion of the biological sample utilizing parallel point scanning; and
a detector configured to simultaneously acquire a plurality of point images at different locations of the portion of the biological sample.
2. The microscope of claim 1, wherein the microscope is portable and configured to be handheld.
3. The microscope of claim 1, wherein the optical unit has an overall thickness of less than 5 millimeters.
4. The microscope of claim 1, wherein the optical unit comprises a first microlens array and an edge long-pass filter disposed on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, and each respective condenser annulus is configured to block a center portion of an illumination beam at a first wavelength on the respective lens element and to enable the illumination beam at the first wavelength incident upon the respective lens element through the respective condenser annulus to be focused on the portion of biological sample, and wherein the edge long-pass filter is transparent for illumination beams at one or more wavelengths different from the first wavelength.
5. The microscope of claim 4, wherein the optical unit comprises a second microlens array focally aligned with the first microlens array, wherein the second microlens array is configured to collimate a diffracted and phase altered transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent light emitted by the biological sample at the one or more wavelengths.
6. The microscope of claim 5, comprising a microarray phase plate configured to retard by 90 degrees the collimated phase altered transmitted beam and to enable undiffracted light at the first wavelength that passed through biological sample to pass through.
7. The microscope of claim 6, comprising an absorption filter and an interference notch filter located downstream of the first and second microlens array and the microarray phase plate, wherein the absorption filter and the interference notch filter are transparent to light at the first wavelength and filter the emitted fluorescent light at the one or more wavelengths.
8. The microscope of claim 7, comprising a third microlens array and a fourth microlens array focally aligned with the first and second microlens array and located downstream of the absorption filter and the interference notch filter, and a pinhole array disposed between the third and fourth microlens array, and wherein the third microlens array, the pinhole array, and the fourth microlens array are configured to spatially filter the phase altered transmitted beam and the undiffracted light at the first wavelength and to spatially filter the emitted fluorescent light at the one or more wavelengths for detection by the detector.
9. The microscope of claim 7, comprising a dichroic mirror disposed between the second microlens array and the microarray phase plate that is reflective at the second and third wavelengths.
10. The microscope of claim 1, comprising a piezo-driven scanner configured to move the biological sample in multiple directions, wherein the piezo-driven scanner is configured to step the biological sample one lens element pitch in both a first direction and a second direction.
11. The microscope of claim 1, comprising a processor configured to generate a phase contrast image and a multicolor fluorescence image of the portion of the biological sample based on the plurality of point images at different locations.
12. The microscope of claim 1, wherein the microscope is configured to be utilized in a trans-illumination configuration, a total internal reflection-illumination configuration, and an epi-illumination configuration.
13. The microscope of claim 1, comprising a waveguide structure formed by a pair of glass slides surrounding a high refractive index fluid, and a prism configured to provide the illumination beams at the one or more wavelengths to the waveguide structure for illuminating the biological sample.
14. A microscope, comprising:
an optical unit configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning, wherein the optical unit comprises:
a first microlens array;
an edge long-pass filter disposed on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength;
a second microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength;
an absorption filter and an interference notch filter located downstream of the first and second microlens array, wherein the absorption filter and the interference notch filter are configured to be transparent to the beam at the first wavelength and block excitation beams of different wavelengths while only allowing emitted fluorescent beams at the second and third wavelengths to pass; and
a third microlens array and a fourth microlens array located downstream of the absorption filter and the interference notch filter, and a pinhole array disposed between the third and fourth microlens array, and wherein the third microlens array, the pinhole array, and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths;
wherein the first, second, third, and fourth microlens arrays are focally aligned.
15. The microscope of claim 14, wherein each respective condenser annulus is configured to block a center portion of the beam at the first wavelength on the respective lens element and to enable the beam at the first wavelength incident upon the respective lens element through the respective condenser annulus to be focused on the portion of biological sample.
16. The microscope of claim 14, wherein the optical unit has an overall thickness of less than 5 millimeters.
17. The microscope of claim 14, wherein the optical unit comprises a microarray phase plate configured to retard by 90 degrees the collimated phase altered transmitted beam and to enable the undiffracted beam at the first wavelength that passed through biological sample to pass through.
18. A method of manufacturing an optical unit for a microscope configured to enable both phase contrast imaging and multicolor fluorescence imaging of a portion of a biological sample utilizing parallel point scanning, comprising:
providing a first microlens array;
disposing an edge long-pass filter on a backside of the first microlens array, wherein the edge long-pass filter is configured to form a respective condenser annulus associated with a respective lens element of the first microlens array, wherein the edge long-pass filter is configured to enable a portion of a beam at a first wavelength to pass through to the first microlens array, and the edge-long filter is transparent to beams at a second and a third wavelength different from the first wavelength;
optically aligning a second microlens array with the first microlens array, wherein the second microlens array is configured to collimate a diffracted transmitted beam at the first wavelength from the biological sample, and the second microlens array is configured to collect fluorescent beams emitted by the biological sample at the second wavelength and the third wavelength;
disposing an absorption filter and an interference notch filter downstream of the first and second microlens array, wherein the absorption filter and the interference notch filter are configured to be transparent to the beam at the first wavelength and block excitation beams of different wavelengths while only allowing emitted fluorescent beams at the second and third wavelengths to pass; and
optically aligning a third microlens array, a fourth microlens array, and a pinhole array disposed between the third and fourth microlens array with the first and second microlens arrays downstream of the absorption filter and the interference notch filter, wherein the third microlens array, the pinhole array, and the fourth microlens array are configured to spatially filter the transmitted beam at the first wavelength and the undiffracted beam at the first wavelength that has passed through the biological sample and to spatially filter the emitted fluorescent beams at the second and third wavelengths.
19. The method of claim 18, comprising disposing a microarray phase plate between the second microlens array and the absorption filter, wherein the microarray phase plate is configured to retard by 90 degrees the collimated phase altered transmitted beam and to enable the undiffracted beam at the first wavelength that passed through biological sample to pass through.
20. The method of claim 18, wherein the optical unit has an overall thickness of less than 5 millimeters.
US16/171,707 2018-10-26 2018-10-26 Miniaturized microscope for phase contrast and multicolor fluorescence imaging Active 2038-11-06 US10634890B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/171,707 US10634890B1 (en) 2018-10-26 2018-10-26 Miniaturized microscope for phase contrast and multicolor fluorescence imaging

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US16/171,707 US10634890B1 (en) 2018-10-26 2018-10-26 Miniaturized microscope for phase contrast and multicolor fluorescence imaging

Publications (2)

Publication Number Publication Date
US10634890B1 US10634890B1 (en) 2020-04-28
US20200132975A1 true US20200132975A1 (en) 2020-04-30

Family

ID=70327027

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/171,707 Active 2038-11-06 US10634890B1 (en) 2018-10-26 2018-10-26 Miniaturized microscope for phase contrast and multicolor fluorescence imaging

Country Status (1)

Country Link
US (1) US10634890B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024090068A1 (en) * 2022-10-26 2024-05-02 ソニーセミコンダクタソリューションズ株式会社 Fluorescence detection device and plate for fluorescence detection device

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3581919B1 (en) * 2018-06-15 2022-03-23 IMEC vzw An imaging apparatus and a method for imaging an object
JP7066914B2 (en) * 2019-03-12 2022-05-13 株式会社日立ハイテク Defect detection device, defect detection method, and defect observation device equipped with this
EP4055517A1 (en) * 2019-11-08 2022-09-14 Leica Instruments (Singapore) Pte Ltd System, microscope system, methods and computer programs for training or using a machine-learning model
CN113367717B (en) * 2021-05-26 2022-11-22 中国科学院深圳先进技术研究院 Cone beam X-ray fluorescence imaging method, system, terminal and storage medium

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6133986A (en) 1996-02-28 2000-10-17 Johnson; Kenneth C. Microlens scanner for microlithography and wide-field confocal microscopy
WO2002075370A2 (en) 2001-03-19 2002-09-26 Weinstein Ronald S Miniaturized microscope array digital slide scanner
US7864369B2 (en) 2001-03-19 2011-01-04 Dmetrix, Inc. Large-area imaging by concatenation with array microscope
US20040023415A1 (en) 2002-03-05 2004-02-05 Konstantin Sokolov Biospecific contrast agents
US6934079B2 (en) 2002-05-03 2005-08-23 Max-Planck-Gesellschaft zur Förderung der Wissen-schaften e. V. Confocal microscope comprising two microlens arrays and a pinhole diaphragm array
JPWO2004036284A1 (en) 2002-09-30 2006-02-16 独立行政法人科学技術振興機構 Confocal microscope, fluorescence measuring method and polarization measuring method using confocal microscope
DE102004034970A1 (en) * 2004-07-16 2006-02-02 Carl Zeiss Jena Gmbh Scanning microscope and use
WO2008048612A2 (en) 2006-10-17 2008-04-24 Hnuphotonics Miniature microscope camera
EP2389606B1 (en) * 2009-01-24 2019-08-28 Ecole Polytechnique Federale De Lausanne (EPFL) EPFL-TTO High-resolution microscopy and photolithography devices using focusing micromirrors
WO2011053828A2 (en) 2009-10-30 2011-05-05 The Regents Of The University Of Michigan Targeted dual-axes confocal imaging apparatus with vertical scanning capabilities
US8435738B2 (en) * 2011-09-25 2013-05-07 Theranos, Inc. Systems and methods for multi-analysis
US20160069919A1 (en) * 2011-09-25 2016-03-10 Theranos, Inc. Systems and methods for multi-analysis
US20130162800A1 (en) * 2011-12-22 2013-06-27 General Electric Company Quantitative phase microscopy for label-free high-contrast cell imaging using frequency domain phase shift
US20150087902A1 (en) 2012-03-30 2015-03-26 Trustees Of Boston University Phase Contrast Microscopy With Oblique Back-Illumination
DE102016218452A1 (en) * 2016-09-26 2018-03-29 Carl Zeiss Smt Gmbh Method for determining a distance of a first structural element on a substrate from a second structural element

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024090068A1 (en) * 2022-10-26 2024-05-02 ソニーセミコンダクタソリューションズ株式会社 Fluorescence detection device and plate for fluorescence detection device

Also Published As

Publication number Publication date
US10634890B1 (en) 2020-04-28

Similar Documents

Publication Publication Date Title
US10634890B1 (en) Miniaturized microscope for phase contrast and multicolor fluorescence imaging
JP6282706B2 (en) High resolution microscope and method for 2D or 3D positioning of an object
US8582203B2 (en) Optical arrangement for oblique plane microscopy
US12105271B2 (en) Microscope and method for microscopic image recording with variable illumination
US5847400A (en) Fluorescence imaging system having reduced background fluorescence
US11221472B2 (en) Optical group for detection light for a microscope, method for microscopy, and microscope
US7619732B2 (en) Method and microscope for high spatial resolution examination of samples
US10649186B2 (en) Mobile microscope
JP2012212155A (en) Method and apparatus for fluorescent confocal microscopy
JP2018517178A (en) Configuration and method for light sheet microscopy
JP2022107604A (en) High-throughput hyperspectral imaging system
JP6090607B2 (en) Confocal scanner, confocal microscope
JP2016212154A (en) Scanning microscope system
JP5415854B2 (en) Spectroscopic apparatus and scanning microscope apparatus
EP3074807B1 (en) Optical arrangement for imaging a sample
EP2733514B1 (en) Microscopy apparatus for structured illumination of a specimen
US20240111141A1 (en) Light sheet microscope
CN120359447A (en) Microscope
US11073477B2 (en) Epi-cone shell light-sheet super-resolution system and microscope
US12326548B2 (en) Confocal scanner, confocal scanner system, and confocal microscope system
JP6024576B2 (en) Light source unit for confocal microscope
JP2005091615A (en) Microscope
JP2015018104A (en) Laser scanning confocal microscope and pinhole plate
CN115097618A (en) Fluorescence microscopic imaging light path, optical imaging system and cell analyzer
CN118746551A (en) A spinning disk line scanning confocal imaging system and method

Legal Events

Date Code Title Description
AS Assignment

Owner name: GENERAL ELECTRIC COMPANY, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KASTEN, ANSAS MATTHIAS;CHALLENER, WILLIAM ALBERT;KARP, JASON HARRIS;AND OTHERS;SIGNING DATES FROM 20181018 TO 20181025;REEL/FRAME:047326/0040

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

AS Assignment

Owner name: GE PRECISION HEALTHCARE LLC, WISCONSIN

Free format text: NUNC PRO TUNC ASSIGNMENT;ASSIGNOR:GENERAL ELECTRIC COMPANY;REEL/FRAME:071225/0218

Effective date: 20250505