WO2024015012A1 - Optical system and method of forming the same, method of forming a multi-color image - Google Patents
Optical system and method of forming the same, method of forming a multi-color image Download PDFInfo
- Publication number
- WO2024015012A1 WO2024015012A1 PCT/SG2022/050485 SG2022050485W WO2024015012A1 WO 2024015012 A1 WO2024015012 A1 WO 2024015012A1 SG 2022050485 W SG2022050485 W SG 2022050485W WO 2024015012 A1 WO2024015012 A1 WO 2024015012A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- metalenses
- color
- optical system
- different
- various embodiments
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
- G02B5/201—Filters in the form of arrays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
- G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B82—NANOTECHNOLOGY
- B82Y—SPECIFIC USES OR APPLICATIONS OF NANOSTRUCTURES; MEASUREMENT OR ANALYSIS OF NANOSTRUCTURES; MANUFACTURE OR TREATMENT OF NANOSTRUCTURES
- B82Y20/00—Nanooptics, e.g. quantum optics or photonic crystals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
Definitions
- Various embodiments of this disclosure may relate to an optical system. Various embodiments of this disclosure may relate to a method of forming an optical system. Various embodiments of this disclosure may relate to a method of forming a multi-color image.
- a refractive lens is usually made of at least one hemispherical surface with a certain radius of curvature leading to a relatively thick device. Its diffractive counterparts, referred to as conventional diffractive lenses (CDL), restrict this phase modulation to its minimum, 2n, which allows to reduce considerably the thickness of the lens to, typically, a maximum thickness slightly larger than the wavelength of the light.
- CDL conventional diffractive lenses
- Diffractive lenses suffer from severe chromatic aberrations due to their diffractive nature, i.e. they only focus a single wavelength (the design wavelength) at the desired position, while the other wavelengths are not focused at the same position: the longer wavelengths are focused closer to the lens, and the shorter ones further away.
- the chromatic aberrations lead to blurred images and rainbow effects.
- This chromatic aberration of CDL where the longer wavelengths are focused closer to the lens, and the shorter ones further away, is different than the usual chromatic aberration of refractive lenses, which is due to the material dispersion (i.e. change of the material refractive index with wavelength).
- FIG. 1 provides an illustration of chromatic aberrations for (a) conventional refractive lenses and (b) diffractive lenses. Wavelengths i > Xz > fa are focused at different places along the optical axis. Refractive lenses exhibit positive dispersion, while diffractive lenses exhibit negative.
- meta-atoms are based on the interaction of light with nanostructures patterned on a flat surface, called meta-atoms, which impart locally a certain phase delay to the light.
- the main mechanisms are wave-guiding, geometrical phase and resonant interaction, and each of these mechanisms has different advantages and limitations.
- the meta-atoms restrict the phase modulation to 2n, and are smaller than the wavelength of interest in all directions (with the possible exception of the direction of light propagation, for which they might also have dimensions around the wavelength).
- metalenses demonstrated that they can outperform diffractive lenses in terms of numerical aperture (NA) and focusing efficiency, making them more promising candidates to replace refractive lenses.
- the optical system may include a plurality of color filters, a first color filter of the plurality of color filters configured to select light of a first wavelength range representing a first color channel, and a second color filter of the plurality of color filters configured to select light of a second wavelength range different from the first wavelength range, the light of the second wavelength range representing a second color channel, such that the plurality of color filters provide different color channels.
- the optical system may also include a plurality of metalenses, each of the plurality of metalenses associated with a respective color channel of the plurality of color channels.
- Each of the plurality of metalenses may have a focal length, the plurality of metalenses having equal focal lengths such that the different color channels are combined on a common focal plane to form a multi-color image.
- Each of the plurality of metalenses may include a plurality of nanostructures and may have a (FOV) field of view of more than 30 degrees.
- Each of the plurality of metalenses may have a desired working spectral bandwidth dependent on an extended depth of focus, a central wavelength of the associated color channel, and the focal length at the central wavelength.
- Various embodiments may relate to a method of forming an optical system.
- the method may include providing a plurality of color filters, a first color filter of the plurality of color filters configured to select light of a first wavelength range representing a first color channel, and a second color filter of the plurality of color filters configured to select light of a second wavelength range different from the first wavelength range, the light of the second wavelength range representing a second color channel, such that the plurality of color filters provide different color channels.
- the method may also include providing a plurality of metalenses, each of the plurality of metalenses associated with a respective color channel of the plurality of color channels.
- Each of the plurality of metalenses has a focal length, the plurality of metalenses having equal focal lengths such that the different color channels are combined on a common focal plane to form a multi-color image.
- Each of the plurality of metalenses may include a plurality of nanostructures and may have a (FOV) field of view of more than 30 degrees.
- Each of the plurality of metalenses may have a desired working spectral bandwidth dependent on an extended depth of focus, a central wavelength of the associated color channel, and the focal length at the central wavelength.
- Various embodiments may provide a method of forming a multi-color image.
- the method may include in providing a broadband light to an optical system.
- the optical system may be any suitable optical system as described herein.
- the optical system may include a plurality of color filters, a first color filter of the plurality of color filters configured to select light of a first wavelength range representing a first color channel, and a second color filter of the plurality of color filters configured to select light of a second wavelength range different from the first wavelength range, the light of the second wavelength range representing a second color channel, such that the plurality of color filters provide different color channels.
- the optical system may also include a plurality of metalenses, each of the plurality of metalenses associated with a respective color channel of the plurality of color channels.
- Each of the plurality of metalenses may have a focal length, the plurality of metalenses having equal focal lengths such that the different color channels are combined on a common focal plane to form the multi-color image.
- Each of the plurality of metalenses may include a plurality of nanostructures and has a field of view of more than 30 degrees.
- Each of the plurality of metalenses may have a desired working spectral bandwidth dependent on an extended depth of focus, a central wavelength of the associated color channel, and the focal length at the central wavelength.
- FIG. 1 provides an illustration of chromatic aberrations for (a) conventional refractive lenses and (b) diffractive lenses, in which i > Xz > fa are focused at different places along the optical axis.
- FIG. 2 is a general illustration of an optical system according to various embodiments.
- FIG. 3 is a general illustration of a method of forming an optical system according to various embodiments.
- FIG. 4 is a general illustration of a method of forming a multi-color image according to various embodiments.
- FIG. 5 A shows a schematic of an optical system according to various embodiments.
- FIG. 5B shows a schematic of another optical system according to various embodiments.
- FIG. 5C shows a schematic of yet another optical system according to various embodiments.
- RGB red-green-blue
- FIG. 6 illustrates possible examples of nanoantennas according to various embodiments.
- FIG. 7 shows an example of a lateral projection of metalenses collection according to various embodiments.
- FIG. 8A is a plot of transmission as a function of duty cycle showing the simulated transmission values (obtained using the finite-difference time-domain (FDTD) method) of the metalenses including the nanopillars according to various embodiments.
- FDTD finite-difference time-domain
- FIG. 8B is a plot of transmission as a function of duty cycle showing the simulated phase values (obtained using the finite-difference time-domain (FDTD) method) of the metalenses including the nanopillars according to various embodiments.
- FDTD finite-difference time-domain
- FIG. 8C shows (above) the optical microscope images and (below) the scanning electron microscopy (SEM) images of the fabricated red (R), green (G) and blue (B) metalenses according to various embodiments.
- MTF modulation transfer function
- MTF modulation transfer function
- MTF modulation transfer function
- FIG. 13 shows (a) the original standard ColorChecker test chart with 24 painted patches; (b) the result of red-green-blue (RGB) imaging by the optical system according to various embodiments for field of view (FOV) of 30° X 20°; and (c) the result of red-green-blue (RGB) imaging by the optical system according to various embodiments for field of view (FOV) of 100° X 67°.
- FIG. 14 shows (a) the color AE for the ColorChecker red-green-blue (RGB) with field of view (FOV) of 30°x 20° according to various embodiments; (b) the color AE for the ColorChecker red-green-blue (RGB) with field of view (FOV) of 100°x 67° according to various embodiments; and (c) the color error (left) and the obtained red-green-blue (RGB) image (right) after the efficiency correction procedure for FOV of 100°x 67° according to various embodiments.
- FIG. 15 shows (a) a plot of efficiency (in percent or %) as a function of angle (in degrees) showing the angular dependence of the focusing efficiency at bandwidths around the central wavelengths (Al) of 10 nm, 20 nm, 30 nm and 40 nm for the red metalens according to various embodiments; (b) a plot of efficiency (in percent or %) as a function of angle (in degrees) showing the angular dependence of the focusing efficiency at bandwidths around the central wavelengths (Al) of 10 nm, 20 nm, 30 nm and 40 nm for the green metalens according to various embodiments; and (c) a plot of efficiency (in percent or %) as a function of angle (in degrees) showing the angular dependence of the focusing efficiency at bandwidths around the central wavelengths (Al) of 10 nm, 20 nm, 30 nm and 40 nm for the blue metalens according to various embodiments.
- FIG. 16 shows (a) an original still image; (b) the results of red-green-blue (RGB) imaging by an optical system with field of view (FOV) of 50°x 35°according to various embodiments; and (c) the results of red-green-blue (RGB) imaging by an optical system with field of view (FOV) of 100°x 67°according to various embodiments.
- FIG. 17 is a table comparing an embodiment with a typical cellphone camera and a conventional diffractive lens.
- Embodiments described in the context of one of the optical systems/methods are analogously valid for the other optical systems/methods.
- embodiments described in the context of a method are analogously valid for an optical system/method, and vice versa.
- the articles “a”, “an” and “the” as used with regard to a feature or element include a reference to one or more of the features or elements.
- the term “about” or “approximately” as applied to a numeric value encompasses the exact value and a reasonable variance.
- the term “and/or” includes any and all combinations of one or more of the associated listed items.
- a so-called achromatic diffractive lens can be used to operate at high diffraction orders and provide the same deflection angle for several discrete harmonic wavelengths.
- advanced numerical optimization can help to increase the focusing efficiency, a recent study demonstrated considerable limitation of the achievable Fresnel number (FN), which translates to a limited numerical aperture (NA) or lens size for a given focal length.
- FN Fresnel number
- NA numerical aperture
- diffractive lenses suffer from parasitic interferences and shadowing effects inherent to their blazed profiles, which, in turn, limits their acceptable angles of incidence, i.e. their FOV.
- the hyperbolic phase profile a common standard for metalens design, produces an almost diffraction limited spot and high-NA when light impinges the metalens at normal incidence, while presenting strong coma and astigmatism aberrations for oblique incidence, which drastically limit their FOV to a-few-degrees angle of incidence.
- quadratic phase profiles alleviate those limits on the FOV making this kind of metalenses a very attractive solution for imaging applications.
- Yet another alternative solution tackles the problem of limited FOV using doublets, introducing, however, a strong complexity in the fabrication.
- FIG. 2 is a general illustration of an optical system according to various embodiments.
- the optical system may include a plurality of color filters 202, a first color filter of the plurality of color filters 202 configured to select light of a first wavelength range representing a first color channel, and a second color filter of the plurality of color filters 202 configured to select light of a second wavelength range different from the first wavelength range, the light of the second wavelength range representing a second color channel, such that the plurality of color filters 202 provide different color channels.
- the optical system may also include a plurality of metalenses 204, each of the plurality of metalenses 204 associated with a respective color channel of the plurality of color channels.
- Each of the plurality of metalenses may have a focal length, the plurality of metalenses 204 having equal focal lengths such that the different color channels are combined on a common focal plane to form a multi-color image.
- Each of the plurality of metalenses 204 may include a plurality of nanostructures and may have a (FOV) field of view of more than 30 degrees.
- Each of the plurality of metalenses 204 may have a desired working spectral bandwidth dependent on an extended depth of focus, a central wavelength of the associated color channel, and the focal length at the central wavelength.
- the plurality of color filters 202 are configured to filter light into different color channels, with each color channel having different range of wavelengths.
- the optical system may also include a plurality of metalenses 204 having equal focal lengths so that the different color channels are able to be focused onto a common focal plane to form a multi-color image.
- FIG. 2 illustrates some of the features of an optical system according to various embodiments, and are not intended to limit the arrangement, orientation, shape, size etc. of the various features.
- the optical system may include one or more detectors defining the common focal plane.
- the plurality of color filters 202 may be internal bandpass filters of the one or more detectors. In other words, each color filter of the plurality of color filters 202 may be part of a respective detector of the one or more detectors. [0036] In various other embodiments, the plurality of color filters 202 may be external to the one or more detectors. In other words, the plurality of color filters 202 may be separate from the one or more detectors.
- the plurality of metalenses 204 may be quadratic metalenses. In other words, the plurality of metalenses 204 may provide a quadratic phase profile.
- each of the plurality of metalenses 204 may include a plurality of nanostructures. The specific arrangement of the plurality of nanostructures in each of the plurality of metalenses may provide a quadratic phase profile.
- Such a quadratic phase profile may intrinsically present a certain depth of focus (DOF), e.g. any value from about 5% to about 10% of the focal length (or focal distance) for red, green and blue (RGB) wavelengths according to various embodiments.
- DOF depth of focus
- the DOF may be any value from about 5 pm to about 7 pm for red, green and blue (RGB) wavelengths.
- the phase profile i.e. the arrangement of nanostructures within each metalens of the plurality of metalenses 204
- the DOF of the plurality of metalenses 204 may be engineered to provide a larger desired working spectral bandwidth.
- the plurality of color filters 202 may be arranged between the plurality of metalenses 204 and the common focal plane, such that each of the plurality of metalenses 204 is configured to direct a broadband light to an associated color filter of the plurality of color filters 202 to generate the respective associated color channel.
- Each metalens of the plurality of metalenses 204 associated with a particular color channel may direct a portion of the broadband light to the associated color filter of the plurality of color filters 202 to generate the respective associated color channel.
- the plurality of metalenses 204 may be arranged between the plurality of color filters 202 and the common focal plane, such that each of the plurality of metalenses 204 is configured to direct the light of the respective associated color channel onto the common focal plane.
- each of the plurality of metalenses 204 may have a Fresnel number, the plurality of metalenses 204 having different Fresnel numbers, such that the plurality of metalenses 204 have equal focal lengths.
- the nanostructures of each of the plurality of metalenses 204 may be arranged in a periodic lattice having a predetermined period.
- Fresnel numbers of different metalenses of the plurality of metalenses 204 may be different due to the different predetermined periods of the different metalenses (of the plurality of metalenses 204).
- the periodic lattice may be a square lattice, a rectangular lattice, a hexagonal lattice, or any other common periodic or quasi-periodic Bravais lattice.
- the optical system may further include a plurality of apertures arranged before the plurality of metalenses 204.
- Each of the plurality of apertures may be associated with a respective metalens of the plurality of metalenses 204.
- the plurality of apertures may together with the plurality of metalenses 204 be arranged such that the plurality of color filters 202 may be arranged between the plurality of metalenses 204 (as well as the plurality of apertures) and the common focal plane.
- the plurality of apertures may be arranged before the plurality of metalenses 204, while the plurality of color filters 202 may be arranged after the plurality of metalenses 204 (and before the common focal plane).
- the plurality of metalenses 204 may be arranged between the plurality of apertures and the plurality of color filters 202.
- the plurality of apertures may together with the plurality of metalenses 204 be arranged such that the plurality of metalenses 204 (as well as the plurality of apertures) is arranged between the plurality of color filters 202 and the common focal plane.
- the plurality of apertures may be arranged before the plurality of metalenses 204 and after the plurality of color filters 202, i.e. between the plurality of color filters 202 and the plurality of metalenses 204.
- the plurality of metalenses 204 may be made of a material having a refractive index equal to or greater than 2.
- the plurality of metalenses 204 may include a suitable dielectric material or a suitable semiconductor material.
- the plurality of metalenses 204 may include silicon, gallium phosphide, hafnium oxide, gallium nitride, titanium dioxide, and silicon nitride , sapphire, diamond, silicon carbide, aluminium nitride, a III-V semiconductor (e.g. gallium arsenide or gallium phosphide), or a II- VI semiconductor (e.g. zinc oxide or magnesium oxide).
- heights or thicknesses of the plurality of metalenses 204 may be equal.
- the optical system may include a substrate.
- the plurality of metalenses 204 may be on the substrate. As the plurality of metalenses are formed on the same planar substrate, the top surfaces of the plurality of metalenses 204 may be of the same height level.
- the substrate may allow light to pass through.
- the plurality of nanostructures may be nanopillars.
- the nanopillars may have an arbitrary cross-section, such as circular, elliptical, rectangular, triangular, polygonal, freeform etc.
- the plurality of nanostructures 204 may be nanoantennas, i.e. able to support one or more optical resonances.
- the plurality of color channels may represent different spectral ranges of electromagnetic light.
- the plurality of color channels may be spectrally adjacent to one another or may be overlapping. In various embodiments, the plurality of color channels may collectively cover a continuous spectrum of wavelengths. In various embodiments, the plurality of color channels may be or may include a red (R) channel, a green (G) channel and a blue (B) channel.
- the bluechannel may have a central wavelength of about 460 nm
- the green channel may have a central wavelength of about 530 nm
- the red channel may have a central wavelength of about 620 nm.
- the bandwidth of each channel may be about 40 nm.
- FIG. 3 is a general illustration of a method of forming an optical system according to various embodiments.
- the method may include, in 302, providing a plurality of color filters, a first color filter of the plurality of color filters configured to select light of a first wavelength range representing a first color channel, and a second color filter of the plurality of color filters configured to select light of a second wavelength range different from the first wavelength range, the light of the second wavelength range representing a second color channel, such that the plurality of color filters provide different color channels.
- the method may also include, in 304, providing a plurality of metalenses, each of the plurality of metalenses associated with a respective color channel of the plurality of color channels.
- Each of the plurality of metalenses has a focal length, the plurality of metalenses having equal focal lengths such that the different color channels are combined on a common focal plane to form a multi-color image.
- Each of the plurality of metalenses may include a plurality of nanostructures and may have a (FOV) field of view of more than 30 degrees.
- Each of the plurality of metalenses may have a desired working spectral bandwidth dependent on an extended depth of focus, a central wavelength of the associated color channel, and the focal length at the central wavelength.
- FIG. 3 seeks to illustrate some of the steps in forming the optical system according to various embodiments, and is not intended to limit the sequences of the various steps.
- step 302 can occur before, after or at the same time as step 304.
- the method may also include forming or providing one or more detectors defining the common focal plane.
- the plurality of color filters may be internal bandpass filters of the one or more detectors. In various other embodiments, the plurality of color filters may be external to the one or more detectors.
- the plurality of color filters may be arranged between the plurality of metalenses and the common focal plane, such that each of the plurality of metalenses is configured to direct a broadband light to an associated color filter of the plurality of color filters to generate the respective associated color channel.
- the plurality of metalenses may be arranged between the plurality of color filters and the common focal plane, such that each of the plurality of metalenses is configured to direct the light of the respective associated color channel onto the common focal plane.
- each of the plurality of metalenses may have a Fresnel number, the plurality of metalenses having different Fresnel numbers, such that the plurality of metalenses have equal focal lengths.
- the nanostructures of each of the plurality of metalenses may be arranged in a periodic lattice having a predetermined period.
- Fresnel numbers of different metalenses of the plurality of metalenses may be different due to the different predetermined periods of the different metalenses (of the plurality of metalenses).
- the periodic lattice may be a square lattice, a rectangular lattice, a hexagonal lattice, or any other common periodic or quasi-periodic Bravais lattice.
- the method may further include providing or forming a plurality of apertures arranged before the plurality of metalenses.
- the plurality of metalenses may be made of a material having a refractive index equal to or greater than 2.
- the plurality of metalenses may include a suitable dielectric material or a suitable semiconductor material.
- the plurality of metalenses may include silicon, gallium phosphide, hafnium oxide, gallium nitride, titanium dioxide, and silicon nitride, sapphire, diamond, silicon carbide, aluminium nitride, a III-V semiconductor (e.g. gallium arsenide or gallium phosphide), or a II- VI semiconductor (e.g. zinc oxide or magnesium oxide).
- the optical system may include a substrate.
- the plurality of metalenses may be on the substrate.
- the substrate may allow light to pass through.
- the plurality of nanostructures may be nanopillars.
- the nanopillars may have an arbitrary cross-section, such as circular, elliptical, rectangular, triangular, polygonal, freeform etc.
- the plurality of nanostructures may be nanoantennas, i.e. able to support one or more optical resonances.
- the plurality of color channels may represent different spectral ranges of electromagnetic light.
- the plurality of color channels may be spectrally adjacent to one another or may be overlapping.
- the plurality of color channels may be or may include a red (R) channel, a green (G) channel and a blue (B) channel.
- FIG. 4 is a general illustration of a method of forming a multi-color image according to various embodiments.
- the method may include in, 402, providing a broadband light to an optical system.
- the optical system may be any suitable optical system as described herein.
- the optical system may include a plurality of color filters, a first color filter of the plurality of color filters configured to select light of a first wavelength range representing a first color channel, and a second color filter of the plurality of color filters configured to select light of a second wavelength range different from the first wavelength range, the light of the second wavelength range representing a second color channel, such that the plurality of color filters provide different color channels.
- the optical system may also include a plurality of metalenses, each of the plurality of metalenses associated with a respective color channel of the plurality of color channels.
- Each of the plurality of metalenses may have a focal length, the plurality of metalenses having equal focal lengths such that the different color channels are combined on a common focal plane to form the multi-color image.
- Each of the plurality of metalenses may include a plurality of nanostructures and has a field of view of more than 30 degrees.
- Each of the plurality of metalenses may have a desired working spectral bandwidth dependent on an extended depth of focus, a central wavelength of the associated color channel, and the focal length at the central wavelength.
- the multi-color image may be detected by one or more detectors defining the common focal plane.
- FIG. 5A shows a schematic of an optical system according to various embodiments.
- the light coming from an object is focused on a pixelated color detector 506 by a collection of wide FOV metalenses 504 fabricated on the same substrate (chip) and having the same thickness.
- metalenses 504 imparting a quadratic phase profile to the incoming light may be used.
- the collection of metalenses 504 may be arranged in onedimensional (ID) or two-dimensional (2D) array of any arbitrary shape. Each metalens in the array may be optimized for operation at a particular color (central wavelength Xc) and a corresponding frequency band with a certain bandwidth (i.e. color channel) that purposely matches the bandwidth of the color filters 502 in the system.
- ID onedimensional
- 2D two-dimensional
- each channel may provide a wide-FOV image with a certain bandwidth.
- corresponding images of each color channel may be formed and finally, the color channels may be merged to produce a multi-color image.
- the color filters 502 may be internal bandpass filters of the detector. The internal bandpass filter may limit the bandwidth of each channel.
- FIG. 5B shows a schematic of another optical system according to various embodiments.
- the light coming from an object may be focused on a pixelated color detector 506 by a collection of metalenses 504 fabricated on the same chip.
- Each channel may produce a wide-FOV image with a certain bandwidth.
- the light may pass through the color filters 502 before reaching the metalenses 504.
- the images may be subsequently merged to produce a final multi-color image.
- external bandpass filters may be utilized.
- the images may have the same magnification. This may be ensured by the same focal length /for all metalenses 504, which may also mean that all images are obtained in the same focal plane, corresponding to the detector plane (plane of the detector 506).
- the depth of focus (DOF) of the quadratic metalenses 504 may have to be adjusted to work within the desired, non-zero bandwidth.
- the focal spot may need to intersect the detector plane and provide a good point spread function (PSF) for all wavelengths in the bandwidth range, which may be achieved by engineering an extended DOF.
- PSF point spread function
- the chromatic shift of the focal distance of a metalens with the wavelength may be provided by where f c represents the focal distance at the central wavelength A c of the range of interest.
- f max ⁇ DOF the maximum acceptable shift for the focal distance corresponds to the DOF
- a DOF of ⁇ 5% - 10% of the focal distance f c may be engineered to cover a bandwidth of ⁇ 40 nm when the central wavelengths are red (R), green (G) or blue (B), which correspond to the bandwidth of typical filters used in commercial color sensors. Relying on this, each channel in the system may have a certain operational bandwidth and may bring multiple-hues into focus.
- the metalenses may form the image focusing light either at different detector locations of the detector 506, as in FIG. 5A, or at the same place, as in FIG. 5C.
- FIG. 5C shows a schematic of yet another optical system according to various embodiments.
- the light coming from an object may be focused on a pixelated color detector 506 by a collection of metalenses 504 fabricated on the same chip.
- the metalenses 506 may form the image focusing light at the same place of the detector 502.
- the wide FOV metalenses may include a collection of nanostructures (often called nanoantennas or meta- atoms in the literature).
- the meta-atoms may be: 1) nanopillars with circular, elliptical, rectangular or polygonal cross-section acting as waveguides; 2) nanofins, rotated in the metalens to exploit the Pancharatnam-Berry phase; 3) resonant nanoantennas, supporting one or more optical resonances, e.g. making up a Huygens metasurface, or any other type of meta-atoms commonly used to map the desired phase profile.
- the nanoantennas may or may not be embedded in a medium.
- FIG. 6 illustrates possible examples of nanoantennas according to various embodiments.
- the material to generate the meta-atoms can include dielectric and semiconductor materials, such as silicon, gallium phosphide (GaP), hafnium oxide, gallium nitride, titanium dioxide, silicon nitride, sapphire, diamond, silicon carbide (SiC), aluminium nitride (AIN) or other group IV, III- V or II- VI semiconductors or other oxides with moderate or high refractive index (typically n > 2) and that is relatively transparent in the wavelength range of interest (k)
- dielectric and semiconductor materials such as silicon, gallium phosphide (GaP), hafnium oxide, gallium nitride, titanium dioxide, silicon nitride, sapphire, diamond, silicon carbide (SiC), aluminium nitride (AIN) or other group IV, III- V or II- VI semiconductors or other oxides with moderate or high refractive index (typically n > 2) and that is relatively transparent in the wavelength range of interest (k
- other materials such as those given above, as well as other meta-atom shapes and heights may be used.
- the meta-atoms may have a height of approximately the same length as the longest wavelength in the longest operating bandwidth or below.
- all the meta-atoms in all the metalenses can have the same height.
- FIG. 7 shows an example of a lateral projection of metalenses collection according to various embodiments.
- the meta-atoms may be designed to act as local waveguides for the incident light. Owing to this, the meta-atoms may introduce a variable phase delay depending on their diameter. Importantly, the circular cross-section may ensure polarization-insensitive operation.
- the meta-atoms may be arranged in a certain periodic lattice, such as a square lattice, a rectangular lattice, a hexagonal lattice or any other suitable two- dimensional lattice.
- ⁇ p ⁇ (r) is the desired phase delay at the meta-atom position, /is the focal length of the lens
- FIGS. 8A - B show the simulated values (obtained using the finite-difference timedomain (FDTD) method) of the transmission and phase values for the nanopillars included in the R, G and B metalenses (depicted as solid line, dashed line and dashed-dotted line respectively), given as a function of the duty cycle, which is the ratio between the nanopillar diameters and the lattice constant.
- FDTD finite-difference timedomain
- FIG. 8C shows (above) the optical microscope images and (below) the scanning electron microscopy (SEM) images of the fabricated red (R), green (G) and blue (B) metalenses according to various embodiments.
- the metalenses may each have a diameter (D) of 200 pm and a focal length (f) of 83 pm.
- the scale bars in the optical microscope images correspond to 20 pm, while the scale bars in the SEM images correspond to 200 nm.
- the point spread function (PSF) and modulation transfer function (MTF) of the metalenses can be measured for different angles of incidence and frequency bandwidths around the central wavelength of each metalens. This can be done using a collimated laser beam, whose angle of incidence (q>) onto the metalens and bandwidth (Al) can be adjusted.
- the scale bars in (d) - (f) correspond to 2 pm.
- FIG. 10 shows the same characteristics measured for the fabricated metalens.
- the scale bars in (d) - (f) correspond to 2 pm.
- MTF modulation transfer function
- the optical system may also include a plurality of filters 1102, a plurality of metalenses 1104 and a detector 1106.
- the simulations corresponding to a hyperbolic phase profile as previously proposed in the literature are also presented.
- the lens NA, diameter and designed wavelength are fixed to 0.5, 200 um and 620 nm, similar to the quadratic phase profile.
- the focal length of the hyperbolic metalens has been changed to 173 um to obtain the same NA as the quadratic metalens. This leads to a difference in demagnification, which can be seen by different sizes of the scale bars.
- the scale bars for the hyperbolic phase profile images is 10 pm, while the scale bars for the quadratic phase profile images is 5 pm.
- the images at different wavelengths for the quadratic phase profile remain virtually unchanged, exhibiting uniform imaging over 40 nm bandwidth.
- the hyperbolic phase profile shows a high-resolution image only at the designed wavelength (620 nm), but a substantial degradation at 600 nm and 640 nm.
- the stability of the MTF (and corresponding image quality) of the optical system may provide more balanced imaging and may reduce color distortions. More complex meta- atoms may be utilized to improve MTF stability via dispersion engineering.
- the nanopillars described here as examples may be simple in terms of the fabrication process.
- Various embodiments may also allow for good colour reproduction.
- the colour reproduction of the optical system may be characterized by a standard ColorChecker test chart with 24 painted patches (often referred as Macbeth chart), as depicted in FIG. 13(a).
- FIG. 13 shows (a) the original standard ColorChecker test chart with 24 painted patches; (b) the result of red-green-blue (RGB) imaging by the optical system according to various embodiments for field of view (FOV) of 30° X 20°; and (c) the result of red-green- blue (RGB) imaging by the optical system according to various embodiments for field of view (FOV) of 100° X 67°.
- FIG. 13(b) - (c) show the images of the individual R, G and B color channels obtained by the R, G and B fabricated metalenses, respectively.
- the R, G and B color channels show raw images obtained by each metalens, while the RGB image is the resulting merged image after post-processing.
- the RGB images may be obtained by a post-processing merging process that includes a simple normalization procedure to account for minimum and maximum intensity values (color balance) in each channel.
- the quality of the color reproduction can be assessed using the CIELAB metric.
- RGB intensity values for both reference and measured images may be converted to luminance (L*), color relation in a red-green (a*) and color relation in a yellow-blue (b*).
- the color error AE is calculated as geometric difference in L*a*b* three-dimensional space (AL*) 2 + (Aa*) 2 + (Ah*) 2 .
- the color error AE is found to be in the range between 5 and 23 varied for different patches for FOV of 30° X 20 (FIG. 14a), and between 5 and 57 for larger FOV of 100° X 67° (FIG. 14b).
- the larger errors found for larger FOV can be associated with the angular dependent focusing efficiency of the metalenses.
- the focusing efficiency can be measured and used as a calibration curve. This procedure may allow reducing the color error (FIG. 14c shows the efficiency corrected RGB image with the corresponding color errors, FIG. 15 presents the measured metalenses focusing efficiency).
- FIG. 15 shows (a) a plot of efficiency (in percent or %) as a function of angle (in degrees) showing the angular dependence of the focusing efficiency at bandwidths around the central wavelengths (AX) of 10 nm, 20 nm, 30 nm and 40 nm for the red metalens according to various embodiments; (b) a plot of efficiency (in percent or %) as a function of angle (in degrees) showing the angular dependence of the focusing efficiency at bandwidths around the central wavelengths (AX) of 10 nm, 20 nm, 30 nm and 40 nm for the green metalens according to various embodiments; and (c) a plot of efficiency (in percent or %) as a function of angle (in degrees) showing the angular dependence of the focusing efficiency at bandwidths around the central wavelengths (AX) of 10 nm, 20 nm, 30 nm and 40 nm for the blue metalens according to various embodiments.
- FIG. 16 shows (a) an original still image; (b) the results of red-green-blue (RGB) imaging by an optical system with field of view (FOV) of 50° X 35°according to various embodiments; and (c) the results of red-green-blue (RGB) imaging by an optical system with field of view (FOV) of 100° X 67°according to various embodiments.
- the red (R), green (G) and blue (B) channels show raw images, produced by each metalens, while the RGB image indicates the results of the fusion of the different channels.
- the images denoted “Wiener filter” indicates that the images are reconstructed by deconvolution.
- FIG. 17 is a table comparing an embodiment with a typical cellphone camera and a conventional diffractive lens. “+” indicates presence of a particular trait while indicates absence of a particular trait.
- Various embodiments may include or provide an array of quadratic metalenses on a single chip and a color detector, each metalens designed to provide wide-FOV focusing of good quality over a certain angular range and realized using dielectric materials.
- the optical system may include additional bandpass color filters and/or apertures in the front focal plane of each metalens.
- Each metalens (color channel) may operate in a certain spectral bandwidth, defined by internal detector or external bandpass color filters.
- Each channel may provide a large FOV image.
- the final multispectral image may be produced by the channels fusion.
- the merging process may include intensity correction, color balance and deconvolution.
- Various embodiments may involve usage of an array of quadratic phase profile metalenses providing wide field-of-view for multispectral and white light imaging.
- Various embodiments may relate to an approach to form the image in the same detector plane with detector filters bandwidths similar to metalenses operation bandwidths.
- Various embodiments may relate to the use of quadratic phase profile lenses having an extended depth of focus, thereby allowing for quality enhancement image processing techniques.
- Various embodiments may have a great commercial potential in a number of applications where a full-color large FOV imaging is needed.
- Various embodiments may have applications in portable cameras, mobile phone cameras, security cameras, compact microscopes for medicine, agriculture and object identification, as well as general drone inspection.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Spectrometry And Color Measurement (AREA)
- Color Television Image Signal Generators (AREA)
- Lenses (AREA)
Abstract
Description
Claims
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/SG2022/050485 WO2024015012A1 (en) | 2022-07-12 | 2022-07-12 | Optical system and method of forming the same, method of forming a multi-color image |
| CN202280099762.4A CN119768715A (en) | 2022-07-12 | 2022-07-12 | Optical system, method for forming optical system, and method for forming multicolor image |
| TW111126918A TW202403396A (en) | 2022-07-12 | 2022-07-18 | Optical system and method of forming the same, method of forming a multi-color image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/SG2022/050485 WO2024015012A1 (en) | 2022-07-12 | 2022-07-12 | Optical system and method of forming the same, method of forming a multi-color image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024015012A1 true WO2024015012A1 (en) | 2024-01-18 |
Family
ID=89537214
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/SG2022/050485 Ceased WO2024015012A1 (en) | 2022-07-12 | 2022-07-12 | Optical system and method of forming the same, method of forming a multi-color image |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN119768715A (en) |
| TW (1) | TW202403396A (en) |
| WO (1) | WO2024015012A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117970636A (en) * | 2024-03-20 | 2024-05-03 | 浙江大学 | Hybrid aperture, large field of view, multi-band superlens imaging system |
| CN119063846A (en) * | 2024-11-06 | 2024-12-03 | 中国科学院长春光学精密机械与物理研究所 | A hyperspectral imaging method using a meta-lens |
| CN119235260A (en) * | 2024-09-29 | 2025-01-03 | 上海交通大学 | A design method for achromatic extended-depth-of-focus endoscopic optical coherence tomography probe |
| WO2025166018A1 (en) * | 2024-01-30 | 2025-08-07 | Massachusetts Institute Of Technology | Ultrawide field-of-view, large depth-of-field metasurface assembly for microendoscopy |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200388642A1 (en) * | 2019-06-06 | 2020-12-10 | Applied Materials, Inc. | Imaging system and method of creating composite images |
| US20210028215A1 (en) * | 2019-07-26 | 2021-01-28 | Metalenz, Inc. | Aperture-Metasurface and Hybrid Refractive-Metasurface Imaging Systems |
| US20210037219A1 (en) * | 2018-01-29 | 2021-02-04 | University Of Washington | Metasurfaces and systems for full-color imaging and methods of imaging |
| US20210044748A1 (en) * | 2019-08-08 | 2021-02-11 | Juejun Hu | Ultra-Wide Field-of-View Flat Optics |
| US20210048342A1 (en) * | 2019-08-14 | 2021-02-18 | Samsung Electronics Co., Ltd. | Spectral imaging apparatus |
| US20210231909A1 (en) * | 2020-01-27 | 2021-07-29 | University Of Washington | Simultaneous focal length control and achromatic computational imaging with quartic metasurfaces |
| US20210325541A1 (en) * | 2020-04-17 | 2021-10-21 | Samsung Electronics Co., Ltd. | Hybrid sensor system and method for providing 3d imaging |
-
2022
- 2022-07-12 WO PCT/SG2022/050485 patent/WO2024015012A1/en not_active Ceased
- 2022-07-12 CN CN202280099762.4A patent/CN119768715A/en active Pending
- 2022-07-18 TW TW111126918A patent/TW202403396A/en unknown
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20210037219A1 (en) * | 2018-01-29 | 2021-02-04 | University Of Washington | Metasurfaces and systems for full-color imaging and methods of imaging |
| US20200388642A1 (en) * | 2019-06-06 | 2020-12-10 | Applied Materials, Inc. | Imaging system and method of creating composite images |
| US20210028215A1 (en) * | 2019-07-26 | 2021-01-28 | Metalenz, Inc. | Aperture-Metasurface and Hybrid Refractive-Metasurface Imaging Systems |
| US20210044748A1 (en) * | 2019-08-08 | 2021-02-11 | Juejun Hu | Ultra-Wide Field-of-View Flat Optics |
| US20210048342A1 (en) * | 2019-08-14 | 2021-02-18 | Samsung Electronics Co., Ltd. | Spectral imaging apparatus |
| US20210231909A1 (en) * | 2020-01-27 | 2021-07-29 | University Of Washington | Simultaneous focal length control and achromatic computational imaging with quartic metasurfaces |
| US20210325541A1 (en) * | 2020-04-17 | 2021-10-21 | Samsung Electronics Co., Ltd. | Hybrid sensor system and method for providing 3d imaging |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2025166018A1 (en) * | 2024-01-30 | 2025-08-07 | Massachusetts Institute Of Technology | Ultrawide field-of-view, large depth-of-field metasurface assembly for microendoscopy |
| CN117970636A (en) * | 2024-03-20 | 2024-05-03 | 浙江大学 | Hybrid aperture, large field of view, multi-band superlens imaging system |
| CN119235260A (en) * | 2024-09-29 | 2025-01-03 | 上海交通大学 | A design method for achromatic extended-depth-of-focus endoscopic optical coherence tomography probe |
| CN119063846A (en) * | 2024-11-06 | 2024-12-03 | 中国科学院长春光学精密机械与物理研究所 | A hyperspectral imaging method using a meta-lens |
Also Published As
| Publication number | Publication date |
|---|---|
| CN119768715A (en) | 2025-04-04 |
| TW202403396A (en) | 2024-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2024015012A1 (en) | Optical system and method of forming the same, method of forming a multi-color image | |
| CN111699415B (en) | Metasurfaces and systems for full color imaging and methods of imaging | |
| US20230062193A1 (en) | Multilayered meta lens and optical apparatus including the same | |
| US11194082B2 (en) | Ultra-compact, aberration corrected, visible chiral spectrometer with meta-lenses | |
| US11747524B2 (en) | Meta lens and optical apparatus including the same | |
| US11079520B2 (en) | Broadband achromatic metalens in the visible spectrum | |
| Arbabi et al. | Miniature optical planar camera based on a wide-angle metasurface doublet corrected for monochromatic aberrations | |
| CN110515215B (en) | Ultrathin optical module and ultrathin display device | |
| US11640040B2 (en) | Simultaneous focal length control and achromatic computational imaging with quartic metasurfaces | |
| CN108873121B (en) | A super apochromatic metasurface composite microlens | |
| Chen et al. | Full-color nanorouter for high-resolution imaging | |
| JP2018511253A (en) | Image sensor with images to create spatially encoded images in a distributed manner | |
| US10200604B2 (en) | Image processing apparatus, image processing program, image processing method, microscopic system | |
| Dong et al. | Achromatic single metalens imaging via deep neural network | |
| CN109716434A (en) | Based on the non-more planar broad band imaging systems of the four-dimension for reentering secondary distortion (NRQD) grating of type and rib | |
| WO2022183094A1 (en) | Optical metalens systems | |
| CN109656006A (en) | A kind of non-focusing all-sky airglow imager of wide spectrum | |
| Baranikov et al. | Large Field‐of‐View and Multi‐Color Imaging with GaP Quadratic Metalenses | |
| Arbabi et al. | An optical metasurface planar camera | |
| Shrestha et al. | Broadband achromatic metasurface lenses | |
| CN109541735B (en) | A design method of a thin-film diffractive element and a thin-film diffractive element | |
| CN116878656A (en) | FP imaging spectrometer and detection method | |
| CN116107085A (en) | Multifunctional achromatic superlens, design method and preparation method | |
| Hasegawa et al. | Development of a Full-Color Metalens for Near-Diffraction-Limited Focusing Performance | |
| CN116625508A (en) | Multi-target hyperspectral detection system based on optical fiber array |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22951298 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 11202500048U Country of ref document: SG |
|
| WWP | Wipo information: published in national office |
Ref document number: 11202500048U Country of ref document: SG |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202280099762.4 Country of ref document: CN |
|
| WWP | Wipo information: published in national office |
Ref document number: 202280099762.4 Country of ref document: CN |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22951298 Country of ref document: EP Kind code of ref document: A1 |