[go: up one dir, main page]

WO2022185720A1 - Dispositif d'imagerie, procédé de fonctionnement de dispositif d'imagerie, et programme - Google Patents

Dispositif d'imagerie, procédé de fonctionnement de dispositif d'imagerie, et programme Download PDF

Info

Publication number
WO2022185720A1
WO2022185720A1 PCT/JP2022/000719 JP2022000719W WO2022185720A1 WO 2022185720 A1 WO2022185720 A1 WO 2022185720A1 JP 2022000719 W JP2022000719 W JP 2022000719W WO 2022185720 A1 WO2022185720 A1 WO 2022185720A1
Authority
WO
WIPO (PCT)
Prior art keywords
modulated light
imaging device
light
imaging
optical element
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/000719
Other languages
English (en)
Japanese (ja)
Inventor
穎 陸
沱 庄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Publication of WO2022185720A1 publication Critical patent/WO2022185720A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/12—Generating the spectrum; Monochromators
    • G01J3/18—Generating the spectrum; Monochromators using diffraction elements, e.g. grating
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G01J3/30—Measuring the intensity of spectral lines directly on the spectrum itself
    • G01J3/36—Investigating two or more bands of a spectrum by separate detectors

Definitions

  • the present disclosure relates to an imaging device, an imaging device operating method, and a program, and more particularly to an imaging device that realizes spectroscopic measurement with a small and lightweight device configuration, an imaging device operating method, and a program.
  • a snapshot-type spectroscopic measurement device equipped with spectral filters arranged in a mosaic pattern has been proposed.
  • the configuration of the optical system including the optical lens requires a certain amount of space, resulting in an increase in the size of the device configuration.
  • Patent Document 1 As a technology for reducing the size and weight of an imaging device, a lensless imaging device composed of a pattern mask and an image sensor has been proposed (see Patent Document 1).
  • the present disclosure has been made in view of such circumstances, and in particular, achieves spectroscopic measurement with a compact and lightweight device configuration.
  • An imaging device and a program are a mask configured with a two-dimensional pattern consisting of transmissive regions and light-shielding regions and generating modulated light by modulating incident light; an optical element that diffracts and separates the modulated light to separate it into modulated light for each wavelength band; and a spectral image for each wavelength band by performing signal processing on the modulated light for each wavelength band.
  • An imaging device including a signal processing unit for restoration, and a program.
  • a method of operating an imaging device includes a mask configured with a two-dimensional pattern consisting of transmissive regions and light-shielding regions and generating modulated light by modulating incident light; and an optical element that diffracts and separates the modulated light to separate the modulated light into each wavelength band, wherein the modulated light for each wavelength band is subjected to signal processing.
  • the operating method of the imaging device includes the step of restoring the spectral image for each wavelength band.
  • modulated light is generated by modulating incident light with a mask configured with a two-dimensional pattern consisting of a transmission region and a light shielding region, and the modulated light generated by the mask is diffracted and separated, the light is split into modulated light for each wavelength band, and signal processing is performed on the modulated light for each wavelength band to restore the spectral image for each wavelength band.
  • FIG. 10 is a diagram showing an example of a spectral intensity analysis result, which is a spectral analysis result of output light of a certain food; It is a figure explaining the prism which is a spectroscopic element. It is a figure explaining the commentary grating
  • FIG. 4 is a diagram illustrating an example of a data cube, which is three-dimensional data in the spatial direction (XY) and the wavelength direction ( ⁇ ) of the object to be measured; It is a figure explaining a point measurement system (spectrometer).
  • FIG. 1 is a side cross-sectional view illustrating a configuration example of a spectroscopic measurement device of the present disclosure
  • FIG. 1 is a bird's-eye view illustrating a configuration example of a spectroscopic measurement device of the present disclosure
  • FIG. 12 is a figure explaining the generation method of the data cube in a signal processing part.
  • PSF point spread function
  • It is a figure explaining the captured image imaged by the image sensor.
  • 12 is a flowchart for explaining spectroscopic measurement processing by the spectroscopic measurement device of FIG. 11; It is a figure explaining the structural example of a general-purpose personal computer.
  • infrared light for example, infrared light (IR: Infrared Radiation), visible light (Visible Light), ultraviolet light (Ultraviolet), etc.
  • visible light visible Light
  • ultraviolet light Ultraviolet
  • Visible Light has a wavelength in the range of about 400 nm to 700 nm.
  • Infrared Radiation IR
  • Ultraviolet is visible light ( It has the characteristic of having a shorter wavelength than Visible Light).
  • the radiated light, reflected light, or transmitted light from an object has different light wavelength components depending on the composition of the object (elements, molecular structure, etc.), and the composition of the object can be analyzed by analyzing these wavelength components. becomes possible.
  • data indicating the quantity for each wavelength is called a wavelength spectrum
  • processing for measuring the wavelength spectrum is called spectroscopic measurement processing.
  • FIG. 2 is a diagram showing an example of spectroscopic measurement of a light-emitting object.
  • Fig. 2 shows, from top to bottom, which wavelengths of light in the visible light wavelength range (approximately 400 nm to 700 nm) are emitted from the sun, electric lights, neon, hydrogen, mercury, and sodium. . Areas with output are shown whitish and areas without output are shown black.
  • FIG. 2 shows the results of spectroscopic measurements of output light from sunlight, electric lights, and various heated substances.
  • the sun, electric light, neon, hydrogen, mercury, sodium, and each of these objects output wavelength light unique to each object.
  • FIG. 3 is a diagram showing an example of a spectral intensity analysis result, which is a spectral analysis result of output light of a predetermined processed food. Two different spectral analysis results were obtained from this food.
  • the observation system of the spectroscopic measurement is equipped with a spectroscopic element (spectroscopic device) to separate the light of each wavelength from the light that enters the camera.
  • a spectroscopic element spectroscopic device
  • a prism shown in FIG. 4 is the most commonly known spectral element.
  • Light incident on the prism that is, light of various wavelengths contained in the incident light is emitted from the prism at an emission angle corresponding to the wavelength of the incident light, the incident angle, and the shape of the prism.
  • An observation system for spectroscopic measurement is provided with a spectroscopic element such as this prism, and has a configuration in which light in units of wavelengths can be individually received by a sensor.
  • a formula showing a change in the traveling direction of light by the prism can be expressed as the following formula (1).
  • ⁇ is the apex angle of the prism
  • ⁇ 1 is the incident angle with respect to the prism entrance surface
  • ⁇ 2 is the exit angle with respect to the prism exit surface
  • ⁇ 1 is the refraction of the prism entrance surface
  • ⁇ 2 is the refraction angle of the prism exit surface
  • ⁇ is the deflection angle (angle between incident light and outgoing light).
  • n is the refractive index of the prism, and the refractive index n depends on the wavelength.
  • ⁇ 1 is the angle of refraction of the incident surface of the prism, and depends on the refractive index n of the prism and the angle of incidence ⁇ 1 with respect to the incident surface of the prism. Therefore, the deflection angle (the angle between the incident light and the emitted light) ⁇ depends on the incident angle ⁇ 1 and the wavelength.
  • ⁇ Diffraction grating (spectral element (2))> Further, as shown in FIG. 5, it is also possible to perform spectroscopy using a diffraction grating that utilizes the properties of light as waves.
  • the exit angle ⁇ of light rays from the diffraction grating can be expressed by the following equation (3).
  • d is the lattice spacing
  • ⁇ is the incident angle
  • ⁇ is the outgoing angle
  • m is the diffraction order.
  • FIG. 6 shows an example of three-dimensional data in the spatial direction (XY) and wavelength direction ( ⁇ ) of the object to be measured, that is, a data cube.
  • a data cube is three-dimensional data consisting of the spatial direction (XY) of the measurement object and the wavelength direction ( ⁇ ). It is data in which the coordinates of each point on the surface of the object to be measured are indicated by XY coordinates, and the intensity ( ⁇ ) of each wavelength light at each coordinate position (x, y) is recorded.
  • the data cube shown in the figure is composed of 8 ⁇ 8 ⁇ 8 cubic data, and one cube is data indicating the light intensity of a specific wavelength ( ⁇ ) at a specific position (x, y).
  • the number of cubes of 8 ⁇ 8 ⁇ 8 is an example, and this number will vary according to the spatial resolution and wavelength resolution of the spectroscopic measurement device.
  • An existing spectroscopic measurement system that acquires three-dimensional data in the spatial direction (XY) and wavelength direction ( ⁇ ) of a measurement target includes (a) a point measurement method (spectrometer), (b) a wavelength scanning method, and (c) It is classified into four types: a spatial scan method and (d) a snapshot method. An outline of each of these methods will be described below.
  • Point measurement method (a) Point measurement method (spectrometer)
  • the point measurement method (spectrometer) will be described with reference to FIG.
  • a prism which is a spectroscopic element
  • a linear sensor in which the element is arranged only in one direction. It is a configuration that projects the With this configuration, different wavelengths of light are recorded on different elements (pixels) on the linear sensor.
  • the wavelength resolution depends on the element size (number of pixels) of the linear sensor. That is.
  • This spatial scanning method can achieve high spatial resolution and wavelength resolution, but it requires a large-scale device for scanning, and the scanning processing time is required, which increases the measurement time.
  • the data cube described with reference to FIG. 6, that is, the spatial direction (XY) and wavelength direction ( ⁇ ) of the measurement object as shown in FIG. 3D data cube can be obtained.
  • the sensor area sensor
  • the information in the wavelength direction is recorded overlapping on the sensor surface
  • the parameters required for signal processing are linked to the configuration and performance of the optical system of the spectroscopic measurement device, the conventional configuration had to be used with the optical system fixed. and spatial resolution is difficult to adjust.
  • a configuration has also been proposed in which a data cube is obtained by spatially arranging optical filters having different transmission bands on the sensor.
  • the sensor area is finite, and the optical filter must be mounted on the sensor, and the mounting of the optical filter reduces the spatial resolution of the sensor.
  • the (d) snapshot method described with reference to FIG. 10 has high utility value because it is possible to acquire a data cube by taking only one image.
  • a spectroscopic measurement device with high spatial resolution and high wavelength resolution is realized in a small size and light weight.
  • the spectroscopic measurement device 101 in FIGS. 11 and 12 has a configuration that applies the characteristics of the device configuration employed in the lensless imaging device. More specifically, the spectroscopic measurement apparatus 101 performs signal processing on an imaging block 111 that captures an image based on light from an imaging target as a captured image, and on the captured image captured by the imaging block 111 to obtain a plurality of A signal processing unit 112 is provided to restore spectral images of wavelength bands as a stacked data cube.
  • FIG. 11 is a side cross-sectional view of the imaging block 111 of the spectroscopic measurement device 101
  • FIG. 12 is a bird's-eye view of the imaging block 111.
  • the imaging block 111 is composed of a mask 121, an optical element 122 with a diffraction action, and an image sensor 123 in order from the light incident direction, which is the left part of FIG. 11 and the upper part of FIG.
  • the mask 121 is made of a light-shielding material and has a pattern of openings and light-shielding portions formed at a predetermined pitch. , passes through the optical element 122 .
  • the pattern of the opening and the light shielding part may be any pattern that is generally used in lensless cameras. For example, it may be a random pattern, a Uniformly Redundant Array (URA) pattern, or a Modified Uniformly Redundant Array (MURA) pattern. .
  • the optical element 122 consists of a prism or a DOE (Diffractive Optical Element), which decomposes the modulated light by changing the direction of transmission for each wavelength, and produces an image with a different amount of deviation for each wavelength. It is diffracted so that it is incident on the sensor 123 .
  • DOE diffractive Optical Element
  • the image sensor 123 is composed of a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. is captured as a captured image and output to the signal processing unit 112 .
  • CMOS Complementary Metal Oxide Semiconductor
  • CCD Charge Coupled Device
  • the signal processing unit 112 decomposes and configures the captured image supplied from the image sensor 123 into captured images for each wavelength by performing binary matrix arithmetic processing for each wavelength.
  • An image for each wavelength that is, a spectral image is restored by performing arithmetic processing using the decoding matrix, and a data cube, which is the result of spectroscopic measurement, is generated based on the spectral image restored for each wavelength.
  • the optical element 122 uses a DOE that diffracts incident light in two directions for each wavelength.
  • optical elements 122 have one diffraction direction, but it has been experimentally confirmed that two or more diffraction directions are necessary to obtain a data cube, which is the result of spectroscopic measurement. ing. Therefore, the optical element 122 must have two or more diffraction directions. However, here, the case where there are two diffraction directions will be described.
  • a scene consisting of incident light incident on the mask 121 is a data cube f with a spatial resolution of x ⁇ y and a spectral resolution of n bands.
  • the spectral data cube we want to restore is f
  • the mask 121 is, for example, a matrix m composed of random patterns containing only binary values of 0 and 1 of size mx ⁇ my
  • incident light passes through the mask 121 in a wavelength band It can be considered that the convolution calculation of the matrix m is performed on the spectroscopic image fi incident on the mask 121 every time.
  • each wavelength of light is modulated to generate modulated light.
  • An image Di represented by a PSF point spread function
  • PSF point spread function
  • the image Di is such that only the pixels observed on the image sensor 123 as shown by the black dots in FIG. , and the pixel values of other pixels are 0.
  • the optical element 122 diffracts light in two directions, the pixels indicated by black dots appear at two locations at approximately the same distance ri in the X direction from the central position in the X direction.
  • the position of the black point in the image Di corresponding to different wavelength bands varies depending on the wavelength, the distance ri from the center position in the X direction.
  • the position of the black point in the Y direction is roughly around the center of the image.
  • the spectral modulation information Mi of each wavelength band i corresponds to the image Di corresponding to the PSF. It is imaged as a captured image g formed by being superimposed.
  • the signal obtained by the image sensor 123 receiving the modulated light transmitted through the optical element 122 that diffracts the light of each wavelength band in two directions according to the wavelength, that is, the captured image g captured by the image sensor 123 is , is expressed by the following equation (4).
  • Hi is a two-dimensional image that is the result of a convolution operation between the matrix m of the mask 121 and the image Di corresponding to the PSF (point spread function) of the wavelength band i.
  • Equation (4) is transformed into Equation (5) below by expanding the matrix into one dimension and transforming it into a vector.
  • the vector V(g) in Equation (5) is obtained by expanding g in Equation (4) into a one-dimensional vector.
  • Vector V(fi) is the result of one-dimensional expansion of two-dimensional image fi.
  • two-dimensional image Hi is transformed into matrix M(Hi) according to the value of vector V(fi)
  • the convolution operation Hi*fi coincides with the matrix multiplication M(Hi)V(fi).
  • V(g) Q ⁇ F ... (6)
  • Equation (6) Q is a matrix in which each M(Hi) is arranged in the horizontal direction as shown in Equation (7) below, and F is a matrix as shown in Equation (8) below. , and each vector V(fi) is a vertically arranged vector.
  • Equation (6) is a matrix obtained from the known mask 121 and the known PSF (point spread function) image Di. Therefore, matrix Q is also a known matrix.
  • equation (6) is a linear equation
  • vector F can be obtained by computing equation (9) below.
  • Equation (9) is the inverse matrix of matrix Q.
  • a spectral data cube is obtained by transforming the vector F obtained by calculating the equation (9) into the format of the spectral data cube (x ⁇ y ⁇ n), and for each wavelength band i as a result of spectral measurement
  • the spectroscopic image fi can be reconstructed.
  • Equation (9) is also referred to as a spectral restoration equation.
  • the matrix Q becomes full rank
  • the spatial resolution of the spectral image (spectral data cube) fi is x ⁇ y
  • the spatial resolution of the mask 121 is mx ⁇ my
  • the spatial resolution Mx ⁇ My of the spectral modulation information Mi obtained by modulating the incident light by the mask 121 is (mx+x ⁇ 1) ⁇ (my+y ⁇ 1).
  • the optical element 122 described above diffracts the modulated light in two directions, left and right in the x direction (two directions, up and down in the drawing).
  • the distance is d
  • the spatial resolution of the captured image captured by the image sensor 123 is X ⁇ Y
  • the modulated light diffracted in two directions by the optical element 122 does not overlap on the image sensor 123, and there is no gap. is incident on the image sensor 123 at .
  • the optical element 122 has a minimum diffraction angle ⁇ min so that the modulated light beams diffracted in two directions do not overlap on the image sensor 123, and all the modulated light beams emitted from the optical element 122 are directed onto the image sensor 123.
  • a maximum diffraction angle smaller than ⁇ max is selected so that light can be received at .
  • the signal processing unit 112 includes an image acquisition unit 141, a spectral restoration unit 142, a memory 143, and a signal transformation unit 144.
  • the image acquisition unit 141 acquires the captured image g captured by the image sensor 123 and outputs it to the spectral restoration unit 142 .
  • the spectral restoration unit 142 vectorizes the captured image g and transforms it into the vector V(g) described above. Further, the spectral reconstruction unit 142 reads out the inverse matrix Q ⁇ 1 of the matrix Q stored in advance in the memory 143, forms the spectral reconstruction equation of the above equation (9), and obtains the vector F by calculation. , to the signal transformation unit 144 .
  • the signal transforming unit 144 transforms the vector F by the transforming method described above, transforms it into the spectroscopic data cube format (x ⁇ y ⁇ n), restores the spectroscopic data cube, and outputs it as a spectroscopic measurement result.
  • the spectral data cube is a stack of n spectral images fi with a spatial resolution of x ⁇ y for each wavelength band i, which is the number of wavelength bands. Therefore, it can be considered that n spectral images fi for each wavelength band i are restored by obtaining the vector F in the spectral restoration unit 142 . Therefore, for example, it may be made to function as a spectral imaging device by extracting and outputting spectral images of a specific wavelength band or all wavelength bands.
  • step S31 the mask 121 modulates the incident light and causes it to enter the optical element 122 as modulated light.
  • step S ⁇ b>32 the optical element 122 diffracts the modulated light at angles for each wavelength band and makes it enter the image sensor 123 .
  • step S33 the image sensor 123 detects the light of each wavelength band in which the modulated light is diffracted at the angle of each wavelength band, that is, the spectral modulation information Mi of each wavelength band i is shifted according to the wavelength. , an image of the laminated state is captured as a captured image g and output to the signal processing unit 112 .
  • step S ⁇ b>34 the image acquisition unit 141 acquires the captured image g captured by the image sensor 123 and outputs it to the spectral restoration unit 142 .
  • step S ⁇ b>35 the spectral restoration unit 142 reads the inverse matrix Q ⁇ 1 prestored in the memory 143 .
  • step S36 the spectral restoration unit 142 vectorizes the captured image g and transforms it into the vector V(g) described above.
  • step S37 the spectral reconstruction unit 142 uses the inverse matrix Q ⁇ 1 and the vector V(g) to form the spectral reconstruction equation of Equation (9) described above, and obtains the vector F by computation, Output to the signal transformation unit 144 .
  • step S38 the signal transformation unit 144 transforms the vector F using the transformation method described above, transforms it into the format of the spectral data cube (x ⁇ y ⁇ n) to restore the spectral data cube, and outputs it as the spectral measurement result. do.
  • the series of processes described above can be executed by hardware, but can also be executed by software.
  • the programs that make up the software are installed in a computer built into dedicated hardware, or various programs are installed to execute various functions. installed from a recording medium on, for example, a general-purpose computer.
  • FIG. 18 shows a configuration example of a general-purpose computer.
  • This personal computer incorporates a CPU (Central Processing Unit) 1001 .
  • An input/output interface 1005 is connected to the CPU 1001 via a bus 1004 .
  • a ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 are connected to the bus 1004 .
  • the input/output interface 1005 includes an input unit 1006 including input devices such as a keyboard and a mouse for the user to input operation commands, an output unit 1007 for outputting a processing operation screen and images of processing results to a display device, and programs and various data.
  • LAN Local Area Network
  • magnetic discs including flexible discs
  • optical discs including CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc)), magneto-optical discs (including MD (Mini Disc)), or semiconductors
  • a drive 1010 that reads and writes data from a removable storage medium 1011 such as a memory is connected.
  • the CPU 1001 reads a program stored in the ROM 1002 or a removable storage medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, installs the program in the storage unit 1008, and loads the RAM 1003 from the storage unit 1008. Various processes are executed according to the program.
  • the RAM 1003 also appropriately stores data necessary for the CPU 1001 to execute various processes.
  • the CPU 1001 loads, for example, a program stored in the storage unit 1008 into the RAM 1003 via the input/output interface 1005 and the bus 1004, and executes the above-described series of programs. is processed.
  • a program executed by the computer (CPU 1001) can be provided by being recorded on a removable storage medium 1011 such as a package medium, for example. Also, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
  • the program can be installed in the storage section 1008 via the input/output interface 1005 by loading the removable storage medium 1011 into the drive 1010 . Also, the program can be received by the communication unit 1009 and installed in the storage unit 1008 via a wired or wireless transmission medium. In addition, programs can be installed in the ROM 1002 and the storage unit 1008 in advance.
  • the program executed by the computer may be a program that is processed in chronological order according to the order described in this specification, or may be executed in parallel or at a necessary timing such as when a call is made. It may be a program in which processing is performed.
  • a system means a set of multiple components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device housing a plurality of modules in one housing, are both systems. .
  • the present disclosure can take the configuration of cloud computing in which a single function is shared by multiple devices via a network and processed jointly.
  • each step described in the flowchart above can be executed by a single device, or can be shared by a plurality of devices.
  • one step includes multiple processes
  • the multiple processes included in the one step can be executed by one device or shared by multiple devices.
  • a mask configured with a two-dimensional pattern consisting of a transmission region and a light shielding region and generating modulated light by modulating incident light; an optical element that diffracts and separates the modulated light generated by the mask into modulated light for each wavelength band; and a signal processing unit that restores the spectral image for each wavelength band by subjecting the modulated light for each wavelength band to signal processing.
  • ⁇ 2> further comprising an imaging device that captures, as spectral modulation information, information possessed by the modulated light for each wavelength band that has been dispersed by the optical device;
  • the signal processing unit restores the spectral image for each wavelength band by performing signal processing on the spectral modulation information, which is information possessed by the modulated light for each wavelength band, captured by the imaging element.
  • ⁇ 3> The imaging device according to ⁇ 2>, wherein the optical element diffracts the modulated light at different angles according to wavelengths.
  • ⁇ 4> The imaging device according to ⁇ 3>, wherein the optical element diffracts the modulated light in at least two directions at different angles according to the wavelength.
  • ⁇ 5> The imaging device according to ⁇ 3>, wherein the optical element diffracts the modulated light at different angles according to the wavelength, and makes all the diffracted modulated light incident on the imaging element.
  • a maximum diffraction angle is set as a maximum value of an angle at which the modulated light is diffracted so that all the diffracted modulated light is incident on the imaging element ⁇ 5>
  • the imaging device according to . ⁇ 7> The maximum diffraction angle according to ⁇ 6>, which is set according to the spatial resolution of the spectral modulation information, the spatial resolution of the image captured by the imaging device, and the distance between the optical device and the imaging device. Imaging device.
  • Mx be the spatial resolution in the diffraction direction of the spectral modulation information
  • X be the spatial resolution of the image captured by the imaging element
  • d be the distance between the optical element and the imaging element
  • the maximum diffraction angle is ⁇ max
  • ⁇ 9> The imaging apparatus according to ⁇ 3>, wherein the optical element diffracts the modulated light so that the modulated light does not overlap on the imaging element.
  • ⁇ 10> The imaging device according to ⁇ 9>, wherein the optical element has a minimum diffraction angle as a minimum value of an angle at which the modulated light is diffracted so that the modulated light does not overlap on the imaging element. . ⁇ 11> The imaging apparatus according to ⁇ 10>, wherein the minimum diffraction angle is set according to the spatial resolution of the image captured by the imaging element and the distance between the optical element and the imaging element.
  • the signal processing unit restores the spectral image for each of the plurality of wavelength bands by performing matrix operation processing on the two-dimensional signal forming the spectral modulation information.
  • the imaging device according to any one of the above. ⁇ 15> The imaging according to ⁇ 14>, wherein the signal processing unit converts the two-dimensional signal into a vector format and performs the matrix operation processing to restore the spectral image for each of the plurality of wavelength bands.
  • the signal processing unit converts the restored spectral images for each of the plurality of wavelength bands into a data cube format and outputs the data cube format.
  • ⁇ 17> The imaging device according to any one of ⁇ 1> to ⁇ 16>, wherein the two-dimensional pattern of the mask is a random pattern, a Uniformly Redundant Array (URA) pattern, or a Modified Uniformly Redundant Array (MURA) pattern.
  • UUA Uniformly Redundant Array
  • MURA Modified Uniformly Redundant Array
  • a mask configured with a two-dimensional pattern consisting of a transmission area and a light shielding area and generating modulated light by modulating incident light;
  • a method of operating an imaging device comprising an optical element that diffracts and separates the modulated light generated by the mask to separate the modulated light into each wavelength band,
  • a method of operating an imaging device comprising: restoring a spectral image for each wavelength band by subjecting modulated light for each wavelength band to signal processing.
  • a mask configured with a two-dimensional pattern consisting of a transmissive region and a light shielding region and generating modulated light by modulating incident light;
  • a computer that controls an imaging device comprising an optical element that diffracts and separates the modulated light generated by the mask to separate the modulated light into each wavelength band,
  • a program that functions as a signal processing unit that restores a spectral image for each wavelength band by applying signal processing to the modulated light for each wavelength band.
  • 101 spectroscopic measurement device 111 imaging block, 112 signal processing unit, 121 mask, 122 optical element, 123 image sensor, 141 image acquisition unit, 142 spectral restoration unit, 143 memory, 144 signal transformation unit

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectrometry And Color Measurement (AREA)

Abstract

La présente divulgation concerne un dispositif d'imagerie, un procédé de fonctionnement de dispositif d'imagerie et un programme au moyen desquels une mesure spectroscopique de haute précision peut être obtenue. La lumière modulée est générée par modulation de la lumière incidente avec un masque formé à partir d'un motif bidimensionnel composé d'une région de transmission et d'une région bloquant la lumière, la lumière modulée générée par le masque est diffractée et séparée pour diviser ainsi spectralement la lumière en lumière modulée pour chaque bande de longueur d'onde, et un traitement de signal est effectué sur la lumière modulée pour chaque bande de longueur d'onde, ce qui permet de restaurer une image spectrale pour chaque bande de longueur d'onde. La présente divulgation peut être appliquée à un dispositif de mesure spectroscopique.
PCT/JP2022/000719 2021-03-02 2022-01-12 Dispositif d'imagerie, procédé de fonctionnement de dispositif d'imagerie, et programme Ceased WO2022185720A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021-032444 2021-03-02
JP2021032444 2021-03-02

Publications (1)

Publication Number Publication Date
WO2022185720A1 true WO2022185720A1 (fr) 2022-09-09

Family

ID=83153949

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/000719 Ceased WO2022185720A1 (fr) 2021-03-02 2022-01-12 Dispositif d'imagerie, procédé de fonctionnement de dispositif d'imagerie, et programme

Country Status (1)

Country Link
WO (1) WO2022185720A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008545974A (ja) * 2005-06-06 2008-12-18 デューク ユニヴァーシティー オーバーラップした画像を用いる光学分光法
JP2013115745A (ja) * 2011-11-30 2013-06-10 Sumitomo Electric Ind Ltd 対象検出装置および対象検出方法
CN104316179A (zh) * 2014-08-27 2015-01-28 北京空间机电研究所 一种光谱压缩的超光谱成像系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008545974A (ja) * 2005-06-06 2008-12-18 デューク ユニヴァーシティー オーバーラップした画像を用いる光学分光法
JP2013115745A (ja) * 2011-11-30 2013-06-10 Sumitomo Electric Ind Ltd 対象検出装置および対象検出方法
CN104316179A (zh) * 2014-08-27 2015-01-28 北京空间机电研究所 一种光谱压缩的超光谱成像系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CULL E. C., GEHM M. E., BRADY D. J., HSIEH C. R., MOMTAHAN O., ADIBI A.: "Dispersion multiplexing with broadband filtering for miniature spectrometers", APPLIED OPTICS, OPTICAL SOCIETY OF AMERICA, WASHINGTON, DC, US, vol. 46, no. 3, 20 January 2007 (2007-01-20), US , pages 365 - 374, XP055963444, ISSN: 0003-6935, DOI: 10.1364/AO.46.000365 *

Similar Documents

Publication Publication Date Title
US12052518B2 (en) Multi-modal computational imaging via metasurfaces
US9927300B2 (en) Snapshot spectral imaging based on digital cameras
Liang Punching holes in light: recent progress in single-shot coded-aperture optical imaging
Cao et al. A prism-mask system for multispectral video acquisition
US9459148B2 (en) Snapshot spectral imaging based on digital cameras
US8351031B2 (en) Single-shot spectral imager
JP7246093B2 (ja) 波面センサおよびその使用方法
JP2022002398A (ja) 撮像装置および分光システム
EP3700197B1 (fr) Dispositif et procédé d'imagerie, et dispositif et procédé de traitement d'image
CN104121990A (zh) 基于随机光栅的压缩感知宽波段高光谱成像系统
WO2007087372A2 (fr) Modulation d'image spatiale permettant d'améliorer les performances d'un spectromètre d'imagerie par tomodensitométrie
US11079273B2 (en) Coded aperture spectral imaging device
CN114279564B (zh) 一种并行压缩感知计算层析成像光谱仪及其成像光谱重建方法
CN114264370A (zh) 一种压缩感知计算层析成像光谱仪系统和成像方法
US11199448B2 (en) Spectroscopic measurement device and spectroscopic measurement method
JP7582183B2 (ja) 回折素子の製造方法及び撮像装置の製造方法
WO2022185720A1 (fr) Dispositif d'imagerie, procédé de fonctionnement de dispositif d'imagerie, et programme
JP6984736B2 (ja) 撮像装置及び撮像方法
US20240110863A1 (en) Information processing device, information processing method, and program
CN120008735A (zh) 一种基于fpga的高光谱成像方法与系统
CN119803663A (zh) 小型机载设备中编码孔径快照式高光谱成像感知建模方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22762779

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22762779

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP