CN110736539A - gaze type spectral imaging system based on compressed sensing - Google Patents
gaze type spectral imaging system based on compressed sensing Download PDFInfo
- Publication number
- CN110736539A CN110736539A CN201910841873.8A CN201910841873A CN110736539A CN 110736539 A CN110736539 A CN 110736539A CN 201910841873 A CN201910841873 A CN 201910841873A CN 110736539 A CN110736539 A CN 110736539A
- Authority
- CN
- China
- Prior art keywords
- imaging
- mirror
- template
- encoding
- coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000701 chemical imaging Methods 0.000 title claims abstract description 54
- 238000003384 imaging method Methods 0.000 claims abstract description 114
- 230000003595 spectral effect Effects 0.000 claims abstract description 53
- 239000006185 dispersion Substances 0.000 claims abstract description 33
- 238000012545 processing Methods 0.000 claims abstract description 17
- 239000004973 liquid crystal related substance Substances 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 abstract description 7
- 238000005516 engineering process Methods 0.000 description 24
- 238000000034 method Methods 0.000 description 7
- 238000001228 spectrum Methods 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 238000013144 data compression Methods 0.000 description 4
- 238000013500 data storage Methods 0.000 description 4
- 238000007906 compression Methods 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 230000006835 compression Effects 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012634 optical imaging Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000012271 agricultural production Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
- G01J3/0208—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
- G01J2003/2826—Multispectral imaging, e.g. filter imaging
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
本发明提供一种基于压缩感知的凝视型光谱成像系统,解决现有成像系统数据传输成本增加、信噪比较低,以及系统体积大、成本高、成像质量差的问题。该系统包括沿光束方向依次设的第一成像镜、分光单元、第一编码模板、合光单元、第二编码模板、成像镜组、单元探测器及数据处理单元;第一成像镜用于将目标成像;分光单元包括第一准直镜、第一色散元件、第二成像镜;第一编码模板用于对第二成像镜成像后的图像信息进行光谱维编码;合光单元包括第二准直镜、第二色散元件、第三成像镜;第二编码模板用于对第三成像镜成像后的图像信息进行空间微编码;成像镜组用于将编码后的图像压缩至单元探测器焦平面上,数据处理单元用于对目标信息复原。
The invention provides a gaze-type spectral imaging system based on compressed sensing, which solves the problems of increased data transmission cost, low signal-to-noise ratio, large system volume, high cost and poor imaging quality of the existing imaging system. The system includes a first imaging mirror, a light splitting unit, a first encoding template, a light combining unit, a second encoding template, an imaging mirror group, a unit detector and a data processing unit arranged in sequence along the beam direction; the first imaging mirror is used to target imaging; the light splitting unit includes a first collimating mirror, a first dispersion element, and a second imaging mirror; the first encoding template is used to perform spectral dimension encoding on the image information imaged by the second imaging mirror; the light combining unit includes a second collimating mirror A straight mirror, a second dispersive element, and a third imaging mirror; the second encoding template is used to perform spatial micro-coding on the image information imaged by the third imaging mirror; the imaging mirror group is used to compress the encoded image to the unit detector focus On the plane, the data processing unit is used to restore the target information.
Description
技术领域technical field
本发明涉及光谱成像技术,具体涉及一种基于压缩感知的凝视型光谱成像系统。The invention relates to spectral imaging technology, in particular to a gaze-type spectral imaging system based on compressed sensing.
背景技术Background technique
高/多光谱成像技术能够获取目标的图像信息和光谱信息,获得目标的表面结构和光谱特性信息,被广泛应用于航空航天遥感、农林牧渔普查、地质环境监测、气象监测和预报、天文观测、化学成分监测等诸多领域,在军事、工业和农业生产中具有不可或缺的应用价值。随着光谱成像技术的发展,其应用波段从可见光、近红外不断的向中长波红外、太赫兹波段扩展。Hyper/multi-spectral imaging technology can obtain the image information and spectral information of the target, and obtain the surface structure and spectral characteristic information of the target. , chemical composition monitoring and many other fields, it has indispensable application value in military, industrial and agricultural production. With the development of spectral imaging technology, its application bands have been continuously expanded from visible light and near-infrared to mid- and long-wave infrared and terahertz bands.
传统的单通道光谱成像技术信噪比较低,相比于传统光学成像,光谱成像仪可以获得目标的三维数据立方体,N个谱段的数据立方体的数据量扩大了N倍,极大的数据量会带来数据存储问题,对于传输信息的信号所需的带宽容限特性要求水涨船高,不仅仅如此,由于数据量扩大,采集传输信号所需时间增加,则采集速度也相应增大,使得数据传输的成本增高、对硬件要求提高,否则严重影响数据处理时间,影响工作效益。对于机载和星载设备,也会带来信息获取和传输受限的问题,导致无法实时获取探测及侦查数据;同时,要获得高空间分辨率和高光谱分辨率的图谱信息,往往需要较大规格的探测器,则所需成本较高;而在太赫兹和中长波红外波段,大规格探测器的工艺不成熟、价格昂贵、性能难以保证,并且由于中波红外及太赫兹成像半导体技术发展相对缓慢,因此需要转变大面阵探测的思路。压缩感知概念的提出使得单像素成像成为可能。压缩感知(Compressive Sensing,CS)又称压缩采样,是由E.Candès,J.Romberg,T.Tao和Donoho等人于近年提出的一个全新的数学理论,它通过对信号的冗余性进行充分的挖掘,对原始信号进行一个线性、非自适应的全局观测得到少量的观测信号,再通过重构算法精确重构原始信号。2006年在美国莱斯大学单像素相机也随着压缩感知理论的完善成功问世,该设备的工作原理其实就是压缩感知理论在光学成像上的基本应用,相对于传统成像一一对应的方式来说,通过增加一些具备整体场景信息的像素块对应的光强值大小来获取图片信息。参考Rice大学的研究成果。2008年,成功实现太赫兹单像素成像。2011年,Correia M课题组成功研究出动态照明的单像素相机,2013年,B.Sun等人成功研制出具有3D成像功能的单像素相机。2016年,Yiwei Zhang等人设计出单像素3D视频成像装置;2017年Chi H等人利用频谱仪实现了单像素光谱成像;Zhang Z等人提出一种基于傅里叶变换的调制模式实现单像素成像。The traditional single-channel spectral imaging technology has a low signal-to-noise ratio. Compared with traditional optical imaging, the spectral imager can obtain a three-dimensional data cube of the target. The amount of data will bring about data storage problems, and the bandwidth tolerance characteristics required for the signal to transmit information will increase with water. The cost of transmission increases and the hardware requirements increase, otherwise the data processing time will be seriously affected and the work efficiency will be affected. For airborne and spaceborne equipment, there will also be problems of limited information acquisition and transmission, resulting in the inability to obtain detection and reconnaissance data in real time; Large-scale detectors require higher costs; while in the terahertz and mid- and long-wave infrared bands, the technology of large-scale detectors is immature, expensive, and difficult to guarantee performance, and due to the mid-wave infrared and terahertz imaging semiconductor technology The development is relatively slow, so it is necessary to change the thinking of large area array detection. The concept of compressed sensing makes single-pixel imaging possible. Compressive Sensing (CS), also known as compressed sampling, is a new mathematical theory proposed by E. Candès, J. Romberg, T. Tao and Donoho in recent years. A linear, non-adaptive global observation is performed on the original signal to obtain a small amount of observation signal, and then the original signal is accurately reconstructed by a reconstruction algorithm. In 2006, the single-pixel camera at Rice University in the United States was also successfully introduced with the improvement of compressed sensing theory. The working principle of this device is actually the basic application of compressed sensing theory in optical imaging. Compared with the traditional imaging method of one-to-one correspondence , and obtain picture information by increasing the light intensity values corresponding to some pixel blocks with overall scene information. Refer to the research results of Rice University. In 2008, terahertz single-pixel imaging was successfully achieved. In 2011, Correia M's research group successfully developed a single-pixel camera with dynamic illumination. In 2013, B.Sun et al. successfully developed a single-pixel camera with 3D imaging function. In 2016, Yiwei Zhang et al. designed a single-pixel 3D video imaging device; in 2017, Chi H et al. used a spectrometer to achieve single-pixel spectral imaging; Zhang Z et al. proposed a modulation mode based on Fourier transform to achieve single-pixel imaging. imaging.
综上所述,目前对于单像素成像的研究主要集中于传统的全色成像,部分研究将其拓展至3D成像和光谱成像,但这些成像过程都需采用扫描的方式获取目标的三维信息,该扫描过程需要电机、控制装置及运动部件,增加了系统整体的体积重量和成本,同时降低系统可靠性和成像质量。To sum up, the current research on single-pixel imaging mainly focuses on traditional panchromatic imaging, and some studies extend it to 3D imaging and spectral imaging, but these imaging processes all need to use scanning to obtain the three-dimensional information of the target. The scanning process requires motors, control devices and moving parts, which increases the overall volume, weight and cost of the system, while reducing system reliability and imaging quality.
发明内容SUMMARY OF THE INVENTION
为了解决现有成像系统获取数据量增加导致数据传输成本增加、信噪比较低,以及现有单像素成像的扫描方式导致系统体积大、成本高、成像质量差的技术问题,本发明提供了一种基于压缩感知的凝视型光谱成像系统。In order to solve the technical problems of increased data transmission cost and low signal-to-noise ratio caused by the increase in the amount of data acquired by the existing imaging system, and the existing single-pixel imaging scanning method caused the system to be large in size, high in cost, and poor in imaging quality, the present invention provides A gaze-based spectral imaging system based on compressed sensing.
为实现上述目的,本发明提供的技术方案是:For achieving the above object, the technical scheme provided by the present invention is:
一种基于压缩感知的凝视型光谱成像系统,其特殊之处在于:包括沿光束方向依次设置的第一成像镜、分光单元、第一编码模板、合光单元、第二编码模板、成像镜组、单元探测器及数据处理单元;所述第一成像镜用于将目标成像于一次像面位置;所述分光单元包括沿第一成像镜出射光路方向依次设置的第一准直镜、第一色散元件、第二成像镜;所述第一编码模板用于对第二成像镜成像后的不同视场光谱图像信息进行光谱维编码;所述合光单元包括沿第一编码模板出射光路方向依次设置的第二准直镜、第二色散元件、第三成像镜;其中,第二色散元件用于将第一色散元件色散的光束进行合束;所述第一色散元件和第二色散元件的结构相同,且沿第一编码模板对称分布;所述第二编码模板用于对第三成像镜成像后的空间图像信息进行空间微编码;所述成像镜组用于将编码后的图像压缩至单元探测器焦平面上;所述单元探测器用于对编码压缩后的信息进行接收并采集,数据处理单元用于对单元探测器获取的信息进行反演,实现对目标的空间信息和光谱信息的复原,获取目标的三维数据立方体。A gaze-type spectral imaging system based on compressed sensing, which is special in that it includes a first imaging mirror, a light splitting unit, a first encoding template, a light combining unit, a second encoding template, and an imaging mirror group arranged in sequence along the beam direction. , a unit detector and a data processing unit; the first imaging mirror is used to image the target at the primary image plane position; the spectroscopic unit includes a first collimating mirror, a first collimating mirror, a second a dispersive element and a second imaging mirror; the first encoding template is used to perform spectral dimension encoding on spectral image information of different fields of view imaged by the second imaging mirror; the light combining unit includes an exit light path along the first encoding template a second collimating mirror, a second dispersive element, and a third imaging mirror arranged in sequence in directions; wherein, the second dispersive element is used to combine the light beams dispersed by the first dispersive element; the first dispersive element and the second dispersive element The elements have the same structure and are symmetrically distributed along the first encoding template; the second encoding template is used to perform spatial micro-encoding on the spatial image information imaged by the third imaging mirror; the imaging mirror group is used to encode the encoded image Compressed to the focal plane of the unit detector; the unit detector is used to receive and collect the encoded and compressed information, and the data processing unit is used to invert the information obtained by the unit detector to realize the spatial information and spectrum of the target. Restoration of information, obtaining the 3D data cube of the target.
进一步地,所述成像镜组包括沿光束方向依次设置的两个相互垂直的柱面镜,分别为第一柱面镜和第二柱面镜,第一柱面镜镜将编码后的图像压缩成一条线,第二柱面镜将线压缩成点信息;Further, the imaging lens group includes two mutually perpendicular cylindrical mirrors arranged in sequence along the beam direction, which are respectively a first cylindrical mirror and a second cylindrical mirror, and the first cylindrical mirror compresses the encoded image. into a line, and the second cylindrical mirror compresses the line into point information;
或者成像镜组包括一个或者多个透镜。Or the imaging lens group includes one or more lenses.
进一步地,所述第一色散元件和第二色散元件的口径相等、焦距相等。Further, the apertures and focal lengths of the first dispersion element and the second dispersion element are the same.
进一步地,所述第一色散元件和第二色散元件均为棱镜或光栅。Further, the first dispersion element and the second dispersion element are both prisms or gratings.
进一步地,所述第一编码模板和第二编码模板均包括移动式机械模板和固定编码模板;所述固定编码模板包括数字微镜阵列和液晶空间光调制器;所述第一编码模板和第二编码模板的编码体制为哈达玛编码或者傅里叶变换编码或者随机编码。Further, both the first coding template and the second coding template include a movable mechanical template and a fixed coding template; the fixed coding template includes a digital micromirror array and a liquid crystal spatial light modulator; the first coding template and the first coding template The coding system of the two-coded template is Hadamard coding, Fourier transform coding or random coding.
同时,本发明提供了一种基于压缩感知的凝视型光谱成像系统,其特殊之处在于:包括沿光束方向依次设置的第一成像镜、第二编码模板、分光单元、第一编码模板、合光单元、成像镜组、单元探测器及数据处理单元;所述第一成像镜用于将目标成像于一次像面位置;所述第二编码模板用于对第一成像镜成像后的空间图像信息进行空间微编码;所述分光单元包括沿第二编码模板出射光路方向依次设置的第一准直镜、第一色散元件、第二成像镜;所述第一编码模板用于对第二成像镜成像后的不同视场光谱图像信息进行光谱维编码;所述合光单元包括沿第一编码模板出射光路方向依次设置的第二准直镜、第二色散元件、第三成像镜;其中,第二色散元件用于将第一色散元件色散的光束进行合束;所述第一色散元件和第二色散元件的结构相同,且沿第一编码模板对称分布;所述成像镜组用于将第三成像镜成像后的图像压缩至单元探测器焦平面上;所述单元探测器用于对压缩后的信息进行接收并采集,所述数据处理单元用于对单元探测器获取的信息进行反演,实现对目标的空间信息和光谱信息的复原,获取目标的三维数据立方体。At the same time, the present invention provides a gaze-type spectral imaging system based on compressed sensing, which is special in that it includes a first imaging mirror, a second encoding template, a spectroscopic unit, a first encoding template, a a light unit, an imaging mirror group, a unit detector and a data processing unit; the first imaging mirror is used to image the target at the primary image plane position; the second encoding template is used to image the space image after the first imaging mirror The information is spatially micro-encoded; the light splitting unit includes a first collimating mirror, a first dispersion element, and a second imaging mirror arranged in sequence along the direction of the exit light path of the second encoding template; the first encoding template is used for the second encoding template. Spectral image information of different fields of view imaged by the imaging mirror is subjected to spectral dimension encoding; the light combining unit includes a second collimating mirror, a second dispersive element, and a third imaging mirror sequentially arranged along the direction of the exit light path of the first encoding template; The second dispersive element is used to combine the beams dispersed by the first dispersive element; the first and second dispersive elements have the same structure and are symmetrically distributed along the first encoding template; the imaging lens group uses is used to compress the image imaged by the third imaging mirror onto the focal plane of the unit detector; the unit detector is used for receiving and collecting the compressed information, and the data processing unit is used for processing the information acquired by the unit detector. Inversion, realizes the restoration of the spatial information and spectral information of the target, and obtains the three-dimensional data cube of the target.
进一步地,所述成像镜组包括沿光束方向依次设置的两个相互垂直的柱面镜,分别为第一柱面镜和第二柱面镜,第一柱面镜镜将成像后的图像压缩成一条线,第二柱面镜将线压缩成点信息;Further, the imaging lens group includes two mutually perpendicular cylindrical mirrors arranged in sequence along the beam direction, namely a first cylindrical mirror and a second cylindrical mirror, and the first cylindrical mirror compresses the image after imaging. into a line, and the second cylindrical mirror compresses the line into point information;
或者成像镜组包括一个或者多个透镜。Or the imaging lens group includes one or more lenses.
进一步地,所述第一色散元件和第二色散元件均为棱镜或光栅。Further, the first dispersion element and the second dispersion element are both prisms or gratings.
进一步地,所述第一色散元件和第二色散元件的口径相等、焦距相等。Further, the apertures and focal lengths of the first dispersion element and the second dispersion element are the same.
进一步地,所述第一编码模板和第二编码模板均包括移动式机械模板和固定编码模板;所述固定编码模板包括数字微镜阵列和液晶空间光调制器;所述第一编码模板和第二编码模板的编码体制为哈达玛编码或者傅里叶变换编码或者随机编码。Further, both the first coding template and the second coding template include a movable mechanical template and a fixed coding template; the fixed coding template includes a digital micromirror array and a liquid crystal spatial light modulator; the first coding template and the first coding template The coding system of the two-coded template is Hadamard coding, Fourier transform coding or random coding.
与现有技术相比,本发明的优点是:Compared with the prior art, the advantages of the present invention are:
1、本发明光谱成像系统首先对目标光谱维信息进行编码,获得光谱维编码的压缩图像,然后对目标空间维信息进行编码,或者首先对目标空间维信息进行编码,获得空间维编码的压缩图像,然后对目标光谱维信息进行编码,最终由单元探测器获得整个图谱的压缩数据,完成对光谱和空间的编码,从而实现单像素光谱成像;压缩的数据中同时包含了目标的图像信息和光谱信息,并且该方案能够实现凝视成像,无需通过扫描即可获得目标的空间信息,该成像系统体积小、成本低、成像质量好;1. The spectral imaging system of the present invention firstly encodes the target spectral dimension information to obtain a spectrally encoded compressed image, and then encodes the target spatial dimension information, or first encodes the target spatial dimension information to obtain a spatially encoded compressed image , and then encode the spectral dimension information of the target, and finally obtain the compressed data of the entire spectrum by the unit detector, complete the encoding of the spectrum and space, so as to realize single-pixel spectral imaging; the compressed data contains both the image information and spectrum of the target. information, and the solution can realize gaze imaging, and the spatial information of the target can be obtained without scanning. The imaging system is small in size, low in cost and good in imaging quality;
对目标进行光谱维编码的过程,可实现一次成像获得的目标图谱信息具有多个光谱通道信息,同时能够保证获得的目标图像信息具有较高的信噪比;The process of encoding the target spectral dimension can realize that the target spectral information obtained by one imaging has multiple spectral channel information, and at the same time, it can ensure that the obtained target image information has a high signal-to-noise ratio;
编码和压缩过程可实现对数据进行压缩,大大降低数据存储,采集和传输时间。The encoding and compression process can compress the data, greatly reducing the data storage, acquisition and transmission time.
2.本发明光谱成像系统可适用于可见光、红外、太赫兹、微波等多个波段,适用性广泛。2. The spectral imaging system of the present invention can be applied to visible light, infrared, terahertz, microwave and other wavelength bands, and has wide applicability.
3.本发明可采用数据处理单元对单元探测器获取的信息进行反演,获取目标的三维数据立方体。3. In the present invention, a data processing unit can be used to invert the information acquired by the unit detector to acquire a three-dimensional data cube of the target.
附图说明Description of drawings
图1是本发明基于压缩感知的凝视型光谱成像系统实施例一的光路图;Fig. 1 is the optical path diagram of the first embodiment of the staring-type spectral imaging system based on compressed sensing of the present invention;
图2是本发明基于压缩感知的凝视型光谱成像系统实施例二的光路图。FIG. 2 is an optical path diagram of the second embodiment of the gaze-type spectral imaging system based on compressed sensing according to the present invention.
其中,附图标记如下:Among them, the reference numerals are as follows:
1-第一成像镜,2-分光单元,21-第一准直镜,22-第一色散元件,23-第二成像镜,3-第一编码模板,4-合光单元,41-第二准直镜,42-第二色散元件,43-第三成像镜,5-第二编码模板,6-成像镜组,7-单元探测器。1-first imaging mirror, 2-beam splitting unit, 21-first collimating mirror, 22-first dispersive element, 23-second imaging mirror, 3-first encoding template, 4-light combining unit, 41-th Two collimating mirrors, 42-second dispersive element, 43-third imaging mirror, 5-second encoding template, 6-imaging mirror group, 7-unit detector.
具体实施方式Detailed ways
以下结合附图和具体实施例对本发明的内容作进一步详细描述。The content of the present invention will be described in further detail below with reference to the accompanying drawings and specific embodiments.
实施例一Example 1
本实施例提出的光谱成像技术,首先通过空间光调制器实现目标的光谱维编码,在此基础上,再次进行目标的空间维编码,最终通过单像素对编码后的信息进行采样,实现单像素凝视光谱成像。通过压缩感知算法对采集的信息进行反演即可复原出目标的空间图像信息及光谱信息。相比于大规格面阵探测器,单元探测器往往具有更高的性能,包括更低的探测器噪声、更高的量子效率和探测帧频、更大的探测信号接收面积等优势。同时,可通过单元探测器获得目标的图谱三维数据。The spectral imaging technology proposed in this embodiment first realizes the spectral dimension encoding of the target through the spatial light modulator. On this basis, the spatial dimension encoding of the target is performed again, and finally the encoded information is sampled through a single pixel to achieve a single pixel. Gaze spectral imaging. The spatial image information and spectral information of the target can be recovered by inverting the collected information through the compressed sensing algorithm. Compared with large-scale area array detectors, unit detectors often have higher performance, including lower detector noise, higher quantum efficiency and detection frame rate, and larger detection signal receiving area. At the same time, the three-dimensional data of the atlas of the target can be obtained through the unit detector.
如图1所示,一种基于压缩感知的凝视型光谱成像系统,包括沿光束方向依次设置的第一成像镜1、分光单元2、第一编码模板3、合光单元4、第二编码模板5、成像镜组6、单元探测器7及数据处理单元。As shown in FIG. 1, a gaze-type spectral imaging system based on compressed sensing includes a
第一成像镜1由单片或者多个镜片组成,用于将目标成像于一次像面位置。The
分光单元2包括沿第一成像镜1出射光路方向依次设置的第一准直镜21、第一色散元件22、第二成像镜23;其中,第一准直镜21由单片或者多个镜片组成,对进入系统的光束进行准直,使其不同视场入射的光束各自平行进入第一色散元件22中;第一色散元件22起色散分光作用,对不同视场的平行光进行色散分光,色散后的光束传播至第二成像镜23,经过第一色散元件22色散后的光束包含目标的光谱信息;第二成像镜23由单片或者多个镜片组成,对色散后光束进行成像,在第一编码模板3处获得目标的光谱信息。The
第一编码模板3用于对目标的不同视场光谱信息进行光谱维编码,实现目标的光谱维编码,获得光谱维编码的图像;其编码模板包括空间光调制器件数字微镜阵列(DMD)、液晶空间光调制器(LCM)以及机械掩模板,其中编码体制包括哈达玛编码、傅里叶变换编码和随机编码等多种编码形式。The
合光单元4包括沿沿第一编码模板出射光路方向依次设置的第二准直镜41、第二色散元件42、第三成像镜43;第二准直镜41由单片或者多个镜片组成,对编码后的不同谱段的光束进行准直,继而进入第二色散元件42处;第二色散元件42的作用是将第一色散元件22色散的不同波段光束进行合束,合束后的光束传播至第三成像镜43;其中第二色散元件42、第一色散元件22的型号和参数一致,可以为光栅或棱镜;第三成像镜43对编码后的光束进行成像,在第二编码模板5位置处获得目标的的空间图像。其中,第一色散元件22和第二色散元件42的结构相同,且沿第一编码模板3对称分布。The
第二编码模板5为空间编码模板,用于对经过光谱维编码的空间图像进行空间微编码;其包括数字微镜阵列(DMD),液晶空间光调制器(LCM)和机械模板等多种形式;其中编码体制包括哈达玛编码、傅里叶变换编码和随机编码等多种编码形式。The
成像镜组6用于将编码后的图像压缩至单元探测器7焦平面上,该成像镜组6具有特殊的作用,将整副图像缩放至很小的尺度;该成像镜组6由单片或者多个镜片组成,可以用沿光束方向依次设置的两块相互垂直的柱面镜,通过第一块柱面镜将编码后的图像压缩成一条线,再通过第二块柱面镜将线压缩成点信息;或者成像镜组6采用透镜镜组对图像进行压缩。The
单元探测器7用于对编码压缩后的信息进行接收并采集。The
数据处理单元,基于压缩感知的信号复原算法,具体如匹配追踪(MP)、正交匹配跟踪(OMP)、阈值硬迭代(IHT)、压缩采样匹配追踪(CoSaMP)和子空间追踪(SP),通过压缩感知的算法对单元探测器7获取的信息进行反演,可以实现对目标的空间信息和光谱信息的复原,获取目标的三维数据立方体。Data processing unit, signal recovery algorithm based on compressed sensing, such as matching pursuit (MP), orthogonal matching pursuit (OMP), threshold hard iteration (IHT), compressed sampling matching pursuit (CoSaMP) and subspace pursuit (SP), through The compressed sensing algorithm inverts the information obtained by the
采用编码成像技术对目标光谱维信息进行编码,获得光谱维编码的压缩图像,其中色散可采用棱镜、光栅等多种分光元件,编码可采用哈达玛编码、傅里叶编码及其衍化的各种编码形式;在此基础上,通过编码模板对空间维信息进行编码,最终由单元探测器像元结构获得整个图谱的压缩数据。压缩的数据中同时包含了目标的图像信息和光谱信息,并且该方案能够实现凝视成像,无需通过扫描即可获得目标的空间信息。The spectral dimension information of the target is encoded by the coding imaging technology, and the compressed image of the spectral dimension encoding can be obtained. The dispersion can use various light-splitting elements such as prisms and gratings, and the encoding can use various Hadamard coding, Fourier coding and their derivatives Encoding form; on this basis, the spatial dimension information is encoded through the encoding template, and finally the compressed data of the entire atlas is obtained from the pixel structure of the unit detector. The compressed data contains both the image information and spectral information of the target, and the solution can realize gaze imaging, and the spatial information of the target can be obtained without scanning.
本实施例光谱成像系统通过双编码的技术方案实现对光谱和空间的编码,从而实现单像素光谱成像。The spectral imaging system of this embodiment realizes the encoding of spectrum and space through the technical solution of double encoding, thereby realizing single-pixel spectral imaging.
本实施例通过双色散孔径编码技术(包括两块色散元件)实现了对目标光谱信息的编码,该过程中同时获得了目标完整的图像信息,在此基础上,对获得的图像信息进行编码,压缩后由单元探测器接收,实现凝视型单像素光谱成像技术。This embodiment realizes the encoding of the spectral information of the target through the dual-dispersion aperture encoding technology (including two dispersive elements), during which the complete image information of the target is obtained at the same time, and on this basis, the obtained image information is encoded, After compression, it is received by the unit detector to realize staring single-pixel spectral imaging technology.
本实施例光谱成像系统相比已有的单像素光谱成像技术,具有更高的信噪比。通过双色散孔径编码光谱成像技术实现光谱维度的编码,该过程一次成像获得的目标图谱信息具有多个光谱通道信息,是一种多通道的光谱成像技术,能够保证获得的目标图像信息具有较高的信噪比。Compared with the existing single-pixel spectral imaging technology, the spectral imaging system of this embodiment has a higher signal-to-noise ratio. The spectral dimension coding is realized by the dual-dispersion aperture coding spectral imaging technology. The target spectral information obtained by one imaging in this process has multiple spectral channel information. It is a multi-channel spectral imaging technology, which can ensure that the obtained target image information has high signal-to-noise ratio.
本实施例光谱成像系统适用于包括可见光、红外、太赫兹、微波等多个波段,相比其他单像素光谱成像装置,该技术的编码模板可采用多种空间光调制器件,包括数字微镜器件(DMD)、液晶空间光调制器、机械掩模板等多种器件,适用性广泛。The spectral imaging system of this embodiment is suitable for multiple wavelength bands including visible light, infrared, terahertz, microwave, etc. Compared with other single-pixel spectral imaging devices, the coding template of this technology can use various spatial light modulation devices, including digital micromirror devices. (DMD), liquid crystal spatial light modulator, mechanical mask and other devices, with wide applicability.
本实施例光谱成像系统具有极大的数据压缩功能。相比目前已有的技术方案,该技术能够实现比已有方案高数十倍的数据压缩比,大大降低数据存储,采集和传输时间和难度。The spectral imaging system of this embodiment has a great data compression function. Compared with the existing technical solutions, this technology can achieve a data compression ratio dozens of times higher than the existing solutions, greatly reducing the time and difficulty of data storage, collection and transmission.
实施例二
本实施例提出的光谱成像技术,首先通过空间光调制器实现目标的空间维编码,在此基础上,再次进行目标的光谱维编码,最终通过单像素对编码后的信息进行采样,实现单像素凝视光谱成像。通过压缩感知算法对采集的信息进行反演即可复原出目标的空间图像信息及光谱信息。相比于大规格面阵探测器,单元探测器往往具有更高的性能,包括更低的探测器噪声、更高的量子效率和探测帧频、更大的探测信号接收面积等优势。同时,可通过单元探测器获得目标的图谱三维数据。The spectral imaging technology proposed in this embodiment first realizes the spatial dimensional coding of the target through the spatial light modulator, and then performs the spectral dimensional coding of the target again on this basis, and finally samples the coded information through a single pixel to realize a single pixel. Gaze spectral imaging. The spatial image information and spectral information of the target can be recovered by inverting the collected information through the compressed sensing algorithm. Compared with large-scale area array detectors, unit detectors often have higher performance, including lower detector noise, higher quantum efficiency and detection frame rate, and larger detection signal receiving area. At the same time, the three-dimensional data of the atlas of the target can be obtained through the unit detector.
如图2所示,一种基于压缩感知的凝视型光谱成像系统,包括沿光束方向依次设置的第一成像镜1、第二编码模板5、分光单元2、第一编码模板3、合光单元4、成像镜组6及单元探测器7。As shown in FIG. 2, a gaze-type spectral imaging system based on compressed sensing includes a
第一成像镜1由单片或者多个镜片组成,用于将目标成像于一次像面位置。The
第二编码模板5为空间编码模板,用于对第一成像镜1成像后的空间图像信息进行空间微编码;其包括数字微镜阵列(DMD),液晶空间光调制器(LCM)和机械模板等多种形式;其中编码体制包括哈达玛编码、傅里叶变换编码和随机编码等多种编码形式。The
分光单元2包括沿第二编码模板5出射光路方向依次设置的第一准直镜21、第一色散元件22、第二成像镜23;其中,第一准直镜21由单片或者多个镜片组成,对进入系统的光束进行准直,使其不同视场入射的光束各自平行进入第一色散元件22中;第一色散元件22起色散分光作用,对不同视场的平行光进行色散分光,色散后的光束传播至第二成像镜23,经过第一色散元件22色散后的光束包含目标的光谱信息;第二成像镜23由单片或者多个镜片组成,对色散后光束进行成像,在第一编码模板3处获得目标的光谱信息。The
第一编码模板3用于对目标的不同视场光谱信息进行光谱维编码,实现目标的光谱维编码,获得光谱维编码的图像;其编码模板包括空间光调制器件数字微镜阵列(DMD)和液晶空间光调制器(LCM)以及机械掩模板,其中编码体制包括哈达玛编码、傅里叶变换编码和随机编码等多种编码形式。The
合光单元4包括沿沿第一编码模板出射光路方向依次设置的第二准直镜41、第二色散元件42、第三成像镜43;第二准直镜41由单片或者多个镜片组成,对编码后的不同谱段的光束进行准直,继而进入第二色散元件42处;第二色散元件42的作用是将第一色散元件22色散的不同波段光束进行合束,合束后的光束传播至第三成像镜43;其中第二色散元件42、第一色散元件22的型号和参数一致,可以为光栅或棱镜;第三成像镜43对编码后的光束进行成像,在第二编码模板5位置处获得目标的的空间图像。其中,第一色散元件22和第二色散元件42的结构相同,且沿第一编码模板3对称分布。The
成像镜组6用于将编码成像后的图像压缩至单元探测器7焦平面上,该成像镜组6具有特殊的作用,将整副图像缩放至很小的尺度;该成像镜组6由单片或者多个镜片组成,可以用沿光束方向依次设置的两块相互垂直的柱面镜,通过第一块柱面镜将编码后的图像压缩成一条线,再通过第二块柱面镜将线压缩成点信息;或者成像镜组6采用透镜镜组对图像进行压缩。The
单元探测器7用于对编码压缩后的信息进行接收并采集。The
数据处理单元,基于压缩感知的数据处理单元(信号复原算法),具体如匹配追踪(MP)、正交匹配跟踪(OMP)、阈值硬迭代(IHT)、压缩采样匹配追踪(CoSaMP)和子空间追踪(SP),通过压缩感知的算法对单元探测器7获取的信息进行反演,可以实现对目标的空间信息和光谱信息的复原,获取目标的三维数据立方体。Data processing unit, data processing unit based on compressed sensing (signal recovery algorithm), such as matching pursuit (MP), orthogonal matching pursuit (OMP), threshold hard iteration (IHT), compressed sampling matching pursuit (CoSaMP) and subspace tracking (SP), by inverting the information obtained by the
采用编码成像技术对目标空间维信息进行编码,获得空间维编码的压缩图像,其中色散可采用棱镜、光栅等多种分光元件,编码可采用哈达玛编码、傅里叶编码及其衍化的各种编码形式;在此基础上,通过编码模板对光谱维信息进行编码,最终由单元探测器像元结构获得整个图谱的压缩数据。压缩的数据中同时包含了目标的图像信息和光谱信息,并且该方案能够实现凝视成像,无需通过扫描即可获得目标的空间信息。The target spatial dimension information is encoded by the coding imaging technology, and the compressed image of the spatial dimension coding can be obtained, in which the dispersion can use various light-splitting elements such as prisms and gratings, and the coding can use various kinds of Hadamard coding, Fourier coding and their derivatives. Encoding form; on this basis, the spectral dimension information is encoded through the encoding template, and finally the compressed data of the entire spectrum is obtained from the pixel structure of the unit detector. The compressed data contains both the image information and spectral information of the target, and the solution can realize gaze imaging, and the spatial information of the target can be obtained without scanning.
本实施例光谱成像系统通过双编码的技术方案实现对光谱和空间的编码,从而实现单像素光谱成像。The spectral imaging system of this embodiment realizes the encoding of spectrum and space through the technical solution of double encoding, thereby realizing single-pixel spectral imaging.
本实施例通过双色散孔径编码技术(包括两块色散元件)实现了对目标光谱信息的编码,该过程中同时获得了目标完整的图像信息,在此基础上,对获得的图像信息进行编码,压缩后由单元探测器接收,实现凝视型单像素光谱成像技术。This embodiment realizes the encoding of the spectral information of the target through the dual-dispersion aperture encoding technology (including two dispersive elements), during which the complete image information of the target is obtained at the same time, and on this basis, the obtained image information is encoded, After compression, it is received by the unit detector to realize staring single-pixel spectral imaging technology.
本实施例光谱成像系统相比已有的单像素光谱成像技术,具有更高的信噪比。通过双色散孔径编码光谱成像技术实现光谱维度的编码,该过程一次成像获得的目标图谱信息具有多个光谱通道信息,是一种多通道的光谱成像技术,能够保证获得的目标图像信息具有较高的信噪比。Compared with the existing single-pixel spectral imaging technology, the spectral imaging system of this embodiment has a higher signal-to-noise ratio. The spectral dimension coding is realized by the dual-dispersion aperture coding spectral imaging technology. The target spectral information obtained by one imaging in this process has multiple spectral channel information. It is a multi-channel spectral imaging technology, which can ensure that the obtained target image information has high signal-to-noise ratio.
本实施例光谱成像系统适用于包括可见光、红外、太赫兹、微波等多个波段,相比其他单像素光谱成像装置,该技术的编码模板可采用多种空间光调制器件,包括数字微镜器件(DMD)、液晶空间光调制器、机械掩模板等多种器件,适用性广泛。The spectral imaging system of this embodiment is suitable for multiple wavelength bands including visible light, infrared, terahertz, microwave, etc. Compared with other single-pixel spectral imaging devices, the coding template of this technology can use various spatial light modulation devices, including digital micromirror devices. (DMD), liquid crystal spatial light modulator, mechanical mask and other devices, with wide applicability.
本实施例光谱成像系统具有极大的数据压缩功能。相比目前已有的技术方案,该技术能够实现比已有方案高数十倍的数据压缩比,大大降低数据存储,采集和传输时间和难度。The spectral imaging system of this embodiment has a great data compression function. Compared with the existing technical solutions, this technology can achieve a data compression ratio dozens of times higher than the existing solutions, greatly reducing the time and difficulty of data storage, collection and transmission.
以上仅是对本发明的优选实施方式进行了描述,并不将本发明的技术方案限制于此,本领域技术人员在本发明主要技术构思的基础上所作的任何公知变形都属于本发明所要保护的技术范畴。The above only describes the preferred embodiments of the present invention, and does not limit the technical solutions of the present invention to this. Any known deformations made by those skilled in the art on the basis of the main technical concept of the present invention belong to the protection of the present invention. technical category.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910841873.8A CN110736539B (en) | 2019-09-06 | 2019-09-06 | A gaze-based spectral imaging system based on compressed sensing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910841873.8A CN110736539B (en) | 2019-09-06 | 2019-09-06 | A gaze-based spectral imaging system based on compressed sensing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110736539A true CN110736539A (en) | 2020-01-31 |
| CN110736539B CN110736539B (en) | 2021-04-20 |
Family
ID=69267537
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910841873.8A Active CN110736539B (en) | 2019-09-06 | 2019-09-06 | A gaze-based spectral imaging system based on compressed sensing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110736539B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111538164A (en) * | 2020-07-09 | 2020-08-14 | 之江实验室 | A parallel control device for hollow spot array based on digital micromirror device |
| CN111624172A (en) * | 2020-07-01 | 2020-09-04 | 中国科学院上海技术物理研究所 | Thermal infrared video hyperspectral imaging system for gas detection |
| CN114444638A (en) * | 2022-03-28 | 2022-05-06 | 中科谱光(郑州)应用科学技术研究院有限公司 | Artwork coding system based on multi-dimensional data acquisition technology |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102322954A (en) * | 2011-08-15 | 2012-01-18 | 苏州大学 | Hyper-spectral compression imaging method and system thereof |
| CN203274918U (en) * | 2013-05-14 | 2013-11-06 | 中国科学院西安光学精密机械研究所 | adjustable wave plate type polarization interference imaging spectrometer |
| CN103575396A (en) * | 2013-11-19 | 2014-02-12 | 中国科学院空间科学与应用研究中心 | Imaging spectral system and method based on compressed sensing and Hadamard transformation |
| CN107389192A (en) * | 2017-07-28 | 2017-11-24 | 中南民族大学 | The compressed sensing reconfiguration system and its method of sparse spectrum |
-
2019
- 2019-09-06 CN CN201910841873.8A patent/CN110736539B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102322954A (en) * | 2011-08-15 | 2012-01-18 | 苏州大学 | Hyper-spectral compression imaging method and system thereof |
| CN203274918U (en) * | 2013-05-14 | 2013-11-06 | 中国科学院西安光学精密机械研究所 | adjustable wave plate type polarization interference imaging spectrometer |
| CN103575396A (en) * | 2013-11-19 | 2014-02-12 | 中国科学院空间科学与应用研究中心 | Imaging spectral system and method based on compressed sensing and Hadamard transformation |
| CN107389192A (en) * | 2017-07-28 | 2017-11-24 | 中南民族大学 | The compressed sensing reconfiguration system and its method of sparse spectrum |
Non-Patent Citations (1)
| Title |
|---|
| WEN-KAI YU等: "《Three-dimensional single-pixel compressive reflectivity imaging based on complementary modulation》", 《APPLIED OPTICS》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111624172A (en) * | 2020-07-01 | 2020-09-04 | 中国科学院上海技术物理研究所 | Thermal infrared video hyperspectral imaging system for gas detection |
| CN111538164A (en) * | 2020-07-09 | 2020-08-14 | 之江实验室 | A parallel control device for hollow spot array based on digital micromirror device |
| CN111538164B (en) * | 2020-07-09 | 2020-10-20 | 之江实验室 | A parallel control device for hollow spot array based on digital micromirror device |
| CN114444638A (en) * | 2022-03-28 | 2022-05-06 | 中科谱光(郑州)应用科学技术研究院有限公司 | Artwork coding system based on multi-dimensional data acquisition technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110736539B (en) | 2021-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Yang et al. | Compressive hyperspectral imaging via sparse tensor and nonlinear compressed sensing | |
| Cao et al. | Computational snapshot multispectral cameras: Toward dynamic capture of the spectral world | |
| CN103592026B (en) | Time flight imaging spectrum system and method based on compressed sensing and coding transformation | |
| CN103091258B (en) | A kind of multi-spectral imager based on liquid zoom technology | |
| US20180209850A1 (en) | Spectral imaging method and system | |
| CN106872037B (en) | Fast illuminated compact optical field imaging full-polarization spectrum detection device and method | |
| CN103913229B (en) | Coding template multi-target active imaging spectrum system and method | |
| CN107064005B (en) | The fast illuminated imaging system and algorithm for reconstructing of a kind of EO-1 hyperion light field | |
| CN104793343A (en) | Three-channel and single-Wollaston prism polarization imaging device and polarization information detecting method | |
| CN110736539A (en) | gaze type spectral imaging system based on compressed sensing | |
| CN110632000B (en) | Dynamic double-arm multi-channel staring spectrum imaging system based on compressed sensing | |
| CN104121990A (en) | Random grating based compressed sensing broadband hyperspectral imaging system | |
| CN110631703B (en) | Single-pixel spectrum imaging system based on tunable filter | |
| CN114638758A (en) | Method for restoring and reconstructing damaged image based on spectral imaging technology of compressed sensing | |
| CN110632002B (en) | Aperture coded spectrum detection device based on compressed sensing | |
| CN104154999A (en) | Compressed sensing-based multispectral imaging calculation system | |
| WO2019025759A1 (en) | Coded aperture spectral imaging device | |
| CN112665720B (en) | Dual-channel tunable hyperspectral imager and method based on complementary compression coding | |
| Oktem et al. | Computational spectral and ultrafast imaging via convex optimization | |
| CN106949967B (en) | The fast compact channel modulation type optical field imaging full-polarization spectrum detection device of illuminated and method | |
| Kuiteing et al. | Compressive hyperspectral imaging using progressive total variation | |
| KR101986998B1 (en) | Hyperspectral Imaging Device | |
| Rueda Chacón et al. | Spatial super-resolution in coded aperture-based optical compressive hyperspectral imaging systems | |
| CN105120141A (en) | Compressed sensing photoelectronic imaging method and device | |
| CN210862922U (en) | Single-pixel spectral imaging system based on tunable optical filter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |