WO2023238664A1 - Spectrum measurement system, method for operating spectrum measurement system, and illumination device - Google Patents

Abstract

The present disclosure relates to a spectrum measurement system with which it is possible to realize spectrum measurement using a single image obtained using a typical camera, a method for operating a spectrum measurement system, and an illumination device. In a state in which an object is irradiated with illumination by an illumination device, in which there are arranged a plurality of illumination cells comprising a plurality of point light sources that emit light having different wavelength characteristics, the object that is irradiated with illumination from the illumination device is imaged using a typical camera, and a spectral image of the object is generated on the basis of the captured image. The present disclosure can be applied to spectrum measurement systems.

Description

Spectroscopic measurement system, method of operating the spectroscopic measurement system, and lighting device

The present disclosure relates to a spectroscopic measurement system, an operating method of the spectroscopic measurement system, and an illumination device, and in particular, a spectroscopic measurement system and a spectroscopic measurement system that can realize spectroscopic measurement with one imaging using a general camera. The present invention relates to a method of operating a lighting device, and a lighting device.

Light (infrared radiation, visible light, ultraviolet) is a type of electromagnetic wave, and has different wavelengths (vibration periods) depending on the type of light.

Objects that emit or reflect light have unique amounts of each wavelength component depending on the composition of the object (elements, molecular structure, etc.), so each wavelength component of light must be separated and analyzed. This allows us to determine the type and state of the object being observed.

For example, when spectroscopically measuring light from sunlight, electric lamps, and various heated materials, different patterns are observed, which can be used to identify the type of luminescent object.

Therefore, in general, the amount of each wavelength depending on the composition of an object is called a wavelength spectrum, and measuring this wavelength spectrum is called spectroscopic measurement.

The type and state of the object to be measured can be measured using the wavelength spectrum measured by this spectroscopic measurement.

Additionally, by measuring the wavelength spectrum of an unknown substance through spectrometry, it becomes possible to identify the type and composition of the unknown substance.

In this way, if spectroscopic measurement is possible, it will be possible to obtain various information regarding the object to be measured.

However, when using a general camera (condensing lens + sensor), all wavelengths are observed in a mixed state, making it impossible to obtain the spectral characteristics of such an object.

For this reason, there are broadly two types of known methods for acquiring spectral characteristics.

On the one hand, there is a method of capturing images by realizing spectroscopy on the camera side, and more specifically, a method in which an optical element such as a diffraction element or a prism is inserted into the camera's optical system. , is a method of realizing spectroscopy inside a camera and capturing the spectroscopic image as a spectroscopic image.

On the other hand, the illumination side realizes spectroscopy and irradiates the measurement target, images the measurement target irradiated with the spectroscopic light using a general camera, and obtains a spectral image from the captured image. It's a method. More specifically, by irradiating the object with illumination with different wavelength characteristics and capturing an image of the object, a spectral image is obtained by observing the intensity of reflected light from the object in the captured image. This is the way to do it.

Among these, when performing spectroscopy on the camera side, many methods have been developed that utilize signal processing to obtain a set of spectral images in the entire wavelength range in one imaging (snapshot). A specially configured camera with optical elements is required.

On the other hand, in the case of a configuration in which spectroscopy is performed on the illumination side, a general camera can be used, making it easy to use.

Therefore, a technology has been proposed that realizes spectroscopy on the illumination side so that a general camera can be used (see Patent Document 1).

Japanese Patent Application Publication No. 2020-122759

However, in the technology of Patent Document 1, it is necessary to repeat the process of illuminating and imaging while switching the wavelength of the light emitted on the illumination side, and while it is possible to easily perform spectroscopic measurements using a general camera, Measurement takes time and effort.

The present disclosure has been made in view of this situation, and in particular, makes it possible to realize spectroscopic measurement with a single image capture using a general camera.

A spectroscopic measurement system according to a first aspect of the present disclosure includes a plurality of point light sources arranged in an array that emit light with different wavelength characteristics, and a boundary between the adjacent point light sources is located at a boundary between the adjacent point light sources. A lighting section in which a plurality of lighting cells each having a grid that prevents intermingling of light is arranged in an array, and irradiating an object with illumination, and the object irradiated with illumination from the lighting section. The present invention is a spectroscopic measurement system including an imaging section that captures an image of an object, and a spectral image generation section that generates a spectral image of the object based on the image captured by the imaging section.

A method of operating a spectroscopic measurement system according to a first aspect of the present disclosure includes a plurality of point light sources arranged in an array that emit light with different wavelength characteristics, and a boundary between adjacent point light sources is A method for operating a spectroscopic measurement system comprising: an illumination section in which a plurality of illumination cells having grids that prevent light from mixing between the point light sources are arranged in an array; an imaging section; and a spectral image generation section. The illumination unit irradiates the object with illumination, the imaging unit images the object irradiated with the illumination from the illumination unit as an image, and the spectral image generation unit includes: The method of operating a spectroscopic measurement system includes the step of generating a spectroscopic image of the object based on the image captured by the imaging unit.

In the first aspect of the present disclosure, the light source includes a plurality of point light sources arranged in an array that emit light with different wavelength characteristics, and the light source between the adjacent point light sources is arranged at a boundary between the adjacent point light sources. The illumination section has a plurality of illumination cells arranged in an array, each having a grid that prevents them from intersecting.The illumination unit irradiates the object with illumination, captures an image of the illuminated object, and then captures the image. A spectral image of the object is generated based on the captured image.

The illumination device according to the second aspect of the present disclosure includes a plurality of point light sources arranged in an array that emit light with different wavelength characteristics, and a boundary between the adjacent point light sources is provided at a boundary between the adjacent point light sources. This is a lighting device in which a plurality of lighting cells each having a grid that prevents the lights from mixing are arranged in an array to irradiate an object with light.

In a second aspect of the present disclosure, the light source includes a plurality of point light sources arranged in an array that emit light with wavelength characteristics, and the light source between the adjacent point light sources is arranged at a boundary between the adjacent point light sources. A plurality of illumination cells arranged in an array, each having a grid that prevents them from intersecting, irradiates the object to be subjected to spectroscopic measurement.

FIG. 1 is a diagram illustrating a configuration example of a spectroscopic measurement system of the present disclosure. It is a figure explaining a lighting device. It is a figure explaining the wavelength characteristic of the point light source of the lighting cell which comprises a lighting device. It is a figure explaining the wavelength characteristic of the point light source of the lighting cell which comprises a lighting device. FIG. 6 is a diagram illustrating an example in which the light emitted from each point light source of the illumination cell is parallel light. FIG. 6 is a diagram illustrating an example in which light emitted from each point light source of a lighting cell has spreading directionality. FIG. 2 is a diagram illustrating an image of an object when it is irradiated with general illumination and an image of an object when it is irradiated with spectroscopic measurement light. It is a figure explaining a spectral image set. FIG. 2 is a diagram illustrating a configuration example of an information processing device. It is a flowchart explaining spectroscopic measurement processing (part 1). FIG. 2 is a diagram illustrating a configuration example of an illumination cell in which the wavelength characteristics of a point light source are set continuously and randomly in the wavelength direction. FIG. 3 is a diagram illustrating wavelength characteristics of a point light source that is set continuously and randomly in the wavelength direction. It is a flowchart explaining spectroscopic measurement processing (part 2).

Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that, in this specification and the drawings, components having substantially the same functional configurations are designated by the same reference numerals and redundant explanation will be omitted.

Hereinafter, a mode for implementing the present technology will be described. The explanation will be given in the following order.
1. Preferred embodiment 2. Application example 3. Example of execution by software

<<1. Preferred embodiment >>
<Configuration example of the spectroscopic measurement system of the present disclosure>
With reference to FIG. 1, a configuration example of a spectroscopic measurement system of the present disclosure will be described.

The spectroscopic measurement system 11 in FIG. 1 includes an illumination device 31 that irradiates an object 30 to be measured with illumination light for spectrometry, and a camera that images the object 30 illuminated with the illumination for spectrometry. 32, and an information processing device 33 that generates a spectral image set through signal processing based on images captured by the camera 32.

The lighting device 31 includes, for example, lighting cells 41 arranged in an array as shown in FIG. Each of 41a-1 to 41a-9 emits light in a set wavelength band, and irradiates the object 30 with it.

Note that hereinafter, the irradiation light emitted by the illumination device 31 for realizing spectroscopic measurement will be referred to as spectroscopic measurement light. Further, the detailed configuration of the lighting device 31 will be described later with reference to FIGS. 2 to 6.

The camera 32 is an imaging device equipped with a general condensing lens and an image sensor, and captures an image of the object 30 irradiated with the spectroscopic measurement light emitted from the illumination device 31, and converts information of the captured image into information. It is output to the processing device 33.

Although the camera 32 and the information processing device 33 are shown connected by wire in FIG. 1, a connection method may be used as long as image information can be supplied from the camera 32 to the information processing device 33. .

For example, a configuration may be adopted in which the camera 32 and the information processing device 33 are connected via wireless communication or the like, and image information is supplied from the camera 32 to the information processing device 33.

Additionally, the camera 32 may store information on captured images in a storage medium, and may supply the information to the information processing device 33 via the storage medium.

The information processing device 33 generates a spectral image by extracting each wavelength band set for each point light source 41a of the illumination cell 41 on the image based on the image supplied from the camera 32, and extracts all the wavelength bands. spectral images are combined and output as a spectral image set.

With such a configuration, it is possible to generate a spectral image set with a single image capture using a general camera.

<Lighting device>
Next, a configuration example of the lighting device 31 will be described with reference to FIGS. 2 to 6.

As shown in FIG. 2, the illumination cells 41 constituting the illumination device 31 include, for example, a total of nine rectangular point light sources 41a-1 to 41a-9, 3×3, arranged in an array at equal intervals. It is said that the configuration is as follows.

Note that, hereinafter, unless there is a particular need to distinguish between the point light sources 41a-1 to 41a-9, they will simply be referred to as point light sources 41a, and the other configurations will also be referred to in the same manner.

Further, although the illumination cell 41 in FIG. 2 shows an example in which the point light sources 41a are arranged in 3×3 pieces in the horizontal and vertical directions, this is only an example, and in one illumination cell 41, The number of point light sources 41a arranged in the horizontal and vertical directions may be any other number, and may not be arranged in an array.

As shown in FIGS. 3 and 4, the point light sources 41a-1 to 41a-9 each emit light with different wavelength characteristics Ci(λ) (i=1, 2, 3,..., 9). emits.

More specifically, as shown in FIG. 4, the wavelength characteristics Cx(λ) (x=1, 2, 3, ..., 9) of the light emitted by the point light sources 41a-1 to 41a-9 are respectively are set so that they are substantially orthogonal.

The boundary between adjacent point light sources 41a is separated by, for example, a black grid 41b so that the optical paths of the light emitted by each point light source 41a do not intertwine.

Therefore, as shown in FIG. 5, the shapes of cross sections S11-1 to S11-9 of the light emitted from each of the point light sources 41a-1 to 41a-9 on the plane S1 at a predetermined distance from the illumination cell 41 are as follows: The light emitted from the point light sources 41a-1 to 41a-9 may be parallel light so as to be the same as the point light sources 41a-1 to 41a-9.

Further, as long as the light emitted from each of the point light sources 41a does not mix, the light emitted from the point light sources 41a-1 to 41a-9 does not have to be parallel light. For example, as shown in FIG. The cross sections S21-1 to S21-9 of the light emitted from each of the point light sources 41a-1 to 41a-9 on the surface S2 at a predetermined distance from the point light sources 41a-1 to 41a-9 are For example, the light may be directional light such as a light source of a projector.

Furthermore, the grid 41b also functions as a mark for specifying the range (position) of each illumination cell 41 on the image captured by the camera 32. For this reason, it is desirable that the grid 41b has a thickness that can be confirmed on the captured image. Further, a structure other than the grid 41b may be provided as long as it can function as a mark for specifying the range (position) of the illumination cell 41. For example, a structure capable of specifying the range of the illumination cell 41 may be provided. Instead of the grid 41b, marks, patterns, etc. that allow the positions of the corners and boundaries of the illumination cells 41 to be specified on the image may be added.

The camera 32 is equipped with a general condensing lens and an image sensor, and captures an image of an object irradiated with light emitted from each of the lighting cells 41 of the lighting device 31, and converts information of the captured image into information. It is output to the processing device 33.

The image captured by the camera 32 is different from the image captured under general uniform illumination in an environment where light emitted from the illumination device 31 is irradiated. This is an image in which light with different wavelength characteristics is irradiated on a unit basis.

The left part of FIG. 7 shows an image P1 of the object 30 captured by the camera 32 when the image is captured under general uniform illumination, and the right part of FIG. An image P2 is shown in which the target object 30 is captured in a state where it is illuminated.

At the bottom of each of the images P1 and P2 in FIG. 7, enlarged images PZ1 and PZ2 of the regions Z1 and Z2 in the images P1 and P2 in FIG. 7 are shown.

The enlarged image PZ1 shows that under general illumination, an image with a color scheme that is visible to the human eye is captured by being illuminated with white light that is a mixture of uniform light of various wavelengths. has been done.

On the other hand, in the enlarged image PZ2, the light having the respective wavelength characteristics of the point light sources 41a-1 to 41a-9 constituting the illumination cell 41 of the illumination device 31 is irradiated in a rectangular shape without mixing. It is shown that an image is being captured.

The information processing device 33 analyzes the image captured by the camera 32 by signal processing, and determines the wavelength characteristics for each of the wavelength characteristics set for each of the point light sources 41a-1 to 41a-9 constituting the illumination cell 41. By extracting the area irradiated with light, a spectral image of each wavelength characteristic is generated, and the spectral images of all wavelength characteristics are collectively output as a spectral image set.

That is, as shown in FIG. 8, for example, when an image PA is captured by the camera 32, the information processing device 33 extracts spectral images PA1 to PA34 for each wavelength characteristic, and combines them to form a spectral image set. Configure and output.

In FIG. 8, an example is shown in which a point light source 41a corresponding to 34 types of wavelength characteristics (34 types of wavelength characteristics where the wavelength is set from 450 nm to 780 nm at 10 nm intervals) orthogonal to the illumination cell 41 is set. In the case where a point light source 41a having nine types of wavelength characteristics as shown in FIGS. 3 and 4 is set, nine spectral images corresponding to each of the nine types of wavelength characteristics are extracted. It turns out.

<Information processing device>
Next, a configuration example of the information processing device 33 will be described with reference to the block diagram of FIG.

The information processing device 33 is, for example, a personal computer, a server on a network, a cloud server, etc., and acquires an image captured by the camera 32 via the network or via the removable storage medium 107, and performs spectroscopic analysis. Generate an image.

More specifically, the information processing device 33 is composed of a control section 101, an input section 102, an output section 103, a storage section 104, a communication section 105, a drive 106, and a removable storage medium 107. It is connected to the computer via a computer and can send and receive data and programs.

The control unit 101 is composed of a processor and a memory, and controls the entire operation of the information processing device 33. Further, the control section 101 includes a signal processing section 111.

The signal processing unit 111 performs signal processing on the information of the image captured by the camera 32 to generate a spectral image set.

More specifically, the signal processing unit 111 extracts pixel signals for each wavelength characteristic set to the point light source 41a that constitutes the illumination cell 41 of the illumination device 31 for each pixel with respect to image information, and processes the image. As a result, spectral images corresponding to wavelength characteristics are generated, and these are collectively output as a spectral image set.

The input unit 102 is composed of input devices such as a keyboard, a mouse, and a touch panel through which the user of the information processing device 33 inputs operation commands, and supplies various input signals to the control unit 101.

The output unit 103 is controlled by the control unit 101 and includes a display unit and an audio output unit. The output unit 103 outputs and displays images of the operation screen and processing results on a display unit including a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence). Furthermore, the output unit 103 controls an audio output unit including an audio output device to reproduce various voices, music, sound effects, and the like.

The storage unit 104 is composed of an HDD (Hard Disk Drive), SSD (Solid State Drive), or semiconductor memory, and is controlled by the control unit 101 to write or read various data and programs including content data.

The communication unit 105 is controlled by the control unit 101 and realizes wired or wireless communication such as LAN (Local Area Network) and Bluetooth (registered trademark), and as necessary via a network (not shown). , and transmits and receives various data and programs to and from various devices including the camera 32. That is, the communication unit 105 receives image information when it is transmitted from the camera 32.

The drive 106 includes magnetic disks (including flexible disks), optical disks (including CD-ROMs (Compact Disc-Read Only Memory), DVDs (Digital Versatile Discs)), magneto-optical disks (including MDs (Mini Discs)), Alternatively, data is read from and written to a removable storage medium 107 such as a semiconductor memory.

<Spectroscopic measurement processing (Part 1)>
Next, spectroscopic measurement processing by the spectroscopic measurement system 11 will be described with reference to the flowchart in FIG.

In step S31, the illumination device 31 irradiates the target object 30 with spectroscopic measurement light by causing each point light source 41a of the illumination cell 41 to emit light.

In step S32, the camera 32 captures an image including the object 30 irradiated with the spectroscopic measurement light within its angle of view, and outputs information on the captured image to the information processing device 33. Note that the information on the image captured by the camera 32 may be supplied to the information processing device 33 via the network, or the camera 32 may store it in the removable storage medium 107 and the information may be stored in the removable storage medium 107. Alternatively, the information may be supplied to the information processing device 33 via a computer.

In step S33, the signal processing unit 111 in the control unit 101 of the information processing device 33 specifies the range (position) of the illumination cell 41 in the image based on the grid 41b, and also specifies the range (position) of the illumination cell 41 based on the point light source 41a of the illumination cell 41. Pixel signals are extracted for each set wavelength characteristic (region).

In step S34, the signal processing unit 111 generates a spectral image for each wavelength characteristic based on the pixel signal for each set wavelength characteristic of the extracted point light source 41a.

In step S35, the signal processing unit 111 collects the spectral images for each wavelength characteristic and outputs them as a spectral image set.

Through the above processing, it becomes possible to obtain a spectral image with a single image capture using a general camera that does not have a mechanism for measuring spectral images, and realizes spectral measurement based on the spectral image. becomes possible.

<<2. Application example >>
In the above, the point light sources 41a-1 to 41a-9 have different wavelength characteristics Ci(λ) (i=1, 2, 3, ..., 9), as shown in FIGS. 3 and 4. Regarding an example in which the configuration is configured to emit light with I've explained it.

However, the wavelength characteristics of the light emitted by each of the point light sources 41a are configured to change continuously and randomly in the wavelength direction, and a spectral image set with an arbitrary number of wavelength characteristics is obtained by signal processing. Good too.

FIG. 11 shows an example of the configuration of an illumination cell 41' in which the wavelength characteristics of the light emitted from the point light source 41a of FIGS. 3 and 4 are continuously and randomly changed in the wavelength direction.

Further, FIG. 12 shows a wavelength characteristic C'x that continuously and randomly changes in the wavelength direction set for each of the point light sources 41'a-1 to 41'a-9 in the illumination cell 41' of FIG. (λ) (x=1, 2, 3,..., 9).

When the illumination device 31 is configured by arranging the illumination cells 41' in an array as shown in FIGS. 11 and 12, the signal processing unit 111 generates a spectral image set using the following determinant. Calculate.

In addition, in explaining the calculation method of the spectral image set, the wavelength characteristics of the point light sources 41'am are as follows: C=[C ₁ (λ), C ₂ (λ), C ₃ (λ), . . . C _m (λ)] ⁻¹ . Here, m is the number of point light sources 41'a. Therefore, in the case of the illumination cell 41' of FIGS. 11 and 12, m=9.

Moreover, C _i (λ) is C _i (λ)=[C _i (λ ₁ ), C _i (λ ₂ ), C _i (λ ₃ ), ..., C _i (λ _n )]. Let n be the number of bands, which is the number of spectral images.

At this time, the pixel brightness value I (=[I ₁ , I ₂ , I ₃ , ..., I _m ]) corresponding to each point light source 41'a in the image captured by the camera 32 is calculated using the following formula. It can be expressed as (1).

Here, f is the wavelength spectrum of the pixel corresponding to the point light source 41'a, and f=[f(λ ₁ ), f(λ ₂ ), f(λ ₃ ), ..., f(λ _n )] can be expressed as ^-1 . Further, Sn is a noise characteristic of an image sensor that captures an image in the camera 32.

From the above relationship, the pixel brightness value I (=[I ₁ , I ₂ , I ₃ , . . . , I _m ]) becomes a determinant expressed by the following equation (2).

That is, the signal processing unit 111 calculates the wavelength spectrum f(=[f(λ 1 ), f(λ ₂ ), f(λ ₃ ), . . . from the relationship of equation (1) (= equation ( ₂ )). , f(λ _n )] ⁻¹ ), a spectral image is calculated. As shown in equation (2), matrix C is a matrix set based on the wavelength characteristics of point light source 41'a.

Here, the wavelength spectrum f can be calculated using the following equation (3) using a pseudo-inverse matrix of the matrix C set based on the wavelength characteristics of the point light source 41'a, for example, by modifying the equation (1). It can be expressed as

Therefore, the signal processing unit 111 calculates the wavelength spectrum f of the pixel corresponding to each point light source 41a' by calculating the above-mentioned equation (3), and generates a spectral image set.

However, when using equation (3), although the calculation can be relatively simple, the determinant C that expresses the spectral characteristics is not regular, so there is a possibility that the wavelength spectrum f cannot be determined with high accuracy.

Therefore, in order to improve the accuracy of the wavelength spectrum f obtained by the calculation, the signal processing unit 111 may calculate the wavelength spectrum f using an optimization calculation such as the following equation (4), for example. desirable.

Here, R is an appropriate regularization term and α is a weighting factor.

Note that from an image captured using the illumination device 31 configured such that the wavelength characteristics of the point light sources 41a are substantially orthogonal as shown in FIGS. 3 and 4, the above equation (3) or equation ( It is also possible to obtain a spectral image set by calculation using 4).

However, in the wavelength characteristics of the point light source 41a of the illumination cell 41, which was explained with reference to FIGS. 3 and 4, they are approximately orthogonal to each other, so all values are 0 except for a certain interval, and the matrix C expressing the spectral characteristics is 0. Most of them become 0, and at the same time as the matrix C falls in rank, the condition number becomes significantly higher than that of the illumination cell 41', so there is a possibility that the accuracy of calculation by Equation (3) or Equation (4) will decrease.

Therefore, when using an illumination cell 41 configured such that the wavelength characteristics of the point light sources 41a are substantially orthogonal as shown in FIGS. The accuracy can be maintained by generating .

When using the illumination cell 41, the number of measurable bands is smaller compared to the illumination cell 41', but on the other hand, calculations such as equation (3) or (4) are not required, so the signal processing unit It becomes possible to reduce the processing load in 111 and to realize faster processing.

<Spectral measurement processing (Part 2)>
Next, with reference to the flowchart in FIG. 13, a description will be given of spectroscopic measurement processing by the spectroscopic measurement system 11 using the illumination device 31 including the illumination cell 41'. Note that the processes in steps S51 and S52 in the flowchart of FIG. 13 are the same process except that the lighting device 31 uses a lighting cell 41' instead of the lighting cell 41, so a description thereof will be omitted. .

That is, in step S53, the signal processing unit 111 in the control unit 101 of the information processing device 33 extracts pixel signals corresponding to each of the point light sources 41'a of the illumination cell 41' in the image.

In step S54, the signal processing unit 111 uses the equation (3 ) or by calculating equation (4), a spectral image with the set number of bands n is generated.

In step S55, the signal processing unit 111 collects the spectral images of the set number of bands n obtained by calculation and outputs them as a spectral image set.

Through the above processing, it is possible to obtain a spectral image with a single image capture using a general camera that is not equipped with an optical element for spectroscopy, and it is possible to realize spectral measurements based on the spectral image. It becomes possible.

Through the above processing, in conventional spectroscopic measurements, it was necessary to capture images the same number of times as the number of bands required, but according to the present disclosure, spectral images of many wavelength bands can be obtained with one imaging. It becomes possible to do so.

Additionally, it becomes possible to perform spectroscopic measurements using a commercially available camera instead of an expensive camera with a complicated optical system, such as a general snapshot spectroscopic camera.

Further, since overlapping diffraction images are not formed between adjacent pixels on the image sensor used in the camera 32, accuracy is improved even when a spectral image set is obtained by calculation.

Furthermore, instead of the illumination cell 41 constituting the illumination device 31, an illumination cell 41' consisting of point light sources 41'a-1 to 41'a-9 whose wavelength characteristics are set continuously and randomly in the wavelength direction is used. In this manner, the signal processing unit 111 calculates the above-mentioned equation (3) or equation (4) to obtain a set of spectral images in 34 wavelength bands using the nine point light sources 41'a. , confirmed by simulation. In this case, each spectral image forming the spectral image set has a size that is 1/9 of the captured image size.

However, when using illumination cells 41 in which the wavelength characteristics of the point light sources 41a are orthogonal to each other and trying to obtain spectral images with the same 34 wavelength characteristics, it is necessary to set 34 point light sources 41a. , each spectral image needs to be compressed to about 1/100 of the captured image size.

For this reason, the signal processing unit 111 performs calculation using equation (3) or equation (4) using an illumination cell 41' consisting of a point light source 41'a whose wavelength characteristics are set continuously and randomly in the wavelength direction. By determining a spectral image set, it is possible to eliminate the trade-off relationship between wavelength resolution and spatial resolution.

<<3. Example of execution using software >>
Incidentally, the series of processes described above can be executed by hardware, but can also be executed by software. When a series of processes is executed by software, the programs that make up the software can execute various functions by using a computer built into dedicated hardware or by installing various programs. It is installed from a recording medium onto a computer that can be used, for example, a general-purpose computer.

The control unit 101 of the information processing device 33 in FIG. 9 is, for example, a CPU, and uses a program stored in a ROM (not shown) or a removable storage medium 107 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory. The program is read out and installed in the storage unit 104, and various processes are executed according to the program loaded from the storage unit 104 into a RAM (not shown). The RAM also appropriately stores data necessary for the control unit 101 to execute various processes.

In the information processing device 33 configured as described above, the control unit 101 loads, for example, a program stored in the storage unit 104 into a RAM (not shown) via the bus 108 and executes the program. The series of processes described above are performed.

The program executed by the control unit 101 can be provided by being recorded on a removable storage medium 107, such as a package medium, for example. Additionally, programs may be provided via wired or wireless transmission media, such as local area networks, the Internet, and digital satellite broadcasts.

In the information processing device 33, the program can be installed in the storage unit 104 by attaching the removable storage medium 107 to the drive 106. Further, the program can be received by the communication unit 105 via a wired or wireless transmission medium and installed in the storage unit 104. Other programs can be installed in advance in a ROM or storage unit 104 (not shown).

Note that the program executed by the information processing device 33 may be a program in which processing is performed in chronological order according to the order described in this specification, in parallel, or as necessary when called. The program may be a program that performs processing at specific timings.

Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are located in the same casing. Therefore, multiple devices housed in separate casings and connected via a network, and a single device with multiple modules housed in one casing are both systems. .

Note that the embodiments of the present disclosure are not limited to the embodiments described above, and various changes can be made without departing from the gist of the present disclosure.

For example, the present disclosure can take a cloud computing configuration in which one function is shared and jointly processed by multiple devices via a network.

Furthermore, each step described in the above flowchart can be executed by one device or can be shared and executed by multiple devices.

Further, when one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices.

Note that the present disclosure can also take the following configuration.

<1> Consisting of a plurality of point light sources that emit light with different wavelength characteristics and arranged in an array, so that the light between the adjacent point light sources does not mix at the boundary between the adjacent point light sources. an illumination unit in which a plurality of illumination cells each having a grid are arranged in an array and irradiate the object with illumination;
an imaging unit that captures an image of the object irradiated with illumination from the illumination unit; and a spectral image generation unit that generates a spectral image of the object based on the image captured by the imaging unit. A spectroscopic measurement system equipped with and.
<2> The spectral image generation unit specifies a range of the illumination cells based on the grid in the image, and generates a spectral image of the object based on the specified illumination cells. <1 The spectroscopic measurement system described in >.
<3> The spectroscopic measurement system according to <1> or <2>, wherein the wavelength characteristics of the lights emitted by the plurality of point light sources in the same illumination cell are orthogonal to each other.
<4> The spectral image generation unit extracts pixel signals in the same wavelength range set for the point light source in the image captured by the imaging unit, thereby generating a spectral image of the object for each wavelength range. The spectroscopic measurement system according to <3> that generates an image.
<5> The spectroscopic measurement system according to <1> or <2>, wherein the wavelength characteristics of the light emitted by the plurality of point light sources in the same illumination cell change continuously and randomly in the wavelength direction.
<6> The spectral image generation unit extracts pixel signals having the same wavelength characteristics set for the point light source in the image captured by the imaging unit, and extracts pixel signals having the same wavelength characteristics set for the point light source, and The spectroscopic measurement system according to <5>, wherein a spectral image of the object for each wavelength range is generated by solving a determinant using a matrix set according to wavelength characteristics of light emitted by the point light source.
<7> The spectral image generation unit solves a determinant using a pseudo-inverse matrix of a matrix that is set according to wavelength characteristics of light emitted by the plurality of point light sources in the same illumination cell. , the spectroscopic measurement system according to <6>, which generates a spectral image of the object for each wavelength range.
<8> The spectral image generation unit generates a wavelength range by optimization calculation of a determinant using a matrix set according to wavelength characteristics of light emitted by the plurality of point light sources in the same illumination cell. The spectroscopic measurement system according to <6>, wherein the spectroscopic measurement system generates a spectroscopic image of the target object at each time.
<9> Consisting of a plurality of point light sources that emit light with different wavelength characteristics and arranged in an array, so that the light between the adjacent point light sources does not mix at the boundary between the adjacent point light sources. a lighting section in which a plurality of lighting cells each having a grid are arranged in an array;
an imaging unit;
1. A method of operating a spectroscopic measurement system comprising a spectral image generation section,
The illumination unit irradiates the target object with illumination,
The imaging unit captures an image of the object illuminated with illumination from the illumination unit,
The spectroscopic image generation unit generates a spectroscopic image of the object based on the image captured by the imaging unit.
<10> Consisting of a plurality of point light sources that emit light with different wavelength characteristics and arranged in an array, so that the light between the adjacent point light sources does not mix at the boundary between the adjacent point light sources. A lighting device in which a plurality of lighting cells each having a grid are arranged in an array to irradiate an object with light.
<11> The lighting device according to <10>, wherein the wavelength characteristics of the light emitted by the plurality of point light sources in the same lighting cell are orthogonal to each other.
<12> The lighting device according to <10>, wherein the wavelength characteristics of the light emitted by the plurality of point light sources in the same lighting cell continuously and randomly change in the wavelength direction.

11 Spectroscopic measurement system, 30 Target, 31 Illumination device, 32 Mask, 33 Information processing device, 41, 41' Illumination cell, 41a, 41a-1 to 41a-9, 41'a, 41'a-1 to 41' a-9 point light source, 41b grid, 111 signal processing section

Claims (12)

Consisting of a plurality of point light sources that emit light with different wavelength characteristics and arranged in an array, a grid is provided at the boundary between the adjacent point light sources to prevent light from mixing between the adjacent point light sources. an illumination unit having a plurality of illumination cells arranged in an array and irradiating a target object with illumination;
an imaging unit that captures an image of the object irradiated with illumination from the illumination unit; and a spectral image generation unit that generates a spectral image of the object based on the image captured by the imaging unit. A spectroscopic measurement system equipped with and. The spectral image generation unit specifies the range of the illumination cells based on the grid in the image, and generates the spectral image of the target based on the specified illumination cells. spectroscopic measurement system. The spectroscopic measurement system according to claim 1, wherein the wavelength characteristics of the lights emitted by the plurality of point light sources in the same illumination cell are orthogonal to each other. The spectral image generation unit generates a spectral image of the object for each wavelength range by extracting pixel signals in the same wavelength range set for the point light source in the image captured by the imaging unit. The spectroscopic measurement system according to claim 3. The spectroscopic measurement system according to claim 1, wherein wavelength characteristics of the light emitted by the plurality of point light sources in the same illumination cell continuously and randomly change in the wavelength direction. The spectral image generation unit extracts pixel signals having the same wavelength characteristics set for the point light sources in the image captured by the imaging unit, and extracts pixel signals having the same wavelength characteristics set for the point light sources, and extracts pixel signals having the same wavelength characteristics set for the point light sources, and The spectroscopic measurement system according to claim 5, wherein a spectral image of the object for each wavelength range is generated by solving a determinant using a matrix set according to wavelength characteristics of light emitted by the system. The spectral image generation unit generates a wavelength range by solving a determinant using a pseudo-inverse matrix of a matrix that is set according to wavelength characteristics of light emitted by the plurality of point light sources in the same illumination cell. The spectroscopic measurement system according to claim 6, wherein the spectroscopic measurement system generates a spectroscopic image of the object for each time. The spectral image generation unit generates the spectral image for each wavelength range by optimization calculation of a determinant using a matrix that is set according to wavelength characteristics of light emitted by the plurality of point light sources in the same illumination cell. The spectroscopic measurement system according to claim 6, which generates a spectroscopic image of a target object. Consisting of a plurality of point light sources that emit light with different wavelength characteristics and arranged in an array, a grid is provided at the boundary between the adjacent point light sources to prevent light from mixing between the adjacent point light sources. a lighting unit including a plurality of lighting cells arranged in an array;
an imaging unit;
1. A method of operating a spectroscopic measurement system comprising a spectral image generation section,
The illumination unit irradiates the target object with illumination,
The imaging unit captures an image of the object illuminated with illumination from the illumination unit,
The spectroscopic image generation unit generates a spectroscopic image of the object based on the image captured by the imaging unit. Consisting of a plurality of point light sources that emit light with different wavelength characteristics and arranged in an array, a grid is provided at the boundary between the adjacent point light sources to prevent light from mixing between the adjacent point light sources. An illumination device in which a plurality of illumination cells are arranged in an array and irradiate an object with illumination. The lighting device according to claim 10, wherein the wavelength characteristics of the light emitted by the plurality of point light sources in the same lighting cell are orthogonal to each other. The lighting device according to claim 10, wherein wavelength characteristics of the light emitted by the plurality of point light sources in the same lighting cell continuously and randomly change in the wavelength direction.

Images