WO2020244619A1 - Spectral curve acquiring method, electronic device, and chip - Google Patents

Abstract

Provided in the present application are a spectral curve acquiring method, an electronic device, and a chip. The electronic device receives a photographing request inputted by a user requesting to photograph a set of images, controls the order of exposure of supplementary lights in a supplementary lighting device on the basis of the photographing request, and produces a set of images on the basis of the order of exposure, the set of images comprising an image for which lighting is provided simultaneously by the different supplementary lights and the ambient light and an image for which lighting is provided solely by the ambient light. Then, the electronic device obtains a spectral curve of a target object on the basis of the images. In the process, with the supplementary lights providing lights of different wavelengths, images of different wave bands of the target object are produced, thus acquiring the spectral curve of the target object, obviating the need for a dedicated spectrometer, and making costs inexpensive. Moreover, this can be provided to general users for use in daily life. In addition, the process of acquiring the spectral curve does not alter the architecture of the electronic device for normal photographing.

Description

Method for obtaining spectrum curve, electronic equipment and chip

This application requires the priority of a Chinese patent application filed with the State Intellectual Property Office of China with the application number 201910493020.X, and the Chinese patent application with the title of the invention titled "Method for obtaining spectral curve, electronic equipment and chip" on June 6, 2019 Priority, the entire content of which is incorporated in this application by reference.

Technical field

The embodiments of the present application relate to the field of spectral analysis technology, and in particular to a method for obtaining a spectral curve, electronic equipment, and a chip.

Background technique

With the continuous development of technology, more and more electronic devices have camera functions. At the same time, in order to meet the needs of back-end smart applications, electronic devices are required to have the ability to capture high-quality images, as well as to have spectral analysis capabilities to be able to obtain the spectral curve of the object.

In the traditional process of acquiring the spectrum curve, the optical device is used as the light source to illuminate the object. By adjusting the optical device spectrum, the wavelength of the light passing through the lens of the optical device is different at different times, so that different wavelengths of light are used for irradiation For the same object, the optical equipment images the object in different time periods, and images of the same object in different bands can be obtained. After that, the optical device sends the images of these different wavebands to the electronic device, and the electronic device analyzes the images of the different wavebands to obtain the spectral curve of the object.

However, most of the above-mentioned optical devices are dedicated spectrometers, etc., with limited use range and high prices. Therefore, how to obtain the spectral curve of an object is an urgent problem in the industry.

Summary of the invention

The embodiments of the present application provide a method for obtaining a spectrum curve, an electronic device, and a chip, and a light supplement device provides light of different wavelength bands to achieve the purpose of obtaining a spectrum curve of an object.

In the first aspect, an embodiment of the present application provides a method for obtaining a spectral curve, which can be applied to an electronic device or a chip in an electronic device. The method is described below by taking an electronic device as an example. The method includes: the electronic device receives a shooting request input by a user, and the shooting request is used to request to shoot a group of images, and the group of images includes a first image and a first image. Two images, where the light source of the first image is a light supplement device and ambient light, the light source of the second image is ambient light, and the light supplement device includes at least one light supplement lamp, and different light supplement lamps in the at least one light supplement light To provide light of different wavelengths; the electronic equipment controls the exposure sequence of each fill light in the fill light device according to the shooting request; according to the exposure sequence, the target object is photographed to obtain the first image and the second image; One image and the second image determine the spectral curve of the target object. With this solution, the electronic device receives a shooting request input by the user requesting to shoot a group of images or, according to the shooting request, controls the exposure sequence of each fill light in the fill light device, and obtains a set of images according to the exposure sequence. The group of images includes images that are illuminated by different fill lights and ambient light at the same time, and images that are illuminated by only ambient light. Then, the electronic device obtains the spectral curve of the target object according to the images. In this process, different wavelengths of light are provided by the fill light to obtain images of different wavelength bands of the target object, and then the spectral curve of the target object is obtained, without the need for a dedicated spectrometer, and the cost is low. Moreover, it can be provided to ordinary users to use in their daily lives. In addition, the process of acquiring the spectral curve does not change the normal photographing architecture of the electronic device.

In a feasible design, when the electronic device determines the spectral curve of the target object based on the first image and the second image, it removes the second image from the first image to obtain a third image whose light source is a light supplement device; The third image determines the spectral curve of the target object. With this solution, the electronic device obtains a third image by removing the second image from each first image, and uses each third image to determine the spectral curve of the target object, so as to achieve the purpose of obtaining the spectral curve of the target object.

In a feasible design, when the electronic device determines the spectral curve of the target object according to the third image, it performs interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object. With this scheme, the spectral curve of the target object is obtained through an interpolation algorithm, so as to achieve the purpose of obtaining the spectral curve of the target object.

In a feasible design, the difference between the wavelengths of two adjacent fill lamps in the exposure sequence is a preset difference. With this solution, since the wavelength difference between two adjacent fill light lamps in the exposure sequence is a preset threshold, the wavelengths provided by the fill light device are distributed in the entire frequency spectrum.

In a feasible design, the supplementary light frequency band of the supplementary light device is visible light frequency band, the first image and the second image are red, green and blue RGB images; or the supplementary light frequency band of the supplementary light device is infrared frequency band, and the first image and the second The image is a red, green, blue infrared RGB-IR image. With this solution, the supplementary light frequency band of the supplementary light device can be a visible light frequency band or an infrared frequency band, achieving the purpose of flexibly acquiring spectral images according to requirements.

In a feasible design, the light supplement device is built into the electronic device; or the light supplement device is externally placed on the electronic device.

In a second aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory, and a computer program stored in the memory and running on the processor. The processor executes the following steps when the program is executed: receiving a user The input shooting request, the shooting request is used to request to shoot a group of images, the group of images includes the first image and the second image, the light source of the first image is the light supplement device and the ambient light, and the light source of the second image is For ambient light, the light-filling device includes at least one light-filling lamp, and different light-filling lamps in the at least one light-filling lamp are used to provide light of different wavelengths; according to the shooting request, controlling the exposure sequence of the light-filling lamps in the light-filling device; According to the exposure sequence, the target object is photographed to obtain the first image and the second image; according to the first image and the second image, the spectral curve of the target object is determined. With this solution, the electronic device receives a shooting request input by the user requesting to shoot a group of images or, according to the shooting request, controls the exposure sequence of each fill light in the fill light device, and obtains a set of images according to the exposure sequence. The group of images includes images that are illuminated by different fill lights and ambient light at the same time, and images that are illuminated by only ambient light. Then, the electronic device obtains the spectral curve of the target object according to the images. In this process, different wavelengths of light are provided by the fill light to obtain images of different wavelength bands of the target object, and then the spectral curve of the target object is obtained, without the need for a dedicated spectrometer, and the cost is low. Moreover, it can be provided to ordinary users to use in their daily lives. In addition, the process of acquiring the spectral curve does not change the normal photographing architecture of the electronic device.

In a feasible design, when the electronic device determines the spectral curve of the target object based on the first image and the second image, it removes the second image from the first image to obtain a third image whose light source is a light supplement device; The third image determines the spectral curve of the target object. With this solution, the electronic device obtains a third image by removing the second image from each first image, and uses each third image to determine the spectral curve of the target object, so as to achieve the purpose of obtaining the spectral curve of the target object.

In a feasible design, when the electronic device determines the spectral curve of the target object according to the third image, it performs interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object. Using this scheme, the spectral curve of the target object is obtained through the interpolation algorithm, and the purpose of obtaining the spectral curve of the target object is achieved.

In a feasible design, the difference between the wavelengths of two adjacent fill lamps in the exposure sequence is a preset difference. With this solution, since the wavelength difference between two adjacent fill light lamps in the exposure sequence is a preset threshold, the wavelengths provided by the fill light device are distributed in the entire frequency spectrum.

In a feasible design, the supplementary light frequency band of the supplementary light device is visible light frequency band, the first image and the second image are red, green and blue RGB images; or the supplementary light frequency band of the supplementary light device is infrared frequency band, and the first image and the second The image is a red, green, blue infrared RGB-IR image. With this solution, the supplementary light frequency band of the supplementary light device can be a visible light frequency band or an infrared frequency band, achieving the purpose of flexibly acquiring spectral images according to requirements.

In a feasible design, the light supplement device is built into the electronic device; or the light supplement device is externally placed on the electronic device.

In a third aspect, an embodiment of the present application provides a chip that includes a processor and an interface. The interface is used to receive code instructions and transmit them to the processor. The processor runs the code instructions to perform the following steps: Request, the shooting request is used to request to shoot a group of images, the group of images contains a first image and a second image, where the light source of the first image is the light supplement device and the ambient light, and the light source of the second image is the environment The fill light device includes at least one fill light, and different fill lights in the at least one fill light are used to provide light of different wavelengths; according to the shooting request, control the exposure sequence of each fill light in the fill light device; according to the exposure Sequentially, the target object is photographed to obtain the first image and the second image; according to the first image and the second image, the spectral curve of the target object is determined. With this scheme, the electronic device receives a user input request to take a group of images According to the shooting request or, according to the shooting request, control the exposure sequence of each fill light in the fill light device, and obtain a set of images according to the exposure sequence. The set of images includes images that are simultaneously illuminated by different fill lights and ambient light And an image illuminated only by ambient light. Then, the electronic device obtains the spectral curve of the target object according to the images. In this process, different wavelengths of light are provided by the fill light to obtain images of different wavelength bands of the target object, and then the spectral curve of the target object is obtained, without the need for a dedicated spectrometer, and the cost is low. Moreover, it can be provided to ordinary users to use in their daily lives. In addition, the process of acquiring the spectral curve does not change the normal photographing architecture of the electronic device.

In a feasible design, when the electronic device determines the spectral curve of the target object based on the first image and the second image, it removes the second image from the first image to obtain a third image whose light source is a light supplement device; The third image determines the spectral curve of the target object. With this solution, the electronic device obtains a third image by removing the second image from each first image, and uses each third image to determine the spectral curve of the target object, so as to achieve the purpose of obtaining the spectral curve of the target object.

In a feasible design, when the electronic device determines the spectral curve of the target object according to the third image, it performs interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object. With this scheme, the spectral curve of the target object is obtained through an interpolation algorithm, so as to achieve the purpose of obtaining the spectral curve of the target object.

In a feasible design, the difference between the wavelengths of two adjacent fill lamps in the exposure sequence is a preset difference. With this solution, since the wavelength difference between two adjacent fill light lamps in the exposure sequence is a preset threshold, the wavelengths provided by the fill light device are distributed in the entire frequency spectrum.

In a feasible design, the supplementary light frequency band of the supplementary light device is visible light frequency band, the first image and the second image are red, green and blue RGB images; or the supplementary light frequency band of the supplementary light device is infrared frequency band, and the first image and the second The image is a red, green, blue infrared RGB-IR image. With this solution, the supplementary light frequency band of the supplementary light device can be a visible light frequency band or an infrared frequency band, achieving the purpose of flexibly acquiring spectral images according to requirements.

In a feasible design, the light supplement device is built into the electronic device; or the light supplement device is externally placed on the electronic device.

In a fourth aspect, an embodiment of the present application provides a computer program product containing instructions, which when run on an electronic device, causes the electronic device to execute the foregoing first aspect or the methods in the various possible implementation manners of the first aspect.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium that stores instructions in the computer-readable storage medium, and when it runs on an electronic device, the electronic device executes the first aspect or the first aspect described above. Methods in various possible implementations.

The spectral curve acquisition method, electronic device and chip provided by the embodiments of the present application, the electronic device receives a user input request to shoot a group of images or, according to the shooting request, controls the exposure of each fill light in the fill light device Sequence: According to the exposure sequence, a set of images is obtained. The set of images includes images that are illuminated by different fill lights and ambient light at the same time and images that are illuminated by only ambient light. Then, the electronic device obtains the spectral curve of the target object according to the images. In this process, different wavelengths of light are provided by the fill light to obtain images of different wavelength bands of the target object, and then the spectral curve of the target object is obtained, without the need for a dedicated spectrometer, and the cost is low. Moreover, it can be provided to ordinary users to use in their daily lives. In addition, the process of acquiring the spectral curve does not change the normal photographing architecture of the electronic device.

Description of the drawings

FIG. 1 is a schematic diagram of an electronic device to which an embodiment of the present application is applicable;

FIG. 2 is a schematic diagram of another electronic device to which an embodiment of the present application is applicable;

FIG. 3 is a flowchart of a method for obtaining a spectral curve provided by an embodiment of the present application;

4 is a schematic diagram of inputting a shooting request in the method for obtaining a spectral curve provided by an embodiment of the present application;

FIG. 5 is another schematic diagram of inputting a shooting request in the method for obtaining a spectral curve provided by an embodiment of the present application;

6 is a schematic diagram of the wavelength of the fill light in the method for obtaining a spectral curve provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a chip provided by an embodiment of the present application.

Detailed ways

At present, many scenes need to obtain the spectral curve of an object. For example, when analyzing the composition of an object, the spectral curve of the object needs to be used; for example, when judging the color of an object, the spectral curve of the object also needs to be used. At this time, the red green blue (RGB) image taken by the electronic device under ambient light cannot be used to obtain the spectral curve. In order to obtain the spectral curve of the object, the usual method is to use the optical device as a light source to illuminate the object, and to adjust the spectrum of the optical device so that the wavelength of the light passing through the lens of the optical device is different at different times. Perform imaging to obtain images of the same object in different bands. After that, the optical device sends the images to the electronic device, and the electronic device analyzes the images of different wavelength bands to obtain the spectral curve of the object.

In the above process of obtaining the spectral curve, the optical device images the object based on different wavebands, so as to obtain images of the same object in different wavebands. Most of the optical equipment is a dedicated spectrometer. The spectrometer uses an optical dispersion system, such as a prism, to disperse the incident light into light of different wavelength bands, so that the light of different wavelength bands is used to irradiate the object and image the object.

However, since most optical devices are dedicated spectrometers, etc., their use range is limited and the price is high, and they cannot be provided to ordinary users. Therefore, how to obtain the spectral curve of an object is an urgent problem in the industry.

In view of this, the embodiments of the present application provide a method, electronic device, and chip for obtaining a spectrum curve, which provide light of different wavelength bands through a light supplement device to achieve the purpose of obtaining a spectrum curve of an object.

The electronic devices involved in the embodiments of the present application may be devices capable of providing users with voice and/or data connectivity, handheld devices with wireless connection functions, and other processing devices connected to wireless modems. In the embodiments of this application, the electronic device may communicate with one or more core networks or the Internet via a radio access network (e.g., radio access network, RAN), and may be a mobile electronic device, such as a mobile phone (or called a "cellular "Phones, mobile phones), computers, and data cards, for example, can be portable, pocket-sized, handheld, computer-built or vehicle-mounted mobile devices, and they exchange language and/or data with the wireless access network. For example, personal communication service (PCS) phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), tablets Computer (Pad), computer with wireless transceiver function and other equipment. Wireless electronic equipment can also be referred to as system, subscriber unit, subscriber station, mobile station, mobile station (MS), remote station (remote station), access point ( access point, AP), remote electronic equipment (remote terminal), access electronic equipment (access terminal), user electronic equipment (user terminal), user agent (user agent), subscriber station (subscriber station, SS), user terminal equipment (customer premises equipment, CPE), terminal (terminal), user equipment (user equipment, UE), mobile terminal (mobile terminal, MT), etc. Wireless electronic devices can also be wearable devices and next-generation communication systems, for example, electronic devices in 5G networks or electronic devices in public land mobile network (PLMN) networks that will evolve in the future, and NR communication systems. Electronic equipment, etc.

Fig. 1 is a schematic diagram of an electronic device to which an embodiment of the present application is applicable. Please refer to FIG. 1. In this embodiment, the light supplement device is built in the electronic device, and is connected to the same processor as the camera of the electronic device. In the process of acquiring the spectrum curve, the user inputs a shooting request through voice and touching the light. The processor controls the exposure sequence of the fill light in the light supplement device according to the shooting request, and controls the camera to shoot the target object according to the exposure sequence , So as to obtain a group of images. The number of images in the group of images is related to the number of light-filling lamps in the light-filling device. Normally, the number of images is one more than the number of light-filling lamps. For example, if the number of fill light lamps in the fill light device is 4, the group of images includes 5 images, and the 5 images include the images corresponding to each fill light in the 4 fill light lamps, and one fill light The light is off and the image is under ambient light. For another example, if the number of fill light lamps in the fill light device is 3, the group of images includes 4 images, and the 4 images include the images corresponding to each of the 3 fill light lamps, and one fill light lamp. The light is off and the image is under ambient light.

Fig. 2 is a schematic diagram of another electronic device to which an embodiment of the present application is applicable. Please refer to FIG. 2, in this embodiment, the light supplement device is externally placed on the electronic device, and the light supplement device and the electronic device are connected via a universal serial bus (USB). In this embodiment, after the electronic device receives the shooting request input by the user and determines the exposure sequence according to the shooting request, it needs to send instructions to the light supplement device via USB, etc., so that the light supplement device exposes according to the exposure sequence; at the same time, the electronic device According to the exposure sequence, the target object is photographed to obtain a set of images.

Hereinafter, on the basis of the above-mentioned FIG. 1 and FIG. 2, the method for obtaining the spectral curve according to the embodiment of the present application will be described in detail. For example, see Figure 3.

Fig. 3 is a flowchart of a method for obtaining a spectral curve provided by an embodiment of the present application. This embodiment is described from the perspective of an electronic device, and this embodiment includes:

101. The electronic device receives a shooting request input by a user.

Wherein, the shooting request is used to request to shoot a group of images, the group of images includes a first image and a second image, the light source of the first image is a light supplement device and ambient light, and the second image The light source of is the ambient light, the light supplement device includes at least one light supplement lamp, and different light supplement lamps in the at least one light supplement lamp are used to provide light of different wavelengths.

Exemplarily, the user can input a shooting request through voice or touch. For example, see Figure 4 and Figure 5.

FIG. 4 is a schematic diagram of inputting a shooting request in the method for acquiring a spectral curve provided by an embodiment of the present application. Please refer to Figure 4, in this embodiment, there is a "spectral curve" application (APP) on the electronic device. The APP can be an APP that comes with the operating system of the electronic device, or it can be downloaded and installed by the user on the electronic device. The third-party APP on the device. When the spectrum curve needs to be obtained, the user clicks on the "spectral curve" APP on the desktop to open the APP. Then, the user clicks the shooting button to start shooting. Among them, the shooting button is shown as an oval in the figure.

FIG. 5 is another schematic diagram of inputting a shooting request in the method for acquiring a spectral curve provided by an embodiment of the present application. Referring to FIG. 5, in this embodiment, the camera of the electronic device has a spectral curve acquisition mode. To obtain the spectral curve, the user clicks on the camera on the desktop to turn on the camera. Then, the user selects the spectral curve mode and switches the camera to the spectral curve mode. Finally, the user clicks the shooting button to start shooting. Among them, the shooting button is shown as an ellipse in the figure.

102. The electronic device controls the exposure sequence of each fill light in the fill light device according to the shooting request.

Exemplarily, the order of the light supplement lamps in the light supplement device is pre-stored on the electronic device. For example, the fill light device includes 4 fill lights, namely fill light 1, fill light 2, fill light 3, and fill light 4. The wavelengths provided by the 4 fill lights correspond to the interval range of 620. Nanometer (nm) ~ 760nm, 592nm ~ 620nm, 578nm ~ 592nm, 500nm ~ 578nm, the exposure sequence is fill light 1 exposure, fill light 2 exposure, fill light 3 exposure, fill light 4 exposure, fill light 1 ～Fill light 4 is not exposed.

In the embodiments of the present application, the wavelength ranges of the light provided by the respective light supplement lamps of the light supplement device are also called different narrowband spectra.

103. The electronic device photographs the target object according to the exposure sequence to obtain the first image and the second image.

Exemplarily, the electronic device photographs the target object according to the exposure sequence of the fill light in the fill light device to obtain the first image and the second image. Wherein, the light source of the first image is a light supplement device and ambient light, and the light source of the second image is ambient light. Continuing to use the example in step 102, the light supplement device contains 4 light supplement lamps, and the electronic device obtains 5 images according to the exposure sequence. The 5 images include: the light supplement light 1 exposure and the image provided by the ambient light, the supplement light Light 2 exposure and ambient light provide illuminated images, fill light 3 exposure and ambient light provide illuminated images, fill light 4 exposure and ambient light provide illuminated images, fill light 1 to 4 are all not exposed but environment Light provides illuminated images. Among them, the first 4 images can be called the first image, and the last image in which all the fill lights are not exposed is called the second image.

During the shooting process, the exposure speed of each fill light is related to the shooting frame rate of the electronic device.

104. The electronic device determines the spectral curve of the target object according to the first image and the second image.

Exemplarily, the electronic device removes the second image from each first image to obtain an image illuminated only by the fill light, and then the electronic device obtains the spectrum of the target object based on the images only illuminated by the fill light curve.

According to the method for obtaining the spectral curve provided by the embodiment of the present application, the electronic device receives a user input requesting a shooting request for shooting a group of images or, according to the shooting request, controls the exposure sequence of each fill light in the fill light device according to the exposure sequence A set of images is obtained, and the set of images includes images that are illuminated by different fill lights and ambient light at the same time and images that are illuminated by only ambient light. Then, the electronic device obtains the spectral curve of the target object according to the images. In this process, different wavelengths of light are provided by the fill light to obtain images of different wavelength bands of the target object, and then the spectral curve of the target object is obtained, without the need for a dedicated spectrometer, and the cost is low. Moreover, it can be provided to ordinary users to use in their daily lives. In addition, the process of acquiring the spectral curve does not change the normal photographing architecture of the electronic device.

Hereinafter, how the electronic device in the foregoing embodiment determines the spectral curve of the target object based on the first image and the second image will be described in detail.

In a feasible design, when the electronic device determines the spectral curve of the target object based on the first image and the second image, it removes the second image from the first image to obtain the second image with the light source as the supplementary light device. After three images, the electronic device determines the spectral curve of the target object according to the third image.

Exemplarily, the fill light device includes 4 fill lights, namely fill light 1, fill light 2, fill light 3, and fill light 4. The wavelengths provided by the 4 fill lights correspond to the interval ranges respectively. 620 nanometers (nm) ~ 760nm, 592nm ~ 620nm, 578nm ~ 592nm, 500nm ~ 578nm, the electronic device obtains 4 first images and 1 second image, the light sources of the 4 first images are fill light 1+ambient light, fill light 2+ambient light, fill light 3+ambient light, fill light 4+ambient light, the light source of the second image is ambient light. Therefore, the electronic device uses technologies such as high-dynamic range (HDR) to remove the second image from the four first images, and the light sources are respectively fill light 1, fill light 2, fill light 3 and 4 third images of fill light 4. Then, the electronic device determines the spectral curve of the target object according to the third images.

In this embodiment, the electronic device obtains a third image by removing the second image from each first image, and uses each third image to determine the spectral curve of the target object to achieve the purpose of obtaining the spectral curve of the target object.

Hereinafter, how the electronic device determines the spectral curve of the target object based on the third image will be described in detail.

In a feasible design, the electronic device performs interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object.

Exemplarily, the electronic device combines the spectral response function of an image sensor (sensor) of the camera of the electronic device to perform interpolation processing on each third image to obtain the spectral curve of the target object.

In this embodiment, the spectral curve of the target object is obtained through an interpolation algorithm, so as to achieve the purpose of obtaining the spectral curve of the target object.

In a feasible design, the difference between the wavelengths of two adjacent fill lamps in the above exposure sequence is a preset difference. Exemplarily, refer to FIG. 6, which is a schematic diagram of the wavelength of the fill light in the method for obtaining a spectrum curve provided by an embodiment of the present application. Please refer to Fig. 6, the light supplement device includes 4 light supplement lamps, namely supplement light 1, supplement light 2, supplement light 3 and supplement light 4. The exposure sequence is supplement light 1, supplement light 2, For the fill light 3 and the fill light 4, the light of each fill light can be decomposed into three colors of red (red), green (green), and blue (blue). Among them, the blue light is shown by the solid line in the figure, the green light is shown by the dotted line in the figure, and the red light is shown by the dotted line in the figure. In order to distribute the wavelengths provided by the supplementary light device in the entire frequency spectrum, the difference between the wavelengths of the supplementary lights is X, that is, each supplementary light is distributed in the entire spectrum interval in steps of X, so that the Fill light can obtain narrow-band spectral images in the entire spectral range. Among them, the entire spectrum interval of the supplemental light device is, for example, the visible light spectrum and the ultraviolet spectrum.

In this embodiment, since the wavelength difference between two adjacent fill light lamps in the exposure sequence is a preset threshold, the wavelengths provided by the fill light device are distributed in the entire frequency spectrum.

In a feasible design, the first image and the second image are RGB images in the visible light frequency band of the supplementary light frequency band of the above-mentioned supplementary light device; or, the supplementary light frequency band of the above-mentioned supplementary light device is the infrared frequency band, then the first image And the second image is a red green blue infrared (RGB-IR) image.

Exemplarily, when the camera of the electronic device is used to capture RGB images, the supplement light frequency of the light supplement device is in the visible light frequency band, and when the camera of the electronic device is used to capture infrared images, the supplement light frequency of the light supplement device is the infrared frequency band. What kind of images the camera of an electronic device can capture depends on the pixels of the camera's sensor.

In this embodiment, the supplemental light frequency band of the supplemental light device may be a visible light frequency band or an infrared frequency band, so as to achieve the purpose of flexibly acquiring spectral images according to requirements.

FIG. 7 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. Please refer to FIG. 7. The electronic device 100 provided by an embodiment of the present application includes a processor 11, a memory 12, and is stored on the memory 12 and can A computer program running on the processor 11, when the processor 11 executes the program, the following steps are executed:

Receiving a photographing request input by a user, the photographing request is used to request to photograph a group of images, the group of images includes a first image and a second image, and the light source of the first image is a supplementary light device and ambient light, The light source of the second image is the ambient light, the light supplement device includes at least one light supplement lamp, and different light supplement lamps in the at least one light supplement lamp are used to provide light of different wavelengths;

According to the shooting request, controlling the exposure sequence of the light supplement lamps in the light supplement device;

Photographing the target object according to the exposure sequence to obtain the first image and the second image;

According to the first image and the second image, the spectral curve of the target object is determined.

In a feasible design, the determining the spectral curve of the target object according to the first image and the second image includes:

Removing the second image from the first image to obtain a third image whose light source is the light supplement device;

According to the third image, the spectral curve of the target object is determined.

In a feasible design, the determining the spectral curve of the target object according to the third image includes:

Perform interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object.

In a feasible design, the difference between the wavelengths of two adjacent fill lights in the exposure sequence is a preset difference.

In a feasible design, the compensation light frequency band of the light compensation device is a visible light frequency band, and the first image and the second image are red, green, and blue RGB images;

or,

The supplemental light frequency band of the supplementary light device is an infrared frequency band, and the first image and the second image are red, green, and blue infrared RGB-IR images.

In a feasible design, the light supplement device is built in the electronic equipment; or, the light supplement device is externally built in the electronic equipment.

The electronic device provided in the embodiment of the present application can perform the actions of the electronic device in the foregoing method embodiment, and its implementation principles and technical effects are similar, and will not be repeated here.

FIG. 8 is a schematic structural diagram of a chip provided by an embodiment of the present application. Please refer to FIG. 8. The chip 200 provided by an embodiment of the present application includes a processor 21 and an interface 22. The interface 22 is used to receive code instructions and transmit To the processor 21, the processor 21 runs the code instructions to perform the following steps:

Receiving a photographing request input by a user, the photographing request is used to request to photograph a group of images, the group of images includes a first image and a second image, and the light source of the first image is a supplementary light device and ambient light, The light source of the second image is the ambient light, the light supplement device includes at least one light supplement lamp, and different light supplement lamps in the at least one light supplement lamp are used to provide light of different wavelengths;

According to the shooting request, controlling the exposure sequence of the light supplement lamps in the light supplement device;

Photographing the target object according to the exposure sequence to obtain the first image and the second image;

According to the first image and the second image, the spectral curve of the target object is determined.

In a feasible design, the determining the spectral curve of the target object according to the first image and the second image includes:

Removing the second image from the first image to obtain a third image whose light source is the light supplement device;

According to the third image, the spectral curve of the target object is determined.

In a feasible design, the determining the spectral curve of the target object according to the third image includes:

Perform interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object.

In a feasible design, the difference between the wavelengths of two adjacent fill lights in the exposure sequence is a preset difference.

In a feasible design, the compensation light frequency band of the light compensation device is a visible light frequency band, and the first image and the second image are red, green, and blue RGB images;

or,

The supplemental light frequency band of the supplementary light device is an infrared frequency band, and the first image and the second image are red, green, and blue infrared RGB-IR images.

In a feasible design, the light supplement device is built in the electronic equipment; or, the light supplement device is externally built in the electronic equipment.

The chip provided in the embodiment of the present application can execute the actions of the electronic device in the foregoing method embodiment when running code instructions, and its implementation principles and technical effects are similar, and will not be repeated here.

In addition, on the basis of the foregoing method for obtaining spectral curves, the embodiments of the present application also provide a computer program product containing instructions, which when run on an electronic device, causes the electronic device to perform the actions of the electronic device in any of the foregoing embodiments. Its implementation principle and technical effect are similar, so it will not be repeated here.

On the basis of the above-mentioned method for obtaining spectral curves, the embodiments of the present application also provide a computer-readable storage medium having instructions stored in the computer-readable storage medium, which when running on an electronic device, cause the electronic device to execute any of the above The actions of the electronic device in the embodiment are similar in implementation principles and technical effects, and will not be repeated here.

The embodiment of the present application may divide the electronic device into functional modules according to the foregoing method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. It should be noted that the division of modules in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.

The term "plurality" herein refers to two or more. The term "and/or" in this article is only an association relationship describing associated objects, which means that there can be three types of relationships, for example, A and/or B can mean: A alone exists, A and B exist at the same time, exist alone B these three situations. In addition, the character "/" in this article generally indicates that the associated objects before and after are in an "or" relationship; in the formula, the character "/" indicates that the associated objects before and after are in a "division" relationship.

It can be understood that the various numerical numbers involved in the embodiments of the present application are only for easy distinction for description, and are not used to limit the scope of the embodiments of the present application.

It can be understood that, in the embodiments of the present application, the size of the sequence numbers of the foregoing processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not be implemented in this application. The implementation process of the example constitutes any limitation.

It is understandable that, in the embodiment of the present application, the memory may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or a volatile memory. (volatile memory), such as random-access memory (random-access memory, RAM). The memory is any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The memory in the embodiments of the present application may also be a circuit or any other device capable of realizing a storage function, for storing program instructions and/or data.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated as needed. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be It can be combined or integrated into another device, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate. The parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments. In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

The methods provided in the embodiments of the present application may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a dedicated computer, a computer network, a second network node, a terminal, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a digital video disc (digital video disc, DVD)), or a semiconductor medium (for example, SSD).

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any change or replacement within the technical scope disclosed in this application shall be covered by the protection scope of this application . Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (18)

A method for obtaining a spectrum curve, characterized in that it comprises: The electronic device receives a shooting request input by the user, the shooting request is used to request to shoot a group of images, the group of images includes a first image and a second image, and the light source of the first image is a light supplement device and an environment Light, the light source of the second image is the ambient light, the light supplement device includes at least one light supplement lamp, and different light supplement lamps in the at least one light supplement lamp are used to provide light of different wavelengths; The electronic device controls the exposure sequence of the light fill lamps in the light fill device according to the shooting request; The electronic device photographs the target object according to the exposure sequence to obtain the first image and the second image; The electronic device determines the spectral curve of the target object according to the first image and the second image. The method according to claim 1, wherein the electronic device determining the spectral curve of the target object according to the first image and the second image comprises: Removing the second image from the first image by the electronic device to obtain a third image whose light source is the light supplement device; The electronic device determines the spectral curve of the target object according to the third image. The method according to claim 2, wherein the electronic device determining the spectral curve of the target object according to the third image comprises: The electronic device performs interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object. The method according to any one of claims 1 to 3, wherein the difference between the wavelengths of two adjacent fill lights in the exposure sequence is a preset difference. The method according to any one of claims 1 to 4, wherein: The complementary light frequency band of the light supplement device is a visible light frequency band, and the first image and the second image are red, green, and blue RGB images; or, The supplemental light frequency band of the supplementary light device is an infrared frequency band, and the first image and the second image are red, green, and blue infrared RGB-IR images. The method according to any one of claims 1 to 5, wherein the light supplement device is built in the electronic device; or the light supplement device is externally installed in the electronic device. An electronic device, comprising: a processor, a memory, and a computer program stored on the memory and running on the processor, wherein the processor executes the program when the program is executed The following steps: Receiving a photographing request input by a user, the photographing request is used to request to photograph a group of images, the group of images includes a first image and a second image, and the light source of the first image is a supplementary light device and ambient light, The light source of the second image is the ambient light, the light supplement device includes at least one light supplement lamp, and different light supplement lamps in the at least one light supplement lamp are used to provide light of different wavelengths; According to the shooting request, controlling the exposure sequence of the light supplement lamps in the light supplement device; Photographing the target object according to the exposure sequence to obtain the first image and the second image; According to the first image and the second image, the spectral curve of the target object is determined. The device according to claim 7, wherein the determining the spectral curve of the target object according to the first image and the second image comprises: Removing the second image from the first image to obtain a third image whose light source is the light supplement device; According to the third image, the spectral curve of the target object is determined. The device according to claim 8, wherein the determining the spectral curve of the target object according to the third image comprises: Perform interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object. The device according to any one of claims 7-9, wherein the difference in wavelength between two adjacent fill lights in the exposure sequence is a preset difference. The device according to any one of claims 7 to 10, characterized in that: The complementary light frequency band of the light supplement device is a visible light frequency band, and the first image and the second image are red, green, and blue RGB images; or, The supplemental light frequency band of the supplementary light device is an infrared frequency band, and the first image and the second image are red, green, and blue infrared RGB-IR images. The device according to any one of claims 7 to 11, wherein the light supplement device is built in an electronic device; or, the light supplement device is externally built in the electronic device. A chip, characterized in that the chip includes a processor and an interface, the interface is used to receive code instructions and transmit them to the processor, and the processor runs the code instructions to perform the following steps: Receiving a photographing request input by a user, the photographing request is used to request to photograph a group of images, the group of images includes a first image and a second image, and the light source of the first image is a supplementary light device and ambient light, The light source of the second image is the ambient light, the light supplement device includes at least one light supplement lamp, and different light supplement lamps in the at least one light supplement lamp are used to provide light of different wavelengths; According to the shooting request, controlling the exposure sequence of the light supplement lamps in the light supplement device; Photographing the target object according to the exposure sequence to obtain the first image and the second image; According to the first image and the second image, the spectral curve of the target object is determined. The chip according to claim 13, wherein the determining the spectral curve of the target object according to the first image and the second image comprises: Removing the second image from the first image to obtain a third image whose light source is the light supplement device; According to the third image, the spectral curve of the target object is determined. The chip according to claim 14, wherein the determining the spectral curve of the target object according to the third image comprises: Perform interpolation processing on the third image corresponding to each of the at least one fill light to obtain the spectral curve of the target object. The chip according to any one of claims 13 to 15, wherein the difference between the wavelengths of two adjacent fill lamps in the exposure sequence is a preset difference. The chip according to any one of claims 13-16, wherein: The supplementary light frequency band of the supplementary light device is a visible light frequency band, and the first image and the second image are red, green, and blue RGB images; or, The supplemental light frequency band of the supplementary light device is an infrared frequency band, and the first image and the second image are red, green, and blue infrared RGB-IR images. The chip according to any one of claims 13 to 17, wherein the light supplement device is built in an electronic device; or the light supplement device is externally built in the electronic device.

Images