WO2019000119A1 - Lighting correction method and apparatus - Google Patents
Lighting correction method and apparatus Download PDFInfo
- Publication number
- WO2019000119A1 WO2019000119A1 PCT/CN2017/085146 CN2017085146W WO2019000119A1 WO 2019000119 A1 WO2019000119 A1 WO 2019000119A1 CN 2017085146 W CN2017085146 W CN 2017085146W WO 2019000119 A1 WO2019000119 A1 WO 2019000119A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- light
- source
- detection object
- calibration plate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/141—Control of illumination
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/19—Image acquisition by sensing codes defining pattern positions
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/06—Recognition of objects for industrial automation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/246—Calibration of cameras
Definitions
- the present invention relates to the field of industrial vision technology, and in particular, to a light correction method and apparatus.
- Industrial visual inspection is an emerging detection method that achieves the required detection purpose by analyzing and calculating the characteristics of pixels, brightness, and color of the image of the object to be detected collected by the machine vision device.
- Industrial vision systems typically include a light source, an image acquisition device, an image processing device, a monitor, and the like.
- the light source is an important factor affecting the industrial visual inspection effect, which directly affects the quality and effect of the image acquired by the image acquisition device.
- the ideal light source should be evenly illuminated on the surface of the test object.
- the ideal light source does not exist, and it can only be moved closer to the ideal light source by the shape and layout of the light source. That is to say, the actual light source is unevenly illuminated on the surface of the detection object, which affects the quality and effect of the acquired image, so that there is an error between the acquired image and the actual detected object, thereby reducing the accuracy of industrial visual inspection. .
- the present invention provides a lighting correction method and apparatus, which can solve the problem that the accuracy of industrial vision detection is reduced due to uneven illumination of the light source on the surface of the detection object in the prior art.
- the present invention provides a lighting correction method, the method comprising: collecting an image of a detection object under illumination by a light source; and positioning the detection object by using at least an image of the detection object to obtain a spatial position of the detection object; The spatial position of the detection object and the light field information of the light source acquired in advance acquire the light field distribution of the visible surface of the detection object; and the image of the detection object is polished according to the light field distribution.
- the method for acquiring the light field information of the pre-acquired light source includes: collecting an image of the calibration plate under the illumination of the light source; and acquiring the incident light of the spatial position where the reflective region is located according to the image of the calibration plate and the reflectivity of the reflective area on the calibration plate. Strong; at least the light field information of the light source is obtained by using the incident light intensity.
- the incident light intensity of obtaining the spatial position of the reflective area according to the image of the calibration plate and the reflectivity of the reflective area on the calibration plate includes: positioning the reflective area according to the image of the calibration plate to obtain a spatial position where the reflective area is located; according to the calibration plate The grayscale value of the reflection area in the image acquires the reflected light intensity of the reflection area; and the incident light intensity of the spatial position where the reflection area is located is obtained according to the reflected light intensity and the reflectance of the reflection area.
- the positioning of the reflective area according to the image of the calibration plate to obtain the spatial position of the reflective area includes: positioning the calibration plate according to the image of the calibration plate to obtain spatial position information of the calibration plate; and distributing according to the reflective area on the calibration plate.
- the information and the spatial position information of the calibration plate determine the spatial location of the reflective area.
- obtaining the light field information of the light source by using at least the incident light intensity comprises: acquiring the light field information of the light source by using the incident light intensity and the radiation model corresponding to the light source.
- At least obtaining the light field information of the light source by using the incident light intensity further comprises: establishing a corresponding radiation model for the light source.
- the light source comprises a line light source and/or a surface light source
- the corresponding radiation model for the light source comprises: equalizing the line source/area source into a plurality of point sources; establishing a corresponding radiation model for each equivalent point source; The set of radiation models for all equivalent point sources is used as the radiation model for the line source/area source.
- the line source/area source is equivalent to a plurality of point sources including: collecting an image of the line source/area source; and confirming the outgoing light intensity distribution of the line source/area source according to the image of the line source/area source; according to the outgoing light intensity The distribution equalizes the line source/area source to multiple point sources.
- the light field information includes at least the intensity of the outgoing light in each visible direction of each light source.
- the method before acquiring the incident light intensity of the spatial position where the reflective region is located according to the image of the calibration plate and the reflectance of the reflective region on the calibration plate, the method further includes: acquiring a reflectance in at least one direction of the reflective region.
- the obtaining the reflectance in the at least one direction of the reflective region includes: detecting a bidirectional reflection distribution function of the reflective region to obtain an isotropic reflectance of the reflective region.
- the performing the lighting correction on the image of the detection object according to the light field distribution includes: adjusting the grayscale value of the pixel corresponding to the detection object in the image according to the light field distribution, so that the light field corresponding to the adjusted grayscale value is adjusted Evenly distributed.
- At least the positioning of the detection object by the image of the detection object to acquire the spatial position of the detection object includes acquiring the spatial position of the detection object by using the depth image of the detection object and/or the stereo model information in combination with the image of the detection object.
- the present invention also provides a light-lighting correction apparatus, the apparatus comprising: a processor and a memory, the memory storing instructions for executing the instructions to implement any of the methods provided above.
- the present invention also provides a readable storage medium storing instructions that, when executed, implement any of the methods provided above.
- the beneficial effects of the present invention are: different from the prior art, the present invention uses the spatial position of the detection object and the light field information of the light source obtained in advance to acquire the light field distribution of the visible surface of the detection object;
- the image of the object is polished to reduce the influence of uneven illumination on the image, so that the error between the image and the actual detected object is reduced, thereby improving the accuracy of industrial visual inspection.
- FIG. 1 is a schematic flow chart of a first embodiment of a lighting correction method of the present invention
- FIG. 2 is a schematic flow chart of a second embodiment of the polishing correction method of the present invention.
- FIG. 3 is a schematic flow chart of a third embodiment of the lighting correction method of the present invention.
- FIG. 4 is a schematic flow chart of positioning a reflective area in an embodiment of the lighting correction method of the present invention.
- FIG. 5 is a schematic flow chart of a fourth embodiment of the lighting correction method of the present invention.
- FIG. 6 is a schematic flow chart of a fifth embodiment of the lighting correction method of the present invention.
- FIG. 7 is a schematic flow chart of a sixth embodiment of the lighting correction method of the present invention.
- FIG. 8 is a schematic diagram of calibration of a reflective area in an embodiment of the lighting correction method of the present invention.
- Figure 9 is a schematic structural view of a first embodiment of the lighting correction device of the present invention.
- Figure 10 is a block diagram showing the structure of a second embodiment of the lighting correction device of the present invention.
- the first embodiment of the lighting correction method of the present invention includes:
- S11 Acquire an image of the detection object under illumination of the light source.
- Controlling an image capturing device such as a camera, a camera, etc., to collect a detected object under illumination of a light source image.
- the image capture device can perform photographing to capture an image of the detected object when the detected object enters its own field of view.
- S12 Position the detection object by using at least the image of the detection object to obtain the spatial position of the detection object.
- the spatial position of the detection object is for the subsequent illumination correction of the surface of the detection object
- at least the spatial coordinates of the visible surface of the detection object should be included, which can be represented by the visible surface contour shape of the detection object and the spatial coordinates of the key points. Of course, it can also be expressed by detecting the complete surface contour shape of the object and the spatial coordinates of the key points.
- the visible surface refers to the surface of the detected object in the acquired image.
- the detection object can be identified based on the image of the detection object to acquire the coordinates of the visible surface of the detection object. Since the image of the detection object is a plane image taken from a certain angle, the coordinates obtained by the recognition are only the coordinates in the plane image, and the spatial information on all dimensions of the detection object cannot be completely reflected, and it may be necessary to obtain the detection object in combination with other information. The location of the space.
- the spatial position of the detected object is acquired by using the image of the detected object in combination with the depth image and/or the stereo model information of the detected object.
- the depth image is obtained by acquiring a detection object using a depth sensor, and includes detecting a depth value of each part of the object, that is, a distance from the depth sensor.
- the spatial position of the detected object can be calculated.
- the stereo model information generally includes the shape of the detected object and the size information in each dimension.
- the distance of the detection object relative to the image acquisition device can be calculated according to the parameters of the image acquisition device, and then combined with the position of the image acquisition device and the stereo model information of the detection object, the calculation can be calculated. Detects the spatial location of the object.
- the distance between the detection object and the image acquisition device is known, If the detection object is transmitted on the marked pipeline, the marker is used to indicate the distance from the image acquisition device, then the distance between the detection object and the image acquisition device and the image acquisition device are detected according to the coordinates of the detection object in the image. The position and parameters can be used to calculate the spatial position of the detected object.
- S13 Acquire a light field distribution of the visible surface of the detection object by using the spatial position of the detection object and the light field information of the light source acquired in advance.
- detecting the light field distribution of the visible surface of the object includes detecting the intensity of the incident light of portions of the visible surface of the object, and the light field information of the light source includes the intensity of the outgoing light for each visible direction of each light source.
- the light field distribution of the visible surface of the detection object can be calculated according to the light field function of the light source and the visible surface function of the detection object.
- the visible surface of the detection object may be divided into a plurality of parts, according to the spatial position of the detection object and the known The position of each light source can calculate the distance between each part of the visible surface of the detection object relative to each light source, and combine the light attenuation coefficient (generally constant) and the light attenuation model of the light propagation medium between the light source and the detection object, and can calculate The intensity of incident light.
- the visible surface of the detection object is composed of a plurality of pixel points.
- the visible surface of the detection object may be correspondingly divided according to the distribution of the pixel points.
- Each of the divided portions corresponds to a plurality of adjacent pixels in the image.
- other methods can be used to divide the visible surface of the detected object.
- S14 Perform light correction on the image of the detection object according to the light field distribution.
- the grayscale value of each pixel corresponding to the detected object in the image reflects the reflection of the visible surface of the detected object.
- the intensity of the light, the intensity of the reflected light is proportional to the intensity of the incident light. Therefore, according to the light field distribution obtained in S13, the image of the detection object can be corrected accordingly, and the gray scale of at least part of the pixel corresponding to the detection object is adjusted. The value, the uniformity of the light field of the detected object in the image after the light correction is improved.
- the gray scale values are ⁇ g 1 , g 2 , . . . g n ⁇ , and the corresponding light field distribution is ⁇ i 1 , i 2 , . . . i n ⁇
- I j represents the light intensity after the adjustment of the jth pixel point
- int ( ⁇ ) represents an integer
- m is the maximum value of the gray scale value.
- the adjusted light field distribution ⁇ I 1 , I 2 , ... I n ⁇ is higher than the uniformity of the light field distribution of the original image, and generally shows that the variance/standard deviation of ⁇ I 1 , I 2 , ... I n ⁇ is smaller than The variance/standard deviation of ⁇ i 1 , i 2 ,...i n ⁇ . If I i is equal to the same constant for all the pixels of the corresponding detection object, the adjusted light field is evenly distributed.
- adjusting the grayscale value by multiplying the coefficient obtained according to the light field distribution is only an indication, and other methods may be used to adjust the grayscale value according to the light field distribution.
- the light field distribution of the visible surface of the detection object is acquired by using the spatial position of the detection object and the light field information of the light source acquired in advance, and the image of the detection object is corrected according to the light field distribution, and the light correction is not only corrected. It can resist the unevenness of the light field of the visible surface of the detected object in a single image, and can also resist the difference of the light field when the detected object is located at different positions in different images, and reduce the influence of the uneven illumination on the image, so that the image and the actual detected object The error between the two is reduced, thereby improving the accuracy of industrial visual inspection.
- the second embodiment of the lighting correction method of the present invention is based on the first embodiment of the lighting correction method of the present invention, and the method for acquiring the light field information of the light source includes:
- the image capturing device is controlled to collect an image of the calibration plate under illumination by the light source.
- the image capturing device in this step is the same as the image capturing device used in step S11, and the light source is the light source in step S11.
- Figure The same as the acquisition device generally means that the image acquisition devices used twice are of the same or the same type and are installed at the same position and angle.
- the calibration plate has at least one reflective area, and the reflective area can reflect the incident light, and the color thereof is not pure black. To avoid the influence of the ambient color temperature, the color of the reflective area is generally white or gray.
- the calibration plate may have a black non-reflective area in addition to the reflective area.
- the reflective area and the non-reflective area may be combined to form a specific pattern for positioning, such as a black-and-white/black-gray/black-and-white gray interlaced grid pattern. If there are more than one reflective area on the calibration plate, non-reflective areas may be provided between the different reflective areas for spacing.
- the reflectance in at least one direction of the reflective area on the calibration plate you need to obtain the reflectance in at least one direction of the reflective area on the calibration plate. If the reflectivity of the reflective region is isotropic, that is, the reflectance is independent of the incident light angle, then the incident light intensity is not required to take into account the angle of the incident light; if the reflectivity of the reflective region is not isotropic, then the calculation is performed. When the incident light intensity is taken, the angle of the incident light needs to be considered, and the angle of the incident light can be calculated according to the spatial position of the reflective region and the spatial position of the light source.
- S23 Acquire at least the light field information of the light source by using the incident light intensity.
- the light field information of the resulting light source needs to be stored for subsequent illumination correction of the image of the detected object.
- the calibration plate can be moved such that its reflective area covers each portion of the field of view of the image capture device and the first two steps are repeated each time the calibration plate is moved, the incident light intensity of each portion of the field of view can be taken as Light field information of the light source. Because of the sheer volume of data, consider modeling the relationship between incident light intensity and spatial location to reduce the amount of storage space. Moving the calibration plate includes translating and/or rotating the calibration plate to change the spatial position of the calibration plate.
- the light field information of the light source is obtained by using the radiation model corresponding to the light source and the acquired incident light intensity.
- the radiation model corresponding to the light source may be its theoretical radiation model or a radiation model established according to the characteristics of the actual light source.
- the radiation model corresponding to the light source generally includes at least the relationship between the intensity of the outgoing light of the light source and the direction, and may also include an attenuation model of the outgoing light during propagation.
- the calibration plate is moved and the first two steps are repeated several times.
- the unknown parameters in the radiation model of the light source are calculated according to the incident light intensity at different spatial positions, and the intensity of the light emitted by the light source in each visible direction can be obtained.
- the light field information of the light source includes at least the intensity of the emitted light in each visible direction, and may also include an attenuation model of the outgoing light during the propagation. If the number of light sources is greater than one, in order to simplify the model and reduce the amount of calculation, you can choose to measure independently for each light source.
- the light field of the light source is calibrated using a calibration plate of the reflectance of the known reflection region, and the light field information of the light source can be acquired for subsequent illumination correction.
- step S22 includes:
- S221 Position the reflective area according to the image of the calibration plate to obtain the spatial position where the reflective area is located.
- the coordinates of the reflection area can be identified according to the image of the calibration plate. Combined with the actual size of the reflection area, the position and parameters of the image acquisition device, the spatial coordinates of the spatial position where the reflection area is located can be calculated to realize the positioning of the reflection area.
- the reflective area can be directly positioned, or the calibration plate can be positioned first and then the spatial position of the reflective area can be confirmed according to the spatial position of the calibration plate. If the number of reflective regions is greater than one, you can also choose to locate one of the reflective regions first, and then combine the distribution of the reflective regions to determine other The spatial location of the reflective area.
- step S221 specifically includes:
- S2211 Position the calibration plate according to the image of the calibration plate to obtain spatial position information of the calibration plate.
- S2212 Determine a spatial position where the reflective area is located according to the distribution information of the reflective area on the calibration plate and the spatial position information of the calibration plate.
- the calibration plate is first positioned, and then the spatial position of the reflective region is determined according to the spatial position of the calibration plate and the distribution information of the known reflective region on the calibration plate.
- the number of reflective regions is greater than one, The identification and positioning process of different reflective regions can be omitted, especially in the case where the number of reflective regions is large, the calculation amount can be effectively reduced.
- S222 Acquire a reflected light intensity of the reflective area according to a grayscale value of the reflective area in the image of the calibration plate.
- the magnitude of the grayscale value reflects the reflected light intensity of the reflective area under illumination from the source.
- the gray scale value can be directly used to indicate the reflected light intensity, and the gray scale value can be processed to some extent, for example, after the normalization process to represent the reflected light intensity.
- S223 Acquire an incident light intensity at a spatial position where the reflective region is located according to the reflected light intensity and the reflectance of the reflective region.
- the fourth embodiment of the lighting correction method of the present invention is based on the second embodiment of the lighting correction method of the present invention.
- the radiation model of the light source is required. Further before S22, it includes:
- the types of light sources generally include point light sources, line light sources, surface light sources and combinations thereof.
- the theoretical radiation model of point light source/line light source/surface light source is based on the uniform distribution of the emitted light on the light-emitting point/line/surface. In practical applications, due to the non-uniformity of the light-emitting elements and/or the light-mixing materials, the outgoing light of the point source/line source/area source is often not uniformly distributed. In order to further improve the accuracy of the light source light field information, it is possible to select a corresponding radiation model for the light source. In the subsequent steps, the actual radiation model established in this step can be used to combine the incident light intensity of the reflection region to obtain the light field information of the light source.
- the fifth embodiment of the lighting correction method of the present invention is based on the fourth embodiment of the lighting correction method of the present invention.
- the light source includes a line source and/or a surface light source, and step S24 specifically includes:
- the camera is facing the line/surface of the line source/area source to capture its image.
- the camera used here is not necessarily the same as the image acquisition device previously used to acquire the detected object/calibration plate image.
- S242 Confirm the output light intensity distribution of the line light source/surface light source according to the image of the line light source/surface light source.
- the emission light intensity distribution is confirmed according to the gray scale value distribution of the pixel points of the corresponding line light source/surface light source in the image.
- the larger the grayscale value the higher the corresponding light intensity.
- the line source/area source is equivalent to a plurality of point sources according to the output intensity distribution.
- the line source/area source can be divided into multiple parts according to the output intensity distribution, and the degree of dispersion of the outgoing light intensity in the same part (which can be expressed by the variance or standard deviation of the gray scale value) should be less than the preset first threshold.
- the difference between the average values of the outgoing light intensities of the adjacent portions is greater than a preset second threshold. For each part that is divided, you can choose to directly equivalent it to a little light source; you can also choose to make it according to its area.
- Dividing again that is, the portion whose area is less than or equal to the third threshold is directly equivalent to the point source, and the portion having the area larger than the third threshold is again divided into at least two sub-sections whose area is less than or equal to the third threshold, and each sub-section is Equivalent to a point source.
- the theoretical model of the point source can be used as its corresponding radiation model, and the corresponding radiation model can be established according to the light intensity distribution of the point source obtained in S202.
- S245 A set of radiation models of all equivalent point sources is used as a radiation model of the line source/area source.
- the line source/area source may be selected to be integrally controlled, or may be selected.
- Independently controlling each of the line source/area source sources for example, adding an optical device to the line source/area source according to an equivalent result, the device partially transmits light, and the remaining portion is shielded from light, and the device is controlled to transmit light.
- the position and size of the part correspond to the currently controlled equivalent point source.
- the line source/area source is equivalent to a plurality of point sources according to the outgoing light intensity distribution of the line source/area source.
- the radiation model of the point source equivalent in this embodiment is closer to the ideal model, and the actual model of the equivalent point source can also be used, and the radiation model of the obtained line source/area source is more accurate.
- the sixth embodiment of the lighting correction method of the present invention is based on the second embodiment of the lighting correction method of the present invention.
- the method further includes:
- BRDF Bidirectional Reflectance Distribution Function
- the reflectivity of the reflective region can be obtained. For example, as shown in FIG. 8 , the reflection area in the lower right corner of the calibration plate in the left half of the figure is calibrated, and the reflection light is irradiated from various angles with incident light of a known light intensity to measure the reflected light intensity and the reflected light intensity. Dividing the incident light intensity as the reflectance at the current angle, an image of the reflectance-angle in the lower right corner of the figure can be drawn, and the image can represent the reflectance of the reflective region.
- the reflective area of the specular or diffuse material can be used. Since the BRDF model of the specular/diffuse material is known, a few measurements can determine the reflection of the reflected area. Rate, which simplifies the process. In addition, if the number of reflective regions on the calibration plate is greater than one and the uniformity of different reflective regions is good, only one reflective region can be calibrated, and the obtained reflectances are used as the reflectances of all reflective regions.
- This step can be performed completely every time the light source field is calibrated; it can also be selected to be performed only once (for example, at the factory or during the initial calibration of the source light field), and used directly in the calibration source light field.
- the obtained isotropic reflectance or select several angles for sampling, and verify that the obtained isotropic reflectance is correct before use.
- the first embodiment of the lighting correction device of the present invention comprises a processor 110 and a memory 120, and the processor 110 is connected to the memory 120.
- the memory 120 is used for instructions and data required for the operation of the processor 110.
- the processor 110 controls the operation of the lighting correction device, and the processor 110 may also be referred to as a CPU (Central Processing Unit).
- Processor 110 may be an integrated circuit chip with signal processing capabilities.
- the processor 110 can also be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, and discrete hardware components.
- a general purpose processor can be a microprocessor or The processor can also be any conventional processor or the like.
- the processor 110 is operative to execute instructions stored in the memory 120 to implement any of the embodiments of the present illumination correction method and the methods provided by the non-conflicting combination.
- the lighting correction device may be a separate device in the industrial vision system, disposed between the image acquisition device and the image processing device, or may be integrated with the image processing device.
- a first embodiment of the readable storage medium of the present invention includes a memory 210.
- the memory 210 stores instructions that, when executed, implement the methods provided by any of the embodiments of the lighting correction method of the present invention and combinations that do not conflict.
- the memory 210 may include a read-only memory (ROM), a random access memory (RAM), a flash memory, a hard disk, an optical disk, and the like.
- ROM read-only memory
- RAM random access memory
- flash memory a hard disk
- optical disk an optical disk
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
本发明涉及工业视觉技术领域,尤其涉及一种打光校正方法及装置。The present invention relates to the field of industrial vision technology, and in particular, to a light correction method and apparatus.
工业视觉检测是通过对机器视觉设备采集的检测对象的图像的像素、亮度、颜色等特征进行分析运算,从而达到所要求的检测目的的新兴检测手段。工业视觉系统一般包括光源、图像采集装置、图像处理装置、监视器等。Industrial visual inspection is an emerging detection method that achieves the required detection purpose by analyzing and calculating the characteristics of pixels, brightness, and color of the image of the object to be detected collected by the machine vision device. Industrial vision systems typically include a light source, an image acquisition device, an image processing device, a monitor, and the like.
光源是影响工业视觉检测效果的重要因素,它直接影响了图像采集装置采集到的图像的质量和效果。理想的光源应当在检测对象表面打光均匀。然而实际应用中,理想光源是不存在的,只能通过光源的造型和布局来尽量向理想光源靠拢。也就是说,实际的光源在检测对象表面打光不均匀,这样会影响采集到的图像的质量和效果,使得采集到的图像与实际检测物体之间存在误差,进而降低工业视觉检测的准确度。The light source is an important factor affecting the industrial visual inspection effect, which directly affects the quality and effect of the image acquired by the image acquisition device. The ideal light source should be evenly illuminated on the surface of the test object. However, in practical applications, the ideal light source does not exist, and it can only be moved closer to the ideal light source by the shape and layout of the light source. That is to say, the actual light source is unevenly illuminated on the surface of the detection object, which affects the quality and effect of the acquired image, so that there is an error between the acquired image and the actual detected object, thereby reducing the accuracy of industrial visual inspection. .
【发明内容】[Summary of the Invention]
有鉴于此,本发明提供一种打光校正方法及装置,能够解决现有技术中光源在检测对象表面打光不均匀导致工业视觉检测的准确度降低的问题。In view of the above, the present invention provides a lighting correction method and apparatus, which can solve the problem that the accuracy of industrial vision detection is reduced due to uneven illumination of the light source on the surface of the detection object in the prior art.
为解决上述问题,本发明提供的一种打光校正方法,该方法包括:采集检测对象在光源照射下的图像;至少利用检测对象的图像对检测对象进行定位以获取检测对象的空间位置;利用检测对象的空间位置及预先获取的光源的光场信息获取检测对象可见表面的光场分布;根据光场分布对检测对象的图像进行打光校正。 In order to solve the above problems, the present invention provides a lighting correction method, the method comprising: collecting an image of a detection object under illumination by a light source; and positioning the detection object by using at least an image of the detection object to obtain a spatial position of the detection object; The spatial position of the detection object and the light field information of the light source acquired in advance acquire the light field distribution of the visible surface of the detection object; and the image of the detection object is polished according to the light field distribution.
其中,预先获取的光源的光场信息的获取方式,包括:采集标定板在光源照射下的图像;根据标定板的图像及标定板上反射区域的反射率获取反射区域所在的空间位置的入射光强;至少利用入射光强获取光源的光场信息。The method for acquiring the light field information of the pre-acquired light source includes: collecting an image of the calibration plate under the illumination of the light source; and acquiring the incident light of the spatial position where the reflective region is located according to the image of the calibration plate and the reflectivity of the reflective area on the calibration plate. Strong; at least the light field information of the light source is obtained by using the incident light intensity.
其中,根据标定板的图像及标定板上反射区域的反射率获取反射区域所在空间位置的入射光强包括:根据标定板的图像对反射区域进行定位以获取反射区域所在的空间位置;根据标定板的图像中反射区域的灰阶值获取反射区域的反射光强;根据反射光强及反射区域的反射率获取反射区域所在的空间位置的入射光强。The incident light intensity of obtaining the spatial position of the reflective area according to the image of the calibration plate and the reflectivity of the reflective area on the calibration plate includes: positioning the reflective area according to the image of the calibration plate to obtain a spatial position where the reflective area is located; according to the calibration plate The grayscale value of the reflection area in the image acquires the reflected light intensity of the reflection area; and the incident light intensity of the spatial position where the reflection area is located is obtained according to the reflected light intensity and the reflectance of the reflection area.
其中,根据标定板的图像对反射区域进行定位以获取反射区域所在的空间位置包括:根据标定板的图像对标定板进行定位以获取标定板的空间位置信息;根据反射区域在标定板上的分布信息及标定板的空间位置信息确定反射区域所在的空间位置。The positioning of the reflective area according to the image of the calibration plate to obtain the spatial position of the reflective area includes: positioning the calibration plate according to the image of the calibration plate to obtain spatial position information of the calibration plate; and distributing according to the reflective area on the calibration plate. The information and the spatial position information of the calibration plate determine the spatial location of the reflective area.
其中,至少利用入射光强获取光源的光场信息包括:利用入射光强及光源对应的辐射模型获取光源的光场信息。Wherein, obtaining the light field information of the light source by using at least the incident light intensity comprises: acquiring the light field information of the light source by using the incident light intensity and the radiation model corresponding to the light source.
其中,至少利用入射光强获取光源的光场信息之前进一步包括:为光源建立对应的辐射模型。Wherein, at least obtaining the light field information of the light source by using the incident light intensity further comprises: establishing a corresponding radiation model for the light source.
其中,光源包括线光源和/或面光源,为光源建立对应的辐射模型包括:将线光源/面光源等效为多个点光源;为每个等效的点光源建立对应的辐射模型;将所有等效的点光源的辐射模型的集合作为线光源/面光源的辐射模型。Wherein, the light source comprises a line light source and/or a surface light source, and the corresponding radiation model for the light source comprises: equalizing the line source/area source into a plurality of point sources; establishing a corresponding radiation model for each equivalent point source; The set of radiation models for all equivalent point sources is used as the radiation model for the line source/area source.
其中,将线光源/面光源等效为多个点光源包括:采集线光源/面光源的图像;根据线光源/面光源的图像确认线光源/面光源的出射光强分布;根据出射光强分布将线光源/面光源等效为多个点光源。Wherein, the line source/area source is equivalent to a plurality of point sources including: collecting an image of the line source/area source; and confirming the outgoing light intensity distribution of the line source/area source according to the image of the line source/area source; according to the outgoing light intensity The distribution equalizes the line source/area source to multiple point sources.
其中,光场信息至少包括每个光源的每个可见方向的出射光强度。 Wherein, the light field information includes at least the intensity of the outgoing light in each visible direction of each light source.
其中,根据标定板的图像及标定板上反射区域的反射率获取反射区域所在的空间位置的入射光强之前进一步包括:获取反射区域至少一个方向上的反射率。Wherein, before acquiring the incident light intensity of the spatial position where the reflective region is located according to the image of the calibration plate and the reflectance of the reflective region on the calibration plate, the method further includes: acquiring a reflectance in at least one direction of the reflective region.
其中,获取反射区域至少一个方向上的的反射率包括:检测反射区域的双向反射分布函数以获取反射区域的各向反射率。The obtaining the reflectance in the at least one direction of the reflective region includes: detecting a bidirectional reflection distribution function of the reflective region to obtain an isotropic reflectance of the reflective region.
其中,根据光场分布对检测对象的图像进行打光校正包括:根据光场分布,对图像中对应检测对象的像素点的灰阶值进行调整,以使得调整之后的灰阶值对应的光场均匀分布。The performing the lighting correction on the image of the detection object according to the light field distribution includes: adjusting the grayscale value of the pixel corresponding to the detection object in the image according to the light field distribution, so that the light field corresponding to the adjusted grayscale value is adjusted Evenly distributed.
其中,至少利用检测对象的图像对检测对象进行定位以获取检测对象的空间位置包括:利用检测对象的深度图像和/或立体模型信息结合检测对象的图像获取检测对象的空间位置。Wherein, at least the positioning of the detection object by the image of the detection object to acquire the spatial position of the detection object includes acquiring the spatial position of the detection object by using the depth image of the detection object and/or the stereo model information in combination with the image of the detection object.
本发明还提供一种打光校正装置,该装置包括:处理器和存储器,存储器存储有指令,处理器用于执行指令以实现以上提供的任一种方法。The present invention also provides a light-lighting correction apparatus, the apparatus comprising: a processor and a memory, the memory storing instructions for executing the instructions to implement any of the methods provided above.
本发明还提供一种可读存储介质,该可读存储介质存储有指令,指令被执行时实现以上提供的任一种方法。The present invention also provides a readable storage medium storing instructions that, when executed, implement any of the methods provided above.
通过上述方案,本发明的有益效果是:区别于现有技术,本发明利用检测对象的空间位置及预先获取的光源的光场信息获取检测对象可见表面的光场分布;根据光场分布对检测对象的图像进行打光校正,降低打光不均匀对图像造成的影响,使得图像与实际检测物体之间的误差减小,从而提高工业视觉检测的准确度。With the above solution, the beneficial effects of the present invention are: different from the prior art, the present invention uses the spatial position of the detection object and the light field information of the light source obtained in advance to acquire the light field distribution of the visible surface of the detection object; The image of the object is polished to reduce the influence of uneven illumination on the image, so that the error between the image and the actual detected object is reduced, thereby improving the accuracy of industrial visual inspection.
为了更清楚地说明本发明实施方式中的技术方案,下面将对实施方式描述 中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施方式,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。其中:In order to explain the technical solution in the embodiment of the present invention more clearly, the following describes the embodiment. BRIEF DESCRIPTION OF THE DRAWINGS The drawings used in the following description are briefly introduced. It is obvious that the drawings in the following description are only some embodiments of the present invention, and those skilled in the art can also perform without creative work. Other figures are obtained from these figures. among them:
图1是本发明打光校正方法第一实施例的流程示意图;1 is a schematic flow chart of a first embodiment of a lighting correction method of the present invention;
图2是本发明打光校正方法第二实施例的流程示意图;2 is a schematic flow chart of a second embodiment of the polishing correction method of the present invention;
图3是本发明打光校正方法第三实施例的流程示意图;3 is a schematic flow chart of a third embodiment of the lighting correction method of the present invention;
图4是本发明打光校正方法一实施例中对反射区域进行定位的流程示意图;4 is a schematic flow chart of positioning a reflective area in an embodiment of the lighting correction method of the present invention;
图5是本发明打光校正方法第四实施例的流程示意图;5 is a schematic flow chart of a fourth embodiment of the lighting correction method of the present invention;
图6是本发明打光校正方法第五实施例的流程示意图;6 is a schematic flow chart of a fifth embodiment of the lighting correction method of the present invention;
图7是本发明打光校正方法第六实施例的流程示意图;7 is a schematic flow chart of a sixth embodiment of the lighting correction method of the present invention;
图8是本发明打光校正方法一实施例中对反射区域进行标定的示意图;FIG. 8 is a schematic diagram of calibration of a reflective area in an embodiment of the lighting correction method of the present invention; FIG.
图9是本发明打光校正装置第一实施例的结构示意图;Figure 9 is a schematic structural view of a first embodiment of the lighting correction device of the present invention;
图10是本发明打光校正装置第二实施例的结构示意图。Figure 10 is a block diagram showing the structure of a second embodiment of the lighting correction device of the present invention.
下面将结合本发明实施方式中的附图,对本发明实施方式中的技术方案进行清楚、完整地描述。以下各实施例中不相互冲突的可以任意结合。显然,所描述的实施方式仅仅是本发明一区域分实施方式,而不是全区域实施方式。基于本发明中的实施方式,本领域普通技术人员在没有做出创造性的劳动前提下所获得的所有其他实施方式,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described in the following with reference to the accompanying drawings. Any of the following embodiments that do not conflict with each other can be arbitrarily combined. It will be apparent that the described embodiments are merely a sub-area embodiment of the invention, rather than a full-area embodiment. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without departing from the inventive scope are the scope of the present invention.
如图1所示,本发明打光校正方法第一实施例包括:As shown in FIG. 1, the first embodiment of the lighting correction method of the present invention includes:
S11:采集检测对象在光源照射下的图像。S11: Acquire an image of the detection object under illumination of the light source.
控制图像采集装置,例如相机、摄像头等采集检测对象在光源照射下的图 像。图像采集装置可以在检测对象进入自身的视野范围内时进行拍摄以采集检测对象的图像。Controlling an image capturing device, such as a camera, a camera, etc., to collect a detected object under illumination of a light source image. The image capture device can perform photographing to capture an image of the detected object when the detected object enters its own field of view.
S12:至少利用检测对象的图像对检测对象进行定位以获取检测对象的空间位置。S12: Position the detection object by using at least the image of the detection object to obtain the spatial position of the detection object.
由于检测对象的空间位置是用于后续的检测对象表面的打光校正,因此应至少包括检测对象的可见表面的空间坐标,可以用检测对象的可见表面轮廓形状及关键点的空间坐标来表示,当然也可以用检测对象的完整表面轮廓形状及关键点的空间坐标来表示。可见表面是指采集到的图像中的检测对象的表面。Since the spatial position of the detection object is for the subsequent illumination correction of the surface of the detection object, at least the spatial coordinates of the visible surface of the detection object should be included, which can be represented by the visible surface contour shape of the detection object and the spatial coordinates of the key points. Of course, it can also be expressed by detecting the complete surface contour shape of the object and the spatial coordinates of the key points. The visible surface refers to the surface of the detected object in the acquired image.
根据检测对象的图像可以识别出检测对象以获取检测对象可见表面的坐标。由于检测对象的图像为从某个角度拍摄得到的平面图像,识别得到的坐标只是在该平面图像内的坐标,无法完整的反映检测对象所有维度上的空间信息,可能需要结合其他信息得到检测对象的空间位置。The detection object can be identified based on the image of the detection object to acquire the coordinates of the visible surface of the detection object. Since the image of the detection object is a plane image taken from a certain angle, the coordinates obtained by the recognition are only the coordinates in the plane image, and the spatial information on all dimensions of the detection object cannot be completely reflected, and it may be necessary to obtain the detection object in combination with other information. The location of the space.
在本发明一个实施例中,利用检测对象的图像结合检测对象的深度图像和/或立体模型信息来获取检测对象的空间位置。深度图像是使用深度传感器对检测对象进行采集得到的,包括检测对象各部分的深度值,即相对于深度传感器的距离。根据检测对象的深度值,在图像和深度图像中的坐标以及深度传感器和图像采集装置的位置和参数(包括其中的图形传感器的尺寸和分辨率),可以计算出检测对象的空间位置。立体模型信息一般包括检测对象的形状以及在各维度上的尺寸信息。根据检测对象在图像中的尺寸和其实际的尺寸,结合图像采集装置的参数可以计算出检测对象相对于图像采集装置的距离,然后结合图像采集装置的位置和检测对象的立体模型信息可以计算出检测对象的空间位置。In one embodiment of the present invention, the spatial position of the detected object is acquired by using the image of the detected object in combination with the depth image and/or the stereo model information of the detected object. The depth image is obtained by acquiring a detection object using a depth sensor, and includes detecting a depth value of each part of the object, that is, a distance from the depth sensor. Depending on the depth value of the detected object, the coordinates in the image and depth image, and the position and parameters of the depth sensor and image acquisition device (including the size and resolution of the graphics sensor therein), the spatial position of the detected object can be calculated. The stereo model information generally includes the shape of the detected object and the size information in each dimension. According to the size of the detection object in the image and its actual size, the distance of the detection object relative to the image acquisition device can be calculated according to the parameters of the image acquisition device, and then combined with the position of the image acquisition device and the stereo model information of the detection object, the calculation can be calculated. Detects the spatial location of the object.
在其他实施例中,如果检测对象与图像采集装置之间的距离是已知的,例 如检测对象在带有标记的流水线上传输,标记用来表示与图像采集装置之间的距离,那么根据检测对象在图像中的坐标,检测对象与图像采集装置之间的距离和图像采集装置的位置和参数,可以计算出检测对象的空间位置。In other embodiments, if the distance between the detection object and the image acquisition device is known, If the detection object is transmitted on the marked pipeline, the marker is used to indicate the distance from the image acquisition device, then the distance between the detection object and the image acquisition device and the image acquisition device are detected according to the coordinates of the detection object in the image. The position and parameters can be used to calculate the spatial position of the detected object.
S13:利用检测对象的空间位置及预先获取的光源的光场信息获取检测对象可见表面的光场分布。S13: Acquire a light field distribution of the visible surface of the detection object by using the spatial position of the detection object and the light field information of the light source acquired in advance.
一般而言,检测对象可见表面的光场分布包括检测对象可见表面的各部分的入射光强度,光源的光场信息包括每个光源的每个可见方向的出射光强度。In general, detecting the light field distribution of the visible surface of the object includes detecting the intensity of the incident light of portions of the visible surface of the object, and the light field information of the light source includes the intensity of the outgoing light for each visible direction of each light source.
在规则状态(光源的光场信息和检测对象的可见表面都可以用函数表示)下,检测对象可见表面的光场分布可以根据光源的光场函数和检测对象的可见表面函数计算得到。在不规则状态(光源的光场信息和检测对象的可见表面中的至少一个无法用函数表示)下,可以将检测对象的可见表面划分为多个部分,根据检测对象的空间位置和已知的每个光源的位置,能够计算出检测对象可见表面各部分相对于每个光源的距离,结合光源与检测对象之间的光传播介质的光衰减系数(一般为常数)及光衰减模型,能够计算出入射光强度。例如,光源只有一个,检测对象可见表面上的某个部分相对于该光源的距离为d,该光源在该方向上的出射光强度为I0,光衰减系数为α,则该部分的入射光强度I=I0*exp(-α*d)。Under the rule state (the light field information of the light source and the visible surface of the detection object can be represented by a function), the light field distribution of the visible surface of the detection object can be calculated according to the light field function of the light source and the visible surface function of the detection object. In an irregular state (at least one of the light field information of the light source and the visible surface of the detection object cannot be represented by a function), the visible surface of the detection object may be divided into a plurality of parts, according to the spatial position of the detection object and the known The position of each light source can calculate the distance between each part of the visible surface of the detection object relative to each light source, and combine the light attenuation coefficient (generally constant) and the light attenuation model of the light propagation medium between the light source and the detection object, and can calculate The intensity of incident light. For example, there is only one light source, and the distance between a certain portion of the visible surface of the detection object relative to the light source is d, the light intensity of the light source in the direction is I 0 , and the light attenuation coefficient is α, then the incident light of the portion Intensity I = I 0 *exp(-α*d).
在采集到的图像中,检测对象的可见表面是由多个像素点组成的,为了便于后续的打光校正,在不规则状态下,可以选择按照像素点的分布来对应划分检测对象的可见表面,划分出来的每个部分对应图像中的若干个相邻的像素点。当然也可以采用其他方式来划分检测对象的可见表面。In the acquired image, the visible surface of the detection object is composed of a plurality of pixel points. In order to facilitate subsequent illumination correction, in an irregular state, the visible surface of the detection object may be correspondingly divided according to the distribution of the pixel points. Each of the divided portions corresponds to a plurality of adjacent pixels in the image. Of course, other methods can be used to divide the visible surface of the detected object.
S14:根据光场分布对检测对象的图像进行打光校正。S14: Perform light correction on the image of the detection object according to the light field distribution.
图像中对应检测对象的各像素点的灰阶值反映了检测对象可见表面的反射 光强度,反射光的强度与入射光的强度成正比关系,因此根据S13中得到光场分布可以相应地对检测对象的图像进行打光校正,调整其中对应检测对象的至少部分像素点的灰阶值,打光校正之后的图像中检测对象的光场均匀性提高。The grayscale value of each pixel corresponding to the detected object in the image reflects the reflection of the visible surface of the detected object. The intensity of the light, the intensity of the reflected light is proportional to the intensity of the incident light. Therefore, according to the light field distribution obtained in S13, the image of the detection object can be corrected accordingly, and the gray scale of at least part of the pixel corresponding to the detection object is adjusted. The value, the uniformity of the light field of the detected object in the image after the light correction is improved.
举例说明,原始图像中对应检测对象的像素点共有n个,其灰阶值为{g1,g2,…gn},对应的光场分布为{i1,i2,…in},调整之后的灰阶值为{G1,G2,…Gn},Gj=min{int(Ij*gj/ij),m},j=1,2,…,n。其中表示Ij表示第j个像素点调整之后的光强,int(·)表示取整数,m为灰阶值的最大值。调整之后的光场分布{I1,I2,…In}比原始图像的光场分布的均匀性更高,一般表现为{I1,I2,…In}的方差/标准差小于{i1,i2,…in}的方差/标准差。如果对于所有的对应检测对象的像素点,Ii均等于同样的常数,则调整之后的光场均匀分布。本例中采用乘以根据光场分布得到的系数的方式来调整灰阶值仅为示意,也可以采用其他方式实现根据光场分布调整灰阶值。For example, there are n pixels corresponding to the detection object in the original image, and the gray scale values are {g 1 , g 2 , . . . g n }, and the corresponding light field distribution is {i 1 , i 2 , . . . i n } The adjusted grayscale values are {G 1 , G 2 , . . . G n }, G j =min{int(I j *g j /i j ), m}, j=1, 2, . . . , n. Wherein I j represents the light intensity after the adjustment of the jth pixel point, int (·) represents an integer, and m is the maximum value of the gray scale value. The adjusted light field distribution {I 1 , I 2 , ... I n } is higher than the uniformity of the light field distribution of the original image, and generally shows that the variance/standard deviation of {I 1 , I 2 , ... I n } is smaller than The variance/standard deviation of {i 1 , i 2 ,...i n }. If I i is equal to the same constant for all the pixels of the corresponding detection object, the adjusted light field is evenly distributed. In this example, adjusting the grayscale value by multiplying the coefficient obtained according to the light field distribution is only an indication, and other methods may be used to adjust the grayscale value according to the light field distribution.
通过上述实施例的实施,利用检测对象的空间位置及预先获取的光源的光场信息获取检测对象可见表面的光场分布,根据光场分布对检测对象的图像进行打光校正,打光校正不仅能对抗单一图像中检测对象可见表面的光场不均匀,还能对抗不同图像中检测对象位于不同位置时的光场差异,降低打光不均匀对图像造成的影响,使得图像与实际检测物体之间的误差减小,从而提高工业视觉检测的准确度。Through the implementation of the above embodiment, the light field distribution of the visible surface of the detection object is acquired by using the spatial position of the detection object and the light field information of the light source acquired in advance, and the image of the detection object is corrected according to the light field distribution, and the light correction is not only corrected. It can resist the unevenness of the light field of the visible surface of the detected object in a single image, and can also resist the difference of the light field when the detected object is located at different positions in different images, and reduce the influence of the uneven illumination on the image, so that the image and the actual detected object The error between the two is reduced, thereby improving the accuracy of industrial visual inspection.
如图2所示,本发明打光校正方法第二实施例,是在本发明打光校正方法第一实施例的基础上,光源的光场信息的获取方式包括:As shown in FIG. 2, the second embodiment of the lighting correction method of the present invention is based on the first embodiment of the lighting correction method of the present invention, and the method for acquiring the light field information of the light source includes:
S21:采集标定板在光源照射下的图像。S21: Acquire an image of the calibration plate under illumination of the light source.
控制图像采集装置采集标定板在光源照射下的图像。本步骤中的图像采集装置与步骤S11中所用的图像采集装置相同,光源即为步骤S11中的光源。图 像采集装置相同一般是指两次所用的图像采集装置是同一个或者同样型号,且安装在同样的位置及角度。The image capturing device is controlled to collect an image of the calibration plate under illumination by the light source. The image capturing device in this step is the same as the image capturing device used in step S11, and the light source is the light source in step S11. Figure The same as the acquisition device generally means that the image acquisition devices used twice are of the same or the same type and are installed at the same position and angle.
标定板上具有至少一个反射区域,反射区域能够反射入射光,其颜色不为纯黑,为避免环境色温的影响,反射区域的颜色一般为白色或者灰色。为了与环境区分开以降低识别难度,标定板上除了反射区域之外,还可以有黑色的非反射区域。反射区域和非反射区域可以组成特定图案以便于定位,例如黑白/黑灰/黑白灰交错的格子图案。如果标定板上的反射区域数量不止一个,那么不同的反射区域之间可以设有非反射区域以进行间隔。The calibration plate has at least one reflective area, and the reflective area can reflect the incident light, and the color thereof is not pure black. To avoid the influence of the ambient color temperature, the color of the reflective area is generally white or gray. In order to distinguish from the environment to reduce the difficulty of recognition, the calibration plate may have a black non-reflective area in addition to the reflective area. The reflective area and the non-reflective area may be combined to form a specific pattern for positioning, such as a black-and-white/black-gray/black-and-white gray interlaced grid pattern. If there are more than one reflective area on the calibration plate, non-reflective areas may be provided between the different reflective areas for spacing.
S22:根据标定板的图像及标定板上反射区域的反射率获取反射区域所在的空间位置的入射光强。S22: Obtain an incident light intensity at a spatial position where the reflective region is located according to an image of the calibration plate and a reflectance of the reflective region on the calibration plate.
执行本步骤之前需要获取标定板上反射区域至少一个方向上的反射率。如果反射区域的反射率具备各向同性,即反射率大小与入射光角度无关,那么计算入射光强时不需要考虑入射光的角度;反之如果反射区域的反射率不具备各向同性,则计算入射光强时需要考虑入射光的角度,可以根据反射区域的空间位置和光源的空间位置计算得到入射光的角度。Before performing this step, you need to obtain the reflectance in at least one direction of the reflective area on the calibration plate. If the reflectivity of the reflective region is isotropic, that is, the reflectance is independent of the incident light angle, then the incident light intensity is not required to take into account the angle of the incident light; if the reflectivity of the reflective region is not isotropic, then the calculation is performed. When the incident light intensity is taken, the angle of the incident light needs to be considered, and the angle of the incident light can be calculated according to the spatial position of the reflective region and the spatial position of the light source.
S23:至少利用入射光强获取光源的光场信息。S23: Acquire at least the light field information of the light source by using the incident light intensity.
得到的光源的光场信息需要存储下来以用于后续的检测对象的图像的打光校正。The light field information of the resulting light source needs to be stored for subsequent illumination correction of the image of the detected object.
如果能够移动标定板使其反射区域覆盖图像采集装置的视野范围中的每个部分并且每次移动标定板都重复执行前两个步骤,则可以将视野范围中的每个部分的入射光强作为光源的光场信息。由于数据量十分庞大,可以考虑对入射光强-空间位置之间的关系进行建模以减少要占用的存储空间。移动标定板包括对标定板进行平移和/或旋转,从而改变标定板的空间位置。 If the calibration plate can be moved such that its reflective area covers each portion of the field of view of the image capture device and the first two steps are repeated each time the calibration plate is moved, the incident light intensity of each portion of the field of view can be taken as Light field information of the light source. Because of the sheer volume of data, consider modeling the relationship between incident light intensity and spatial location to reduce the amount of storage space. Moving the calibration plate includes translating and/or rotating the calibration plate to change the spatial position of the calibration plate.
上述方法需要非常大的工作量,为减少工作量,在本发明一个实施例中,利用光源对应的辐射模型和获取的入射光强来获取光源的光场信息。光源对应的辐射模型可以是其理论辐射模型,也可以是根据实际光源的特性为其建立的辐射模型。The above method requires a very large workload. In order to reduce the workload, in one embodiment of the invention, the light field information of the light source is obtained by using the radiation model corresponding to the light source and the acquired incident light intensity. The radiation model corresponding to the light source may be its theoretical radiation model or a radiation model established according to the characteristics of the actual light source.
光源对应的辐射模型一般至少包括光源的出射光强度与方向的关系,除此之外,还可以包括出射光在传播过程中的衰减模型。移动标定板并重复执行前两个步骤若干次,根据得到的不同空间位置的入射光强来计算出光源的辐射模型中的未知参数,可以得到光源在每个可见方向的出射光强度。光源的光场信息中至少包括其在每个可见方向的出射光强度,除此之外,还可以包括出射光在传播过程中的衰减模型。如果光源的数量大于一,为了简化模型减少计算量,可以选择为每个光源独立测量。The radiation model corresponding to the light source generally includes at least the relationship between the intensity of the outgoing light of the light source and the direction, and may also include an attenuation model of the outgoing light during propagation. The calibration plate is moved and the first two steps are repeated several times. The unknown parameters in the radiation model of the light source are calculated according to the incident light intensity at different spatial positions, and the intensity of the light emitted by the light source in each visible direction can be obtained. The light field information of the light source includes at least the intensity of the emitted light in each visible direction, and may also include an attenuation model of the outgoing light during the propagation. If the number of light sources is greater than one, in order to simplify the model and reduce the amount of calculation, you can choose to measure independently for each light source.
通过上述实施例的实施,利用已知反射区域的反射率的标定板对光源的光场进行标定,能够获取光源的光场信息,以用于后续的打光校正。Through the implementation of the above embodiment, the light field of the light source is calibrated using a calibration plate of the reflectance of the known reflection region, and the light field information of the light source can be acquired for subsequent illumination correction.
如图3所示,本发明打光校正方法第三实施例,是在本发明打光校正方法第二实施例的基础上,步骤S22包括:As shown in FIG. 3, the third embodiment of the lighting correction method of the present invention is based on the second embodiment of the lighting correction method of the present invention, and step S22 includes:
S221:根据标定板的图像对反射区域进行定位以获取反射区域所在的空间位置。S221: Position the reflective area according to the image of the calibration plate to obtain the spatial position where the reflective area is located.
可以根据标定板的图像识别出其中的反射区域的坐标,结合反射区域的实际尺寸,图像采集装置的位置与参数,可以计算反射区域所在的空间位置的空间坐标,实现对反射区域的定位。The coordinates of the reflection area can be identified according to the image of the calibration plate. Combined with the actual size of the reflection area, the position and parameters of the image acquisition device, the spatial coordinates of the spatial position where the reflection area is located can be calculated to realize the positioning of the reflection area.
可以直接对反射区域进行定位,也可以先对标定板进行定位然后根据标定板的空间位置确认反射区域的空间位置。如果反射区域的数量大于一,也可以选择先对其中的一个反射区域进行定位,然后结合反射区域的分布来确定其他 反射区域的空间位置。The reflective area can be directly positioned, or the calibration plate can be positioned first and then the spatial position of the reflective area can be confirmed according to the spatial position of the calibration plate. If the number of reflective regions is greater than one, you can also choose to locate one of the reflective regions first, and then combine the distribution of the reflective regions to determine other The spatial location of the reflective area.
如图4所示,在本发明打光校正方法一个实施例中,步骤S221具体包括:As shown in FIG. 4, in an embodiment of the lighting correction method of the present invention, step S221 specifically includes:
S2211:根据标定板的图像对标定板进行定位以获取标定板的空间位置信息。S2211: Position the calibration plate according to the image of the calibration plate to obtain spatial position information of the calibration plate.
S2212:根据反射区域在标定板上的分布信息及标定板的空间位置信息确定反射区域所在的空间位置。S2212: Determine a spatial position where the reflective area is located according to the distribution information of the reflective area on the calibration plate and the spatial position information of the calibration plate.
本实施例中采用先对标定板进行定位,再根据标定板的空间位置和已知的反射区域在标定板上的分布信息确定反射区域的空间位置,在反射区域的数量大于一的情况下,能够省去不同反射区域的识别和定位过程,特别是在反射区域的数量较多的情况下,可以有效的减少计算量。In this embodiment, the calibration plate is first positioned, and then the spatial position of the reflective region is determined according to the spatial position of the calibration plate and the distribution information of the known reflective region on the calibration plate. When the number of reflective regions is greater than one, The identification and positioning process of different reflective regions can be omitted, especially in the case where the number of reflective regions is large, the calculation amount can be effectively reduced.
S222:根据标定板的图像中反射区域的灰阶值获取反射区域的反射光强。S222: Acquire a reflected light intensity of the reflective area according to a grayscale value of the reflective area in the image of the calibration plate.
灰阶值的大小反映了反射区域在光源照射下的反射光强。可以直接使用灰阶值来表示反射光强,也可以对灰阶值进行一定处理,例如归一化处理之后来表示反射光强。The magnitude of the grayscale value reflects the reflected light intensity of the reflective area under illumination from the source. The gray scale value can be directly used to indicate the reflected light intensity, and the gray scale value can be processed to some extent, for example, after the normalization process to represent the reflected light intensity.
S223:根据反射光强及反射区域的反射率获取反射区域所在的空间位置的入射光强。S223: Acquire an incident light intensity at a spatial position where the reflective region is located according to the reflected light intensity and the reflectance of the reflective region.
反射光强为IR,反射率为r,则入射光强Ii=IR/r。如果反射区域的反射率具有各向同性,则反射率r为常数,如果反射区域的反射率不具有各向同性,则其反射率r与入射光角度相关,计算出入射光角度之后得到该角度下的反射率。可以根据光源的空间坐标(如果是线光源/面光源,可以为其中心点)和反射区域中指定点(例如中心点)的坐标计算出两者之间连线相对于指定平面,例如水平面/垂直面的夹角θ1,根据反射区域的空间位置,能够计算出反射区域相对于该平面的夹角θ2,则入射光角度(入射光与反射区域的夹角)θ3=|θ1-θ2|。 The reflected light intensity is I R and the reflectance is r, then the incident light intensity I i =I R /r. If the reflectance of the reflective region is isotropic, the reflectance r is constant. If the reflectance of the reflective region is not isotropic, the reflectance r is related to the angle of the incident light, and the angle of the incident light is calculated to obtain the angle. Reflectivity. You can calculate the connection between the two based on the spatial coordinates of the light source (if it is the line source/surface source, its center point) and the coordinates of the specified point (such as the center point) in the reflection area, such as the horizontal plane / The angle θ 1 of the vertical plane can calculate the angle θ 2 of the reflection area with respect to the plane according to the spatial position of the reflection area, and the incident light angle (the angle between the incident light and the reflection area) θ 3 =| θ 1 -θ 2 |.
如图5所示,本发明打光校正方法第四实施例,是在本发明打光校正方法第二实施例的基础上,在获取光源的光场信息时需要用到光源的辐射模型,步骤S22之前进一步包括:As shown in FIG. 5, the fourth embodiment of the lighting correction method of the present invention is based on the second embodiment of the lighting correction method of the present invention. When acquiring the light field information of the light source, the radiation model of the light source is required. Further before S22, it includes:
S24:为光源建立对应的辐射模型。S24: Establish a corresponding radiation model for the light source.
光源的类型一般包括点光源、线光源、面光源及其组合,点光源/线光源/面光源的理论辐射模型是建立在其出射光在发光点/线/面上均匀分布的基础上的。而实际应用中,由于发光元件和/或混光材料的不均匀性,点光源/线光源/面光源的出射光往往不是均匀分布的。为进一步提高光源光场信息的准确度,可以选择为光源建立对应的辐射模型。在后续步骤中可以使用本步骤建立的实际辐射模型结合反射区域的入射光强来获取光源的光场信息。The types of light sources generally include point light sources, line light sources, surface light sources and combinations thereof. The theoretical radiation model of point light source/line light source/surface light source is based on the uniform distribution of the emitted light on the light-emitting point/line/surface. In practical applications, due to the non-uniformity of the light-emitting elements and/or the light-mixing materials, the outgoing light of the point source/line source/area source is often not uniformly distributed. In order to further improve the accuracy of the light source light field information, it is possible to select a corresponding radiation model for the light source. In the subsequent steps, the actual radiation model established in this step can be used to combine the incident light intensity of the reflection region to obtain the light field information of the light source.
如图6所示,本发明打光校正方法第五实施例,是在本发明打光校正方法第四实施例的基础上,光源包括线光源和/或面光源,步骤S24具体包括:As shown in FIG. 6 , the fifth embodiment of the lighting correction method of the present invention is based on the fourth embodiment of the lighting correction method of the present invention. The light source includes a line source and/or a surface light source, and step S24 specifically includes:
S241:采集线光源/面光源的图像。S241: Acquire an image of a line source/area source.
将相机正对线光源/面光源的发光线/面来采集其图像。这里使用的相机与之前用于采集检测物体/标定板图像的图像采集装置不一定相同。The camera is facing the line/surface of the line source/area source to capture its image. The camera used here is not necessarily the same as the image acquisition device previously used to acquire the detected object/calibration plate image.
S242:根据线光源/面光源的图像确认线光源/面光源的出射光强分布。S242: Confirm the output light intensity distribution of the line light source/surface light source according to the image of the line light source/surface light source.
根据图像中对应线光源/面光源的像素点的灰阶值分布来确认其出射光强分布。一般而言,灰阶值越大对应的光强越高。The emission light intensity distribution is confirmed according to the gray scale value distribution of the pixel points of the corresponding line light source/surface light source in the image. In general, the larger the grayscale value, the higher the corresponding light intensity.
S243:根据出射光强分布将线光源/面光源等效为多个点光源。S243: The line source/area source is equivalent to a plurality of point sources according to the output intensity distribution.
可以按照出射光强分布将线光源/面光源划分为多个部分,同一部分内的出射光强的离散程度(可以用灰阶值的方差或标准差来表示)应当小于预设的第一阈值,相邻部分的出射光强的平均值之差大于预设的第二阈值。对于划分出的每个部分,可以选择直接将其等效为一点光源;也可以选择根据其面积进行 再次划分,即将面积小于或者等于第三阈值的部分直接等效为点光源,将面积大于第三阈值的部分再次划分为至少两个面积小于或者等于第三阈值的子部分,并将每个子部分等效为一个点光源。The line source/area source can be divided into multiple parts according to the output intensity distribution, and the degree of dispersion of the outgoing light intensity in the same part (which can be expressed by the variance or standard deviation of the gray scale value) should be less than the preset first threshold. The difference between the average values of the outgoing light intensities of the adjacent portions is greater than a preset second threshold. For each part that is divided, you can choose to directly equivalent it to a little light source; you can also choose to make it according to its area. Dividing again, that is, the portion whose area is less than or equal to the third threshold is directly equivalent to the point source, and the portion having the area larger than the third threshold is again divided into at least two sub-sections whose area is less than or equal to the third threshold, and each sub-section is Equivalent to a point source.
S244:为每个等效的点光源建立对应的辐射模型。S244: Establish a corresponding radiation model for each equivalent point source.
可以采用点光源的理论模型作为其对应的辐射模型,也可以根据S202中得到的该点光源的光强分布为其建立对应的辐射模型。The theoretical model of the point source can be used as its corresponding radiation model, and the corresponding radiation model can be established according to the light intensity distribution of the point source obtained in S202.
S245:将所有等效的点光源的辐射模型的集合作为线光源/面光源的辐射模型。S245: A set of radiation models of all equivalent point sources is used as a radiation model of the line source/area source.
对于等效为多个点光源的线光源/面光源,在结合反射区域的入射光强获取该线光源/面光源的光场信息时,可以选择整体控制该线光源/面光源,也可以选择独立控制该线光源/面光源中的每个等效点光源,例如,根据等效结果在该线光源/面光源增加一光学装置,该装置部分透光,剩余部分遮光,控制该装置透光部分的位置与大小使之与当前控制的等效点光源对应。For a line source/area source equivalent to a plurality of point sources, when the light field information of the line source/area source is acquired in combination with the incident light intensity of the reflection area, the line source/area source may be selected to be integrally controlled, or may be selected. Independently controlling each of the line source/area source sources, for example, adding an optical device to the line source/area source according to an equivalent result, the device partially transmits light, and the remaining portion is shielded from light, and the device is controlled to transmit light. The position and size of the part correspond to the currently controlled equivalent point source.
本实施例中是根据线光源/面光源的出射光强分布将线光源/面光源等效为多个点光源。在其他实施例中,也可以选择简单的将线光源/面光源划分为多个部分,每个部分等效为一个点光源。两者相比,本实施例中等效出来的点光源的辐射模型更接近于理想模型,也可以使用等效点光源的实际模型,最后得到的线光源/面光源的辐射模型准确性更高。In this embodiment, the line source/area source is equivalent to a plurality of point sources according to the outgoing light intensity distribution of the line source/area source. In other embodiments, it is also possible to simply divide the line source/area source into a plurality of sections, each section being equivalent to a point source. Compared with the two, the radiation model of the point source equivalent in this embodiment is closer to the ideal model, and the actual model of the equivalent point source can also be used, and the radiation model of the obtained line source/area source is more accurate.
如图7所示,本发明打光校正方法第六实施例,是在本发明打光校正方法第二实施例的基础上,步骤S22之前进一步包括:As shown in FIG. 7, the sixth embodiment of the lighting correction method of the present invention is based on the second embodiment of the lighting correction method of the present invention. Before step S22, the method further includes:
S25:检测反射区域的双向反射分布函数以获取反射区域的各向反射率。S25: Detect a bidirectional reflection distribution function of the reflection area to obtain an isotropic reflectance of the reflection area.
这一过程也可以被称为对标定板上反射区域的标定。双向反射分布函数(Bidirectional Reflectance Distribution Function,BRDF)定义了给定入射方向上 的辐射照度(irradiance)如何影响给定出射方向上的辐射率(radiance),即入射光线经过某个表面反射后如何在各个出射方向上分布。根据BRDF可以获取反射区域的各向反射率。举例说明,如图8所示,对图中左半部分的标定板右下角的反射区域进行标定,用已知光强的入射光从各个角度照射该反射区域,测量反射光强,反射光强除以入射光强即为当前角度下的反射率,可以绘出图中右下角的反射率-角度的图像,该图像即可表示反射区域的各向反射率。This process can also be referred to as the calibration of the reflective area on the calibration plate. Bidirectional Reflectance Distribution Function (BRDF) defines a given incident direction How the irradiance affects the radiance in a given exit direction, ie how the incident ray is distributed in each direction of the exit after being reflected by a surface. According to the BRDF, the reflectivity of the reflective region can be obtained. For example, as shown in FIG. 8 , the reflection area in the lower right corner of the calibration plate in the left half of the figure is calibrated, and the reflection light is irradiated from various angles with incident light of a known light intensity to measure the reflected light intensity and the reflected light intensity. Dividing the incident light intensity as the reflectance at the current angle, an image of the reflectance-angle in the lower right corner of the figure can be drawn, and the image can represent the reflectance of the reflective region.
由于对标定板上反射区域的标定过程十分繁琐,可以使用镜面反射或者漫反射材料的反射区域,由于镜面反射/漫反射材料的BRDF模型已知,少数次测量即可确定反射区域的各向反射率,从而简化该过程。此外,如果标定板上反射区域的数量大于一,且不同反射区域的均匀性较好,可以只对一个反射区域进行标定,将获取的各向反射率作为所有反射区域的各向反射率。Since the calibration process of the reflective area on the calibration plate is very cumbersome, the reflective area of the specular or diffuse material can be used. Since the BRDF model of the specular/diffuse material is known, a few measurements can determine the reflection of the reflected area. Rate, which simplifies the process. In addition, if the number of reflective regions on the calibration plate is greater than one and the uniformity of different reflective regions is good, only one reflective region can be calibrated, and the obtained reflectances are used as the reflectances of all reflective regions.
可以在每次标定光源光场的过程中都完整执行本步骤;也可以选择只完整执行一次本步骤(例如在出厂时或者初次标定光源光场过程中),后面的标定光源光场中直接使用已获取的各向反射率,或者选择几个角度进行抽检,验证已获取的各向反射率正确之后再使用。This step can be performed completely every time the light source field is calibrated; it can also be selected to be performed only once (for example, at the factory or during the initial calibration of the source light field), and used directly in the calibration source light field. The obtained isotropic reflectance, or select several angles for sampling, and verify that the obtained isotropic reflectance is correct before use.
如图9所示,本发明打光校正装置第一实施例包括:处理器110和存储器120,处理器110连接存储器120。As shown in FIG. 9, the first embodiment of the lighting correction device of the present invention comprises a
存储器120用于处理器110工作所需的指令和数据。The
处理器110控制打光校正装置的操作,处理器110还可以称为CPU(Central Processing Unit,中央处理单元)。处理器110可能是一种集成电路芯片,具有信号的处理能力。处理器110还可以是通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。通用处理器可以是微处理器或者
该处理器也可以是任何常规的处理器等。The
处理器110用于执行存储器120中存储的指令以实现本发明打光校正方法任一实施例以及不冲突的组合所提供的方法。The
打光校正装置可以是工业视觉系统中的一个独立装置,设置于图像采集装置和图像处理装置之间,也可以与图像处理装置集成在一起。The lighting correction device may be a separate device in the industrial vision system, disposed between the image acquisition device and the image processing device, or may be integrated with the image processing device.
如图10所示,本发明可读存储介质第一实施例包括:存储器210。存储器210存储有指令,该指令被执行时实现本发明打光校正方法任一实施例以及不冲突的组合所提供的方法。As shown in FIG. 10, a first embodiment of the readable storage medium of the present invention includes a
存储器210可以包括只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、闪存(Flash Memory)、硬盘、光盘等。The
以上所述仅为本发明的实施方式,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。 The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.
Claims (15)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201780036245.1A CN109643444B (en) | 2017-06-26 | 2017-06-26 | Lighting correction method and device |
| PCT/CN2017/085146 WO2019000119A1 (en) | 2017-06-26 | 2017-06-26 | Lighting correction method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/085146 WO2019000119A1 (en) | 2017-06-26 | 2017-06-26 | Lighting correction method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019000119A1 true WO2019000119A1 (en) | 2019-01-03 |
Family
ID=64740292
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/085146 Ceased WO2019000119A1 (en) | 2017-06-26 | 2017-06-26 | Lighting correction method and apparatus |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109643444B (en) |
| WO (1) | WO2019000119A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117750595A (en) * | 2024-02-19 | 2024-03-22 | 深圳市光脉电子有限公司 | Hybrid light source control method, system, electronic equipment and storage medium |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111105365B (en) * | 2019-12-05 | 2023-10-24 | 深圳积木易搭科技技术有限公司 | Color correction method, medium, terminal and device for texture image |
| CN115631243B (en) * | 2022-09-14 | 2025-09-09 | 北京达佳互联信息技术有限公司 | Light source calibration method in light field acquisition system, related equipment and storage medium |
| CN119758370A (en) * | 2024-12-24 | 2025-04-04 | 深圳亿维瑞光科技有限公司 | Correlated imaging method and correlated imaging system for correcting nonuniform light field |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040085477A1 (en) * | 2002-10-30 | 2004-05-06 | The University Of Chicago | Method to smooth photometric variations across multi-projector displays |
| CN203632743U (en) * | 2013-12-16 | 2014-06-04 | 威海华菱光电股份有限公司 | Image acquisition apparatus |
| CN104156916A (en) * | 2014-07-31 | 2014-11-19 | 北京航空航天大学 | Light field projection method used for scene illumination recovery |
| CN104539921A (en) * | 2014-11-26 | 2015-04-22 | 北京理工大学 | Illumination compensation method based on multi-projector system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003168084A (en) * | 2001-11-30 | 2003-06-13 | Sanyo Electric Co Ltd | Personal authentication system and method |
| JP2012002541A (en) * | 2010-06-14 | 2012-01-05 | Sony Corp | Image processing device, image processing method, program, and electronic equipment |
| JP2013221767A (en) * | 2012-04-13 | 2013-10-28 | Panasonic Corp | Visual inspection device and visual inspection method |
| CN103761713A (en) * | 2014-01-21 | 2014-04-30 | 中国石油大学(华东) | Method for calibrating uneven brightness of microcosmic oil displacement experiment image |
| CN105447834B (en) * | 2015-12-28 | 2018-03-13 | 浙江工业大学 | A kind of mahjong image irradiation inequality bearing calibration of feature based classification |
-
2017
- 2017-06-26 WO PCT/CN2017/085146 patent/WO2019000119A1/en not_active Ceased
- 2017-06-26 CN CN201780036245.1A patent/CN109643444B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040085477A1 (en) * | 2002-10-30 | 2004-05-06 | The University Of Chicago | Method to smooth photometric variations across multi-projector displays |
| CN203632743U (en) * | 2013-12-16 | 2014-06-04 | 威海华菱光电股份有限公司 | Image acquisition apparatus |
| CN104156916A (en) * | 2014-07-31 | 2014-11-19 | 北京航空航天大学 | Light field projection method used for scene illumination recovery |
| CN104539921A (en) * | 2014-11-26 | 2015-04-22 | 北京理工大学 | Illumination compensation method based on multi-projector system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117750595A (en) * | 2024-02-19 | 2024-03-22 | 深圳市光脉电子有限公司 | Hybrid light source control method, system, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109643444A (en) | 2019-04-16 |
| CN109643444B (en) | 2022-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170359573A1 (en) | Method and apparatus for camera calibration using light source | |
| US8233157B2 (en) | Method and apparatus of a portable imaging-based measurement with self calibration | |
| WO2019000119A1 (en) | Lighting correction method and apparatus | |
| JP5133626B2 (en) | Surface reflection characteristic measuring device | |
| Bertin et al. | Digital stereo photogrammetry for grain-scale monitoring of fluvial surfaces: Error evaluation and workflow optimisation | |
| US12055384B2 (en) | Apparatus and method for capturing an object surface by electromagnetic radiation | |
| TWI490445B (en) | Methods, apparatus, and machine-readable non-transitory storage media for estimating a three dimensional surface shape of an object | |
| JP6519265B2 (en) | Image processing method | |
| US10746536B2 (en) | Optical displacement meter | |
| US20080151194A1 (en) | Method and System for Illumination Adjustment | |
| CN105277558B (en) | Multi-step method for studying surface and corresponding equipment | |
| WO2016145582A1 (en) | Phase deviation calibration method, 3d shape detection method and system, and projection system | |
| JP2017511038A (en) | Improved alignment method of two projection means | |
| US20160313180A1 (en) | Apparatus and method for profiling a beam of a light emitting semiconductor device | |
| KR102370888B1 (en) | Systems and Methods for 3-D Profile Determination Using Model-Based Peak Selection | |
| Frangez et al. | Surface finish classification using depth camera data | |
| US8334908B2 (en) | Method and apparatus for high dynamic range image measurement | |
| KR102602369B1 (en) | Image processing method for object with smooth surface on optical detection and detection system thereof | |
| KR101739096B1 (en) | Device and method for inspecting external appearance of display panel | |
| CN108240800B (en) | Surface topography measuring method | |
| EP3869542B1 (en) | Device and method for inspection | |
| KR100983877B1 (en) | System and method for measuring reflectance of an object | |
| KR102368707B1 (en) | Non-Lambertian Surface Inspecting System For Line Scan | |
| JP2021032580A (en) | Measuring device and measuring method | |
| JP2020129187A (en) | Contour recognition device, contour recognition system and contour recognition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17916048 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17916048 Country of ref document: EP Kind code of ref document: A1 |