[go: up one dir, main page]

WO2019119842A1 - Procédé et appareil de fusion d'image, dispositif électronique et support de stockage lisible par ordinateur - Google Patents

Procédé et appareil de fusion d'image, dispositif électronique et support de stockage lisible par ordinateur Download PDF

Info

Publication number
WO2019119842A1
WO2019119842A1 PCT/CN2018/101859 CN2018101859W WO2019119842A1 WO 2019119842 A1 WO2019119842 A1 WO 2019119842A1 CN 2018101859 W CN2018101859 W CN 2018101859W WO 2019119842 A1 WO2019119842 A1 WO 2019119842A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
exposure
pixel
infrared
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/101859
Other languages
English (en)
Chinese (zh)
Inventor
范蒙
俞海
浦世亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Publication of WO2019119842A1 publication Critical patent/WO2019119842A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/14—Optical objectives specially designed for the purposes specified below for use with infrared or ultraviolet radiation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems

Definitions

  • an embodiment of the present application provides an image fusion method, where the method includes:
  • the step of performing de-infrared processing on the remaining images in the image of each frame to obtain a visible light color image includes: performing an IR channel of the target image if the target image includes an IR channel Interpolating, generating the target image after the interpolation process, wherein the target image is the remaining image in each frame image; for each pixel in the target image after the interpolation process, updating is performed as follows Visible light color image: If the pixel has an R value, the R value of the pixel is updated: the difference between the R value of the pixel and the IR parameter value of the pixel; if the pixel has a G value, the G value of the pixel is updated: The difference between the G value of the pixel and the IR parameter value of the pixel; if the pixel has a B value, the B value of the pixel is updated: a difference between the B value of the pixel and the IR parameter value of the pixel; wherein, the pixel The IR parameter value is the product of the IR value of the IR
  • the first preset exposure is the first exposure or the last exposure of the at least two exposures.
  • an embodiment of the present application provides an electronic device, including a processor and a memory, where the memory is used to store program code, and the processor is configured to execute any of the foregoing when executing the program code stored on the memory. Method steps as described in the image fusion method.
  • FIG. 9 is a schematic structural diagram of an image fusion device according to another embodiment of the present disclosure.
  • each video image in the video can be regarded as a fused image in the present application file, that is, each frame of the video image is obtained by fusion of multi-frame original images obtained by image sensor imaging. Therefore, in the video technology field, the image capturing period may be: a start exposure time of the first frame original image corresponding to the previous frame video image, and a start exposure time of the first frame original image corresponding to the next frame video image. The time passed.
  • the infrared brightness image may be a brightness image that senses the infrared light signal. It should be noted that the infrared brightness image is not limited to a brightness image that only senses the infrared light signal, and may also be an infrared light signal. And brightness images of other band optical signals.
  • Step X Perform demosaic processing on one of the obtained frame images to generate an infrared illuminance image.
  • Step 2 The R channel value, the G channel value, the B channel value, and the IR (Infrared Spectroscopy) value in the target image obtained after the interpolation are averaged to obtain a sensed infrared brightness image after demosaic processing.
  • IR Infrared Spectroscopy
  • step 2 can obtain a sensible infrared brightness image that includes only the brightness signal, and the brightness value of each pixel in the infrared brightness image is: corresponding channel value after interpolation in the target image. average of.
  • the luminance values of each pixel in the image are: the R channel value after interpolation of the pixel, the G channel value after interpolation, the B channel value after interpolation, and the interpolation.
  • De-infrared processing is performed on the remaining images in the obtained frame images to obtain a visible light color image.
  • Step a3 performing color noise reduction processing on K1, K2, and K3 corresponding to all pixels in the visible light color image, for example, using Gaussian filtering processing to obtain K1', K2', K3' after the color noise reduction processing corresponding to each pixel.
  • Step b4 combining the processed UV component with the luminance signal of the infrared illuminating image to form a new YUV signal, and the image corresponding to the new YUV signal may be used as the final fused image;
  • the YUV signal is then converted into a new RGB signal, and the image corresponding to the new RGB signal is used as the final fused image.
  • the pre-processing unit performs wide dynamic synthesis processing on the images a and b to obtain a wide dynamic image, and performs de-infrared processing on the wide dynamic image to obtain a visible light color image.
  • the pre-processing unit also performs demosaic processing on the image c to obtain an infrared illuminance image.
  • the first preset exposure may be the first exposure or the last exposure of the at least two exposures.
  • the first determining module 120 may be specifically configured to: perform demosaic processing on one of the frames of the frames to generate an infrared brightness image.
  • the method is applied to an image fusion device, where each frame image is collected by the image fusion device; and the optical lens of the image fusion device is provided with a filter.
  • the spectral region filtered by the filter includes [T1, T2]; wherein, 600 nm ⁇ T1 ⁇ 800 nm, 750 nm ⁇ T2 ⁇ 1100 nm, and T1 ⁇ T2.
  • the step of performing infrared light filling in the exposure time corresponding to the preset exposure in the image collection period may include: following the following control manners;
  • the infrared fill light is performed in the exposure time corresponding to the preset exposure in the image acquisition period: the start time of the infrared fill light is not earlier than the exposure start time of the first preset exposure, and the end time of the infrared fill light is not late At the end of exposure of the first predetermined exposure.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Processing (AREA)

Abstract

Selon certains modes de réalisation, la présente invention concerne un procédé et un appareil de fusion d'image, un dispositif électronique et un support de stockage lisible par ordinateur. Le procédé comprend : tout d'abord l'obtention de chaque trame d'image qui est obtenue au moyen d'au moins deux expositions dans une période de collecte d'image ; la détermination d'une image de luminosité sensible à l'infrarouge sur la base de l'une des trames d'image collectées ; la réalisation d'une élimination infrarouge sur une image à traiter dans les trames d'image collectées afin d'obtenir une image de couleur visible ; et enfin la fusion de l'image de luminosité sensible à l'infrarouge et de l'image de couleur visible afin d'obtenir une image fusionnée. Dans la solution fournie par les modes de réalisation de la présente invention, les trames d'image obtenues au moyen d'au moins deux expositions dans une période de collecte d'image peuvent être collectées par un capteur d'image, et la collecte et la fusion d'image peuvent être achevées tant qu'un capteur d'image existe dans un dispositif, de façon à améliorer la qualité d'image dans le cas de faible éclairage. Par conséquent, le dispositif dans la solution fournie par les modes de réalisation de la présente invention présente une bonne adaptabilité, et est pratique à utiliser.
PCT/CN2018/101859 2017-12-20 2018-08-23 Procédé et appareil de fusion d'image, dispositif électronique et support de stockage lisible par ordinateur Ceased WO2019119842A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711381018.0A CN109951646B (zh) 2017-12-20 2017-12-20 图像融合方法、装置、电子设备及计算机可读存储介质
CN201711381018.0 2017-12-20

Publications (1)

Publication Number Publication Date
WO2019119842A1 true WO2019119842A1 (fr) 2019-06-27

Family

ID=66992522

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/101859 Ceased WO2019119842A1 (fr) 2017-12-20 2018-08-23 Procédé et appareil de fusion d'image, dispositif électronique et support de stockage lisible par ordinateur

Country Status (2)

Country Link
CN (2) CN109951646B (fr)
WO (1) WO2019119842A1 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113905185A (zh) * 2021-10-27 2022-01-07 锐芯微电子股份有限公司 图像处理方法和装置
CN114143419A (zh) * 2020-09-04 2022-03-04 聚晶半导体股份有限公司 双传感器摄像系统及其深度图计算方法
CN114157382A (zh) * 2021-12-28 2022-03-08 中电海康集团有限公司 一种光视一体机时间同步控制系统
CN114331934A (zh) * 2021-12-07 2022-04-12 杭州海康威视数字技术股份有限公司 一种图像处理方法、装置及设备
CN114500850A (zh) * 2022-02-22 2022-05-13 锐芯微电子股份有限公司 图像处理方法及装置、系统、可读存储介质
CN115187496A (zh) * 2022-07-07 2022-10-14 杭州萤石软件有限公司 可见光图像与红外光图像融合的方法、装置及电子设备
US20230123736A1 (en) * 2021-10-14 2023-04-20 Redzone Robotics, Inc. Data translation and interoperability
CN119784607A (zh) * 2024-12-26 2025-04-08 西北工业大学 一种基于语义损失函数驱动的红外双波段图像融合方法

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021016900A1 (fr) * 2019-07-31 2021-02-04 华为技术有限公司 Capteur d'image et procédé de photodétection d'image
CN112399064B (zh) * 2019-08-12 2023-05-23 浙江宇视科技有限公司 双光融合抓拍方法和相机
CN110602415B (zh) * 2019-09-30 2021-09-07 杭州海康威视数字技术股份有限公司 曝光控制装置、方法及摄像机
CN113259546B (zh) * 2020-02-11 2023-05-12 华为技术有限公司 图像获取装置和图像获取方法
CN113271414B (zh) * 2020-02-14 2022-11-18 上海海思技术有限公司 图像获取方法和装置
CN113940052B (zh) * 2020-04-29 2023-01-20 华为技术有限公司 摄像机及获取图像的方法
CN111383206B (zh) * 2020-06-01 2020-09-29 浙江大华技术股份有限公司 一种图像处理方法、装置、电子设备及存储介质
CN114374776B (zh) * 2020-10-15 2023-06-23 华为技术有限公司 摄像机以及摄像机的控制方法
CN113114926B (zh) * 2021-03-10 2022-11-25 杭州海康威视数字技术股份有限公司 一种图像处理方法、装置及摄像机
CN113112495B (zh) * 2021-04-30 2024-02-23 浙江华感科技有限公司 一种异常图像处理方法、装置、热成像设备及存储介质
CN115314628B (zh) * 2021-05-08 2024-03-01 杭州海康威视数字技术股份有限公司 一种成像方法、系统及摄像机
CN115314629B (zh) * 2021-05-08 2024-03-01 杭州海康威视数字技术股份有限公司 一种成像方法、系统及摄像机
CN113489865A (zh) * 2021-06-11 2021-10-08 浙江大华技术股份有限公司 一种单目摄像机和图像处理系统
CN113596357B (zh) * 2021-07-29 2023-04-18 北京紫光展锐通信技术有限公司 图像信号处理器、图像信号处理装置及方法、芯片、终端设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010081010A2 (fr) * 2009-01-09 2010-07-15 New York University Procédés, support accessible par ordinateur et systèmes pour faciliter une photographie avec flash invisible à l'œil humain
CN104661008A (zh) * 2013-11-18 2015-05-27 深圳中兴力维技术有限公司 低照度条件下彩色图像质量提升的处理方法和装置
CN107072644A (zh) * 2014-09-18 2017-08-18 株式会社岛津制作所 成像装置
CN107438170A (zh) * 2016-05-25 2017-12-05 杭州海康威视数字技术股份有限公司 一种图像透雾方法及实现图像透雾的图像采集设备

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040256561A1 (en) * 2003-06-17 2004-12-23 Allyson Beuhler Wide band light sensing pixel array
US8408821B2 (en) * 2010-10-12 2013-04-02 Omnivision Technologies, Inc. Visible and infrared dual mode imaging system
US9143704B2 (en) * 2012-01-20 2015-09-22 Htc Corporation Image capturing device and method thereof
CN102982518A (zh) * 2012-11-06 2013-03-20 扬州万方电子技术有限责任公司 红外与可见光动态图像的融合方法及装置
US9654704B2 (en) * 2013-03-15 2017-05-16 Infrared Integrated Systems, Ltd. Apparatus and method for multispectral imaging with three dimensional overlaying
JP2014216734A (ja) * 2013-04-24 2014-11-17 日立マクセル株式会社 撮像装置及び撮像システム
KR20150021353A (ko) * 2013-08-20 2015-03-02 삼성테크윈 주식회사 영상 융합 시스템 및 그 방법
US9723224B2 (en) * 2014-03-31 2017-08-01 Google Technology Holdings LLC Adaptive low-light identification
CN105263008B (zh) * 2014-06-19 2018-03-16 深圳中兴力维技术有限公司 低环境照度下的彩色图像质量提升方法及其装置
CN105243726B (zh) * 2014-07-11 2018-03-30 威海新北洋荣鑫科技股份有限公司 数字图像数据的获取方法及装置
JP6264233B2 (ja) * 2014-09-02 2018-01-24 株式会社Ｊｖｃケンウッド 撮像装置、撮像装置の制御方法及び制御プログラム
KR102388249B1 (ko) * 2015-11-27 2022-04-20 엘지이노텍 주식회사 일반 촬영 및 적외선 촬영 겸용 카메라 모듈
CN105611136B (zh) * 2016-02-26 2019-04-23 联想(北京)有限公司 一种图像传感器以及电子设备
CN106572289B (zh) * 2016-10-21 2019-08-20 维沃移动通信有限公司 一种摄像头模组的图像处理方法和移动终端

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010081010A2 (fr) * 2009-01-09 2010-07-15 New York University Procédés, support accessible par ordinateur et systèmes pour faciliter une photographie avec flash invisible à l'œil humain
CN104661008A (zh) * 2013-11-18 2015-05-27 深圳中兴力维技术有限公司 低照度条件下彩色图像质量提升的处理方法和装置
CN107072644A (zh) * 2014-09-18 2017-08-18 株式会社岛津制作所 成像装置
CN107438170A (zh) * 2016-05-25 2017-12-05 杭州海康威视数字技术股份有限公司 一种图像透雾方法及实现图像透雾的图像采集设备

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114143419A (zh) * 2020-09-04 2022-03-04 聚晶半导体股份有限公司 双传感器摄像系统及其深度图计算方法
CN114143419B (zh) * 2020-09-04 2023-12-26 聚晶半导体股份有限公司 双传感器摄像系统及其深度图计算方法
US20230123736A1 (en) * 2021-10-14 2023-04-20 Redzone Robotics, Inc. Data translation and interoperability
CN113905185A (zh) * 2021-10-27 2022-01-07 锐芯微电子股份有限公司 图像处理方法和装置
CN113905185B (zh) * 2021-10-27 2023-10-31 锐芯微电子股份有限公司 图像处理方法和装置
CN114331934A (zh) * 2021-12-07 2022-04-12 杭州海康威视数字技术股份有限公司 一种图像处理方法、装置及设备
CN114157382A (zh) * 2021-12-28 2022-03-08 中电海康集团有限公司 一种光视一体机时间同步控制系统
CN114157382B (zh) * 2021-12-28 2024-02-09 中电海康集团有限公司 一种光视一体机时间同步控制系统
CN114500850A (zh) * 2022-02-22 2022-05-13 锐芯微电子股份有限公司 图像处理方法及装置、系统、可读存储介质
CN114500850B (zh) * 2022-02-22 2024-01-19 锐芯微电子股份有限公司 图像处理方法及装置、系统、可读存储介质
CN115187496A (zh) * 2022-07-07 2022-10-14 杭州萤石软件有限公司 可见光图像与红外光图像融合的方法、装置及电子设备
CN119784607A (zh) * 2024-12-26 2025-04-08 西北工业大学 一种基于语义损失函数驱动的红外双波段图像融合方法

Also Published As

Publication number Publication date
CN112788249A (zh) 2021-05-11
CN112788249B (zh) 2022-12-06
CN109951646A (zh) 2019-06-28
CN109951646B (zh) 2021-01-15

Similar Documents

Publication Publication Date Title
WO2019119842A1 (fr) Procédé et appareil de fusion d'image, dispositif électronique et support de stockage lisible par ordinateur
CN111988587B (zh) 图像融合设备和图像融合方法
CN108419061B (zh) 基于多光谱的图像融合设备、方法及图像传感器
CN110493532B (zh) 一种图像处理方法和系统
CN110493506B (zh) 一种图像处理方法和系统
TWI488144B (zh) 使用由相同影像擷取裝置所擷取之場景之低解析度影像及至少一個高解析度影像來提供經改良高解析度影像的方法
CN103250405B (zh) 用于多孔径成像的闪光系统
WO2017202061A1 (fr) Procédé de désembuage d'image et appareil de capture d'image mettant en œuvre un désembuage d'image
KR20160012743A (ko) 촬영 장치 및 그 촬영 방법
CN106063249A (zh) 摄像装置及其控制方法以及计算机可读记录介质
CN103546730A (zh) 基于多摄像头的图像感光度增强方法
US9148552B2 (en) Image processing apparatus, image pickup apparatus, non-transitory storage medium storing image processing program and image processing method
JP2020187409A (ja) 画像認識装置、固体撮像装置、および画像認識方法
CN110493531B (zh) 一种图像处理方法和系统
JP4250506B2 (ja) 画像処理方法、画像処理装置、画像処理プログラムおよび撮像システム
JP5681589B2 (ja) 撮像装置及び画像処理方法
WO2020146118A1 (fr) Balance automatique des blancs assistée par enroulement de lentille
US20200077006A1 (en) Image processing method and imaging device
JP2014209689A (ja) 撮像装置及び方法
CN109345602A (zh) 图像处理方法和装置、存储介质、电子设备
CN109447925B (zh) 图像处理方法和装置、存储介质、电子设备
JP4993275B2 (ja) 画像処理装置
JP2020191506A (ja) 欠陥画素検出装置および撮像装置、並びに欠陥画素検出方法
JP2006101231A (ja) ホワイトバランス調整装置、色調整装置、ホワイトバランス調整方法、及び色調整方法
JP2011044965A (ja) 撮像装置、撮像方法及びコンピュータプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18891109

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18891109

Country of ref document: EP

Kind code of ref document: A1