[go: up one dir, main page]

WO2018137495A1 - Appareil de prise de vues panoramique à champ de lumière - Google Patents

Appareil de prise de vues panoramique à champ de lumière Download PDF

Info

Publication number
WO2018137495A1
WO2018137495A1 PCT/CN2018/072035 CN2018072035W WO2018137495A1 WO 2018137495 A1 WO2018137495 A1 WO 2018137495A1 CN 2018072035 W CN2018072035 W CN 2018072035W WO 2018137495 A1 WO2018137495 A1 WO 2018137495A1
Authority
WO
WIPO (PCT)
Prior art keywords
light field
light
camera
panoramic
cameras
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/072035
Other languages
English (en)
Chinese (zh)
Inventor
虞晶怡
曹煊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Plex VR Digital Technology Shanghai Co Ltd
Original Assignee
Plex VR Digital Technology Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Plex VR Digital Technology Shanghai Co Ltd filed Critical Plex VR Digital Technology Shanghai Co Ltd
Publication of WO2018137495A1 publication Critical patent/WO2018137495A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view

Definitions

  • the invention relates to the field of panoramic camera imaging technology, in particular to a light field panoramic camera.
  • the existing panoramic camera can only capture 360° 2D images, that is, only the color and brightness information of the light can be collected, and the direction information of the light cannot be collected. Therefore, existing panoramic cameras can only provide viewing of "fixed” focused images, but not "refocus".
  • the 360° panorama seen by both eyes when using an existing panoramic camera can only be focused on a cylindrical surface of a fixed radius.
  • the ciliary muscles can relax and contract, thereby focusing on different objects at different distances.
  • the human eye can choose to focus on a cylindrical surface of different radii.
  • the ciliary muscle relaxes and focuses in the vicinity (ie, the radius is smaller).
  • the ciliary muscles are tight.
  • the existing panoramic camera loses the direction information of the light, and the human eye can only see the fixed focus image, and cannot refocus.
  • the technical solution adopted by the present invention includes N light field cameras, and N ⁇ 2, the light field cameras are evenly distributed and fixed on a circular support, and each light field camera takes an angle of FOV Cam , two adjacent The light field image acquired by the light field camera overlaps at an angle of FOV Overlap ; the need to satisfy: combine the color, brightness and light direction of the light collected in the FOV Cam of the adjacent two light field camera angles into a larger light.
  • Field image; splicing the light field image acquired by N light field cameras can obtain the color, brightness and light direction information of the light in the 360° panoramic range, and refocusing can be realized at any viewpoint within 360°.
  • the light field camera comprises a combination of a conventional camera and a microlens array, as shown in FIG. 3, the microlens array is embedded between the main lens overlap factor and the imaging sensor.
  • the present invention has the following advantages:
  • the overlapping angles of two adjacent light field cameras change dynamically with the number of cameras.
  • the number of light field cameras is small, considering the shooting angle of a single light field camera is large, the imaging distortion is serious, so two adjacent The light field camera captures a large overlap angle to ensure that the light field images captured by two adjacent light field cameras can be correctly stitched together.
  • Figure 1a is a schematic view (top view) of only one fixed focus plane when the human eye views a conventional panorama;
  • Figure 1b is a schematic view (side view) of only one fixed focus plane when the human eye views a conventional panorama;
  • 2a is a schematic view (top view) of refocusing at different distances in the distance when the human eye views the panoramic light field map collected by the present invention
  • 2b is a schematic view (side view) of refocusing at different distances in the distance when the human eye views the panoramic light field map collected by the present invention
  • Figure 3 is a schematic structural diagram of a light field camera
  • N 4
  • the traditional panoramic camera can only capture 360° panoramic 2D images, only contains the color and brightness information of the light within 360°, but lacks the direction information of the light; therefore, the traditional panoramic camera cannot achieve refocusing.
  • the light field camera 001 of the embodiment is modified from a conventional camera by embedding a microlens array 102 between the main lens 101 of the conventional camera and the imaging sensor 103.
  • the following embodiments of the present invention all adopt the light field camera 001 modified in this manner.
  • the angle of each light field camera is FOV Cam , and the angle of the light field image collected by two adjacent light field cameras overlaps with FOV Overlap ;
  • ⁇ is the overlap factor and ⁇ ⁇ 0; (the camera shooting range angle can not be any angle, but is determined when the camera and the lens are purchased, so the lower limit of the FOV Cam can be specified).
  • the overlap factor ⁇ is an artificially set parameter whose magnitude reflects the overlap angle of two adjacent cameras. If ⁇ is equal to zero, 360° is equally divided into N equal parts, camera shooting range angle Yes, it is not required to overlap the shooting range of adjacent cameras.
  • the panoramic camera of the light field can also be formed, but the stitched panorama has a large dead zone (ie, the area where the camera cannot capture images).
  • the value of ⁇ needs to be reasonably determined according to the angle of the shooting range of the light field camera.
  • the value of ⁇ is between [0.2, 0.4].
  • the value of ⁇ is between [0.2, 0.4].
  • the empirical value is between [0.2, 0.4], and the embodiment takes 0.3, which is an example sufficient to support the content of the claims.
  • the FOV of the light field camera selected in this embodiment is 240°, which satisfies the above requirements.
  • Each light field camera simultaneously collects information on the color, brightness and light direction of the light at an angle of 240°, and stores the three aspects of the collected information as a light field image.
  • the light field images captured by the two light field cameras partially overlap, and the light field images of the overlapping portions are fused, that is, the color, brightness and light direction of the overlapping portions of the light are merged, thereby obtaining a 360° panoramic light field image.
  • the three light field cameras 1 are evenly distributed and fixed on a circular bracket 2, and the normal lines of the adjacent two light field camera 1 lenses are 120°, according to the formula.
  • the shooting angle of the single light field camera 1 is FOV Cam ⁇ 156°, and the FOV of the light field camera 1 selected in this embodiment is 160°, which satisfies the above requirements.
  • Each light field camera simultaneously collects information on the color, brightness and light direction of the light at an angle of 160°, and stores the three aspects of the collected information as a light field image.
  • the light field images captured by any two adjacent light field cameras partially overlap, and the light field images captured by all the adjacent two light field cameras are spliced, thereby obtaining a 360° panoramic light field image.
  • the four light field cameras 1 are uniformly distributed and fixed on a circular bracket 2, and the normal lines of the adjacent two light field camera lenses are 90°, according to the formula.
  • the shooting angle of the single light field camera 1 is FOV Cam ⁇ 117°, and the FOV of the light field camera 1 selected in this embodiment is 120°, which satisfies the above requirements.
  • Each light field camera 1 simultaneously collects information on the color, brightness and light direction of the light at an angle of 120°, and stores the three aspects of the collected information as a light field image.
  • the light field images captured by any two adjacent light field cameras partially overlap, and the light field images captured by all the adjacent two light field cameras are spliced, thereby obtaining a 360° panoramic light field image.
  • the eight light field cameras 1 are uniformly distributed and fixed on a circular support 2, and the normal lines of the adjacent two light field camera 1 lenses are 45°.
  • the shooting angle of the single light field camera is FOV Cam ⁇ 58.5°, and the FOV of the light field camera selected in this embodiment is 60°, which satisfies the above requirements.
  • Each light field camera simultaneously collects information on the color, brightness and light direction of the light at an angle of 60°, and stores the three aspects of the collected information as a light field image.
  • the light field images captured by any two adjacent light field cameras partially overlap, and the light field images captured by all the adjacent two light field cameras are spliced, thereby obtaining a 360° panoramic light field image.
  • the overlap factor ⁇ can be appropriately reduced to reduce the requirement for the light field camera FOV Cam .
  • the number of light field cameras is relatively large, and only the light field camera FOV Cam ⁇ 58.5° is needed.
  • the beneficial effects of the present invention are mainly: collecting the color, brightness and light direction information of the light in the 360° range, and stitching the images of all the adjacent light field cameras by the feature point registration.
  • the linear transition fusion method is used to fuse the images of the overlapping regions, and finally a panoramic light field map is obtained, which can be refocused at any viewpoint within 360°.
  • the eye is viewing the panorama, it can be selectively focused on any object, and the human eye can obtain a more realistic panoramic viewing effect.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un appareil de prise de vues panoramique à champ de lumière, comprenant N appareils de prise de vues à champ de lumière (1), N ≥ 2. Les appareils de prise de vues à champ de lumière (1) sont uniformément répartis et fixés sur un support circulaire (2). L'angle de photographie de chaque appareil de prise de vues à champ de lumière (1) est FOVAppareil et l'angle de chevauchement entre des images de champ de lumière acquises par deux appareils adjacents de prise de vues à champ de lumière(1) est FOVChevauchement. Une image de champ de lumière panoramique capturée par l'appareil de prise de vues panoramique à champ de lumière permet une refocalisation à n'importe quel un angle de visualisation compris dans la plage de 360°, de sorte que les yeux peuvent sélectivement se focaliser sur un objet lors de la visualisation de l'image panoramique, et que les yeux peuvent obtenir un effet de visualisation panoramique plus réaliste.
PCT/CN2018/072035 2017-01-24 2018-01-10 Appareil de prise de vues panoramique à champ de lumière Ceased WO2018137495A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710062692.6 2017-01-24
CN201710062692.6A CN107450265A (zh) 2017-01-24 2017-01-24 光场全景相机

Publications (1)

Publication Number Publication Date
WO2018137495A1 true WO2018137495A1 (fr) 2018-08-02

Family

ID=60486242

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/072035 Ceased WO2018137495A1 (fr) 2017-01-24 2018-01-10 Appareil de prise de vues panoramique à champ de lumière

Country Status (2)

Country Link
CN (1) CN107450265A (fr)
WO (1) WO2018137495A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107450265A (zh) * 2017-01-24 2017-12-08 叠境数字科技（上海）有限公司 光场全景相机
CN108337434B (zh) * 2018-03-27 2020-05-22 中国人民解放军国防科技大学 一种针对光场阵列相机的焦外虚化重聚焦方法
CN110086994A (zh) * 2019-05-14 2019-08-02 宁夏融媒科技有限公司 一种基于相机阵列的全景光场的综合系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070081081A1 (en) * 2005-10-07 2007-04-12 Cheng Brett A Automated multi-frame image capture for panorama stitching using motion sensor
CN101825840A (zh) * 2010-05-06 2010-09-08 浙江大学 一种多镜头实时全景成像系统
CN101963751A (zh) * 2010-08-19 2011-02-02 西北工业大学 高分辨率实时全景高动态范围图像获取装置及方法
JP2012227679A (ja) * 2011-04-19 2012-11-15 Mathematec Corp ２眼カメラ
CN102903090A (zh) * 2012-01-20 2013-01-30 李文松 全景立体图像合成方法、装置、系统和浏览装置
CN206450959U (zh) * 2017-01-24 2017-08-29 叠境数字科技（上海）有限公司 光场全景相机
CN107450265A (zh) * 2017-01-24 2017-12-08 叠境数字科技（上海）有限公司 光场全景相机

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070081081A1 (en) * 2005-10-07 2007-04-12 Cheng Brett A Automated multi-frame image capture for panorama stitching using motion sensor
CN101825840A (zh) * 2010-05-06 2010-09-08 浙江大学 一种多镜头实时全景成像系统
CN101963751A (zh) * 2010-08-19 2011-02-02 西北工业大学 高分辨率实时全景高动态范围图像获取装置及方法
JP2012227679A (ja) * 2011-04-19 2012-11-15 Mathematec Corp ２眼カメラ
CN102903090A (zh) * 2012-01-20 2013-01-30 李文松 全景立体图像合成方法、装置、系统和浏览装置
CN206450959U (zh) * 2017-01-24 2017-08-29 叠境数字科技（上海）有限公司 光场全景相机
CN107450265A (zh) * 2017-01-24 2017-12-08 叠境数字科技（上海）有限公司 光场全景相机

Also Published As

Publication number Publication date
CN107450265A (zh) 2017-12-08

Similar Documents

Publication Publication Date Title
US10348947B2 (en) Plenoptic imaging device equipped with an enhanced optical system
US11743591B2 (en) Imaging system, method, and applications
ES2776367T3 (es) Aparato de captación de imágenes que incluye elementos de lente que tienen diferentes diámetros
US8908054B1 (en) Optics apparatus for hands-free focus
CN104835118A (zh) 通过两路鱼眼摄像头采集全景图像的方法
CN103150715A (zh) 图像拼接处理方法及装置
TWI661724B (zh) 相位檢測自動聚焦圖元陣列和相關的成像系統
CN103295231A (zh) 一种鱼眼图像拼接中鱼眼镜头垂直映射图像几何校正方法
US10057487B1 (en) Panoramic imaging systems based on normal-lens cameras
WO2011095026A1 (fr) Procédé et système de photographie
CN101540822A (zh) 高分辨率大视场航空成像装置及其方法
WO2018137495A1 (fr) Appareil de prise de vues panoramique à champ de lumière
CN206450959U (zh) 光场全景相机
WO2017219590A1 (fr) Appareil de collecte d'images et caméra panoramique
CN108205236B (zh) 全景摄像机及其镜头
CN108234904A (zh) 一种多视频融合方法、装置与系统
CN107659786A (zh) 一种全景视频监控装置及处理方法
CN105892022A (zh) 图像采集装置及全景相机
KR101469361B1 (ko) 초광각 파노라마 영상 촬영 장치
US20160252805A1 (en) Optical device for capturing images in a 360° horizontal field of view
Abdelhamid et al. 360 degrees imaging systems design, implementation and evaluation
CN108282606B (zh) 全景拼接方法及其设备
CN104010119A (zh) 360度环场实时显像装置
CN107155072A (zh) 全景拍摄方法、装置和终端设备
JP2004070002A (ja) 撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18744903

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18744903

Country of ref document: EP

Kind code of ref document: A1