[go: up one dir, main page]

WO2016036065A1 - Dispositif et procédé photographiques stéréoscopiques panoramiques - Google Patents

Dispositif et procédé photographiques stéréoscopiques panoramiques Download PDF

Info

Publication number
WO2016036065A1
WO2016036065A1 PCT/KR2015/009059 KR2015009059W WO2016036065A1 WO 2016036065 A1 WO2016036065 A1 WO 2016036065A1 KR 2015009059 W KR2015009059 W KR 2015009059W WO 2016036065 A1 WO2016036065 A1 WO 2016036065A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
image
left eye
panoramic
right eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/009059
Other languages
English (en)
Korean (ko)
Inventor
최광진
박영준
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FXGear Inc
Original Assignee
FXGear Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FXGear Inc filed Critical FXGear Inc
Publication of WO2016036065A1 publication Critical patent/WO2016036065A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators

Definitions

  • Embodiments are directed to an apparatus and method for panoramic stereo imaging, and more particularly, to an apparatus and method for acquiring a stereoscopic stereo image by combining a plurality of panoramic cameras.
  • the stereoscopic image refers to a stereoscopic image in which an image corresponding to the left eye and an image corresponding to the right eye are separately configured. For example, when the polarization of the image corresponding to both eyes different from each other, and wearing a special glasses to which the polarizer is applied to watch a stereo image, it is possible to feel a three-dimensional feeling from the image displayed on the plane.
  • the panoramic image refers to a wide viewing angle image obtained by capturing an image using a plurality of cameras arranged along a trajectory of an image to be acquired and then concatenating the obtained images.
  • the stereo image is to be obtained in the form of a panorama, since the stereo image is divided into the left eye image and the right eye image, several pairs of a left eye camera and a right eye camera must be used to obtain a panoramic stereo image.
  • FIG. 1 is a schematic configuration diagram of a conventional panoramic stereo imaging apparatus.
  • a pair of left eye cameras 101, 102, 103, and 104 that captures a left eye image and a right eye camera 111, 112, 113, and 114 that capture a right eye image are paired one by one.
  • a plurality of left eye camera-right camera pairs are disposed around the reference point 100.
  • the reference point 100 corresponds to a pivot point of the trajectory of the panoramic image.
  • the panoramic stereo imaging apparatus is applied to a head-mounted display device (HMD)
  • the head position of the user wearing the HMD may correspond to the reference point 100.
  • the image may be acquired by a left eye camera-right camera pair positioned in the corresponding direction.
  • a stereo image may be obtained using the left eye camera 101 and the right eye camera 111 arranged to photograph the direction. Since the left-eye camera-right camera pairs are arranged in various directions, even if the line of sight changes, a stereo image of the corresponding direction can be obtained, and as a result, a panoramic stereo image can be obtained.
  • the conventional panoramic stereo imaging apparatus has a limitation in matching the image boundary due to the limitation of the rig structure connecting the left eye camera and the right eye camera. That is, since the positions of the cameras are slightly separated from each other, the center of the left eye camera 101-right eye camera 111 pair and the left eye camera 102-right eye camera 112 pair do not coincide with each other in FIG. 1. As a result, a defective area is generated between the photographing area by the left eye camera 101-right eye camera 111 pair and the photographing area by the left eye camera 102-right eye camera 112 pair. This causes the panoramic image to be disconnected without naturally connecting when the user rotates the gaze direction from the front (ie, top in FIG. 1) to the right (ie, right in FIG. 1).
  • a panoramic stereo photographing apparatus and method which can always improve the defects of the image by always matching the center point of the camera combination for taking a stereo image.
  • a panoramic stereo photographing apparatus includes: a plurality of camera modules configured to acquire an image; And a control unit configured to generate a left eye panoramic image and a right eye panoramic image using the images acquired by the plurality of camera modules, and generate a stereo image using the left eye panoramic image and the right eye panoramic image.
  • Each of the plurality of camera modules may include a plurality of cameras arranged in different directions.
  • the controller selects a left eye camera and a right eye camera from each of the plurality of camera modules, generates the left eye panorama image by combining images of the selected left eye cameras, and generates the right eye panorama image by combining images of the selected right eye cameras. It can be configured to.
  • the controller may be further configured to determine a left eye camera and a right eye camera among cameras included in each camera module based on a relative position between the cameras included in each camera module and a reference point.
  • the plurality of camera modules may be symmetrically arranged with respect to a reference point, and each camera module may have the same camera arrangement as other camera modules disposed at symmetric positions with respect to each camera module with the reference point therebetween. .
  • a panorama stereo photographing method includes: capturing an image by a plurality of camera modules; Generating a left eye panoramic image and a right eye panoramic image by combining images of the plurality of camera modules by the panoramic stereo photographing apparatus; And generating a stereo image using the left eye panoramic image and the right eye panoramic image.
  • Each of the plurality of camera modules may include a plurality of cameras arranged in different directions.
  • the generating of the left eye panoramic image and the right eye panoramic image may include selecting a left eye camera and a right eye camera from each of the plurality of camera modules; Combining the images of selected left eye cameras to generate the left eye panoramic image; And combining the images of the selected right eye cameras to generate the right eye panoramic image.
  • the selecting of the left eye camera and the right eye camera may include determining a left eye camera and a right eye camera among cameras included in each camera module based on a relative position between the cameras included in each camera module and a reference point. It may include.
  • the photographing of the image may include photographing the image using a plurality of camera modules symmetrically arranged with respect to a reference point.
  • each camera module may have the same camera arrangement as another camera module disposed in a symmetrical position with respect to each camera module with the reference point therebetween.
  • the center of the left eye panoramic image and the right eye panoramic image are always aligned with the same reference point even if the line of sight corresponding to the stereo image changes. Therefore, in the conventional panoramic stereo photographing apparatus, defects may be prevented from occurring due to the limitation of the rig structure, and a panoramic stereo image may be obtained by using a relatively small number of cameras.
  • FIG. 1 is a schematic configuration diagram of a conventional panoramic stereo imaging apparatus.
  • FIG. 2 is a schematic block diagram of a panoramic stereo photographing apparatus according to an embodiment.
  • FIG. 3 is a conceptual diagram illustrating a principle of generating a stereo image.
  • FIG. 4 is a conceptual diagram illustrating the configuration of a panoramic image in the panoramic stereo photographing apparatus according to an embodiment.
  • 5A to 5C are schematic views illustrating arrangement of camera modules in the panoramic stereo photographing apparatus according to another embodiment.
  • 6 to 8 are schematic views showing the arrangement of camera modules in the panoramic stereo imaging apparatus according to another embodiment.
  • FIG. 9 is a schematic flowchart of a panoramic stereo photographing method according to an exemplary embodiment.
  • FIG. 2 is a schematic block diagram of a panoramic stereo photographing apparatus according to an embodiment.
  • the panoramic stereo photographing apparatus includes a plurality of camera modules 21-24 and a controller 20 for controlling the same.
  • Each camera module 21-24 may include a plurality of cameras.
  • the plurality of camera modules 21-24 may be symmetrically arranged with respect to the predetermined reference point 100.
  • FIG. 2 corresponds to a plan view of the user wearing the HMD and the reference point 100. May correspond to the head position of the user.
  • each of the cameras included in the camera modules 21-24 is shown in a fan shape, which is intended to conceptually indicate the shooting direction and angle of view of each camera, and the actual shape or size of the camera, or It should be understood that it does not represent the actual shooting area by the camera.
  • an image is intended to include both a single image such as a picture or a series of consecutive images such as an image.
  • a video including both an image and an audio may be included in the image described herein.
  • each camera module 21-24 are arranged to face in different directions from each other, and are configured to capture images of different directions. That is, each camera module 21-24 may be one panoramic camera. Each camera module 21-24 may be a panoramic camera capable of 360-degree omnidirectional photographing, or may be a panoramic camera capable of capturing only some angles. For example, referring to the camera module 21, the camera module 21 may include a camera 211 disposed toward the lower left of the drawing and another camera 212 disposed toward the upper right of the drawing opposite thereto. have. However, this is only an example, and the number of cameras constituting each camera module 21 and its arrangement may be different from those shown in the drawings.
  • the plurality of camera modules 21-24 may be symmetrically arranged with respect to the reference point 100.
  • each camera module 21-24 may have the same camera arrangement form as other camera modules 21-24 disposed symmetrically with respect to the reference point 100.
  • the camera module 21 of FIG. 2 has an arrangement in which two cameras 211 and 212 face left and right upper ends, respectively.
  • the camera module 24 disposed symmetrically with the camera module 21 with the reference point 100 also has an arrangement in which two cameras 241 and 242 face the lower left and upper right sides of the drawing, respectively.
  • the controller 20 is electrically connected to the plurality of camera modules 21-24, and is configured to generate a panoramic stereo image using the images obtained from the plurality of camera modules 21-24.
  • the control unit 20 may be directly connected to the plurality of camera modules 21-24 through a wired connection, or may be located at a remote location with the plurality of camera modules 21-24, and the plurality of camera modules 21 through wireless communication. -24 may be configured to receive and process the captured image.
  • the control unit 20 may be further configured to control operations by the plurality of camera modules 21-24 by transmitting control signals to the plurality of camera modules 21-24.
  • the controller 20 is configured to obtain a panoramic stereo image by using the images acquired by the plurality of camera modules 21-24.
  • the controller 20 may generate a left eye panoramic image and a right eye panoramic image, respectively, by using the images acquired by the plurality of camera modules 21-24, and generate a stereo image by combining the generated left eye and right eye panoramic images.
  • the stereo image generated as described above may include an omnidirectional stereo image, and a panorama stereo image may be obtained by presenting a specific portion of the stereo image according to the direction of the user's gaze. A detailed operation of the controller 20 will be described later with reference to FIG. 4.
  • FIG. 3 is a conceptual diagram illustrating a principle of generating a stereo image.
  • a line of sight corresponding to a stereo image is the upper right of the drawing.
  • two cameras arranged in a line of sight direction may be used among the plurality of cameras 211, 212, 221, 222, 231, 232, 241, and 242 constituting the plurality of camera modules 21-24.
  • Stereo images can be generated with the right eye camera. If there is no camera arranged to match the gaze direction, the camera arranged in the direction closest to the gaze direction may be used.
  • the camera modules 21-24 are symmetrically disposed with respect to the reference point 100 and the camera modules 21-24 disposed at the symmetrical positions have the same camera arrangement form.
  • two cameras 212 and 241 facing in the eye direction belong to two camera modules 21 and 24 positioned at symmetrical positions with respect to the reference point 100, respectively.
  • the left eye camera and the right eye camera are determined among the two cameras 212 and 241 and the reference point 100 in the eye direction.
  • the camera 212 is a left eye camera because the camera 212 is located on the left side when looking at the gaze direction from the reference point 100, and the camera 241 is located on the right side when looking at the gaze direction at the reference point 100.
  • a stereo image may be generated by using the image photographed by the camera 212 as a left eye image and the image photographed by the camera 241 as a right eye image.
  • a stereo image is generated using the above principles, and includes a plurality of cameras 211, 212, 221, 222, 231, 232, 241, which constitute the plurality of camera modules 21-24. Select the left eye cameras and the right eye cameras from 242 and generate the left eye and right eye panorama images using the selected left eye and right eye cameras. It will be described in detail with reference to Figure 4 below.
  • FIG. 4 is a conceptual diagram illustrating the configuration of a panoramic image in the panoramic stereo photographing apparatus according to an embodiment.
  • the controller may select one left eye camera from each camera module.
  • the camera arranged to photograph the left direction when the camera module is viewed from the reference point 100 may be selected as the left eye camera.
  • the camera 211, the camera 221, the camera 232, and the camera 242 were selected as the left eye camera.
  • FIGS. 4C and 4D conceptually illustrates an image photographed by each of the cameras 211, 221, 232, and 242 selected as the left eye camera.
  • the controller may configure the left eye panoramic image by combining the images photographed by the respective left eye cameras as illustrated in FIGS. 4C and 4D.
  • the panomamara image generated as described above includes an omnidirectional left eye image.
  • the above process may be similarly applied to cameras 212, 222, 231, and 241 not previously selected among the cameras constituting the camera module, thereby generating a right eye panoramic image.
  • the controller may generate a stereo image using the left eye panoramic image and the right eye panoramic image generated as described above. Since each of the left and right eye images constituting the stereo image is itself composed of a panoramic image, the generated stereo image includes the omnidirectional stereo image. By presenting a specific portion of the stereo image according to the direction of the user's gaze, a panoramic stereo image can be obtained.
  • the panoramic stereo photographing apparatus may include more or fewer camera modules arranged with reference points interposed therebetween.
  • FIG. 5A is a schematic diagram showing the arrangement of the camera modules 51-53 in the panoramic stereo photographing apparatus according to an embodiment
  • FIG. 5B is a schematic diagram of the right eye images obtained by the camera modules 51-53
  • FIG. 5C is a schematic diagram of the left eye images obtained by the camera modules 51-53.
  • the panoramic stereo photographing apparatus includes camera modules 51-53 and a controller (not shown), and the camera modules 51-53 are arranged in a triangle shape.
  • the camera modules 51-53 may be disposed at each vertex position of the equilateral triangle, and the center of the equilateral triangle may correspond to the reference point.
  • each of the camera modules 51-53 may function as one panoramic camera.
  • a right eye panoramic image is generated using the right eye images shown in FIG. 5B in the same manner as the embodiment of FIG. 4, and a left eye panoramic image is generated in the same manner as the embodiment of FIG. 4 using the left eye images shown in FIG. 5C. can do.
  • a panoramic stereo image may be generated using the generated right eye panoramic image and the left eye panoramic image.
  • the panoramic stereo photographing apparatus may include a plurality of camera modules and a controller (not shown) disposed three-dimensionally in space as illustrated in FIGS. 6 to 8.
  • a controller not shown
  • FIGS. 6 to 8 eight camera modules 61-68 are disposed at each vertex position of the cube
  • six camera modules 71-76 are disposed at each vertex position of the octahedron
  • four camera modules 81-84 are disposed at each vertex position of the tetrahedron.
  • each of the camera modules 61-68, 71-76 and 81-84 functions as one panoramic camera.
  • the left eye and right eye panorama images are respectively generated in the same manner as described above with reference to FIG. 4, and the left eye and right eye panorama images are used.
  • the left eye and right eye panorama images are used.
  • FIG. 6 to 8 merely illustrate an arrangement of three-dimensional camera modules, and the arrangement of camera modules in the panoramic stereo imaging apparatus according to the embodiments is not limited thereto, and is not illustrated herein. Other different forms.
  • FIG. 9 is a schematic flowchart of a panoramic stereo photographing method according to an exemplary embodiment.
  • the panorama stereo imaging method according to the present embodiment may be performed by the above-described panorama stereo imaging apparatus.
  • an image may be acquired using a plurality of camera modules (S101).
  • one left eye camera and one right eye camera may be determined in each camera module (S102). Specifically, when the camera module is viewed from the reference point among the cameras constituting each camera module, the cameras disposed on the left side may be selected as the left eye camera, and the cameras disposed toward the right side may be selected as the right eye camera. .
  • a left eye panoramic image may be generated using the selected left eye cameras (S103), and a right eye panoramic image may be generated using the selected right eye cameras (S104).
  • a panoramic stereo image may be generated using the left eye panoramic image and the right eye panoramic image (S105).
  • the left eye panoramic image and the right eye panoramic image of the whole orientation may be generated using the left eye camera and the right eye camera selected from each camera module, respectively.
  • a panoramic stereo image may be obtained by combining the left eye and right eye panorama images thus generated. Therefore, a panoramic stereo image in the corresponding gaze direction may be obtained regardless of the direction of the user's gaze.
  • Embodiments are directed to an apparatus and method for panoramic stereo imaging, and more particularly, to an apparatus and method for acquiring a stereoscopic stereo image by combining a plurality of panoramic cameras.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

La présente invention concerne un dispositif photographique stéréoscopique panoramique pouvant comporter: des modules multiples d'appareils photographiques configurés pour obtenir des images; et une unité de commande configurée pour générer une image panoramique d'œil gauche et une image panoramique d'œil droit en utilisant les images obtenues par les modules multiples d'appareils photographiques et pour générer une image stéréoscopique en utilisant l'image panoramique d'œil gauche et l'image panoramique d'œil droit. Le dispositif photographique stéréoscopique panoramique est configuré de telle façon que les centres de l'image panoramique d'œil gauche et de l'image panoramique d'œil droit sont toujours alignés au même point de référence même si la direction de visée change. En conséquence, l'apparition de défauts dans les frontières d'images due à une limitation d'une structure de montage dans les dispositifs photographiques stéréoscopiques panoramiques conventionnels peut être empêchée, et une image stéréoscopique panoramique peut être obtenue à l'aide d'un nombre relativement réduit d'appareils photographiques.
PCT/KR2015/009059 2014-09-03 2015-08-28 Dispositif et procédé photographiques stéréoscopiques panoramiques Ceased WO2016036065A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020140116847A KR20160028165A (ko) 2014-09-03 2014-09-03 파노라마 스테레오 촬영 장치 및 방법
KR10-2014-0116847 2014-09-03

Publications (1)

Publication Number Publication Date
WO2016036065A1 true WO2016036065A1 (fr) 2016-03-10

Family

ID=55440061

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/009059 Ceased WO2016036065A1 (fr) 2014-09-03 2015-08-28 Dispositif et procédé photographiques stéréoscopiques panoramiques

Country Status (2)

Country Link
KR (1) KR20160028165A (fr)
WO (1) WO2016036065A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107172413A (zh) * 2016-03-21 2017-09-15 三立房有限公司 现实场景视频显示方法和系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003131309A (ja) * 2001-10-26 2003-05-09 Konica Corp 撮影方法および撮影装置
JP2004514951A (ja) * 2000-11-29 2004-05-20 アールヴイシー　エルエルシー 球面立体視撮影システム及びその方法
JP2011160442A (ja) * 2003-06-03 2011-08-18 Leonard P Steuart Iii ディジタル３ｄ／３６０度カメラシステム
US8004558B2 (en) * 2005-04-07 2011-08-23 Axis Engineering Technologies, Inc. Stereoscopic wide field of view imaging system
KR20120121743A (ko) * 2011-04-27 2012-11-06 삼성테크윈 주식회사 3차원 영상을 생성하는 감시 시스템

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4654015B2 (ja) 2004-12-08 2011-03-16 京セラ株式会社 カメラ装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004514951A (ja) * 2000-11-29 2004-05-20 アールヴイシー　エルエルシー 球面立体視撮影システム及びその方法
JP2003131309A (ja) * 2001-10-26 2003-05-09 Konica Corp 撮影方法および撮影装置
JP2011160442A (ja) * 2003-06-03 2011-08-18 Leonard P Steuart Iii ディジタル３ｄ／３６０度カメラシステム
US8004558B2 (en) * 2005-04-07 2011-08-23 Axis Engineering Technologies, Inc. Stereoscopic wide field of view imaging system
KR20120121743A (ko) * 2011-04-27 2012-11-06 삼성테크윈 주식회사 3차원 영상을 생성하는 감시 시스템

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107172413A (zh) * 2016-03-21 2017-09-15 三立房有限公司 现实场景视频显示方法和系统

Also Published As

Publication number Publication date
KR20160028165A (ko) 2016-03-11

Similar Documents

Publication Publication Date Title
WO2016027930A1 (fr) Dispositif portatif et son procédé de commande
WO2002044808A3 (fr) Systeme et procede de photographie stereoscopique spherique
WO2012060564A1 (fr) Appareil-photo 3d
CN106162145B (zh) 基于无人机的立体图像生成方法、装置
WO2018000892A1 (fr) Procédé d'imagerie, appareil et système permettant une image stéréo panoramique
TW201832115A (zh) 虛擬實境頭戴設備
CN103780817A (zh) 摄像组件
US10645340B2 (en) Video communication device and method for video communication
WO2011134215A1 (fr) Dispositif de caméra stéréoscopique
JP2011141381A (ja) 立体画像表示装置及び立体画像表示方法
WO2012046964A2 (fr) Dispositif d'affichage d'image stéréoscopique destiné à afficher une image stéréoscopique en traçant une position focalisée
CN107646193B (zh) 双目立体视觉图像的提供方法、传送装置和照相机单元
JP6649010B2 (ja) 情報処理装置
WO2013180442A1 (fr) Appareil et caméra pour filmer de la vidéo en 3d
WO2016036065A1 (fr) Dispositif et procédé photographiques stéréoscopiques panoramiques
JP2011135202A (ja) 映像信号処理装置及び映像信号処理方法
JPH07250352A (ja) 立体撮像表示方式
JPH06148763A (ja) 多人数観測用レンチキュラ立体表示方式
US12278943B2 (en) Display device and display method therefor
WO2012165717A1 (fr) Appareil pour générer une image tridimensionnelle (3d) stéréoscopique à l'aide d'un module asymétrique à deux caméras et procédé associé
JPH02291787A (ja) 広視野表示装置
WO2014185578A1 (fr) Procédé d'alignement d'axe optique d'appareil photo stéréo de type orthogonal et appareil photo stéréo de type orthogonal
JP2011182003A (ja) パノラマカメラ及び３６０度パノラマ立体映像システム
JP2002344998A (ja) 立体画像表示装置
WO2013055012A1 (fr) Lunettes à obturateurs pour images 3d

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15838779

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15838779

Country of ref document: EP

Kind code of ref document: A1