[go: up one dir, main page]

WO2016195167A1 - Procédé de conversion de contenu, appareil de conversion de contenu, et programme de génération d'hologramme multicouche - Google Patents

Procédé de conversion de contenu, appareil de conversion de contenu, et programme de génération d'hologramme multicouche Download PDF

Info

Publication number
WO2016195167A1
WO2016195167A1 PCT/KR2015/009492 KR2015009492W WO2016195167A1 WO 2016195167 A1 WO2016195167 A1 WO 2016195167A1 KR 2015009492 W KR2015009492 W KR 2015009492W WO 2016195167 A1 WO2016195167 A1 WO 2016195167A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
content
background image
target image
stacked
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/009492
Other languages
English (en)
Korean (ko)
Inventor
오병기
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
3d Factory Co Ltd
Original Assignee
3d Factory Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 3d Factory Co Ltd filed Critical 3d Factory Co Ltd
Publication of WO2016195167A1 publication Critical patent/WO2016195167A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/26—Processes or apparatus specially adapted to produce multiple sub- holograms or to obtain images from them, e.g. multicolour technique
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof

Definitions

  • the present invention relates to a method, an apparatus and a program for converting content for stacked holograms.
  • the 3D (3D) image technology is a new concept of realistic image media that enhances the quality of visual information unlike the actual 2D image. It is expected to lead the culture.
  • Such a 3D stereoscopic image may be obtained by directly photographing through a plurality of cameras, or may be obtained through a method of converting a 2D planar image into a 3D stereoscopic image having a stereoscopic feeling.
  • depth information is applied to an object of the 2D planar image so that the 2D planar image may be converted into a 3D stereoscopic image.
  • 3D stereoscopic images are displayed in a multi-view autostereoscopic 3D (AS3D; AutoStereoscopic 3D) on a three-dimensional space, and according to an increase in the need to express objects more realistically and consistently, a plurality of 3D images are converted into AS3D images.
  • AS3D Autostereoscopic 3D
  • Technology is being used.
  • a multiview AS3D image integrates and displays a 3D image in a 3D space as a multiview stereoscopic image. Therefore, a problem arises in that the consistency of the three-dimensional effect of the three-dimensional effect is weak at one time point and the three-dimensional effect is relatively strong at another point occurs. This problem causes a ghost phenomenon that causes viewers to experience visual fatigue or dizziness.
  • an object of the present invention is to propose a technology for producing a content for displaying a multi-view 3D stereoscopic image in which a stereoscopic effect is improved without ghosting by using 2D image contents.
  • an embodiment of the present invention proposes a content production method for providing a hologram with improved three-dimensional effect.
  • a content conversion method of a content conversion apparatus for a stacked hologram for generating a stacked hologram from a single 2D video content includes: extracting a still image from the 2D video content according to a predetermined frame rate; Separating the target image and the background image including one or more objects from the extracted still image, performing mapping using the specific map on each of the separated target image and the background image, and the mapped target image And generating a multiview image for each of the background images using depth and stereoscopic values.
  • Another embodiment of the present invention is an extraction module for extracting a still image according to a predetermined frame rate from the 2D image content, and separating the object image and the background image containing one or more objects with respect to the extracted still image, Stacking type from one 2D image content including a mapping module for mapping each target image and background image using a specific map, and a viewpoint conversion module for generating a multiview image for each mapped target image and background image It is characterized by providing a content conversion apparatus for stacked holograms for generating holograms.
  • the target video and the background video can be reproduced on two physically separated displays, thereby creating a three-dimensional image without dizziness or ghosting. Can provide.
  • FIG. 1 is a block diagram showing a main configuration of a content conversion apparatus for stacked holograms according to the present invention.
  • 3A and 3B are exemplary views for explaining generation of a target image and a background image according to an embodiment of the present disclosure.
  • FIG. 4 is a flowchart illustrating a mapping according to an embodiment of the present disclosure.
  • 5A to 5E are exemplary diagrams for explaining mapping of the target image and the background image according to one embodiment of the present specification.
  • 6A and 6B are exemplary diagrams for describing a method of generating a multiview image, according to an exemplary embodiment.
  • FIG. 7 is an exemplary diagram illustrating a format of a target image and a background image content generated according to an embodiment of the present specification.
  • FIG. 8 is an exemplary view for explaining a method for synchronizing a target image and a background image into one file according to an embodiment of the present specification.
  • FIG. 9 is an exemplary view for explaining a setup method for displaying a target image and a background image according to an embodiment of the present specification.
  • FIG. 10 is an exemplary diagram in which a stacked hologram implementing system according to an exemplary embodiment of the present specification is installed.
  • FIG. 11 is an exemplary diagram in which a stacked hologram implementing system according to another exemplary embodiment of the present specification is installed.
  • first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.
  • first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.
  • a display panel is used as a generic term for an image that can be viewed by a person.
  • FIG. 1 is a detailed configuration diagram of the main configuration of the content conversion apparatus for a stacked hologram according to the present invention.
  • the apparatus for converting stacked holograms includes an extraction module 110, a mapping module 120, a viewpoint conversion module 130, and a synchronization module 140.
  • the above components are expressed separately according to the function of the stacked hologram content conversion apparatus according to an embodiment of the present invention.
  • One component may be divided into a plurality of components or a plurality of components may be integrated into one component. Such embodiments are also within the scope of the present invention.
  • the extraction module 110 generates a target image and a background image, which are still images, from a video of 2D image content. To this end, the extraction module 110 may extract a still image at a predetermined frame rate from a video of 2D image content.
  • Frame rate refers to the number of frames progressing per second. For example, it consists of 30 frames per second for TV and 24 frames per second for movies. These frames per second can be selected, changed and saved by the user.
  • the 2D image content acquired by the extraction module 110 may be a single view image.
  • the single-view image refers to an image obtained by photographing an object and a background from the same location through the photographing apparatus.
  • the extraction module 110 separates the target image including one or more objects from the extracted still image.
  • the target image is separated and the remaining part becomes the background image.
  • the mapping module 120 converts 2D video content into 3D video. More specifically, the mapping module 120 performs mapping on each of the target image and the background image separated by the extraction module 110.
  • the specific map may be at least one of a depth map, a displacement map, a texture map, and a combination thereof.
  • mapping module 120 converts a plurality of single-view 2D images into a plurality of 3D images by using various conversion techniques including a 3D image converter or a 3D image conversion program.
  • the viewpoint conversion module 130 generates a multiview image for each of the target image and the background image converted into the 3D image.
  • the viewpoint transformation module 140 renders the multiview AS3D image in the three-dimensional space through the projection reconstruction in the three-dimensional space.
  • the viewpoint conversion module 130 displays the plurality of 3D images in a single three-dimensional space and converts the multi-view AS3D images.
  • the synchronization module 140 synchronizes the multi-view AS3D object image and the multi-view AS3D image background image processed separately from one still image of the original 2D image content.
  • FIG. 2 is a flowchart illustrating a content conversion method of a content conversion apparatus for a stacked hologram according to an exemplary embodiment of the present specification.
  • 3 to 6 are exemplary views for explaining a method of extracting a still image according to an embodiment of the present disclosure.
  • FIG. 7 is an exemplary diagram illustrating a format of a target image and a background image content generated according to an embodiment of the present specification.
  • FIG. 8 is an exemplary view for explaining a method for synchronizing a target image and a background image into one file according to an embodiment of the present specification.
  • a still image is extracted according to a predetermined frame rate from one 2D image content acquired by the stacked hologram content converter in step S210.
  • 3A is a diagram illustrating a state in which a plurality of still images are extracted. Each still image extracted in this way is 2D content.
  • step 220 the stacked hologram content converting apparatus extracts one or more objects from the still image extracted in step 210 as the object image, and separates the object image and the background image by defining the unextracted background as the background image.
  • a contour of a desired object such as a human, as a target image
  • a contour of a desired object is drawn in a CG program, and the image and background of the human are based on the contour.
  • an optical flow method to extract a specific region from a frame, an optical flow method, a kernel-based mean-shift method using similarity of object distribution, and a contour based detection of an object boundary ) Tracking methods.
  • Step 230 and 240 are steps for representing such a real object.
  • mapping of the target image and the background image is performed. This step converts simple planar 2D video content into 3D video content.
  • FIG. 4 is a flowchart illustrating a mapping according to an embodiment of the present invention.
  • an image to be performed is a background image. Since the background image is the remaining image obtained by separating the target image from one image, a blank area 601 as shown in FIG. 5A is formed by separating the target image.
  • the pixel is filled in the empty area 601 with reference to the pixels around the empty area 601 and the information about the frame before and after the corresponding image.
  • step 231 If the target image is not a background image in step 231, the process proceeds to step 233, which is the next step without going through step 232.
  • step 233 when there are a plurality of objects included in the working image, which is either the target image or the background image, the depth of each object is extracted, and in step 234, the object is rearranged by referring to the depth value (depth value).
  • the depth value of each pixel represents a three-dimensional distance difference between objects in the image and is expressed as a value between 0 and 255. The closer the distance is, the closer to zero. Therefore, an object having a small depth value is placed before an object having a large depth value.
  • the object T1 having the smallest depth value is disposed at the frontmost surface
  • the object T2 having the middle depth value is disposed at the middle
  • the object having the largest depth value is disposed at the middle
  • an object T1 having the smallest depth value is disposed in front of the display panel D and an object having an intermediate depth value in the display panel D.
  • T2 is disposed, and an object T3 having the largest depth value is disposed behind the display panel D.
  • step 235 the background image and the target image are formed as 3D images by applying a three-dimensional effect to the rearranged object.
  • the object image provided with the three-dimensional effect is illustrated in FIG. 5E.
  • each of the 3D object image and the 3D background image is converted into a multiview image AS3D.
  • a plurality of viewpoint images are generated for the 3D object image and the 3D background image, respectively.
  • three-dimensional image information such as disparity map, motion compensation information, and object segmentation information is extracted from the 3D object image and the 3D background image.
  • N virtual view images are generated.
  • step 250 the AS3D target image converted into a multiview image and the AS3D background image are synchronized.
  • a raster file of the target image and a raster file of the multiview image are generated so that each generated AS3D target image and the AS3D background image are reproduced on separate screens.
  • a raster file generated according to each viewpoint is 9 tile content. It is assumed that each image has a resolution of 1280 ⁇ 720.
  • each viewpoint image of the target image content and each viewpoint image of the background image content may be bundled into a pair of tiles to generate 9 new tiles.
  • the one-eye image of the target video content and the one-eye image of the background image content are grouped into a pair of one-eye image.
  • the paired viewpoint images may be processed for synchronization.
  • the target video content and the background video content may include time information for each unit. During playback, synchronization with time information can be achieved.
  • the image generated by pairing the target video content and the background video content may have a total resolution of 3840 ⁇ 4320 or 7680 ⁇ 2160.
  • FIG. 9 is an exemplary view for explaining a setup method for displaying a target image and a background image according to an embodiment of the present specification.
  • display setting can be performed through a display screen of a PC or the like connected to the playback apparatus.
  • the two displays are set to the extended mode in order to reproduce the object image and the background image on the first display panel and the second display panel, respectively.
  • a nine-eye display is adopted to obtain a stable image when playing content for a stereoscopic image array. It is not limited to this.
  • FIG. 10 is an exemplary diagram in which a stacked hologram implementing system according to an exemplary embodiment of the present specification is installed.
  • the first display panel 210 is installed on the rear side of the two display panels separated from each other, and the second display panel is ceiling mounted in front of the first display panel 210.
  • the target image is plotted by a two-way mirror 230 provided at a 45 degree angle on the second display panel 220 to form a hologram. Therefore, the target image is stacked and displayed in front of the background image output by the first display panel 210 with different depths.
  • the depth that can be expressed in an autostereoscopic 3d display panel is a maximum pop-out distance and a maximum depth in distance.
  • the maximum pop-out distance and maximum depth in distance are 0.5 times the display panel height H, respectively, and the maximum depth distance that can be expressed in one display is the display panel height.
  • FIG. 11 is an exemplary diagram in which a stacked hologram implementing system according to another exemplary embodiment of the present specification is installed.
  • the first display panel 410 and the second display panel 420 are raised on one plane with each other, and two-way mirrors are provided at the angles of 45 degrees.
  • the background image is reproduced on the first display panel 410 disposed further behind the viewer, and the object image is reproduced on the second display panel 420 disposed earlier.
  • the front means a direction closer to the viewer.
  • the background image output from the first display panel 410 is plotted by the first two-way mirror 430 to generate a first hologram, and the target image output from the second display panel 420 is the second two-way mirror 440. ) To generate a second hologram.
  • the first hologram and the second hologram are displayed to be stacked with different depths.
  • first display panel 410 and the second display panel 420 may further provide a sense of depth between the first hologram and the second hologram.
  • each block of the flowchart illustrations and combinations of flowchart illustrations may be performed by computer program instructions. Since these computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, those instructions executed through the processor of the computer or other programmable data processing equipment may be described in flow chart block (s). You will create a module that performs the functions. These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular manner, and thus the computer usable or computer readable memory.
  • Instructions stored in may produce an article of manufacture containing an instruction module that performs the functions described in the flowchart block (s).
  • Computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operating steps may be performed on the computer or other programmable data processing equipment to create a computer-implemented process to create a computer or other programmable data. Instructions for performing the processing equipment may also provide steps for performing the functions described in the flowchart block (s).
  • each block may represent a portion of a module, segment, or code that includes one or more executable instructions for executing a specified logical function (s).
  • logical function e.g., a module, segment, or code that includes one or more executable instructions for executing a specified logical function (s).
  • the functions noted in the blocks may occur out of order.
  • the two blocks shown in succession may in fact be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending on the corresponding function.
  • ' ⁇ part' used in the present embodiment refers to software or a hardware component such as an FPGA or an ASIC, and ' ⁇ part' performs certain roles.
  • ' ⁇ ' is not meant to be limited to software or hardware.
  • ' ⁇ Portion' may be configured to be in an addressable storage medium or may be configured to play one or more processors.
  • ' ⁇ ' means components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and the like. Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.
  • the functionality provided within the components and the 'parts' may be combined into a smaller number of components and the 'parts' or further separated into additional components and the 'parts'.
  • the components and ' ⁇ ' may be implemented to play one or more CPUs in the device or secure multimedia card.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Holo Graphy (AREA)

Abstract

Un mode de réalisation de la présente invention concerne un procédé de conversion de contenu permettant à un appareil de conversion de contenu de générer un hologramme multicouche à partir d'un contenu d'image 2D. Le procédé comprend les étapes consistant à : extraire une image fixe du contenu d'image 2D selon une cadence de trames prédéterminée ; séparer, dans l'image fixe extraite, une image d'arrière-plan et une image cible contenant un ou plusieurs objets ; exécuter un mappage pour chacune des images d'arrière-plan et des images cible séparées, au moyen d'une carte spécifique ; et générer une image multi-vue pour chacune des images d'arrière-plan et des images cible mappées, au moyen d'une profondeur et d'une valeur tridimensionnelle.
PCT/KR2015/009492 2015-06-01 2015-09-09 Procédé de conversion de contenu, appareil de conversion de contenu, et programme de génération d'hologramme multicouche Ceased WO2016195167A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2015-0077107 2015-06-01
KR1020150077107A KR101754976B1 (ko) 2015-06-01 2015-06-01 적층형 홀로그램용 콘텐츠 변환방법 및 변환장치

Publications (1)

Publication Number Publication Date
WO2016195167A1 true WO2016195167A1 (fr) 2016-12-08

Family

ID=57441403

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/009492 Ceased WO2016195167A1 (fr) 2015-06-01 2015-09-09 Procédé de conversion de contenu, appareil de conversion de contenu, et programme de génération d'hologramme multicouche

Country Status (2)

Country Link
KR (1) KR101754976B1 (fr)
WO (1) WO2016195167A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107071392A (zh) * 2016-12-23 2017-08-18 网易（杭州）网络有限公司 图像处理方法和装置

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180116708A (ko) * 2017-04-17 2018-10-25 주식회사 쓰리디팩토리 적층형 홀로그램용 콘텐츠 제공방법 및 제공장치
KR102752514B1 (ko) * 2022-12-15 2025-01-14 한국전자기술연구원 사용자 단말의 동영상 촬영 기능을 이용한 홀로그램 제작 방법 및 상기 방법에 의해 제작된 홀로그램 보안 코드를 판독하기 위한 방법
WO2025049975A1 (fr) * 2023-09-01 2025-03-06 Swave Bv Système et procédés d'affichage de contenus multimédias 3d

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050001101A (ko) * 2003-06-27 2005-01-06 한국과학기술연구원 2차원 이미지로부터 3차원 이미지를 생성하는 방법
KR20100036683A (ko) * 2008-09-30 2010-04-08 삼성전자주식회사 영상 출력 방법 및 장치
KR20130110339A (ko) * 2012-03-29 2013-10-10 한국과학기술원 3차원 입체영상 생성 방법 및 장치
KR20140003741A (ko) * 2012-06-26 2014-01-10 세종대학교산학협력단 입체 컨텐츠 제작 방법 및 장치
KR101451236B1 (ko) * 2014-03-03 2014-10-15 주식회사 비즈아크 3차원 영상 변환 방법 및 그 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050001101A (ko) * 2003-06-27 2005-01-06 한국과학기술연구원 2차원 이미지로부터 3차원 이미지를 생성하는 방법
KR20100036683A (ko) * 2008-09-30 2010-04-08 삼성전자주식회사 영상 출력 방법 및 장치
KR20130110339A (ko) * 2012-03-29 2013-10-10 한국과학기술원 3차원 입체영상 생성 방법 및 장치
KR20140003741A (ko) * 2012-06-26 2014-01-10 세종대학교산학협력단 입체 컨텐츠 제작 방법 및 장치
KR101451236B1 (ko) * 2014-03-03 2014-10-15 주식회사 비즈아크 3차원 영상 변환 방법 및 그 장치

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107071392A (zh) * 2016-12-23 2017-08-18 网易（杭州）网络有限公司 图像处理方法和装置

Also Published As

Publication number Publication date
KR20160141446A (ko) 2016-12-09
KR101754976B1 (ko) 2017-07-06

Similar Documents

Publication Publication Date Title
JP5011316B2 (ja) 出力画像のレンダリング
US9083963B2 (en) Method and device for the creation of pseudo-holographic images
WO2010101362A2 (fr) Procédé et appareil de génération de métadonnées et procédé de traitement d'image et appareil utilisant des métadonnées
JP2013214975A (ja) ３ｄディスプレイ装置およびその映像処理方法
EP1897056A1 (fr) Échange combiné de données d'image et de données apparentées
CN102300105A (zh) 一种将2d内容转换成3d内容的方法
JP2008544681A (ja) 画像及び関連する深さデータの結合されたやり取り
CN103442241A (zh) 一种3d显示方法和3d显示装置
WO2016195167A1 (fr) Procédé de conversion de contenu, appareil de conversion de contenu, et programme de génération d'hologramme multicouche
JP5454569B2 (ja) 立体映像データ処理装置および立体映像データ処理方法
CN101697597A (zh) 产生3d影像的方法
US20120120190A1 (en) Display device for use in a frame sequential 3d display system and related 3d display system
TWI387934B (zh) 多視角影像之建構方法及系統
US20120050271A1 (en) Stereoscopic image processing device, method for processing stereoscopic image, and multivision display system
WO2014107014A1 (fr) Dispositif d'affichage et appareil d'affichage
WO2016056735A1 (fr) Dispositif d'affichage d'image multivue et son procédé de commande
CN104994370A (zh) 一种3d视频图像采集系统
TWI674556B (zh) 用於在平板面板輸入立體圖像的硬體系統
JP2004102526A (ja) 立体画像表示装置、表示処理方法及び処理プログラム
KR20200054846A (ko) 이중 입체 영상 디스플레이 장치 및 방법
KR101912242B1 (ko) 3d 디스플레이 장치 및 그 영상 처리 방법
CN1972460A (zh) 拼接型光栅式三维自由立体显示屏
CN207603821U (zh) 一种基于集群和渲染的裸眼3d系统
US20130044102A1 (en) Method for outputting three-dimensional (3d) image and display apparatus thereof
KR101276603B1 (ko) 3차원 영상 디스플레이 장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15894340

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15894340

Country of ref document: EP

Kind code of ref document: A1