Serrano et al., 2019 - Google Patents
Motion parallax for 360 RGBD videoSerrano et al., 2019
View PDF- Document ID
- 2059831811743561850
- Author
- Serrano A
- Kim I
- Chen Z
- DiVerdi S
- Gutierrez D
- Hertzmann A
- Masia B
- Publication year
- Publication venue
- IEEE Transactions on Visualization and Computer Graphics
External Links
Snippet
We present a method for adding parallax and real-time playback of 360° videos in Virtual Reality headsets. In current video players, the playback does not respond to translational head movement, which reduces the feeling of immersion, and causes motion sickness for …
- 230000003068 static 0 abstract description 29
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G06T15/205—Image-based rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/50—Lighting effects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic or multiview television systems; Details thereof
- H04N13/02—Picture signal generators
- H04N13/0203—Picture signal generators using a stereoscopic image camera
- H04N13/0239—Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic or multiview television systems; Details thereof
- H04N13/02—Picture signal generators
- H04N13/0203—Picture signal generators using a stereoscopic image camera
- H04N13/0207—Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic or multiview television systems; Details thereof
- H04N13/0003—Stereoscopic image signal coding, multiplexing, processing, recording or transmission
- H04N13/0007—Processing stereoscopic image signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRICAL DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/30—Information retrieval; Database structures therefor; File system structures therefor
- G06F17/30781—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F17/30784—Information retrieval; Database structures therefor; File system structures therefor of video data using features automatically derived from the video content, e.g. descriptors, fingerprints, signatures, genre
- G06F17/30799—Information retrieval; Database structures therefor; File system structures therefor of video data using features automatically derived from the video content, e.g. descriptors, fingerprints, signatures, genre using low-level visual features of the video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
- G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic or multiview television systems; Details thereof
- H04N13/04—Picture reproducers
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Serrano et al. | Motion parallax for 360 RGBD video | |
| Attal et al. | Matryodshka: Real-time 6dof video view synthesis using multi-sphere images | |
| Broxton et al. | Immersive light field video with a layered mesh representation | |
| Niklaus et al. | 3d ken burns effect from a single image | |
| US11210838B2 (en) | Fusing, texturing, and rendering views of dynamic three-dimensional models | |
| US10911732B2 (en) | Free-viewpoint photorealistic view synthesis from casually captured video | |
| JP7519390B2 (en) | Neural Blending for Novel View Synthesis | |
| Casas et al. | 4d video textures for interactive character appearance | |
| US20130321396A1 (en) | Multi-input free viewpoint video processing pipeline | |
| Kuster et al. | FreeCam: A Hybrid Camera System for Interactive Free-Viewpoint Video. | |
| Richardt et al. | Capture, reconstruction, and representation of the visual real world for virtual reality | |
| WO2013074561A1 (en) | Modifying the viewpoint of a digital image | |
| US20230152883A1 (en) | Scene processing for holographic displays | |
| CN109791704B (en) | Texture rendering method, system and device based on multi-layer UV mapping for free-running FVV application | |
| Zheng et al. | Parallax photography: creating 3d cinematic effects from stills | |
| Waidhofer et al. | PanoSynthVR: Toward light-weight 360-degree view synthesis from a single panoramic input | |
| CA3173542A1 (en) | Techniques for re-aging faces in images and video frames | |
| Alain et al. | Introduction to immersive video technologies | |
| WO2020193703A1 (en) | Techniques for detection of real-time occlusion | |
| Baričević et al. | User-perspective AR magic lens from gradient-based IBR and semi-dense stereo | |
| Yu et al. | Scam light field rendering | |
| Huang et al. | 360$^\circ $∘ Stereo Image Composition With Depth Adaption | |
| US20240221300A1 (en) | System and Method for Unsupervised and Autonomous 4D Dynamic Scene and Objects Interpretation, Segmentation, 3D Reconstruction, and Streaming | |
| Mühlhausen et al. | Immersive Free‐Viewpoint Panorama Rendering from Omnidirectional Stereo Video | |
| Mühlhausen et al. | Temporal consistent motion parallax for omnidirectional stereo panorama video |