[go: up one dir, main page]

SG11201907264UA - Sphere equator projection for efficient compression of 360-degree video - Google Patents

Sphere equator projection for efficient compression of 360-degree video

Info

Publication number
SG11201907264UA
SG11201907264UA SG11201907264UA SG11201907264UA SG 11201907264U A SG11201907264U A SG 11201907264UA SG 11201907264U A SG11201907264U A SG 11201907264UA SG 11201907264U A SG11201907264U A SG 11201907264UA
Authority
SG
Singapore
Prior art keywords
international
california
san diego
degree video
march
Prior art date
Application number
Inventor
Der Auwera Geert Van
Muhammed Coban
Marta Karczewicz
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of SG11201907264UA publication Critical patent/SG11201907264UA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/12—Panospheric to cylindrical image transformations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/88—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Medicines That Contain Protein Lipid Enzymes And Other Medicines (AREA)

Abstract

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 27 September 2018 (27.09.2018) WIP0 I PCT O V SID o Ho lulu °limo VII IE (10) International Publication Number WO 2018/175611 Al (51) International Patent Classification: H04N 19/597 (2014.01) H04N 19/88 (2014.01) H04N 19/182 (2014.01) (21) International Application Number: PCT/US2018/023601 (22) International Filing Date: 21 March 2018 (21.03.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/475,103 22 March 2017 (22.03.2017) US 15/926,732 20 March 2018 (20.03.2018) US (71) Applicant: QUALCOMM INCORPORATED [US/US]; ATTN: International IP Administration, 5775 Morehouse Drive, San Diego, California 92121-1714 (US). (72) Inventors: VAN DER AUWERA, Geert; 5775 More- house Drive, San Diego, California 92121-1714 (US). COBAN, Muhammed; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). KARCZEWICZ, Marta; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). (74) Agent: WONG, Claudine et al.; Kilpatrick Townsend & Stockton LLP, Mailstop: IP Docketing - 22, 1100 Peachtree Street, N.E., Suite 2800, Atlanta, Georgia 30309 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, = (54) Title: SPHERE EQUATOR PROJECTION FOR EFFICIENT COMPRESSION OF 360-DEGREE VIDEO (57) : Provided are systems and methods for processing 360-degree video data. In various implementations, a spherical rep- resentation of a 360-degree video frame can be segmented into a top region, a bottom region, and a middle region. Using a cylindrical equal area projection, such as the Lambert cylindrical equal area projection, the middle region can be mapped into one or more rectan- gular areas of an output video frame. [Continued on next page] WO 2018/175611 Al 11111101M01101DEIMMERIOMOINIDEIHOIE011111110110111111 MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))
SG11201907264U 2017-03-22 2018-03-21 Sphere equator projection for efficient compression of 360-degree video SG11201907264UA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762475103P 2017-03-22 2017-03-22
US15/926,732 US10839480B2 (en) 2017-03-22 2018-03-20 Sphere equator projection for efficient compression of 360-degree video
PCT/US2018/023601 WO2018175611A1 (en) 2017-03-22 2018-03-21 Sphere equator projection for efficient compression of 360-degree video

Publications (1)

Publication Number Publication Date
SG11201907264UA true SG11201907264UA (en) 2019-10-30

Family

ID=63582713

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201907264U SG11201907264UA (en) 2017-03-22 2018-03-21 Sphere equator projection for efficient compression of 360-degree video

Country Status (9)

Country Link
US (1) US10839480B2 (en)
EP (1) EP3603073A1 (en)
KR (1) KR20190128211A (en)
CN (1) CN110383843B (en)
AU (1) AU2018239448A1 (en)
BR (1) BR112019019163A2 (en)
SG (1) SG11201907264UA (en)
TW (1) TW201903710A (en)
WO (1) WO2018175611A1 (en)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10999602B2 (en) 2016-12-23 2021-05-04 Apple Inc. Sphere projected motion estimation/compensation and mode decision
US11259046B2 (en) 2017-02-15 2022-02-22 Apple Inc. Processing of equirectangular object data to compensate for distortion by spherical projections
US10924747B2 (en) 2017-02-27 2021-02-16 Apple Inc. Video coding techniques for multi-view video
US10593012B2 (en) * 2017-03-22 2020-03-17 Mediatek Inc. Method and apparatus for generating and encoding projection-based frame with 360-degree content represented in projection faces packed in segmented sphere projection layout
US10839480B2 (en) * 2017-03-22 2020-11-17 Qualcomm Incorporated Sphere equator projection for efficient compression of 360-degree video
US10506255B2 (en) * 2017-04-01 2019-12-10 Intel Corporation MV/mode prediction, ROI-based transmit, metadata capture, and format detection for 360 video
US20180288436A1 (en) * 2017-04-03 2018-10-04 Gopro, Inc. Methods and apparatus for providing in-loop padding techniques for rotated sphere projections
US10579898B2 (en) * 2017-04-16 2020-03-03 Facebook, Inc. Systems and methods for provisioning content using barrel projection representation
US11093752B2 (en) 2017-06-02 2021-08-17 Apple Inc. Object tracking in multi-view video
US10754242B2 (en) 2017-06-30 2020-08-25 Apple Inc. Adaptive resolution and projection format in multi-direction video
US20190005709A1 (en) * 2017-06-30 2019-01-03 Apple Inc. Techniques for Correction of Visual Artifacts in Multi-View Images
EP3518087A1 (en) * 2018-01-29 2019-07-31 Thomson Licensing Method and network equipment for tiling a sphere representing a spherical multimedia content
US11212438B2 (en) 2018-02-14 2021-12-28 Qualcomm Incorporated Loop filter padding for 360-degree video coding
US10922783B2 (en) * 2018-03-02 2021-02-16 Mediatek Inc. Cube-based projection method that applies different mapping functions to different square projection faces, different axes, and/or different locations of axis
TWI690728B (en) 2018-03-02 2020-04-11 聯發科技股份有限公司 Method for processing projection-based frame that includes projection faces packed in cube-based projection layout with padding
US10715832B2 (en) * 2018-03-16 2020-07-14 Mediatek Inc. Method and apparatus of block partition for VR360 video coding
CN110349226B (en) * 2018-04-01 2021-06-01 浙江大学 Panoramic image processing method and device
CN109934764A (en) * 2019-01-31 2019-06-25 北京奇艺世纪科技有限公司 Processing method, device, terminal, server and the storage medium of panoramic video file
WO2020190270A1 (en) * 2019-03-15 2020-09-24 STX Financing, LLC Systems and methods for compressing and decompressing a sequence of images
US11816757B1 (en) * 2019-12-11 2023-11-14 Meta Platforms Technologies, Llc Device-side capture of data representative of an artificial reality environment
CN110958444A (en) * 2019-12-23 2020-04-03 中科院微电子研究所昆山分所 720-degree view field environment situation sensing method and situation sensing system
CN110933395A (en) * 2019-12-23 2020-03-27 中科院微电子研究所昆山分所 720-degree panoramic stereo environment mapping method and related device
CN112203079A (en) * 2020-07-17 2021-01-08 中国科学院空天信息创新研究院 A three-dimensional sphere-oriented visualization system
CN114554195B (en) 2020-11-25 2024-06-25 腾讯科技（深圳）有限公司 Image processing method, device and storage medium
US11622100B2 (en) 2021-02-17 2023-04-04 flexxCOACH VR 360-degree virtual-reality system for dynamic events
US12361661B1 (en) 2022-12-21 2025-07-15 Meta Platforms Technologies, Llc Artificial reality (XR) location-based displays and interactions

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6331869B1 (en) * 1998-08-07 2001-12-18 Be Here Corporation Method and apparatus for electronically distributing motion panoramic images
US6466254B1 (en) * 1997-05-08 2002-10-15 Be Here Corporation Method and apparatus for electronically distributing motion panoramic images
JP2003141562A (en) * 2001-10-29 2003-05-16 Sony Corp Image processing apparatus and image processing method for non-planar image, storage medium, and computer program
KR100882011B1 (en) * 2007-07-29 2009-02-04 주식회사 나노포토닉스 Method and apparatus for obtaining omnidirectional image using rotationally symmetrical wide angle lens
US7961980B2 (en) * 2007-08-06 2011-06-14 Imay Software Co., Ltd. Method for providing output image in either cylindrical mode or perspective mode
US10068373B2 (en) * 2014-07-01 2018-09-04 Samsung Electronics Co., Ltd. Electronic device for providing map information
CN104333675B (en) * 2014-10-20 2017-09-05 长春理工大学 A Method of Panoramic Electronic Image Stabilization Based on Spherical Projection
US20160112713A1 (en) * 2014-10-20 2016-04-21 Google Inc. Mapping spherical image to 2d representations
US10104361B2 (en) * 2014-11-14 2018-10-16 Samsung Electronics Co., Ltd. Coding of 360 degree videos using region adaptive smoothing
CN107409233B (en) * 2015-03-05 2020-04-14 索尼公司 Image processing device and image processing method
WO2016140082A1 (en) * 2015-03-05 2016-09-09 ソニー株式会社 Image processing device and image processing method
US9723206B1 (en) * 2015-03-11 2017-08-01 Vsn Technologies, Inc. Enabling a true surround view of a 360 panorama via a dynamic cylindrical projection of the panorama
US20170302714A1 (en) * 2016-04-15 2017-10-19 Diplloid Inc. Methods and systems for conversion, playback and tagging and streaming of spherical images and video
WO2017188714A1 (en) * 2016-04-26 2017-11-02 엘지전자 주식회사 Method for transmitting 360-degree video, method for receiving 360-degree video, apparatus for transmitting 360-degree video, apparatus for receiving 360-degree video
EP3457352B1 (en) * 2016-05-13 2022-06-01 Sony Group Corporation Generation device and generation method, and reproduction device and reproduction method
WO2017204491A1 (en) * 2016-05-26 2017-11-30 엘지전자 주식회사 Method for transmitting 360-degree video, method for receiving 360-degree video, apparatus for transmitting 360-degree video, and apparatus for receiving 360-degree video
US20180054613A1 (en) * 2016-08-22 2018-02-22 Mediatek Inc. Video encoding method and apparatus with in-loop filtering process not applied to reconstructed blocks located at image content discontinuity edge and associated video decoding method and apparatus
GB2555788A (en) * 2016-11-08 2018-05-16 Nokia Technologies Oy An apparatus, a method and a computer program for video coding and decoding
US20180192074A1 (en) * 2017-01-03 2018-07-05 Mediatek Inc. Video processing method for processing projection-based frame with 360-degree content represented by projection faces packed in 360-degree virtual reality projection layout
WO2018128247A1 (en) * 2017-01-03 2018-07-12 엘지전자 주식회사 Intra-prediction method and device in image coding system for 360-degree video
CN108282449B (en) * 2017-01-06 2020-10-09 华为技术有限公司 A transmission method and client for streaming media applied to virtual reality technology
US10742999B2 (en) * 2017-01-06 2020-08-11 Mediatek Inc. Methods and apparatus for signaling viewports and regions of interest
US10560682B2 (en) * 2017-01-13 2020-02-11 Gopro, Inc. Methods and apparatus for providing a frame packing arrangement for panoramic content
CN108537721B (en) * 2017-03-02 2021-09-07 株式会社理光 Panoramic image processing method and device and electronic equipment
US20180253820A1 (en) * 2017-03-03 2018-09-06 Immersive Enterprises, LLC Systems, methods, and devices for generating virtual reality content from two-dimensional images
US10915986B2 (en) * 2017-03-20 2021-02-09 Qualcomm Incorporated Adaptive perturbed cube map projection
US10957044B2 (en) * 2017-03-22 2021-03-23 Qualcomm Incorporated Sphere pole projections for efficient compression of 360-degree video
US10839480B2 (en) * 2017-03-22 2020-11-17 Qualcomm Incorporated Sphere equator projection for efficient compression of 360-degree video
US10593012B2 (en) * 2017-03-22 2020-03-17 Mediatek Inc. Method and apparatus for generating and encoding projection-based frame with 360-degree content represented in projection faces packed in segmented sphere projection layout
US10614609B2 (en) * 2017-07-19 2020-04-07 Mediatek Inc. Method and apparatus for reduction of artifacts at discontinuous boundaries in coded virtual-reality images
US10817980B2 (en) * 2018-02-07 2020-10-27 Ricoh Company, Ltd. Information processing apparatus, information processing system, data generation method, and recording medium storing program code
US10764605B2 (en) * 2018-02-14 2020-09-01 Qualcomm Incorporated Intra prediction for 360-degree video
US10779006B2 (en) * 2018-02-14 2020-09-15 Qualcomm Incorporated Signaling 360-degree video information

Also Published As

Publication number Publication date
CN110383843A (en) 2019-10-25
EP3603073A1 (en) 2020-02-05
CN110383843B (en) 2023-06-06
KR20190128211A (en) 2019-11-15
US10839480B2 (en) 2020-11-17
US20180276789A1 (en) 2018-09-27
TW201903710A (en) 2019-01-16
WO2018175611A1 (en) 2018-09-27
AU2018239448A1 (en) 2019-08-29
BR112019019163A2 (en) 2020-04-14

Similar Documents

Publication Publication Date Title
SG11201907264UA (en) Sphere equator projection for efficient compression of 360-degree video
SG11201907262QA (en) Sphere pole projections for efficient compression of 360-degree video
SG11201901862YA (en) Method and system for processing 360 degree video data
SG11201906481WA (en) Coding mcts-eis sei messages of an access unit
SG11201909450WA (en) 360-degree video coding using face continuities
SG11201907090WA (en) Affine motion information derivation
SG11201808923QA (en) Fisheye rendering with lens distortion correction for 360-degree video
SG11201900438WA (en) Tree-type coding for video coding
SG11201907574YA (en) Signaling important video information in network video streaming using mime type parameters
SG11201907473WA (en) Signalling of video content including sub-picture bitstreams for video coding
SG11201907091PA (en) Intra-prediction mode propagation
SG11201806739UA (en) Determining prediction parameters for non-square blocks in video coding
SG11201905243YA (en) Bilateral filters in video coding with reduced complexity
SG11201906877QA (en) Intra filtering flag in video coding
SG11201908847TA (en) Apparatuses, systems and methods for imaging flow cytometry
SG11201907063QA (en) Techniques and apparatuses for control channel monitoring using a wakeup signal
SG11201900106TA (en) Video coding tools for in-loop sample processing
SG11201804915RA (en) Methods for treating huntington's disease
SG11201804725YA (en) Multi-type-tree framework for video coding
SG11201907532VA (en) Active boundary quilt architecture memory
SG11201906238TA (en) Split sector level sweep using beamforming refinement frames
SG11201807780XA (en) Customizable facility
SG11201809751XA (en) Egfr inhibitor compounds
SG11201907476XA (en) Advanced signalling of regions of interest in omnidirectional visual media
SG11201907023UA (en) Method of reducing neutropenia