[go: up one dir, main page]

SG11201907473WA - Signalling of video content including sub-picture bitstreams for video coding - Google Patents

Signalling of video content including sub-picture bitstreams for video coding

Info

Publication number
SG11201907473WA
SG11201907473WA SG11201907473WA SG11201907473WA SG 11201907473W A SG11201907473W A SG 11201907473WA SG 11201907473W A SG11201907473W A SG 11201907473WA SG 11201907473W A SG11201907473W A SG 11201907473WA
Authority
SG
Singapore
Prior art keywords
track
sub
picture
international
group
Prior art date
Application number
Inventor
Ye-Kui Wang
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of SG11201907473WA publication Critical patent/SG11201907473WA/en

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365—Multiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Library & Information Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)
  • Display Devices Of Pinball Game Machines (AREA)

Abstract

FRAGMENTFRAGMENT FRAGMENT a ISO BASE MEDIA FILE Boo FRAGMENT FILE TYPE (ft/P) 810 MOVIE (moov) 820 TRACK (ral() 824 MOVIE HEADER TRACK TRACK GROUP BOX (trgr) 0.4.1 (nvhd) 22_ HEADER (tkhd) 824a Track_group_type 824c • • • 08 (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 27 September 2018 (27.09.2018) WIPO I PCT IiiimmolimiontiolommilumoliolomflovoimIE (10) International Publication Number WO 2018/175802 Al (51) International Patent Classification: H04N 21/81 (2011.01) H04N 21/235 (2011.01) HO4N 21/84 (2011.01) H04N 21/2365 (2011.01) HO4N 21/854 (2011.01) H04N 21/434 (2011.01) HO4N 21/8547 (2011.01) (21) International Application Number: PCT/US2018/023879 (22) International Filing Date: 22 March 2018 (22.03.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/475,832 23 March 2017 (23.03.2017) US 15/927,993 21 March 2018 (21.03.2018) US (71) Applicant: QUALCOMM INCORPORATED [ /US]; 5775 Morehouse Drive, Attn: International IP Administra- tion, San Diego, California 92121-1714 (US). (72) Inventor: WANG, Ye-Kui; 6264 Sunrose Crest Way, San Diego, California 92130 (US). (74) Agent: MARLETTE, Todd E; 5775 Morehouse Drive, At- tn: International IP Administration, San Diego, California 92121-1714 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, = (54) Title: SIGNALLING OF VIDEO CONTENT INCLUDING SUB-PICTURE BITSTREAMS FOR VIDEO CODING • track...group._type INDICATES THE GROUPING TYPE AND SHALL BE SET TO A SPECIFIC VALUE, OR A VALUE REGISTERED, OR A VALUE FROM A DERIVED SPECIFICATION OR REGISTRATION • track...group_type EQUAL TO 'subp': THIS TRACK GROUP TYPE `subp' INDICATES THAT THE CURRENT TRACK IS ONE A GROUP OF SUB-PICTURE TRACKS CARRYING ONE REPRESENTATION OF A FULL VIDEO CONTENT • WITH track_group_type EQUAL TO 'subp' MORE INFORMATION, SUCH AS THE SIZE OF THE FULL PICTURE, IS AVAILABLE TO BE ADDED N GC 00 O N O FIG. 8 (57) : In various implementations, modifications and/or additions to the ISOBMFF are provided to process video data. A plurality of sub-picture bitstreams are obtained from memory, each sub-picture bitstream including a spatial portion of the video data and each sub-picture bitstream being independently coded. In at least one file, the plurality of sub-picture bitstreams are respectively stored as a plurality of sub-picture tracks. Metadata describing the plurality of sub-picture tracks is stored in a track box within a media file in accordance with a file format. A sub-picture base track is provided that includes the metadata describing the plurality of sub- picture tracks. [Continued on next page] WO 2018/175802 Al MIDEDIMOMMIDIREIDI311111111111011111111111111111111111111111111111 SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))
SG11201907473W 2017-03-23 2018-03-22 Signalling of video content including sub-picture bitstreams for video coding SG11201907473WA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762475832P 2017-03-23 2017-03-23
US15/927,993 US11062738B2 (en) 2017-03-23 2018-03-21 Signalling of video content including sub-picture bitstreams for video coding
PCT/US2018/023879 WO2018175802A1 (en) 2017-03-23 2018-03-22 Signalling of video content including sub-picture bitstreams for video coding

Publications (1)

Publication Number Publication Date
SG11201907473WA true SG11201907473WA (en) 2019-10-30

Family

ID=63581773

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201907473W SG11201907473WA (en) 2017-03-23 2018-03-22 Signalling of video content including sub-picture bitstreams for video coding

Country Status (9)

Country Link
US (1) US11062738B2 (en)
EP (1) EP3603095A1 (en)
KR (1) KR102614206B1 (en)
CN (1) CN110431849B (en)
AU (1) AU2018240385A1 (en)
BR (1) BR112019019339A2 (en)
SG (1) SG11201907473WA (en)
TW (1) TW201838419A (en)
WO (1) WO2018175802A1 (en)

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10962780B2 (en) * 2015-10-26 2021-03-30 Microsoft Technology Licensing, Llc Remote rendering for virtual images
KR102277267B1 (en) * 2017-03-29 2021-07-14 엘지전자 주식회사 How to send 360 video, how to receive 360 video, 360 video sending device, 360 video receiving device
CN109089162B (en) * 2017-04-08 2021-05-28 腾讯科技（深圳）有限公司 Picture file processing method and system
GB2567625B (en) * 2017-10-12 2020-07-15 Canon Kk Method, device, and computer program for generating timed media data
WO2019195037A1 (en) * 2018-04-03 2019-10-10 Futurewei Technologies, Inc. Bitstream signaling of error mitigation in sub-picture bitstream based viewport dependent video coding
WO2019192870A1 (en) 2018-04-05 2019-10-10 Canon Kabushiki Kaisha Method and apparatus for encapsulating images or sequences of images with proprietary information in a file
CN112369016A (en) * 2018-07-06 2021-02-12 索尼公司 Information processing apparatus, information processing method, and program
KR102188270B1 (en) * 2018-07-06 2020-12-09 엘지전자 주식회사 Method for processing 360-degree video data based on sub-picture and apparatus for the same
EP3846465A4 (en) * 2018-10-01 2021-08-11 Samsung Electronics Co., Ltd. VIDEO CONTENT TRANSMISSION METHOD AND DEVICE AND VIDEO CONTENT RECEPTION METHOD AND DEVICE
EP3866471A1 (en) * 2018-12-20 2021-08-18 Telefonaktiebolaget LM Ericsson (publ) Improved tile size signalling in video encoding and decoding
WO2020146662A1 (en) * 2019-01-09 2020-07-16 Futurewei Technologies, Inc. Sub-picture identifier signaling in video coding
GB2585052B (en) * 2019-06-26 2023-07-26 Canon Kk Method and apparatus for encapsulating panorama images in a file
WO2021007225A1 (en) 2019-07-08 2021-01-14 Futurewei Technologies, Inc. Mixed nal unit picture constraints in video coding
KR20220071228A (en) * 2019-09-27 2022-05-31 프라운호퍼-게젤샤프트 추르 푀르데룽 데어 안제반텐 포르슝 에 파우 Merge-friendly file format
CN112911299B (en) * 2019-12-03 2023-02-28 浙江宇视科技有限公司 A video code rate control method, device, electronic equipment and storage medium
CN120223884A (en) * 2019-12-23 2025-06-27 Lg电子株式会社 Image decoding and encoding method and transmission method for image data
PH12022551544A1 (en) * 2019-12-31 2023-04-24 Nokia Technologies Oy A method, an apparatus and a computer program product for video encoding and video decoding
KR102706671B1 (en) * 2020-02-24 2024-09-19 바이트댄스 아이엔씨 Segmentation calculation based on subpicture level
KR20220164549A (en) * 2020-04-02 2022-12-13 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. A file format scheme that allows efficient region of interest, stream access, and parameter set handling.
CN115428454B (en) 2020-04-06 2025-06-24 字节跳动有限公司 Video codec using parameter sets
JP7529794B2 (en) 2020-04-12 2024-08-06 バイトダンス インコーポレイテッド Instantaneous decoding update subpicture coding
CN113542720A (en) * 2020-04-15 2021-10-22 英特尔公司 Apparatus and method for providing camera information associated with point cloud content
CN113824958A (en) * 2020-06-18 2021-12-21 中兴通讯股份有限公司 Video blocking method, transmission method, server, adapter and storage medium
CN111726655B (en) * 2020-07-02 2022-09-06 中影华夏寰宇(北京)电影科技有限公司 Video processing device, method and system
JP7736005B2 (en) * 2020-09-15 2025-09-09 ソニーグループ株式会社 Information processing device and method
US12206879B2 (en) * 2020-09-17 2025-01-21 Lemon Inc. Profile, tier, level and general constraints indication in coded video
US11930295B2 (en) * 2020-09-17 2024-03-12 Lemon Inc. Handling of non-VCL NAL units in picture unit construction
WO2022065893A1 (en) * 2020-09-24 2022-03-31 엘지전자 주식회사 Media file processing method and device therefor
CN116406505A (en) * 2020-09-24 2023-07-07 Lg电子株式会社 Media file processing method and device
CN116569557A (en) * 2020-12-14 2023-08-08 Lg电子株式会社 Method and device for generating/receiving media files supporting random access in units of samples and method for sending media files
CN116982318A (en) * 2021-01-26 2023-10-31 Lg电子株式会社 Media file processing method and device
US12120322B2 (en) * 2021-04-15 2024-10-15 Lemon Inc. Level information for sub-picture tracks
US12346291B2 (en) * 2021-11-03 2025-07-01 Vimeo.Com, Inc. On-the-fly/transparent fragmented ISOBMFF to progressive ISOBMFF transmultiplexing proxy

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060047674A1 (en) 2004-09-01 2006-03-02 Mohammed Zubair Visharam Method and apparatus for supporting storage of multiple camera views
CN101111894A (en) 2005-01-25 2008-01-23 尼禄股份公司 Method for preparing DVD-Video format data, method for reconstructing DVD-Video data and structure of DVD-Video data
CN102132562B (en) * 2008-07-16 2014-10-22 西斯威尔国际有限公司 Method and apparatus for track and track subset grouping
GB2551296B (en) 2013-04-09 2018-02-28 Canon Kk Method, device, and computer program for encapsulating partitioned timed media data
GB2516825B (en) * 2013-07-23 2015-11-25 Canon Kk Method, device, and computer program for encapsulating partitioned timed media data using a generic signaling for coding dependencies
GB2519746B (en) * 2013-10-22 2016-12-14 Canon Kk Method, device and computer program for encapsulating scalable partitioned timed media data
GB2519745B (en) * 2013-10-22 2018-04-18 Canon Kk Method of processing disordered frame portion data units
US9621919B2 (en) * 2013-10-23 2017-04-11 Qualcomm Incorporated Multi-layer video file format designs

Also Published As

Publication number Publication date
TW201838419A (en) 2018-10-16
KR20190131077A (en) 2019-11-25
US11062738B2 (en) 2021-07-13
KR102614206B1 (en) 2023-12-14
AU2018240385A1 (en) 2019-08-29
WO2018175802A1 (en) 2018-09-27
EP3603095A1 (en) 2020-02-05
CN110431849A (en) 2019-11-08
US20180277164A1 (en) 2018-09-27
BR112019019339A2 (en) 2020-04-14
CN110431849B (en) 2021-10-22

Similar Documents

Publication Publication Date Title
SG11201907473WA (en) Signalling of video content including sub-picture bitstreams for video coding
SG11201906484YA (en) Extracting mcts sub-bitstreams for video coding
SG11201907476XA (en) Advanced signalling of regions of interest in omnidirectional visual media
SG11201901862YA (en) Method and system for processing 360 degree video data
SG11201903270RA (en) Method and system for selective access of stored or transmitted bioinformatics data
SG11201900967XA (en) Linear model chroma intra prediction for video coding
SG11201907210YA (en) Policy communication via control plane signaling
SG11201900111YA (en) Intra video coding using a decoupled tree structure
SG11201900109SA (en) Intra video coding using a decoupled tree structure
SG11201906275TA (en) Control resource set group design for improved communications devices, systems, and networks
SG11201900438WA (en) Tree-type coding for video coding
SG11201900269XA (en) Channel sensing for independent links
SG11201408364VA (en) Coding sei nal units for video coding
SG11201805952VA (en) Handling of end of bitstream nal units in l-hevc file format and improvements to hevc and l-hevc tile tracks
SG11201804915RA (en) Methods for treating huntington's disease
SG11201808343WA (en) Dynamic cyclic prefix (cp) length in wireless communication
SG11201804600YA (en) Methods and apparatus for selecting enhanced distributed channel access parameters for different stations
SG11201907508WA (en) Single slot short pucch with support for intra slot frequency hopping
SG11201808968WA (en) Time division multiplexing of synchronization channels
SG11201901631SA (en) Systems and methods of switching interpolation filters
SG11201408111UA (en) Signaling long-term reference pictures for video coding
SG11201407255XA (en) Stereo widening over arbitrarily-configured loudspeakers
SG11201408112XA (en) Random access and signaling of long-term reference pictures in video coding
SG11201408571RA (en) Decoding device, and decoding method
SG11201407579QA (en) Interleukin-2 fusion proteins and uses thereof