[go: up one dir, main page]

WO2004047109A1 - Creation de resumes video - Google Patents

Creation de resumes video Download PDF

Info

Publication number
WO2004047109A1
WO2004047109A1 PCT/IB2003/004797 IB0304797W WO2004047109A1 WO 2004047109 A1 WO2004047109 A1 WO 2004047109A1 IB 0304797 W IB0304797 W IB 0304797W WO 2004047109 A1 WO2004047109 A1 WO 2004047109A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
relevant
program
commercial
video stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2003/004797
Other languages
English (en)
Inventor
Francesco Pessolano
Mauro Barbieri
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to AU2003274479A priority Critical patent/AU2003274479A1/en
Publication of WO2004047109A1 publication Critical patent/WO2004047109A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/327—Table of contents
    • G11B27/329—Table of contents on a disc [VTOC]
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs

Definitions

  • the invention relates to a method of creating a collection of relevant video segments by selecting respective portions from a video stream which corresponds to a program, a first duration of the collection of relevant video segments being relatively short compared with a second duration of the program.
  • the invention further relates to a video segment compilation unit for creating a collection of relevant video segments by selecting respective portions from a video stream which corresponds to a program, a first duration of the collection of relevant video segments being relatively short compared with a second duration of the program.
  • the invention further relates to a video storage system comprising: - a receiving unit for receiving a video stream;
  • Video Abstracting by R. Lienhart, et al., in Communications of the ACM, 40(12), pages 55-62, 1997.
  • This article discloses that video data may be modeled in four layers. At the lowest level, it consists of a set of frames; at the next higher level, frames are grouped into shots or continuous camera recordings, and consecutive shots are aggregated into scenes based on story-telling coherence. All scenes together make the video.
  • the concept of a clip is described as a frame sequence being selected to be an element of the abstract; a video abstract thus consists of a collection of clips.
  • the known method comprises three steps: segmentation and analysis of the video content; clip selection and clip assembly. The goal of the analysis step is to detect special events such as close-ups of the main actors, gunfire, explosions and text.
  • a disadvantage of the known method is that it is relatively complex and not robust.
  • the first one of the respective portions precedes the first non-relevant video segment in the video stream.
  • a video trailer i.e. teaser
  • the segment immediately preceding a commercial-break usually represents interesting events and does not disclose key information, e.g. the name of the murderer in a detective film.
  • the first one of the respective portions succeeds the first non-relevant video segment in the video stream.
  • a video abstract is created which e.g. can be used as follows. If you miss an episode of your favorite television series, the video abstract can be used to become briefly informed what happened in the missed episode, hi that case, you don't have to find time to view the missed episode completely before you watch the next episode.
  • the length, i.e. duration, of the selected video segments might be equal to a predetermined value. But preferably the duration is controllable by a user.
  • the duration of the video segments is related to the duration of the program or to the number of detected commercial-breaks in the program.
  • the collection of relevant video segments is extended by adding further portions of the video stream. This adding of further portions is advantageous e.g. in the case that the number of commercial- breaks per time is below a predetermined threshold.
  • These further portions of the video stream can be selected from the video stream on basis of time distances between commercial- breaks. Alternatively these further portions of the video stream are selected on basis of content analysis of the video stream, e.g. as disclosed in the article "Video Abstracting" by R. Lienhart, et al., in Communications of the ACM, 40(12), pages 55-62, 1997.
  • the order of the selected portions is changed.
  • the correct order i.e. corresponding to the order as in the original program.
  • video segment compilation unit comprises:
  • a commercial-break detector for detecting a first non-relevant video segment in the video stream, which corresponds to a commercial-break in the program
  • a video segment selector for selecting a first one of the portions from the video stream, which is, in the time-domain, located in a neighborhood of the first non- relevant video segment
  • the video segment compilation unit of the video storage system comprises: - a commercial-break detector for detecting a first non-relevant video segment in the video stream, which corresponds to a commercial-break in the program;
  • a video segment selector for selecting a first one of the portions from the video stream, which is, in the time-domain, located in a neighborhood of the first non- relevant video segment; and - an associating unit for associating the first one of the portions with a first one of the relevant video segments.
  • the storage means comprises a hard-disk.
  • the storage means is arranged to store the video stream on a removable memory device, i.e. removable storage medium, like an optical-disk.
  • a video segment compilation unit in accordance with the invention could be included, for example, in a television set, a computer, a video recorder (VCR), a DVD recorder, a set-top box, satellite- tuner or other apparatus in the field of consumer electronics. Modifications of the video segment compilation unit and variations thereof may correspond to modifications and variations thereof of the video storage system described.
  • Fig. 1 schematically shows an embodiment of a recording and reproducing apparatus according to the invention
  • FIG. 2 A schematically shows the creation of a video trailer on basis of a program, according to the invention.
  • Fig. 2B schematically shows the creation of a video summary on basis of a program, according to the invention. Same reference numerals are used to denote similar parts throughout the figures.
  • a program might be a television program as broadcast by a television station, i.e. television broadcaster.
  • the television program will be watched by means of television sets.
  • a program might also be provided by another type of content provider, e.g. by means of the Internet. In that case the program might be watched by other types of equipment than television sets.
  • the program is not broadcast but exchanged by means of removable media, like optical-disks or cassette tapes.
  • the program is a television program. It will be clear that the invention has a broader scope.
  • a television signal comprises picture information, sound information and additional information, such as for example teletext information.
  • the television signal transmits a television program.
  • the television program can comprise a movie or film, an episode of a series, a captured reproduction of a theater performance, a documentary or a sports program.
  • These types of information of the television program may be interrupted by a plurality of units of commercial-break information and announcement information.
  • Each commercial-break usually comprises a plurality of commercial messages.
  • a commercial message usually has a length or commercial message duration of 10, 15, 20, 30, 40 or 60 seconds.
  • Fig. 1 schematically shows an embodiment of a recording and reproducing apparatus 100 according to the invention.
  • This recording and reproducing apparatus 100 is a hard-disk based video storage system.
  • the recording and reproducing apparatus 100 is adapted to record a television signal FS contained in the received signal TS and to reproduce a recorded television signal AFS.
  • the received signal TS may be a broadcast signal received via an antenna or cable but may also be a signal from a storage device like a VCR (Video Cassette Recorder) or Digital Versatile Disk (DVD).
  • the received signal TS is provided by means of the input connector 110.
  • the reproduced television signal AFS is provided at the output connector 112 and can be displayed by means of a display device, e.g. comprised by a television set.
  • the recording and reproducing apparatus 100 includes:
  • This receiving unit 102 e.g. tuner, is arranged to select the television signal FS of a television station.
  • This television signal FS represents a video stream which corresponds to a television program 200;
  • a recording and reproducing means 106 for storage of the video stream as provided by the receiving unit 102.
  • the recording and reproducing means 106 include a signal processing stage for processing the television signal FS to be recorded and for processing the reproduced television signal AFS, as is commonly known. This processing stage might include data compression.
  • the recording and reproducing means 106 include a hard-disk as recording medium for the recording of the processed television signal FS.
  • An exchange unit 104 for adaptation of stored information to a reproduced television signal AFS and for transmission of this a reproduced television signal AFS via the output connector 112, e.g. to a television set.
  • the adaptation might include modulation on a carrier of the television signal FS representing the video stream.
  • the stored information comprises the video stream as provided by the receiving unit 102 and a collection of relevant video segments;
  • a video segment compilation unit 108 for creating such a collection of relevant video segments by selecting respective portions from the video stream which corresponds to the television program.
  • the purpose of this video segment compilation unit 108 is to create a video trailer or alternatively a video abstract of the video stream.
  • the duration of the collection of relevant video segments is relatively short compared with the duration of the television program.
  • a television program takes about 1 or 2 hours and the duration of the collection of relevant video segments is in the range of seconds to minutes. That means e.g. from 10 seconds to 2 minutes.
  • each of the relevant video segments lasts only a few seconds.
  • the duration of the relevant video segments to be selected might be shorter or longer. It is not required that all relevant video segments have the same length.
  • the creation of the collection of relevant video segments can be performed during the recording of the video stream or after the recording has finished. In the former case the video stream is provided by means of connection 114 and in the latter case the video stream is provided by means of connection 116.
  • the video segment compilation unit 108 comprises:
  • a commercial-break detector 118 for detecting non-relevant video segments in the video stream, which correspond to respective commercial-breaks in the television program;
  • a video segment selector 120 for selecting portions from the video stream, which are, in the time-domain, located in a neighborhood of the non-relevant video segments. That means that portions from the video stream are selected which precede or succeed the respective commercial-breaks. These portions can be adjacent to the commercial-breaks but preferably there is a gap or delay, i.e. time difference between the end of a commercial-break and the beginning of a selected portion or vice versa, in the range of a few seconds.
  • the size of the time difference is configurable by the user; and
  • the collection of relevant video segments can be stored as a number of copies of the respective portions of the original video stream. But preferably only a set of pointers is stored. The pointers indicate start or stop locations within the video stream corresponding to begin or end, respectively of the selected portions of the video stream.
  • the collection of relevant video segments, as video data or as pointers can be stored in the same memory device as applied for the storage of the original video stream or in a separate memory device. It will be clear that in the case of a recording and reproducing apparatus which is based on a removable storage medium it is preferred that both video stream and collection of relevant video segments are stored on the same storage medium.
  • the applied commercial-break detector 118 includes detection means adapted to detect black- frame information in the picture information. Black-frame information is present in the picture information when the luminance signal of the television signal has an amplitude value below a black level threshold value during a complete field. When the detection means detect black-frame information they supply black-frame time information representative of the time relationship or position of the detected black-frame information in the television signal. Black-frame time information supplied by the detection means is stored in memory.
  • the commercial-break detector 118 further includes analysis means adapted to analyze whether the time difference between adjacent units of frame picture time iiiformation corresponds to a predetermined preset time difference.
  • black-frame information is followed by further black-frame information within 35 seconds or whether black-frame information is followed by the subsequent black-frame information within a preset time difference of 43 seconds to 50 seconds.
  • preset time differences are based on the fact that commercials usually have a length of 30 seconds, 45 seconds or 60 seconds.
  • alternative commercial-break detectors might be applied too. It is to be noted that a commercial-break is very often preceded and followed by a few scenes of another television film to be broadcast with the aid of a television signal in the near future by way of announcement information. It will be clear that these scenes should not be included in the collection of relevant video segments under construction.
  • this announcement information which may precede and follow a commercial- break in the television signal is skipped during creation of the collection.
  • These scenes are usually characterized by black-frame information including a preceding fade-out and by a high rate of change of scenes.
  • the commercial-break detector 118 it is checked whether a very high rate of change of scenes can be detected adjacent a detected commercial-break, h other words the commercial-break detector 118 is capable of detecting the presence of announcement information.
  • the video segment selector 120 is controlled on basis of this detection. That might be by adapting the above mentioned size of the time difference between commercial-break and relevant video segment to be selected.
  • the commercial-break detector 118 and the video segment selector 120 may be implemented using one processor. Normally, these functions are performed under control of a software program product. During execution, normally the software program product is loaded into a memory, like a RAM, and executed from there. The program may be loaded from a background memory, like a ROM, hard disk, or magnetically and/or optical storage, or may be loaded via a network like Internet. Optionally an application specific integrated circuit provides the disclosed functionality.
  • Fig. 2 A schematically shows the creation of a video trailer 201 on basis of a television program 200, according to the invention.
  • the television program 200 comprises a number of commercial-breaks 202-214.
  • these commercial-breaks 202-214 are not distributed equidistantly in the time-domain, but located at exciting moments of the television program.
  • the number of commercial-breaks in the second half of a television program is higher than the number of commercial-breaks in the first half of the television program.
  • a commercial-break is located such that for the viewer a "question" arises just before the commercial-break starts and that the "question" is answered after the commercial-break.
  • the selected portions 222-234 of the video stream have a duration of a few seconds [1-10 seconds].
  • the duration of the selected video segments might be equal to a predetermined value. But preferably the duration is controllable by a user.
  • the duration of the video segments is related to the duration of the television program. E.g. if the duration of the television program is long then the duration of the selected video segments might be relatively short.
  • the duration of the video segments is related to the number of detected commercial-breaks in the television program. E.g. if the number of commercial-breaks is limited then the duration of the selected video segments might be relatively long.
  • Fig. 2B schematically shows the creation of a video summary 203 on basis of a television program 200, according to the invention.
  • a commercial-break is located such that for the viewer a "question” arises just before the commercial-break starts and that the "question” is answered after the commercial-break.
  • fragments of relatively important scenes of the television program are gathered.
  • the "answers” on, most probably implicit, "questions” are revealed after the commercial-breaks.
  • the collection of relevant video segments that succeed the respective commercial-breaks is very well suitable as a video abstract, because the highlights are disclosed. What is specified, in connection with Fig.
  • duration of video segments for the creation of a video trailer substantially holds for the duration of video segments for the creation of a video abstract.
  • typically the duration of a video segment for a video abstract might be longer than the duration of a video segment for a video trailer.
  • a collection of relevant video segments comprises both portions which precede commercial-breaks and portions which succeed commercial-breaks. These type of collections are typically useful as video abstract.
  • any reference signs placed between parentheses shall not be constructed as limiting the claim.
  • the word 'comprising' does not exclude the presence of elements or steps not listed in a claim.
  • the word "a" or "an” preceding an element does not exclude the presence of a plurality of such elements.
  • the invention can be implemented by means of hardware comprising several distinct elements and by means of a suitable programmed computer. In the unit claims enumerating several means, several of these means can be embodied by one and the same item of hardware.

Landscapes

  • Television Signal Processing For Recording (AREA)

Abstract

La présente invention concerne un procédé permettant de créer une suite de segments vidéo pertinents (201, 203) en sélectionnant les différentes parties considérées (222-234, 242-254) dans une séquence vidéo correspondant à une émission. Cette suite de segments vidéo pertinents (201, 203) peut être mise en oeuvre sous forme de conclusion vidéo ou de résumé vidéo. Il en résulte que la période pendant laquelle s'effectue le recueil des segments vidéo pertinents est relativement courte par comparaison avec la durée de l'émission. Le procédé consiste à détecter dans la séquence vidéo un premier segment vidéo non-pertinent (par exemple 202) correspondant à une coupure publicitaire dans l'émission, puis à sélectionner une première partie parmi les parties considérées dans la séquence vidéo restant dans le domaine temporel, située au voisinage du premier segment vidéo non-pertinent, et à en faire un premier segment des segments vidéo pertinents.
PCT/IB2003/004797 2002-11-19 2003-10-27 Creation de resumes video Ceased WO2004047109A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2003274479A AU2003274479A1 (en) 2002-11-19 2003-10-27 Video abstracting

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP02079797.3 2002-11-19
EP02079797 2002-11-19

Publications (1)

Publication Number Publication Date
WO2004047109A1 true WO2004047109A1 (fr) 2004-06-03

Family

ID=32319623

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2003/004797 Ceased WO2004047109A1 (fr) 2002-11-19 2003-10-27 Creation de resumes video

Country Status (2)

Country Link
AU (1) AU2003274479A1 (fr)
WO (1) WO2004047109A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006077536A3 (fr) * 2005-01-20 2007-02-15 Koninkl Philips Electronics Nv Generation automatique de bandes annonces contenant des placements de produits
CN103929685A (zh) * 2014-04-15 2014-07-16 中国华戎控股有限公司 一种视频摘要生成及索引方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6160950A (en) * 1996-07-18 2000-12-12 Matsushita Electric Industrial Co., Ltd. Method and apparatus for automatically generating a digest of a program
EP1164791A1 (fr) * 1999-02-24 2001-12-19 Sony Corporation Procede de surveillance d'ecran

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6160950A (en) * 1996-07-18 2000-12-12 Matsushita Electric Industrial Co., Ltd. Method and apparatus for automatically generating a digest of a program
EP1164791A1 (fr) * 1999-02-24 2001-12-19 Sony Corporation Procede de surveillance d'ecran

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006077536A3 (fr) * 2005-01-20 2007-02-15 Koninkl Philips Electronics Nv Generation automatique de bandes annonces contenant des placements de produits
US8126763B2 (en) 2005-01-20 2012-02-28 Koninklijke Philips Electronics N.V. Automatic generation of trailers containing product placements
CN103929685A (zh) * 2014-04-15 2014-07-16 中国华戎控股有限公司 一种视频摘要生成及索引方法
CN103929685B (zh) * 2014-04-15 2017-11-07 中国华戎控股有限公司 一种视频摘要生成及索引方法

Also Published As

Publication number Publication date
AU2003274479A1 (en) 2004-06-15

Similar Documents

Publication Publication Date Title
US7894709B2 (en) Video abstracting
TW514875B (en) Commercial skip and chapter delineation feature on DVD recordable media
CN100592286C (zh) 视频内容正向和反向扫描时的图像概要
US8407735B2 (en) Methods and apparatus for identifying segments of content in a presentation stream using signature data
US7046911B2 (en) System and method for reduced playback of recorded video based on video segment priority
US8588579B2 (en) Methods and apparatus for filtering and inserting content into a presentation stream using signature data
US20090196569A1 (en) Video trailer
CN1251487C (zh) 为数字视频记录自动加索引
CN101569191B (zh) 广播台装置和记录重放装置
JP4735413B2 (ja) コンテンツ再生装置およびコンテンツ再生方法
CN100551014C (zh) 内容处理设备、处理内容的方法
WO2004047109A1 (fr) Creation de resumes video
JP2007266838A (ja) 記録再生装置、記録再生方法、及び、記録再生プログラムを記録した記録媒体
JP4675885B2 (ja) 情報記録装置、情報記録方法及び情報記録用プログラム
US20060048204A1 (en) Method of storing a stream of audiovisual data in a memory
JP3782014B2 (ja) テレビ放送録画再生装置及び情報提供サービスシステム
KR101234005B1 (ko) 컨텐트 및 컨텐트에 대한 어플리케이션의 녹화 방법 및 그장치, 컨텐트의 재생 방법 및 그 장치
JPH09294237A (ja) 映像記録再生装置
EP2368358B1 (fr) Procédés et appareil d'identification d'emplacements dans un flux de présentation utilisant des données de signature
JP2012034152A (ja) 記録再生装置
JP2006115405A (ja) 広告信号検出装置及び記録再生装置
JP2006050235A (ja) 受信記録再生装置および放送情報提供装置
KR20050053047A (ko) 방송신호의 음성정보를 이용한 자동 챕터 마킹 기능을가진 디지털 레코더 및 그 방법
JP2010062870A (ja) 映像記録再生装置および映像記録再生方法
JP2006510286A (ja) ブロードキャスト番組を検索及び自動記録するシステム、方法、及び装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP