[go: up one dir, main page]

WO2005072239A3 - Methods and systems for analyzing and summarizing video - Google Patents

Methods and systems for analyzing and summarizing video Download PDF

Info

Publication number
WO2005072239A3
WO2005072239A3 PCT/US2005/001859 US2005001859W WO2005072239A3 WO 2005072239 A3 WO2005072239 A3 WO 2005072239A3 US 2005001859 W US2005001859 W US 2005001859W WO 2005072239 A3 WO2005072239 A3 WO 2005072239A3
Authority
WO
WIPO (PCT)
Prior art keywords
region
board
blocks
content
analyzing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2005/001859
Other languages
French (fr)
Other versions
WO2005072239A2 (en
Inventor
John R Kender
Tiecheng Liu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Columbia University in the City of New York
Original Assignee
Columbia University in the City of New York
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Columbia University in the City of New York filed Critical Columbia University in the City of New York
Publication of WO2005072239A2 publication Critical patent/WO2005072239A2/en
Publication of WO2005072239A3 publication Critical patent/WO2005072239A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/785—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using colour or luminescence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)

Abstract

Methods and systems are provided for analyzing and summarizing instructional videos. According to certain embodiments, video frames are segmented into board background blocks, board content blocks, and irrelevant blocks, and are subsequently merged into a board background region, board content region, occlusion by instructor region, and irrelevant region. The number of chalk pixels in the content areas of each frame are used to define key frames. Mosaiced images are developed to compensate occlusions by an instructor. Additionally, the concept of semantic teaching units is presented, where such semantic units are detected by a model based on the recognition of actions of instructors, and on the measurement of temporal duration and spatial location of board content. Various alternate embodiments are also disclosed.
PCT/US2005/001859 2004-01-21 2005-01-21 Methods and systems for analyzing and summarizing video Ceased WO2005072239A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US53837404P 2004-01-21 2004-01-21
US60/538,374 2004-01-21

Publications (2)

Publication Number Publication Date
WO2005072239A2 WO2005072239A2 (en) 2005-08-11
WO2005072239A3 true WO2005072239A3 (en) 2006-05-11

Family

ID=34825974

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/001859 Ceased WO2005072239A2 (en) 2004-01-21 2005-01-21 Methods and systems for analyzing and summarizing video

Country Status (1)

Country Link
WO (1) WO2005072239A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8804005B2 (en) 2008-04-29 2014-08-12 Microsoft Corporation Video concept detection using multi-layer multi-instance learning
US10901612B2 (en) 2016-12-13 2021-01-26 International Business Machines Corporation Alternate video summarization

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8000533B2 (en) 2006-11-14 2011-08-16 Microsoft Corporation Space-time video montage
WO2014125502A2 (en) 2013-02-18 2014-08-21 Tata Consultancy Services Limited Segmenting objects in multimedia data
US9886793B1 (en) 2016-10-03 2018-02-06 International Business Machines Corporation Dynamic video visualization
CN111144255B (en) * 2019-12-18 2024-04-19 华中科技大学鄂州工业技术研究院 Analysis method and device for non-language behaviors of teacher
CN113190710B (en) * 2021-04-27 2023-05-02 南昌虚拟现实研究院股份有限公司 Semantic video image generation method, semantic video image playing method and related devices
CN114898274B (en) * 2022-06-06 2025-02-11 中邮信息科技(北京)有限公司 A package detection method and device
CN116758255B (en) * 2023-07-13 2025-09-26 电子科技大学 A method for automatically identifying the direction of video images and performing panoramic image stitching

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821335A (en) * 1985-04-05 1989-04-11 Ricoh Company, Limited Electronic blackboard
US5930473A (en) * 1993-06-24 1999-07-27 Teng; Peter Video application server for mediating live video services
US6185560B1 (en) * 1998-04-15 2001-02-06 Sungard Eprocess Intelligance Inc. System for automatically organizing data in accordance with pattern hierarchies therein
US20010049087A1 (en) * 2000-01-03 2001-12-06 Hale Janet B. System and method of distance education
US20020178223A1 (en) * 2001-05-23 2002-11-28 Arthur A. Bushkin System and method for disseminating knowledge over a global computer network
US6564263B1 (en) * 1998-12-04 2003-05-13 International Business Machines Corporation Multimedia content description framework
US20030234772A1 (en) * 2002-06-19 2003-12-25 Zhengyou Zhang System and method for whiteboard and audio capture
US20040002049A1 (en) * 2002-07-01 2004-01-01 Jay Beavers Computer network-based, interactive, multimedia learning system and process

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4821335A (en) * 1985-04-05 1989-04-11 Ricoh Company, Limited Electronic blackboard
US5930473A (en) * 1993-06-24 1999-07-27 Teng; Peter Video application server for mediating live video services
US6185560B1 (en) * 1998-04-15 2001-02-06 Sungard Eprocess Intelligance Inc. System for automatically organizing data in accordance with pattern hierarchies therein
US6564263B1 (en) * 1998-12-04 2003-05-13 International Business Machines Corporation Multimedia content description framework
US20010049087A1 (en) * 2000-01-03 2001-12-06 Hale Janet B. System and method of distance education
US20020178223A1 (en) * 2001-05-23 2002-11-28 Arthur A. Bushkin System and method for disseminating knowledge over a global computer network
US20030234772A1 (en) * 2002-06-19 2003-12-25 Zhengyou Zhang System and method for whiteboard and audio capture
US20040002049A1 (en) * 2002-07-01 2004-01-01 Jay Beavers Computer network-based, interactive, multimedia learning system and process

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8804005B2 (en) 2008-04-29 2014-08-12 Microsoft Corporation Video concept detection using multi-layer multi-instance learning
US10901612B2 (en) 2016-12-13 2021-01-26 International Business Machines Corporation Alternate video summarization

Also Published As

Publication number Publication date
WO2005072239A2 (en) 2005-08-11

Similar Documents

Publication Publication Date Title
CN111242962B (en) Remote training video generation method, device, equipment and storage medium
US8515258B2 (en) Device and method for automatically recreating a content preserving and compression efficient lecture video
CN106254933A (en) Subtitle extraction method and device
EP1645315A3 (en) Pose detection method, video game apparatus pose detection program, and computer-readable medium containing program
EP2154885A4 (en) LEGEND DISPLAY METHOD, VIDEO COMMUNICATION SYSTEM AND APPARATUS
WO2008091483A3 (en) Computer method and apparatus for processing image data
WO2002069267A3 (en) Classification of objects through model ensembles
WO2005041579A3 (en) Method and system for processing captured image information in an interactive video display system
WO2005043270A3 (en) System and method for registering attendance of entities associated with content creation
MY151680A (en) Storage medium storing interactive graphics stream, and reproducing apparatus and method
WO2005072239A3 (en) Methods and systems for analyzing and summarizing video
WO2023195912A3 (en) Processing method and apparatus, terminal device, and medium
CN101005574A (en) Video frequency virtual humance sign language compiling system
CN106657850A (en) Lesson content recording method and system
CN105245817B (en) Video recording playback method and its device
CN113572986B (en) Course recording and broadcasting guiding method and device, readable storage medium and teaching all-in-one machine
KR20140042055A (en) E-learning system of providing video for improvement of study concentration
WO2005057322A3 (en) Methods and apparatus for detecting a television channel change event
CN116311554B (en) Method and system for identifying abnormal student behavior in classroom based on video target detection
Gowing et al. Enhanced visualisation of dance performance from automatically synchronised multimodal recordings
CN111860294A (en) Face capture equipment convenient to trail
CN116955693A (en) Audio-visual significance detection method based on audio-visual consistency sensing
CN204029173U (en) A kind of wireless teaching system
JP2006270711A (en) Information providing device and control program of information providing device
CN116259104A (en) A method, device and system for evaluating the quality of intelligent dance movements

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase