WO2001003429A3 - Automatic extraction method of the structure of a video sequence - Google Patents

Automatic extraction method of the structure of a video sequence Download PDF

Info

Publication number
WO2001003429A3
WO2001003429A3 PCT/EP2000/006169 EP0006169W WO0103429A3 WO 2001003429 A3 WO2001003429 A3 WO 2001003429A3 EP 0006169 W EP0006169 W EP 0006169W WO 0103429 A3 WO0103429 A3 WO 0103429A3
Authority
WO
WIPO (PCT)
Prior art keywords
sequence
video sequence
extraction method
automatic extraction
entities
Prior art date
Application number
PCT/EP2000/006169
Other languages
French (fr)
Other versions
WO2001003429A2 (en
Inventor
Joan Llach-Pinsach
Philippe Salembier
Original Assignee
Koninkl Philips Electronics Nv
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninkl Philips Electronics Nv filed Critical Koninkl Philips Electronics Nv
Priority to JP2001508162A priority Critical patent/JP2003503971A/en
Priority to EP00949240A priority patent/EP1145549A3/en
Publication of WO2001003429A2 publication Critical patent/WO2001003429A2/en
Publication of WO2001003429A3 publication Critical patent/WO2001003429A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835—Generation of protective data, e.g. certificates
    • H04N21/8352—Generation of protective data, e.g. certificates involving content or source identification data, e.g. Unique Material Identifier [UMID]
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/71—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/147—Scene change detection

Abstract

The invention relates to a method intended to automatically create a description of a video sequence - i.e. its table of contents - by means of an analysis of said sequence. The main step of said method is a temporal segmentation of the video shots of the sequence, using camera motion parameters. This segmentation uses a similarity criterion involving, for sub-entities of each shot, the level of homogeneity of these sub-entities on the motion parameters of the camera used to acquire the original images and generate the bitstream constituting the processed sequence.
PCT/EP2000/006169 1999-07-06 2000-06-30 Automatic extraction method of the structure of a video sequence WO2001003429A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2001508162A JP2003503971A (en) 1999-07-06 2000-06-30 Automatic extraction of video sequence structure
EP00949240A EP1145549A3 (en) 1999-07-06 2000-06-30 Automatic extraction method of the structure of a video sequence

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP99401684 1999-07-06
EP99401684.8 1999-07-06
EP99402594 1999-10-20
EP99402594.8 1999-10-20

Publications (2)

Publication Number Publication Date
WO2001003429A2 WO2001003429A2 (en) 2001-01-11
WO2001003429A3 true WO2001003429A3 (en) 2001-07-26

Family

ID=26153672

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2000/006169 WO2001003429A2 (en) 1999-07-06 2000-06-30 Automatic extraction method of the structure of a video sequence

Country Status (6)

Country Link
US (1) US6842197B1 (en)
EP (1) EP1145549A3 (en)
JP (1) JP2003503971A (en)
KR (1) KR100775773B1 (en)
CN (1) CN1193593C (en)
WO (1) WO2001003429A2 (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003503972A (en) * 1999-07-06 2003-01-28 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Automatic extraction of video sequence structure
US7016540B1 (en) * 1999-11-24 2006-03-21 Nec Corporation Method and system for segmentation, classification, and summarization of video images
US7231394B2 (en) * 2001-07-17 2007-06-12 Sony Corporation Incremental bottom-up construction of data documents
KR100859396B1 (en) * 2001-12-24 2008-09-22 주식회사 케이티 Method of Video Summary through Hierarchical Shot Clustering having Threshold Time using Video Summary Time
US20030140093A1 (en) * 2002-01-23 2003-07-24 Factor Cory L. Method and apparatus for providing content over a distributed network
US8718128B2 (en) * 2003-05-07 2014-05-06 Canon Kabushiki Kaisha Moving image processing method and apparatus
US7418455B2 (en) * 2003-11-26 2008-08-26 International Business Machines Corporation System and method for indexing weighted-sequences in large databases
US8089563B2 (en) * 2005-06-17 2012-01-03 Fuji Xerox Co., Ltd. Method and system for analyzing fixed-camera video via the selection, visualization, and interaction with storyboard keyframes
CN101506891A (en) * 2006-08-25 2009-08-12 皇家飞利浦电子股份有限公司 Method and apparatus for automatically generating a summary of a multimedia content item
US8588514B2 (en) * 2007-05-11 2013-11-19 Koninklijke Philips N.V. Method, apparatus and system for processing depth-related information
KR20090034086A (en) * 2007-10-02 2009-04-07 삼성전자주식회사 Apparatus and method for generating a graphic user interface
WO2010119410A1 (en) * 2009-04-14 2010-10-21 Koninklijke Philips Electronics N.V. Key frames extraction for video content analysis
US9020259B2 (en) * 2009-07-20 2015-04-28 Thomson Licensing Method for detecting and adapting video processing for far-view scenes in sports video
CN102737383B (en) * 2011-03-31 2014-12-17 富士通株式会社 Camera movement analyzing method and device in video
CN103065301B (en) * 2012-12-25 2015-07-22 浙江大学 Method of bidirectional comparison video shot segmentation

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5592226A (en) * 1994-01-26 1997-01-07 Btg Usa Inc. Method and apparatus for video data compression using temporally adaptive motion interpolation
US5835667A (en) * 1994-10-14 1998-11-10 Carnegie Mellon University Method and apparatus for creating a searchable digital video library and a system and method of using such a library
US5774593A (en) * 1995-07-24 1998-06-30 University Of Washington Automatic scene decomposition and optimization of MPEG compressed video
KR100319916B1 (en) * 1995-10-24 2002-04-22 윤종용 Hierarchical Scalable Digital Image Compression / Restoration Methods and Apparatus
US5963670A (en) * 1996-02-12 1999-10-05 Massachusetts Institute Of Technology Method and apparatus for classifying and identifying images
JP4159606B2 (en) * 1996-05-24 2008-10-01 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Motion estimation
US5828809A (en) * 1996-10-01 1998-10-27 Matsushita Electric Industrial Co., Ltd. Method and apparatus for extracting indexing information from digital video data
US6195458B1 (en) * 1997-07-29 2001-02-27 Eastman Kodak Company Method for content-based temporal segmentation of video
KR100265812B1 (en) * 1997-09-26 2000-09-15 윤종용 Apparatus and method for motion segmentation of image sequence
US5956026A (en) * 1997-12-19 1999-09-21 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
JP3738939B2 (en) * 1998-03-05 2006-01-25 Ｋｄｄｉ株式会社 Moving image cut point detection device
US6393054B1 (en) * 1998-04-20 2002-05-21 Hewlett-Packard Company System and method for automatically detecting shot boundary and key frame from a compressed video data
US6307550B1 (en) * 1998-06-11 2001-10-23 Presenter.Com, Inc. Extracting photographic images from video
US6389168B2 (en) * 1998-10-13 2002-05-14 Hewlett Packard Co Object-based parsing and indexing of compressed video streams
US6535639B1 (en) * 1999-03-12 2003-03-18 Fuji Xerox Co., Ltd. Automatic video summarization using a measure of shot importance and a frame-packing method
US6411724B1 (en) * 1999-07-02 2002-06-25 Koninklijke Philips Electronics N.V. Using meta-descriptors to represent multimedia information

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
J. D. COURTNEY: "Automatic video indexing via object motion analysis", PATTERN RECOGNITION, vol. 30, no. 4, April 1997 (1997-04-01), pages 607 - 625, XP002156885 *
T. SHIN ET AL: "Hierarchical scene change detection in an MPEG-2 compressed video sequence", PROCEEDINGS OF THE 1998 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, vol. 4, March 1998 (1998-03-01), pages 253 - 256, XP002156884 *

Also Published As

Publication number Publication date
US6842197B1 (en) 2005-01-11
CN1336071A (en) 2002-02-13
EP1145549A2 (en) 2001-10-17
WO2001003429A2 (en) 2001-01-11
KR100775773B1 (en) 2007-11-12
EP1145549A3 (en) 2001-11-28
KR20010074976A (en) 2001-08-09
JP2003503971A (en) 2003-01-28
CN1193593C (en) 2005-03-16

Similar Documents

Publication Publication Date Title
WO2001003429A3 (en) Automatic extraction method of the structure of a video sequence
EP1225518A3 (en) Apparatus and method for generating object-labelled images in a video sequence
WO2005024698A3 (en) Method and apparatus for performing iris recognition from an image
CA2613998C (en) Method, apparatus and system for alternate image/video insertion
EP1098526A3 (en) Video editing apparatus and method
WO2005065283A3 (en) Method and apparatus for automatically capturing and managing images
WO2004062259A3 (en) Video scene background maintenance using statistical pixel modeling
AU7070896A (en) A method of compressing a plurality of video images
ATE537660T1 (en) METHOD AND DEVICE FOR HIERARCHICAL MOTION ESTIMATION USING BLOCK MATCH
EP1610561A3 (en) Encoding and decoding images
MXPA05006753A (en) System to automatically process components on a device.
EP1608157A3 (en) Method and system for reducing effects of undesired signals in an infrared imaging system
AU2001222942A1 (en) Fingerprint scanner auto-capture system and method
GB9916394D0 (en) Method and apparatus for indexing conference content
EP0990996A3 (en) A method for automatically classifying images into events
WO2001067205A3 (en) System and method for capturing adjacent images by utilizing a panorama mode
WO2004079630A3 (en) Method and device for image surfing
EP1021039A3 (en) Image processing apparatus and method
EP1300801A3 (en) Method for extracting object region
WO2005041122A3 (en) Method, apparatus, and system for preparing images for integration and combining images into an integrated image
WO2005020143A3 (en) Image processors and methods of image processing
EP1309203A3 (en) Method and apparatus for generating image transitions
EP0790580A3 (en) System and method for compression of digital images using motion estimation
EP1330120A3 (en) A method for capturing metadata in captured images
EP2326020A3 (en) Method and apparatus for variable accuracy inter-picture timing specification for digital video encoding

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 00801244.X

Country of ref document: CN

AK Designated states

Kind code of ref document: A2

Designated state(s): CN IN JP KR

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

WWE Wipo information: entry into national phase

Ref document number: 2000949240

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2001 508162

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: IN/PCT/2001/301/CHE

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 1020017002908

Country of ref document: KR

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): CN IN JP KR

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

WWP Wipo information: published in national office

Ref document number: 1020017002908

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2000949240

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2000949240

Country of ref document: EP