WO2004044842A3 - Method and apparatus for nonlinear multiple motion model and moving boundary extraction - Google Patents

Method and apparatus for nonlinear multiple motion model and moving boundary extraction Download PDF

Info

Publication number
WO2004044842A3
WO2004044842A3 PCT/US2003/035512 US0335512W WO2004044842A3 WO 2004044842 A3 WO2004044842 A3 WO 2004044842A3 US 0335512 W US0335512 W US 0335512W WO 2004044842 A3 WO2004044842 A3 WO 2004044842A3
Authority
WO
WIPO (PCT)
Prior art keywords
motion model
multiple motion
boundary extraction
moving boundary
nonlinear multiple
Prior art date
Application number
PCT/US2003/035512
Other languages
French (fr)
Other versions
WO2004044842A2 (en
Inventor
Marco Paniconi
James J Carrig Jr
Original Assignee
Sony Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Electronics Inc filed Critical Sony Electronics Inc
Priority to AU2003290644A priority Critical patent/AU2003290644A1/en
Priority to EP03783225A priority patent/EP1561347A4/en
Priority to JP2004551854A priority patent/JP4651385B2/en
Publication of WO2004044842A2 publication Critical patent/WO2004044842A2/en
Publication of WO2004044842A3 publication Critical patent/WO2004044842A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/207—Analysis of motion for motion estimation over a hierarchy of resolutions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/215—Motion-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/223—Analysis of motion using block-matching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/521—Processing of motion vectors for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/537—Motion estimation other than block-based
    • H04N19/543—Motion estimation other than block-based using regions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/553—Motion estimation dealing with occlusions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/12—Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows

Abstract

A method (300) and apparatus for nonlinear multiple motion model and moving boundary extraction are disclosed. In one embodiment, an input image is received, the input image is partitioned into regions/blocks, and the new multiple motion model is applied to each region to extraction (308) the motions and associated moving boundaries (312).
PCT/US2003/035512 2002-11-11 2003-11-06 Method and apparatus for nonlinear multiple motion model and moving boundary extraction WO2004044842A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
AU2003290644A AU2003290644A1 (en) 2002-11-11 2003-11-06 Method and apparatus for nonlinear multiple motion model and moving boundary extraction
EP03783225A EP1561347A4 (en) 2002-11-11 2003-11-06 Method and apparatus for nonlinear multiple motion model and moving boundary extraction
JP2004551854A JP4651385B2 (en) 2002-11-11 2003-11-06 Non-linear motion model and method and apparatus for extracting moving boundary

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/291,989 2002-11-11
US10/291,989 US20040091047A1 (en) 2002-11-11 2002-11-11 Method and apparatus for nonlinear multiple motion model and moving boundary extraction

Publications (2)

Publication Number Publication Date
WO2004044842A2 WO2004044842A2 (en) 2004-05-27
WO2004044842A3 true WO2004044842A3 (en) 2005-02-03

Family

ID=32229341

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/035512 WO2004044842A2 (en) 2002-11-11 2003-11-06 Method and apparatus for nonlinear multiple motion model and moving boundary extraction

Country Status (7)

Country Link
US (2) US20040091047A1 (en)
EP (1) EP1561347A4 (en)
JP (1) JP4651385B2 (en)
KR (1) KR101021409B1 (en)
CN (2) CN1711776A (en)
AU (1) AU2003290644A1 (en)
WO (1) WO2004044842A2 (en)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7095786B1 (en) 2003-01-11 2006-08-22 Neo Magic Corp. Object tracking using adaptive block-size matching along object boundary and frame-skipping when object motion is low
US7957466B2 (en) * 2005-09-16 2011-06-07 Sony Corporation Adaptive area of influence filter for moving object boundaries
US8340185B2 (en) * 2006-06-27 2012-12-25 Marvell World Trade Ltd. Systems and methods for a motion compensated picture rate converter
US7783118B2 (en) * 2006-07-13 2010-08-24 Seiko Epson Corporation Method and apparatus for determining motion in images
EP2047687B1 (en) 2006-08-02 2018-05-16 Thomson Licensing DTV Adaptive geometric partitioning for video encoding
US8923400B1 (en) * 2007-02-16 2014-12-30 Geo Semiconductor Inc Method and/or apparatus for multiple pass digital image stabilization
US8488672B2 (en) * 2007-04-17 2013-07-16 Qualcomm Incorporated Mode uniformity signaling for intra-coding
US20090174812A1 (en) * 2007-07-06 2009-07-09 Texas Instruments Incorporated Motion-compressed temporal interpolation
US20090052532A1 (en) * 2007-08-24 2009-02-26 Simon Robinson Automatically identifying edges of moving objects
US8861603B2 (en) * 2007-08-28 2014-10-14 Samsung Electronics Co., Ltd. System and method for motion vector collection based on K-means clustering for motion compensated interpolation of digital video
WO2009032255A2 (en) * 2007-09-04 2009-03-12 The Regents Of The University Of California Hierarchical motion vector processing method, software and devices
US8208552B2 (en) * 2008-01-25 2012-06-26 Mediatek Inc. Method, video encoder, and integrated circuit for detecting non-rigid body motion
US8059908B2 (en) * 2008-04-29 2011-11-15 Sony Corporation Adaptive area of influence filter for irregular spatial sub-sampled images
US8055087B2 (en) * 2008-04-29 2011-11-08 Sony Corporation Sample level variation for spatial sub-sampled images
US8059909B2 (en) * 2008-04-29 2011-11-15 Sony Corporation Adaptive generation of irregular spatial sub-sampling for images
KR101502362B1 (en) 2008-10-10 2015-03-13 삼성전자주식회사 Apparatus and Method for Image Processing
FR2940492A1 (en) * 2008-12-19 2010-06-25 Thomson Licensing MULTI-RESOLUTION MOTION ESTIMATING METHOD
EP2596636A1 (en) * 2010-07-21 2013-05-29 Dolby Laboratories Licensing Corporation Reference processing using advanced motion models for video coding
JP2013048717A (en) * 2011-08-31 2013-03-14 Sony Corp Image processing device and method, recording medium, and program
WO2013107833A1 (en) * 2012-01-19 2013-07-25 Thomson Licensing Method and device for generating a motion field for a video sequence
US9532048B2 (en) 2012-03-15 2016-12-27 Intel Corporation Hierarchical motion estimation employing nonlinear scaling and adaptive source block size
CN104253650B (en) * 2013-06-27 2016-12-28 富士通株式会社 The estimation unit of intrachannel nonlinear damage and method
US9508026B2 (en) * 2014-07-01 2016-11-29 Irida Labs S.A. System and a method for camera motion analysis and understanding from a video sequence
US10306229B2 (en) 2015-01-26 2019-05-28 Qualcomm Incorporated Enhanced multiple transforms for prediction residual
CN107809642B (en) 2015-02-16 2020-06-16 华为技术有限公司 Method for encoding and decoding video image, encoding device and decoding device
US10623774B2 (en) 2016-03-22 2020-04-14 Qualcomm Incorporated Constrained block-level optimization and signaling for video coding tools
CN106384361B (en) * 2016-09-14 2019-06-14 西安理工大学 The non-rigid targets scene flows estimation method to be developed in more view environment based on level set function
US11323748B2 (en) 2018-12-19 2022-05-03 Qualcomm Incorporated Tree-based transform unit (TU) partition for video coding
CN110139100B (en) * 2019-05-16 2021-07-06 东莞职业技术学院 Extended block matching and motion vector estimation algorithm for multi-image motion estimation

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6400831B2 (en) * 1998-04-02 2002-06-04 Microsoft Corporation Semantic video object segmentation and tracking

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3850952T2 (en) 1987-12-22 1995-02-23 Philips Nv Video signal encoding and decoding with an adaptive filter.
JP3531186B2 (en) * 1992-09-18 2004-05-24 ソニー株式会社 Video signal encoding method and apparatus
JP3679426B2 (en) 1993-03-15 2005-08-03 マサチューセッツ・インスティチュート・オブ・テクノロジー A system that encodes image data into multiple layers, each representing a coherent region of motion, and motion parameters associated with the layers.
JPH08223577A (en) * 1994-12-12 1996-08-30 Sony Corp Moving image coding method and device therefor and moving image decoding method and device therefor
JP3432937B2 (en) * 1995-03-15 2003-08-04 株式会社東芝 Moving object detecting device and moving object detecting method
JP3929492B2 (en) 1995-10-25 2007-06-13 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Segmented image encoding method and system, and decoding method and system thereof
KR970025184A (en) 1995-10-26 1997-05-30 김광호 Moving picture decoder using predictive macroblock transform
US5778097A (en) 1996-03-07 1998-07-07 Intel Corporation Table-driven bi-directional motion estimation using scratch area and offset valves
WO1997040628A1 (en) 1996-04-19 1997-10-30 Nokia Mobile Phones Limited Video encoder and decoder using motion-based segmentation and merging
JP3876392B2 (en) 1996-04-26 2007-01-31 富士通株式会社 Motion vector search method
US5991447A (en) 1997-03-07 1999-11-23 General Instrument Corporation Prediction and coding of bi-directionally predicted video object planes for interlaced digital video
US6249548B1 (en) 1998-07-10 2001-06-19 U.S. Phillips Corporation Motion vector processing
US6658059B1 (en) * 1999-01-15 2003-12-02 Digital Video Express, L.P. Motion field modeling and estimation using motion transform
US6665423B1 (en) * 2000-01-27 2003-12-16 Eastman Kodak Company Method and system for object-oriented motion-based video description
KR100415266B1 (en) * 2000-05-11 2004-01-16 가부시끼가이샤 도시바 Object region information description method, object region information generating device and recording medium
US6731799B1 (en) * 2000-06-01 2004-05-04 University Of Washington Object segmentation with background extraction and moving boundary techniques
US7092550B2 (en) * 2001-12-12 2006-08-15 Sony Corporation Implementation of hough transform and its application in video motion analysis
BR0304545A (en) 2002-01-14 2004-11-03 Nokia Corp Method of encoding images in a digital video sequence to provide encoded video data, video encoder, decoding method of data indicative of a digital video sequence, video decoder, and video decoding system
US6646578B1 (en) 2002-11-22 2003-11-11 Ub Video Inc. Context adaptive variable length decoding system and method

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6400831B2 (en) * 1998-04-02 2002-06-04 Microsoft Corporation Semantic video object segmentation and tracking

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1561347A4 *

Also Published As

Publication number Publication date
CN1711776A (en) 2005-12-21
US20050213660A1 (en) 2005-09-29
CN101257632A (en) 2008-09-03
EP1561347A2 (en) 2005-08-10
US7751479B2 (en) 2010-07-06
CN101257632B (en) 2011-12-14
US20040091047A1 (en) 2004-05-13
WO2004044842A2 (en) 2004-05-27
EP1561347A4 (en) 2009-03-18
AU2003290644A8 (en) 2004-06-03
KR101021409B1 (en) 2011-03-14
JP4651385B2 (en) 2011-03-16
JP2006505870A (en) 2006-02-16
KR20050072139A (en) 2005-07-08
AU2003290644A1 (en) 2004-06-03

Similar Documents

Publication Publication Date Title
WO2004044842A3 (en) Method and apparatus for nonlinear multiple motion model and moving boundary extraction
EP1845735A4 (en) Moving picture encoding method, and apparatus and computer program using the same
AU2003215858A1 (en) Method, apparatus, and program for providing slow motion advertisements in video information
EP1499134A4 (en) Moving picture coding method and decoding method, and apparatus and program using the same
AU2003285807A1 (en) Method for configuring 3d input device, method for reconfiguring 3d input device, method for recognizing wearing of the 3d input device, and the apparatus thereof
EP2533203A3 (en) Video-information decoding apparatus and method
IL146902A0 (en) Drive apparatus, press machine slide drive apparatus and method thereof
WO2004003741A3 (en) Integration of heterogeneous applications
HK1060989A1 (en) Video game apparatus, image processing method and program
HUP0301952A3 (en) Method and system in a computing environment, as well as a computer-readable medium
AU2003270528A8 (en) Method and apparatus for splitting a logical block
WO2005034180A3 (en) System and method for on-tool semiconductor simulation
EP1550938A4 (en) Input method for optimizing digitize operation code for the world characters information and information processing system thereof
EP1499119A4 (en) Image processing apparatus, image processing method, and image processing program
EP1530875A4 (en) Image processing apparatus, control method thereof and control program thereof
EP1575217A4 (en) Communication processing apparatus, communication processing method, and computer program
GB2397991B (en) Apparatus,method and a computer readable medium for providing interactive services
EP1574991A4 (en) Similar image extraction device, similar image extraction method, and similar image extraction program
SG116504A1 (en) Screen display processing apparatus, screen display processing method and computer program.
AU2003273117A1 (en) Alphabet input apparatus and alphabet input method
AU2003220948A1 (en) Photographing apparatus, photographing method and computer program
HK1042262A1 (en) Game machine, method of controlling operation of the game machine, and computer readable medium for controlling the game machine
AU2003241557A1 (en) Micromechanical and related lidar apparatus and method, and fast light-routing components
HK1056068A1 (en) Image processing apparatus, computer readable medium storing program and image processing method
WO2000069162A3 (en) A method and apparatus for video decoding

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003783225

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 20038A30216

Country of ref document: CN

Ref document number: 1020057008406

Country of ref document: KR

Ref document number: 2004551854

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 1020057008406

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2003783225

Country of ref document: EP