Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

A method for automatically locating a predetermined target class of objects in a video image stream, comprising the steps of determining typical colors found in objects of the predetermined target class, detecting a moving area in the video image stream, determining the colors in the moving area, and determining whether the moving area contains colors similar to the predetermined target class typical colors. Additionally the method allows tracking of such located target objects in subsequent frames of the video image stream based upon the colors in the target objects.

Inventor: H. Martin Hunke
Current U.S. Classification: 382/103; 348/169; 382/165
International Classification: G06K 962; G06T 720

View patent at USPTO
Search USPTO Assignment Database

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US5280530Sep 5, 1991Jan 18, 1994U.S. Philips CorporationMethod and apparatus for tracking a moving object
US5323470May 8, 1992Jun 21, 1994Method and apparatus for automatically tracking an object
US5430809Jul 7, 1993Jul 4, 1995Sony CorporationHuman face tracking system
US5473369Feb 23, 1994Dec 5, 1995Sony CorporationObject tracking apparatus

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US6141433Dec 24, 1997Oct 31, 2000NCR CorporationSystem and method for segmenting image regions from a scene likely to represent particular objects in the scene
US6188777Jun 22, 1998Feb 13, 2001Interval Research CorporationMethod and apparatus for personnel detection and tracking
US6198833Sep 16, 1998Mar 6, 2001HoTV, Inc.Enhanced interactive video with object tracking and hyperlinking
US6269173Jul 2, 1998Jul 31, 2001Onemore Inc.Instant response broadcast board system and method
US6289110Sep 22, 1998Sep 11, 2001LG Electronics Inc.Object extracting method using motion picture
US6326994Jan 21, 1998Dec 4, 2001Sony CorporationMatched field-of-view stereographic imaging apparatus
US6360002Jun 11, 2001Mar 19, 2002LG Electronics Inc.Object extracting method using motion picture
US6393403Jun 22, 1998May 21, 2002Nokia Mobile Phones LimitedMobile communication devices having speech recognition functionality
US6404900Jan 14, 1999Jun 11, 2002Sharp Laboratories of America, Inc.Method for robust human face tracking in presence of multiple persons
US6477275Jun 16, 1999Nov 5, 2002Coreco Imaging, Inc.Systems and methods for locating a pattern in an image
US6614465Sep 13, 2001Sep 2, 2003Intel CorporationMethod and apparatus for controlling a remote video camera in a video conferencing system
US6639998Jan 10, 2000Oct 28, 2003LG Electronics Inc.Method of detecting a specific object in an image signal
US6650778Jan 20, 2000Nov 18, 2003Canon Kabushiki KaishaImage processing method and apparatus, and storage medium
US6661907Jun 7, 1999Dec 9, 2003Canon Kabushiki KaishaFace detection in digital images
US6704045Sep 12, 1997Mar 9, 2004Pandora International Ltd.Method of automatically identifying and modifying the appearance of an object in successive frames of a video sequence
US6741273Aug 4, 1999May 25, 2004Mitsubishi Electric Research Laboratories IncVideo camera controlled surround sound
US6754389Dec 1, 1999Jun 22, 2004Koninklijke Philips Electronics N.V.Program classification using object tracking
US6757422Sep 14, 1999Jun 29, 2004Canon Kabushiki KaishaViewpoint position detection apparatus and method, and stereoscopic image display system
US6760465Mar 30, 2001Jul 6, 2004Intel CorporationMechanism for tracking colored objects in a video sequence
US6771813Jul 21, 1999Aug 3, 2004Fujitsu LimitedImage processing apparatus and pattern extraction apparatus
US6816085Nov 17, 2000Nov 9, 2004Method for managing a parking lot
US7003135Aug 17, 2001Feb 21, 2006Industrial Technology Research InstituteSystem and method for rapidly tracking multiple faces
US7043059Jan 9, 2002May 9, 2006Hewlett-Packard Development Company, L.P.Method of selectively storing digital images
US7050606Nov 1, 2001May 23, 2006Cybernet Systems CorporationTracking and gesture recognition system particularly suited to vehicular control applications
US7054481Jul 27, 2001May 30, 2006Canon Kabushiki KaishaAutomatic person meta-data labeller
US7064776Feb 19, 2002Jun 20, 2006National Institute of Advanced Industrial Science and Technology
Stanley Electric Co., Ltd.		Object tracking apparatus, object tracking method and recording medium
US7065241Jan 8, 2001Jun 20, 2006Leuze lumiflex GmbH & Co.Method for monitoring a detection region of a working element
US7085402Sep 5, 2003Aug 1, 2006LG Electronics Inc.Method of detecting a specific object in an image signal
US7119838Aug 19, 2004Oct 10, 2006Blue Marlin LLCMethod and imager for detecting the location of objects
US7121946Jun 29, 2001Oct 17, 2006Cybernet Systems CorporationReal-time head tracking system for computer games and other applications
US7136524Sep 16, 2005Nov 14, 2006Proximex CorporationRobust perceptual color identification
US7146028Apr 10, 2003Dec 5, 2006Canon Kabushiki KaishaFace detection and tracking in a video sequence
US7171023Nov 5, 2002Jan 30, 2007Samsung Electronics Co., Ltd.Illumination-invariant object tracking method and image editing system using the same
US7212228Jan 16, 2003May 1, 2007Advanced Telecommunications Research Institute InternationalAutomatic camera calibration method
US7218759Dec 8, 1999May 15, 2007Canon Kabushiki KaishaFace detection in digital images
US7280688Feb 19, 2004Oct 9, 2007Fujitsu LimitedImage processing apparatus and pattern extraction apparatus
US7346189Sep 5, 2006Mar 18, 2008Samsung Electronics Co., Ltd.Illumination-invariant object tracking method and image editing system using the same
US7349571Sep 29, 2005Mar 25, 2008Fujitsu LimitedImage processing apparatus and pattern extraction apparatus
US7376250Dec 20, 2004May 20, 2008Honda Motor Co., Ltd.Apparatus, method and program for moving object detection
US7460693Sep 27, 2004Dec 2, 2008Seeing Machines Pty LtdMethod and apparatus for the automatic detection of facial features
US7460694Jun 19, 2007Dec 2, 2008FotoNation Vision LimitedReal-time face tracking in a digital image acquisition device
US7460695Jun 21, 2007Dec 2, 2008FotoNation Vision LimitedReal-time face tracking in a digital image acquisition device
US7469055Jun 19, 2007Dec 23, 2008FotoNation Vision LimitedReal-time face tracking in a digital image acquisition device
US7570281Nov 16, 2000Aug 4, 2009Fujifilm CorporationImage processing apparatus and method for detecting a main subject to be photographed
US7586513Apr 7, 2004Sep 8, 2009Tandberg Telecom ASArrangement and method for audio source tracking
US7616233Jun 26, 2003Nov 10, 2009FotoNation Vision LimitedPerfecting of digital image capture parameters within acquisition devices using face detection
US7620218Jun 17, 2008Nov 17, 2009FotoNation Ireland LimitedReal-time face tracking with reference images
US7620266Jan 20, 2005Nov 17, 2009International Business Machines CorporationRobust and efficient foreground analysis for real-time video surveillance
US7630527Jun 20, 2007Dec 8, 2009FotoNation Ireland LimitedMethod of improving orientation and color balance of digital images using face detection information
US7634109Oct 30, 2008Dec 15, 2009FotoNation Ireland LimitedDigital image processing using face detection information
US7650015Feb 20, 2007Jan 19, 2010Image Processing Technologies. LLCImage processing method
US7652593Oct 5, 2006Jan 26, 2010Method for managing a parking lot
US7684592Jan 14, 2008Mar 23, 2010Cybernet Systems CorporationRealtime object tracking system
US7684630Dec 9, 2008Mar 23, 2010FotoNation Vision LimitedDigital image adjustable compression and resolution using face detection information
US7688225Oct 22, 2007Mar 30, 2010Method for managing a parking lot
US7693311Jul 5, 2007Apr 6, 2010FotoNation Vision LimitedPerfecting the effect of flash within an image acquisition devices using face detection
US7697732Feb 23, 2006Apr 13, 2010Sony CorporationData processing apparatus, data processing method and recording medium
US7702136Jul 5, 2007Apr 20, 2010FotoNation Vision LimitedPerfecting the effect of flash within an image acquisition devices using face detection
US7729511Mar 23, 2005Jun 1, 2010Pilz GmbH & Co. KG
Daimler AG		Method and device for safeguarding a hazardous area
US7756322Aug 10, 2004Jul 13, 2010Honda Motor Co., Ltd.Picture taking mobile robot
US7773093Aug 15, 2002Aug 10, 2010Creatier Interactive, LLCMethod and apparatus for associating the color of an object with an event
US7773111Mar 15, 2006Aug 10, 2010LC Technologies, Inc.System and method for perceived image processing in a gaze tracking system
US7804506Feb 25, 2004Sep 28, 2010Creatier Interactive, LLCSystem and method for tracking an object in a video and linking information thereto
US7809162Oct 30, 2008Oct 5, 2010FotoNation Vision LimitedDigital image processing using face detection information
US7813533Oct 6, 2004Oct 12, 2010Fuji Xerox Co., Ltd.Operation-discerning apparatus and apparatus for discerning posture of subject
US7844076Oct 30, 2006Nov 30, 2010FotoNation Vision LimitedDigital image processing using face detection and skin tone information
US7844135Jun 10, 2009Nov 30, 2010Tessera Technologies Ireland LimitedDetecting orientation of digital images using face detection information
US7848549Oct 30, 2008Dec 7, 2010FotoNation Vision LimitedDigital image processing using face detection information
US7853043Dec 14, 2009Dec 14, 2010Tessera Technologies Ireland LimitedDigital image processing using face detection information
US7860274Oct 30, 2008Dec 28, 2010FotoNation Vision LimitedDigital image processing using face detection information
US7864990Dec 11, 2008Jan 4, 2011Tessera Technologies Ireland LimitedReal-time face tracking in a digital image acquisition device
US7868912Apr 5, 2005Jan 11, 2011ObjectVideo, Inc.Video surveillance system employing video primitives
US7912245Jun 20, 2007Mar 22, 2011Tessera Technologies Ireland LimitedMethod of improving orientation and color balance of digital images using face detection information
US7916172Sep 12, 2006Mar 29, 2011Canon Kabushiki KaishaImage pickup apparatus with object tracking capability
US7916897Jun 5, 2009Mar 29, 2011Tessera Technologies Ireland LimitedFace tracking for controlling imaging parameters
US7916977Dec 23, 2009Mar 29, 2011Sony CorporationData processing apparatus, data processing method and recording medium
US7932923Sep 29, 2009Apr 26, 2011ObjectVideo, Inc.Video surveillance system employing video primitives
US7940956Jun 30, 2006May 10, 2011Omron CorporationTracking apparatus that tracks a face position in a dynamic picture image using ambient information excluding the face
US7950802Aug 16, 2006May 31, 2011SeeReal Technologies GmbHMethod and circuit arrangement for recognising and tracking eyes of several observers in real time
US7953251Nov 16, 2010May 31, 2011Tessera Technologies Ireland LimitedMethod and apparatus for detection and correction of flash-induced eye defects within digital images using preview or other reference images
US7956890Sep 19, 2005Jun 7, 2011Proximex CorporationAdaptive multi-modal integrated biometric identification detection and surveillance systems
US7962629Sep 6, 2010Jun 14, 2011Tessera Technologies Ireland LimitedMethod for establishing a paired connection between media devices
US7965875Jun 12, 2007Jun 21, 2011Tessera Technologies Ireland Limited
National University of Ireland		Advances in extending the AAM techniques from grayscale to color images
US7991192Nov 27, 2002Aug 2, 2011Lockheed Martin CorporationMethod of tracking a moving object by an emissivity of the moving object
US8005265Sep 8, 2008Aug 23, 2011Tessera Technologies Ireland LimitedDigital image processing using face detection information
US8019153Sep 18, 2007Sep 13, 2011Canon Kabushiki KaishaWide luminance range colorimetrically accurate profile generation method
US8045757Jun 12, 2007Oct 25, 2011Sony CorporationImage monitoring system and object area tracking method
US8050465Jul 3, 2008Nov 1, 2011DigitalOptics Corporation Europe LimitedReal-time face tracking in a digital image acquisition device
US8055029Jun 18, 2007Nov 8, 2011DigitalOptics Corporation Europe LimitedReal-time face tracking in a digital image acquisition device
US8055067Jan 18, 2007Nov 8, 2011DigitalOptics Corporation Europe LimitedColor segmentation
US8055090Sep 14, 2010Nov 8, 2011DigitalOptics Corporation Europe LimitedDigital image processing using face detection information
US8126207Aug 21, 2008Feb 28, 2012Nikon CorporationSubject tracking method, subject tracking device, and computer program product
US8126208Dec 3, 2010Feb 28, 2012DigitalOptics Corporation Europe LimitedDigital image processing using face detection information
US8131016Dec 3, 2010Mar 6, 2012DigitalOptics Corporation Europe LimitedDigital image processing using face detection information
US8135184May 23, 2011Mar 13, 2012DigitalOptics Corporation Europe LimitedMethod and apparatus for detection and correction of multiple image defects within digital images using preview or other reference images
US8155397Sep 26, 2007Apr 10, 2012DigitalOptics Corporation Europe LimitedFace tracking in a camera processor
US8160299Apr 21, 2011Apr 17, 2012Sony CorporationImage processing apparatus
US8213737Jun 20, 2008Jul 3, 2012DigitalOptics Corporation Europe LimitedDigital image enhancement with reference images
US8224108Dec 4, 2010Jul 17, 2012DigitalOptics Corporation Europe LimitedDigital image processing using face detection information
US8230374Dec 14, 2007Jul 24, 2012Pixel Velocity, Inc.Method of partitioning an algorithm between hardware and software
US8243135Nov 3, 2008Aug 14, 2012Grandeye, Ltd.Multiple-view processing in wide-angle video camera

Claims

1. A method for automatically locating a predetermined target class of objects in a video image stream, comprising the steps of:

(a) determining typical colors found in objects of said predetermined target class;
(b) detecting a moving area in said video image stream;
(c) determining the colors in said moving area;
(d) determining whether the moving area contains colors similar to the predetermined target class typical colors;

wherein said moving area contains at least a portion of a target object in said predetermined target class when said moving area contains colors similar to said predetermined target class typical colors.

2. The method recited in claim 1, further comprising the step of tracking said target object in subsequent frames of said video image stream based upon the colors in said target object.

3. The method recited in claim 1, further comprising the steps of:

(e) selecting a search area in a subsequent frame of said video image stream;
(f) determining colors in said search area;
(g) determining whether the search area colors are consistent with the colors in said target object.

4. The method recited in claim 3, further comprising the steps of predicting the location of said target object based upon the prior location of the said target object, wherein the predicted location is within said search area selected in step (e).

5. The method recited in claim 1, wherein a general target color classifier representative of said predetermined target class colors is used by step (d) to determine whether said moving area contains colors similar to said predetermined target class typical colors.

6. The method recited in claim 3, wherein a individual target color classifier representative of the target object colors is used by step (g) to determine whether said target object is in said search area.

7. The method recited in claim 5, further comprising the steps of modifying said general target color classifier in response to at least one operational condition.

8. The method recited in claim 7, wherein said at least one operational condition is lighting condition.

9. The method recited in claim 7, wherein said at least one operational condition are predetermined characteristics of equipment used to generate said video image stream.

10. The method recited in claim 6, further comprising the steps of modifying said individual target color classifier in response to at least one operational condition.

11. The method recited in claim 10, wherein said at least one operational condition is lighting condition.

12. The method recited in claim 5, wherein said general target color classifier is generated by sampling the colors of sample objects in said predetermined target class.

13. The method recited in claim 1, further comprising the steps of:

(e) ascertaining geometrical structures in said moving area; and
(f) comparing the moving area geometrical structures to the geometrical structures typical of said predetermined target class to determine if said moving area may contain said target object.

Drawings