WO2000036546A1 - Method for detecting a face in a digital image - Google Patents
Method for detecting a face in a digital image Download PDFInfo
- Publication number
- WO2000036546A1 WO2000036546A1 PCT/EP1999/009360 EP9909360W WO0036546A1 WO 2000036546 A1 WO2000036546 A1 WO 2000036546A1 EP 9909360 W EP9909360 W EP 9909360W WO 0036546 A1 WO0036546 A1 WO 0036546A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pixels
- bounding box
- components
- facial
- binary image
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
Definitions
- This invention relates to the field of image detection and more specifically to the detection of a face disposed within a digital image.
- broadcasting becomes more digitally based, it becomes easier to archive and catalog video content.
- researchers have developed systems for content-based image and video indexing and retrieval that utilize low-level visual features (semantics) like color, texture, shape and sketch of an image.
- Human activities are important events in video clips and face detection is a step toward the recognization of human activities.
- Face detection is also useful in security systems, criminal identifications, digital image capturing, and teleconferences.
- a security system for example, it is useful to detect the facial portions of an image being viewed so that an operator of the system can discern whether a human is present in the image.
- One prior art technique that does perform face detection determines whether a cluster of pixels conforms to a facial template. This routine is deficient because of different scales and orientations of possible faces.
- the template itself is one size and orientation and will not detect faces which are of a different size or are rotated. Consequently, the template itself must be scaled up and down and rotated while searching is performed yielding a search space that is too big to be useful or practical.
- Some prior art techniques like EPA 0836326 A2, use merely a shape template to see if a cluster of pixels conforms to that shape. In addition to the scaling and rotation problems mentioned above, this solution is too simplistic to be used with complex backgrounds which may have many objects with the same shape as a face and perhaps even the same color as a face.
- One aspect of the invention is a method for detecting a face disposed within a digital image.
- the method comprises providing a digital image composed of a plurality of pixels and producing a binary image from the digital image by detecting skin colored pixels.
- the method further includes removing pixels corresponding to edges in the luminance component thereby producing binary image components; mapping the binary image components into at least one graph; and classifying the mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates.
- Another aspect of the invention is a computer readable storage medium containing data for performing the steps of providing a digital image composed of a plurality of pixels and producing a binary image from the digital image by detecting skin colored pixels.
- the computer readable storage medium further contains data for removing pixels corresponding to edges in the luminance component thereby producing binary image components; mapping the binary image components into at least one graph; and classifying the mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates.
- Yet another aspect of the invention is a method for detecting a face disposed within a digital image. The method comprises providing a digital image composed of a plurality of pixels and producing a binary image from the digital image by detecting skin colored pixels.
- the method further includes removing pixels corresponding to edges in the luminance component thereby producing binary image components; and classifying each of the binary image components as one of a facial type and a non-facial type.
- the classifying includes forming a bounding box around a classified component of the components and performing at least one of: comparing an area of the bounding box to a bounding box threshold; comparing an aspect ratio of the bounding box to an aspect ratio threshold; determining an area ratio, the area ratio being the comparison between the area of the classified component and the area of the bounding box, and comparing the area ratio to an area ratio threshold; determining an orientation of elongated objects within the bounding box; and determining a distance between a center of the bounding box and a center of the classified component.
- Fig. 1 is a diagram of a cylindrical coordinate system used for graphing colors of pixels in images
- Fig. 2 is three graphs representing projections of the YUV color domain indicating the areas where skin colored pixels lie;
- Figs. 3A-3F are original images and respective binary images, the binary images being formed by grouping pixels based on color;
- Fig. 4 is a diagram illustrating how a 3x3 mask is used as part of luminance variation detection in accordance with the invention.
- Figs. 5A and 5B are diagrams illustrating 4 and 8 type connectivity, respectively;
- Figs. 6A and 6B are images showing what the image of Figs. 3C and 3E would look like after the edges are removed in accordance with the invention
- Fig. 7 is an image showing examples of bounding boxes applied to the image of
- Fig. 8 is a sequence of diagrams showing how components of an image are represented by vertices and connected to form a graph in accordance with the invention.
- Figs. 9A - 9D are a sequence of images illustrating the application of a heuristic according to the invention.
- Fig. 10 is a flow chart detailing the general steps involved in the invention.
- Fig. 11 is a diagram showing two different computer readable storage mediums which could be used to store data used for implementing the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
- Each pixel in an image is generally represented in the HSV (hue, saturation, value) color domain. These values are mapped onto a cylindrical coordinate system as shown in Fig. 1 where P is the value (or luminance), ⁇ is the hue, and r is the saturation. Due to the non-linearity of cylindrical coordinate systems, other color spaces are used to approximate the HSV space. In the present applications, the YUV color space is used because most video material stored on a magnetic medium and the MPEG2 standard, both use this color space.
- each pixel in an image is examined to discern whether it is skin colored. Those pixels which are skin colored are grouped from the rest of the image and are thus retained as potential face candidates. If at least one projection of a pixel does not fall within the boundaries of the skin cluster segment, the pixel is deemed not skin colored and removed from consideration as a potential face candidate.
- the resultant image formed by the skin color detection is binary because it shows either portions of the image which are skin color or portions which are not skin color as shown in Figs. 3B, 3D, and 3F which correspond to original images in Figs. 3A, 3C, and 3E respectively.
- white is shown for skin color and black for non-skin color.
- this detecting step alone may rule out large portions of the image as having a face disposed within it.
- Prior art techniques which use color and shape may thus work for simple backgrounds like that shown in Fig. 3A.
- looking at Figs. 3C and 3D and Figs. 3E and 3F it is clear that detection by color and shape alone may not be sufficient to detect the faces.
- Figs. 3C-3F objects in the background like leather, wood, clothes, and hair, have colors similar to skin. As can be seen in Figs. 3D and 3F, these skin colored objects are disposed immediately adjacent to the skin of the faces and so the faces themselves are difficult to detect.
- the pixels located on edges are removed from consideration. An edge is a change in the brightness level from one pixel to the next. The removal is accomplished by taking each skin colored pixel and calculating the variance in the pixels around it in the luminance component; a high variance being indicative of an edge.
- a box (“window"), the size of either 3x3 or 5x5 pixels is placed on top of a skin colored pixel.
- Clearly, other masks besides a square box could be used.
- the variance is defined as
- ⁇ x is the average of all the pixels in the examined window.
- a "high" variance level will be different depending upon the face and the camera used in broadcasting the digital image.
- an iterative routine is used starting with a very high variance level and working down to a low variance level.
- Connected components are pixels which are of the same binary value (white for facial color) and connected. Connectivity can be either 4 or 8 type connectivity. As shown in Fig. 5A, for 4 type connectivity, the center pixel is considered “connected” to only pixels directly adjacent to it as is indicated by the "1 " in the adjacent boxes. In 8 type connectivity, as is shown in Fig. 5B, pixels diagonally touching the center pixel are also considered to be "connected" to that pixel.
- the connected components are examined in a component classification step to see if they could be a face.
- This examination involves looking at 5 distinct criteria based upon a bounding box drawn around each resulting connected component; examples of which are shown in Fig. 7 based on the image of Fig. 3E.
- the criteria are:
- the area of the bounding box compared to a threshold. This recognizes the fact that a face will generally not be very large or very small.
- the aspect ratio (height compared to the width) of the bounding box compared to a threshold. This recognizes that human faces generally fall into a range of aspect ratios.
- the orientation of elongated objects within the bounding box There are many known ways of determining the orientation of a series of pixels. For example, the medial axis can be determined and the orientation can be found from that axis. In general, faces are not rotated significantly about the axis ("z-axis") which is perpendicular to the plane having the image and so components with elongated objects that are rotated with respect to the z-axis are removed from consideration. 5. The distance between the center of the bounding box and the center of mass of the component being examined. Generally, faces are located within the center of the of the bounding box and will not, for example, be located all to one side.
- Figs. 3C and 3E are shown transformed in Figs. 6A and 6B respectively after the variance iteration process.
- faces in the image were separated from the non-facial skin colored areas in the background as a result of the variance iteration. Frequently, this causes the area with detected skin color to be fragmented as is exemplified in Fig. 6B. This occurs because either there are objects occluding portions of the face (like eyeglasses or facial hair) or because portions were removed due to high variance. It would thus be difficult to look for a face using the resulting components by themselves.
- each resulting component (that survives the color detecting, edge removal, and component classification steps) is represented by a vertex of a graph. Vertices are connected if they are close in space in the original image and if they have a similar color in the original image.
- Y n , U n , and V n are the average values of the luminance and chrominance of the n th component and t n are threshold values.
- the thresholds are based upon variations in the Y, U, and V values in faces and are kept high enough so that components of the same face will be considered similar. Components are considered close in space if the distance between them is less than a threshold. The spatial requirement ensures that spatially distant components are not grouped together because portions of a face would not normally be located in spatially distant portions of an image.
- the connection between vertices is called an edge.
- Each edge is given a weight which is proportional to the Euclidean distance between the two vertices. Connecting the vertices together will result in a graph or a set of disjointed graphs.
- the minimum spanning tree is extracted.
- the minimum spanning tree is generally defined as the subset of a graph where all of the vertices are still connected and the sum of the lengths of the edges of the graph is as small as possible (minimum weight).
- the components corresponding to each resulting graph are classified as either face or not face using the shape parameters defined in the component classification step mentioned above except that now all the components in a graph are classified as a whole instead of one component at a time.
- each graph is split into two graphs by removing the weakest edge (the edge with the greatest weight) and the corresponding components of the resulting graphs are examined again. The division continues until the area of a bounding box formed around the resultant graphs is smaller than a threshold.
- a mask is chosen and applied to each pixel within a potential facial area.
- a 3x3 mask could be used.
- a dilation algorithm is applied to expand the borders of face candidate components.
- an erosion algorithm is used to eliminate pixels from the borders.
- these two algorithms performed in this order, will fill in gaps between components and will also keep the components at substantially the same scale.
- the ratio of pixels with a high variance neighborhood inside the face candidate area is compared to the total number of pixels in the face candidate area. Referring to Figs. 9A to 9D, an original image in Fig.
- FIG. 9A is examined for potential face candidates using the methods described above to achieve the binary image shown in Fig. 9B.
- the morphological closing operation is performed on the binary image resulting in the image shown in Fig. 9C.
- pixels with high variance located in the image of Fig 9C are detected as is shown in Fig. 9D.
- the ratio of the high variance pixels to the total number of pixels can then be determined.
- the invention through detecting pixels that are skin colored, removing edges, grouping components, classifying components, and applying a heuristic, thereby detects faces disposed within a digital image.
- the method can be summarized by steps S2-S16 shown in Fig. 10.
- the data for performing the steps can be stored on a computer readable storage medium 50 or 52 like that shown in Fig. 11.
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP99961034A EP1053530A1 (en) | 1998-12-11 | 1999-12-01 | Method for detecting a face in a digital image |
JP2000588717A JP2002532807A (en) | 1998-12-11 | 1999-12-01 | Method for detecting faces in digital images |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/210,415 US6263113B1 (en) | 1998-12-11 | 1998-12-11 | Method for detecting a face in a digital image |
US09/210,415 | 1998-12-11 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2000036546A1 true WO2000036546A1 (en) | 2000-06-22 |
Family
ID=22782815
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP1999/009360 WO2000036546A1 (en) | 1998-12-11 | 1999-12-01 | Method for detecting a face in a digital image |
Country Status (5)
Country | Link |
---|---|
US (2) | US6263113B1 (en) |
EP (1) | EP1053530A1 (en) |
JP (1) | JP2002532807A (en) |
KR (1) | KR100677177B1 (en) |
WO (1) | WO2000036546A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006508462A (en) * | 2002-11-29 | 2006-03-09 | ソニー・ユナイテッド・キングダム・リミテッド | Face detection |
AU2008260018B2 (en) * | 2008-12-18 | 2010-09-23 | Canon Kabushiki Kaisha | Refining text extraction in colour compound documents |
Families Citing this family (135)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AUPP400998A0 (en) * | 1998-06-10 | 1998-07-02 | Canon Kabushiki Kaisha | Face detection in digital images |
US6263113B1 (en) * | 1998-12-11 | 2001-07-17 | Philips Electronics North America Corp. | Method for detecting a face in a digital image |
US7057636B1 (en) * | 1998-12-22 | 2006-06-06 | Koninklijke Philips Electronics N.V. | Conferencing system and method for the automatic determination of preset positions corresponding to participants in video-mediated communications |
US6639998B1 (en) * | 1999-01-11 | 2003-10-28 | Lg Electronics Inc. | Method of detecting a specific object in an image signal |
US7155033B1 (en) * | 1999-02-01 | 2006-12-26 | Thomson Licensing | Coarse representation of visual object's shape for search/query/filtering applications |
US6940545B1 (en) * | 2000-02-28 | 2005-09-06 | Eastman Kodak Company | Face detecting camera and method |
JP4526639B2 (en) * | 2000-03-02 | 2010-08-18 | 本田技研工業株式会社 | Face recognition apparatus and method |
JP2001282846A (en) * | 2000-03-29 | 2001-10-12 | Canon Inc | Image retrieval method and device |
US7221780B1 (en) * | 2000-06-02 | 2007-05-22 | Sony Corporation | System and method for human face detection in color graphics images |
US7010146B2 (en) * | 2000-06-12 | 2006-03-07 | Kabushiki Kaisha Topcon | Database constructing system |
WO2002019137A1 (en) * | 2000-08-29 | 2002-03-07 | Imageid Ltd. | Indexing, storage & retrieval of digital images |
US20020085738A1 (en) * | 2000-12-28 | 2002-07-04 | Peters Geoffrey W. | Controlling a processor-based system by detecting flesh colors |
KR100416991B1 (en) * | 2001-01-11 | 2004-02-05 | 삼성전자주식회사 | Video terminal apparatus having displaying virtual background and implementing method thereof |
US20020145756A1 (en) * | 2001-04-06 | 2002-10-10 | Stoecker Steven D. | Passport photograph generation system |
TW505892B (en) * | 2001-05-25 | 2002-10-11 | Ind Tech Res Inst | System and method for promptly tracking multiple faces |
KR20030026529A (en) * | 2001-09-26 | 2003-04-03 | 엘지전자 주식회사 | Keyframe Based Video Summary System |
US7130446B2 (en) * | 2001-12-03 | 2006-10-31 | Microsoft Corporation | Automatic detection and tracking of multiple individuals using multiple cues |
AU2002359172A1 (en) * | 2002-01-16 | 2003-07-30 | Autoliv Development Ab | A camera arrangement |
GB0200954D0 (en) * | 2002-01-16 | 2002-03-06 | Autoliv Dev | Improvements in or relating to a camera arrangement |
US20030174869A1 (en) * | 2002-03-12 | 2003-09-18 | Suarez Anthony P. | Image processing apparatus, image processing method, program and recording medium |
EP1353516A1 (en) * | 2002-04-08 | 2003-10-15 | Mitsubishi Electric Information Technology Centre Europe B.V. | A method and apparatus for detecting and/or tracking one or more colour regions in an image or sequence of images |
EP1439484B1 (en) * | 2002-11-22 | 2009-01-21 | Océ-Technologies B.V. | Segmenting an image via shortest cycles |
DE60325934D1 (en) * | 2002-11-22 | 2009-03-12 | Oce Tech Bv | Segmentation of an image by means of shortest cycles |
JP4538214B2 (en) * | 2002-11-22 | 2010-09-08 | オセ−テクノロジーズ・ベー・ヴエー | Image segmentation by graph |
US7844076B2 (en) | 2003-06-26 | 2010-11-30 | Fotonation Vision Limited | Digital image processing using face detection and skin tone information |
US7587068B1 (en) | 2004-01-22 | 2009-09-08 | Fotonation Vision Limited | Classification database for consumer digital images |
US7269292B2 (en) * | 2003-06-26 | 2007-09-11 | Fotonation Vision Limited | Digital image adjustable compression and resolution using face detection information |
US9692964B2 (en) | 2003-06-26 | 2017-06-27 | Fotonation Limited | Modification of post-viewing parameters for digital images using image region or feature information |
US9129381B2 (en) | 2003-06-26 | 2015-09-08 | Fotonation Limited | Modification of post-viewing parameters for digital images using image region or feature information |
US7315630B2 (en) * | 2003-06-26 | 2008-01-01 | Fotonation Vision Limited | Perfecting of digital image rendering parameters within rendering devices using face detection |
US8682097B2 (en) | 2006-02-14 | 2014-03-25 | DigitalOptics Corporation Europe Limited | Digital image enhancement with reference images |
US7362368B2 (en) * | 2003-06-26 | 2008-04-22 | Fotonation Vision Limited | Perfecting the optics within a digital image acquisition device using face detection |
US8330831B2 (en) | 2003-08-05 | 2012-12-11 | DigitalOptics Corporation Europe Limited | Method of gathering visual meta data using a reference image |
US7317815B2 (en) * | 2003-06-26 | 2008-01-08 | Fotonation Vision Limited | Digital image processing composition using face detection information |
US8155397B2 (en) | 2007-09-26 | 2012-04-10 | DigitalOptics Corporation Europe Limited | Face tracking in a camera processor |
US7616233B2 (en) * | 2003-06-26 | 2009-11-10 | Fotonation Vision Limited | Perfecting of digital image capture parameters within acquisition devices using face detection |
US8553949B2 (en) | 2004-01-22 | 2013-10-08 | DigitalOptics Corporation Europe Limited | Classification and organization of consumer digital images using workflow, and face detection and recognition |
US8498452B2 (en) | 2003-06-26 | 2013-07-30 | DigitalOptics Corporation Europe Limited | Digital image processing using face detection information |
US8494286B2 (en) | 2008-02-05 | 2013-07-23 | DigitalOptics Corporation Europe Limited | Face detection in mid-shot digital images |
US7680342B2 (en) | 2004-08-16 | 2010-03-16 | Fotonation Vision Limited | Indoor/outdoor classification in digital images |
US8363951B2 (en) | 2007-03-05 | 2013-01-29 | DigitalOptics Corporation Europe Limited | Face recognition training method and apparatus |
US8896725B2 (en) | 2007-06-21 | 2014-11-25 | Fotonation Limited | Image capture device with contemporaneous reference image capture mechanism |
US8593542B2 (en) | 2005-12-27 | 2013-11-26 | DigitalOptics Corporation Europe Limited | Foreground/background separation using reference images |
US7792335B2 (en) | 2006-02-24 | 2010-09-07 | Fotonation Vision Limited | Method and apparatus for selective disqualification of digital images |
US7574016B2 (en) | 2003-06-26 | 2009-08-11 | Fotonation Vision Limited | Digital image processing using face detection information |
US7792970B2 (en) | 2005-06-17 | 2010-09-07 | Fotonation Vision Limited | Method for establishing a paired connection between media devices |
US7471846B2 (en) | 2003-06-26 | 2008-12-30 | Fotonation Vision Limited | Perfecting the effect of flash within an image acquisition devices using face detection |
US8989453B2 (en) | 2003-06-26 | 2015-03-24 | Fotonation Limited | Digital image processing using face detection information |
US8948468B2 (en) | 2003-06-26 | 2015-02-03 | Fotonation Limited | Modification of viewing parameters for digital images using face detection information |
US7620218B2 (en) | 2006-08-11 | 2009-11-17 | Fotonation Ireland Limited | Real-time face tracking with reference images |
US7440593B1 (en) | 2003-06-26 | 2008-10-21 | Fotonation Vision Limited | Method of improving orientation and color balance of digital images using face detection information |
US7565030B2 (en) | 2003-06-26 | 2009-07-21 | Fotonation Vision Limited | Detecting orientation of digital images using face detection information |
US7190829B2 (en) * | 2003-06-30 | 2007-03-13 | Microsoft Corporation | Speedup of face detection in digital images |
US20050063568A1 (en) * | 2003-09-24 | 2005-03-24 | Shih-Ching Sun | Robust face detection algorithm for real-time video sequence |
JP2005196270A (en) * | 2003-12-26 | 2005-07-21 | Konica Minolta Photo Imaging Inc | Image processing method, image processing equipment, and image processing program |
CN100418106C (en) * | 2003-12-29 | 2008-09-10 | 佳能株式会社 | Method and apparatus for detecting human face |
US7564994B1 (en) * | 2004-01-22 | 2009-07-21 | Fotonation Vision Limited | Classification system for consumer digital images using automatic workflow and face detection and recognition |
US7555148B1 (en) | 2004-01-22 | 2009-06-30 | Fotonation Vision Limited | Classification system for consumer digital images using workflow, face detection, normalization, and face recognition |
US7551755B1 (en) | 2004-01-22 | 2009-06-23 | Fotonation Vision Limited | Classification and organization of consumer digital images using workflow, and face detection and recognition |
US7558408B1 (en) | 2004-01-22 | 2009-07-07 | Fotonation Vision Limited | Classification system for consumer digital images using workflow and user interface modules, and face detection and recognition |
JP3714350B2 (en) * | 2004-01-27 | 2005-11-09 | セイコーエプソン株式会社 | Human candidate region extraction method, human candidate region extraction system, and human candidate region extraction program in image |
WO2005071614A1 (en) * | 2004-01-27 | 2005-08-04 | Seiko Epson Corporation | Human face detection position shift correction method, correction system, and correction program |
CN1954543A (en) * | 2004-04-14 | 2007-04-25 | 数码河股份有限公司 | Geographic location based licensing system |
US8320641B2 (en) | 2004-10-28 | 2012-11-27 | DigitalOptics Corporation Europe Limited | Method and apparatus for red-eye detection using preview or other reference images |
US7796827B2 (en) * | 2004-11-30 | 2010-09-14 | Hewlett-Packard Development Company, L.P. | Face enhancement in a digital video |
US8503800B2 (en) | 2007-03-05 | 2013-08-06 | DigitalOptics Corporation Europe Limited | Illumination detection using classifier chains |
US7715597B2 (en) | 2004-12-29 | 2010-05-11 | Fotonation Ireland Limited | Method and component for image recognition |
US7315631B1 (en) | 2006-08-11 | 2008-01-01 | Fotonation Vision Limited | Real-time face tracking in a digital image acquisition device |
JP4824411B2 (en) * | 2005-01-20 | 2011-11-30 | パナソニック株式会社 | Face extraction device, semiconductor integrated circuit |
TWI297863B (en) * | 2005-05-09 | 2008-06-11 | Compal Electronics Inc | Method for inserting a picture in a video frame |
KR100695159B1 (en) * | 2005-08-04 | 2007-03-14 | 삼성전자주식회사 | Apparatus and method for generating RGB map for skin color model and apparatus and method for detecting skin color employing the same |
KR101303877B1 (en) * | 2005-08-05 | 2013-09-04 | 삼성전자주식회사 | Method and apparatus for serving prefer color conversion of skin color applying face detection and skin area detection |
US7545954B2 (en) * | 2005-08-22 | 2009-06-09 | General Electric Company | System for recognizing events |
KR100756047B1 (en) | 2006-01-25 | 2007-09-07 | 한국인식산업(주) | Apparatus for recognizing a biological face and method therefor |
US7804983B2 (en) | 2006-02-24 | 2010-09-28 | Fotonation Vision Limited | Digital image acquisition control and correction method and apparatus |
KR100695174B1 (en) * | 2006-03-28 | 2007-03-14 | 삼성전자주식회사 | Method and apparatus for tracking listener's head position for virtual acoustics |
JP4765732B2 (en) * | 2006-04-06 | 2011-09-07 | オムロン株式会社 | Movie editing device |
EP2033142B1 (en) | 2006-06-12 | 2011-01-26 | Tessera Technologies Ireland Limited | Advances in extending the aam techniques from grayscale to color images |
EP2050043A2 (en) | 2006-08-02 | 2009-04-22 | Fotonation Vision Limited | Face recognition with combined pca-based datasets |
US7403643B2 (en) | 2006-08-11 | 2008-07-22 | Fotonation Vision Limited | Real-time face tracking in a digital image acquisition device |
US7916897B2 (en) | 2006-08-11 | 2011-03-29 | Tessera Technologies Ireland Limited | Face tracking for controlling imaging parameters |
TW200809700A (en) * | 2006-08-15 | 2008-02-16 | Compal Electronics Inc | Method for recognizing face area |
US7689011B2 (en) * | 2006-09-26 | 2010-03-30 | Hewlett-Packard Development Company, L.P. | Extracting features from face regions and auxiliary identification regions of images for person recognition and other applications |
US20080107341A1 (en) * | 2006-11-02 | 2008-05-08 | Juwei Lu | Method And Apparatus For Detecting Faces In Digital Images |
JP4845715B2 (en) * | 2006-12-22 | 2011-12-28 | キヤノン株式会社 | Image processing method, image processing apparatus, program, and storage medium |
US8055067B2 (en) | 2007-01-18 | 2011-11-08 | DigitalOptics Corporation Europe Limited | Color segmentation |
EP2115662B1 (en) | 2007-02-28 | 2010-06-23 | Fotonation Vision Limited | Separating directional lighting variability in statistical face modelling based on texture space decomposition |
JP4970557B2 (en) | 2007-03-05 | 2012-07-11 | デジタルオプティックス・コーポレイション・ヨーロッパ・リミテッド | Face search and detection in digital image capture device |
WO2008109622A1 (en) | 2007-03-05 | 2008-09-12 | Fotonation Vision Limited | Face categorization and annotation of a mobile phone contact list |
US7979809B2 (en) * | 2007-05-11 | 2011-07-12 | Microsoft Corporation | Gestured movement of object to display edge |
US7916971B2 (en) | 2007-05-24 | 2011-03-29 | Tessera Technologies Ireland Limited | Image processing method and apparatus |
US8094939B2 (en) * | 2007-06-26 | 2012-01-10 | Microsoft Corporation | Digital ink-based search |
US8041120B2 (en) * | 2007-06-26 | 2011-10-18 | Microsoft Corporation | Unified digital ink recognition |
US8315482B2 (en) * | 2007-06-26 | 2012-11-20 | Microsoft Corporation | Integrated platform for user input of digital ink |
CN101488181B (en) * | 2008-01-15 | 2011-07-20 | 华晶科技股份有限公司 | Poly-directional human face detection method |
US8750578B2 (en) | 2008-01-29 | 2014-06-10 | DigitalOptics Corporation Europe Limited | Detecting facial expressions in digital images |
US8218862B2 (en) * | 2008-02-01 | 2012-07-10 | Canfield Scientific, Incorporated | Automatic mask design and registration and feature detection for computer-aided skin analysis |
US7855737B2 (en) | 2008-03-26 | 2010-12-21 | Fotonation Ireland Limited | Method of making a digital camera image of a scene including the camera user |
CN103475837B (en) | 2008-05-19 | 2017-06-23 | 日立麦克赛尔株式会社 | Record reproducing device and method |
WO2010012448A2 (en) | 2008-07-30 | 2010-02-04 | Fotonation Ireland Limited | Automatic face and skin beautification using face detection |
KR20100034843A (en) * | 2008-09-25 | 2010-04-02 | (주)엠엑스알커뮤니케이션즈 | Method and apparatus for security using three-dimensional(3d) face recognition |
WO2010063463A2 (en) | 2008-12-05 | 2010-06-10 | Fotonation Ireland Limited | Face recognition using face tracker classifier data |
US7916905B2 (en) * | 2009-02-02 | 2011-03-29 | Kabushiki Kaisha Toshiba | System and method for image facial area detection employing skin tones |
US20100295782A1 (en) | 2009-05-21 | 2010-11-25 | Yehuda Binder | System and method for control based on face ore hand gesture detection |
US8379917B2 (en) | 2009-10-02 | 2013-02-19 | DigitalOptics Corporation Europe Limited | Face recognition performance using additional image features |
US8170332B2 (en) * | 2009-10-07 | 2012-05-01 | Seiko Epson Corporation | Automatic red-eye object classification in digital images using a boosting-based framework |
US8358812B2 (en) * | 2010-01-25 | 2013-01-22 | Apple Inc. | Image Preprocessing |
US8244003B2 (en) * | 2010-01-25 | 2012-08-14 | Apple Inc. | Image preprocessing |
US8244004B2 (en) * | 2010-01-25 | 2012-08-14 | Apple Inc. | Image preprocessing |
US8254646B2 (en) | 2010-01-25 | 2012-08-28 | Apple Inc. | Image preprocessing |
US8326001B2 (en) * | 2010-06-29 | 2012-12-04 | Apple Inc. | Low threshold face recognition |
JP5787634B2 (en) * | 2010-08-09 | 2015-09-30 | キヤノン株式会社 | Imaging device |
US8836777B2 (en) | 2011-02-25 | 2014-09-16 | DigitalOptics Corporation Europe Limited | Automatic detection of vertical gaze using an embedded imaging device |
US20130201316A1 (en) | 2012-01-09 | 2013-08-08 | May Patents Ltd. | System and method for server based control |
US8983152B2 (en) * | 2013-05-14 | 2015-03-17 | Google Inc. | Image masks for face-related selection and processing in images |
US9256950B1 (en) | 2014-03-06 | 2016-02-09 | Google Inc. | Detecting and modifying facial features of persons in images |
CN106030614A (en) | 2014-04-22 | 2016-10-12 | 史內普艾德有限公司 | System and method for controlling a camera based on processing an image captured by other camera |
US9679212B2 (en) | 2014-05-09 | 2017-06-13 | Samsung Electronics Co., Ltd. | Liveness testing methods and apparatuses and image processing methods and apparatuses |
KR102240570B1 (en) | 2014-05-13 | 2021-04-15 | 삼성전자주식회사 | Method and apparatus for generating spanning tree,method and apparatus for stereo matching,method and apparatus for up-sampling,and method and apparatus for generating reference pixel |
CN106462736B (en) | 2014-08-07 | 2020-11-06 | 华为技术有限公司 | Processing device and method for face detection |
WO2016165060A1 (en) * | 2015-04-14 | 2016-10-20 | Intel Corporation | Skin detection based on online discriminative modeling |
WO2016207875A1 (en) | 2015-06-22 | 2016-12-29 | Photomyne Ltd. | System and method for detecting objects in an image |
US9864901B2 (en) | 2015-09-15 | 2018-01-09 | Google Llc | Feature detection and masking in images based on color distributions |
US9547908B1 (en) | 2015-09-28 | 2017-01-17 | Google Inc. | Feature mask determination for images |
US10223590B2 (en) | 2016-08-01 | 2019-03-05 | Qualcomm Incorporated | Methods and systems of performing adaptive morphology operations in video analytics |
KR102645202B1 (en) | 2017-01-03 | 2024-03-07 | 한국전자통신연구원 | Method and apparatus for machine learning |
JP2018112777A (en) * | 2017-01-06 | 2018-07-19 | 富士通株式会社 | Recommendation item output program, output control program, recommendation item output apparatus, recommendation item output method and output control method |
CN111801703A (en) * | 2018-04-17 | 2020-10-20 | 赫尔实验室有限公司 | Hardware and system for bounding box generation for an image processing pipeline |
US20200065706A1 (en) * | 2018-08-24 | 2020-02-27 | Htc Corporation | Method for verifying training data, training system, and computer program product |
US10803646B1 (en) | 2019-08-19 | 2020-10-13 | Neon Evolution Inc. | Methods and systems for image and voice processing |
US10658005B1 (en) | 2019-08-19 | 2020-05-19 | Neon Evolution Inc. | Methods and systems for image and voice processing |
US10949715B1 (en) | 2019-08-19 | 2021-03-16 | Neon Evolution Inc. | Methods and systems for image and voice processing |
US10671838B1 (en) * | 2019-08-19 | 2020-06-02 | Neon Evolution Inc. | Methods and systems for image and voice processing |
WO2021050369A1 (en) * | 2019-09-10 | 2021-03-18 | The Regents Of The University Of California | Autonomous comfort systems |
US11308657B1 (en) | 2021-08-11 | 2022-04-19 | Neon Evolution Inc. | Methods and systems for image processing using a learning engine |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0621553A2 (en) * | 1993-04-20 | 1994-10-26 | AT&T Corp. | Methods and apparatus for inferring orientation of lines of text |
EP0654749A2 (en) * | 1993-11-22 | 1995-05-24 | Hitachi Europe Limited | An image processing method and apparatus |
WO1999023600A1 (en) * | 1997-11-04 | 1999-05-14 | The Trustees Of Columbia University In The City Of New York | Video signal face region detection |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2973676B2 (en) * | 1992-01-23 | 1999-11-08 | 松下電器産業株式会社 | Face image feature point extraction device |
US5781650A (en) * | 1994-02-18 | 1998-07-14 | University Of Central Florida | Automatic feature detection and age classification of human faces in digital images |
US5912721A (en) * | 1996-03-13 | 1999-06-15 | Kabushiki Kaisha Toshiba | Gaze detection apparatus and its method as well as information display apparatus |
US6343141B1 (en) | 1996-10-08 | 2002-01-29 | Lucent Technologies Inc. | Skin area detection for video image systems |
JP3512992B2 (en) * | 1997-01-07 | 2004-03-31 | 株式会社東芝 | Image processing apparatus and image processing method |
US6263113B1 (en) * | 1998-12-11 | 2001-07-17 | Philips Electronics North America Corp. | Method for detecting a face in a digital image |
-
1998
- 1998-12-11 US US09/210,415 patent/US6263113B1/en not_active Expired - Lifetime
-
1999
- 1999-12-01 JP JP2000588717A patent/JP2002532807A/en active Pending
- 1999-12-01 WO PCT/EP1999/009360 patent/WO2000036546A1/en not_active Application Discontinuation
- 1999-12-01 KR KR1020007008751A patent/KR100677177B1/en not_active IP Right Cessation
- 1999-12-01 EP EP99961034A patent/EP1053530A1/en not_active Withdrawn
-
2001
- 2001-02-22 US US09/790,190 patent/US6574354B2/en not_active Expired - Lifetime
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0621553A2 (en) * | 1993-04-20 | 1994-10-26 | AT&T Corp. | Methods and apparatus for inferring orientation of lines of text |
EP0654749A2 (en) * | 1993-11-22 | 1995-05-24 | Hitachi Europe Limited | An image processing method and apparatus |
WO1999023600A1 (en) * | 1997-11-04 | 1999-05-14 | The Trustees Of Columbia University In The City Of New York | Video signal face region detection |
Non-Patent Citations (4)
Title |
---|
SANGER D ET AL.: "Method for light source discrimination and facial pattern detection from negative color film", JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, vol. 39, no. 2, 1 March 1995 (1995-03-01), pages 166 - 175 |
SANGER D ET AL: "METHOD FOR LIGHT SOURCE DISCRIMINATION AND FACIAL PATTERN DETECTION FROM NEGATIVE COLOR FILM", JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY,US,SOC. FOR IMAGING SCIENCE AND TECHNOLOGY, SPRINGFIELD, VA, vol. 39, no. 2, 1 March 1995 (1995-03-01), pages 166 - 175, XP000197839, ISSN: 1062-3701 * |
SATOH Y ET AL: "FACIAL PATTERN DETECTION AND COLOR CORRECTION FROM NEGATIVE COLOR FILM", JOURNAL OF IMAGING TECHNOLOGY,US,SOC. FOR IMAGING SCIENCE AND TECHNOLOGY, SPRINGFIELD, VA, vol. 16, no. 2, 1 April 1990 (1990-04-01), pages 80 - 84, XP000114553 * |
WONG C ET AL: "A MOBILE ROBOT THAT RECOGNIZES PEOPLE", PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE,US,LOS ALAMITOS, CA: IEEE COMPUTER SOC, 1995, pages 346 - 353, XP000598377, ISBN: 0-8186-7312-5 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006508462A (en) * | 2002-11-29 | 2006-03-09 | ソニー・ユナイテッド・キングダム・リミテッド | Face detection |
AU2008260018B2 (en) * | 2008-12-18 | 2010-09-23 | Canon Kabushiki Kaisha | Refining text extraction in colour compound documents |
AU2008260018C1 (en) * | 2008-12-18 | 2011-01-20 | Canon Kabushiki Kaisha | Refining text extraction in colour compound documents |
Also Published As
Publication number | Publication date |
---|---|
EP1053530A1 (en) | 2000-11-22 |
KR100677177B1 (en) | 2007-02-05 |
US6263113B1 (en) | 2001-07-17 |
KR20010040852A (en) | 2001-05-15 |
JP2002532807A (en) | 2002-10-02 |
US6574354B2 (en) | 2003-06-03 |
US20010026633A1 (en) | 2001-10-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6574354B2 (en) | Method for detecting a face in a digital image | |
Deng et al. | Color image segmentation | |
Celenk | A color clustering technique for image segmentation | |
Cheng et al. | A hierarchical approach to color image segmentation using homogeneity | |
US7336819B2 (en) | Detection of sky in digital color images | |
Abdel-Mottaleb et al. | Face detection in complex environments from color images | |
US20080193020A1 (en) | Method for Facial Features Detection | |
EP1452995A2 (en) | Method for detecting color objects in digital images | |
US8103058B2 (en) | Detecting and tracking objects in digital images | |
Rosenfeld | Image pattern recognition | |
JP2003016448A (en) | Event clustering of images using foreground/background segmentation | |
EP1730694B1 (en) | Detecting sky occlusion objects in color digital images | |
US11836958B2 (en) | Automatically detecting and isolating objects in images | |
Yarlagadda et al. | A reflectance based method for shadow detection and removal | |
Fang et al. | 1-D barcode localization in complex background | |
Dai et al. | Robust and accurate moving shadow detection based on multiple features fusion | |
Abdullah-Al-Wadud et al. | Skin segmentation using color distance map and water-flow property | |
Chan et al. | Using colour features to block dubious images | |
Yun et al. | Robust face detection for video summary using illumination-compensation and morphological processing | |
Raviprakash et al. | Moving object detection for content based video retrieval | |
Dawson et al. | Locating objects in a complex image | |
Mehta et al. | Text Detection from Scene Videos having Blurriness and Text of Different Sizes | |
Walcott et al. | A Colour Object Search Algorithm. | |
Vu et al. | Extraction of text regions from complex background in document images by multilevel clustering | |
Riaz et al. | Extracting color using adaptive segmentation for image retrieval |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): JP KR |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1999961034 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020007008751 Country of ref document: KR |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWP | Wipo information: published in national office |
Ref document number: 1999961034 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 1020007008751 Country of ref document: KR |
|
WWR | Wipo information: refused in national office |
Ref document number: 1020007008751 Country of ref document: KR |