WO2007047719A2 - Face detection and tracking in a wide field of view - Google Patents
Face detection and tracking in a wide field of view Download PDFInfo
- Publication number
- WO2007047719A2 WO2007047719A2 PCT/US2006/040630 US2006040630W WO2007047719A2 WO 2007047719 A2 WO2007047719 A2 WO 2007047719A2 US 2006040630 W US2006040630 W US 2006040630W WO 2007047719 A2 WO2007047719 A2 WO 2007047719A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- view
- field
- tracking system
- facial detection
- camera
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
Abstract
Facial detection and tracking systems and methods within a wide field of view are disclosed. A facial detection and tracking system in accordance with an illustrative embodiment of the present invention can include a wide field of view camera for detecting and tracking one or more objects within a wider field of view, and at least one narrower field of view camera for obtaining a higher-resolution image of each object located within a subset space of the wider field of view. The wide field of view camera can be operatively coupled to a computer or other such device that determines the subset space location of the individual within the wider field of view, and then tasks one or more of the narrower field of view cameras covering the subset space location to obtain a high-resolution image of the object.
Description
FACE DETECTION AND TRACKING IN A WIDE FIELD OF VIEW
Field of the Invention
[Para 1] The present invention relates generally to the field of face detection and tracking. More specifically, the present invention relates to face detection and tracking in a wide field of view.
Background
[Para 2] Surveillance systems are being used with increasing frequency to detect and track individuals within an environment. In security applications, for example, such systems are often employed to detect and track individuals entering or leaving a building facility or security gate, or to monitor individuals within a store, hospital, museum or other such location where the health and/or safety of the occupants may be of concern. More recent trends in the art have focused on the use of facial detection and tracking methods to determine the identity of individuals located within a field of view. In the aviation industry, for example, such systems have been installed in airports to acquire a facial scan of individuals as they pass through various security checkpoints, which are then compared against images contained in a facial image database to determine whether an individual poses a security threat.
[Para 3] Current facial detection and tracking systems typically rely on the use of one or more pan-tilt- zoom (PTZ) cameras to track individuals located within a wide field of view. Such devices can include an optical system operatively coupled to a number of drive motors that permit the operator to zoom-in on the details of an individual, or to monitor a larger area from multiple camera angles. In certain designs, each of the cameras within the system can be connected to a computer equipped with image processing software and/or hardware that can be used to process images received from the cameras in order to detect the identity of the individual. [Para 4] Due to the high resolution often necessary to accurately detect facial features, many prior- art facial detection and tracking systems lack the ability to both detect and track individuals within a wide field of view while simultaneously
acquiring information sufficient to perform facial recognition. In systems employing PTZ cameras, for example, the ability of the camera to effectively track motion within a wide field of view is often limited by the speed and accuracy of the positioning mechanism employed. If, for example, the individual is located within a moving vehicle or is otherwise moving quickly through the image field, such cameras may not be able to adequately cover the entire image field while still providing sufficient resolution to abstract features from the individual's face. In some cases, the inability of the camera to accurate track individuals moving through the image field can also prevent multiple individuals from being detected and/or tracked simultaneously within a wide field of view.
Summary
[Para 5] The present invention relates generally to face detection and tracking systems and methods in a wide field of view. A facial detection and tracking system in accordance with an illustrative embodiment of the present invention can include a wide field of view camera for detecting one or more objects within a wider field of view, and at least one narrower field of view camera for obtaining a higher-resolution image of at least one object located within a subset space of the wider field of view. The narrower field of view cameras can, in some embodiments, be arranged in an array or pattern that, when seamed together, covers the entire field of view without the need for a positioning and/or zoom mechanism. In certain embodiments, the narrower field of view cameras can be overlapped slightly to facilitate the detection of objects moving from one subset space to the next.
[Para 6] In some illustrative embodiments, the face detection and tracking system can employ one or more tri-band imaging (TBI) cameras to detect and analyze various facial features utilizing a combination of low band near-IR light, high band near- ER. light, and/or visible light. A near-IR illuminator can be provided to generate near-IR light on the individual, which can then be sensed by the one or more TBI cameras to determine the presence of skin and/or to detect various facial features. In certain embodiments, an adjustment module can also be provided for adjusting the amount of luminance emitted from the near-IR illuminator, if desired. [Para 7] An illustrative method for detecting and tracking an individual within a wide field of view can include the steps of detecting an object using a wide field of view camera, determining the subset space location of the object within the wide field
of view, tasking one or more narrower field of view cameras covering the subset space location to acquire one or more higher-resolution images of the object, and then processing the higher-resolution images to obtain one or more parameters relating to the object. In certain illustrative embodiments, the one or more narrower field of view cameras can be configured to obtain facial images of a tracked individual, which can then be compared against a facial image database to determine the identity of the individual. Various processing routines can be employed to detect and confirm the presence of skin and/or to detect one or more facial features related to the individual.
Brief Description of the Drawings
[Para 8] Figure 1 is a top diagrammatic view of a prior-art facial detection and tracking system employing a conventional PTZ camera;
[Para 9] Figure 2 is a top diagrammatic view of a facial detection and tracking system in accordance with an illustrative embodiment of the present invention;
[Para 10] Figure 3 is a side view of a facial detection and tracking system in accordance with another illustrative embodiment of the present invention employing a vertical array of narrower field of view cameras;
[Para H] Figure 4 is a layout view of a facial detection and tracking system in accordance with another illustrative embodiment of the present invention employing a two-dimensional array of narrower field of view cameras;
[Para 12] Figure 5 is a block diagram of a facial detection and tracking system in accordance with another illustrative embodiment of the present invention employing a number of tri-band imaging cameras;
[Para 13] Figure 6 is a flow chart showing an illustrative method of tracking and detecting one or more objects within a wide field of view;
[Para 14] Figure 7 is a flow chart showing an illustrative method of detecting and tracking an individual within a wide field of view utilizing one or more tri-band imaging cameras; and
[Para 15] Figure 8 is a flow chart showing an illustrative method of extracting features from an individual's face using a tri-band imaging camera.
Detailed Description
[Para 16] The following description should be read with reference to the drawings, in which like elements in different drawings are numbered in like fashion. The
drawings, which are not necessarily to scale, depict illustrative embodiments and are not intended to limit the scope of the invention. Although examples of various steps are illustrated in the various views, those skilled in the art will recognize that the many of the examples provided have suitable alternatives that can be utilized. Moreover, while several illustrative applications are described throughout the . disclosure, it should be understood that the present invention could be employed in other applications where facial detection and tracking is desired. [Para 17] Figure 1 is a top diagrammatic view of a prior-art facial detection and tracking system 10 employing a conventional pan-tilt-zoom (PTZ) camera 12. As can be seen in Figure 1, the PTZ camera 12 can be configured to operate initially in a wide-angle or omni-directional mode to detect and track an individual 14 located within a relatively wide field of view demarcated generally by the space 16 between the dashed lines 18,20. In this mode, the PTZ camera 12 typically provides a low- resolution view of the surrounding environment sufficient to track the general shape of an individual and/or to distinguish the individual from other individuals and/or objects located within the image field.
[Para 18] To detect one or more facial features of the individual 14 as they move through the wide field of view in the general direction indicated, for example, by arrow 24, the PTZ camera 12 can be configured to pan and/or tilt in a direction towards the individual's. face 22 and initiate an .optical-zoom or telephoto mode, wherein the PTZ camera 12 zooms-in on the area surrounding the individual's face 22. In certain designs, for example, the PTZ camera 12 can include a vari-focus optical lens that can be adjusted to concentrate the PTZ camera 12 on a particular space within the wide field of view in order to provide a higher-resolution image of the face 22 sufficient to perform facial recognition of the individual 14. In other designs, digital techniques can also be employed to adjust the resolution of the PTZ camera 12, such as, for example, by altering the resolution of a charge coupled device (CCD) or other such optical device within the PTZ camera 12. [Para 19] The PTZ camera 12 can be configured to monitor the wide field of view until an object of interest has been detected, or, in the alternative, can be • configured to scan various subset spaces within the wide field of view until such motion is detection. In the latter case, the PTZ camera 12 can be programmed to scan an area in some predefined or random path until an object of interest is detected. Once an individual 14 or other object of interest has been detected, the PTZ camera
12 can then be configured to focus on the individual 14 and acquire an image of the individual's face 22 in the higher-resolution, telephoto mode. [Para 20] Because of the time required for the positioning mechanism to pan and/or tilt towards the individual 14 and to zoom-in on the individual's face 22, many PTZ cameras 12 are limited in their ability track individuals quickly moving through a wide field of view. If, for example, the individual 14 is positioned inside a moving vehicle or is otherwise moving through the image field at a rapid rate, the PTZ camera 12 may not be able to adequately track the individual while still providing a steady image necessary to perform facial recognition, hi those systems in which the PTZ camera 12 is configured to scan the environment in a predefined or random path, the particular path traveled by the individual 14 through the wide field of view may even escape detection by the PTZ camera 12 altogether.
[Para 21] As can be further seen by reference to dashed lines 18' and 20' in Figure 1, the viewing angle of the PTZ camera 12 is significantly diminished when the PTZ camera 12 is focused on the individual's face 22, limiting the ability of the device to detect and/or track other objects of interest within the wider field of view. To compensate for this shortcoming, many prior-art PTZ camera systems must rely on the use of multiple PTZ cameras to detect and track objects within a wide field of view while tasking one or more of the PTZ cameras to acquire information about the individual's identity.
[Para 22] Figure 2 is a top diagrammatic view of a facial detection and tracking _ system 26 in accordance with an illustrative embodiment of the present invention. System 26 includes a wide field of view (WFOV) camera 28 for detecting and tracking individuals and/or other objects of interest located within a wide field of view, and one or more narrower field of view (NFOV) cameras 30,32 that can be used to detect various facial features of an individual 34 in a subset space of the wide field of view. As used herein, the term "wide field of view" connotes a field of view adapted to encompass a particular environment (e.g. a room, hallway, security gate area, etc.), and is not to be construed as having a particular dimension. The dimensions of the wide field of view will, of course, depend on the environment in which the system is employed, and/or the particular application involved. [Para 23] The wide field of view camera 28 can be configured to continuously operate in a wide-angle mode to constantly track objects of interest within a wide field of view. As can be seen in Figure 2, for example, the wide field of view camera 28
can be configured to detect and/or track one or more individuals 34 located within a field of view demarcated generally by the space 36 located between dashed lines 38 and 40. Since the wide field of view camera 28 is configured to constantly operate in a wide-angle mode, the individual 34, which is shown in Figure 2 moving in the general direction indicated by arrow 42, can be tracked in a fixed position without having to employ a pan-tilt-zoom mechanism to move and/or adjust the camera. The ability to track the individual 14 in this manner permits the wide field of view camera 28 to constantly view all objects located within the wide field of view irrespective of their particular location within the space 36.
[Para 24] In certain embodiments, the wide field of view camera 28 can be configured to operate in a low-resolution mode sufficient to detect and/or track an object of interest within the wide field of view while conserving power. The resolution capability of the wide field of view camera will depend on a number of factors, including, for example, the viewing angle of the camera, the pixel density of the optical system employed, and the various characteristics of the surrounding environment. While the illustrative wide field of view camera 28 depicted in Figure 1 is directional (i.e. having an viewing angle θ less than 360°), it should be understood that the wide field of view camera 28 could comprise an omni-directional camera adapted to acquire images in full 360° space, if desired.
[Para 25] Each of the narrower field of view cameras 30,32 can be directed and/or focused on a subset space of the wide field of view for obtaining a facial-image of the individual ._34. As shown in Figure 2, for example, the first narrower field of view camera 30 can be configured to acquire facial images of the individual 34 in a first subset space 44 of space 36, as indicated generally by dashed lines 46 and 48. In similar fashion, the second narrower field of view camera 32 can be configured to acquire facial images of the individual 34 in a second subset space 50 of space 36, as indicated generally by dashed lines 52 and 54.
[Para 26] In use, the narrower field of view cameras 30,32 can be configured to provide a higher-resolution image of the individual's face 56 to detect and analyze various facial features of the individual 34 not capable with a wider field of view •■ camera. As with the wide field of view camera 28, each of the narrower field of view cameras 30,32 can be fixed in position, covering a subset field of view that does not change significantly as the individual 34 moves from one field of view to another. In operation, this arrangement permits each narrower field of view camera 30,32 to track
40630
the individual 34 without having to first pan, tilt, and/or zoom-in on the individual 34. Moreover, since each of the narrower field of view cameras 30,32 remains fixed during tracking, the ability of the system to accurately track objects of interest is not limited to the accuracy and/or speed of the positioning mechanism employed. [Para 27] In certain embodiments, the narrower field of view cameras 30,32 can be overlapped slightly to facilitate the detection and tracking of objects as they move from one subset space 44,50 to the next. In the illustrative embodiment of Figure 2, for example, the first narrower field of view camera 30 is shown overlapped slightly with the second narrower field of view camera 32, forming an overlapping subset space 56 within space 36. When overlapped in this manner, the narrower field of view cameras 30,32 can be tasked to acquire different features of the individual's face 56, which can then be seamed together to form a composite image. If, for example, only a portion of the individual's face 56 is located within the field of view of one of the narrower field of view cameras {e.g. camera 30), the system 26 can be configured to seam the partial image acquired from the other narrower field of camera {e.g. camera 32) into a composite image of the individual 34. Such arrangement could be used, for example, to provide a built-in level of redundancy in the event that one of the narrower field of view cameras 30,32 becomes partially blocked or obscured, or otherwise inoperable.
[Para 28] The various cameras 28,30,32 forming the facial tracking and detection system 26 can be physically separated from each other at various locations within the environment, or can comprise a single camera unit including multiple cameras. In the latter case, for example, each of the cameras 28,30,32 can be disposed within a housing or inset within a wall, ceiling or other desired structure. In the illustrative embodiment of Figure.2, for example, the two narrower field of view cameras 30,32 are shown arranged in a horizontal array on opposites sides of the wide field of view camera 28, with each camera 28,30,32 being physically separated from each other. It should be understood, however, that the positioning of the cameras 28,30,32 in this manner is not limited as such. As discussed with respect to other embodiments herein, for example, the various cameras 28,30,32 can be arranged in a vertical array,
- a multi-dimensional array, or some other desired pattern. - -
[Para 29] While the illustrative embodiment of Figure 2 shows the use of a single, wide field of view camera 28, it should be understood that multiple wide field of view cameras could be employed, if desired. In certain applications, for example, the use
of multiple wide field of view cameras could be employed to extend the overall field of view of the system, or to permit the system to track objects of interest within an area where an obstruction such as a wall or partition may prevent the adequate detection and tracking of objects using a single wide field of view camera. [Para 30] Figure 3 is a side diagrammatic view of a facial detection and tracking system 60 in accordance with another illustrative embodiment of the present invention employing a vertical array of narrower field of view cameras. As shown in Figure 3, system 60 can include a wide field of view (WFOV) camera 62, and one or more narrower field of view cameras 64. The wide field of view camera 62 can be configured to continuously operate in a wide-angle mode to constantly track individuals and/or other objects of interest within a wide field of view. As indicated generally by dashed lines 66,68, for example, the wide field of view camera 62 can operate at a relatively wide viewing angle θ that forms a vertical component of the field of view extending downwardly from a first location 70 to a second location 72. Locations 70 and 72, for example, may represent, respectively, the ceiling and floor of a room or other such space to be monitored. In addition to spanning the vertical space between locations 70 and 72, the wide field of view camera 62 can also be configured to scan a horizontal space, similar to that depicted, for example, in Figure 2. [Para 31] As can be further seen in Figure 3, the narrower field of view cameras 62 can be arranged in a vertical array or pattern, forming a number of respective subset spaces 74 within the wide field of view. The narrower field of view cameras 62 can be configured to overlap slightly to facilitate the detection and tracking of objects as they move from one subset space 74 to the next. Alternatively, and as shown in Figure 3, the narrower field of view cameras can be configured to cover discrete segments within the wide field of view.
[Para 32] In certain embodiments, the narrower field of view cameras 64 can comprise tri-band imaging (TBI) cameras, which use low band near-IR light, high band near-IR light, and visual light to analyze, detect, and match an individual's face. Such devices typically utilize a near-infrared light spectrum to scan facial images by sensing the IR light reflected from the individual's face. The ability to detect such reflected IR light avoids a characteristic problem inherent in many conventional ■- visual spectrum systems, which attempt to analyze non-facial portions of the image during facial recognition. Moreover, since TBI cameras also utilize IR spectrum light to detect the presence of the individual's face, such devices are not as susceptible to
environmental conditions such as glare through a window or windshield, inclement weather {e.g. fog, haze, rain, etc.), nighttime conditions, etc. that can affect the ability of the system to acquire clear image signals.
[Para 33] A near-IR illuminator 76 can be provided for generating near-IR light in both the low and high near-IR spectrums, if desired. In certain applications, for example, the near-IR illuminator 76 can be utilized to direct light towards the individual to obtain a clearer image of the individual's face during nighttime, or when other conditions exist. Since the near- IR light is outside of the visible spectrum, such light is not detectable by the naked eye, and therefore does not alert the individual that he or she is being detected and/or tracked.
[Para 34] Figure 4 is a layout view showing a facial detection and tracking system 76 in accordance with another illustrative embodiment of the present invention employing an X-Y array of narrower field of view cameras. Figure 4, which may represent, for example, a view of the various camera elements within the system 76 as seen from an observer facing the camera, includes a wide field of view (WFOV) camera 78 for detecting and tracking individuals and/or other objects of interest located within a wide field of view, and a number of narrower field of view (NFOV) cameras 80 that can be used to detect facial features of an individual in various subset spaces within the wide field of view.
[Para 35] As can be seen in Figure 4, the narrower field of view cameras 80 can be arranged in a multi-dimensional {i.e. X-Y) array, with each camera 80 adapted to cover an associated range of X and Y coordinates within an X-Y coordinate system 82. The Z-axis, which is indicated in coordinate system 84 as a cross 86, may represent the general direction in which the wide field of view camera 78 and narrower field of view cameras 80 are aimed. The wide field of view camera 78 and narrower field of view cameras 80 can be positioned within a camera housing 86 that supports each of the cameras 78,80 in their respective position within the X-Y array. The housing 82 can also contain other components to facilitate detection and tracking of objects, including, for example, a near-IR illuminator, an adjustment module for controlling the level of luminance provided by the near-IR illuminator, a power ■ supply, a processor/controller, etc.
[Para 36] In the illustrative embodiment of Figure 4, the wide field of view camera 78 is shown positioned centrally at an origin O within the X-Y array. As with other embodiments herein, the wide field of view camera 78 can be configured to
continuously operate in a wide-angle mode to constantly track objects of interest within the wide field of view. While the wide field of view camera 78 is shown located centrally within the X-Y array, it should be understood that other embodiments have been envisioned wherein the wide field of view camera is located at some other desired location within the X-Y array, or at a remote location away from the narrower field of view cameras 80. Moreover, while only one wide field of view camera 78 is illustrated, it should be understood that system 76 could employ multiple wide field of view cameras, if desired.
[Para 37] The narrower field of view cameras 80 can each be configured to recognize various facial features within a particular a range of X-coordinates and Y- coordinates that covers a subset space within the wide field of view. In some embodiments, the narrower field of view cameras 80 can be configured to cover the entire space covered by the wide field of view camera 78, allowing the system 76 to acquire higher-resolution images of individuals and/or objects at all locations within the wide field of view. The ranges covered by each narrower field of view camera 80 can be discrete (i.e. with no overlap between adjacent fields), or, in the alternative, can be overlapped by some desired amount. In certain embodiments, each of the narrower field of view camera elements 80 can comprise a tri-band image (TBI) camera or other such device for detecting and analyzing facial features using multiple light spectrums (e.g. near-IR light, visible light, UV light, etc.). [Para 38] Figure 5 is a block diagram showing a facial detection and tracking system 88 in accordance with another illustrative embodiment of the present invention employing a number of tri-band imaging cameras. As can be seen in Figure 5, system 88 can include a wide field of view (WFOV) camera 90 for detecting and tracking one or more individuals 91 within a wide field of view, and a number of narrower field of view TBI cameras 92, 94,96,98 that can be tasked in a desired manner to perform facial recognition on each individual 92 moving through the wide field of view. [Para 39] The TBI cameras 92,94,96,98 can be configured to operate simultaneously in a coordinated fashion to track and detect individuals 91 as they move from one subset space to the next. As can be seen in Figure 5, the wide field of view camera 90 and narrower field of view TBI cameras 92,94,96,98 can be operatively connected to a computer 100 or other suitable logic device for analyzing and processing images that can be used to facially recognize each tracked individual 91. The computer 100 can include software and/or hardware that can be used to run one or more routines
and/or algorithms therein for controlling and coordinating the operation of the cameras 90,92,94,96,98 in a desired manner. A monitor, screen or other suitable display means 102 can also be provided to display images acquired from the wide field of view camera 90 and/or the narrower field of view cameras 92,94,96,98. [Para 40] As can be further seen in Figure 5, each of the narrower field of view cameras 92,94,96,98 can be operatively connected to a respective near-IR illuminator 104,106,108,110, which as described above, can be used to provide luminance on each tracked individual 91 during nighttime, inclement weather, or other such conditions. Each near-IR illuminator 104,106,108,110 can be connected to a respective adjustment module 112,114,116,118 for adjusting the quality and amount of light emitted from each near-IR illuminator 104,106,108,110 during each successive image capture. While a separate adjustment module 112,114,116,118 is shown provided for each individual near-IR illuminator 104,106,108,110 within the system 88, it should be understood that a single adjustment module could be provided to alter the lighting conditions at multiple cameras, if desired.
[Para 41] The narrower field of view cameras 92,94,96,98 can each be configured to cover a discrete subset space within the wide field of view, or can be overlapped by some desired amount. In the latter case, the narrower field of view cameras 92,94,96,98 can be tasked to focus on different facial features of the individual 91. In certain embodiments, for example, one of the narrower field of view cameras (e.g. camera 92) could be tasked to provide a general scan of the individual's face whereas an adjacent narrower field of view (e.g. camera 94) could be tasked to provide a retinal scan of the individual 91. The various images acquired by each of the narrower field of view cameras 92,94,96,98 can then be processed via the computer 100 to determine the identity of the individual 91 and/or to computer various other parameter relating to the individual 91 (e.g. velocity, direction of travel, height, orientation, etc.).
[Para 42] Turning now to Figure 6, an illustrative method for detecting and tracking an individual within a wide field of view will now be described with respect to the illustrative system 76 of Figure 4. The method, represented generally by reference number 120, may begin at block 122, wherein the system 76 initially detects the presence of an individual within a wide field of view using a wide field of view camera 78. Once initially detected, the system 76 can be configured to compute the X and Y coordinates of the individual within the wide field of view, as indicated
generally by reference to block 124. A control signal can then be sent to one or more of the narrower field of view cameras 80 located nearest to the computed range of X- Y coordinates, causing those narrower field of view camera(s) 80 to perform a higher- resolution scan of the individual, as indicated generally by reference to block 126. [Para 43] Once one or more higher-resolution images are obtained from the narrower field of view cameras 80, an image processing routine or algorithm can be initiated to extract various features from the acquired images, as indicated generally by reference to block 128. At this stage, facial features related to the individual's nose, eyes, mouth, skin color, eyebrows, facial size, etc. may be obtained to perform facial recognition on the individual, or to determine some other desired parameter related to the individual. As indicated generally by reference to block 130, one or more parameters relating to the individual can then be outputted and further analyzed, if desired. As indicated generally by return arrow 132, the system 76 can be configured to update the X-Y coordinates and repeat the image processing as the individual moves through the wide field of view, allowing the system 76 to task different narrower field of view cameras 80 to track the individual, if necessary. [Para 44] Figure 7 is a flow chart illustrating a facial detection and tracking method 134 in accordance with another illustrative embodiment of the present invention utilizing one or more tri-band imaging cameras. As described above, TBI cameras utilize low band near-IRJight, high band near-IR light, and visible light to scan and detect an individual's face. Beginning at step 136, one or more of the narrower field of view TBI cameras can be tasked within a wide field of view to acquire an image input containing one or more image frames. Also at this step, and as indicated generally by reference to block 138, the system can be configured to detect the luminance level at the scene and adjust the amount of near-IR illumination provided by each TBI camera, if necessary.
[Para 45] Once an image input is received from each narrower field of view TBI camera, a series of operations can then be performed to isolate the skin in the images from other surface elements, as indicated generally by reference to block 140. Such skin detection step 140, for example, can be performed to verify that the tracked object is not wearing a mask or other such covering that would prevent the system from accurately recognizing the individual's face.
[Para 46] As can be further seen with respect to block 142, a face detection step may also be performed to acquire various facial features that can be later used to determine
the identity of the tracked individual as well as other desired parameters relating to the individual. Upon detecting various features of the individual face at step 142, the information obtained can then be compared against a facial image database containing a number of previously stored facial images, as indicated generally by reference to block 144. If a match is found, as indicated generally by reference to block 146, the result can be outputted at block 148, informing the operator that a match has been obtained along with the identification of that individual. Alternatively, if no match is found, the system can be configured to alert the operator that the individual is not recognized within the facial image database.
[Para 47] Figure 8 is a flow chart showing an illustrative method of extracting features from an individual's face using a tri-band imaging system. The method, represented generally by reference number 150, may begin at blocks 152 and 154 with the steps of performing a low band near-IR scan and a high band near-IR scan of the individual's face. The high band near-IR image obtained at block 154 is then subtracted (i.e. weighted) from the low band near-IR image obtained at block 152 to obtain a skin image from the two near-IR images, as indicated generally by reference to block 156. In certain embodiments, for example, the image outputs received by the low band and high band near-IR facial scans can be inputted into a weighted difference software program and/or specialized hardware that fuses the image outputs by .performing weighted subtraction of the intensities of the two bands. In use, such fusion of the image outputs intensifies the silhouette of the face and other exposed human skin in the fused image, resulting in a diminution of the background scene covered by the two cameras.
[Para 48] As can be further seen by reference to block 158, one or more feature images can also be extracted from the two near-IR images of steps 152 and 154 using a multi-band feature extraction scheme. In certain embodiments, for example, the two near-IR images obtained from steps 152 and 154 can be utilized in conjunction with visible light, UV light, radar, or some other desired wavelength spectrum to abstract various features from the individual's face (e.g. nose, eyes, mouth, skin color, eyebrows, facial size, etc.) that can be later used to perform facial recognition on the individual. -- . . - • . . .
[Para 49] Next, as indicated generally with reference to block 160, the images acquired from the skin detection step 156 and multi-band feature extraction step 158 can be processed to determine the identity of the individual. In certain embodiments,
for example, a series of generalized Hough transforms or model-sized algorithms can be performed, providing an approximation of features such as the location of the eyes, eyebrows, nose, and/or mouth. From this processing step 160, a final video facial image can be produced, as indicated generally by reference to block 162. Other parameters such as the identity of the individual can also be outputted at this step 162, if desired.
[Para 50] Having thus described the several embodiments of the present invention, those of skill in the art will readily appreciate that other embodiments may be made and used which fall within the scope of the claims attached hereto. Numerous advantages of the invention covered by this document have been set forth in the foregoing description. It will be understood that this disclosure is, in many respects, only illustrative. Changes can be made with respect to various elements described herein without exceeding the scope of the invention.
Claims
1. A facial detection and tracking system, comprising: a wide field of view camera for detecting one or more objects located within a wider field of view; and at least one narrower field of view camera for obtaining a higher-resolution image of at least one detected object, each narrower field of view camera adapted to cover a subset space of the wider field of view.
2. The facial detection and tracking system of claim 1, wherein the wide field of view camera continuously operates in a wide-angle mode.
3. The facial detection and tracking system of claim 1, wherein the wide field of view camera is fixed in position.
4. The facial detection and tracking system of claim 1, wherein the wide field of view camera is adjustable in position.
5. The facial detection and tracking system of claim 1, wherein the wide field of view camera is a TBI camera.
6. The facial detection and tracking system of claim 1, wherein said at least one _ narrow field of view camera is a TBI camera.
7. The facial detection and tracking system of claim 6, further including a near- IR illuminator.
8. The facial detection and tracking system of claim 7, further including an adjustment module for adjusting the light emitted from the near-IR illuminator.
9. The facial detection and tracking system of claim 1, wherein said at least one narrower field of view camera comprises a plurality of narrower field of view cameras.
10. The facial detection and tracking system of claim 9, wherein each of said plurality of narrower field of view cameras is disposed in an array.
11. The facial detection and tracking system of claim 10, wherein said array comprises a horizontal array.
12. The facial detection and tracking system of claim 10, wherein said array comprises a vertical array.
13. The facial detection and tracking system of claim 10, wherein said array comprises a two-dimensional array.
14. The facial detection and tracking system of claim 9, wherein said plurality of narrower field of view cameras covers the entire wider field of view in overlapping segments.
15. The facial detection and tracking system of claim 9, wherein said plurality of narrower field of view cameras covers the entire wider field of view in discrete segments.
16. The facial detection and tracking system of claim 1, further comprising processing means for processing images received from the wide field of view camera and the at least one narrower field of view camera.
17. The facial detection and tracking system of claim 1, further comprising at least one additional wide field of view camera.
18. The facial detection and tracking system of claim 1, wherein the wide field of view camera is further configured to track movement of the one or more objects within the wider field of view.
19. The facial detection and tracking system of claim 1, wherein at least one of said one or more objects is an individual.
20. The facial detection and tracking system of claim 19, wherein said high- resolution image is a facial image.
21. A facial detection and tracking system, comprising: a wide field of view camera for detecting one or more objects located within a wider field of view; and a plurality of narrower field of view cameras for obtaining a higher-resolution image of at least one detected object, each narrower field of view camera adapted to cover a subset space of the wider field of view.
22. The facial detection and tracking system of claim 21, wherein the wide field of view camera continuously operates in a wide-angle mode.
23. The facial detection and tracking system of claim 21, wherein the wide field of view camera is fixed in position.
24. The facial detection and tracking system of claim 21, wherein the wide field of view camera is adjustable.
25. The facial detection and tracking system of claim 21, wherein the wide field of view camera is a TBI camera.
26. The facial detection and tracking system of claim 21, wherein each of said plurality of narrow field of view cameras is a TBI camera.
27. The facial detection and tracking system of claim 26, further including a near- ER illuminator.
28. The facial detection and tracking system of claim 27, further including an adjustment module for adjusting the light emitted from the near-IR illuminator.
29. The facial detection and tracking system of claim 21, wherein each of said plurality of narrower field of view cameras is disposed in an array.
30. The facial detection and tracking system of claim 29, wherein said array comprises a horizontal array.
31. The facial detection and tracking system of claim 29, wherein said array comprises a vertical array.
32. The facial detection and tracking system of claim 29, wherein said array comprises a two-dimensional array.
33. The facial detection and tracking system of claim 21, wherein said plurality of narrower field of view cameras covers the entire wider field of view in overlapping segments.
34. The facial detection and tracking system of claim 21, wherein said plurality of narrower field of view cameras covers the entire wider field of view in discrete segments.
35. The facial detection and tracking system of claim 21, further comprising processing means for processing images received from said plurality of narrower field of view cameras.
36. The facial detection and tracking system of claim 21, further comprising at least one additional wide field of view camera.
37. The facial detection and tracking system of claim 21, wherein the wide field of view camera is further configured to track movement of the one or more objects within the wider field of view.
38. The facial detection and tracking system of claim 21, wherein at least one of said one or more objects is an individual.
39. The facial detection and tracking system of claim 38, wherein said high- resolution image is a facial image.
40. A facial detection and tracking system, comprising: a wide field of view camera adapted to continuously operate in a wide-angle mode for detecting one or more objects located within a wider field of view; a plurality of narrower field of view cameras for obtaining a higher-resolution image of each detected object, each narrower field of view camera adapted to cover a subset space of the wider field of view; and processing means for processing images received from the wide field of view camera and the narrower field of view cameras.
41. A facial detection and tracking system, comprising: a wide field of view camera for detecting and tracking one or more individuals located within a wider field of view; and at least one narrower field of view TBI camera for obtaining a higher-resolution image of each tracked individual, each TBI camera being adapted to cover a subset space of the wider field of view.
42. The facial detection and tracking system of claim 41, further including a near- IR illuminator.
43. . .. „ The. facial detection and tracking system of claim 42, further including an adjustment module for adjusting the light emitted from the near- IR illuminator.
44. A method for detecting and tracking an object within a wide field of view, comprising the steps of: detecting an object within the wider field of view using at least one wide field of view camera; determining the subset space location of the object; tasking one or more narrower field of view cameras covering the subset space location to scan one or more higher-resolution images of the object; and processing the images received from the one or more narrower field of view cameras to obtain at least one parameter relating to the object.
45. The method of claim 44, wherein said object is an individual.
46. The method of claim 45, wherein said processing step includes the step of performing a skin detection routine to detect and confirm the presence of skin.
47. The method of claim 45, wherein said processing step includes the steps of: performing a facial recognition routine to detect one or more facial features of the individual; and comparing the one or more facial features against a set of parameters stored within a facial image database.
48. The method of claim 44, wherein said one or more narrower field of view cameras are TBI cameras.
49. The method of claim 48, further including the step of adjusting the quality and/or amount of near- IR light emitted during the step of tasking one or more narrower field of view TBI cameras covering the subset space location to scan one or more higher-resolution images of the object.
50. A method for facially detecting and tracking one or more individuals within a wide field of view, comprising the steps of: detecting an individual within the wide field of view using at least one wide field of view camera; determining the subset space location of the individual; tasking one or more narrower field of view TBI cameras covering the subset space location to perform a low band and high band near-IR scan of the individual's face; subtracting and fusing the high near-IR image from the low near-IR image; performing a multi-band feature extraction routine to detect one or more facial features of the individual; and processing the images to obtain a final video facial image.
51. The method of claim 50, further comprising the step of comparing the one or more facial features against a set of parameters stored within a facial image database.
52. The method of claim 50, further including the step of adjusting the quality or amount of near-IR light emitted during the step of tasking one or more narrower field of view TBI cameras covering the subset space location to scan one or more higher- resolution images of the individual.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/163,497 | 2005-10-20 | ||
US11/163,497 US7806604B2 (en) | 2005-10-20 | 2005-10-20 | Face detection and tracking in a wide field of view |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2007047719A2 true WO2007047719A2 (en) | 2007-04-26 |
WO2007047719A3 WO2007047719A3 (en) | 2007-06-28 |
Family
ID=37898587
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2006/040630 WO2007047719A2 (en) | 2005-10-20 | 2006-10-18 | Face detection and tracking in a wide field of view |
Country Status (2)
Country | Link |
---|---|
US (1) | US7806604B2 (en) |
WO (1) | WO2007047719A2 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2210354A2 (en) * | 2007-09-11 | 2010-07-28 | Wavebreak Technologies Ltd. | Presence detector and method for estimating an audience |
GB2475945A (en) * | 2009-12-02 | 2011-06-08 | Honeywell Int Inc | Image acquisition system where target distance is determined using a fixed wide-angle camera and a second high-resolution camera |
GB2480521A (en) * | 2010-05-21 | 2011-11-23 | Honeywell Int Inc. | Face recognition system using secondary cameras for high quality images |
CN103021053A (en) * | 2012-11-22 | 2013-04-03 | 成都江法科技有限公司 | Security system for human face recognition |
WO2013105084A1 (en) * | 2012-01-09 | 2013-07-18 | Rafael Advanced Defense Systems Ltd. | Method and apparatus for aerial surveillance |
Families Citing this family (140)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003296711A (en) * | 2002-03-29 | 2003-10-17 | Nec Corp | Method, device and program for identifying facial image |
US20060268360A1 (en) * | 2005-05-12 | 2006-11-30 | Jones Peter W J | Methods of creating a virtual window |
TWI266520B (en) * | 2005-08-22 | 2006-11-11 | Avision Inc | Method for simultaneously capturing images of multiple scan areas |
US20070106797A1 (en) * | 2005-09-29 | 2007-05-10 | Nortel Networks Limited | Mission goal statement to policy statement translation |
US9420234B2 (en) * | 2006-04-13 | 2016-08-16 | Virtual Observer Pty Ltd | Virtual observer |
EP2023812B1 (en) | 2006-05-19 | 2016-01-27 | The Queen's Medical Center | Motion tracking system for real time adaptive imaging and spectroscopy |
EP2076871A4 (en) | 2006-09-22 | 2015-09-16 | Eyelock Inc | Compact biometric acquisition system and method |
US9596401B2 (en) | 2006-10-02 | 2017-03-14 | Sony Corporation | Focusing an image based on a direction of a face of a user |
US7860382B2 (en) * | 2006-10-02 | 2010-12-28 | Sony Ericsson Mobile Communications Ab | Selecting autofocus area in an image |
JP5456022B2 (en) * | 2008-04-14 | 2014-03-26 | ジーブイビービー ホールディングス エス.エイ.アール.エル. | Technology that automatically tracks objects |
US9332191B2 (en) * | 2009-03-02 | 2016-05-03 | Honeywell International Inc. | Method and system for determining shutter fluttering sequence |
US8866920B2 (en) | 2008-05-20 | 2014-10-21 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US11792538B2 (en) | 2008-05-20 | 2023-10-17 | Adeia Imaging Llc | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
EP3328048B1 (en) | 2008-05-20 | 2021-04-21 | FotoNation Limited | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
JP5132445B2 (en) * | 2008-06-25 | 2013-01-30 | キヤノン株式会社 | Image processing apparatus, image processing method, computer program, and storage medium |
WO2010006176A2 (en) * | 2008-07-09 | 2010-01-14 | Global Rainmakers, Inc. | Biometric data acquisition device |
CN101639891B (en) * | 2008-07-28 | 2012-05-02 | 汉王科技股份有限公司 | Double-camera face identification device and method |
SI3354650T1 (en) | 2008-12-19 | 2022-06-30 | Vertex Pharmaceuticals Incorporated | Compounds useful as inhibitors of atr kinase |
US8873810B2 (en) * | 2009-03-02 | 2014-10-28 | Honeywell International Inc. | Feature-based method and system for blur estimation in eye images |
US8320617B2 (en) * | 2009-03-27 | 2012-11-27 | Utc Fire & Security Americas Corporation, Inc. | System, method and program product for camera-based discovery of social networks |
JP5437095B2 (en) * | 2009-05-19 | 2014-03-12 | 東芝機械株式会社 | Laying block placement method, spreading block moving tool, and machine tool equipped with the tool |
US20110153393A1 (en) * | 2009-06-22 | 2011-06-23 | Einav Raff | System and method for monitoring and increasing sales at a cash register |
EP2502115A4 (en) | 2009-11-20 | 2013-11-06 | Pelican Imaging Corp | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US8537272B2 (en) * | 2010-03-02 | 2013-09-17 | Honeywell International Inc. | Method and system for designing optimal flutter shutter sequence |
RU2012153675A (en) | 2010-05-12 | 2014-06-20 | Вертекс Фармасьютикалз Инкорпорейтед | COMPOUNDS USED AS ATR KINASE INHIBITORS |
SG10201503516VA (en) | 2010-05-12 | 2015-06-29 | Pelican Imaging Corp | Architectures for imager arrays and array cameras |
EP2569287B1 (en) | 2010-05-12 | 2014-07-09 | Vertex Pharmaceuticals Inc. | Compounds useful as inhibitors of atr kinase |
US8842161B2 (en) | 2010-05-18 | 2014-09-23 | Polycom, Inc. | Videoconferencing system having adjunct camera for auto-framing and tracking |
US9723260B2 (en) | 2010-05-18 | 2017-08-01 | Polycom, Inc. | Voice tracking camera with speaker identification |
US8248448B2 (en) * | 2010-05-18 | 2012-08-21 | Polycom, Inc. | Automatic camera framing for videoconferencing |
US8395653B2 (en) | 2010-05-18 | 2013-03-12 | Polycom, Inc. | Videoconferencing endpoint having multiple voice-tracking cameras |
US8760517B2 (en) * | 2010-09-27 | 2014-06-24 | Apple Inc. | Polarized images for security |
US8644564B1 (en) * | 2010-11-30 | 2014-02-04 | Bally Gaming, Inc. | Safe illumination for computerized facial recognition |
US8878950B2 (en) | 2010-12-14 | 2014-11-04 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using super-resolution processes |
KR101973822B1 (en) | 2011-05-11 | 2019-04-29 | 포토네이션 케이맨 리미티드 | Systems and methods for transmitting and receiving array camera image data |
WO2012155105A1 (en) | 2011-05-12 | 2012-11-15 | Apple Inc. | Presence sensing |
US20120287031A1 (en) | 2011-05-12 | 2012-11-15 | Apple Inc. | Presence sensing |
US9606209B2 (en) | 2011-08-26 | 2017-03-28 | Kineticor, Inc. | Methods, systems, and devices for intra-scan motion correction |
WO2013043751A1 (en) | 2011-09-19 | 2013-03-28 | Pelican Imaging Corporation | Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures |
IN2014CN02708A (en) | 2011-09-28 | 2015-08-07 | Pelican Imaging Corp | |
IN2014KN00929A (en) | 2011-09-30 | 2015-08-21 | Vertex Pharma | |
CN108685922A (en) | 2011-09-30 | 2018-10-23 | 沃泰克斯药物股份有限公司 | With ATR inhibitor for treating cancer of pancreas and non-small cell lung cancer |
EP2582128A3 (en) * | 2011-10-12 | 2013-06-19 | Canon Kabushiki Kaisha | Image-capturing device |
US20130136298A1 (en) * | 2011-11-29 | 2013-05-30 | General Electric Company | System and method for tracking and recognizing people |
WO2013126578A1 (en) | 2012-02-21 | 2013-08-29 | Pelican Imaging Corporation | Systems and methods for the manipulation of captured light field image data |
US8929592B2 (en) * | 2012-03-13 | 2015-01-06 | Mitsubishi Electric Research Laboratories, Inc. | Camera-based 3D climate control |
PL2833973T3 (en) | 2012-04-05 | 2018-02-28 | Vertex Pharmaceuticals Incorporated | Compounds useful as inhibitors of atr kinase and combination therapies thereof |
US9210392B2 (en) | 2012-05-01 | 2015-12-08 | Pelican Imaging Coporation | Camera modules patterned with pi filter groups |
WO2014005123A1 (en) | 2012-06-28 | 2014-01-03 | Pelican Imaging Corporation | Systems and methods for detecting defective camera arrays, optic arrays, and sensors |
US20140002674A1 (en) | 2012-06-30 | 2014-01-02 | Pelican Imaging Corporation | Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors |
WO2014031795A1 (en) | 2012-08-21 | 2014-02-27 | Pelican Imaging Corporation | Systems and methods for parallax detection and correction in images captured using array cameras |
US20140055632A1 (en) | 2012-08-23 | 2014-02-27 | Pelican Imaging Corporation | Feature based high resolution motion estimation from low resolution images captured using an array source |
EP2901671A4 (en) | 2012-09-28 | 2016-08-24 | Pelican Imaging Corp | Generating images from light fields utilizing virtual viewpoints |
DK2904406T3 (en) | 2012-10-04 | 2018-06-18 | Vertex Pharma | METHOD OF DETERMINING THE ATR INHIBITION, INCREASED DNA DAMAGE |
WO2014078443A1 (en) | 2012-11-13 | 2014-05-22 | Pelican Imaging Corporation | Systems and methods for array camera focal plane control |
GB2508227B (en) * | 2012-11-27 | 2015-02-25 | Bae Systems Plc | Imaging system and process |
US10327708B2 (en) | 2013-01-24 | 2019-06-25 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US9717461B2 (en) | 2013-01-24 | 2017-08-01 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US9305365B2 (en) | 2013-01-24 | 2016-04-05 | Kineticor, Inc. | Systems, devices, and methods for tracking moving targets |
WO2014120734A1 (en) | 2013-02-01 | 2014-08-07 | Kineticor, Inc. | Motion tracking system for real time adaptive motion compensation in biomedical imaging |
US9462164B2 (en) | 2013-02-21 | 2016-10-04 | Pelican Imaging Corporation | Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information |
US9374512B2 (en) | 2013-02-24 | 2016-06-21 | Pelican Imaging Corporation | Thin form factor computational array cameras and modular array cameras |
US20140240477A1 (en) * | 2013-02-26 | 2014-08-28 | Qualcomm Incorporated | Multi-spectral imaging system for shadow detection and attenuation |
WO2014138697A1 (en) | 2013-03-08 | 2014-09-12 | Pelican Imaging Corporation | Systems and methods for high dynamic range imaging using array cameras |
US8866912B2 (en) | 2013-03-10 | 2014-10-21 | Pelican Imaging Corporation | System and methods for calibration of an array camera using a single captured image |
US9094576B1 (en) | 2013-03-12 | 2015-07-28 | Amazon Technologies, Inc. | Rendered audiovisual communication |
US9519972B2 (en) | 2013-03-13 | 2016-12-13 | Kip Peli P1 Lp | Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies |
US9106784B2 (en) | 2013-03-13 | 2015-08-11 | Pelican Imaging Corporation | Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing |
US9888194B2 (en) | 2013-03-13 | 2018-02-06 | Fotonation Cayman Limited | Array camera architecture implementing quantum film image sensors |
WO2014164550A2 (en) | 2013-03-13 | 2014-10-09 | Pelican Imaging Corporation | System and methods for calibration of an array camera |
WO2014159779A1 (en) | 2013-03-14 | 2014-10-02 | Pelican Imaging Corporation | Systems and methods for reducing motion blur in images or video in ultra low light with array cameras |
US9100586B2 (en) | 2013-03-14 | 2015-08-04 | Pelican Imaging Corporation | Systems and methods for photometric normalization in array cameras |
US9497429B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Extended color processing on pelican array cameras |
US10122993B2 (en) | 2013-03-15 | 2018-11-06 | Fotonation Limited | Autofocus system for a conventional camera that uses depth information from an array camera |
US9445003B1 (en) | 2013-03-15 | 2016-09-13 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information |
EP2973476A4 (en) | 2013-03-15 | 2017-01-18 | Pelican Imaging Corporation | Systems and methods for stereo imaging with camera arrays |
JP5851651B2 (en) * | 2013-03-21 | 2016-02-03 | 株式会社日立国際電気 | Video surveillance system, video surveillance method, and video surveillance device |
US20150145950A1 (en) * | 2013-03-27 | 2015-05-28 | Bae Systems Information And Electronic Systems Integration Inc. | Multi field-of-view multi sensor electro-optical fusion-zoom camera |
CN103383729B (en) * | 2013-05-27 | 2016-09-21 | 中国农业大学 | The localization method of rank arrangement target and system |
US9269012B2 (en) * | 2013-08-22 | 2016-02-23 | Amazon Technologies, Inc. | Multi-tracker object tracking |
US10055013B2 (en) * | 2013-09-17 | 2018-08-21 | Amazon Technologies, Inc. | Dynamic object tracking for user interfaces |
US9898856B2 (en) | 2013-09-27 | 2018-02-20 | Fotonation Cayman Limited | Systems and methods for depth-assisted perspective distortion correction |
US9185276B2 (en) | 2013-11-07 | 2015-11-10 | Pelican Imaging Corporation | Methods of manufacturing array camera modules incorporating independently aligned lens stacks |
US10119808B2 (en) | 2013-11-18 | 2018-11-06 | Fotonation Limited | Systems and methods for estimating depth from projected texture using camera arrays |
WO2015081279A1 (en) | 2013-11-26 | 2015-06-04 | Pelican Imaging Corporation | Array camera configurations incorporating multiple constituent array cameras |
US20150185484A1 (en) * | 2013-12-30 | 2015-07-02 | Electronics And Telecommunications Research Institute | Pupil tracking apparatus and method |
KR102269088B1 (en) * | 2013-12-30 | 2021-06-24 | 한국전자통신연구원 | Apparatus and method for tracking pupil |
CN103824090B (en) * | 2014-02-17 | 2017-02-08 | 北京旷视科技有限公司 | Adaptive face low-level feature selection method and face attribute recognition method |
US10089740B2 (en) | 2014-03-07 | 2018-10-02 | Fotonation Limited | System and methods for depth regularization and semiautomatic interactive matting using RGB-D images |
US10004462B2 (en) | 2014-03-24 | 2018-06-26 | Kineticor, Inc. | Systems, methods, and devices for removing prospective motion correction from medical imaging scans |
WO2016014718A1 (en) | 2014-07-23 | 2016-01-28 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
ES2821735T3 (en) | 2014-08-21 | 2021-04-27 | Identiflight Int Llc | Bird detection system and procedure |
US9856856B2 (en) | 2014-08-21 | 2018-01-02 | Identiflight International, Llc | Imaging array for bird or bat detection and identification |
JP2017531976A (en) | 2014-09-29 | 2017-10-26 | フォトネイション ケイマン リミテッド | System and method for dynamically calibrating an array camera |
JP6128468B2 (en) * | 2015-01-08 | 2017-05-17 | パナソニックIpマネジメント株式会社 | Person tracking system and person tracking method |
US9942474B2 (en) | 2015-04-17 | 2018-04-10 | Fotonation Cayman Limited | Systems and methods for performing high speed video capture and depth estimation using array cameras |
US10306193B2 (en) | 2015-04-27 | 2019-05-28 | Microsoft Technology Licensing, Llc | Trigger zones for objects in projected surface model |
US9948914B1 (en) * | 2015-05-06 | 2018-04-17 | The United States Of America As Represented By The Secretary Of The Air Force | Orthoscopic fusion platform |
CN104915000A (en) * | 2015-05-27 | 2015-09-16 | 天津科技大学 | Multisensory biological recognition interaction method for naked eye 3D advertisement |
US9943247B2 (en) | 2015-07-28 | 2018-04-17 | The University Of Hawai'i | Systems, devices, and methods for detecting false movements for motion correction during a medical imaging scan |
US9549101B1 (en) | 2015-09-01 | 2017-01-17 | International Business Machines Corporation | Image capture enhancement using dynamic control image |
US20170085790A1 (en) * | 2015-09-23 | 2017-03-23 | Microsoft Technology Licensing, Llc | High-resolution imaging of regions of interest |
EP3355926A4 (en) | 2015-09-30 | 2019-08-21 | Vertex Pharmaceuticals Inc. | Method for treating cancer using a combination of dna damaging agents and atr inhibitors |
JP6624878B2 (en) * | 2015-10-15 | 2019-12-25 | キヤノン株式会社 | Image processing apparatus, image processing method, and program |
US10875403B2 (en) * | 2015-10-27 | 2020-12-29 | Magna Electronics Inc. | Vehicle vision system with enhanced night vision |
US9842624B2 (en) * | 2015-11-12 | 2017-12-12 | Intel Corporation | Multiple camera video image stitching by placing seams for scene objects |
CN106791586A (en) * | 2015-11-19 | 2017-05-31 | 杭州海康威视数字技术股份有限公司 | A kind of method and monitoring device, device, system being monitored to mobile target |
WO2017091479A1 (en) | 2015-11-23 | 2017-06-01 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US10132971B2 (en) | 2016-03-04 | 2018-11-20 | Magna Electronics Inc. | Vehicle camera with multiple spectral filters |
JP6514140B2 (en) * | 2016-03-17 | 2019-05-15 | 株式会社東芝 | Imaging support apparatus, method and program |
US10638092B2 (en) * | 2016-03-31 | 2020-04-28 | Konica Minolta Laboratory U.S.A., Inc. | Hybrid camera network for a scalable observation system |
TW201743241A (en) * | 2016-06-01 | 2017-12-16 | 原相科技股份有限公司 | Portable electronic device and operation method thereof |
US10757377B2 (en) | 2016-06-01 | 2020-08-25 | Pixart Imaging Inc. | Surveillance system and operation method thereof |
US10297059B2 (en) | 2016-12-21 | 2019-05-21 | Motorola Solutions, Inc. | Method and image processor for sending a combined image to human versus machine consumers |
US10498968B1 (en) | 2017-03-01 | 2019-12-03 | Altia Systems, Inc. | Intelligent zoom method and video system implementing same |
WO2018191648A1 (en) | 2017-04-14 | 2018-10-18 | Yang Liu | System and apparatus for co-registration and correlation between multi-modal imagery and method for same |
KR101983725B1 (en) * | 2017-08-03 | 2019-09-03 | 엘지전자 주식회사 | Electronic device and method for controlling of the same |
US10482618B2 (en) | 2017-08-21 | 2019-11-19 | Fotonation Limited | Systems and methods for hybrid depth regularization |
US10817594B2 (en) | 2017-09-28 | 2020-10-27 | Apple Inc. | Wearable electronic device having a light field camera usable to perform bioauthentication from a dorsal side of a forearm near a wrist |
EP3732656A4 (en) | 2017-12-29 | 2021-09-01 | PlusAI Corp | Method and system for multiple stereo based depth estimation and collision warning/avoidance utilizing the same |
US20190332848A1 (en) | 2018-04-27 | 2019-10-31 | Honeywell International Inc. | Facial enrollment and recognition system |
CN109784199B (en) * | 2018-12-21 | 2020-11-24 | 深圳云天励飞技术有限公司 | Peer-to-peer analysis method and related product |
US11458929B1 (en) * | 2019-05-10 | 2022-10-04 | Gm Cruise Holdings Llc | Unlocking vehicle doors with facial recognition |
US11196943B2 (en) * | 2019-05-31 | 2021-12-07 | Apple Inc. | Video analysis and management techniques for media capture and retention |
US20220360705A1 (en) * | 2019-06-18 | 2022-11-10 | Nec Corporation | Imaging system, imaging method, control apparatus, computer program and recording medium |
CN112149447A (en) * | 2019-06-26 | 2020-12-29 | 杭州海康威视数字技术股份有限公司 | Personnel identification method and device and electronic equipment |
JP7280006B2 (en) * | 2019-08-06 | 2023-05-23 | アルパイン株式会社 | Image processing device, image processing method and image processing program |
US11906628B2 (en) | 2019-08-15 | 2024-02-20 | Apple Inc. | Depth mapping using spatial multiplexing of illumination phase |
MX2022003020A (en) | 2019-09-17 | 2022-06-14 | Boston Polarimetrics Inc | Systems and methods for surface modeling using polarization cues. |
DE112020004813B4 (en) | 2019-10-07 | 2023-02-09 | Boston Polarimetrics, Inc. | System for expanding sensor systems and imaging systems with polarization |
CN114787648B (en) | 2019-11-30 | 2023-11-10 | 波士顿偏振测定公司 | Systems and methods for transparent object segmentation using polarization cues |
CN111259824B (en) * | 2020-01-19 | 2023-04-14 | 成都依能科技股份有限公司 | Method for automatically generating scanning path based on classroom size |
US11195303B2 (en) | 2020-01-29 | 2021-12-07 | Boston Polarimetrics, Inc. | Systems and methods for characterizing object pose detection and measurement systems |
JP2023511747A (en) | 2020-01-30 | 2023-03-22 | イントリンジック イノベーション エルエルシー | Systems and methods for synthesizing data for training statistical models with different imaging modalities, including polarization imaging |
US11763472B1 (en) * | 2020-04-02 | 2023-09-19 | Apple Inc. | Depth mapping with MPI mitigation using reference illumination pattern |
US11953700B2 (en) | 2020-05-27 | 2024-04-09 | Intrinsic Innovation Llc | Multi-aperture polarization optical systems using beam splitters |
CN114677608A (en) * | 2020-12-24 | 2022-06-28 | 中兴通讯股份有限公司 | Identity feature generation method, device and storage medium |
US11290658B1 (en) | 2021-04-15 | 2022-03-29 | Boston Polarimetrics, Inc. | Systems and methods for camera exposure control |
US11954886B2 (en) | 2021-04-15 | 2024-04-09 | Intrinsic Innovation Llc | Systems and methods for six-degree of freedom pose estimation of deformable objects |
US11689813B2 (en) | 2021-07-01 | 2023-06-27 | Intrinsic Innovation Llc | Systems and methods for high dynamic range imaging using crossed polarizers |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997021188A1 (en) * | 1995-12-04 | 1997-06-12 | David Sarnoff Research Center, Inc. | Wide field of view/narrow field of view recognition system and method |
US20020180759A1 (en) * | 1999-05-12 | 2002-12-05 | Imove Inc. | Camera system with both a wide angle view and a high resolution view |
US20040105004A1 (en) * | 2002-11-30 | 2004-06-03 | Yong Rui | Automated camera management system and method for capturing presentations using videography rules |
US20050007450A1 (en) * | 2002-12-13 | 2005-01-13 | Duane Hill | Vehicle mounted system and method for capturing and processing physical data |
Family Cites Families (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3928094A (en) * | 1975-01-16 | 1975-12-23 | Fairchild Camera Instr Co | Method of aligning a wafer beneath a mask and system therefor and wafer having a unique alignment pattern |
US4284412A (en) * | 1979-07-13 | 1981-08-18 | Ortho Diagnostics, Inc. | Method and apparatus for automated identification and enumeration of specified blood cell subclasses |
JPS58143206A (en) * | 1982-02-19 | 1983-08-25 | Canon Inc | Signal processing unit for detection of position |
US7415126B2 (en) * | 1992-05-05 | 2008-08-19 | Automotive Technologies International Inc. | Occupant sensing system |
US4980292A (en) * | 1984-10-01 | 1990-12-25 | Baxter International Inc. | Tablet dispensing |
US4704033A (en) * | 1986-03-06 | 1987-11-03 | Micronix Corporation | Multiple wavelength linear zone plate alignment apparatus and method |
NL8601000A (en) * | 1986-04-21 | 1987-11-16 | Jan Greve T H Twente Afdeling | THE USE OF POLARIZED LIGHT IN FLOW CYTOMETRY. |
US4818263A (en) * | 1987-06-11 | 1989-04-04 | Tektronix, Inc. | Method and apparatus for precisely positioning microlenses on optical fibers |
US5760900A (en) * | 1989-03-18 | 1998-06-02 | Canon Kabushiki Kaisha | Method and apparatus for optically measuring specimen |
US4932989A (en) * | 1989-04-05 | 1990-06-12 | At&T Bell Laboratories | Method and apparatus for fabricating microlenses on optical fibers |
CA2016699C (en) * | 1989-05-15 | 2003-11-18 | Paul N. Marshall | Lytic agents and uses thereof |
JP3215175B2 (en) * | 1992-08-10 | 2001-10-02 | シスメックス株式会社 | Particle analyzer |
US5396284A (en) * | 1993-08-20 | 1995-03-07 | Burle Technologies, Inc. | Motion detection system |
US6714665B1 (en) * | 1994-09-02 | 2004-03-30 | Sarnoff Corporation | Fully automated iris recognition system utilizing wide and narrow fields of view |
US5717631A (en) * | 1995-07-21 | 1998-02-10 | Carnegie Mellon University | Microelectromechanical structure and process of making same |
IT1280475B1 (en) * | 1995-11-09 | 1998-01-20 | Fiat Ricerche | COLOR AND IMAGE SELECTIVE MICROFILTER DEVICES. |
US5837547A (en) * | 1995-12-27 | 1998-11-17 | Caribbean Microparticles Corporation | Flow cytometer calibration method |
US6124663A (en) * | 1996-12-16 | 2000-09-26 | The Boeing Company | Fiber optic connector having a microelectromechanical positioning apparatus and an associated fabrication method |
US6097859A (en) * | 1998-02-12 | 2000-08-01 | The Regents Of The University Of California | Multi-wavelength cross-connect optical switch |
US6054335A (en) * | 1997-12-12 | 2000-04-25 | Xerox Corporation | Fabrication of scanning III-V compound light emitters integrated with Si-based actuators |
US6116756A (en) * | 1997-12-12 | 2000-09-12 | Xerox Corporation | Monolithic scanning light emitting devices |
US6215519B1 (en) * | 1998-03-04 | 2001-04-10 | The Trustees Of Columbia University In The City Of New York | Combined wide angle and narrow angle imaging system and method for surveillance and monitoring |
US6091197A (en) * | 1998-06-12 | 2000-07-18 | Xerox Corporation | Full color tunable resonant cavity organic light emitting diode |
JP4001436B2 (en) * | 1998-07-23 | 2007-10-31 | 三菱電機株式会社 | Optical switch and optical path switching device using optical switch |
US6049281A (en) * | 1998-09-29 | 2000-04-11 | Osterweil; Josef | Method and apparatus for monitoring movements of an individual |
US7483049B2 (en) * | 1998-11-20 | 2009-01-27 | Aman James A | Optimizations for live event, real-time, 3D object tracking |
US6091537A (en) * | 1998-12-11 | 2000-07-18 | Xerox Corporation | Electro-actuated microlens assemblies |
US20020075258A1 (en) * | 1999-05-12 | 2002-06-20 | Imove Inc. | Camera system with high resolution image inside a wide angle view |
US20020063711A1 (en) * | 1999-05-12 | 2002-05-30 | Imove Inc. | Camera system with high resolution image inside a wide angle view |
US6499025B1 (en) * | 1999-06-01 | 2002-12-24 | Microsoft Corporation | System and method for tracking objects by fusing results of multiple sensing modalities |
US6437819B1 (en) * | 1999-06-25 | 2002-08-20 | Rohan Christopher Loveland | Automated video person tracking system |
GB9918248D0 (en) * | 1999-08-04 | 1999-10-06 | Matra Bae Dynamics Uk Ltd | Improvements in and relating to surveillance systems |
US6370260B1 (en) * | 1999-09-03 | 2002-04-09 | Honeywell International Inc. | Near-IR human detector |
US7076088B2 (en) * | 1999-09-03 | 2006-07-11 | Honeywell International Inc. | Near-infrared disguise detection |
US6483935B1 (en) * | 1999-10-29 | 2002-11-19 | Cognex Corporation | System and method for counting parts in multiple fields of view using machine vision |
JP3389548B2 (en) * | 2000-01-13 | 2003-03-24 | 三洋電機株式会社 | Room abnormality detection device and room abnormality detection method |
US7630063B2 (en) * | 2000-08-02 | 2009-12-08 | Honeywell International Inc. | Miniaturized cytometer for detecting multiple species in a sample |
US6597438B1 (en) * | 2000-08-02 | 2003-07-22 | Honeywell International Inc. | Portable flow cytometry |
US7978329B2 (en) * | 2000-08-02 | 2011-07-12 | Honeywell International Inc. | Portable scattering and fluorescence cytometer |
KR100372774B1 (en) * | 2000-10-27 | 2003-02-25 | 한국과학기술연구원 | Visual Tracking Method by Color Information |
US6678413B1 (en) * | 2000-11-24 | 2004-01-13 | Yiqing Liang | System and method for object identification and behavior characterization using video analysis |
US6445298B1 (en) * | 2000-12-21 | 2002-09-03 | Isaac Shepher | System and method for remotely monitoring movement of individuals |
GB2371936A (en) * | 2001-02-03 | 2002-08-07 | Hewlett Packard Co | Surveillance system for tracking a moving object |
US6611206B2 (en) * | 2001-03-15 | 2003-08-26 | Koninklijke Philips Electronics N.V. | Automatic system for monitoring independent person requiring occasional assistance |
GB2373943A (en) * | 2001-03-28 | 2002-10-02 | Hewlett Packard Co | Visible and infrared imaging camera |
US20090231436A1 (en) * | 2001-04-19 | 2009-09-17 | Faltesek Anthony E | Method and apparatus for tracking with identification |
US20030053658A1 (en) * | 2001-06-29 | 2003-03-20 | Honeywell International Inc. | Surveillance system and methods regarding same |
US20030123703A1 (en) * | 2001-06-29 | 2003-07-03 | Honeywell International Inc. | Method for monitoring a moving object and system regarding same |
US20030053659A1 (en) * | 2001-06-29 | 2003-03-20 | Honeywell International Inc. | Moving object assessment system and method |
US20030076417A1 (en) * | 2001-08-07 | 2003-04-24 | Patrick Thomas | Autonomous monitoring and tracking of vehicles in a parking lot to enforce payment rights |
US7027619B2 (en) * | 2001-09-13 | 2006-04-11 | Honeywell International Inc. | Near-infrared method and system for use in face detection |
US6781388B2 (en) * | 2001-09-26 | 2004-08-24 | Delphi Technologies, Inc. | Liquid property sensor |
US20040030531A1 (en) * | 2002-03-28 | 2004-02-12 | Honeywell International Inc. | System and method for automated monitoring, recognizing, supporting, and responding to the behavior of an actor |
US7207939B2 (en) * | 2002-10-03 | 2007-04-24 | Coulter International Corp. | Apparatus and method for analyzing a liquid in a capillary tube of a hematology instrument |
US7079244B2 (en) * | 2002-11-18 | 2006-07-18 | International Remote Imaging Systems, Inc. | Particle analyzer with specimen tube in-line mixer |
US20040154933A1 (en) * | 2003-02-11 | 2004-08-12 | Instrumentation Laboratory Company | Polymeric membranes for use in electrochemical sensors |
TW577855B (en) * | 2003-05-21 | 2004-03-01 | Univ Nat Cheng Kung | Chip-type micro-fluid particle 3-D focusing and detection device |
US7421097B2 (en) * | 2003-05-27 | 2008-09-02 | Honeywell International Inc. | Face identification verification using 3 dimensional modeling |
US7183895B2 (en) * | 2003-09-05 | 2007-02-27 | Honeywell International Inc. | System and method for dynamic stand-off biometric verification |
US7362210B2 (en) * | 2003-09-05 | 2008-04-22 | Honeywell International Inc. | System and method for gate access control |
-
2005
- 2005-10-20 US US11/163,497 patent/US7806604B2/en active Active
-
2006
- 2006-10-18 WO PCT/US2006/040630 patent/WO2007047719A2/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997021188A1 (en) * | 1995-12-04 | 1997-06-12 | David Sarnoff Research Center, Inc. | Wide field of view/narrow field of view recognition system and method |
US20020180759A1 (en) * | 1999-05-12 | 2002-12-05 | Imove Inc. | Camera system with both a wide angle view and a high resolution view |
US20040105004A1 (en) * | 2002-11-30 | 2004-06-03 | Yong Rui | Automated camera management system and method for capturing presentations using videography rules |
US20050007450A1 (en) * | 2002-12-13 | 2005-01-13 | Duane Hill | Vehicle mounted system and method for capturing and processing physical data |
Non-Patent Citations (4)
Title |
---|
BAZAKOS M E ET AL: "Fast access control technology solutions (FACTS)" PROCEEDINGS. IEEE CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, 2005. COMO, ITALY SEPT. 15-16, 2005, PISCATAWAY, NJ, USA,IEEE, 15 September 2005 (2005-09-15), pages 312-317, XP010881194 ISBN: 0-7803-9385-6 * |
DOWDALL-I PAVLIDIS-G BEBIS J: "A face detection method based on multi-band feature extraction in the near-IR spectrum" PROCEEDINGS IEEE WORKSHOP ON COMPUTER VISION BEYOND THE VISIBLE SPECTRUM: METHODS AND APPLICATIONS, XX, XX, 14 December 2001 (2001-12-14), XP002369556 * |
KONG S G ET AL: "Recent advances in visual and infrared face recognition-a review" COMPUTER VISION AND IMAGE UNDERSTANDING, ACADEMIC PRESS, SAN DIEGO, CA, US, vol. 97, no. 1, January 2005 (2005-01), pages 103-135, XP004642050 ISSN: 1077-3142 * |
TNO TPD: "Parkeerwachter" ADVERTISEMENT, 14 November 2003 (2003-11-14), XP007902084 Delft * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2210354A2 (en) * | 2007-09-11 | 2010-07-28 | Wavebreak Technologies Ltd. | Presence detector and method for estimating an audience |
GB2475945A (en) * | 2009-12-02 | 2011-06-08 | Honeywell Int Inc | Image acquisition system where target distance is determined using a fixed wide-angle camera and a second high-resolution camera |
GB2475945B (en) * | 2009-12-02 | 2012-05-23 | Honeywell Int Inc | Multi camera registration for high resolution target capture |
GB2480521A (en) * | 2010-05-21 | 2011-11-23 | Honeywell Int Inc. | Face recognition system using secondary cameras for high quality images |
GB2480521B (en) * | 2010-05-21 | 2013-10-23 | Honeywell Int Inc. | Distant face recognition system |
US9262668B2 (en) | 2010-05-21 | 2016-02-16 | Honeywell International Inc. | Distant face recognition system |
WO2013105084A1 (en) * | 2012-01-09 | 2013-07-18 | Rafael Advanced Defense Systems Ltd. | Method and apparatus for aerial surveillance |
CN103021053A (en) * | 2012-11-22 | 2013-04-03 | 成都江法科技有限公司 | Security system for human face recognition |
Also Published As
Publication number | Publication date |
---|---|
WO2007047719A3 (en) | 2007-06-28 |
US7806604B2 (en) | 2010-10-05 |
US20070092245A1 (en) | 2007-04-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7806604B2 (en) | Face detection and tracking in a wide field of view | |
JP4568009B2 (en) | Monitoring device with camera cooperation | |
US9928707B2 (en) | Surveillance system | |
KR100606485B1 (en) | Object tracking method and object tracking apparatus | |
US7574021B2 (en) | Iris recognition for a secure facility | |
US7940299B2 (en) | Method and apparatus for an omni-directional video surveillance system | |
US9215358B2 (en) | Omni-directional intelligent autotour and situational aware dome surveillance camera system and method | |
EP1765014B1 (en) | Surveillance camera apparatus and surveillance camera system | |
US20060238617A1 (en) | Systems and methods for night time surveillance | |
US9129181B1 (en) | Object detection, location, and/or tracking with camera and lighting system | |
KR100879623B1 (en) | Automated wide area surveillance system using ptz camera and method therefor | |
JP2005505871A (en) | Facial image system for recording and automatic identification | |
US20050084179A1 (en) | Method and apparatus for performing iris recognition from an image | |
US20060187305A1 (en) | Digital processing of video images | |
US20050232466A1 (en) | Method of recognizing and/or tracking objects | |
US20100013917A1 (en) | Method and system for performing surveillance | |
JP5127531B2 (en) | Image monitoring device | |
KR101982751B1 (en) | Video surveillance device with motion path tracking technology using multi camera | |
EP2476098A1 (en) | Method and system for wildfire detection using a visible range camera | |
US20150296142A1 (en) | Imaging system and process | |
KR102097908B1 (en) | System for object photographing | |
KR101738514B1 (en) | Monitoring system employing fish-eye thermal imaging camera and monitoring method using the same | |
KR20210076334A (en) | Video surveillance device for Crime prevention using omnidirectional camera | |
EP2736249A1 (en) | Imaging system and process | |
Kang et al. | Video surveillance of high security facilities |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 06826148 Country of ref document: EP Kind code of ref document: A2 |