|Publication number||US7609852 B2|
|Application number||US 11/419,751|
|Publication date||Oct 27, 2009|
|Filing date||May 22, 2006|
|Priority date||Nov 16, 2004|
|Also published as||US7542585, US20060115154, US20060209184|
|Publication number||11419751, 419751, US 7609852 B2, US 7609852B2, US-B2-7609852, US7609852 B2, US7609852B2|
|Original Assignee||Huper Laboratories Co., Ltd.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (5), Referenced by (4), Classifications (9), Legal Events (2)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This is a continuation-in-part of application Ser. No. 11/164,254, filed Nov. 16, 2005, and which is included in its entirety herein by reference.
1. Field of the Invention
The present invention relates to a flame detection and smoke detection method and system to give an early fire-alarm information, and more specifically, to a flame detection and smoke detection method and system based on image processing.
2. Description of the Prior Art
Fire has caused countless casualties and damages to our society in the past decades. For years many efforts have been made trying to avoid such great and unpredictable damages with various fire detection technologies or fire prevention devices. Most of the fire detection technologies are base on particle sampling, temperature sampling, relative humidity sampling, air transparency testing, smoke analysis, in addition to the traditional ultraviolet and infrared fire detectors. However, fire detection systems using any of these technologies have so many limitations that the performance of effective fire detection is rarely satisfactory. As some of the systems are limited in applying in only some specific places, for example, the smoke sampling isn't suitable for a kitchen, others are limited in application because of the distance of the fire or the scale of the fire, for example, the detection device using temperature sampling technology can only be activated when the fire has caused a significant increase in the temperature detected by the detection device. Even some are too expensive therefore can only be utilized in important places. These fire detection devices using the above technologies either must be set in the proximity of a fire or can't provide the additional information about the process of burning, such as flame location, size, growing rate, and so on. Thus, they are not always reliable because energy emission of non-flame or byproducts of combustion, which can be yielded in other ways, may be detected by misadventure. This usually results in false alarms. To provide more reliable information about fires, the visual-based approach is becoming more and more interesting.
The prior art flame detection and smoke detection based on image processing uses images detected by an infrared camera. With smoke detection, fire expansion detection, HSI image analysis, and disorder analysis of fire, the prior art fire detection extracts the fire and validates the fire. However, the prior art fire detection method usually results in high false alarms and can't provide an early detection of a fire.
The claimed invention provides a flame detection method based on image processing. The method comprises capturing images of a predetermined area, detecting number of flame pixels of each image, generating a value according to the number of flame pixels of each image, and comparing values generated from images captured within a predetermined time interval to generate a comparison result.
The claimed invention further provides a smoke detection method based on image processing. The method comprises capturing images of a predetermined area, detecting number of smoke pixels of each image, generating a value according to the number of smoke pixels of each image, and, comparing values generated from images captured within a predetermined time interval to generate a comparison result.
The claimed invention further provides a flame detection and smoke detection system based on image processing. The system comprises an image capturing device for capturing images of a predetermined area, means for detecting number of flame pixels and number of smoke pixels of each image captured by the image capturing device, means for generating a value according to the number of flame pixels or the number of smoke pixels of each image, and means for comparing values generated from images captured by the image capturing device within a predetermined time interval to generate a comparison result.
These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
Please refer to
Step S101: Capture images of a predetermined area;
Step S102: Check if the predetermined area contains any moving object;
Step S103: Check if the moving object is formed by flame pixels or smoke pixels; if so, go to Step S105; if not, go to Step S102;
Step S105: Detect number of flame pixels and number of smoke pixels of each image captured in the predetermined area;
Step S106: Input the number of flame pixels and the number of smoke pixels detected in Step S105 to a fire detection fuzzy system;
Step S107: Generate alarm information of each image captured in the predetermined area by the fire detection fuzzy alarm system according to the number of flame pixels and the number of smoke pixels of each image;
First of all, the image capturing device is used to capture images of a predetermined area as in Step S101. Then the images are detected to check whether there is any moving object in the image by checking differences in a plurality of consecutive frames of the predetermined area since flame or smoke is unsteady by nature in Step S102. Next validation of the moving objects as flame or smoke or none of the above is carried out in Step S103. In order to decide whether the detected moving object is flame/smoke or not, the present invention flame detection and smoke detection method uses image processing to validate pixel by pixel of the moving object. Since the RGB (red, green, blue) color format is widely used in most capturing devices, the present invention adopts directly the RGB color model to analyze the characteristics of the flame/smoke pixels in order to avoid the additional operations required in transforming to other color models.
To simulate the color sensing properties of the human visual system, RGB color information is usually transformed into a mathematical space that decouples the brightness (or luminance) information from the color information. Among many color models, HSI (hue/saturation/intensity) color model is very suitable for providing a more people-oriented way of describing the colors, because the hue and saturation components are intimately related to the way in which human beings perceive color.
Based on the common knowledge of fire, it is reasonable to assume that the colors of general flames belong to the red-yellow range. This will map the value of hue of general flames to be distributed from 00 to 600.
Condition 1: R≧G>B, where R, G, B are red, green, blue gray levels of the pixel respectively.
Please refer to
Condition 2: R>RT, where R is red gray level of the pixel, and RT is a threshold of the red gray level.
However, the background illumination may affect the saturation of flame or generate a flame-like alias in color, and then result in a false flame-detection. To avoid being confused by the background illumination, the saturation value of the pixel detected should be over a threshold. Since the value of saturation is the value of the red gray level when the red gray level reaches RT of a pixel, and based on the basic concept, the saturation will degrade with the increasing red gray level. Thus, once the red gray level of a pixel exceeds RT, the saturation of the pixel will decrease down to zero when the red gray level increases up to the top value of 255.
Condition 3: S≧((255−R)*ST/RT), where S is saturation of a pixel, and ST is saturation of the pixel when the red gray level of the pixel equals RT.
Besides, when the fire is in a dark environment without other background illumination, the fire will be the major light source. The fire may display partial white in an image captured from an image capturing device. Thus, in such circumstances, the intensity (I) of a pixel will be considered the best parameter in validating a pixel as a flame pixel, and the intensity I of a real flame pixel should be over a threshold of the intensity of the pixel, say, IT. We then add a fourth condition of validation when the predetermined area is in a dark environment:
Condition 4: I>IT.
Based on the above analysis, we can put all the conditions together and propose that a pixel will be validated as a real flame pixel when it satisfies the following conditions:
Condition 1: R≧G>B;
Condition 2: R>RT;
Condition 3: S≧((255−R)*ST/RT); and
Condition 4: I>IT, if the predetermined area is in a dark environment.
Step S103 further comprises the validation of a smoke pixel. Since the smoke usually displays grayish color during a burning process, and such grayish color can be classified into two gray levels: light gray and dark gray, the R, G, B gray levels of a smoke pixel need to be approximately equal. And by experimental results, the intensity (I) of a smoke pixel should be lying in the range of the light gray level or the dark gray level, say, L1≦I≦L2 or D1≦I≦D2, where L1, L2 represent light gray level values and D1, D2 represent dark gray level values and all depend on the statistical data of experiments. Therefore, we introduce two conditions for validating a pixel as a smoke pixel:
Condition 5: Rąα=Gąα=Bąα;
Condition 6: L1≦I≦L2 or D1≦I≦D2;
where R, G, B are red, green blue gray levels of the pixel respectively, α is a deviation constant, I is the intensity of the pixel, and L1, L2, D1, D2 are four experimental results of the gray level ranges.
While some flame-like regions in an image may have the same colors as fire, and these flame-similar areas are usually extracted as the real flame from an image, we should validate the moving object as flame or smoke by using the particular characteristic of dynamic disorder of flame/smoke. Since the shape of flame is changeable anytime owing to air flow, we can use the following decision rule to check for the disorder of the moving object:
Condition 7: (FEP/FTP)≧FTD;
where the parameter FEP denotes the circumference of an object formed by flame pixels of the image, FTP is the number of pixels of the object, and FTD is a disorder threshold that distinguishes from other flame-like objects.
As applied to the moving object formed by flame pixels, the moving object formed by smoke pixels can also be tested by the disorder analysis decision rule.
When the moving object captured in the predetermined area validated as real flame or smoke, then update the number of real flame pixels and the number of real smoke pixels as in Step S105 and input the number of flame pixels and the number of smoke pixels to a fire detection fuzzy system as in Step S106.
Please refer to
The present invention flame detection and smoke detection method provides an iterative growth-checking based method to check if the burning fire will spread to cause an accident. The basic concept is that if the alarm information increases with the burning time, the fire is considered to spread out and hence a fire alarm should be given in the while.
Another exemplary embodiment of the present invention is described in
Step S201: Capture images of a predetermined area;
Step S202: Check if the predetermined area contains any moving object;
Step S203: Extract flame pixels from the moving object;
Step S204: Determine if the moving object is real flame; if so, go to S205; if not, go to S202;
Step S205: Release a signal of discovering flame;
Step S206: Determine if the real flame discovered in S204 is going to spread out by a flame alarm raising process; if so, go to S207, if not, repeat S206;
Step S207: Release a flame alarm.
In Step S203, the early fire detection method uses conditions 1, 2, 3, and 4 as mentioned above to determine whether a pixel in the moving object is a flame pixel. And in Step S204, the moving object is validated as real flame by disorder rule mentioned in condition 7 and a feature of grow of flame pixels. The feature of grow of flame pixels indicates that if a flame-pixel quantity Mi+1 of a next image frame is greater than a flame-pixel quantity Mi of a current image frame for more than g times at intervals of tF during a time period T, where g, tF, and T rely on statistical data of experiments, than the moving object is dealt with as real flame.
Next, when real flame is discovered as a signal is released in S206, number eight and number nine conditions are applied to determine if real flame is going to spread out.
Condition 8: Mi+1>Mi for (R/N)>K; or
Condition 9: ((Mi+1−Mi)/Mi)>S;
Where Mi+1 and Mi are the flame-pixel quantities of a next image frame and a current image frame respectively, N denotes the times of comparing Mi with Mi+1 at intervals of tR during a time period T, R denotes the times of Mi+1>Mi, K is a number between 0 and 1 relying on statistical data experiments, and S denotes the growing rate of flames and will be more than at least 2 based on experimental results, where S mainly relies on the quantity of fuels.
If condition 8 or condition 9 is satisfied, the real flame is judged to going to spread out and a flame alarm is released as in S207.
Another exemplary embodiment of the present invention is described in
Step S301: Capture images of a predetermined area;
Step S302: Check if the predetermined area contains any moving object;
Step S303: Extract smoke pixels from the moving object;
Step S304: Determine if the moving object is real smoke; if so, go to S305; if not, go to S302;
Step S305: Release a signal of discovering smoke;
Step S306: Determine if the real smoke discovered in S304 is going to spread out by a smoke alarm raising process; if so, go to S307, if not, repeat S306;
Step S307: Release a smoke alarm.
In Step S303, the smoke detection method uses conditions 5 and 6 as mentioned above to determine whether a pixel in the moving object is a smoke pixel. The rest steps of the smoke detection method are similar to those of the flame detection method and if condition 8 is satisfied, the real smoke is determined to going to spread out and a smoke alarm is released as in S307. It should be pointed out that, in condition 8 used for smoke detection, Mi+1 and Mi mean the smoke-pixel quantities of a next image frame and a current image frame respectively, N denotes the times of comparing Mi with Mi+1 at intervals of tR during a time period T, R denotes the times of Mi+1>Mi, K is a number between 0 and 1 relying on statistical data experiments.
Finally, please refer
The exemplary embodiment of the present invention flame detection and smoke detection method and system use techniques of image processing to detect the growing of flame or smoke by analyzing the characteristics of flame and smoke. Once validating a flame or smoke's existence, use a fire detection fuzzy system and a comparative criterion to determine the growing characteristic of the flame or smoke for next step decision. In such combination of fire detection and smoke detection method, the method and system can precisely provide proper information of any fire instance and lower the misreport rate of a fire accident.
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US7155029 *||May 10, 2002||Dec 26, 2006||Detector Electronics Corporation||Method and apparatus of detecting fire by flame imaging|
|US7245315 *||May 20, 2002||Jul 17, 2007||Simmonds Precision Products, Inc.||Distinguishing between fire and non-fire conditions using cameras|
|US7256818 *||May 20, 2002||Aug 14, 2007||Simmonds Precision Products, Inc.||Detecting fire using cameras|
|US7280696 *||May 20, 2002||Oct 9, 2007||Simmonds Precision Products, Inc.||Video detection/verification system|
|US7302101 *||Aug 21, 2002||Nov 27, 2007||Simmonds Precision Products, Inc.||Viewing a compartment|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8538080 *||Sep 9, 2011||Sep 17, 2013||Chang Jung Christian University||Flame identification method and device using image analyses in HSI color space|
|US20120195462 *||Aug 2, 2012||Chang Jung Christian University||Flame identification method and device using image analyses in hsi color space|
|CN102881109A *||Feb 28, 2012||Jan 16, 2013||北京华拓信通科技股份有限公司||Forest fire early-warning system based on non-refrigerant infrared temperature detector|
|CN102881109B *||Feb 28, 2012||Dec 24, 2014||北京华拓信通科技股份有限公司||Forest fire early-warning system based on non-refrigerant infrared temperature detector|
|U.S. Classification||382/100, 348/143, 382/165|
|International Classification||H04N7/18, G06K9/00|
|Cooperative Classification||G08B17/125, G08B29/186|
|European Classification||G08B17/12V, G08B29/18S1|
|May 23, 2006||AS||Assignment|
Owner name: HUPER LABORATORIES CO., LTD., TAIWAN
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHEN, CHAO-HO;REEL/FRAME:017655/0614
Effective date: 20060512
|Mar 14, 2013||FPAY||Fee payment|
Year of fee payment: 4