Background technology
License plate recognition technology (VehicleLicense Plate Recognition, VLPR) refers to detect the vehicle on monitored road surface and the automatic lifting technology that a license plate information (containing Chinese character, English alphabet, arabic numeral and number plate color) processes of picking up the car.Car plate identification is one of important component part in the modern intelligent transportation system, uses very extensive.It is analyzed vehicle image or the video sequence of shot by camera take technology such as Digital Image Processing, pattern-recognition, computer visions as the basis, obtains the unique number-plate number of each automobile, thus the identifying of finishing.Can realize parking lot fee collection management by some subsequent treatment means, magnitude of traffic flow control index measurement, vehicle location, automobile burglar, high way super speed robotization supervision, electronic eye used for catching red light runner, toll station etc. function.For safeguarding traffic safety and urban public security, prevent traffic jam, realize that the traffic automation management has the meaning of reality.
Usually licence plate recognition method comprises following three steps: car plate location, License Plate Character Segmentation, Recognition of License Plate Characters.And the index of estimating licence plate recognition method mainly comprises processing time, recognition accuracy etc., more than in three steps each step all can have influence on the performance of whole licence plate recognition method.
Existing various licence plate recognition method mostly exists a lot of defectives.Thereby algorithm of locating license plate of vehicle is consuming time many and be subjected to easily the accuracy that car plate place complex background disturbs affects the location, because the diversity of the license plate image that gathers, and be subject to being permitted multifactorial impact when gathering image, such as the rainy day, dense fog, light etc., so that some license plate image quality appearance difference is in various degree arranged, in the ordinary course of things, the background of the image that gathers is very complicated, gathering image is the picture that gathers in high-speed motion, so the position of car plate is unfixing in the picture, the size of car plate is also different, above all disturbing factors, all brought difficulty to the license plate area location, existing method does not well address this problem.
Along with the development from the analogue camera to the high definition camera, the contradiction of image high-resolution and recognition speed is more and more noticeable.The advantage of high definition is self-evident, but when identifying, car plate also can cause some problems, the high definition picture is because the picture broad covered area, the identification of a plurality of car plates may appear in picture simultaneously, existing Vehicle License Plate Recognition System concentrates on mostly processes the image that only comprises a car, comprise at input picture in the situation of a lot of motor vehicles, existing Vehicle License Plate Recognition System can not show very high performance.In addition, the HD video code stream is very large, and the processing speed of Vehicle License Plate Recognition System has been proposed very high requirement, if processing speed is crossed the phenomenon that may cause leaking slowly car, thereby is difficult to realize lifting to vehicle snapshot rate and car plate recognition accuracy.
In addition, at present in the Recognition Algorithm of License Plate part, owing in the car plate of China English alphabet and arabic numeral are arranged not only, also comprise the numerous and diverse Chinese character of stroke, cause its identification difficulty external only much bigger to the situation of letter, numeral identification, the Some Domestic road conditions is poor in addition, the car plate damage ratio is more serious, and the number plate of vehicle of actual motion can be subject to the impacts such as mud, oil, lacquer, characters on license plate often has the phenomenon of fracture, the number plate manufacture craft character that also can occur lack of standardization shoals, fogs simultaneously, makes the difficulty of Recognition of License Plate Characters become large.Template matching method is used widely in the car plate automatic identification field because of its fireballing characteristic, but under above all abominable conditions, the precision of template matching method is limited by very large, in addition, template matching method is not good for the rotation resistance, has limited to a certain extent its range of application yet.Use other methods such as neural network to identify, can bring no small lifting processing complexity again, in general, existing licence plate recognition method, possess at the same time also exist on higher processing speed and the larger recognition accuracy a lot of not enough.
Summary of the invention
The objective of the invention is to propose a kind of recognition methods of the motor vehicle trade mark, existing binary Images Processing is combined with the morphology processing, carry out many car plates location, then by slightly to smart car plate being rotated rectification, the enhanced edition template matches that combines with the rarefaction representation theory is to realize the high-performance car plate identification of low computation complexity, high recognition accuracy.
The recognition methods of the motor vehicle trade mark that the present invention proposes may further comprise the steps:
(1) read in coloured image or a gray level image that contains car plate, if this image is coloured image, then be translated into gray level image, the note gray level image is initial pictures G;
(2) utilize median filter method that initial pictures G is carried out pre-service, weaken salt-pepper noise, obtain pretreated image
(3) utilize binary conversion treatment and morphology disposal route, from pretreated image
In orient license plate area, obtain pretreated image
In the set { P of all license plate areas
i(i=1,2 .., N), wherein N is total number of license plate area, P
iBe i license plate area, concrete steps are as follows:
(3-1) at pretreated image
On carry out rim detection, obtain pretreated image
Edge image E, edge image E is bianry image, if the pixel value of the pixel (x, y) among the edge image E is 1, then this pixel (x, y) is marginal point, if the pixel value of pixel (x, y) is 0, then this pixel (x, y) is non-marginal point;
(3-2) with among the edge image E, be set to 0 with the pixel value of marginal point on the edge that the borderline phase of edge image E is connected, obtain pretreated edge image
(3-3) definition one wide be W1 pixel, the height be the structural element of H1 pixel, to above-mentioned pretreated edge image
Carry out closing operation of mathematical morphology, obtain the edge image E after the closed operation
1
(3-4) one of definition is wide be that W2 pixel, height are the structural element of H2 pixel, and edge image E is exported in closed operation
1Carry out the morphology opening operation, obtain the edge image E behind the opening operation
2
The set that the pixel that (3-5) is communicated with in the definition image forms is connected region, according to the edge image E behind the opening operation
2In all pixel values be the connectedness of 1 pixel, to the edge image E behind the opening operation
2In all pixel values be that 1 pixel is divided, the connected region that the pixel that obtains being communicated with forms makes edge image E
2In each pixel value be that 1 pixel is corresponding with a connected region;
(3-6) each connected region is judged that obtain the set of the corresponding connected region of all motor vehicle trades mark to be identified, determining step is as follows:
(3-6-1) from the connected region of step (3-5), get a connected region A who did not judge and judge, if all connected regions in the connected region of step (3-5) all were judged, then carry out step (3-6-5);
The ratio of width to height of the connected region that (3-6-2) the setting car plate is corresponding is 3~5.5, the ratio of width to height of the bounding box of connected region A is compared with the ratio of width to height of setting license plate area, if the ratio of width to height of the bounding box of connected region A is greater than the upper limit of the ratio of width to height of setting license plate area, or the ratio of width to height of the bounding box of connected region A is less than the lower limit of the ratio of width to height of setting license plate area, judge that then connected region A is not the connected region corresponding with car plate, and carry out step (3-6-1);
If the ratio of width to height of the bounding box of connected region A is less than or equal to the upper limit of the ratio of width to height of setting license plate area, or the ratio of width to height of the bounding box of connected region A is more than or equal to the lower limit of the ratio of width to height of setting license plate area, then judge connected region A as drafting connected region corresponding to car plate, and carry out step (3-6-3);
(3-6-3) from pretreated image
In, take out a gray level image that the pixel in the bounding box with connected region A is corresponding
Adopt adaptive threshold, with gray level image
Binaryzation obtains the bianry image B corresponding with the pixel in bounding box connected region A after the binaryzation
A, set the in the horizontal direction frequency threshold value that replaces of black and white of a connected region corresponding with car plate, if bianry image B
AThe number of times that replaces of black and white is judged that then connected region A is not connected region corresponding to car plate, and is carried out step (3-6-1), if bianry image B less than frequency threshold value in the horizontal direction
AThe number of times that replaces of black and white is judged that then connected region A drafts connected region corresponding to car plate, and is carried out step (3-6-4) more than or equal to frequency threshold value in the horizontal direction;
(3-6-4) calculate bianry image B
AInterior pixel value is that 1 pixel number accounts for bianry image B
AInterior all pixel number purpose ratio α, if α is not between 0.3~0.4, judge that then connected region A is not connected region corresponding to car plate, if α is between 0.3~0.4, judge that then connected region A is connected region corresponding to car plate, get back to step (3-6-1), carry out the judgement of next connected region;
The set of (3-6-5) establishing connected region corresponding to all car plates is { A
i(i=1,2 .., N), wherein A
iBe i the connected region that car plate is corresponding, in order from the set { A of connected region
iThe middle taking-up connected region A corresponding with each car plate
iBounding box, to the pixel in the bounding box at pretreated image
The pixel of interior correspondence carries out binary conversion treatment, obtains a pixel set P
i, note pixel set P
iBe license plate area, thereby the set that obtains all license plate areas is { P
i(i=1,2 .., N), wherein P
iBe i license plate area;
(4) to above-mentioned license plate area P
iBe rotated and correct and the processing of trimming edge the license plate area after obtaining processing
Concrete steps are as follows:
(4-1) utilize edge detection operator, from license plate area P
iMiddle extraction and license plate area P
iCorresponding binary edge map E
Pi, calculate binary edge map E
PiDraw the winter (Radon) conversion, from the matrix that conversion obtains, obtain the matrix peak value, the angle θ corresponding with the matrix peak value is license plate area P
iAnglec of rotation θ, according to the anglec of rotation θ of car plate to license plate area P
iIn all pixels carry out reverse rotation θ angle, rotated roughly the license plate area P after the rectification
I1
(4-2) remove license plate area P
I1In the constant band of pixel value of boundary pixel up and down, the license plate area P that is tentatively tightened
I2
The license plate area P that (4-3) will tentatively tighten
I2In the pixel value of every delegation pixel sue for peace, the pixel value sum of establishing the capable pixel of m is S
m, by sequence number m inferior ordered pair S from small to large
mSort, obtain S
mFirst maximum value S
M0, establish and S
M0Corresponding line number is m
0, to the license plate area P of above-mentioned preliminary deflation
I2In the 1st~m
0Pixel value is that 1 pixel carries out fitting of a polynomial one time in the row, the license plate area P that is tentatively tightened according to polynomial slope k once
I2The pitch angle
According to the pitch angle
License plate area P to preliminary deflation
I2Interior all pixels carry out reverse rotation, obtain the license plate area P after meticulous rotation is corrected
I3
(4-4) remove license plate area P
I3In the constant band of up and down boundary pixel pixel value, obtain the license plate area P that secondary tightens
I4
(4-5) utilize interpolation method, to the license plate area P of secondary deflation
I4Carry out proportional zoom, so that license plate area is high for setting number pixel H, obtain a license plate area after the processing behind the proportional zoom
(5) adopt vertical projection method, to the license plate area after the above-mentioned processing
Carry out Character segmentation and process the license plate area after the computing
Two-value perspective view in vertical direction, and searching trough point, from the trough point whole car plate is carried out Character segmentation, obtain 7 character blocks, remove in each character block the up and down constant band of the pixel value of boundary pixel, character block after obtaining tightening, and the character block after will tightening utilizes interpolation method to zoom to
Namely wide
Individual pixel, a skyer pixel obtains character block to be identified;
(6) template matching method of employing enhanced edition carries out character recognition to above-mentioned character block to be identified, and the implementation step is as follows:
(6-1) from above-mentioned character block to be identified, get a character block C to be identified
Ij, the character block C that this is to be identified
IjBe divided into four zones, the pixel in each piece zone is lined up a column vector, and four column vectors corresponding with four zones are got up in succession, consist of this character block C to be identified
IjProper vector
(6-2) gather the car plate samples pictures, to each character that may occur in the car plate, from samples pictures, manually mark the respective symbols piece, and with the character block size scaling
Carry out proper vector according to the method in the step (6-1) and extract, the proper vector of all characters is saved as a dictionary D, each proper vector is a base among the dictionary D;
(6-3) adopt iteration threshold to select projection algorithm (Iterative Threshold-Selective Projection algorithm), find the solution above-mentioned C
IjProper vector
The most sparse solution vector under dictionary D
Solution vector
Each component ω
Ij-kExpression C
IjProper vector
K base in dictionary D
Weight;
(6-4) calculate under the two norm meanings each base among the dictionary D
By with
Corresponding weights omega
Ij-kCarry out vector and C behind the proportional zoom
IjProper vector
Between apart from d
Ij-k, establish apart from d
Ij-kIn minor increment be d
Ij-k0, with this minor increment d
Ij-k0Base among the corresponding dictionary D is
Corresponding character is character block C to be identified
IjRepresented character:
(6-5) repeating step (6-1)-(6-4) is until the license plate area after processing
In all character blocks to be identified all identify complete;
(7) repeating step (4)-(6) are until the set { P of license plate area
i(i=1,2 ..., N) in all license plate areas all oneself is disposed, the output recognition result.
The licence plate recognition method that the present invention proposes, its advantage is:
1, the present invention's use combines Morphology Algorithm and carries out license plate locating method with binary Images Processing, take full advantage of the fireballing advantage of binary Images Processing, introduce simultaneously Morphology Algorithm, can effectively remove unwanted marginal information for the interference of car plate location, remedy when utilizing binary Images Processing to carry out the car plate location for the comparatively responsive deficiency of marginal information.The present invention has promoted the precision that car plate is located by introducing priori to a certain degree greatly under on the less prerequisite of generalization impact, realized the location not only fast but also accurate to car plate.
2, the present invention can disposablely detect a plurality of license plate areas in the single image simultaneously, and fast processing identification, has realized preferably many car plates recognition function.
3, the present invention has adopted a kind of by thick rotation antidote to essence, can effectively correct the tilt phenomenon that license plate area occurs, for follow-up cut apart, recognizer provides good input, thereby greatly promote the accuracy of identification of a whole set of licence plate recognition method, and the anti-revolving property of introducing has thus enlarged the scope of application of this licence plate recognition method.
4, the present invention improves the conventional template matching algorithm, and is theoretical by using rarefaction representation, on the basis of conventional template matching algorithm speed advantage, further promoted computing velocity, greatly improved the identification accuracy simultaneously.The present invention has carried out meticulousr Division identification for the character of easily obscuring after template matches, thereby has very low identification error rate.
5, the present invention can be used for the Real-time Vehicle License Plate recognition system, processes high-speed data-flow, has simultaneously very high recognition accuracy, and the mal-conditions such as, character fracture fuzzy for illumination variation, misty rain impact, car plate have certain robustness.
Embodiment
The licence plate recognition method that the present invention proposes, its FB(flow block) may further comprise the steps as shown in Figure 1:
(1) read in coloured image or a gray level image that contains car plate, if this image is coloured image, then be translated into gray level image, the note gray level image is initial pictures G;
(2) utilize median filter method that initial pictures G is carried out pre-service, weaken salt-pepper noise, obtain pretreated image
(3) utilize binary conversion treatment and morphology disposal route, from pretreated image
In orient license plate area, obtain pretreated image
In the set { P of all license plate areas
i(i=1,2 .., N), wherein N is total number of license plate area, P
iBe i license plate area, its FB(flow block) as shown in Figure 2, concrete steps are as follows:
(3-1) at pretreated image
On carry out rim detection, can carry out rim detection according to the different edge detection operator of practical application scene choice for use, in experiment, used the Sobel operator to carry out rim detection, obtain pretreated image
Edge image E, edge image E is bianry image, if the pixel value of the pixel (x, y) among the edge image E is 1, then this pixel (x, y) is marginal point, represents that it is positioned at pretreated image
In the edge on, if the pixel value of pixel (x, y) is 0, then this pixel (x, y) is non-marginal point, represents that this point is not positioned at pretreated image
In the edge on;
(3-2) with among the edge image E, be set to 0 with the pixel value of marginal point on the edge that the borderline phase of edge image E is connected, be about to this part point and be classified as non-marginal point, obtain pretreated edge image
(3-3) definition one wide be W1 pixel, the height be the structural element of H1 pixel, to above-mentioned pretreated edge image
Carry out closing operation of mathematical morphology, obtain the edge image E after the closed operation
1, having chosen wide in one embodiment of the present of invention is that 30 pixels, height are that the structural element of 1 pixel carries out closed operation;
Expand first in the morphology operations, after the process of corroding, be called closing operation of mathematical morphology, expansion algorithm is as follows:
With a certain specific structural element, each pixel of scan image, bianry image with structural element and its covering is done AND-operation, if all AND-operation results are 0, then this pixel pixel value of computing output image is 0, otherwise this pixel pixel value of computing output image is 1;
Erosion algorithm is as follows:
With a certain specific structural element, each pixel of scan image, bianry image with structural element and its covering is done AND-operation, if all AND-operation results are 1, then this pixel pixel value of computing output image is 1, otherwise this pixel pixel value of computing output image is 0;
Edge image E expands first, finishes the closed operation of edge image after corroding again, obtains closed operation output edge image E
1
(3-4) one of definition is wide be that W2 pixel, height are the structural element of H2 pixel, and edge image E is exported in closed operation
1Carry out the morphology opening operation, obtain the edge image E behind the opening operation
2, chosen the structural element of wide 30 pixels, high 1 pixel in one embodiment of the present of invention, to closed operation output edge image E
1Carry out the morphology opening operation, corrode first in the morphology operations, after the process that expands, be called the morphology opening operation;
The set that the pixel that (3-5) is communicated with in the definition image forms is connected region, according to the edge image E behind the opening operation
2In all pixel values be the connectedness of 1 pixel, to the edge image E behind the opening operation
2In all pixel values be that 1 pixel is divided, the connected region that the pixel that obtains being communicated with forms makes edge image E
2In each pixel value be that 1 pixel is corresponding with a connected region;
(3-6) each connected region is judged that obtain the set of the corresponding connected region of all car plates to be identified, determining step is as follows:
(3-6-1) from the connected region of step (3-5), get a connected region A who did not judge and judge, if all connected regions in the connected region of step (3-5) all were judged, then carry out step (3-6-5);
The ratio of width to height of the connected region that (3-6-2) the setting car plate is corresponding is 3~5.5, the ratio of width to height of the bounding box of connected region A is compared with the ratio of width to height of setting license plate area, if the ratio of width to height of the bounding box of connected region A is greater than the upper limit of the ratio of width to height of setting license plate area, or the ratio of width to height of the bounding box of connected region A is less than the lower limit of the ratio of width to height of setting license plate area, judge that then connected region A is not the connected region corresponding with car plate, and carry out step (3-6-1);
If the ratio of width to height of the bounding box of connected region A is less than or equal to the upper limit of the ratio of width to height of setting license plate area, or the ratio of width to height of the bounding box of connected region A is more than or equal to the lower limit of the ratio of width to height of setting license plate area, then judge connected region A as drafting connected region corresponding to car plate, and carry out step (3-6-3);
(3-6-3) from pretreated image
In, take out a gray level image that the pixel in the bounding box with connected region A is corresponding
Adopt adaptive threshold, with gray level image
Binaryzation obtains the bianry image B corresponding with the pixel in bounding box connected region A after the binaryzation
ASet the in the horizontal direction frequency threshold value that replaces of black and white of a connected region corresponding with car plate, because the domestic number-plate number is 7, the black and white alternate frequency should be above 14 times in the horizontal direction for interior bianry image corresponding to pixel of the connected region bounding box scope that car plate is corresponding, so this threshold value is set to 14 in this experiment, if bianry image B
AThe number of times that replaces of black and white is judged that then connected region A is not connected region corresponding to car plate, and is carried out step (3-6-1), if bianry image B less than frequency threshold value in the horizontal direction
AThe number of times that replaces of black and white is judged that then connected region A drafts connected region corresponding to car plate, and is carried out step (3-6-4) more than or equal to frequency threshold value in the horizontal direction;
(3-6-4) calculate bianry image B
AInterior pixel value is that 1 pixel number accounts for bianry image B
AInterior all pixel number purpose ratio α, if α is not between 0.3~0.4, judge that then connected region A is not connected region corresponding to car plate, if α is between 0.3~0.4, judge that then connected region A is connected region corresponding to car plate, get back to step (3-6-1), carry out the judgement of next connected region;
The set of (3-6-5) establishing connected region corresponding to all car plates is { A
i(i=1,2 .., N), wherein A
iBe i the connected region that car plate is corresponding, in order from the set { A of connected region
iThe middle taking-up connected region A corresponding with each car plate
iBounding box, to the pixel in the bounding box at pretreated image
The pixel of interior correspondence carries out binary conversion treatment, obtains a pixel set P
i, note pixel set P
iBe license plate area, thereby the set that obtains all license plate areas is { P
i(i=1,2 .., N), wherein P
iBe i license plate area;
(4) to above-mentioned license plate area P
iBe rotated and correct and the processing of trimming edge the license plate area after obtaining processing
Prepare for follow-up separating character and identification, concrete steps are as follows:
(4-1) utilize edge detection operator, from license plate area P
iMiddle extraction and license plate area P
iCorresponding binary edge map E
Pi, calculate binary edge map E
PiDraw the winter (Radon) conversion, from the matrix that conversion obtains, obtain the matrix peak value, the angle θ corresponding with the matrix peak value is license plate area P
iAnglec of rotation θ, according to the anglec of rotation θ of car plate to license plate area P
iIn all pixels carry out reverse rotation θ angle, rotated roughly the license plate area P after the rectification
I1
(4-2) remove license plate area P
I1In the constant band of pixel value of boundary pixel up and down, remove whereby the car plate edge, license plate area is tightened the license plate area P that is tentatively tightened
I2
The license plate area P that (4-3) will tentatively tighten
I2In the pixel value of every delegation pixel sue for peace, the pixel value sum of establishing the capable pixel of m is S
m, by sequence number m inferior ordered pair S from small to large
mSort, obtain S
mFirst maximum value S
M0, establish and S
M0Corresponding line number is m
0, to the license plate area P of above-mentioned preliminary deflation
I2In the 1st~m
0Pixel value is that 1 pixel carries out fitting of a polynomial one time in the row, the license plate area P that is tentatively tightened according to polynomial slope k once
I2The pitch angle
According to the pitch angle
License plate area P to preliminary deflation
I2Interior all pixels carry out reverse rotation, obtain the license plate area P after meticulous rotation is corrected
I3
(4-4) remove license plate area P
I3In the constant band of up and down boundary pixel pixel value, further remove whereby the car plate edge, license plate area is further tightened, obtain the license plate area P that secondary tightens
I4
(4-5) utilize interpolation method, to the license plate area P of secondary deflation
I4Carry out proportional zoom, so that license plate area is high for setting for example 30 pixels of number pixel H(), obtain a license plate area after the processing behind the proportional zoom
(5) adopt vertical projection method, to the license plate area after the above-mentioned processing
Carry out Character segmentation and process the license plate area after the computing
Two-value perspective view in vertical direction, and searching trough point, from the trough point whole car plate is carried out Character segmentation, obtain 7 character blocks, remove in each character block the up and down constant band of the pixel value of boundary pixel, character block after obtaining tightening, and the character block after will tightening utilizes interpolation method to zoom to
Namely wide
Individual pixel, a high H pixel obtains character block to be identified, the H value is 30 in one embodiment of the present of invention, because external factor is a bit smudgy clear the time, the better effects if of this method is so this dividing method can effectively be resisted certain mal-condition when car plate;
(6) template matching method of employing enhanced edition carries out character recognition to above-mentioned character block to be identified, and the implementation step is as follows:
(6-1) from above-mentioned character block to be identified, get a character block C to be identified
Ij, the character block C that this is to be identified
IjBe divided into four zones, the pixel in each piece zone is lined up a column vector, and four column vectors corresponding with four zones are got up in succession, consist of this character block C to be identified
IjProper vector
(6-2) gather the car plate samples pictures, to each character that may occur in the car plate, from samples pictures, manually mark the respective symbols piece, and with the character block size scaling
Carry out proper vector according to the method in the step (6-1) and extract, the proper vector of all characters is saved as a dictionary D, each proper vector is a base among the dictionary D;
(6-3) adopt iteration threshold to select projection algorithm (Iterative Threshold-Selective Projection algorithm), find the solution above-mentioned C
IjProper vector
The most sparse solution vector under dictionary D
Solution vector
Each component ω
Ij-kExpression C
IjProper vector
K base in dictionary D
Weight;
(6-4) calculate under the two norm meanings each base among the dictionary D
By with
Corresponding weights omega
Ij-kCarry out vector and C behind the proportional zoom
IjProper vector
Between apart from d
Ij-k, establish apart from d
Ij-kIn minor increment be d
Ij-k0, with this minor increment d
Ij-k0Base among the corresponding dictionary D is
Corresponding character is character block C to be identified
IjRepresented character relatively is difficult to the character range distinguished when recognition result falls into some, during such as O, D, G, needs to adopt the geometric properties of kinds of characters further to distinguish, because C in the method
IjProper vector
The most sparse solution vector under dictionary D
Has sparse property, so do not need to calculate C
IjProper vector
The distance of all bases in the dictionary D, thereby effective boosting algorithm speed, and to each base
Press ω
Ij-kCarry out proportional zoom, in the situation of boosting algorithm complexity not, also effectively raise recognition accuracy;
(6-5) repeating step (6-1)-(6-4) is until the license plate area after processing
In all character blocks to be identified all identify complete;
(7) repeating step (4)-(6) are until the set { P of license plate area
iAll license plate areas all are disposed in (i=1,2 .., N), the output recognition result.