|Publication number||US4334241 A|
|Application number||US 06/140,415|
|Publication date||Jun 8, 1982|
|Filing date||Apr 14, 1980|
|Priority date||Apr 16, 1979|
|Also published as||DE3014629A1, DE3014629C2|
|Publication number||06140415, 140415, US 4334241 A, US 4334241A, US-A-4334241, US4334241 A, US4334241A|
|Inventors||Seiji Kashioka, Yoshihiro Shima, Takafumi Miyatake|
|Original Assignee||Hitachi, Ltd.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (4), Referenced by (101), Classifications (16), Legal Events (1)|
|External Links: USPTO, USPTO Assignment, Espacenet|
(1) Field of the Invention
This invention relates to a pattern position detecting system, and more particularly to a pattern position detecting system which automatically and speedily detects the position of a specified pattern existent on the surface of an object body by utilizing an imaging device.
(2) Description of the Prior Art
Systems wherein a certain target pattern is sampled from among images picked up by an imaging device such as television camera, in a manner to be distinguished from other patterns and a background pattern and has its position within a two-dimensional image obtained, have been already proposed in Japanese Patent Application Publication No. 52-14112 (U.S. Pat. No. 3,898,617) and Japanese Published Unexamined Patent Application No. 52-91331. These systems find the specified position of an object in such a way that a local pattern of an object surface is stored as a standard pattern in advance, that the standard pattern and partial patterns cut out in various positions within the image as fed by the imaging device are successively compared, and that positional coordinates typical of the partial pattern which best coincide are sampled. These systems are applied to, for example, the position detection of a semiconductor pellet when the wire bonding between bonding pads formed on the semiconductor pellet and lead fingers is automatically carried out.
In the prior-art systems, however, the target pattern is identified by finding the position of the pattern best coincident with the standard pattern within the image, so that only a pattern having an inherent feature which is not included in the other patterns on the object can become the target pattern. Accordingly, in case where a pattern having such an inherent feature does not exist on the object or where the pattern having the inherent feature exists only in a position which is inconvenient for grasping the positional deviation or rotational deviation of the object, the prior-art systems cannot achieve the expected purpose and their ranges of applications have been limited.
For example, when a part of a digitated electrode of a high power transistor having cyclic patterns or one of a plurality of electrodes or bonding pads in the same shape as formed in the edges of a chip of an IC (integrated circuit) or an LSI (large scale integration) is intended to have its position detected as the target pattern, the electrode part to be made the detection target needs to be put into a special shape at the stage of the design of the electrode pattern in order to apply either of the prior-art systems.
An object of this invention is to provide a pattern position detecting system which can reliably identify a target pattern even in case where a plurality of patterns having the same feature as that of the target pattern to be detected exists on an object.
In order to accomplish the object, according to this invention, positional coordinates are detected for all patterns which lie in a pattern search area and which have the same feature as that of a target pattern, and from among the detected positional coordinates, positional coordinates which satisfy an inherent positional relationship lying between the target pattern and another pattern on an object are sampled, whereby the position of the target pattern is identified.
More precisely, the pattern position detecting system according to this invention is characterized by comprising imaging means to pick up an image of an object which includes a target pattern to-be-detected, first means to successively cut out local patterns of an image surface on the basis of image signals delivered from said imaging means, second means to generate positional coordinates which indicate typical positions of the respective local patterns cut out, third means to compare the respective local patterns with a standard pattern having the same feature as that of the target pattern and to obtain degrees of coincidence, fourth means to compare the degree of coincidence with the degrees of coincidence of the other local patterns in the vicinity of the particular local pattern so as to successively sample the local patterns whose degrees of coincidence become the maximum, said fourth means storing the positional coordinates and degrees of coincidence of the respective local patterns, and fifth means to sample positional coordinates fulfilling a positional relationship inherent to the target pattern from among the positional coordinates finally left in said fourth means, the sampled positional coordinates being identified as indicating a position of said target pattern.
The foregoing and other objects, advantages, manner of operation and novel features of the present invention will be understood from the following detailed description when read in connection with the accompanying drawings.
FIGS. 1(a) and 1(b) are diagrams showing patterns on an object and a standard pattern for explaining the principle of this invention,
FIG. 2 is a diagram for explaining an example of a method of storing the positional coordinates of a plurality of patterns coincident with a standard pattern in this invention,
FIG. 3 is a diagram showing another example of an object for position detection,
FIGS. 4a and 4b and FIGS. 5a and 5b are diagrams of pattern states in pattern search areas 12A and 12B at the time when the object has undergone positional deviations,
FIG. 6 is a general arrangement diagram of a pattern position detecting system showing an embodiment of this invention,
FIG. 7 is a detailed arrangement diagram of a search area dividing circuit 50 in the system of FIG. 6,
FIGS. 8a to 8c and FIGS. 9a to 9c are diagrams for explaining further embodiments of this invention each employing a plurality of sorts of standard patterns.
First of all, the principle of this invention will be described.
By way of example, FIG. 1(a) shows an object 10 which includes a plurality of patterns 2a-2i having the same shape. Assuming here that the pattern 2b is a target to-be-detected, a standard or reference pattern as shown in FIG. 1(b) having the same feature as that of the target pattern 2b is prepared in advance. Partial patterns 3 each having the same size as that of the standard pattern are cut out or segmented from the image of the object successively in accordance with the scanning of the picture surface. The respective partial patterns are compared with the standard pattern, and the positional coordinates of the partial patterns at the times when they have coincided are stored in succession.
Each of the partial patterns and the standard pattern consists of a plurality of picture elements. Which of the picture elements is used to represent the positional coordinates of the partial pattern is arbitrary. Supposing that the positional coordinates of the partial pattern are represented by a picture element (illustrated by a black dot in the drawing, and hereinafter called "typical point") at the right lower corner of the partial pattern, then the positional coordinates of typical points 4a-4i can be obtained by the above processing.
The target pattern 2b has, with respect to e.g. the patterns 2e and 2f, such a positional relationship that they occupy the respective apices of a triangle indicated by broken lines. This positional relationship is a relationship which is peculiar to the above set of patterns and which does not exist among the other patterns on the object. Regarding such a positional relationship peculiar to the target pattern 2b, note may well be taken of a triangle which is formed among it and other patterns than the aforecited ones 2e and 2f, for example, the patterns 2h and 2i or the patterns 2h and 2g.
In this invention, one set of typical points fulfilling the foregoing positional relationship peculiar to the target pattern are sought out from among the plurality of typical points stored as the points coincident with the standard pattern, and the target pattern is identified on the basis of the relative positional relationship among the respective typical points in this set.
In the pattern recognition employing an imaging device, a pattern actually picked up is difficult to perfectly coincide with the standard pattern on account of various fluctuating factors even when it is the true target pattern. Therefore, a certain extent of error cannot help being permitted for the result of the comparison between the partial pattern and the standard pattern. In this case, when a system is adopted wherein all the partial patterns whose degrees of coincidence with the standard pattern are at least a predetermined value have their positional coordinates stored, the positional coordinates of the large number of partial patterns which are cut out around and from near a partial pattern position indicative of the highest degree of coincidence are stored in a memory, and the memory needs to have a large storage capacity. In addition, it is necessary in this system that, from among a group of coordinate data, the positional coordinates of the highest degree of coincidence as lie in the center thereof are sampled, and that the data are properly arranged so that a single coordinate position may remain for one pattern on the object.
In order to eliminate such inconveniences, according to this invention, only when the degree of coincidence between a local pattern and a standard pattern has become a maximum value in the vicinity of the particular local pattern, the positional coordinates of the local pattern are sampled.
In order to sample the coordinates at the maximum point of the degree of coincidence between the local pattern and the standard pattern, there may be adopted, for example, a measure wherein the search area of a pattern is divided into a plurality of sections (n1 sections in a Y-direction and n2 sections in an X-direction), and the positional coordinates of partial patterns whose degrees of coincidence with the standard pattern are evaluated for the respective sections so as to sample the partial patterns whose degrees of coincidence are at least a predetermined value.
FIG. 2 shows an example in which the imaged picture surface of the object 10 shown in FIG. 1 is divided into 5×6 sections. The size (d1 in height and d2 in width) of each section is determined by the dimensions and positional relationships of patterns having the same feature as that of the target pattern which is expected to exist in the search area. By way of example, as illustrated in the figure, the dimensions d1 and d2 of the section are set so as to hold:
d1 <w1 cos θ
d2 <w2 cos θ
where w1 denotes the interval between the respective typical points 4c and 4f of the patterns being the closest in the vertical direction on the object, w2 denotes the interval between the respective typical points 4f and 4g of the patterns being the closest in the horizontal direction, and θ denotes the maximum allowable angle of rotational deviations of the object supplied into the imaging field of view. Thus, even when the object involves a positional deviation or rotational deviation, the typical points of all the patterns to be detected can be received in any sections one by one in such a manner that two or more points are never included in one section. Accordingly, when a partial pattern which exhibits the maximum degree of coincidence with the standard pattern is sampled from among partial patterns which are successively cut out and whose typical points belong to the same section, any failure to detect the position of a pattern does not occur. In FIG. 2, to the end of clarifying the contrast with the object 10 in FIG. 1, the partial pattern 3 is illustrated in the state in which it inclines relative to the imaged picture surface. However, the actual cut-out position of the partial pattern from the imaged picture surface extends along the X- and Y-axes as indicated at 3'.
The foregoing is the example wherein the whole object is imaged within one field of view and wherein one set of positional coordinates lying in the positional relationship inherent to the target pattern are sampled from among the positional coordinates detected within the identical field of view. This invention, however, is also applicable to a case where as will be stated hereunder, parts of an object are enlarged and imaged and then one set of positional coordinates lying in a positional relationship inherent to a target pattern are found among positional coordinates detected in the individual fields of view.
As an example thereof, FIG. 3 shows a semiconductor pellet 10 in which pads A1 -An and B1 -Bn are regularly formed on both sides of a circuit element forming region 11. In the semiconductor pellet, by way of example, the two pads A1 and B1 which are at the longest distance l are used as target patterns, and pattern search areas 12A and 12B are set in positions which include the respective pads at substantially central parts thereof. Let it be supposed to first enlarge and pick up the image of the search area 12A and to subsequently move the imaging field of view a predetermined distance and pick up the image of the search area 12B. Then, in case where, by way of example, the pellet 10 has undergone a positional deviation rightwards a component of one pad from the position of FIG. 3, patterns as shown in FIGS. 4a and 4b are picked up in the search areas 12A and 12B respectively. On the other hand, when the pellet 10 has undergone a positional deviation leftwards a component of one pad, patterns within the respective search areas become as shown in FIGS. 5a and 5b.
Referring to these figures, the patterns having the same feature appear in the respective search areas in numbers which differ each time in accordance with the positional deviations of the object, and hence, the target pads A1 and B1 cannot be identified in the individual areas. When it is determined that the leftmost pattern is the target pad in the search area 12A while the rightmost pattern in the search area 12B, an erroneous recognition is feared when a noise pattern is involved. However, if one set of positional coordinates lying in the positional relationship of the distance l are sampled among the positional coordinates of the pads included in the search areas 12A and 12B, those of the search area 12A in the set of positional coordinates can be identified to correspond to the pad A1 and those of the search area 12B to correspond to the pad B1.
Hereunder, an embodiment of a pattern position detecting system according to this invention will be described.
FIG. 6 is a block diagram showing the general construction of the pattern position detecting system. Numeral 40 designates an imaging device, for example, television camera, and numeral 41 a clock generator. A clock signal 41s which is delivered from the clock generator 41 is applied to an X-Y coordinate counter 42. The X-Y coordinate counter 42 consists of an X-abscissa counter which counts the clock signal pulses 41s to obtain the abscissa of an imaged picture surface, and a Y-ordinate counter which counts carry signal pulses 42c of the X-abscissa counter to obtain the ordinate of the imaged picture surface. Numeral 43 indicates a synchronizing signal generator, which generates a synchronizing signal 43s necessary for the picture surface scanning of the imaging device 40 on the basis of the count values of the X-Y coordinate counter 42.
The imaging device 40 raster-scans the image surface in synchronism with the synchronizing signal 43s and provides an image signal 40s. The image signal 40s is converted by a threshold circuit 44 into a binary signal 44s indicating whether the image of a picture element is "white" or "black", the binary signal being supplied to an image memory 45.
As the image memory 45 and a partial pattern cutting-out or segmenting circuit indicated by symbol 46, circuits of the type disclosed in the specification of Japanese Patent Application Publication No. 52-14112 (U.S. Pat. No. 3,898,617) are applicable.
More specifically, the image memory 45 is composed of (n-1) shift registers which are connected in series with one another and which serve to temporarily store binary-coded picture information corresponding to (n-1) scanning lines. Output signals of these registers and the binary signals 44s correspond to n picture elements lying in the positional relationship in which they are arrayed in the vertical direction on the imaged picture surface. Accordingly, when the signals of the n picture elements are fetched in parallel from the image memory 45, they are led to the partial pattern cutting-out circuit 46 composed of n shift registers each having a length of n bits, and they are fetched as parallel information of (n×n) bits, then the partial patterns of the (n×n) picture elements corresponding to the scanning positions of the image are successively taken out.
Numeral 47 designates a register for holding a reference or standard pattern which is made up of information of (n×n) picture elements to be compared with the partial patterns. The content of this register and the output of the partial pattern cutting-out circuit 46 are compared and checked up at the respectively corresponding bits by means of a judging or decision circuit 48. The total number of bits whose contents coincide is delivered from the decision circuit 48 as a signal 48s indicative of the degree of coincidence between the partial pattern and the standard pattern. Since the circuits 45, 46 and 48 operate in synchronism with the clock signal 41s, the coincidence signals 48s are successively provided in parallel with the scanning of the image surface.
Shown at 50 is a search area dividing circuit (the concrete construction of which will be described with reference to FIG. 7). It operates in synchronism with the clock signal 41s, and it decides whether or not the present scanning point falls within a search area, on the basis of the carry signal 42c of the X-counter and an X-Y coordinate signal 49 (49X, 49Y) as are provided from the X-Y coordinate counter 42. If the present scanning point lies in the search area, a coincidence comparison instruction signal 51 is provided. In addition, this circuit divides the search area into a plurality of sections and generates an address signal 52 (52X, 52Y) indicating which section the scanning point belongs to. The address signal 52 is applied to a coincidence memory 56 and a coordinate memory 57 through an address switching circuit 55.
The coincidence memory 56 has memory areas corresponding to the address signals 52, and can store the maximum degrees of coincidence between the partial pattern and the standard pattern up to the present time for the respective sections corresponding to the addresses in the search area. More specifically, the contents of the addressed memory areas of the memory 56 are read out as signals 56s, and they are applied to a comparator 59 together with the coincidence signals 48s delivered from the circuit 48 in succession. The comparator 59 provides a pulse signal 59s when the degree of coincidence 48s obtained anew is greater. The pulse signal 59s is applied to an AND gate 54 which is enabled or disabled by the coincidence comparison instruction signal 51. It is delivered from the AND gate 54 during only the output period of the comparison instruction signal 51, and becomes a pulse 54s permitting the memories 56 and 57 to update data. In response to the pulse signal 54s, accordingly, the coincidence memory 56 can store the new degree of coincidence given by the signal 48s in the memory area corresponding to the address signal 52.
On the other hand, the coordinate memory 57 has coordinate memory areas corresponding to the address signals 52 similar to the coincidence memory 56. When the coordinate memory has been given the pulse signal 54s, it stores the coordinate data 49 delivered from the X-Y coordinate counter 42 in the addressed memory area thereof.
The scanning of the picture surface is performed repeatedly in the X-direction while shifting positions in the Y-direction, so that the addresses of the sections within the search area change successively in accordance with the picture surface scanning. At the time when the scanning of one picture surface has ended, the maximum degree of coincidence between the standard pattern and the partial pattern and the positional coordinates of the partial pattern concerning all the sections are stored in the memories 56 and 57.
Shown at 60 is a controller, which is a device having the functions of the input/output, sequence control and numerical control of information and the decision of data, for example, an electronic computer. Upon receiving an external start signal 61A, the controller 60 starts control operations in conformity with a procedure programmed in advance. First, a necessary standard pattern 62 is sent into the register 47, and parameters such as the dimensions d1 and d2 of the section, the numbers of divisions n1 and n2 and the coordinates Xs and Ys of the starting point of the search area are sent into the search area dividing circuit 50 through a signal line 63. Clear signals 64 and 65 are respectively applied to the coincidence memory 56 and the coordinate memory 57 so as to clear the contents of the memories, whereupon a switching signal 66 is delivered so as to permit the address switching circuit 55 to provide an address from the search area dividing circuit 50.
When these pre-processing operations have ended, the control circuit 60 supplies the search area dividing circuit 50 with a start instruction signal 67 for a pattern detecting operation. Upon receiving the instruction signal 67, the search area dividing circuit 50 starts the operation for detecting a pattern at the timing at which the picture surface scanning of the imaging device 40 has returned to the initial position. When the scanning of one picture surface has ended, the circuit 50 provides an end signal 53 to inform the controller of the end of the pattern detecting operation.
Upon receiving the end signal 53, the controller 60 provides the switching signal 66 to establish the state in which the address switching circuit 55 can access the memories 56 and 57 by the use of an address signal 68 provided from the controller. Thus, the controller 60 successively reads out the degrees of coincidence of the respective sections stored in the coincidence memory 56 and decides whether or not they are at least a predetermined value. If they are at least the predetermined value, coordinate values are read out from the coordinate memory 57 and are written into a memory 69 on the controller side.
In case where pattern search areas have been set in separate imaging fields of view on the object, the following measure may be taken. That is, positional coordinate data detected in the first search area is written into a first search area data-area of the memory 69, after which the controller 60 provides a control signal 61B for moving the imaging field of view to the second search area. Then, the foregoing operation is repeated to cause the search area dividing circuit 50 to execute the pattern detecting operation in the second search area, and coordinate data is read out from the coordinate memory and written into a second search area data-area of the memory 69. In case where three search areas have been set on the object, operations similar to the above are repeated on a third search area.
When the coordinate data sampling processing thus far described has ended, the controller 60 sequentially checks the relative positional relationships of the coordinates within the memory 69, finds out one set of coordinates satisfying a predetermined positional relationship and identifies them as the positional coordinates of the target pattern. In case of adopting the form in which the imaging field of view is moved thereby to switch one search area to another search area, the positional coordinates of patterns obtained in the respective search areas are values with their origins being the scanning starting points of the respective imaging fields of view, and hence, the coordinate values in the second and third search areas need to be corrected in accordance with the amounts of movements of the fields of view. The corrections of these coordinate values may be made either at the time of moving the data from the coordinate memory 57 to the memory 69 or at the stage of deciding the relative positional relationships among the coordinates.
In deciding the relative positional relationships among the coordinates, by way of example, first coordinates are selected from the first search area, and the distances between them and the respective coordinates of the second search area are successively calculated, thereby to find out one set of coordinates having the predetermined distance l. If such set is not found out, there may be repeated the procedure in which the next coordinates are selected from the first search area and the relations with the respective coordinates of the second search area are decided with reference to the selected coordinates. In case where the third search area has been set, only the set lying in the predetermined positional relationship in the first and second search areas has the relation with the coordinates of the third search area confirmed.
In case where the object is supplied to the imaging field of view at high positional accuracy and where the sampling order of the coordinates corresponding to the target patterns among the coordinates to be sampled in the respective search areas is substantially fixed, the processing time of data can be shortened by setting a procedure so that these coordinates may be firstly subjected to the decision of the relative positional relationship and that when the predetermined positional relationship is not met, the other coordinates may be decided.
If the positions of two fixed points on the object have been known, the magnitude of deviation from the standard position of the object can be calculated at 150, and the actual position of another fixed point previously known in a standard coordinate system can be evaluated by a coordinate transformation at 152. Accordingly, in case where the controller 60 is employed for controlling a wire bonding equipment for a semiconductor pellet, it is possible to calculate the magnitude of the positional deviation of the semiconductor pellet and the actual positions of respective pads to-be-bonded from the positional coordinates of the two target patterns and to control the amount of movement of an X-Y table for a capillary on the basis of the calculated results as at 154.
The concrete arrangement of the search area dividing circuit 50 will be explained with reference to FIG. 7.
This circuitry consists of an X-address control portion and a Y-address control portion. 70X and 70Y indicate registers for holding the coordinates Xs and Ys of the start point of the search, respectively, 71X and 71Y indicate registers for holding the X-directional and Y-directional dimensions d2 and d1 of one divided section, respectively, and 72X and 72Y indicate registers for holding the numbers n2 and n1 of the sections in the X-direction and Y-direction, respectively. The parameters to be held in these registers are sent in from the controller 60 through the signal line 63. 73X, 73Y, 74X, 74Y, 75X and 75Y indicate coincidence detector circuits, 76X, 76Y, 77X and 77Y indicate counters, 78X, 78Y and 79 indicate flip-flops, 80X, 80Y, 81 and 84 indicate AND gates, and 82X, 82Y, 83X and 83Y indicate OR gates, respectively.
First, the operation of the X-address control portion will be described. The coincidence detector circuit 73X compares the X-abscissa 49X of the scanning point delivered from the coordinate counter 42 and the abscissa Xs of the search starting point held in the register 70X, and provides a pulse signal 90X upon coincidence. This pulse signal 90X sets the flip-flop 78X, and also resets the values of the counters 76X and 77X into zero through the OR gates 82X and 83X respectively. When the flip-flop 78X has become the set state, its output enables the AND gate 80X, and the fundamental clocks 41s are successively applied to the counter 76X, so that the counting operation is conducted.
The coincidence detector circuit 74X provides a pulse signal 91X when the value of the counter 76X has coincided with the lateral width d2 of one divided section held in the register 71X. This pulse signal 91X is applied to the counter 77X to increment the count value by one, and is also applied to the reset terminal of the counter 76X through the OR gate 82X. Accordingly, the counter 76X repeats the counting operation every count value equal to the lateral width of the divided section, and it increments the value of the counter 77X each time the scanning point shifts from one section to the next section in the X-direction. The content of the counter 77X becomes a value indicating which section in the lateral direction the scanning is being performed in, and this value is provided as the signal 52X indicating the X-address of the section.
The coincidence detector circuit 75X compares the value of the counter 77X and the appointed X-directional number n2 of the section held in the register 72X, and provides a pulse signal 92X upon coincidence. The pulse signal 92X is applied through the OR gate 83X to the reset terminal of the counter 77X so as to return the value of the counter, and also resets the flip-flop 78X so as to disable the AND gate 80X and to block the entry of the fundamental clocks 41s. Since these operations are repeated every horizontal scanning line, the signals 52X indicative of the X-addresses of the divided sections within the search area are repeatedly provided.
Subsequently, the Y-address control portion will be described. In the Y-address control portion, when the instruction signal 67 for starting the detecting operation has been delivered from the controller 60, the flip-flop 79 is set and the AND gate 84 is enabled. The coincidence detector circuit 73Y compares the Y-ordinate 49Y of the scanning point provided from the coordinate counter 42 and the ordinate Ys of the search starting point held in the register 70Y, and provides a pulse signal 90Y upon coincidence. This pulse signal 90Y resets the counters 76Y and 77Y through the OR gates 82Y and 83Y respectively, and if the AND gate 84 is enabled, the signal sets the flip-flop 78Y therethrough. Thus, the AND gate 80Y is enabled, and the carry signals 42c provided from the coordinate counter 42 at the respective horizontal scanning lines are successively applied to the counter 76Y, so that the counting operation is conducted.
The coincidence detector circuit 74Y provides a pulse signal 91Y when the value of the counter 76Y has coincided with the vertical width d1 of one divided section held in the register 71Y. This pulse signal is applied to the counter 77Y to increment the count value by one, and is also applied through the OR gate 82Y to the reset terminal of the counter 76Y to reset the value thereof. Accordingly, the counter 76Y repeats the counting operations with the periods being the count values equal to the vertical width of the divided section, and it causes the counter 77Y to perform the counting operation each time the scanning point has shifted from one section to the next section in the Y-direction. The content of the counter 77Y becomes a value indicating which section in the vertical direction the scanning is being executed in, and this value is provided as the signal 52Y indicative of the Y-address of the section. The signal 52Y is given to the coincidence memory 56 and the coordinate memory 57 shown in FIG. 6, together with the signal 52X indicative of the X-address.
The coincidence detector circuit 75Y compares the value of the counter 77Y and the appointed vertical number n1 of the section held in the register 72Y, and provides a pulse signal 92Y upon coincidence. This pulse signal 92Y resets the counter 77Y through the OR gate 83Y, and simultaneously resets the flip-flops 78Y and 79. In addition, the pulse signal is sent to the control circuit 60 as the end signal 53 of the pattern detecting processing as appointed.
Since the flip-flop 78Y is in the "on" state for just one scanning period of the search area, the coincidence comparison instruction signal 51 is obtained by deriving from the AND gate 81 the AND output between an output signal 93 of the flip-flop 78Y and an output signal 94 of the AND gate 80X of the X-address control portion.
In the foregoing embodiment, it has been explained that the comparisons with the partial patterns are made by the use of the single standard pattern in order to detect the target pattern. In the pattern position detecting system according to this invention, however, a high degree of pattern recognition can be carried out by preparing a plurality of sorts of standard patterns.
By way of example, the standard pattern to be sent from the controller 60 to the register 47 is changed, whereby a target pattern having a different feature can be detected from the object. FIGS. 8a to 8c show an example thereof. By employing a standard pattern 100 shown in FIG. 8b in the first picture surface scanning, the positional coordinates of patterns 21a-21e on an object 20 shown in FIG. 8a can be sampled, and by employing a standard pattern 101 in FIG. 8c in the next picture surface scanning, the positional coordinates of patterns 22a-22e can be detected. In this way, a target pattern position which lies in an inherent positional relationship between the patterns having different features can be detected.
In case where the deviation of the object in the rotational direction has exceeded a certain limit, a target pattern really existing in a search area fails to be detected when the threshold value for the decision of the degree of coincidence is made severe because the degree of coincidence is insufficient with a comparison with a standard pattern in its normal position. Also in such case, the recognizing capability can be enhanced in the way that a plurality of sorts of standard patterns corresponding to the inclinations of the object are prepared in advance and that when the target pattern cannot be detected with the first standard pattern, the remaining standard patterns are used for comparisons.
In case where a body 30 having minute patterns as shown in FIG. 9a is an object, the resolution can be enhanced by enlarging and imaging the vicinities of a target pattern 31a and patterns 31b and 31c which lie in inherent positional relationships with the target pattern. In this case, when it is intended to compare the whole target pattern with a standard pattern, large partial patterns need to be cut out. In such case, two kinds of small-sized standard patterns 102 and 103 corresponding to features of parts of the target pattern are prepared as shown by way of example in FIGS. 9b and 9c, the standard pattern 102 is employed in the first picture surface scanning so as to obtain the positional coordinates of patterns coincident therewith, the standard pattern 103 is employed in the next picture surface scanning thereby to obtain the positional coordinates of patterns coincident therewith, and coordinates forming pairs in the specified positional relationships are sampled, whereby the patterns 31a, 31b and 31c can be detected. When the divided sections of the search area when employing the standard pattern 102 and those when employing the standard pattern 103 are set in advance in a manner to shift within the imaging field of view in conformity with the specified positional relationships, a pair of positional coordinates 32a and 33a, 32b and 33b, or 32c and 33c to be detected from the same pattern on the object can be accommodated in the section of an identical address, and the decision of the positional relationship is facilitated.
Since the image information processing apparatus explained with reference to FIG. 6 can arbitrarily set the search areas of patterns within the single imaging field of view, it can sample patterns from search areas in positions differing for the respective picture surfaces while the field of view remains fixed, and it can change standard patterns on all occasions. Accordingly, in case where all the search areas set in the object fall within the identical field of view of the imaging device, positional coordinates from different search areas can be sampled merely by repeating the picture surface scannings, and the pattern positions can be detected in a short time.
As set forth above, according to this invention, even in case where a body surface which is formed with a plurality of patterns endowed with the same feature as that of a standard pattern is an object, the position of a target pattern can be reliably detected, and hence, no restriction is imposed on the shape or arrayal of the target pattern. Accordingly, this invention can be extensively applied to position recognition systems for semiconductor products and other various bodies.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4115805 *||May 23, 1975||Sep 19, 1978||Bausch & Lomb Incorporated||Image analysis indexing apparatus and methods|
|US4186412 *||Dec 7, 1977||Jan 29, 1980||Tokyo Shibaura Electric Co., Ltd.||Apparatus for detecting the position of fine object|
|US4208675 *||Mar 20, 1978||Jun 17, 1980||Agence Nationale De Valorization De La Recherche (Anvar)||Method and apparatus for positioning an object|
|US4281342 *||Mar 28, 1979||Jul 28, 1981||Hitachi, Ltd.||Mark detecting system using image pickup device|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US4441205 *||May 18, 1981||Apr 3, 1984||Kulicke & Soffa Industries, Inc.||Pattern recognition system|
|US4443855 *||May 6, 1981||Apr 17, 1984||Robert Bishop||Method of and apparatus for controlling robotic equipment with the aid of mask algorithm image processing techniques|
|US4450579 *||Jun 10, 1981||May 22, 1984||Fujitsu Limited||Recognition method and apparatus|
|US4475122 *||Nov 9, 1981||Oct 2, 1984||Tre Semiconductor Equipment Corporation||Automatic wafer alignment technique|
|US4490850 *||Dec 17, 1981||Dec 25, 1984||Ncr Corporation||Matrix character recognition|
|US4491962 *||Mar 23, 1982||Jan 1, 1985||Hitachi, Ltd.||Method of determining an optimum threshold for obtaining binary image signal for use in a pattern recognition system|
|US4547800 *||Mar 2, 1981||Oct 15, 1985||Unimation, Inc.||Position detecting method and apparatus|
|US4555726 *||Mar 5, 1984||Nov 26, 1985||The United States Of America As Represented By The Secretary Of The Navy||Video target track valid indicator|
|US4566125 *||Dec 8, 1982||Jan 21, 1986||Texas Instruments Incorporated||Apparatus and method for pattern location|
|US4581760 *||Sep 13, 1983||Apr 8, 1986||Fingermatrix, Inc.||Fingerprint verification method|
|US4618938 *||Feb 22, 1984||Oct 21, 1986||Kla Instruments Corporation||Method and apparatus for automatic wafer inspection|
|US4626992 *||May 21, 1984||Dec 2, 1986||Motion Analysis Systems, Inc.||Water quality early warning system|
|US4644584 *||May 16, 1983||Feb 17, 1987||Sumio Nagashima||Pattern position detecting apparatus|
|US4651341 *||Sep 13, 1983||Mar 17, 1987||Fujitsu Limited||Pattern recognition apparatus and a pattern recognition method|
|US4680627 *||Mar 12, 1986||Jul 14, 1987||Hitachi, Ltd.||Apparatus for checking patterns on printed circuit boards|
|US4701859 *||Oct 10, 1984||Oct 20, 1987||Fujitsu Limited||Inspecting method and apparatus for a photomask pattern|
|US4797751 *||Jun 16, 1986||Jan 10, 1989||Yamaguchi Cinema Corporation||Electronic camera apparatus for recording and reproducing moving object images|
|US4803644 *||Sep 20, 1985||Feb 7, 1989||Hughes Aircraft Company||Alignment mark detector for electron beam lithography|
|US4803735 *||Oct 9, 1986||Feb 7, 1989||Hitachi, Ltd.||Method and apparatus for calculating position and orientation by combination of features of partial shapes|
|US4814884 *||Oct 21, 1987||Mar 21, 1989||The United States Of America As Represented By The Secretary Of The Air Force||Window generator|
|US4849679 *||Dec 31, 1987||Jul 18, 1989||Westinghouse Electric Corp.||Image processing system for an optical seam tracker|
|US4908873 *||May 13, 1983||Mar 13, 1990||Philibert Alex C||Document reproduction security system|
|US4926489 *||Oct 5, 1987||May 15, 1990||Kla Instruments Corporation||Reticle inspection system|
|US4969199 *||Feb 27, 1987||Nov 6, 1990||Kabushiki Kaisha Toshiba||Apparatus for inspecting the molded case of an IC device|
|US5001574 *||Jun 23, 1988||Mar 19, 1991||Canon Kabushiki Kaisha||Image processing system|
|US5046109 *||Feb 1, 1990||Sep 3, 1991||Nikon Corporation||Pattern inspection apparatus|
|US5062714 *||Feb 12, 1990||Nov 5, 1991||X-Rite, Incorporated||Apparatus and method for pattern recognition|
|US5067162 *||Jun 30, 1986||Nov 19, 1991||Identix Incorporated||Method and apparatus for verifying identity using image correlation|
|US5086480 *||Oct 5, 1990||Feb 4, 1992||British Telecommunications Public Limited Company||Video image processing|
|US5119436 *||Sep 24, 1990||Jun 2, 1992||Kulicke And Soffa Industries, Inc||Method of centering bond positions|
|US5129014 *||Dec 8, 1989||Jul 7, 1992||Xerox Corporation||Image registration|
|US5137362 *||Mar 26, 1990||Aug 11, 1992||Motorola, Inc.||Automatic package inspection method|
|US5226095 *||May 26, 1992||Jul 6, 1993||Matsushita Electric Industrial Co., Ltd.||Method of detecting the position of an object pattern in an image|
|US5259038 *||Oct 10, 1990||Nov 2, 1993||Hatachi, Ltd.||Point pattern matching method and system as well as picture recognizing method and system using the same|
|US5402504 *||Aug 28, 1991||Mar 28, 1995||Xerox Corporation||Segmentation of text styles|
|US5495535 *||Jan 28, 1993||Feb 27, 1996||Orbotech Ltd||Method of inspecting articles|
|US5570435 *||Dec 28, 1994||Oct 29, 1996||Xerox Corporation||Segmentation of text styles|
|US5649022 *||May 27, 1992||Jul 15, 1997||Hitachi, Ltd.||Pattern checking method and checking apparatus|
|US5956417 *||Feb 28, 1994||Sep 21, 1999||Sensor Adaptive Machines, Inc.||Robot vision using target holes, corners and other object features|
|US6044183 *||Jun 6, 1995||Mar 28, 2000||Laser Measurement International Inc.||Robot vision using target holes, corners and other object features|
|US6175640 *||Jan 23, 1998||Jan 16, 2001||Sony Corporation||Fingerprint comparing apparatus|
|US6317512 *||Nov 19, 1996||Nov 13, 2001||Hitachi, Ltd||Pattern checking method and checking apparatus|
|US6493470 *||Jun 19, 1996||Dec 10, 2002||Canon Kabushiki Kaisha||Image processing method and apparatus for detecting the tilt amount of input image data|
|US6643400 *||Mar 30, 2000||Nov 4, 2003||Minolta Co., Ltd.||Image processing apparatus and method for recognizing specific pattern and recording medium having image processing program recorded thereon|
|US6731801 *||Feb 21, 2003||May 4, 2004||Minolta Co., Ltd.||Image processing apparatus and method for recognizing specific pattern and recording medium having image processing program recorded thereon|
|US6788829 *||Mar 30, 2000||Sep 7, 2004||Minolta Co., Ltd.||Image processing apparatus and method for recognizing specific pattern and recording medium having image processing program recorded thereon|
|US6816755||May 24, 2002||Nov 9, 2004||Braintech Canada, Inc.||Method and apparatus for single camera 3D vision guided robotics|
|US6833865||Jul 29, 1999||Dec 21, 2004||Virage, Inc.||Embedded metadata engines in digital capture devices|
|US6877134||Jul 29, 1999||Apr 5, 2005||Virage, Inc.||Integrated data and real-time metadata capture system and method|
|US6920249||Sep 24, 2001||Jul 19, 2005||Leica Microsystems Semiconductor Gmbh||Method and measuring instrument for determining the position of an edge of a pattern element on a substrate|
|US7184573||Jan 4, 2006||Feb 27, 2007||Myport Technologies, Inc.||Apparatus for capturing information as a file and enhancing the file with embedded information|
|US7336814||Jul 14, 2005||Feb 26, 2008||Braintech Canada, Inc.||Method and apparatus for machine-vision|
|US7403224||Sep 10, 2004||Jul 22, 2008||Virage, Inc.||Embedded metadata engines in digital capture devices|
|US7711178||Oct 9, 2007||May 4, 2010||Hitachi, Ltd.||Pattern inspection method and its apparatus|
|US7769827||Aug 3, 2010||Virage, Inc.||Interactive video application hosting|
|US7778438||Jan 8, 2007||Aug 17, 2010||Myport Technologies, Inc.||Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval|
|US7778440||Feb 27, 2007||Aug 17, 2010||Myport Technologies, Inc.||Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval|
|US7817846 *||Oct 19, 2010||Samsung Techwin Co., Ltd.||Method of correcting bonding coordinates using reference bond pads|
|US7957583||Aug 2, 2007||Jun 7, 2011||Roboticvisiontech Llc||System and method of three-dimensional pose estimation|
|US7962948||Jun 14, 2011||Virage, Inc.||Video-enabled community building|
|US8068638||Aug 17, 2010||Nov 29, 2011||Myport Technologies, Inc.||Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval|
|US8090187||Mar 16, 2010||Jan 3, 2012||Hitachi, Ltd.||Pattern inspection method and its apparatus|
|US8095237||Aug 6, 2003||Jan 10, 2012||Roboticvisiontech Llc||Method and apparatus for single image 3D vision guided robotics|
|US8135169||Aug 16, 2010||Mar 13, 2012||Myport Technologies, Inc.||Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval|
|US8171509||May 1, 2012||Virage, Inc.||System and method for applying a database to video multimedia|
|US8387087||Feb 26, 2013||Virage, Inc.||System and method for applying a database to video multimedia|
|US8437535||May 7, 2013||Roboticvisiontech Llc||System and method of determining object pose|
|US8495694||May 12, 2011||Jul 23, 2013||Virage, Inc.||Video-enabled community building|
|US8509477||Mar 10, 2012||Aug 13, 2013||Myport Technologies, Inc.||Method for multi-media capture, transmission, conversion, metatags creation, storage and search retrieval|
|US8548978||Aug 21, 2007||Oct 1, 2013||Virage, Inc.||Network video guide and spidering|
|US8559699||Oct 10, 2008||Oct 15, 2013||Roboticvisiontech Llc||Methods and apparatus to facilitate operations in image based systems|
|US8687841||Nov 29, 2011||Apr 1, 2014||Myport Technologies, Inc.||Apparatus and method for embedding searchable information into a file, encryption, transmission, storage and retrieval|
|US8983119||Aug 13, 2013||Mar 17, 2015||Myport Technologies, Inc.||Method for voice command activation, multi-media capture, transmission, speech conversion, metatags creation, storage and search retrieval|
|US9070193||Feb 7, 2014||Jun 30, 2015||Myport Technologies, Inc.||Apparatus and method to embed searchable information into a file, encryption, transmission, storage and retrieval|
|US9159113||Feb 7, 2014||Oct 13, 2015||Myport Technologies, Inc.||Apparatus and method for embedding searchable information, encryption, transmission, storage and retrieval|
|US9338520||Jan 25, 2013||May 10, 2016||Hewlett Packard Enterprise Development Lp||System and method for applying a database to video multimedia|
|US20020057839 *||Sep 24, 2001||May 16, 2002||Klaus Rinn||Method and measuring instrument for determining the position of an edge of a pattern element on a substrate|
|US20030179921 *||Jan 30, 2003||Sep 25, 2003||Kaoru Sakai||Pattern inspection method and its apparatus|
|US20040172164 *||Aug 6, 2003||Sep 2, 2004||Babak Habibi||Method and apparatus for single image 3D vision guided robotics|
|US20050033760 *||Sep 10, 2004||Feb 10, 2005||Charles Fuller||Embedded metadata engines in digital capture devices|
|US20050276508 *||Jun 15, 2004||Dec 15, 2005||Lockheed Martin Corporation||Methods and systems for reducing optical noise|
|US20060088203 *||Jul 14, 2005||Apr 27, 2006||Braintech Canada, Inc.||Method and apparatus for machine-vision|
|US20060115111 *||Jan 4, 2006||Jun 1, 2006||Malone Michael F||Apparatus for capturing information as a file and enhancing the file with embedded information|
|US20070230771 *||Jul 12, 2006||Oct 4, 2007||Samsung Techwin Co., Ltd.||Method of correcting bonding coordinates using reference bond pads|
|US20070276539 *||May 25, 2007||Nov 29, 2007||Babak Habibi||System and method of robotically engaging an object|
|US20070282818 *||Aug 21, 2007||Dec 6, 2007||Virage, Inc.||Network video guide and spidering|
|US20070282819 *||Aug 21, 2007||Dec 6, 2007||Virage, Inc.||Network video guide and spidering|
|US20080028047 *||May 22, 2007||Jan 31, 2008||Virage, Inc.||Interactive video application hosting|
|US20080069435 *||Sep 19, 2007||Mar 20, 2008||Boca Remus F||System and method of determining object pose|
|US20080181485 *||Dec 14, 2007||Jul 31, 2008||Beis Jeffrey S||System and method of identifying objects|
|US20090033655 *||Aug 2, 2007||Feb 5, 2009||Boca Remus F||System and method of three-dimensional pose estimation|
|US20090041361 *||May 12, 2008||Feb 12, 2009||Fujitsu Limited||Character recognition apparatus, character recognition method, and computer product|
|US20100017033 *||Jul 18, 2008||Jan 21, 2010||Remus Boca||Robotic systems with user operable robot control terminals|
|US20100092032 *||Oct 10, 2008||Apr 15, 2010||Remus Boca||Methods and apparatus to facilitate operations in image based systems|
|US20100172570 *||Mar 16, 2010||Jul 8, 2010||Kaoru Sakai||Pattern inspection method and its apparatus|
|US20100303288 *||Dec 2, 2010||Myport Technologies, Inc.||Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval|
|US20100310071 *||Dec 9, 2010||Myport Technologies, Inc.||Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval|
|US20110098960 *||Jun 18, 2009||Apr 28, 2011||Masaki Mizuochi||Charged particle beam device|
|US20110214144 *||Sep 1, 2011||Virage, Inc.||Video-enabled community building|
|EP0125532A2 *||Apr 21, 1984||Nov 21, 1984||Fingermatrix, Inc.||Fingerprint verification method|
|EP0162688A2 *||May 20, 1985||Nov 27, 1985||Motion Analysis Corporation||Environment monitoring system|
|U.S. Classification||348/87, 382/151|
|International Classification||H01L21/68, G06T7/60, G01B11/00, H01L21/00, B23Q17/24, H04N7/18, G05D3/12, H01L21/60|
|Cooperative Classification||H01L21/68, H01L21/681, H01L21/67144|
|European Classification||H01L21/67S2T, H01L21/68L, H01L21/68|
|Dec 1, 1981||AS||Assignment|
Owner name: HITACHI. LTD., 5-1, 1-CHOME, MARUNOUCHI, CHIYODA-K
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNORS:KASHIOKA, SEIJI;SHIMA, YOSHIHIRO;MIYATAKE, TAKAFUMI;REEL/FRAME:003930/0502
Effective date: 19800312