|Publication number||US5515159 A|
|Application number||US 08/386,404|
|Publication date||May 7, 1996|
|Filing date||Feb 10, 1995|
|Priority date||Feb 10, 1995|
|Publication number||08386404, 386404, US 5515159 A, US 5515159A, US-A-5515159, US5515159 A, US5515159A|
|Inventors||Peter W. Sites, Bernard A. Roche, Creed F. Jones, III, James C. Griner|
|Original Assignee||Westinghouse Electric Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (3), Referenced by (72), Classifications (7), Legal Events (10)|
|External Links: USPTO, USPTO Assignment, Espacenet|
1. Field of the Invention
This invention relates generally to vision systems for inspecting the integrity of seals on packaged goods and more particularly to an on-line machine vision system for inspecting the integrity of package seals for packages including elastomer seals.
2. Description of the Prior Art
Machine vision systems for inspecting the seals of packages containing various types of products moving at a relatively rapid rate along a production line are generally known and typically involve the use of one or more video cameras which are located at an inspection station where the packages are viewed as they pass along a conveyor. Images are generated of the packages which are then analyzed in order to determine the existence of any defects, for example, in the seal between a container and the lid affixed thereto.
Attempts to implement machine vision solutions seldom fail for lack of ability to perform the requisite analyses, but rather it is the failure to adequately capture images that contain all of the information necessary for performance of these analyses. This is due, for example, to incorrect sensor selection, improper optics, poor lighting, lack of attention to part positioning and/or materials handling problems and various other matters that can cause the system to acquire inadequate images and hence fail to operate as intended.
Accordingly, it is an object of the present invention to provide an improvement in on-line machine vision systems for performing inspection of package seals.
It is another object of the invention to provide an on-line machine vision system for performing quality inspection of opaque, translucent, and transparent elastomer sealed flexible and semi-rigid package seals.
It is still another object of the invention to provide an improvement in the lighting utilized in an on-line machine vision inspection of package seals.
It is a further object of the invention to provide an on-line machine vision system for performing an inspection of a package seal for continuity, location and type of defect.
It is yet another object of the invention to provide an on-line machine vision system which can continuously monitor system operation and when necessary transmit inspection information to a host system for archiving and statistical analysis.
Briefly, the foregoing and other objects are achieved by apparatus and a method implemented thereby for performing on-line inspection of opaque, translucent and transparent elastomer sealed flexible and semi-rigid package seals. In the case of highly reflective opaque seals of various elastomers and colors, low incident angle e.g. 5°-15°, structured side lighting is used to locate and define the seal and highlight defects within the sealed area. Actual angle of incidence and intensity are application dependent, however, and thus may be tailored to the specific application intended. The structured light is generated by a plurality of low incident angle light sources located substantially perpendicular to a major axis of straight or substantially straight sections of the seal and a plurality of structured light sources located perpendicular to a chord of curved segments of the seal. For transparent i.e. highly light transmissive seals, not only is the low incident structured side lighting utilized to define the seal area, but uniform back lighting of the package and seal is provided in order to then locate and classify defects within the seal boundaries. Multiple video images of portions of the area containing the seal and portions of the remaining lidstock are generated by CCD type cameras in response to one or more sensors which detect the presence and proper positioning of the package moving along a conveyor for image acquisition. The images generated are fed to one or more image processors which perform a series of stored program operations which, among other things, define the straight and curved portions of the sealed area, the edges of the actual sealed area, and the actual width of the sealed area. The actual width is compared to a prescribed minimum value, then the package is (a) accepted, (b) possibly accepted, or (c) rejected. Unacceptable packages or possibly acceptable packages are diverted from the inspection station by diverter assemblies for further inspection. If the seal is acceptable, the images are next processed to detect the presence or absence of flaw candidates such as channel defects, cluster defects, or incomplete seals. Each flaw candidate is then subjected to further analysis for locating any flaws relative to their location on the package and determines the type and severity of each defect. The package is then again either (a) accepted or (b) rejected.
This invention will be more readily understood when considered together with the accompanying drawings wherein:
FIG. 1 is a system block diagram illustrative of one preferred embodiment of the subject invention;
FIG. 2 is a schematic illustration of a multi-station inspection system for the embodiment shown in FIG. 1 including two image cameras and two low incident angle side lighting sources at each station;
FIGS. 3A and 3B are plan and side elevational views, respectively, of a typical product package including an elastomer package seal;
FIG. 4 is a front elevational view of a package under inspection and are receiving incident light from a structured light source from the side at a relatively low incident angle;
FIG. 5 is illustrative of four images generated for analysis by a pair of video cameras at each inspection station;
FIG. 6 is an electrical block diagram depicting the major components of an image processor utilized in the subject invention;
FIG. 7 is a system block diagram illustrative of another preferred embodiment of the invention;
FIG. 8 is a system block diagram illustrative of still another preferred embodiment of the subject invention; and
FIG. 9 is a flow chart illustrative of the computer software for implementing the algorithms for carrying the inspection of seals in accordance with the subject invention.
This invention discloses, among other things, a means to limit human inspection of elastomeric, heat and pressure sealed flexible and semi-rigid package seals while performing automatic machine vision inspection of package seals on-line at full production rates. The system to be described herein separates packages into three seal quality categories: (a) acceptable; (b) possibly acceptable; and (c) not acceptable. "Acceptable" packages are directly shipped to customers. "Possibly acceptable" packages are diverted to a holding area for further inspection by other machines or involves human inspection. "Not-acceptable" packages are diverted to a reject area for possible recovery of usable product.
All the seals to be considered for inspection by this invention are considered to be reflective. Some are opaque and others are translucent, while still others are transparent. In all instances, the heat and pressure applied in fabricating the seal between the package and lidstock creates a coining effect that is visible as to its boundaries and defects only under proper lighting conditions.
This now leads to a consideration of the various embodiments of the invention. Referring now to the drawings wherein like reference numerals refer to like components throughout, the embodiment shown in FIG. 1 depicts one station of one or more sequential inspection stations where highly reflective opaque seals 12 (FIG. 3A) located on the outer edge of a package 14 containing a product which is to be vended, not shown, and covered by lidstock 16 are inspected. The side view of FIG. 3B is indicative of a perimeter seal 12 of a flexible package 14. Semi-rigid packaging such as the package 14 shown, for example, in FIG. 4 has a relatively smooth, substantially level contour seal 12.
The configuration of FIG. 1 is utilized for highly reflective opaque seals of various elastomers and colors. In this embodiment, low incident angle structured light having a well defined beam is projected towards the top surface of the seal 12 and the outer edge of the package 14 at a relatively shallow angle (5°-15°) relative to the plane of the seal as shown in FIG. 4. Reference numeral 18 designates a structured incident light source of between 100 and 150 ft. candles. It should be noted, however, that the incident angle, intensity and shape of the beam is application dependent and thus may be varied to meet the specific task intended.
Referring now to FIG. 2, in order to inspect the seal 12 completely around the perimeter of the package 14, three pairs of structured light sources 181-1, 181-2 ; 182-1, 182-2 ; and 183-1 and 183-2 are provided at three separate stations. Station number 1 is used for illuminating the long sides 20 and 22 of the package 12, the second for illuminating the rear left corner 24 and the forward right corner 26 as well as one half of the front and rear sides 28 and 30, and the third for illuminating the opposite diagonal corners, i.e. left front corner 32 and right rear corner 34 and the other half of the front and rear side 28 and 30. Such an arrangement, however, can be changed and/or modified depending on the specific application.
Associated with each low incident angle light source 181 -1, 181 -2, . . . 183 -1, 183 -2 is an overhead charge couple device (CCD) camera 361 -1, 361 -2, 362 -1, 362 -2, 363 -1 and 363 -2, which respectively operate to grab or acquire image information as shown in FIG. 4. Image information may be front and rear half frame (field) images as images 38F, 38R, 40F, 40R when interlaced cameras are used, full frame image when frame transfer cameras are used, or may be acquired using linear array (line scan) cameras, or variations thereof, such as time delay and integration cameras. If field acquisition type cameras are used, field acquisition takes place approximately 16ms displaced in time during which a package 14, moving on a conveyor 42 such as shown in FIG. 1 and traveling 100 feet per minute, moves 0.027 feet. If frame transfer or linear array cameras are used, object displacement is not of any concern.
Further as shown in FIG. 2, package front edge position sensors 441, 442 and 443 are located at the three inspection stations for determining when a package 14 is in the appropriate position for acquiring one or more images by the respective pairs of cameras 361 -1, 361 -2, 362 -1, 362 -2; and 362 -1, 363 -2. An additional sensor 46 is located at the first station behind the front edge position sensor 441 for detecting when a particular package 14 is leaving the first station. The number of sensors 44, 46, moreover, is not necessarily limited to the number shown, but is application dependent, and is therefore dependent upon the particular configuration desired. The same may be said with respect to the number of light sources 18 and CCD cameras 36.
The actual number of images acquired at each location and the number of locations necessary to image the entire area of a package seal 12 again is application dependent. However, image processing begins as soon as an image is acquired by at least one system image processor 46, the details of which are shown in FIG. 6.
In FIG. 1, the embodiment for inspecting an opaque seal 12 includes a master image processor 461 and a plurality of slave image processors, one of which is shown by reference numeral 46n. Thus at any given time, the system may be acquiring an image or images, processing an image or images, making decisions based upon the results of the image processing and analysis, and outputting signals from the master image processor 461 through an input/output interface 48 to diverter mechanisms, for example, a pusher type diverter assembly 50 located alongside the conveyor 42 and a door type of diverter assembly associated with the pair of chutes 52 and 54 which feed initially rejected packages 14 into one or two containers 56 and 58 for receiving "non-acceptable" packages and "possibly acceptable" packages, respectively. The input/output interface 48 couples the package sensors 441, 442, 443 and 46 to the master image processor 461.
Reference numeral 60 denotes a system cabinet for housing the image processors 461. . . 46n in addition to the input/output interface 48 and a video input interface 62 which couples the video inputs from one pair of cameras 36-1 and 36-2 to the master image processor 461 via electrical cables 64-1 and 64-2. Further, as shown in FIG. 1, each slave image processor, for example processor 46n, includes a video input interface 66 which would be coupled to a respective pair of cameras 36, not shown, but which would be, for example, another pair of cameras for one of the other stations shown in FIG. 2.
The system cabinet 60, moreover, houses an uninterruptible AC power supply unit which is coupled to a 120VAC source through a circuit breaker type switch 70. The output of the power supply unit 68 comprises, for example, a clean, regulated, uninterruptible 120 VAC, that is not subject to transient interruptions or surges, thereby protecting electronic components from damage. This supply voltage is applied through circuit breaker switch 72 to various transformer type power supplies, not shown, where voltages are reduced to more appropriate levels, e.g. + or -5 volts DC, and to 120 VAC devices, such as lighting systems, through circuit breaker switch 74. The master image processor 461 and the slave image processor(s) 46n are interconnected by means of a high speed video bus 76 and a bus 78, the latter being known in the industry as a VME bus. The master image processor 461, in addition to sensing the state of the seal 12 at one of the inspection stations, generates output signals on cable leads 80 and 82 for indicating the inspection results on a video monitor 84 and for providing a communication interface to a host system, not shown, which exercises overall control of the system.
Referring now to FIG. 6, each of the image processors 461 and 46n comprise identical complete stand-alone modules which can operate either as a VME bus master or slave device. Each image processor is configured to include a standard VME mother board 86 and two piggy-back modules 88 and 90 which might be termed a CPU module and a video module, respectively. The CPU module 88 contains a CPU 92, e.g. a Motorola 68040 microprocessor, and an EPROM memory 94 comprising a DRAM having up to 8M bytes of memory. The CPU 92 and the memory 94 couple to the mother board 86 by way of a multi-pin connector 96. The video module 90 includes a camera interface(s) 98 which is located between the video interface 62 shown in FIG. 1 and a digitizer 100, typically an A/D converter for digitizing the input video information. The output of the digitizer 100 is then fed to a multiplexed video data bus 102 which is then coupled to an image memory 104 via connector 106.
The mother board additionally includes a VME bus logic section 108 and an input/output control section 110. The bus logic 108 connects the VME bus 78 and the video bus 76 to the internal connector 96, while the I/O control element 110 connects serial ports 114 and parallel I/O ports 116 to cable 82 (FIG. 1) and to the input/output interface 48. Finally, a series of pseudo color output ports 118 couple the processed video from a video RAMDAC 120 to the system monitor cable 82.
Before considering further operational details of this invention, the embodiments disclosed in Figures 7 and 8 will first be explained. Whereas the first embodiment depicted in FIGS. 1 and 2 is utilized to locate and define the true area of highly reflective opaque seals 12 of various elastomers and colors and thereafter highlight and classify any defects, such as the defects consisting of a narrowed sealed width region 15 or a discontinuity defect 17 such as shown in FIG. 5 using low incident angle structured incident lighting, the embodiment shown in FIG. 7 is designed to inspect fully transparent or nearly transparent and, therefore, highly light transmissive seals 12' formed between a package 14' and lidstock 16' using two types of lighting. The embodiment of FIG. 7 is substantially the same as the first embodiment shown in FIG. 1, but now additionally includes diffuse backlighting of the seal 12 as well as low incident angle side lighting. The backlighting is provided by an assembly 122 including a light transmissive diffuser member 124 and a relatively low intensity light source 126 having an intensity of between 5 and 25 ft. candles together with a reflector 128 which is located beneath the conveyor 42. Again the specific intensity is application dependent and thus may be varied depending on the specific application. The conveyor 42 now includes transparent or light transmissive sections 43 the size of the package 14' for the passage of light upwardly therethrough. In operation, the low incident angle side lighting is utilized, as before, to define the actual area of the seal 12'; however, the backlighting is now used to locate and classify defects 15 and 17, for example, as shown in FIG. 5, within the seal boundaries.
As to the embodiment shown in FIG. 8, where markings are previously placed on the package 14' to define the seal area for substantially transparent and highly light transmissive seals 12', a system having only diffused backlighting need be used since the only task now is to locate and classify defects as in FIG. 7. In FIG. 8, the low incident angle structured lighting system is eliminated and only a diffused backlighting system 123 including the diffuser 124, the electric lamp 126 and reflector 128 are positioned below the conveyor 42 which again requires transparent sections 43 so that uniform backlighting can be transmitted through the package 14' and seal 12' to, for example, cameras 36-1 and 36-2.
Considering now the flow chart of FIG. 9, depending upon which of the embodiments are utilized, detection of seals 12 or 12' is performed by first positioning a package 14 or 14' for inspection per step 130 and then acquiring images of portions of the lidstock which contains the seal and some portions of the remaining lidstock per step 132. Areas o f interest are next defined in both the straight and curved portions of the seal and the edges of the seal are then defined through application of a series of linear scans of the images generated by pairs of CCD cameras which produce pairs of edge points that define the actual inner and outer edges of the seal. This is noted in steps 134 and 136.
This is followed by comparing the actual width of the seal to a prescribed minimum value as indicated by step 138 whereupon the seal 12 or 12' and accordingly the package 14 or 14' is accepted or rejected. If a defect as shown by reference numeral 15 in FIG. 5 is detected, the package would be rejected.
If accepted other flaws are detected next by computing the gradient of each pixel of the image generated within actual boundaries of the seal, keeping the vector components separated. This is indicated by step 140. Next, dot products of the edge vectors and a unit vector parallel to the actual seal are generated as shown by step 142.
This is followed by step 144 where a comparison is made of the magnitude of the edge strength in directions parallel and perpendicular to the seal track to reveal the presence or absence of flaw candidates such as channel defects, cluster defects, or incomplete seals.
Each flaw candidate is then subjected to a connected component analysis as shown by steps 146 and 148 followed by a determination step 150 of accepting, possibly accepting, or rejecting the package. Then further analysis is carried out which includes the step 153 of locating the flaw relative to its location on the package and providing a report per step 154 which is generated in accordance with the output of the master image processor.
All images acquired by the pairs of cameras 36-1 and 36-2 at an inspection station are processed in the same fashion as follows. Areas of interest appropriate to the geometry of the seal are defined in each acquired image. The areas of interest are rectangular, with one or more such areas positioned over and with their major axes parallel to the straight sections of the seal, and one positioned approximately at the mid-point of any curved areas of the seal as shown, for example, in the multi-station configuration of FIG. 2.
Within each area of interest, a number of search vectors are defined perpendicular to the edges of the seal area. Along each search vector, the gradient is computed according to the following equation: ##EQU1## where: P is the pixel of interest within a 3×3 pixel matrix lying centered along the search vector, Pij is the pixel at the center of the above mentioned pixel matrix; and, the remainder are pixel locations relative to Pij.
Potential edge points which are a predetermined distance apart, based on the expected geometry of the seal, are identified by noting those points where the calculated gradient magnitude meets or exceeds an experimentally determined, for the particular system design, threshold value. These points are identified as the edges of the seal area. This processing is repeated for each search vector in each area of interest. One point of each pair corresponds to the inside edge of the seal area while the other point corresponds to the outer edge.
Due to noise, glare, and other image artifacts, some points may be incorrectly located. In other words, the data is "noisy" but the noise is not normally distributed. To remove the effect of this noise on the precise definition of the seal area, the points are chosen in sets of three to perform a curve fit. If the results of any curve fit operation are not compatible with the rest, those points are discarded. However, one point is chosen from each area of interest present in the image. These points are used to mathematically derive a curve consisting of a line segment for the side of the seal area and an ellipse with a specified eccentricity for the end area of the package. The eccentricity is determined by the geometry of the package and the imaging hardware, and is fixed at system setup time.
By repeating this process for all of the sets of points present in the areas of interest, a number of curves are obtained. These curves are defined in terms of the ellipse center point and diameter, and the slope and intercept of the line segment. The center points and line slopes are examined to determine the "clustering". If the standard deviation of any of these quantities exceeds a value equal to the total error that would be introduced by allowing any single point on a curve to deviate from the curve by an amount equal to one-fourth the seal width, it is concluded that one or more of the curves is in error.
An iterative process is carried out which determines which curve is most in error. This curve is removed, and the process is repeated until the standard deviation falls within predetermined limits, indicating significant agreement between the remaining curves. Once the curves are combined in this fashion, the remaining data is combined to produce the final overall curve fit for the seal area edge.
When curves are obtained for the inner and outer seal area edges, the curves are checked mathematically to see if the edges they define are closer together than a specified minimum distance, which varies by the particular application intended. This indicates insufficient seal width to properly protect the package contents at that point, and the package is rejected. This fast check is done to detect gross errors in seal width without tracing the entire seal area and checking width at each point, which requires much more processing time.
Accordingly, the seal area consists of the area bounded by the inner and outer curves. Within this irregularly shaped region of interest, flaw enhancement and detection are next carried out. Because flaws tend to have strong visual components perpendicular to the major axis of the seal, while illumination artifacts and shadows generally lie parallel to the seal, it is desirable to emphasize intensity changes along the seal area. To do this, the gradient vector parallel to the seal track is computed at each point in the seal area. The process to perform this operation is governed by the following general mathematical procedure.
(1) At each point in the seal area, a unit vector parallel to the seal track is derived by computing the derivative of the seal curve equation;
(2) The gradient vector is approximated using a pair of 5×5 masks, one to calculate the horizontal component of the gradient and one for the vertical;
(3) The dot product of the gradient vector and the unit vector is formed at each pixel; this is equivalent to the magnitude of edge strength in the direction of the track. If the unit vector is represented by U, the gradient vector by G, the edge mask matrices by Mx and My, and the image neighborhood of the pixel (ij) as I(ij), the resulting edge strength is: ##EQU2## (4) To examine this enhanced data for potential flaws, a number of gray-level and variance statistics are collected as the edge data is computed. Based on these overall statistics, a threshold for the edge data is selected and applied to the image; and
(5) Connected component or "blob" analysis is performed in a well known manner to locate any significant areas of edge activity. If none are found, the seal area is free of anomalies and the package is deemed acceptable.
If any sizable areas of edge strength are found, it still must be determined whether they represent actual flaws or artifacts of some kind. To do this, a number of features are next calculated for each flaw candidate. They include: connection status (flaw connected to the inner edge, outer edge, or both), area, density or "darkness" aspect ratio, "stringiness", angle of orientation, and solidity or number of holes. If a flaw is connected to both edges, it is defined as a channel leak, and the package is rejected. Small flaws which are nearly circular and not connected to the edge, called star or cluster flaws, usually correspond to a contaminant trapped beneath the seal. Such a package is also rejected. Other types of flaw candidates, such as cuts, tears, or markings specific to a particular application, may also be defined and the system configured to locate, identify, and reject them.
For each application, the package perimeter is defined in some number of agreed sectors of arc as measured from the geometric center of the package. Defect locations relative to these defined sectors are computed using the information generated by the foregoing connected components analysis. Knowing the location of defects provides an aid to inspectors in determining and correcting the cause of the defect, so this information, along with other application-specific data, is reported by the system.
Thus what has been shown and described is an automatic machine vision inspection system for flexible and semi-rigid package seals comprised of opaque, translucent and transparent elastomeric material which is tolerant of position or internal variation, angular or skew variations, vibrations induced by conveyor motion, and variations in the angle of the sealed surface with respect to the system imaging cameras.
Having thus shown and described what is considered to be the preferred method and embodiments for implementing the subject invention, it is to be noted that the same has been made by way of illustration and not limitation. Accordingly, all modifications, alterations and changes coming within the spirit and scope of the invention are herein meant to be included.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4220966 *||Aug 17, 1978||Sep 2, 1980||Western Electric Company, Inc.||Determining boundaries of a transparent tube|
|US5249034 *||Jan 15, 1992||Sep 28, 1993||Toyo Glass Co., Ltd.||Method of and apparatus for inspecting end of object for defect|
|JPH01209307A *||Title not available|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5754677 *||Oct 23, 1995||May 19, 1998||Fuji Machine Mfg. Co., Ltd.||Image processing apparatus|
|US5790247 *||Sep 26, 1996||Aug 4, 1998||Photon Dynamics, Inc.||Technique for determining defect positions in three dimensions in a transparent structure|
|US5854679 *||Nov 13, 1997||Dec 29, 1998||Aerospatiale Societe Nationale Industrielle||Object characteristics measurement system|
|US5911001 *||Dec 17, 1997||Jun 8, 1999||Fuji Machine Mfg. Co., Ltd.||Image processing apparatus|
|US5986414 *||Jul 9, 1997||Nov 16, 1999||Synergistech, Inc.||Configurable light output controller, method for controlling lights and a system for implementing the method and including a configurable light output controller|
|US6097427 *||Mar 13, 1998||Aug 1, 2000||Ethicon, Inc.||Method of and apparatus for detecting defects in a process for making sealed sterile packages|
|US6201600 *||Dec 19, 1997||Mar 13, 2001||Northrop Grumman Corporation||Method and apparatus for the automatic inspection of optically transmissive objects having a lens portion|
|US6301380 *||Sep 12, 1997||Oct 9, 2001||Philip Morris Incorporated||Fold inspection device for transparent overwrap film|
|US6597806||Dec 3, 1999||Jul 22, 2003||Fuji Machine Mfg. Co., Ltd.||Image processing method and apparatus|
|US6614916 *||Jan 4, 2001||Sep 2, 2003||Bell & Howell Mail And Messaging Technologies Company||Machine vision system and triggering method|
|US6640002||May 25, 1999||Oct 28, 2003||Fuji Machine Mfg. Co., Ltd.||Image processing apparatus|
|US6655114 *||Feb 15, 2001||Dec 2, 2003||Toyo Jidoki Co., Ltd||Apparatus and method for sealing and inspecting a seal portion of a packaging bag|
|US6661931||Nov 28, 2000||Dec 9, 2003||Fuji Machine Mfg. Co., Ltd.||Image processing method, image processing system, and modifying-data producing method|
|US6970182 *||Oct 20, 1999||Nov 29, 2005||National Instruments Corporation||Image acquisition system and method for acquiring variable sized objects|
|US7015908 *||Nov 29, 2000||Mar 21, 2006||Namco Ltd.||Image generation system and information storage medium|
|US7036287||Jul 2, 2003||May 2, 2006||Van Der Stahl Scientific, Inc.||Method and device for inspecting and monitoring the seal integrity of sterile packages|
|US7142707||Dec 12, 2003||Nov 28, 2006||Northrop Grumman Corporation||Automated inspection of packaging materials for package integrity|
|US7209575 *||Sep 8, 2004||Apr 24, 2007||Berry Plastics Corporation||Method for visual inspection of printed matter on moving lids|
|US7272916||May 31, 2005||Sep 25, 2007||Van Der Stahl Scientific, Inc.||Method and device for inspecting and monitoring the seal integrity of sterile packages|
|US7792352 *||May 19, 2008||Sep 7, 2010||Hitachi High-Technologies Corporation||Method and apparatus for inspecting pattern defects|
|US7832181||Nov 7, 2008||Nov 16, 2010||Delkor Systems, Inc.||Detection system|
|US8005292||Sep 7, 2010||Aug 23, 2011||Hitachi High-Technologies Corporation||Method and apparatus for inspecting pattern defects|
|US8223200||Jun 9, 2009||Jul 17, 2012||Hormel Foods Corporation||Package vision evaluation system|
|US8285025 *||Mar 25, 2008||Oct 9, 2012||Electro Scientific Industries, Inc.||Method and apparatus for detecting defects using structured light|
|US8483867||Oct 18, 2010||Jul 9, 2013||Mckesson Automation Inc.||System, method and corresponding apparatus for storing, retrieving and delivering unit dose blisters|
|US8503758 *||Jul 14, 2011||Aug 6, 2013||Keyence Corporation||Image measurement device, method for image measurement, and computer readable medium storing a program for image measurement|
|US8639019||Sep 12, 2012||Jan 28, 2014||Hitachi High-Technologies Corporation||Method and apparatus for inspecting pattern defects|
|US8760508||Jan 13, 2010||Jun 24, 2014||R.J. Reynolds Tobacco Company||Filtered smoking article inspection system, and associated method|
|US8831764 *||Oct 17, 2011||Sep 9, 2014||R. J. Reynolds Tobacco Company||Cigarette package coding system and associated method|
|US8860802 *||Oct 8, 2009||Oct 14, 2014||Youri N. Djachiachvili||Method and apparatus for detecting defects and embedded objects in sealed sterilized packaging|
|US8929641 *||Mar 17, 2009||Jan 6, 2015||Aesynt Incorporated||System and method for determining the orientation of a unit dose package|
|US9233768||Feb 27, 2012||Jan 12, 2016||The Procter & Gamble Company||Method of rejecting a defective unit dose pouch from a manufacturing line|
|US9470638||Feb 27, 2012||Oct 18, 2016||The Procter & Gamble Company||Apparatus and method for detecting leakage from a composition-containing pouch|
|US9522758 *||Nov 29, 2009||Dec 20, 2016||Khs Gmbh||Beverage bottling plant having an apparatus for inspecting bottles or similar containers with an optoelectric detection system and an optoelectric detection system|
|US9586710 *||Oct 5, 2012||Mar 7, 2017||Pitney Bowes Inc.||Method and system for identifying/outsorting improperly wrapped envelopes in a mailpiece fabrication system|
|US9664570||Nov 13, 2012||May 30, 2017||R.J. Reynolds Tobacco Company||System for analyzing a smoking article filter associated with a smoking article, and associated method|
|US20020135603 *||Nov 29, 2000||Sep 26, 2002||Jun Nakagawa||Image generation system and information storage medium|
|US20030044056 *||Jun 13, 2002||Mar 6, 2003||Robotic Vision Systems, Inc.||Post-seal inspection system|
|US20030177624 *||Mar 7, 2003||Sep 25, 2003||Schmidt Gerd Uwe||Method for the manufacture of a spring core and device for implementing the method|
|US20030179920 *||Mar 10, 2003||Sep 25, 2003||Intelligent Machine Concepts, L.L.C.||Inspection system for determining object orientation and defects|
|US20050226488 *||Mar 31, 2004||Oct 13, 2005||Paud Barry||Inspection system for blister packages|
|US20050283332 *||May 31, 2005||Dec 22, 2005||Charles Webb||Method and device for inspecting and monitoring the seal integrity of sterile packages|
|US20060050949 *||Sep 8, 2004||Mar 9, 2006||Scott Spaeth||Method for visual inspection of printed matter on moving lids|
|US20060244954 *||Mar 29, 2006||Nov 2, 2006||Daley Wayne D||System and method for inspecting packaging quality of a packaged food product|
|US20070184957 *||Jan 23, 2007||Aug 9, 2007||Mobert Srl||Device and method for automatic control of plastic bag handles|
|US20070265730 *||May 30, 2007||Nov 15, 2007||Mckesson Automation Inc.||System, method and corresponding apparatus for scanning an identification code of an unknown orientation|
|US20070296963 *||Apr 15, 2005||Dec 27, 2007||Sepha Limited||Methods and Apparatus for Inspecting the Sealing and Integrity of Blister Packages|
|US20080022632 *||Jul 24, 2007||Jan 31, 2008||Soudronic Ag||Method and apparatus for manufacturing objects provided with a sealed seam|
|US20080232674 *||May 19, 2008||Sep 25, 2008||Kaoru Sakai||Method and apparatus for inspecting pattern defects|
|US20090245614 *||Mar 25, 2008||Oct 1, 2009||Electro Scientific Industries, Inc.||Method and apparatus for detecting defects using structured light|
|US20100059074 *||Sep 5, 2008||Mar 11, 2010||R. J. Reynolds Tobacco Company||Inspection System for a Smoking Article Having an Object Inserted Therein, and Associated Method|
|US20100115887 *||Nov 7, 2008||May 13, 2010||Delkor Systems, Inc.||Detection System|
|US20100118138 *||Oct 8, 2009||May 13, 2010||Djachiachvili Youri N||Method and apparatus for detecting defects and embedded objects in sealed sterilized packaging|
|US20100141756 *||Nov 29, 2009||Jun 10, 2010||Grote Frank Joachim||Beverage bottling plant having an apparatus for inspecting bottles or similar containers with an optoelectric detection system and an optoelectric detection system|
|US20100239169 *||Mar 17, 2009||Sep 23, 2010||Mckesson Automation Inc.||System And Method For Determining The Orientation Of A Unit Dose Package|
|US20100328446 *||Sep 7, 2010||Dec 30, 2010||Kaoru Sakai||Method and apparatus for inspecting pattern defects|
|US20110024444 *||Oct 18, 2010||Feb 3, 2011||Mckesson Automation Inc.||System, Method and Corresponding Apparatus for Storing, Retrieving and Delivering Unit Dose Blisters|
|US20110169942 *||Jan 13, 2010||Jul 14, 2011||R.J.Reynolds Tobacco Company||Filtered smoking article inspection system, and associated method|
|US20130096711 *||Oct 17, 2011||Apr 18, 2013||R.J. Reynolds Tobacco Company||Cigarette Package Coding System and Associated Method|
|US20140096477 *||Oct 5, 2012||Apr 10, 2014||Pitney Bowes Inc.||Method and system for identifying/outsorting improperly wrapped envelopes in a mailpiece fabrication system|
|CN100403014C||May 10, 2005||Jul 16, 2008||浙江工业大学||On-line automatic device for monitoring press quality of outer casing of crystal oscillator|
|EP0843153A1 *||Nov 13, 1997||May 20, 1998||AEROSPATIALE Société Nationale Industrielle||System for measuring the characteristics of an object|
|EP1342693A1 *||Feb 26, 2003||Sep 10, 2003||AGRO Federkernproduktion eK||Method and device for manufacture of pocketed springs|
|EP1371969A1 *||May 12, 2003||Dec 17, 2003||General Electric Company||Sensor alignment method for 3D measurement systems|
|WO2002102051A2 *||Jun 13, 2002||Dec 19, 2002||International Product Technology,Inc.||Post-seal inspection system|
|WO2002102051A3 *||Jun 13, 2002||Jul 31, 2003||Robotic Vision Systems||Post-seal inspection system|
|WO2004092717A1 *||Apr 5, 2004||Oct 28, 2004||Northrop Grumman Corporation||Automated inspection of packaging materials for package integrity|
|WO2005114155A1 *||Apr 15, 2005||Dec 1, 2005||Sepha Limited||Methods and apparatus for inspecting the sealing and integrity of blister packages|
|WO2006028571A2 *||Jul 11, 2005||Mar 16, 2006||Berry Plastics Corporation||Method for visual inspection of printed matter on moving lids|
|WO2006028571A3 *||Jul 11, 2005||Aug 10, 2006||Berry Plastics Corp||Method for visual inspection of printed matter on moving lids|
|WO2013130439A1 *||Feb 26, 2013||Sep 6, 2013||The Procter & Gamble Company||Method of rejecting a defective unit dose pouch from a manufacturing line|
|WO2015052445A1||Oct 9, 2014||Apr 16, 2015||Luceo||Method and device for inspecting packaging seams|
|U.S. Classification||356/237.1, 348/92, 348/131|
|Cooperative Classification||G01N21/9515, G01N21/95|
|Mar 27, 1995||AS||Assignment|
Owner name: WESTINGHOUSE ELECTRIC CORPORATION, PENNSYLVANIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SITES, PETER W.;ROCHE, BERNARD A.;JONES, CREED F. III;AND OTHERS;REEL/FRAME:007436/0503;SIGNING DATES FROM 19950305 TO 19950307
|Jul 16, 1996||AS||Assignment|
Owner name: NORTHROP GRUMMAN CORPORATION, CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WESTINGHOUSE ELECTRIC CORPORATION;REEL/FRAME:008104/0190
Effective date: 19960301
|Nov 5, 1999||FPAY||Fee payment|
Year of fee payment: 4
|Nov 7, 2003||FPAY||Fee payment|
Year of fee payment: 8
|Oct 4, 2006||AS||Assignment|
Owner name: BANYAN MEZZANINE FUND, L.P., FLORIDA
Free format text: SECURITY AGREEMENT;ASSIGNOR:PERCEPTICS, LLC;REEL/FRAME:018338/0584
Effective date: 20061003
|Oct 17, 2007||AS||Assignment|
Owner name: PERCEPTICS, LLC, TENNESSEE
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NORTHROP GRUMMAN CORPORATION;REEL/FRAME:019974/0141
Effective date: 20061003
|Nov 12, 2007||REMI||Maintenance fee reminder mailed|
|May 7, 2008||LAPS||Lapse for failure to pay maintenance fees|
|Jun 3, 2008||AS||Assignment|
Owner name: SUNTRUST BANK, TENNESSEE
Free format text: SECURITY AGREEMENT;ASSIGNOR:PERCEPTICS, LLC;REEL/FRAME:021029/0797
Effective date: 20080530
|Jun 24, 2008||FP||Expired due to failure to pay maintenance fee|
Effective date: 20080507