|Publication number||US7525114 B2|
|Application number||US 11/687,506|
|Publication date||Apr 28, 2009|
|Filing date||Mar 16, 2007|
|Priority date||Feb 14, 2006|
|Also published as||US20070210240|
|Publication number||11687506, 687506, US 7525114 B2, US 7525114B2, US-B2-7525114, US7525114 B2, US7525114B2|
|Inventors||Leonard Metcalfe, Terry Arden|
|Original Assignee||Lmi Technologies Ltd.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (14), Referenced by (5), Classifications (7), Legal Events (2)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is a continuation-in-part of U.S. patent application Ser. No. 11/364,488 entitled Multiple Axis Multipoint Non-Contact Measurement System filed 27 Feb. 2006, now U.S. Pat. No. 7,420,196 which claimed priority from Canadian patent application serial no. 2,536,411, all of which are herein incorporated in their entirety by this reference thereto.
This invention relates to triangulation-based non-contact measurement. In particular, this invention relates to multipoint triangulation-based non-contact measurement wherein a plurality of light sources are reflected and imaged on an array.
In multipoint triangulation-based sensors, a series of aligned spots reflected from a workpiece are imaged by a camera that lies in the same plane as both the spots and the light sources.
The camera typically comprises a two-dimensional pixel array onto which the spots are imaged. The range to each of the spots is derived by triangulation from the location of its image on the array.
As was discussed in U.S. Pat. No. 5,986,745 to Hermary et al., a known limitation of such systems is the difficulty in sorting or discriminating between adjacent spots, for example as a result of the proximity or overlap of imaged spots, or due to dropout of a spot by occlusion from irregular surface characteristics.
One approach to enhancing reliable discrimination between spots is to more accurately determine the centroids of the spots along the triangulation axis. U.S. Pat. No. 5,056,922 to Cielo et al. discloses the use of an elliptical spot (e.g. the shape characteristic of TEM01 mode laser light) wherein the longitudinal axis of the elliptical spot is perpendicular to the longitudinal axis of the detecting elements of a linear array. This allows more accurate determination of the centroid of the spots and hence, better discrimination between adjacent spots.
U.S. Pat. No. 5,986,745 to Hermary et al. addresses the problem by using a spatially encoded pattern of light projected onto a workpiece rather than discrete spots.
U.S. Pat. No. 4,937,445 to Leong teaches the use of a small number of beams, so as to effectively limit the possibility of misidentification of a given spot, while U.S. Pat. No. 4,687,325 to Corby relies on a time-separated series of different patterns of beams.
It is apparent that the problem of spot discrimination in multipoint triangulation sensing systems is well known and that a variety of approaches are used to address it.
An object of the present invention is therefore to provide an improved, elegant and simple means of discriminating between successive spots in a multipoint triangulation-based sensor.
Optical triangulation sensors are often disposed on opposed sides of an object in order to characterize both sides of the object. In such cases, there is a risk of crosstalk between the two sensors when a projected spot is imaged on the opposite sensor enclosure rather than on the surface of the object to be measured. The present invention facilitates the avoidance of such crosstalk.
These and other objects of the invention will be better understood by reference to the detailed description of the preferred embodiment which follows.
In known prior art multipoint triangulation systems, the camera, the set of projected spots and the light sources are all in the same plane such that single reference-axis triangulation takes place.
According to the invention, the spots are imaged onto a two-dimensional array and the optical and camera set up is selected so as to provide triangulation of the spots effectively about two axes. Preferably one axis is shorter than the other.
The location of successive spots imaged from a workpiece onto the array will vary less along the shorter triangulation axis than along the longer triangulation axis. Appropriate optical parameters for the shorter triangulation can be selected such that even with the maximum expected variation in height of the workpiece, the spots as imaged along the shorter triangulation axis will be constrained to defined, non-overlapping areas of the array. Thus spot discrimination is significantly improved. The longer triangulation axis is used for dimensional measurement while a combination of the shorter and longer triangulation axes is used for spot discrimination.
The inventors have also found that the foregoing can be achieved by spatially offsetting the camera from the plane in which all of the aligned spots lie. This results in range triangulation about the longer axis and spot discrimination about a combination of the longer axis and the axis defined by the spatial offset.
A look-up table may be used to compare the predetermined possible positions of each spot with the actual position of each reflection and thereby correctly associate each reflection with a given projected spot.
In one aspect the invention comprises optical measuring apparatus comprising at least one source for projecting a plurality of discrete zones of electromagnetic radiation along a projection plane and imaging apparatus for imaging a plurality of reflections of said zones from at least one surface extending through said projection plane, said imaging apparatus being spatially offset from said projection plane. In a more particular aspect, the optical measuring apparatus comprises optical triangulation apparatus, the source comprises a laser and the zones of electromagnetic radiation comprise spots of light.
In another aspect, the invention comprises optical measuring apparatus for determining spatial or dimensional characteristics of at least one remote object, comprising a plurality of sources for projecting along a projection plane a plurality of discrete zones of light onto said at least one remote object, imaging apparatus for acquiring an image of a plurality of reflections of said zones of light from said at least one remote object, said imaging apparatus being spatially offset from said projection plane, and a processor for outputting from said imaging apparatus data characterizing said image of said plurality of reflections.
In a further aspect of the invention, there is also provided a record of the possible locations of each reflection in the captured image.
In yet another aspect, the invention comprises a method of optically determining the spatial or dimensional characteristics of at least one remote object, comprising projecting onto said object a plurality of discrete zones of electromagnetic radiation along a projection plane, said projection plane intersecting at least one surface of said object and acquiring an image of a plurality of reflections of said zones from said at least one remote object from a vantage point that is spatially offset from said projection plane.
In a further aspect, the method of the invention comprises predetermining a range of possible locations in said image of each of said plurality of reflections, and associating each one of a plurality of said reflections with one of said zones of electromagnetic radiation by reference to the actual location of each of said reflections in said image and said possible locations of each of said reflections.
In another aspect the invention comprises an optical triangulation sensor having a housing, at least one source in said housing for projection discrete zones of electromagnetic radiation along a projection plane toward an object, imaging apparatus in said housing comprising a two-dimensional array having perpendicular axes, and being disposed such that neither of said axes are normal to said projection plane.
In yet another aspect, the invention comprises the use of at least two optical sensors disposed on opposed sides of a remote object for determining the characteristics of the object. Each sensor comprises at least one source for projecting a plurality of spots of light along a common projection plane toward the object as well as a camera that is spatially offset from the projection plane. The spatial offset provides an angled field of view for the camera that includes the object but does not include the sensor opposite. This simplifies the process of avoiding crosstalk between the sensors that can otherwise result from imaging spots that impinge on the enclosure of the opposite sensor.
In a more particular aspect, the invention comprises a non-contact optical triangulation sensor comprising a housing containing a light source and imaging apparatus. The light source is adapted to project a plurality of aligned discrete zones of electromagnetic radiation onto a workpiece such that the plane that includes the aligned zones that is normal to the workpiece does not include the imaging apparatus.
The foregoing was intended as a broad summary only and of only some of the aspects of the invention. It was not intended to define the limits or requirements of the invention. Other aspects of the invention will be appreciated by reference to the detailed description of the preferred embodiment and to the claims.
The invention will be described by reference to the detailed description of the preferred embodiment and to the drawings thereof in which:
Depending on the distance of specific surface points of the workpiece 16 from the light sources 10, beam 12 may be reflected on the workpiece at points 12 a (short range) or 12 b (longer range) and beam 14 may be reflected at points 14 a or 14 b.
Camera 20 also lies in plane 18 as will be appreciated by reference to
According to the preferred embodiment of the invention illustrated in
Dual axis triangulation in the preferred optical set up described above results in different behaviour of the reflections on the imaging array than is the case with prior art optical set ups. As the range to the spot on the workpiece varies, the corresponding reflection is displaced across the array in a generally diagonal path rather than along the horizontal axis.
In the preferred embodiment shown in
The spatial offset of the camera effectively provides a partial side view of the workpiece and of the reflected spots. The greater the offset from the reflection plane, the better the side component of the view and the easier it is to discriminate between spots.
While the preferred embodiment contemplates a plurality of separate light sources projecting along a common light projection plane, this is not essential to the invention. Provided that the light spots reflected from the workpiece all lie substantially in a common reflection plane and that the point of view of the camera is offset from that plane, the invention will enhance discrimination between the spots. The invention is therefore applicable to beam splitting configurations or configurations where the cameras are not necessarily disposed to project light along common planes.
This optical arrangement can be achieved by providing a light source and imaging apparatus generally along a longitudinal axis 53 of an enclosure or housing 60. The light source is adapted to project a plurality of discrete zones of light for aligned reflection from a nominally flat workpiece. The light source is oriented so that the measurement plane does not include the imaging apparatus, i.e. the reflection axis is skewed in relation to the longitudinal axis of the enclosure, i.e. it is not perpendicular to it. In a typical prior art optical sensor enclosure, the light source and the imaging apparatus are spaced from one another within the enclosure along the longitudinal axis of the enclosure and the light source projects the zones of light along a projection plane that includes the imaging apparatus. In such enclosure, rotating the light source and associated optics within the enclosure to effectively re-orient or skew the reflection axis on the workpiece achieves the object of the invention. It will be appreciated that this arrangement potentially allows for a relatively narrower enclosure than the preferred embodiment as the enclosure need not accommodate a significant lateral offset for the camera.
It is also within the scope of the invention to use more than a single camera. A first camera could be used to provide an image used principally for range determination of the various spots, while a second camera could be offset from the plane in which the spots lie for the purposes of acquiring an image used primarily for spot discrimination. In such case, it would be necessary to associate the data from the second camera with the data from the first camera in order to correlate the identity of the sorted spots to the spots for which range has been determined.
Referring now to
It will be appreciated by those skilled in the art that the preferred and alternative embodiments have been described in some detail but that certain modifications may be practiced without departing from the principles of the invention.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4687325||Mar 28, 1985||Aug 18, 1987||General Electric Company||Three-dimensional range camera|
|US4937445||Sep 23, 1987||Jun 26, 1990||Softac Systems Ltd.||Apparatus for determining the distances of points on a surface from a reference axis|
|US5056922||Feb 6, 1989||Oct 15, 1991||Canadian Patents And Development Limited/Societe Canadienne Des Brevets Et D'exploitation Limitee||Method and apparatus for monitoring the surface profile of a moving workpiece|
|US5109161||Oct 10, 1990||Apr 28, 1992||Canon Kabushiki Kaisha||Light emitter and optical system for a distance measuring device|
|US5196900||Oct 9, 1990||Mar 23, 1993||Metronor A.S.||Method and sensor for opto-electronic angle measurements|
|US5811827||Jun 5, 1995||Sep 22, 1998||Sensor Adaptive Machines, Inc.||Method and apparatus for electro-optically determining the dimension, location and attitude of objects|
|US5986745||Mar 24, 1997||Nov 16, 1999||Hermary; Alexander Thomas||Co-planar electromagnetic profile scanner|
|US6204755||Aug 6, 1999||Mar 20, 2001||Honda Giken Kogyo Kabushiki Kaisha||Object detecting device|
|US6825936||Aug 17, 2001||Nov 30, 2004||Lmi Technologies, Inc.||High speed camera based sensors|
|US6876458||Mar 19, 2003||Apr 5, 2005||Steinbichler Optotechnik Gmbh||Method and device for determining the absolute coordinates of an object|
|US7208749||Aug 21, 2003||Apr 24, 2007||Lockheed Martin Corporation||System and method for locating and positioning an ultrasonic signal generator for testing purposes|
|US20040119035||Dec 20, 2002||Jun 24, 2004||Hongzhi Kong||Object surface characterization using optical triangulaton and a single camera|
|US20040128102 *||Feb 22, 2002||Jul 1, 2004||John Petty||Apparatus and method for obtaining three-dimensional positional data from a two-dimensional captured image|
|US20040246495||Nov 7, 2003||Dec 9, 2004||Fuji Xerox Co., Ltd.||Range finder and method|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8090194||Jan 3, 2012||Mantis Vision Ltd.||3D geometric modeling and motion capture using both single and dual imaging|
|US8208719||Nov 22, 2011||Jun 26, 2012||Mantis Vision Ltd.||3D geometric modeling and motion capture using both single and dual imaging|
|US8538166||Nov 20, 2007||Sep 17, 2013||Mantisvision Ltd.||3D geometric modeling and 3D video content creation|
|US9367952||May 20, 2015||Jun 14, 2016||Mantisvision Ltd.||3D geometric modeling and 3D video content creation|
|US20100074532 *||Nov 20, 2007||Mar 25, 2010||Mantisvision Ltd.||3d geometric modeling and 3d video content creation|
|U.S. Classification||250/559.31, 250/206.1, 356/602|
|International Classification||G01V8/00, G01N21/86|
|Sep 26, 2012||FPAY||Fee payment|
Year of fee payment: 4
|Jan 14, 2016||AS||Assignment|
Owner name: LMI TECHNOLOGIES LTD., IRELAND
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ARDEN, TERRY;REEL/FRAME:037488/0866
Effective date: 20110408