|Publication number||US6879384 B2|
|Application number||US 10/322,521|
|Publication date||Apr 12, 2005|
|Filing date||Dec 19, 2002|
|Priority date||Dec 19, 2001|
|Also published as||DE50212406D1, EP1321777A2, EP1321777A3, EP1321777B1, US20030123045|
|Publication number||10322521, 322521, US 6879384 B2, US 6879384B2, US-B2-6879384, US6879384 B2, US6879384B2|
|Inventors||Johannes Riegl, Rainer Reichert, Nikolaus Studnicka, Andreas Ullrich|
|Original Assignee||Riegl Laser Measurement Systems, Gmbh|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (4), Referenced by (12), Classifications (22), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
1. Field of the Invention
The present invention relates to a process and an apparatus for taking up, or measuring, an object space using an opto-electronic range finder which operates according to a method of determining the time-of-flight of a signal. In the context of the present specification, the term “determining the time-of-flight” should be understood in its broadest meaning, i.e. encompassing both counting the time between the emission of a transmitter signal up to the receipt of a reflected signal and, in the case of a continuous-wave laser, determining the time-of flight by determining the phase shift between the transmitted beam and the reflected beam received.
More specifically the present invention relates to such a process which comprises a first take-up step in which optical transmitter signals in form of a beam of a predetermined first divergence angle are transmitted along a first path of rays into the object space, and after reflection of such an optical signal from an object it is received by a receiver, i.e. after a time-of flight of said transmitter signals and said reflected signals which, thus, have a certain time relationship during a measuring cycle between a transmitted and a reflected signal.
While appropriate optics are assigned to the transmitter and the receiver and define a first and second optical axis, an evaluating step determines the distance of the above mentioned object in the object space from the time-of-flight meant in the above sense. To obtain different distance values even from larger objects, a scanning step by deviating the direction of the first and second optical axes by a certain angle of deflection between two subsequent measuring cycles. Since the scanning step is effected over a certain maximum deviation angle of a scanner, it is contemplated to decode this angle in any position of the scanner for determining the actual angle of deviation during scanning.
When an object space has to be taken up, reference marks, e.g. retro-reflectors, are arranged in the object space which have either defined geographical coordinates, thus being adapted to define a coordinate system (as soon as their position in relation to the “image” taken up is known) into which the image can be inserted in correspondence with reality, or to form a 3-D image of the object space by taking the object space from at least two different directions, and using said coordinates to form a 3-D image, e.g. by known CAD-computer software. The term “image” in the context of range finding means that all the measuring results during scanning result in a so-called point cloud which is often called “distance image”. However, it already been suggested to superimpose such a “distance image” by a two-dimensional image of the object scene, and in this case all ingredients necessary to form a 3-D image are present, i.e. a two-dimensional image plus the depth of the scene derived from the distance measurings which form the third dimension.
The invention relates also to an apparatus for carrying out the above described process.
2. Background Information
Since retro-reflectors, generally used as reference marks, have typically a size of about 25 mm×25 mm up to 100 mm×100 mm and modem range finders, at a beam divergence smaller than 1 mrad, e.g. 0.3 mrad, have a radius of action significantly larger than 1000 m, one cannot ensure that the range finder detects all reference marks. This may result in problems, particularly in the case of a measuring program which runs, to a high degree, automatically, and may result in the necessity to repeat measurements. Since the evaluation, particularly combining of a plurality of detail images and the assigned data files to obtain a 3-D model is, in general, made off-line and not in the field, this may lead to a considerable expenditure.
It is an object of the invention to ensure, in the case of the above-mentioned range finder systems, that reference marks are detected reliably.
In principle, one could chose the ratio of beam divergence and scanning rate so that the measuring spots of two subsequent measurement overlap each other to such a degree that even a reference mark, that is positioned far away, is reliably detected. But this would mean a very high number of measuring values and, thus, very long measuring times for the whole object space. So long a measuring time is, however, often not acceptable; first, if it is the question of non-stationary objects, second, if during taking up other events have to be interrupted, as it may be the case when documenting a traffic accident or in applications in industry. Thus, the above mentioned object should be achieved even with short measuring times.
According to the invention, these objects are achieved in that a second take-up step is carried out, using an enlarged divergence angle of the transmitted beam for determining the location of the reference marks in the form of coordinates for use as a reference in each first take-up step. Of course, the second take-up step comprises all the sub-steps that are comprised by the first take-up step.
This second take-up step could theoretically be carried out simultaneously with the first take-up step. However, this would necessitate two appliances, one of which does the first step, the other one the second step. Therefore, it is preferred if the steps are carried out in succession, particularly the second step before the first step. For if the second step is carried out after the first step, the determined location (coordinates) of the reference marks can only be inserted into the image taken in the first step in a separate procedure.
To change the divergence angle various devices may be used. For example, optical elements could be inserted in the path of rays of the transmitter during the first step, which make the divergence smaller; in the second step they are removed or change their focal length and/or the focus which means, in general, moving at least one lens along the optical axis. However, it is preferred to use optical elements which enlarge the divergence angle during the second step.
The optical elements can be assembled of more than one piece. In principle, they could consist of wedges, mirrors and so on. Preferred is to use at least one lens. For example a plurality of lenses could be used to form a zoom lens where at least one lens is movable to change the focal length and/or the focus.
There are alternative ways of using optical elements for varying the divergence angle. Either an optical element may be inserted into the path of rays of the transmitter and/or into the path of rays of the receiver.
Changing the divergence angle does not mean changing it insignificantly. A factor of at least 5 should be taken into consideration. However, it is preferred to have at least a factor of 10. On the other hand, choosing a factor too high would in most cases be impracticable. Therefore, a factor of 20 in maximum is contemplated.
According to another characteristic of the invention, the focus of the respective optical element is changed to adjust the divergence of angle either of the transmitter (which is preferred) and/or of the receiver.
It is particularly advantageous, if after the second take-up step has been carried out, details of the object space are taken up according to the first step where a reference mark has been determined, wherein scanning is effected with such an elevated resolution, as compared with said second step, that said angle of deflection between two subsequent measuring cycles is equal to or smaller than said first divergence angle so that said coordinates of the respective reference mark can be determined with high precision from said details taken-up.
Optionally, the distance value of a reference mark determined in the second step is used for focusing the optics onto this reference mark.
If at least two distance measurements are made using the enlarged divergence, the resulting distance values may advantageously be averaged.
Especially if retro-reflectors are used as reference marks in the object space, the amplitude of the echo-signal received can be so high that the receiver channel may be overexcited. This may lead to false results. To avoid this, a step of reducing the power of either the transmitter signals and/or of the received signals while determining the location of the reference marks to limit the dynamics of at least one of the signals received after reflection.
Preferably, this may be done by inserting an optical damping element, having a damping effect to optical signals, into the path of rays of the respective signal. As an example of such a damping element, a gray filter may be used.
The damping effect of the damping element may be continuously variable, e.g. by the use of a continuously variable aperture diaphragm or a gray wedge. The operation may be such, that after a first measurement the damping element is varied so that the receiver channel can be operated in its optimum dynamic range.
Alternatively, the damping effect of the damping element may be variable in steps. In this case, the damping element may be an apertured diaphragm having at least two apertures of different size, the smaller one being inserted in one of said path of rays during the second take-up step, the wider one being inserted in one of said path of rays during the first take-up step. In this case too, the damping element may be varied so that the receiver channel can be operated in its optimum dynamic range.
Especially if retro-reflectors are used as reference marks in the object space, at least one second receiver channel which is collinear and has a reduced sensitivity as compared with the first receiver channel may be used, wherein in the second take-up step the distance of a retro-reflector is measured by the second receiver channel. In such a case, it is suitable if all these receiver channels are evaluated simultaneously by using a multi-channel time measuring device. In this way, a single take-up step in which the whole object space is scanned, the entire dynamic range is determined with the highest possible precision.
Further details of the invention will become apparent from the following description of a preferred embodiment with reference to the drawing in which:
The laser scanner or measuring head 1, in this embodiment, has two parts, i.e. a first, stationary lower part 1 a firmly attached to the tripod 2, and a rotatable or pivotable upper part 1 b. This means that the upper part 1 b is rotatably mounted about a vertical axis (as is indicated in position A) on the lower part 1 a of the measuring head 1, and is driven to exert a movement to and fro according to arrows φ by a motor (not shown). The upper part 1 b of the measuring head 1 comprises a laser range finder system, at least part of an evaluating device and a rotating mirror prism (or other scanning device) which will be described below with reference to FIG. 4 and which deflects a measuring beam 15 of a certain divergence angle β about a horizontal axis up and down in correspondence with arrow α.
Thus, by the laser scanner 1, due to its pivoting movement over the angle φ and the rotation of the prism (8 in
After a first pick-up from the position A, the laser scanner 1 is transferred to position B, while the retro-reflectors 6 remain positioned as before. It will be understood that the invention is not restricted to re-position one laser scanner and to pick the object space up in succession, but it would equally be possible to use more than one laser scanners to be operated simultaneously.
In position B, the laser scanner 1 is again oriented towards the object 4, and a further pick-up is taken. In order to obtain a documentation of all aspects as precise as possible of the object 4, the laser scanner 1 may be then positioned in one or more different places (e.g. in position C). In any case, the data files obtained from the different places are then combined to form a 3-D model with customary software (such as CAD-software), in which step the reference marks 6 of each image picked up are rendered coincident.
As mentioned before, various reference marks are conceivable. For instance they may contain a coding mark to be automatically identified for later processing by a processor so that the processor may bring the same mark seen from different positions easily in registration or coincidence. Otherwise, an operator may be necessary to do this. As soon as the spatial coordinates of the reference marks 6 are defined, in any coordinate system desired, the object 4 may be included and positioned into this coordinate system by the processor. The 3-D model of the object 4 may then be represented from any side desired and may even be processed further using known CAD programs.
Principally, it would be desirable to chose the scanning rate (or the deviating angle α and/or φ between two measurements) so small that the measuring spots 20 overlap each other. On the other hand, such small scanning rates would lead to extremely long measuring times, which are often not acceptable, particularly if it is the question of large scanning areas (large object spaces to be picked up) or of not purely stationary objects. A ratio of scanning rate and beam divergence, as in
In general, retro-reflectors 6 are used as reference marks and have, typically, dimensions of about 50 mm×50 mm up to 100 mm×100 mm. With a radius of action of a modern laser scanner which is at about 1 km or significantly longer, the reference marks would appear under an angle so small that the probability that the measuring beam does not detect the reflectors is very high. In the case of
According to the invention, to avoid this the laser scanner 1 is switched over to a second measuring mode, wherein the divergence angle β (FIG. 1), which according to
By widening the beam, the energy impinging an area of an object (4 or 6) is reduced per unit of area so that the energy reflected from many objects will not be sufficient for evaluation. The retro-reflectors, however, will have a degree of reflection so high that even with positioning these reference marks at a large distance the reflected signal will have an amplitude totally sufficient for a reliable measurement. To the contrary, as will be explained later, often additional measures will be necessary to avoid overexciting the receiver device by too large amplitudes of the signals reflected from the retro-reflectors.
Since the individual measuring spots 22 of the above described second measuring mode, using a large divergence angle β (
Since, on the other hand, the precision, with which a 3-D model can be embedded or inserted into a superordinate system of coordinates, is determined primarily by the precise location or definition of the positions of the reference marks, it is possible, according to a further characteristic of the invention, only those partial and detailed areas of the object field are scanned at a low scanning rate, and thus with a high spatial resolution, in which a reference mark has been determined during the second scanning or take-up step.
Details of the principle of the invention will now be explained with reference to FIG. 4. This figure shows the measuring head 1 of
The evaluation stage 3 comprises also the circuitry for determining a distance value either from the counted time-of-flight or a time and phase relationship between transmitted and received signals. Therefore, the stage 3 is also coupled to the transmitting laser 9 and controls it. The laser 9 may consist of a laser diode, such as a GaAs-diode, of a solid laser or a gas laser, but consists advantageously of a diode pumped, grade switched solid laser.
An optic 10 is located in the path of rays of the transmitting laser 9 and will, in general, be adjusted so that it forms an image of the light source, i.e. the laser 9, in infinity. By the rotating mirror prism 8, the measuring beam 15 is deviated or deflected in the direction of arrow α which designates also the angle of deviation. A receiver channel is provided in parallel to the transmitter channel 9, 10 and comprises an optical system 13 and a receiver diode 14. The optical axis of this receiver channel 13, 14 is deflected by the mirror prism 8 in parallel to the measuring beam 15. However, it will be understood that the transmitter channel 9, 10 and the receiver channel 13, 14 may each have a separate prism with a separate drive motor, where these motors have to be synchronized.
Between the laser 9 and the optical system 10, there are two sliding carriers 25 and 26 each displaceable in a horizontal plane. The first sliding carrier 25 supports at least one, in the present embodiment two, lens systems 27 by which the measuring beam 15 is widened (i.e. the divergence angle β of
A second sliding carrier 26 supports at least one light damping element 28 which either reduces the effective power of the transmitting laser 9 and/or the amplitude of the received signal. In the present embodiment both possibilities are realized by having a damping element 28 in both channels 9, 10 and 13, 14. These damping elements may be chosen from a vast variety of damping elements known by those skilled in the art. A preferred embodiment uses a gray filter which is either a uniformly damping filter or a portion of a displaceable gray wedge which may be appropriately be adjusted by means known per se. Another possibility within the scope of the present invention is the use of a diaphragm which may either be a continuously adjustable aperture diaphragm (i.e. situated in an aperture plane) and/or an apertured diaphragm which is adjustable in steps by moving either of at least two apertures of different size into the respective path of rays. Both sliding carriers 25, 26 may be displaced either manually or by driving devices (not shown) to be moved into the respective path of rays or out of it. If a driving device is used, it is suitable that the evaluation stage 3 controls this driving device, such as a motor or an electromagnet.
Adjacent to the transmitter optics 10, a receiver optical system 13 is provided whose optical axis is parallel to that of the transmitter optics 10. The receiver optical system 13 concentrates radiation, generally diffusely, reflected from a target or object situated in the path of rays of the transmitter optics onto the receiver diode 14. Advantageously, an avalanche diode is used as a receiver diode 14. Preferably the spectral characteristics of the transmitting laser 9 and the receiving diode 14 are made compatible to each other so that the receiver diode 14 has its maximum spectral sensitivity in a range where the transmitting laser 9 emits maximum power. Since, however, the receiver diode 14, apart from the radiation transmitted by the laser 9 and reflected by an object (such as object 4 in FIG. 1), will receive much noise radiation in the form of daylight or light of various artificial light sources possible present in an object space, it may be advantageous to pre-pose an optical filter, which has narrow-band characteristics as good as possible, which provide a maximum transmission within a spectral band in which the wave length of the laser 9 has its maximum.
The receiver channel 13, 14 is capable of aiming to a plurality of targets and is controlled by a clock-generator 52 and comprises an amplifier and analogue signal processor stage 36 as well as an analogue/digital converter 37, where the transmitter pulse and the echo pulse(s) are digitized and further processed. Considering the constant time-of-flight of the reference transmitter pulse in the photoconductor 53, the time difference or interval between the arrival of the transmitter pulse through the photoconductor, and the echo pulse, and from this interval the distance of the respective object is determined. Although this method is preferred, it is within the scope of the present invention to determine the time-of-flight indirectly by comparing the phase-shift between transmitter signal and received signal of a continuous-wave signal.
The whole circuitry is clocked by a clock-generator 52. The processor 34 and the data memory 38 are coupled to each other by a data bus 39 schematically illustrated. Coupled to this data bus are also a program memory 40 for the processor 34 as well as an intermediate data memory 41 in which rough data are stores after the processor 34 has carried out a first evaluation, and which is read out at the end of a measuring cycle. Processor 34, using algorithms stored in program memory 40, determines from these rough data a distance value for each individual image element.
In addition to the receiver channel 13, 14 described, at least one further, collinear receiver channel 13′, 14′ of a reduced sensitivity may be provided and may be switched to become active by a switch S. When measuring the distances of the retro-reflectors 6 (
Controlling the driving motor 11 of the mirror prism 8 is done by a unit 45, while the motor 18 for pivoting the upper part 1 b of the measuring head is controlled by a unit 46. The processor 34 controls the program sequences of all three measuring modes described above and, therefore, controls also the switch S (which will normally be an electronic switch), as is indicated by a dotted line 51 connecting the switch S with the data bus 39. The necessary enlargement of the beam's divergence angle β (
The data files obtained from different scanning take-ups and which are taken up each by mode 1 and mode 3 plus per raster element (20 or 22 in
Further processing of a plurality of scanned images for generating a 3-D model of the object space, as has been described with reference to
It will be appreciated by those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restricted. The scope of the invention is indicated by the appended claims rather than the foregoing description and all changes that come within the meaning and range and equivalence thereof are intended to be embraced therein.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4950075 *||May 2, 1989||Aug 21, 1990||Hitachi, Ltd.||Method of detecting an object by use of laser light and laser radar|
|US5361217 *||May 5, 1993||Nov 1, 1994||Fuji Photo Optical Co., Ltd.||Position measuring/plotting apparatus|
|US5988862 *||Apr 24, 1996||Nov 23, 1999||Cyra Technologies, Inc.||Integrated system for quickly and accurately imaging and modeling three dimensional objects|
|US6563574 *||Dec 28, 2001||May 13, 2003||Kabushiki Kaisha Topcon||Surveying apparatus|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7135672 *||Dec 20, 2004||Nov 14, 2006||United States Of America As Represented By The Secretary Of The Army||Flash ladar system|
|US7206063||Mar 28, 2006||Apr 17, 2007||Deere & Company||Optical range finder with directed attention|
|US7382443||Dec 7, 2006||Jun 3, 2008||Kabushiki Kaisha Topcon||Distance measuring method and distance measuring device|
|US8077293||Mar 17, 2009||Dec 13, 2011||Kabushiki Kaisha Topcon||Surveying device and surveying system|
|US8577126||Apr 11, 2008||Nov 5, 2013||Irobot Corporation||System and method for cooperative remote vehicle behavior|
|US8730457||Nov 30, 2011||May 20, 2014||Sick Ag||Sensor arrangement for object recognition|
|US20090180668 *||Mar 17, 2009||Jul 16, 2009||Irobot Corporation||System and method for cooperative remote vehicle behavior|
|US20110121160 *||Sep 20, 2010||May 26, 2011||Cedes Ag||Sensor for monitoring a monitored area|
|CN1987518B||Dec 20, 2006||Mar 21, 2012||株式会社拓普康||距离测定方法以及距离测定装置|
|DE102010060942A1 *||Dec 1, 2010||Jun 6, 2012||Sick Ag||Sensoranordnung zur Objekterkennung|
|EP1801538A2 *||Dec 1, 2006||Jun 27, 2007||Kabushiki Kaisha TOPCON||Distance measuring method and distance measuring device|
|EP2103902A1||Mar 11, 2009||Sep 23, 2009||Kabushiki Kaisha Topcon||Surveying Device and Surveying System|
|U.S. Classification||356/5.01, 382/154, 356/141.1, 356/612|
|International Classification||G01B11/03, G01C15/00, G01S7/481, G01S17/10, G01S17/89, G01S17/42|
|Cooperative Classification||G01S17/10, G01S7/4817, G01S17/42, G01S7/4813, G01S7/4868, G01S17/89, G01C15/002|
|European Classification||G01S7/481E, G01S7/486E, G01C15/00A, G01S7/481B2, G01S17/89|
|Dec 19, 2002||AS||Assignment|
|Sep 22, 2008||FPAY||Fee payment|
Year of fee payment: 4
|Sep 27, 2012||FPAY||Fee payment|
Year of fee payment: 8