CA2272357C - A system for determining the spatial position of a target - Google Patents
A system for determining the spatial position of a target Download PDFInfo
- Publication number
- CA2272357C CA2272357C CA002272357A CA2272357A CA2272357C CA 2272357 C CA2272357 C CA 2272357C CA 002272357 A CA002272357 A CA 002272357A CA 2272357 A CA2272357 A CA 2272357A CA 2272357 C CA2272357 C CA 2272357C
- Authority
- CA
- Canada
- Prior art keywords
- target
- passive
- energy
- active
- targets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/87—Combinations of systems using electromagnetic waves other than radio waves
- G01S17/875—Combinations of systems using electromagnetic waves other than radio waves for determining attitude
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/74—Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
- G01S5/163—Determination of attitude
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
- A61B2034/2057—Details of tracking cameras
Abstract
A system for determining the spatial position of a target having an active target adapted to emit energy in response to an active signal and a passive target adapted to reflect energy impinging upon such passive target from an active energy source. A common energy detector is provided for detecting both the energy emitted by the active target and the energy reflected by the passive target. A common processor is provided for determining the spatial positions of both the passive and active targets in response to the energy detected by the common detector. During a sensor cycle the spatial position of the active target is determined and during a sensor cycle the position of the passive target is determined. The sensor cycles may be interspersed or may be the same cycle to enable simultaneous determination of both the active target and the passive target during a single sensor cycle. The system also enables the determination of the spatial position and angular orientation of both a rigid object having affixed thereto active targets and/or another rigid object having affixed thereto passive targets and/or an object having affixed thereto both an active and passive targets.
Description
A SYSTEM FOR DETERMINING THE SPATIAL POSITION OF~A TARGET
Background of the Invention This invention relates generally to systems for determining the spatial position of a target and more particularly to systems of such type which are adapted to determine the spatial position of both active and passive targets. Still more particularly, the invention relates to systems adapted to determine the spatial positions and angular orientations of one object having active targets mounted thereto and another object having passive targets mounted thereto.
As is known in the art, systems are available for determining the spatial position and angular orientation of an object. One such system includes passive retro-reflectors as point markers, or targets, affixed to the object and a second system includes active radiating emitters as the affixed point markers, or targets. Both techniques operate by projecting the image of a high contrasting target onto spaced sensors and using mathematical processing to determine the three dimensional coordinates of each one of the point targets.
These three dimensional coordinates (i.e., 3D) are then used as discrete points, or may be considered as a set if their geometric arrangement is known, resulting in the determination of the position and angular orientation of the object (i.e., six degrees of freedom: x,y and z positions and pitch, yaw and roll angular orientations) in space relative to a three dimensional coordinate system centered at a preselected point in space, typically at a point fixed relative to the sensors.
Both active and passive targets operate by projecting the image of a high contrasting target onto spaced sensors and use mathematical processing to determine the spatial position of each one of the targets relative to a three dimensional coordinate system the SUBSTITUTE SHEET (RULE 26)
Background of the Invention This invention relates generally to systems for determining the spatial position of a target and more particularly to systems of such type which are adapted to determine the spatial position of both active and passive targets. Still more particularly, the invention relates to systems adapted to determine the spatial positions and angular orientations of one object having active targets mounted thereto and another object having passive targets mounted thereto.
As is known in the art, systems are available for determining the spatial position and angular orientation of an object. One such system includes passive retro-reflectors as point markers, or targets, affixed to the object and a second system includes active radiating emitters as the affixed point markers, or targets. Both techniques operate by projecting the image of a high contrasting target onto spaced sensors and using mathematical processing to determine the three dimensional coordinates of each one of the point targets.
These three dimensional coordinates (i.e., 3D) are then used as discrete points, or may be considered as a set if their geometric arrangement is known, resulting in the determination of the position and angular orientation of the object (i.e., six degrees of freedom: x,y and z positions and pitch, yaw and roll angular orientations) in space relative to a three dimensional coordinate system centered at a preselected point in space, typically at a point fixed relative to the sensors.
Both active and passive targets operate by projecting the image of a high contrasting target onto spaced sensors and use mathematical processing to determine the spatial position of each one of the targets relative to a three dimensional coordinate system the SUBSTITUTE SHEET (RULE 26)
-2-origin of which is at a pre-selected point in space, typically at a point fixed relative to the sensors. The spatial positions of the targets can be used in many applications. For example, several discrete targets can be affixed to points of interest on a human subject. The human subject can then conduct a series of motions while the system determines spatial position data for each of the various targets affixed to the human subject. The data can be graphically displayed and/or collected and stored for use in a multitude of applications. One of the uses for the data is to provide information to medical professionals conducting medical assessments or diagnosis of the subject's movements. Another use for the data collected is to transfer it to a computer animation software package to create movements in an animated character which are comparable to those made by the human subject. In another example, two or more of the targets may be rigidly affixed to an object in a known geometric arrangement. The system then considers the rigidly affixed targets as a set resulting in the determination of the spatial position of the object and, in the case where two targets are used, the vector angle of the object or, in the case where three or more targets are used, the angular orientation of the object.
Determining the spatial position and either the vector angle or angular orientation of an object has several uses. For example, a pointing device can be made out of the object whereby the end tip of the pointing device is in a known position relative to the targets. Such a pointing device can be used as a digitizing pointer held by hand as in reverse engineering applications. An operator moves this pointing object to various known places on a manufactured component and the accuracy of the manufacturing processes is determined from analysis of the determined end tip position of the pointing device.
SUBSTITUTE SHEET (RULE 26)
Determining the spatial position and either the vector angle or angular orientation of an object has several uses. For example, a pointing device can be made out of the object whereby the end tip of the pointing device is in a known position relative to the targets. Such a pointing device can be used as a digitizing pointer held by hand as in reverse engineering applications. An operator moves this pointing object to various known places on a manufactured component and the accuracy of the manufacturing processes is determined from analysis of the determined end tip position of the pointing device.
SUBSTITUTE SHEET (RULE 26)
3 PCT/CA98/00911 In one emitting target (i.e., active target) system, multiple charge couple device (CCD) sensors are used to detect the energy emitted by the target. A single point target is energized per sensor cycle to emit infrared energy. During each sensor cycle, the emitted energy focused onto the sensor is collected (i.e. integrated) and shifted to the sensor processing circuitry. In order to determine the 3D position of the target, the target must be detected on at least three sensor axes (i.e. to cover a minimum of 3 orthogonal planes). There are many advantages to a system which uses emitting targets including high contrast images being produced on the sensors, control over activation of each of the targets affording positive and automatic target discrimination, and the ability to use high speed linear sensors. These systems, however, are designed to work with only active point targets.
In one retro-reflective target (i.e., passive target) system, an energy source is energized to emit infrared energy in the general direction of the retro-reflective target. Multiple CCD sensors are then used to detect the energy reflected by the target. During each sensor cycle, the reflected energy focused onto the sensor is collected (i.e., integrated) and shifted to the sensor processing circuitry. In order to determine the 3D position of the target, the target must be detected on at least three sensor axes (i.e. to cover a minimum of 3 orthogonal planes). There are many advantages to a retro-reflective target system including the use of wireless targets and the ability to use inexpensive low speed area array sensors. These systems, however, are designed to wark with only passive point targets.
In some applications, such as in an image guided surgical procedure where instrument pose is being tracked with respect to the patient, certain surgical instruments have affixed to them active targets and other surgical SUBSTITUTE SHEET (RULE 26)
In one retro-reflective target (i.e., passive target) system, an energy source is energized to emit infrared energy in the general direction of the retro-reflective target. Multiple CCD sensors are then used to detect the energy reflected by the target. During each sensor cycle, the reflected energy focused onto the sensor is collected (i.e., integrated) and shifted to the sensor processing circuitry. In order to determine the 3D position of the target, the target must be detected on at least three sensor axes (i.e. to cover a minimum of 3 orthogonal planes). There are many advantages to a retro-reflective target system including the use of wireless targets and the ability to use inexpensive low speed area array sensors. These systems, however, are designed to wark with only passive point targets.
In some applications, such as in an image guided surgical procedure where instrument pose is being tracked with respect to the patient, certain surgical instruments have affixed to them active targets and other surgical SUBSTITUTE SHEET (RULE 26)
-4-instruments have affixed to them passive targets. Thus, when the surgeon is performing a procedure during an operation which requires an instrument having passive targets, such instrument, along with its sensors, processor and display are used by the surgeon. Once that procedure is performed and the surgeon requires an instrument having passive targets, such instrument along with its sensors, processors and display are used by the surgeon.
Summary of the Invention In accordance with a first broad aspect, the present invention provide a system for determining the spatial position of a target having an active optical target adapted to emit optical energy in response to an active signal; and a passive optical target adapted to reflect optical energy impinging upon such passive optical target.
A common energy detector is provided for detecting both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target. A
common processor is provided for determining the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector. During a first sensor cycle the spatial position of the active optical target is determined and during a second sensor cycle the position of the passive optical target is determined. The sensor cycles may be interspersed, or the sensor cycles may be the same to enable simultaneous detection of both the active optical target and the passive optical target during a single sensor cycle.
In accordance with another feature of the invention, a system is provided for determining the spatial position and angular orientation of a rigid object having affixed thereto active targets and/or a rigid object having _5_ affixed thereto passive targets and/or a rigid body having affixed thereto both a passive target and an active target.
The active and passive targets are affixed to their respective rigid objects in known, fixed relationship to each other and to the geometry of the object. A common energy detector is provided for detecting the energy emitted by the active targets affixed to one object, the energy reflected by the passive target affixed to the other object or both the energy emitted from the active target and the energy reflected by the passive target which are affixed to the same rigid body. A common processor is provided for determining the spatial position of the object in response to the energy detected by the common detector. During a sensor cycle the spatial position of the active target is determined and during a sensor cycle the position of the passive target is determined. The sensor cycles may be interspersed, or the sensor cycles may be the same to enable simultaneous detection of both the active target and the passive target during a single sensor cycle.
In accordance with another feature of the invention, a display is provided for depicting the determined spatial orientation and position of the objects having active and passive targets.
With such arrangement, the use of a common detector for both the active and passive targets enables the common processor to use the same processing steps in determining the spatial orientation of both the active and passive target affixed objects. Further, in a surgical environment, the surgeon has a system adapted to operate with both active and passive targets and is thereby able to view on a common display one instrument having active targets affixed to it, and/or another instrument having -5a-passive targets affixed to it and/or another object having both active and passive targets affixed to it.
In accordance with a second broad aspect, the invention provides a method for determining the spatial position of a target, comprising: affixing a passive optical target to an object; affixing an active optical target to an object; detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector; wherein during a first sensor cycle the spatial position of the active optical target is determined; wherein during a second sensor cycle the position of the passive optical target is determined.
In accordance with a third broad aspect, the invention provides a method for determining the spatial position and angular orientation of objects, comprising:
affixing a plurality of passive optical targets to one of the objects; affixing a plurality of active optical targets to another one of the objects; detecting with a common energy detector both the optical energy emitted by the active optical targets and the optical energy reflected by the passive optical targets; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector; wherein during a first sensor cycle the spatial position of the active optical targets is determined; wherein during a second sensor cycle the position of the passive optical targets is determined.
-5b-In accordance with a fourth broad aspect, the invention provides a method for determining the spatial position of an object, comprising: affixing a passive optical target and an active optical target to the object;
detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector; wherein during a first sensor cycle the spatial position of the active optical target is determined; wherein during a second sensor cycle the position of the passive optical target is determined.
Brief Description of the Drawings Other features of the invention will become more readily apparent with reference to the following description taken together with the following drawings, in which:
FIG. 1 is a block diagram of a system for determining the spatial position and orientation of a pair of rigid objects according to the invention;
FIGS. 2 and 3 are diagrammatic sketches of the system of FIG. 1;
FIG. 4 is a diagram useful in understanding the retro-reflective characteristics of an exemplary passive target used in the system of FIGS. 1-3;
FIGS. 5A-5D are timing diagram showing the various operating patterns of the system of FIGS. 1-3, FIG. 5A
showing an active only mode, FIG. 5B showing a passive only mode. FIG. 5C showing an interspersed active-passive mode and FIG. 5D showing a simultaneous active-passive mode;
FIG. 6 is a sketch of a display used in the system of FIG. 1, such display showing a pair of objects, the spatial orientation and position of one of the objects being obtained with such object having affixed thereto active targets and the spatial orientation and position of the other one of the objects being obtained with such object having affixed thereto passive targets; and FIG. 7 shows an object having both active and passive targets affixed thereto, such targets being detectable by the system of FIG. 1.
Description of the Preferred Embodiments Referring now to FIG. 1, a system 10 for determining the spatial position and orientation of either or both of a pair of rigid object 12a, 12b is provided. Here, the rigid objects 12a, 12b are different surgical instruments. Here, rigid body 12a has a plurality of, here four, passive, retro-reflecting point targets 14a affixed thereto. Here, each of the energy retro-reflecting targets 14a includes a sphere, affixable to object 12a, covered with a retro-reflective material as SUBSTITUTE SHEET (RULE 26) _7_ is generally available and well known in the art. As is also known in the art, other types of energy retro-reflecting targets are available such as flat disks affixable to the object 12a, covered with a retro-reflective material as is generally available. The targets 14a are affixed to object 12a in a known, fixed relationship to each other and to the geometry of the object 12a.
Here, rigid body 12b has a plurality of active point l0 targets 14b affixed thereto. The targets 14b are affixed to object 12b in a known, fixed relationship to each -other and to the geometry of the object 12b. The active targets 14b are fed via a cable 16 to a controller 18, as shown. Here, the energy emitting targets 14b include an infrared energy emitting diode which, upon being energized with electrical energy fed thereto by controller 18 via cable 16, emits infrared light energy.
Such infrared energy emitting diodes are generally available and well known in the art.
Referring also to FIG. 2, a common energy detection system 20 is provided for detecting both the energy emitted by the active targets 14b affixed to object 12b and the energy reflected by the passive targets 14a affixed to the other object 12a. The common detector system 20 includes a pair of spaced sensor assemblies 21L
and 21R. Each one of the sensor assemblies 21L, 21R
includes: a, here two two-dimensional, charge couple device (CCD) sensor 22L, 22R (FIGS. 1 and 3), respectively; an annular mounting ring 25L, 25R, respectively; a focusing lens 23L, 23R mounted centrally within the annular mounting ring 25L, 25R, respectively, as shown; and, a plurality of light emitting diodes 27L, 27R mounted to a respective one of the annular mounting rings 25L, 25R, as shown.
Each of sensor assembly 21R and 21L has its own u, v, zs co-ordinate system aligned with its associated SUBSTITUTE SHEET (RULE 26) _g_ directional infrared energy source, i.e., light emitting diodes 27L, 27R, respectively. The diodes 27L, 27R are evenly distributed circumferentially about the zs axis of each of sensor assemblies 21R and 21L. The plurality of infrared emitting diodes 27L, 27R is energized with electrical energy by a processor section 19. The processor section 19 includes a processor 26, host computer 30, display 32 and controller 18. The processor 26 energizes the diodes 27L, 27R via a signal on line 29, the plurality of infrared emitting diodes 27L, 27R
operate to produce an incident directional energy beam 40I (FIG. 4) of infrared energy with a direction of propagation aimed along a directional axis which generally corresponds to the z6 axis of each of the sensor assemblies 22L, 22R associated with that directional infrared energy source. The incident directional energy beam created by the directional infrared energy source is of a size, shape and intensity that corresponds to the volumetric field of view of its associated sensor 22L, 22R and sufficient to provide an incident directional energy beam throughout the measurement volume 28 (FIG.
1) .
The sensor assemblies 21L, 21R are each able to produce output signals on lines 24L, 24R, respectively, which represent the intensity of energy focused thereon.
During each sensor cycle, the energy focused thereon is collected (i.e. integrated) and then shifted to a processor 26. Here, the sensor assemblies 21L and 21R
are mounted to a fixed reference and are separated from each other by a predetermined distance, D, (FIG. 2) here 500mm. Here, the sensor assemblies 21L, 21R each have a field of view sufficient to observe a common measurement volume 28 of approximately 1m3 centered along the z axis at approximately 1.9m from the origin point which is midway between the lenses 23L and 23R.
SU9STiTUTE SHEET (RULE 26) _g_ As noted above, each of sensor assemblies 21R and 21L has its own associated lens 23L, 23R, respectively, for focusing both the reflected energy from the energy retro-reflecting targets 14a and the emitted energy from the energy emitting targets 14b, in order to create a focused energy image of the emitted or reflected energy from the targets 14b, 14a, respectively on the lens' 23L, 23R associated sensor assemblies 21R, 21L, respectively.
The processor 26 coupled to the sensors 22R and 22L
determine the two-dimensional u, v positions of the focused energy image on each of the sensors 22R and 22L.
Then, using the u, v position of the focused energy image of the same target 14a, 14b on each of the sensors 22R
and 22L to perform mathematical computations known in the art which computations include comparing the u, v positions of the focused energy image to a data set of known spatial positions relative to the origin of a common, fixed x, y, z co-ordinate system in order to determine the spatial position the target 14a, 14b in relation to the common co-ordinate system. The processor 26 is coupled to the host computer 30 in order that the spatial position of the targets 14a, 14b can be displayed on display 32 or further processed by the host computer 30. As noted above, the processor 26 is coupled to the directional infrared energy sources 27L, 27R in order that the processing section 19 can activate the directional infrared energy sources 27R and 27L at appropriate times during an energy reflecting target detection mode. The processor 26 is also coupled to the controller 18 in order that the processor 26 can signal the controller 18 to activate the energy emitting targets 14b in the required manner during an energy emitting target detection mode. Thus, there are two operating modes of the system 10: an active mode (i.e., target 14b emitting mode); and a passive mode (i.e., target 14a reflecting mode). These modes may be operated in a SU8STtTUTE SHEET (RULE 26) manner to be described in detail in connection with FIGS.
5A-5D. Suffice it to say here, however, that the processor section 19 common processor for both modes and is adapted to determine the spatial positions of both the passive and active targets in response to the energy detected by the common detector (i.e., sensors 22R and 22L) during a sequence of sensor cycles. During a first portion of the sensor cycles the spatial position of the active target is determined and during a second portion of the cycles the position of the passive target is determined. The sensor cycles in the first portion may be interspersed with the sensor cycles in the second portion, or cycles in the first and second portions may overlap to enable simultaneous determination of both the active target and the passive target during a single sensor cycle. It is noted that the position of either an active target or a passive target may be determined in a single sensor cycle. Thus, the processing of a sensor cycle for active target or targets may, for example be interspersed with the processing of a sensor cycle for the passive target or targets. Further, a plurality of active target sensor cycles may occur followed by the processing of one or more passive target sensor cycles.
That is, the active and passive cycles may be interspersed. Further, the sensor cycle may be the same to enable simultaneous detection of both the active target and the passive target during a single sensor cycle.
Thus, the controller 18 is provided for controlling the activation of the energy emitting targets 14b. More particularly, the controller 18 is coupled to one or more of the energy emitting targets 14b and is, upon receiving the appropriate signal or signals from the processor 25, able to activate one or more of the energy emitting targets 14b either individually, individually in a sequence specified by the processor 26, all at the same SUBSTITUTE SHEET (RULE 26) time, or in subsets specified by the processor 26 in a manner described in our co-pending patent application Serial No. 08/603,791 entitled "System for Determining the Spatial Position and Angular Orientation of an Object", filed February 20, 1996 and assigned to the same assignee as the present invention.
The system 10 operates in one of a plurality of operating mode patterns as selected by the user. These patterns will be described in detail in connection with FIGS, 5A-5D. When the processor 26 operates in the energy reflecting target mode, the processor 26 activates each of the directional infrared energy sources 27L, 27R.
In response to the delivery of such electrical energy, the infrared emitting diodes 27L, 27R emit energy, here infrared energy, which energy combines in an incident directional energy beam with a direction of propagation aimed along a directional axis which generally corresponds to the z5 axis of the sensor assemblies 22L, 22R. The energy retro-reflecting targets 14a located in the measurement volume 15 operate to retro-reflect the incident directional energy beam. Referring again to FIG. 2, an _ncident directional energy beam 40I from a directional infrared energy source 27L, or 27R is reflected by a retro-reflecting target i4a such that the majority of the retro-reflected energy 40R is reflected in a manner such that it is parallel to the incident directional energy beam 40I but with the opposite direction of propagation (as opposed to simple reflection whereby, as is well known in the art, energy is reflected such that the angle between the incident energy ray and the normal to the point on the surface where said incident energy ray is reflected is equal to the angle between the reflected energy ray and the said normal to the point of reflection). Retro-reflecting as used in the invention is well known in the art. The incident directional energy beam 40I emitted by the directional infrared energy source 27L, for example, and acting upon an energy retro-reflecting target 14a will result in a reflected directional energy beam 40R having a direction of propagation only toward lens 23L, the sensor 22L and none of the reflected directional energy beam 40R
propagating toward lens 23R and sensor 22R. Likewise, the incident directional energy beam 40I emitted by the directional infrared energy source 27R and acting upon an energy retro-reflecting target 14a will result in a reflected directional energy beam 40R having a direction of propagation only toward lens 23R and sensor 22R and none of the reflected directional energy beam 40R
propagating toward lens 23L and sensor 22L. The reflected directional energy beam 40R is therefore propagating in the direction from whence it originated.
Thus, in the case of energy initially created by the directional infrared energy source 27R, the reflected directional energy beam 40R will be collected by lens 23R
and focused by lens 23R onto sensor 22R.
In the passive target operating mode, the directional infrared energy sources 27L, 27R are activated by the processor 26. When a retro-reflective target 14a is situated in space such that it is within the directional beam of the directional infrared energy source (thereby illuminated by the said directional energy source) and the field of view of the CCD sensors 22L, 22R, the directional infrared energy is retro-reflected by the retro-reflective target 14a back through lenses 23L, 23R, which focus the energy image onto the CCD sensors 22L, 22R, respectively. Thus, infrared energy retro-reflected by a passive target 14a located in the field of view of the CCD sensor 22L, 22R is collected through lenses 23L, 23R, respectively, which focuses the energy image onto the CCD sensor 22L, 22R, respectively.
SUBSTITUTE SHEET (RULE 26) *rB
I .
During the active target mode, the infrared energy emitting targets 14b are activated by the emitting target controller 18, causing the emitting targets 14b to emit infrared energy. Infrared energy emitted by an emitting target 14b located in the field of view of the CCD sensor 22L, 22R is collected through lenses 23L, 23R, respectively, which focuses the energy image onto the CCD
sensor 22L, 22R, respectively.
During either the active target mode of the passive target mode, the energy image is shifted out of the two dimensional CCD sensors 22L, 22R during each cycle of the sensors 22L, 22R into the processor 26. The processor 26 is programmed to determine the position of the energy focuses image. Thus, the processor 26 uses the same processing for both the active target mode and the passive target mode to determine the spatial position of each object 12a, 12b.
Referring to FIGS. 5A-5D various operating patterns are shown. One pattern, (i.e., an active only pattern) is shown in FIG. 5A. Here, only the targets 14b are activated via a pulse on line 16 during each of a sequence of sensor cycles. Another pattern (i.e., a passive only pattern) is shown in FIG. 5B. Here, only sources 27L, 27R are activated via a pulse on line 29 during each of a sequence of sensor cycles. Another pattern {i.e., an interspersed pattern) is shown in FIG.
5C. Here, the activation of sources 27L, 27R and the activation of targets 14b with pulses on line 29 are interspersed with pulses on line 16. Thus, here, the common processor determines the spatial positions of both the passive and active targets in response to the energy detected by the common detector during a sequence of interspersed active-passive sensor cycles. Still another pattern (i.e., a simultaneous pattern) is shown in FIG.
5D. Here, the activation of sources 27L, 27R and the activation of targets 14b with pulses on line 29 are SUBSTITUTE SHEET (RULE 26) simultaneous with the activation of targets 14b with pulses on line 16 during each of a sequence of sensor cycles. Thus, here, the common processor determines the spatial positions of both the passive and active targets in response to the energy detected by the common detector during each of a sequence of simultaneous active-passive sensor cycles.
Thus, from FIGS. 5C and 5D it is noted that during a first portion of the sensor cycles the spatial position of an active target is determined and during a second portion of the cycles the position of the passive target is determined. The sensor cycles in the first portion may be interspersed with the sensor cycles in the second portion, as in FIG. 5C, or cycles in the first and second portions may overlap to enable simultaneous determination of both the active target and the passive target during each of a sequence of single sensor cycles, as in FIG.
5D.
It is also noted from the foregoing that the use of the common detector for both the active and passive targets enables the common processor to use the same processing steps in determining the spatial orientation of both the active and passive target affixed objects.
The position of each of the targets 14a and targets 14b is communicated to the host computer 30 by the processor 26. The computer 30 can be programmed to enable concurrent display of both object 12a and object 12b as shown in FIG. 6. Alternatively, the information from the computer may be stored for later display and/or further processing.
Thus, the system 10 includes: a single or a plurality of activatable emitting point targets 14b, preferably infrared emitting target points, affixable to object 12b; and/or a single or a plurality of retro-reflective point targets, preferably highly reflective retro-reflective targets, affixable to object 12a; a SUBSTITUTE SHEET (RULE 26) sensor section 20, preferably a pair of infrared sensing two dimensional array, CCD sensors, for providing signals representative of positional information of energy collected by the sensor's from either or both of emitting point targets 14b or retro-reflective point targets 14a;
a processing section 19 (which includes a processor 26, preferably a micro-processor, a controller 18, and a host computer 30) responsive to the signals produced by the sensor section 20. The processing section 19 is programmed to determine the position of the active point targets 14b and/or the passive point targets 14a and for determining the spatial position of the point targets 14a, 14b and, optionally, the spatial position and orientation of objects 12a and/or 12b. The system 10 includes an energy source, preferably a plurality of directional infrared emitters 27L, 27R, fixed in relation to the sensors 22L, 22R by preferably surrounding each of the pairs of sensors 22L, 22R as assemblies 21L, 21R, respectively, where the directional beam of the emitters will illuminate the field of view of the sensors 22L, 22R
it surrounds with infrared energy by directing said directional beam along an axis which corresponds to the axis projecting perpendicularly through the area centroid of the two dimensional array CCD sensor 22L, 22R. The emitters 27L, 27R are controllable to be activated as directed by the aforementioned processor section 19. The controller 18 provides for the sequenced control and activation of a plurality of emitting point targets 14b activated as directed by processor section 19.
Referring to FIG. 7 an object 12c is shown with a combination of active and passive targets adapted for detection and processing by the processor section 19. It is also noted that various combinations of passive and active targets and objects may be used, including a single passive and/or active target.
SUBSTITUTE SHEET (RULE 26) WO 99117133 PCTICA9$/00911 Other embodiments are within the spirit and scope of the appended claims. For example, while the determination of the location of at least three of the point targets 14a, 14b is required for 6D position and angular orientation determination, if less than a six degrees of freedom (6D) determination is desired (i.e., a position of, and a vector along, the object 12a, 12b) the determination of the location of only two of the targets 14a, 14b on each object 12a, 12b, respectively, is required. Further, while the sensor section 20 described above included a pair of spaced 2D sensors 22L, 22R, such sensor section 20 may include other sensor arrangements.
For example, the sensor section 20 may include a single 2D sensor, a pair of linear sensors, or other suitable arrangement of sensors.
For example, although individual point targets are shown, here with 4 retro-reflective point targets 14a, and 4 emitting point targets 14b, the position of, and angle along, a rigid object could be determined with 2 or more retro-reflective targets 14a, or 2 or more active radiating targets 14b, or any combination of 1 or more of each retro-reflective targets 14a and active radiating targets 14b. Further, although the determination of the position and orientation of rigid objects 12a, 12b is shown here, if only the position of the object 12a or 12b is desired it can be determined with a single retro-reflective target 14a or a single active radiating target 14b. Still further, although here position sensor system 10, uses a pair of two dimensional image sensors 22L, 22R, a mathematical process is available which uses a single two dimensional image sensor 11, or two one dimensional image sensors, which can determine the position and orientation of an object with 3 or more targets, by using knowledge of the relative position of said targets and an initial estimate of the position of the object. Also, although here position sensor system SUBSTITUTE SHEET (RULE 26) 10, uses a pair of two dimensional image sensors 22L, 22R, a mathematical process is available which uses N two dimensional image sensors, where N is 2 or greater, or M
one dimensional image sensors, where M is 3 or greater, which can determine the position of a target. Here, position sensor system 10 uses a pair of two dimensional image sensors 11, which are fixed in relative position and orientation, it is possible to have the image sensors free to be repositioned prior to use and a calibration sequence is employed prior to tracking the positions of point targets which will determine the relative position and orientation of the two dimensional image sensors.
SUBSTITUTE SHEET (RULE 26)
Summary of the Invention In accordance with a first broad aspect, the present invention provide a system for determining the spatial position of a target having an active optical target adapted to emit optical energy in response to an active signal; and a passive optical target adapted to reflect optical energy impinging upon such passive optical target.
A common energy detector is provided for detecting both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target. A
common processor is provided for determining the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector. During a first sensor cycle the spatial position of the active optical target is determined and during a second sensor cycle the position of the passive optical target is determined. The sensor cycles may be interspersed, or the sensor cycles may be the same to enable simultaneous detection of both the active optical target and the passive optical target during a single sensor cycle.
In accordance with another feature of the invention, a system is provided for determining the spatial position and angular orientation of a rigid object having affixed thereto active targets and/or a rigid object having _5_ affixed thereto passive targets and/or a rigid body having affixed thereto both a passive target and an active target.
The active and passive targets are affixed to their respective rigid objects in known, fixed relationship to each other and to the geometry of the object. A common energy detector is provided for detecting the energy emitted by the active targets affixed to one object, the energy reflected by the passive target affixed to the other object or both the energy emitted from the active target and the energy reflected by the passive target which are affixed to the same rigid body. A common processor is provided for determining the spatial position of the object in response to the energy detected by the common detector. During a sensor cycle the spatial position of the active target is determined and during a sensor cycle the position of the passive target is determined. The sensor cycles may be interspersed, or the sensor cycles may be the same to enable simultaneous detection of both the active target and the passive target during a single sensor cycle.
In accordance with another feature of the invention, a display is provided for depicting the determined spatial orientation and position of the objects having active and passive targets.
With such arrangement, the use of a common detector for both the active and passive targets enables the common processor to use the same processing steps in determining the spatial orientation of both the active and passive target affixed objects. Further, in a surgical environment, the surgeon has a system adapted to operate with both active and passive targets and is thereby able to view on a common display one instrument having active targets affixed to it, and/or another instrument having -5a-passive targets affixed to it and/or another object having both active and passive targets affixed to it.
In accordance with a second broad aspect, the invention provides a method for determining the spatial position of a target, comprising: affixing a passive optical target to an object; affixing an active optical target to an object; detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector; wherein during a first sensor cycle the spatial position of the active optical target is determined; wherein during a second sensor cycle the position of the passive optical target is determined.
In accordance with a third broad aspect, the invention provides a method for determining the spatial position and angular orientation of objects, comprising:
affixing a plurality of passive optical targets to one of the objects; affixing a plurality of active optical targets to another one of the objects; detecting with a common energy detector both the optical energy emitted by the active optical targets and the optical energy reflected by the passive optical targets; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector; wherein during a first sensor cycle the spatial position of the active optical targets is determined; wherein during a second sensor cycle the position of the passive optical targets is determined.
-5b-In accordance with a fourth broad aspect, the invention provides a method for determining the spatial position of an object, comprising: affixing a passive optical target and an active optical target to the object;
detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector; wherein during a first sensor cycle the spatial position of the active optical target is determined; wherein during a second sensor cycle the position of the passive optical target is determined.
Brief Description of the Drawings Other features of the invention will become more readily apparent with reference to the following description taken together with the following drawings, in which:
FIG. 1 is a block diagram of a system for determining the spatial position and orientation of a pair of rigid objects according to the invention;
FIGS. 2 and 3 are diagrammatic sketches of the system of FIG. 1;
FIG. 4 is a diagram useful in understanding the retro-reflective characteristics of an exemplary passive target used in the system of FIGS. 1-3;
FIGS. 5A-5D are timing diagram showing the various operating patterns of the system of FIGS. 1-3, FIG. 5A
showing an active only mode, FIG. 5B showing a passive only mode. FIG. 5C showing an interspersed active-passive mode and FIG. 5D showing a simultaneous active-passive mode;
FIG. 6 is a sketch of a display used in the system of FIG. 1, such display showing a pair of objects, the spatial orientation and position of one of the objects being obtained with such object having affixed thereto active targets and the spatial orientation and position of the other one of the objects being obtained with such object having affixed thereto passive targets; and FIG. 7 shows an object having both active and passive targets affixed thereto, such targets being detectable by the system of FIG. 1.
Description of the Preferred Embodiments Referring now to FIG. 1, a system 10 for determining the spatial position and orientation of either or both of a pair of rigid object 12a, 12b is provided. Here, the rigid objects 12a, 12b are different surgical instruments. Here, rigid body 12a has a plurality of, here four, passive, retro-reflecting point targets 14a affixed thereto. Here, each of the energy retro-reflecting targets 14a includes a sphere, affixable to object 12a, covered with a retro-reflective material as SUBSTITUTE SHEET (RULE 26) _7_ is generally available and well known in the art. As is also known in the art, other types of energy retro-reflecting targets are available such as flat disks affixable to the object 12a, covered with a retro-reflective material as is generally available. The targets 14a are affixed to object 12a in a known, fixed relationship to each other and to the geometry of the object 12a.
Here, rigid body 12b has a plurality of active point l0 targets 14b affixed thereto. The targets 14b are affixed to object 12b in a known, fixed relationship to each -other and to the geometry of the object 12b. The active targets 14b are fed via a cable 16 to a controller 18, as shown. Here, the energy emitting targets 14b include an infrared energy emitting diode which, upon being energized with electrical energy fed thereto by controller 18 via cable 16, emits infrared light energy.
Such infrared energy emitting diodes are generally available and well known in the art.
Referring also to FIG. 2, a common energy detection system 20 is provided for detecting both the energy emitted by the active targets 14b affixed to object 12b and the energy reflected by the passive targets 14a affixed to the other object 12a. The common detector system 20 includes a pair of spaced sensor assemblies 21L
and 21R. Each one of the sensor assemblies 21L, 21R
includes: a, here two two-dimensional, charge couple device (CCD) sensor 22L, 22R (FIGS. 1 and 3), respectively; an annular mounting ring 25L, 25R, respectively; a focusing lens 23L, 23R mounted centrally within the annular mounting ring 25L, 25R, respectively, as shown; and, a plurality of light emitting diodes 27L, 27R mounted to a respective one of the annular mounting rings 25L, 25R, as shown.
Each of sensor assembly 21R and 21L has its own u, v, zs co-ordinate system aligned with its associated SUBSTITUTE SHEET (RULE 26) _g_ directional infrared energy source, i.e., light emitting diodes 27L, 27R, respectively. The diodes 27L, 27R are evenly distributed circumferentially about the zs axis of each of sensor assemblies 21R and 21L. The plurality of infrared emitting diodes 27L, 27R is energized with electrical energy by a processor section 19. The processor section 19 includes a processor 26, host computer 30, display 32 and controller 18. The processor 26 energizes the diodes 27L, 27R via a signal on line 29, the plurality of infrared emitting diodes 27L, 27R
operate to produce an incident directional energy beam 40I (FIG. 4) of infrared energy with a direction of propagation aimed along a directional axis which generally corresponds to the z6 axis of each of the sensor assemblies 22L, 22R associated with that directional infrared energy source. The incident directional energy beam created by the directional infrared energy source is of a size, shape and intensity that corresponds to the volumetric field of view of its associated sensor 22L, 22R and sufficient to provide an incident directional energy beam throughout the measurement volume 28 (FIG.
1) .
The sensor assemblies 21L, 21R are each able to produce output signals on lines 24L, 24R, respectively, which represent the intensity of energy focused thereon.
During each sensor cycle, the energy focused thereon is collected (i.e. integrated) and then shifted to a processor 26. Here, the sensor assemblies 21L and 21R
are mounted to a fixed reference and are separated from each other by a predetermined distance, D, (FIG. 2) here 500mm. Here, the sensor assemblies 21L, 21R each have a field of view sufficient to observe a common measurement volume 28 of approximately 1m3 centered along the z axis at approximately 1.9m from the origin point which is midway between the lenses 23L and 23R.
SU9STiTUTE SHEET (RULE 26) _g_ As noted above, each of sensor assemblies 21R and 21L has its own associated lens 23L, 23R, respectively, for focusing both the reflected energy from the energy retro-reflecting targets 14a and the emitted energy from the energy emitting targets 14b, in order to create a focused energy image of the emitted or reflected energy from the targets 14b, 14a, respectively on the lens' 23L, 23R associated sensor assemblies 21R, 21L, respectively.
The processor 26 coupled to the sensors 22R and 22L
determine the two-dimensional u, v positions of the focused energy image on each of the sensors 22R and 22L.
Then, using the u, v position of the focused energy image of the same target 14a, 14b on each of the sensors 22R
and 22L to perform mathematical computations known in the art which computations include comparing the u, v positions of the focused energy image to a data set of known spatial positions relative to the origin of a common, fixed x, y, z co-ordinate system in order to determine the spatial position the target 14a, 14b in relation to the common co-ordinate system. The processor 26 is coupled to the host computer 30 in order that the spatial position of the targets 14a, 14b can be displayed on display 32 or further processed by the host computer 30. As noted above, the processor 26 is coupled to the directional infrared energy sources 27L, 27R in order that the processing section 19 can activate the directional infrared energy sources 27R and 27L at appropriate times during an energy reflecting target detection mode. The processor 26 is also coupled to the controller 18 in order that the processor 26 can signal the controller 18 to activate the energy emitting targets 14b in the required manner during an energy emitting target detection mode. Thus, there are two operating modes of the system 10: an active mode (i.e., target 14b emitting mode); and a passive mode (i.e., target 14a reflecting mode). These modes may be operated in a SU8STtTUTE SHEET (RULE 26) manner to be described in detail in connection with FIGS.
5A-5D. Suffice it to say here, however, that the processor section 19 common processor for both modes and is adapted to determine the spatial positions of both the passive and active targets in response to the energy detected by the common detector (i.e., sensors 22R and 22L) during a sequence of sensor cycles. During a first portion of the sensor cycles the spatial position of the active target is determined and during a second portion of the cycles the position of the passive target is determined. The sensor cycles in the first portion may be interspersed with the sensor cycles in the second portion, or cycles in the first and second portions may overlap to enable simultaneous determination of both the active target and the passive target during a single sensor cycle. It is noted that the position of either an active target or a passive target may be determined in a single sensor cycle. Thus, the processing of a sensor cycle for active target or targets may, for example be interspersed with the processing of a sensor cycle for the passive target or targets. Further, a plurality of active target sensor cycles may occur followed by the processing of one or more passive target sensor cycles.
That is, the active and passive cycles may be interspersed. Further, the sensor cycle may be the same to enable simultaneous detection of both the active target and the passive target during a single sensor cycle.
Thus, the controller 18 is provided for controlling the activation of the energy emitting targets 14b. More particularly, the controller 18 is coupled to one or more of the energy emitting targets 14b and is, upon receiving the appropriate signal or signals from the processor 25, able to activate one or more of the energy emitting targets 14b either individually, individually in a sequence specified by the processor 26, all at the same SUBSTITUTE SHEET (RULE 26) time, or in subsets specified by the processor 26 in a manner described in our co-pending patent application Serial No. 08/603,791 entitled "System for Determining the Spatial Position and Angular Orientation of an Object", filed February 20, 1996 and assigned to the same assignee as the present invention.
The system 10 operates in one of a plurality of operating mode patterns as selected by the user. These patterns will be described in detail in connection with FIGS, 5A-5D. When the processor 26 operates in the energy reflecting target mode, the processor 26 activates each of the directional infrared energy sources 27L, 27R.
In response to the delivery of such electrical energy, the infrared emitting diodes 27L, 27R emit energy, here infrared energy, which energy combines in an incident directional energy beam with a direction of propagation aimed along a directional axis which generally corresponds to the z5 axis of the sensor assemblies 22L, 22R. The energy retro-reflecting targets 14a located in the measurement volume 15 operate to retro-reflect the incident directional energy beam. Referring again to FIG. 2, an _ncident directional energy beam 40I from a directional infrared energy source 27L, or 27R is reflected by a retro-reflecting target i4a such that the majority of the retro-reflected energy 40R is reflected in a manner such that it is parallel to the incident directional energy beam 40I but with the opposite direction of propagation (as opposed to simple reflection whereby, as is well known in the art, energy is reflected such that the angle between the incident energy ray and the normal to the point on the surface where said incident energy ray is reflected is equal to the angle between the reflected energy ray and the said normal to the point of reflection). Retro-reflecting as used in the invention is well known in the art. The incident directional energy beam 40I emitted by the directional infrared energy source 27L, for example, and acting upon an energy retro-reflecting target 14a will result in a reflected directional energy beam 40R having a direction of propagation only toward lens 23L, the sensor 22L and none of the reflected directional energy beam 40R
propagating toward lens 23R and sensor 22R. Likewise, the incident directional energy beam 40I emitted by the directional infrared energy source 27R and acting upon an energy retro-reflecting target 14a will result in a reflected directional energy beam 40R having a direction of propagation only toward lens 23R and sensor 22R and none of the reflected directional energy beam 40R
propagating toward lens 23L and sensor 22L. The reflected directional energy beam 40R is therefore propagating in the direction from whence it originated.
Thus, in the case of energy initially created by the directional infrared energy source 27R, the reflected directional energy beam 40R will be collected by lens 23R
and focused by lens 23R onto sensor 22R.
In the passive target operating mode, the directional infrared energy sources 27L, 27R are activated by the processor 26. When a retro-reflective target 14a is situated in space such that it is within the directional beam of the directional infrared energy source (thereby illuminated by the said directional energy source) and the field of view of the CCD sensors 22L, 22R, the directional infrared energy is retro-reflected by the retro-reflective target 14a back through lenses 23L, 23R, which focus the energy image onto the CCD sensors 22L, 22R, respectively. Thus, infrared energy retro-reflected by a passive target 14a located in the field of view of the CCD sensor 22L, 22R is collected through lenses 23L, 23R, respectively, which focuses the energy image onto the CCD sensor 22L, 22R, respectively.
SUBSTITUTE SHEET (RULE 26) *rB
I .
During the active target mode, the infrared energy emitting targets 14b are activated by the emitting target controller 18, causing the emitting targets 14b to emit infrared energy. Infrared energy emitted by an emitting target 14b located in the field of view of the CCD sensor 22L, 22R is collected through lenses 23L, 23R, respectively, which focuses the energy image onto the CCD
sensor 22L, 22R, respectively.
During either the active target mode of the passive target mode, the energy image is shifted out of the two dimensional CCD sensors 22L, 22R during each cycle of the sensors 22L, 22R into the processor 26. The processor 26 is programmed to determine the position of the energy focuses image. Thus, the processor 26 uses the same processing for both the active target mode and the passive target mode to determine the spatial position of each object 12a, 12b.
Referring to FIGS. 5A-5D various operating patterns are shown. One pattern, (i.e., an active only pattern) is shown in FIG. 5A. Here, only the targets 14b are activated via a pulse on line 16 during each of a sequence of sensor cycles. Another pattern (i.e., a passive only pattern) is shown in FIG. 5B. Here, only sources 27L, 27R are activated via a pulse on line 29 during each of a sequence of sensor cycles. Another pattern {i.e., an interspersed pattern) is shown in FIG.
5C. Here, the activation of sources 27L, 27R and the activation of targets 14b with pulses on line 29 are interspersed with pulses on line 16. Thus, here, the common processor determines the spatial positions of both the passive and active targets in response to the energy detected by the common detector during a sequence of interspersed active-passive sensor cycles. Still another pattern (i.e., a simultaneous pattern) is shown in FIG.
5D. Here, the activation of sources 27L, 27R and the activation of targets 14b with pulses on line 29 are SUBSTITUTE SHEET (RULE 26) simultaneous with the activation of targets 14b with pulses on line 16 during each of a sequence of sensor cycles. Thus, here, the common processor determines the spatial positions of both the passive and active targets in response to the energy detected by the common detector during each of a sequence of simultaneous active-passive sensor cycles.
Thus, from FIGS. 5C and 5D it is noted that during a first portion of the sensor cycles the spatial position of an active target is determined and during a second portion of the cycles the position of the passive target is determined. The sensor cycles in the first portion may be interspersed with the sensor cycles in the second portion, as in FIG. 5C, or cycles in the first and second portions may overlap to enable simultaneous determination of both the active target and the passive target during each of a sequence of single sensor cycles, as in FIG.
5D.
It is also noted from the foregoing that the use of the common detector for both the active and passive targets enables the common processor to use the same processing steps in determining the spatial orientation of both the active and passive target affixed objects.
The position of each of the targets 14a and targets 14b is communicated to the host computer 30 by the processor 26. The computer 30 can be programmed to enable concurrent display of both object 12a and object 12b as shown in FIG. 6. Alternatively, the information from the computer may be stored for later display and/or further processing.
Thus, the system 10 includes: a single or a plurality of activatable emitting point targets 14b, preferably infrared emitting target points, affixable to object 12b; and/or a single or a plurality of retro-reflective point targets, preferably highly reflective retro-reflective targets, affixable to object 12a; a SUBSTITUTE SHEET (RULE 26) sensor section 20, preferably a pair of infrared sensing two dimensional array, CCD sensors, for providing signals representative of positional information of energy collected by the sensor's from either or both of emitting point targets 14b or retro-reflective point targets 14a;
a processing section 19 (which includes a processor 26, preferably a micro-processor, a controller 18, and a host computer 30) responsive to the signals produced by the sensor section 20. The processing section 19 is programmed to determine the position of the active point targets 14b and/or the passive point targets 14a and for determining the spatial position of the point targets 14a, 14b and, optionally, the spatial position and orientation of objects 12a and/or 12b. The system 10 includes an energy source, preferably a plurality of directional infrared emitters 27L, 27R, fixed in relation to the sensors 22L, 22R by preferably surrounding each of the pairs of sensors 22L, 22R as assemblies 21L, 21R, respectively, where the directional beam of the emitters will illuminate the field of view of the sensors 22L, 22R
it surrounds with infrared energy by directing said directional beam along an axis which corresponds to the axis projecting perpendicularly through the area centroid of the two dimensional array CCD sensor 22L, 22R. The emitters 27L, 27R are controllable to be activated as directed by the aforementioned processor section 19. The controller 18 provides for the sequenced control and activation of a plurality of emitting point targets 14b activated as directed by processor section 19.
Referring to FIG. 7 an object 12c is shown with a combination of active and passive targets adapted for detection and processing by the processor section 19. It is also noted that various combinations of passive and active targets and objects may be used, including a single passive and/or active target.
SUBSTITUTE SHEET (RULE 26) WO 99117133 PCTICA9$/00911 Other embodiments are within the spirit and scope of the appended claims. For example, while the determination of the location of at least three of the point targets 14a, 14b is required for 6D position and angular orientation determination, if less than a six degrees of freedom (6D) determination is desired (i.e., a position of, and a vector along, the object 12a, 12b) the determination of the location of only two of the targets 14a, 14b on each object 12a, 12b, respectively, is required. Further, while the sensor section 20 described above included a pair of spaced 2D sensors 22L, 22R, such sensor section 20 may include other sensor arrangements.
For example, the sensor section 20 may include a single 2D sensor, a pair of linear sensors, or other suitable arrangement of sensors.
For example, although individual point targets are shown, here with 4 retro-reflective point targets 14a, and 4 emitting point targets 14b, the position of, and angle along, a rigid object could be determined with 2 or more retro-reflective targets 14a, or 2 or more active radiating targets 14b, or any combination of 1 or more of each retro-reflective targets 14a and active radiating targets 14b. Further, although the determination of the position and orientation of rigid objects 12a, 12b is shown here, if only the position of the object 12a or 12b is desired it can be determined with a single retro-reflective target 14a or a single active radiating target 14b. Still further, although here position sensor system 10, uses a pair of two dimensional image sensors 22L, 22R, a mathematical process is available which uses a single two dimensional image sensor 11, or two one dimensional image sensors, which can determine the position and orientation of an object with 3 or more targets, by using knowledge of the relative position of said targets and an initial estimate of the position of the object. Also, although here position sensor system SUBSTITUTE SHEET (RULE 26) 10, uses a pair of two dimensional image sensors 22L, 22R, a mathematical process is available which uses N two dimensional image sensors, where N is 2 or greater, or M
one dimensional image sensors, where M is 3 or greater, which can determine the position of a target. Here, position sensor system 10 uses a pair of two dimensional image sensors 11, which are fixed in relative position and orientation, it is possible to have the image sensors free to be repositioned prior to use and a calibration sequence is employed prior to tracking the positions of point targets which will determine the relative position and orientation of the two dimensional image sensors.
SUBSTITUTE SHEET (RULE 26)
Claims (10)
1. A system for determining the spatial position of a target, comprising:
an active optical target adapted to emit optical energy in response to an active signal;
a passive optical target adapted to reflect optical energy impinging upon such passive optical target;
an active optical energy source positioned to impinge optical energy upon the passive optical target;
a common energy detector for detecting both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and a common processor for determining the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical target is determined;
wherein during a second sensor cycle the position of the passive optical target is determined.
an active optical target adapted to emit optical energy in response to an active signal;
a passive optical target adapted to reflect optical energy impinging upon such passive optical target;
an active optical energy source positioned to impinge optical energy upon the passive optical target;
a common energy detector for detecting both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and a common processor for determining the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical target is determined;
wherein during a second sensor cycle the position of the passive optical target is determined.
2. The system recited in claim 1 wherein the processor is adapted to intersperse a plurality of the first sensor cycles with a plurality of the second sensor cycles.
3. The system recited in claim 1 wherein the processor is adapted to have the first and second sensor cycles occur simultaneously.
4. The system recited in claim 1 wherein the processor is adapted to selectively either intersperse a plurality of the first sensor cycles with the plurality of second sensor cycles or to occur simultaneously.
5. A method for determining the spatial position of a target, comprising:
affixing a passive optical target to an object;
affixing an active optical target to an object;
detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical target is determined;
wherein during a second sensor cycle the position of the passive optical target is determined.
affixing a passive optical target to an object;
affixing an active optical target to an object;
detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical target is determined;
wherein during a second sensor cycle the position of the passive optical target is determined.
6. The method recited in claim 5 wherein the processor is adapted to intersperse a plurality of the first sensor cycles.
7. The method recited in claim 5 wherein the processor is adapted to have the first and second sensor cycles occur simultaneously.
8. The method recited in claim 5 wherein the processor is adapted to selectively either have the plurality of the first sensor cycles interspersed with the plurality of second sensor cycles or have the first and second cycles occur simultaneously.
9. A method for determining the spatial position and angular orientation of objects, comprising:
affixing a plurality of passive optical targets to one of the objects;
affixing a plurality of active optical targets to another one of the objects;
detecting with a common energy detector both the optical energy emitted by the active optical targets and the optical energy reflected by the passive optical targets; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical targets is determined;
wherein during a second sensor cycle the position of the passive optical targets is determined.
affixing a plurality of passive optical targets to one of the objects;
affixing a plurality of active optical targets to another one of the objects;
detecting with a common energy detector both the optical energy emitted by the active optical targets and the optical energy reflected by the passive optical targets; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical targets is determined;
wherein during a second sensor cycle the position of the passive optical targets is determined.
10. A method for determining the spatial position of an object, comprising:
affixing a passive optical target and an active optical target to the object;
detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical target is determined;
wherein during a second sensor cycle the position of the passive optical target is determined.
affixing a passive optical target and an active optical target to the object;
detecting with a common energy detector both the optical energy emitted by the active optical target and the optical energy reflected by the passive optical target; and determining with a common processor the spatial positions of both the passive and active optical targets in response to the optical energy detected by the common detector;
wherein during a first sensor cycle the spatial position of the active optical target is determined;
wherein during a second sensor cycle the position of the passive optical target is determined.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US08/938,098 US5923417A (en) | 1997-09-26 | 1997-09-26 | System for determining the spatial position of a target |
| US08/938,098 | 1997-09-26 | ||
| PCT/CA1998/000911 WO1999017133A1 (en) | 1997-09-26 | 1998-09-28 | A system for determining the spatial position of a target |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2272357A1 CA2272357A1 (en) | 1999-04-08 |
| CA2272357C true CA2272357C (en) | 2003-11-25 |
Family
ID=25470893
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002272357A Expired - Fee Related CA2272357C (en) | 1997-09-26 | 1998-09-28 | A system for determining the spatial position of a target |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US5923417A (en) |
| EP (1) | EP0941488A1 (en) |
| JP (1) | JP3667352B2 (en) |
| CN (1) | CN1141599C (en) |
| CA (1) | CA2272357C (en) |
| WO (1) | WO1999017133A1 (en) |
Families Citing this family (67)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1068607A4 (en) * | 1998-04-03 | 2009-07-08 | Image Guided Technologies Inc | Wireless optical instrument for position measurement and method of use therefor |
| US6363940B1 (en) | 1998-05-14 | 2002-04-02 | Calypso Medical Technologies, Inc. | System and method for bracketing and removing tissue |
| JP4033582B2 (en) * | 1998-06-09 | 2008-01-16 | 株式会社リコー | Coordinate input / detection device and electronic blackboard system |
| US6483577B2 (en) | 1998-11-02 | 2002-11-19 | Hunter Engineering Company | Vehicle alignment sensor system |
| DE19947422A1 (en) | 1999-10-01 | 2001-05-03 | Siemens Ag | Medical diagnostic imaging device |
| US6417947B1 (en) * | 1999-10-07 | 2002-07-09 | At&T Corp. | Free space light multibeam network bridge apparatus and methods |
| DE19959720B4 (en) | 1999-12-10 | 2005-02-24 | Siemens Ag | Method for operating a magnetic resonance tomography device |
| DE10026711B4 (en) * | 2000-05-30 | 2007-04-19 | Sick Ag | Position monitoring device and method |
| US7085400B1 (en) | 2000-06-14 | 2006-08-01 | Surgical Navigation Technologies, Inc. | System and method for image based sensor calibration |
| DE10036207B4 (en) | 2000-07-25 | 2006-11-30 | Siemens Ag | Method for performing a perfusion measurement by means of magnetic resonance imaging |
| DE10051415C2 (en) * | 2000-10-17 | 2003-10-09 | Advanced Realtime Tracking Gmb | Optical tracking system and method |
| US7194296B2 (en) * | 2000-10-31 | 2007-03-20 | Northern Digital Inc. | Flexible instrument with optical sensors |
| EP2130511A1 (en) | 2000-11-17 | 2009-12-09 | Calypso Medical, Inc | System for locating and defining a target location within a human body |
| US20020193685A1 (en) | 2001-06-08 | 2002-12-19 | Calypso Medical, Inc. | Guided Radiation Therapy System |
| US6597443B2 (en) * | 2001-06-27 | 2003-07-22 | Duane Boman | Spatial tracking system |
| US6812842B2 (en) | 2001-12-20 | 2004-11-02 | Calypso Medical Technologies, Inc. | System for excitation of a leadless miniature marker |
| US6838990B2 (en) | 2001-12-20 | 2005-01-04 | Calypso Medical Technologies, Inc. | System for excitation leadless miniature marker |
| US6822570B2 (en) | 2001-12-20 | 2004-11-23 | Calypso Medical Technologies, Inc. | System for spatially adjustable excitation of leadless miniature marker |
| US6757582B2 (en) | 2002-05-03 | 2004-06-29 | Carnegie Mellon University | Methods and systems to control a shaping tool |
| US6889833B2 (en) * | 2002-12-30 | 2005-05-10 | Calypso Medical Technologies, Inc. | Packaged systems for implanting markers in a patient and methods for manufacturing and using such systems |
| US7289839B2 (en) * | 2002-12-30 | 2007-10-30 | Calypso Medical Technologies, Inc. | Implantable marker with a leadless signal transmitter compatible for use in magnetic resonance devices |
| US20050060899A1 (en) * | 2003-09-23 | 2005-03-24 | Snap-On Technologies, Inc. | Invisible target illuminators for 3D camera-based alignment systems |
| US7104947B2 (en) * | 2003-11-17 | 2006-09-12 | Neuronetics, Inc. | Determining stimulation levels for transcranial magnetic stimulation |
| CN1325929C (en) * | 2003-11-17 | 2007-07-11 | 中国农业大学 | Infrared positioning system and method |
| DE10356418A1 (en) * | 2003-11-27 | 2005-07-07 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Method for position tracking of moving objects and position tracking system |
| US8196589B2 (en) * | 2003-12-24 | 2012-06-12 | Calypso Medical Technologies, Inc. | Implantable marker with wireless signal transmitter |
| US7651459B2 (en) * | 2004-01-06 | 2010-01-26 | Neuronetics, Inc. | Method and apparatus for coil positioning for TMS studies |
| US8177702B2 (en) | 2004-04-15 | 2012-05-15 | Neuronetics, Inc. | Method and apparatus for determining the proximity of a TMS coil to a subject's head |
| WO2006012631A2 (en) | 2004-07-23 | 2006-02-02 | Calypso Medical Technologies, Inc. | Integrated radiation therapy systems and methods for treating a target in a patient |
| US8088058B2 (en) * | 2005-01-20 | 2012-01-03 | Neuronetics, Inc. | Articulating arm |
| US20060199159A1 (en) * | 2005-03-01 | 2006-09-07 | Neuronetics, Inc. | Head phantom for simulating the patient response to magnetic stimulation |
| US7285793B2 (en) * | 2005-07-15 | 2007-10-23 | Verisurf Software, Inc. | Coordinate tracking system, apparatus and method of use |
| US7824324B2 (en) | 2005-07-27 | 2010-11-02 | Neuronetics, Inc. | Magnetic core for medical procedures |
| DE112007000340T5 (en) * | 2006-02-09 | 2008-12-18 | Northern Digital Inc., Waterloo | Retroreflective brand tracking systems |
| CN1932549B (en) * | 2006-09-29 | 2010-05-12 | 重庆邮电大学 | Low-level flying target passive location method and system |
| US7946209B2 (en) * | 2006-10-04 | 2011-05-24 | Raytheon Company | Launcher for a projectile having a supercapacitor power supply |
| WO2008052348A1 (en) * | 2006-11-02 | 2008-05-08 | Northern Digital Inc. | Integrated mapping system |
| DE502006007337D1 (en) | 2006-12-11 | 2010-08-12 | Brainlab Ag | Multi-band tracking and calibration system |
| US20090002677A1 (en) * | 2007-06-26 | 2009-01-01 | Honeywell International Inc. | Target locator system |
| US9884200B2 (en) * | 2008-03-10 | 2018-02-06 | Neuronetics, Inc. | Apparatus for coil positioning for TMS studies |
| WO2009149409A1 (en) | 2008-06-05 | 2009-12-10 | Calypso Medical Technologies, Inc. | Motion compensation for medical imaging and associated systems and methods |
| WO2010145002A1 (en) * | 2009-06-16 | 2010-12-23 | Baanto International Ltd. | Two-dimensional position sensing systems and sensors therefor |
| CA2718686C (en) | 2009-10-20 | 2015-07-14 | Imris Inc. | Imaging system using markers |
| US9839486B2 (en) | 2010-04-14 | 2017-12-12 | Smith & Nephew, Inc. | Systems and methods for patient-based computer assisted surgical procedures |
| JP2012057996A (en) | 2010-09-07 | 2012-03-22 | Mitsutoyo Corp | Image measuring device and image measuring method |
| US9833637B2 (en) | 2011-05-02 | 2017-12-05 | Radiadyne Llc | Skin patch dosimeter |
| US8668345B2 (en) | 2011-11-30 | 2014-03-11 | Izi Medical Products | Retro-reflective marker with snap on threaded post |
| US8661573B2 (en) | 2012-02-29 | 2014-03-04 | Izi Medical Products | Protective cover for medical device having adhesive mechanism |
| US9008757B2 (en) | 2012-09-26 | 2015-04-14 | Stryker Corporation | Navigation system including optical and non-optical sensors |
| CA2928460C (en) | 2012-10-30 | 2021-10-19 | Truinject Medical Corp. | System for injection training |
| KR101371384B1 (en) * | 2013-01-10 | 2014-03-07 | 경북대학교 산학협력단 | Tracking system and method for tracking using the same |
| KR101371387B1 (en) * | 2013-01-18 | 2014-03-10 | 경북대학교 산학협력단 | Tracking system and method for tracking using the same |
| CA2972754A1 (en) | 2014-01-17 | 2015-07-23 | Clark B. Foster | Injection site training system |
| US10290231B2 (en) | 2014-03-13 | 2019-05-14 | Truinject Corp. | Automated detection of performance characteristics in an injection training system |
| BR112017011443A2 (en) | 2014-12-01 | 2018-02-27 | Truinject Corp | omnidirectional light emitting training instrument |
| EP3047809B1 (en) | 2015-01-23 | 2022-04-13 | Storz Medical Ag | Extracorporeal shock wave lithotripsy system having off-line ultrasound localization |
| US10024965B2 (en) | 2015-04-01 | 2018-07-17 | Vayavision, Ltd. | Generating 3-dimensional maps of a scene using passive and active measurements |
| EP3365049A2 (en) | 2015-10-20 | 2018-08-29 | Truinject Medical Corp. | Injection system |
| WO2017151441A2 (en) | 2016-02-29 | 2017-09-08 | Truinject Medical Corp. | Cosmetic and therapeutic injection safety systems, methods, and devices |
| US10849688B2 (en) | 2016-03-02 | 2020-12-01 | Truinject Corp. | Sensory enhanced environments for injection aid and social training |
| US10269266B2 (en) | 2017-01-23 | 2019-04-23 | Truinject Corp. | Syringe dose and position measuring apparatus |
| US10445928B2 (en) | 2017-02-11 | 2019-10-15 | Vayavision Ltd. | Method and system for generating multidimensional maps of a scene using a plurality of sensors of various types |
| US11227194B2 (en) * | 2019-07-16 | 2022-01-18 | Baidu Usa Llc | Sensor synchronization offline lab validation system |
| CA3194223A1 (en) | 2020-07-21 | 2021-10-06 | Leddartech Inc. | Beam-steering device particularly for lidar systems |
| WO2022016276A1 (en) | 2020-07-21 | 2022-01-27 | Leddartech Inc. | Beam-steering device particularly for lidar systems |
| CA3125716A1 (en) | 2020-07-21 | 2021-10-10 | Leddartech Inc. | Systems and methods for wide-angle lidar using non-uniform magnification optics |
| CN116636313A (en) | 2020-12-04 | 2023-08-22 | 利奥癌症治疗公司 | Multiaxial medical imaging |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US3876308A (en) * | 1971-05-24 | 1975-04-08 | Us Navy | Automatic command guidance system using optical trackers |
| US3799676A (en) * | 1972-05-26 | 1974-03-26 | Us Air Force | Optical tracking system |
| US4396945A (en) * | 1981-08-19 | 1983-08-02 | Solid Photography Inc. | Method of sensing the position and orientation of elements in space |
| US5557347A (en) * | 1986-11-04 | 1996-09-17 | The Charles Stark Draper Laboratory, Inc. | Ballistic missile boresight and inertial tracking system and method |
| US5614912A (en) * | 1991-09-09 | 1997-03-25 | The Mitre Corporation | Radar processing method and apparatus |
| FR2718519B1 (en) * | 1994-04-12 | 1996-04-26 | Thomson Csf | Aiming device for weapon, and equipped weapon. |
| US5685504A (en) * | 1995-06-07 | 1997-11-11 | Hughes Missile Systems Company | Guided projectile system |
-
1997
- 1997-09-26 US US08/938,098 patent/US5923417A/en not_active Expired - Lifetime
-
1998
- 1998-09-28 CN CNB988014076A patent/CN1141599C/en not_active Expired - Fee Related
- 1998-09-28 WO PCT/CA1998/000911 patent/WO1999017133A1/en active Application Filing
- 1998-09-28 CA CA002272357A patent/CA2272357C/en not_active Expired - Fee Related
- 1998-09-28 JP JP51952499A patent/JP3667352B2/en not_active Expired - Fee Related
- 1998-09-28 EP EP98944939A patent/EP0941488A1/en not_active Withdrawn
Also Published As
| Publication number | Publication date |
|---|---|
| WO1999017133A1 (en) | 1999-04-08 |
| CN1241260A (en) | 2000-01-12 |
| US5923417A (en) | 1999-07-13 |
| CN1141599C (en) | 2004-03-10 |
| JP3667352B2 (en) | 2005-07-06 |
| EP0941488A1 (en) | 1999-09-15 |
| CA2272357A1 (en) | 1999-04-08 |
| JP2001506762A (en) | 2001-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2272357C (en) | A system for determining the spatial position of a target | |
| US6061644A (en) | System for determining the spatial position and orientation of a body | |
| US5059789A (en) | Optical position and orientation sensor | |
| US8988505B2 (en) | Imaging system using markers | |
| EP3281600B1 (en) | Marker for optical tracking, optical tracking system, and optical tracking method | |
| US10105186B2 (en) | Virtual rigid body optical tracking system and method | |
| US9739595B2 (en) | Multi-dimensional measuring system with measuring instrument having 360° angular working range | |
| EP0785848B1 (en) | Control equipment with a movable control member | |
| EP2436001B1 (en) | Position measurement systems using position sensitive detectors | |
| US5686942A (en) | Remote computer input system which detects point source on operator | |
| EP0294101A2 (en) | System for measuring the angular displacement of an object | |
| US6559935B1 (en) | Sensors of relative position and orientation | |
| CN108387175A (en) | Coordinate measuring set with automatic target object identification | |
| JP4052908B2 (en) | Optical coordinate input system | |
| CA2002039A1 (en) | Helmet pointing apparatus | |
| Steinicke et al. | Generating optimized marker-based rigid bodies for optical tracking systems. | |
| Wolfe et al. | A multisensor robotic locating system and the camera calibration problem | |
| US20230029105A1 (en) | Fingertip lidar system for visual assistance | |
| WO2022125715A1 (en) | Needle guidance system | |
| Cojocaru et al. | Object Tracking and Orientation Determination Means, Systems for Robots | |
| JPH1186006A (en) | Index extracting, detecting, and tracking device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |