Publication number | US7173562 B2 |

Publication type | Grant |

Application number | US 10/954,218 |

Publication date | Feb 6, 2007 |

Filing date | Oct 1, 2004 |

Priority date | Jan 8, 2002 |

Fee status | Paid |

Also published as | US6646593, US6812886, US7515098, US20040021598, US20060284762 |

Publication number | 10954218, 954218, US 7173562 B2, US 7173562B2, US-B2-7173562, US7173562 B2, US7173562B2 |

Inventors | David Alan Garren |

Original Assignee | Science Applications International Corporation |

Export Citation | BiBTeX, EndNote, RefMan |

Patent Citations (14), Non-Patent Citations (13), Referenced by (7), Classifications (15), Legal Events (5) | |

External Links: USPTO, USPTO Assignment, Espacenet | |

US 7173562 B2

Abstract

Described herein are frequency-domain back-projection processes for forming spotlight synthetic aperture radar (“SAR”) images that are not corrupted by the effects of multiple-bounce ghosting artifacts. These processes give an approximately exact reconstruction of the multiple bounce reflectivity function (MBRF) ƒ(x,y,γ). Specifically, the evaluation of ƒ(x,y,γ) in they γ=0 plane gives an approximately exact reconstruction of the true object scattering centers which is uncorrupted by multiple-bounce contributions to the phase history data G(ξ, θ). In addition, the non-zero dependence of ƒ(x,y,γ) upon the MB coordinate γ can be used to facilitate the identification of features-interest within the imaged region.

Claims(2)

1. A process for analyzing radar scattering data from an area-of-interest comprising:

receiving radar scattering data from the area-of-interest, the area-of-interest includes at least two scattering points;

identifying the radar scattering data as containing multiple-bounce information resulting from reflection off of the at least two scattering points;

imaging the area-of-interest using the multiple-bounce information; and

separating the radar scattering data according to the identifying the radar scattering data, wherein separating the radar scattering data comprises:

reconstructing the at least two scattering points according to the identifying the radar scattering data, wherein the reconstructing the at least two scattering points comprises:

reconstructing a multiple bounce reflectivity function (“MBRF”)ƒ(x,y,γ) for each of the at least two scattering points based on measured phase history data as described according to the equation

wherein ξ represents spatial frequency and θ represents measurement angle.

2. A process for analyzing radar scattering data from an area-of-interest comprising:

receiving radar scattering data from the area-of-interest, the area-of-interest includes at least two scattering points;

identifying the radar scattering data as containing multiple-bounce information resulting from reflection off of the at least two scattering points;

imaging the area-of-interest using the multiple-bounce information; and

separating the radar scattering data according to the identifying the radar scattering data, wherein the separating the radar scattering data comprises:

reconstructing the at least two scattering points according to the identifying the radar scattering data, wherein the reconstructing the at least two scattering points comprises:

reconstructing a multiple bounce reflectivity function (“MBRF”)ƒ(x,y,γ) for each of the at least two scattering points based on measured phase history data as described according to the equation

wherein ξ′ represents spatial frequency which is scaled by a factor cos(β/2), β being equal to an angle between the first location and the second location, and θ′ is a bisector angle between the angle β;

transmitting at a first location a radar signal toward the area-of-interest; and

receiving radar scattering data includes receiving at a second location the radar scattering data from a reflection of the radar signal, the second location is different from the first location.

Description

This application is a continuation of, and incorporates by reference in its entirety, U.S. patent application Ser. No. 10/631,712 filed Aug. 1, 2003, now U.S. Pat. No. 6,812,886, entitled “PROCESS FOR MAPPING MULTIPLE-BOUNCING GHOSTING ARTIFACTS FROM RADAR IMAGING DATA,” which claims priority to U.S. patent application Ser. No. 10/059,416 entitled “PROCESS FOR MAPPING MULTIPLE-BOUNCE GHOSTING ARTIFACTS FROM RADAR IMAGING DATA,” now U.S. Pat. No. 6,646,593, which claims priority to and incorporates by reference in its entirety, U.S. Provisional Patent Application No. 60/345,639, entitled “SPOTLIGHT SAR IMAGE FORMATION WITHOUT MULTIPLE-BOUNCE GHOSTING ARTIFACTS” filed Jan. 8, 2002.

1. Field of the Invention

Generally, the invention involves a process for forming radar images. More specifically, the invention involves a process for mapping multiple bounce ghosts (MBGs) and for forming radar images without the deleterious effects of MBGs.

2. Description of the Related Art

Radar, at its most basic application, is used to measure the range to a target. With knowledge of the speed of propagation of the wave, i.e., electromagnetic wave, that is transmitted toward the target, it is possible to resolve in a first dimension, the distance to the target, based on the received reflected wave or echo. In order to use radar as an imaging tool, it is necessary to collect information about the cross-range of the target, in addition to the first dimension information. This cross-range information is about a second dimension perpendicular to the first dimension.

Synthetic aperture radar (SAR) can be used to collect data in both the first and second dimensions, through a process wherein the reflected waves are measured at different angles with respect to an object-of-interest. This process is referred to in the art as collecting radar measurements over a synthetic (as opposed to a literal) aperture. By taking various measurements of the object-of-interest from varying aspect angles, it is possible to determine approximate distance to the scattering centers within an object-of-interest in the first dimension and location of these scattering centers within the object-of-interest in the second, cross-range dimension. This process of two-dimensional imaging is commonly referred to as reflection tomography.

SAR systems take advantage of the long-range propagation characteristics of radar signals and the complex information processing capability of modern digital electronics to provide high-resolution imagery. SAR imaging is not restricted by time of day or atmospheric conditions due to its operative frequencies. Consequently, SAR imaging supplements other photographic and optical imaging techniques in order to facilitate environmental monitoring, earth-resource mapping, and military operations which may require broad-area imaging at high resolutions. More specifically, SAR technology provides detailed terrain information to geologists for mineral exploration, environmentalists for determination of oil spill boundaries, navigators for sea state and ice hazard mapping, and the military for reconnaissance and targeting information.

Other systems using reflection data, also referred to as projection measurements, are fault inspection systems using acoustic imaging, submarine sonar for imaging underwater objects and the like, seismic imaging system for tunnel detection, oil exploration, geological surveys, etc., and medical diagnostic tools such as sonograms and echocardiograms.

There have been two basic types of processing techniques used in the field of reflection tomography to reconstruct single-bounce (SB) reflection data. First, the frequency-domain projection-slice theorem takes the measured phase history from the reflection data taken at different aspect angles and generates the reconstruction of an image using Fourier transforms. This reconstruction technique is often used for reconstructing SAR image data in order to minimize the computational load that results from necessarily complex processing. A second technique, more prevalent in the medical imaging community, is based on the time-domain back projection techniques. Both of these techniques are discussed in U.S. Pat. No. 5,805,098 to McCorkle which is incorporated herein by reference in its entirety.

Summary of the Problem

The reflection data processing techniques described in the related art assume that the impinging wave reflects a single time off of the object of interest before returning back to the receiver. This assumption neglects the situation wherein the wave actually reflects off of multiple portions of the object of interest, cascading for any number of times, before returning to the receiver. All prior art on reflection tomography assumes only one bounce. That is, conventional tomography does not include the effects of multiple-bounce (MB) scattering events wherein the mediating waveform first scatters off of one portion of the extended object-of-interest, which then scatters in a cascade fashion off of one or more other regions of this same extended object-of interest or off of other objects before scattering into the receiver. These facts motivate the need for the development of a modified image formation process that applies for cases in which the measured reflection data also identifies and accounts for MB scattering events.

A particular imaging scenario wherein the prior art process is insufficient includes determining the physical distribution of the scattering centers for cases in which multiple-bounce echoes occur. For example, prior art processes would have a difficult time determining from three (3) received echoes that instead of three scattering centers for an object-of-interest, the image actually contained two targets, wherein the third echo was between the two scattering centers as opposed to a third scattering center. The problem is exacerbated in a case where there are many scattering centers within the image, with the possibility for multiple bounces between the scattering centers. Further, in the case of SAR imaging, the process becomes even more complicated by the fact that the object (or region)-of-interest radar information is only gathered over a very small aspect angle range, for example, up to approximately 15 degrees. Current processing schemes place the multiple-bounce echoes at incorrect (ghost) locations due to fundamental assumptions implicit in the processing.

Summary of the Solution

Described herein are frequency-domain back-projection processes for forming, e.g, spotlight SAR images that are not corrupted by the effects of multiple-bounce ghosting artifacts. These processes give an approximately exact reconstruction of the multiple bounce reflectivity function (MBRF) ƒ(x,y,γ). As shown in the embodiments herein, the reconstruction process is not affected to any greater extent by noise and interference than in the case of the single bounce processing. Specifically, the evaluation of ƒ(x,y,γ) in the γ=0 plane gives an approximately exact reconstruction of the true object scattering centers which is uncorrupted by multiple-bounce contributions to the phase history data G(ξ, θ). In addition, the non-zero dependence of ƒ(x,y,γ) upon the MB coordinate γ can be used to facilitate the identification of features-interest within the imaged region.

In an embodiment of the present invention, a process is described for incorporating the effects of multiple bounces obtained using the back projection imaging process referred to herein, in order to obtain a cleaned up image that has removed the misleading effects of the multiple bounces, commonly referred to as multiple bounce ghosts (MBGs). The process identifies the MBGs and maps the MBG reflections into a metrically-correct image plane, also referred to as, a delay image plane or higher dimensional image plane, creating auxiliary images, which are useful in providing further information about the viewing region, including additional discriminating information that could assist in object recognition and identification. The imaging information, including both single and multiple bounce information, is only required for a narrow range of measurement angles.

The processes of the present invention are useful in three dimensional imaging, providing images that are free of multi-path effects, and extending the field-of-use of the technology beyond SAR imaging to all areas of reflection tomography. Because the technology incorporates a physical model that explicitly allows for multi-bounce effects in image formation, it is applicable to any image formation technology where that phenomenon is found such as, but not limited to, real aperture radar imaging, synthetic aperture radar (SAR) imaging, inverse SAR (ISAR) imaging, active sonar underwater acoustic mapping, active geographic acoustic exploration and ultrasonic medical imaging.

In the Figures:

*a*)–**1**(*b*) illustrate scattering events according to embodiments of the present invention;

*a*)–**2**(*d*) illustrate true scattering point data from multiple depth planes, according to a first embodiment of the present invention;

*a*)–**3**(*b*) illustrate measurement functions for scattering data according to a first embodiment of the present invention;

*a*)–**5**(*d*) illustrate scattering point data for an object-of-interest utilizing multiple bounce reconstruction according to a first embodiment of the present invention;

*a*)–**6**(*d*) illustrate true scattering point data from multiple depth planes, according to a second embodiment of the present invention;

*a*)–**7**(*b*) illustrate measurement functions for scattering data according to a second embodiment of the present invention;

*a*)–**9**(*d*) illustrate scattering point data for an object-of-interest utilizing multiple bounce reconstruction according to a second embodiment of the present invention.

In a preferred embodiment of the present invention, the imaging process assumes the condition that a scattered waveform has the same characteristics as the incident waveform. In the context of SAR imaging, the measured range to target (i.e., assumed object-of-interest) of a given multiple bounce (MB) scattering event at some aperture angle is identical to that of an equivalent single bounce (SB) scattering event. *a *presents an example of such equivalent scattering events. In this example, the transmitter is co-located with the receiver (both shown as **10**) at a large distance from the region-of-interest, so that the effects of a curved wave front can be neglected. One skilled in the art recognizes that the process described herein may be adjusted for non co-located transmitter and receiver configurations, as well as for distances from the region of interest which result in curved wavefronts. *a *shows that waveform traverses a total distance of 2 L in propagating from the transmitter at **10** to scattering point (SP) **1** and back to the co-located receiver at **10**. This distance represents the measured range-to target from the co-located transmitter-receiver to SP **1** based upon waveform transmission and the corresponding reception of the its echo.

The specifics of the transmitter and receiver configurations usable with the embodiments described herein are known to those skilled in the art. Further, one skilled in the art recognizes that the mode of collection of the SAR data is not limited to any single mode, but may include, among others, spotlight mode, strip map mode, range Doppler profiler (RDP) mode, air-to-air mode, and the like.

Still referring to *a*, the multiple scattering event due to SPs **2** and **3** are considered. Here, the transmitted waveform reflects off of SP **2**, which then reflects off of SP **3** prior to reception. If the sum of the line segments A+B+C is equal to 2 L in *a*, then the measured range-to target of the single-scattering event at SP **1** at the shown measurement angle θ is identical to, and therefore indistinguishable from, the double-scattering event due to the cascaded reflection from SP **2** to SP **3**. In addition, multiple-scattering events involving three or more scattering points can have this same range-to-target, as shown in *b. *

Referring to *b*, the sum of the two-point scattering event, A+B+C, cascaded from SP **2** and SP **3** and measured at the receiver **10**, is equivalent to the sum of the three-point scattering event, D+E+F+G, cascaded from SP **4**, SP **5**, and SP **6** measured at the receiver **10**, at the shown measurement angle θ.

As described in the Summary of the Problem, conventional SAR theory assumes that all scattering events which affect the measured phase history data (i.e., range-to-target projections) are due to SB effects, as occurs with SP **1** in *a*. This is not always the case. When MB events, such as SPs **2** and **3** in *a*, also significantly impact the measured phase history data, the application of the conventional SAR image formation techniques yield imperfect reconstructions of the region-of-interest.

According to an embodiment of the present invention, the best image of the true scattering centers is obtained by taking into account the MBG data retrieved via imaging through application of an image reconstruction algorithm for multi-bounce scattering (IRAMS). This process for applying the IRAMS is developed through examination of the properties of the MB scattering event shown in, for example, *a*. The data, retrieved via the transmitter and receiver configurations **10**, is processed according to the IRAMS via a processor (not shown). Processors are well known in the art and will not be discussed further herein. Let (x_{i}, y_{i}) denote the two-dimensional (2-D) Cartesian coordinates of the spatial position of SP **2** with which the incident waveform initially interacts. Define (x_{ƒ}, y_{ƒ}) to be the spatial position of SP **3** with which the waveform that was initially reflected off of SP **2** interacts before being reflected into the receiver. Let the variable {tilde over (γ)} denotes the effective path length that the waveform traverses between the initial (x_{i}, y_{i}) and final (x_{ƒ}, y_{ƒ}) scattering centers. This path length {tilde over (γ)} is not required to be equal to the distance between the initial and final scattering centers, i.e., √{square root over ((x_{ƒ}−x_{i})^{2}+(y_{ƒ}−y_{i})^{2})}{square root over ((x_{ƒ}−x_{i})^{2}+(y_{ƒ}−y_{i})^{2})}, as occurs for scattering events involving only two scattering centers. For example, triple-point scattering events are possible, as shown in *b*. *b *shows a waveform scattering off of the initial point (x_{i}, y_{i}) of SP **4** to an intermediate location (x_{5}, y_{5}) at SP **5**, before reflecting off of the final scattering center (x_{ƒ}, y_{ƒ}) at SP **6** and subsequently being collected into the receiver.

Under the definitions above, all single-reflection scattering events are characterized by {tilde over (γ)}=0. Double-reflection scattering events have {tilde over (γ)}=√{square root over ((x_{ƒ}−x_{i})^{2}+(y_{ƒ}−y_{i})^{2})}{square root over ((x_{ƒ}−x_{i})^{2}+(y_{ƒ}−y_{i})^{2})}, whereas N-point scattering events with N>2 are characterized by {tilde over (γ)}>√{square root over ((x_{ƒ}−x_{i})^{2}+(y_{ƒ}−y_{i})^{2})}{square root over ((x_{ƒ}−x_{i})^{2}+(y_{ƒ}−y_{i})^{2})}. Again, the goal of this analysis is to remove the effects of all MB scattering events, which are described by {tilde over (γ)}>0, in order to form an improved spotlight SAR image.

*a *and **1** *b *reveal that the measured range-to target of a scattering event relative to that of the coordinate origin (x=0, y=0) depends upon the observation angle θ via

*s*(θ)=[{*x* _{i} *+x* _{ƒ}}cos(θ)+{*y* _{i} *+y* _{ƒ}} sin(θ)+{tilde over (γ)}]/2. (1)

The division by 2 arises since the range-to-target is equal to one-half of the round-trip distance that the waveform traverses from the transmitter to the object and back into the co-located receiver. The range-to-target spatial coordinate s is related to the waveform time-of-flight t via

with c equal to the waveform speed. Given the MB range-to-target measurements s(θ) collected over some extent of angles θ for an isolated scattering event, it is clear from Eq.(1) that it is possible to determine only the mean position of the initial and final scattering centers, i.e., {(x_{i}+x_{ƒ})/2, (y_{i}+y_{ƒ})/2}, and the total path length {tilde over (γ)} between these two points. No other information can be unambiguously gleaned.

Since only the mean position of the initial and final scattering centers can be determined uniquely, the measured range-to-target for a N-point scattering event with respect to the selected coordinate origin can be expressed in the form

*s*(θ)=*x *cos(θ)+*y *sin(θ)+γ, (3)

in terms of the parameters {x≡(x_{i}+x_{ƒ})/2, y≡{y_{i}+y_{ƒ}}, γ≡{{tilde over (γ)}/2} of Eq. (1). Every N-point scattering event is characterized by the parameters (x,y,γ) and traces a sinusoid in range-angle (s, θ) that is shifted in the s-direction by a distance of γ. In contrast, each SB scattering event is characterized by the parameters (x,y; γ=0) and traces an unshifted sinusoid in range-angle space.

Equation (3) shows that for any generic N-point scattering event with N>1, range-to-target measurements can yield only the values (x,y,γ). This result applies even if there are no other scattering events present. In fact, many individual scattering events having one, two, or more bounces can have identical values of (x,y,γ). Specifically, all scattering events having the same average position for the initial and final scattering centers, i.e., x=(x_{i}+x_{ƒ})/2 and y≡{y_{i}+y_{ƒ}}/2}, and having the same total path length {tilde over (γ)}˜2γ between the initial and final scattering centers contribute to the same (x,y,γ)-point in the MB reflectivity function (MBRF) density ƒ(x,y,γ). That is, the density ƒ(x,y,γ) at a given point in (x,y,γ)-space is formed by the integral of all N-point scattering events characterized by the same values of x, y, and γ. In general, the MBRF ƒ(x,y,γ) is permitted to be a complex function, as in the modeling of the single-bounce reflectivity function ƒ_{SB}(x,y).

Consider the two different scattering events presented in *b*. The range-to-target of the transmitted waveform is considered with respect to the parallel wave front denoted by the thin dashed lines in this figure. The line segments have been drawn so that the following relations hold:

*A+B+C=D+E+F+G,* (4)

*x* _{2} *+x* _{3} *=x* _{4} *+x* _{6} (5)

*y* _{2} *+y* _{3} *=y* _{4} *+y* _{6} (6)

Thus, the 2-point scattering event of SPs **2** and **3**, and the 3-point scattering event of SPs **4**, **5**, and **6** have the same values of x, y, and γ within the MBRF ƒ(x,y,γ). The MBRF is the most basic representation of the region-of-interest which can be reconstructed based upon phase history measurements that include contributions due to MB scattering events.

The measured MB projection function g(s, θ) is determined by the MBRF ƒ(x,y,γ) via

with δ( . . . ) the standard Delta function defined by A(s)≡∫ds′A(s′)δ(s′−s). That is, Eq. (7) is merely the integral of all range-to-target projections of MB scattering events, as determined by Eq. (3). The integral over dγin Eq. (7) applies from −∞ to ∞, provided that the MBRF ƒ(x,y,γ) is constrained to be equal to zero for γ<0. If the MBRF density contains only single-bounce effects, i.e., ƒ_{SB}(x,y)≡ƒ(x,y; γ=0), then the MB transformation equation (7) reduces to the conventional Radon transform

Define the 1-D Fourier transform of the function g(s, θ) with respect to s, applied independently for each observation angle θ, i.e.,

The notation g(s, θ)

so that the waveform temporal bandwidth is

Inserting Eq. (7) into Eq. (9) and interchanging the order of integration gives

Evaluation of the delta function yields the forward MB transformation between the MBRF ƒ(x,y,γ) and the phase history measurements G(ξ, θ):

This equation implicitly assumes that the MBRF ƒ(x,y,γ) is invariant over the extent of measurement angles θ and spatial frequencies ξ under consideration. In a similar fashion, the omission of MB effects yields the corresponding SB result:

with G_{SB}(ξ, θ)

There are two different classes of techniques for inverting Eq. (14) in order to obtain the SB reflectivity function density ƒ_{SB}(x,y) given the measured projections G_{SB}(ξ, θ). The first class of methods invokes the projection-slice theorem. However, it is not clear that these projection-slice techniques can be utilized to invert the particular MB transformation equation (13) of the present embodiment. In particular, the measurements G(ξ, θ) are collected by varying the values of only two variables, i.e., ξ and θ. In contrast, the three-dimensional (3-D) Fourier transform of the desired MBRF density f(x,y,γ) requires an appropriate set of projection measurements over three dimensions, whereas there exist only two in the current example. Therefore, the application of projection-slice methods is not applied to invert the MB transformation equation (13) in the present embodiment. One skilled in the art recognizes that the application of the projection-slice method may be used as an alternative to inversion in an alternative embodiment, wherein the data consists of three-dimensional projection measurements.

The second class of inversion methods used to reconstruct the SB reflectivity function θ_{SB}(x,y) utilizes back-projection functions. Back projection functions reconstruct ƒ_{SB}(x,y) based upon the measured function-domain projection function g_{SB}(s, θ). Alternatively, a frequency-domain back-projection technique may be used to reconstruct ƒ_{SB}(x,y). The present embodiment applies back-projection techniques in order to reconstruct the MBRF ƒ(x,y,γ) based upon the phase history measurements G(ξ, θ).

Alternatively, for a continuous-domain solution, the inversion of the MB projection equation begins with the following definition of the back-projection operation applied to the MB measured transform-domain projections G(ξ, θ):

The limits of integration in Eq. (15) is chosen to be consistent with the collected transform-domain measurements, i.e., ξ_{min}≦ξ≦ξ_{max }and θ_{min}≦θ≦θ_{max}, as described above.

Substituting Eq. (13) for G(ξ, θ) into the back projection function b(x,y,γ) of Eq. (15) and interchanging the order of integration gives

in terms of the kernel function λ(x,y,γ) is defined by

Thus, the MB back-projection function b(x,y,γ) can be expressed in terms of the MBRF ƒ(x,y,γ) via

*b*(*x,y*,γ)=λ(*x,y*,γ)*ƒ(*x,y*,γ). (18)

In this equation, the symbol * denotes the 3-D convolution operation. The 3-D Fourier transform operator

Here, the operator

SAR image reconstruction requires that the MBRF ƒ(x,y,γ) be determined on a discrete grid in (x,y,γ) space, i.e., {x_{l}}_{l=1, . . . ,L}, {y_{m}}_{m=1, . . . ,M}, and {γ_{n}}_{n=1, . . . ,N}. This grid is not required to have equal intervals between grid points in each of the three dimensions of (x,y,γ)-space. However, the assumption of a uniform grid will be shown to reduce the required computation time, even if each of the three dimensions has a different resolution. This analysis generates an estimate of the MBRF matrix f(l,m,n), which is the discrete approximation of the MBRF density ƒ(x,y,γ).

The measurements arising from the coherent processing of the received radar waveform are transduced at a finite set of discrete spatial frequencies {ξ_{p}}_{p=1, . . . ,P }and a finite set of discrete observation angles {θ_{q}}_{q=1, . . . ,Q }relative to the defined coordinate system. This grid in (ξ_{p},θ_{q})-space is not required to be uniform, just as the (x_{l},y_{m},γ_{n})-space of the MBRF matrix f(l,m,n) can be non-uniform. Thus, the measured phase history data are determined by the discrete domain measurement vector G(p,q) as an approximation of the density G(ξ, θ).

Given the definitions for the vectors f(l,m,n) and G(p,q), the MB transformation equation (13) has the discrete form

in terms of the matrix of phase functions

*H*(*l,m,n,p,q*)=exp(−*j*2π[*x* _{l }cos(θ_{q})+*y* _{m }sin(θ_{q})+γ_{n}]ξ_{p}). (21)

Equation (20) can be expressed in the basic form of the algebraic reconstruction problem

where is the vector of unknowns of length U≡L×M×N, the variable is a vector of measurements of length V≡P×Q and is the U×V matrix of the vectors giving the projection of an (l,m,n) object space point onto (p,q) measurement space. The requirement that V≧U must be satisfied in order to obtain a solution for , otherwise, Eq. (22) is undetermined.

A method for obtaining a solution of Eq. (22) is via the pseudo-inverse

with the superscript denoting the Hermitian transpose. The pseudo-inverse gives the unique least-squares solution provided that the square matrix

The matrix

Inserting Eq. (20) for G(p,q) into Eq. (24) and interchanging the order of the summation gives

in terms of the matrix kernel

with

*l,l′,m,m′,n,n′*)≡[{*x* _{l} *−x* _{l′}}cos(θ_{q})+{*y* _{m} *−y* _{m′}})sin(θ_{q})+{γ_{n}−γ_{n′}}]ξ_{p}, (27)

For the case of a uniform grid in (x_{l},y_{m},γ_{n})-space, i.e., {x_{l}=l δ_{x}}_{l=1, . . . ,L}, {y_{m}=mδ_{y}}_{m=1, . . . ,M}, and {γ_{n}=nδ_{γ}}_{n=1, . . . ,N}, with δ_{x}, δ_{y}, δ_{γ}, all constants, Eq. (27) reduces to

*l,l′m,m′,n,n′*)=[{*l−l′*}δ_{x }cos(θ_{q})+{*m−m′*}δ_{y }sin(θ_{q})+{*n−n′*}δ_{γ}]ξ_{p}, (28)

Thus, Eq. (25) has the form

*b*(*l,m,n*)=Λ(*l,m,n*)*f(*l,m,n*) (29)

with

and the phase matrix

Ω(*l, m, n, p, q*)≡[*lδ* _{x }cos(θ_{q})+*mδ* _{y }sin(θ_{q})+*nδ* _{γ}]ξ_{p}. (31)

Here, the symbol “*” denotes the 3-D discrete convolution. The convolutional structure of Eq. (29) permits the inversion of f(l,m,n) to be computed in FFT-time of order O(U log_{2}(U)). Thus the rate-determining step is the computation of the back-projection vector b(l,m,n) given the measurement phase history vector G(p,q) via Eq. (24), which is of order O(U×V). Alternatively, function-domain back-projection operations can be performed in order O(U log_{2}(U)), such that in an alternative embodiment of the present invention, the transform-domain back-projections applied to MB image reconstruction described herein, can also can be implemented in order O(U log_{2}(U)).

The SB analog of Eq. (29) has the form

*b* _{SB}(*l,m*)=Λ_{SB}(*l,m*)**f* _{SB}(*l,m*), (32)

with

and

Ω_{SB}(*l, m, n, p, q*)≡[*lδ* _{x }cos(θ_{q})+*mδ* _{y }sin(θ_{q})]ξ_{p}. (34)

Here, the symbol “*” denotes two-dimensional (2-D) discrete convolution. In Eq. (32), b_{SB}(l,m) is determined by

in terms of the matrix of SB phase functions

*H* _{SB}(*l,m,p,q*)=exp(−*j*2πΩ_{SB}(*l, m, p, q*)). (36)

Since the measurements G(p,q) are determined by the MB transformation Eq. (20), the SB reconstruction technique of computing f(l, m) based upon Eqs. (32)–(36) will contain undesirable artifacts unless contributions due to MB scattering events are absent in the measurement phase history data G(p,q).

The previous paragraphs have developed a technique for MB image reconstruction by deriving the 3-D convolution equation (29), which is equivalent to the matrix form of Eq. (25). The existence of a well-behaved solution for the MBRF f(l, m, n) requires that the 3-D Hermitian-Toeplitz matrix _{l, m, n}(p,q)≡H(l,m,n,p,q) are all linearly independent functions of the phase history measurement indices p and q. This constraint is satisfied if one or more of the elements of the normalized phase vectors a_{l, m, n}(p,q)≡Ω(l,m,n,p,q) of Eq. (31) change by unity or greater between adjacent cells in image-space (l,m,n). The normalized phase vectors a_{l, m, n}(p,q) satisfy this requirement, and thus yield a well-behaved solution to Eq. (29) or (25), if the following conditions apply.

First, consider the fact that spotlight SAR phase history data is typically collected over a narrow extent of measurement angles Δ_{θ}≡θ_{max}−θ_{min}<<1, here considered about θ=0 without loss in generality. For a power-series expansion about θ=0 through only first order in θ, the factor cos(θ_{q}) in the normalized phase of Eq. (31) is approximately unity. Thus, the dependence of the along-range coordinate x in Eq. (31) is identical to that of the MB coordinate γ, so that the effects of x and γ cannot be differentiated through first order. Therefore, a well-behaved MB reconstruction requires that the extent of measurement angles Δ_{θ} be sufficiently large that second order effects become significant. The required second order expansion of Eq. (31) has the form:

In order to give a desired image-space resolution (δ_{x}, δ_{y}, δ_{γ}), the extent of measurements in spatial frequency Δ_{ξ} and in angle Δ_{74 } must be selected to be large enough so that the zeroth, first, and second order terms in Eq. (37) all change by unity or greater between adjacent image-space cells (l,m,n). The change in the zeroth order phase term {lδ_{x}+nδ_{γ}}ξ_{p }of Eq. (37) exceeds unity between adjacent cells in both the x and γ dimensions over the extent of spatial frequencies if

Δ_{ξ}≳max{δ_{x} ^{−1}, δ_{γ} ^{−1}}, (38)

which reduces to the well-known SB relation Δ_{ξ}˜δ_{x} ^{−1}.

The change in the first order phase term mδ_{y}θ_{q}ξ_{p }of Eq. (37) exceeds unity between adjacent cells in they dimension over the extent of measurement angles if

Δ_{74}≳{ξ_{cƒ}δ_{y}}^{−1}, (39)

with ξ_{cƒ} equal to the center spatial frequency. This relation is identical to that of the SB case. The change in the second order phase term—(½)lδ_{xθ} _{ q } _{ 2 }ξ_{p }of Eq. (37) exceeds unity between adjacent cells in the x dimension over the extent of measurement angles if

Δ_{θ}≳√{square root over (2{ξ_{cƒ}δ_{x}}^{−1})}, (40)

Thus, the first and second order constraints of Eqs. (39) and (40) are combined to yield

Δ_{θ}≳max {{ξ_{cƒ}δ_{y}}^{−1}, √{square root over (2{ξ_{cƒ}δ_{x}}^{−1})}} (41)

For the case of identical image-space resolutions in each dimension, i.e., δ≡δ_{x}=δ_{y}=δ_{γ}, the required measurement extents reduce to

Δ_{ξ}≳δ^{−1} (42)

Δ_{θ}≳√{square root over (2{ξ_{cƒ}δ}^{−1})}. (43)

Therefore, the extent of measurement frequencies required for the MB case is unmodified from that of the SB case. However, the extent of measurement angles is greater for the MB case than for the SB case.

In order to derive an expression for the measurement intervals δ_{ξ} and δ_{θ} required for a desired image-space extent (Δ_{x}≡Lδ_{x}, Δ_{y}≡Mδ_{y}, Δ_{γ}≡Nδ_{γ}, consider the normalized phase of Eq. (37) with θ_{q}=_{q}δ_{θ} and ξ_{p}=ξ_{cƒ}+pδ_{ξ}, i.e.,

The change in the normalized phase of Eq. (44) must be unity or less between adjacent measurement samples δ_{ξ} and δ_{θ} in order to obtain a well-behaved solution. The change in the zeroth order term of Eq. (44) is unity or smaller over the image-space extents in the x and y dimensions if

δ_{ξ}≲{Δ_{x}+Δ_{y}}^{−1}. (45)

The first order term of Eq. (44) is unity or smaller over the image-space extents in they dimension if

δ_{θ}≲{Δ_{x}+Δ_{y}}^{−1}. (46)

whereas the second order term does so for

δ_{ξ}≲√{square root over (2{ε_{cƒ}Δ_{x}}^{−1})}. (47)

The combination Eqs. (46) and (47) gives

δ_{θ}≲min{{ξ_{cƒ}Δ_{y}}^{−1},√{square root over (2{ξ_{cƒ}Δ_{x}}^{−1})}}, (48)

For equal extents in the x and y spatial dimensions, i.e., Δ≡Δ_{x}=Δ_{y}, Eq. (48) reduces to

δ_{θ}≲{ξ_{cƒ}Δ}^{−1}, (49)

which is identical to that of the SB case.

The SAR image reconstruction processes developed above are applied to simulated MB phase history data with the following results. *a *presents an example containing a number of assumed scattering center reflectivities. The co-located transmitter and receiver (not shown) are located at the top of each of the figures, transmitting and receiving down and up the paper in a lengthwise direction. This plot corresponds to the γ=0 plane of the MBRF ƒ(x,y,γ). In addition, it is assumed that there exists a MB coupling within the four sets of closely-spaced scattering centers located in the four corners **12**, **14**, **16**, and **18** of *a*. For example, there is a contribution to the MBRF ƒ(x,y,γ) corresponding to the two scattering centers at (x,y)=(12, 3) and (12, 5) located in corner **12** of the truth plot in *a*. Specifically, the γ=1 plane of the MBRF shown in *b *contains a contribution at the mean position (x,y)=(**12**, **4**) between these two scattering centers, in accord with the distance 2γ=2 between these two scattering centers. Likewise, the truth scattering centers at (x,y)=(**12**, **13**) and (**14**, **13**) in the lower right corner **14** of *a *yield the γ=1 MB contribution at (**13**, **13**) in *b*. Similarly, the truth scattering centers at (x,y)=(**3**, **5**) and (**5**, **3**) in the upper left corner **16** of *a *have a MB coupling length of 2γ=2√{square root over (2)}, thus giving linearly-interpolated contributions at (**4**, **4**) in the γ=1 and γ=2 planes of *b *and **2** *c. *

The three coupled scattering centers at (x,y)=(**3**, **12**), (**5**, **12**) and (**5**, **14**) in the upper right corner **18** of *a *give three different double-bounce contributions corresponding to (x,y,γ)=(**4**, **12**, **1**), (**5**, **13**, **1**), and (**4**, **13**, √{square root over (2)}), similar to the double-bounce couplings in the other three corners **12**, **14**, and **16** of *a*. In addition, the upper right corner **18** scattering centers yield various triple-bounce events. For example, the scattering sequence (**5**, **14**)→(**5**, **12**)→(**3**, **12**) gives the MB contribution at (x,y,γ)=(**4**, **13**, **2**) in *c*, since the total path length between the initial point (**5**, **14**) and the final point (**3**, **12**) is 2γ=4 Likewise, the scattering sequence (**5**, **14**)→(**3**, **12**)→(**5**, **12**) gives a contribution for (x,y,γ)=(**5**, **13**, √{square root over (2)}+1), and the sequence (**3**, **12**)→(**5**, **14**)→(**5**, **12**) yields (x,y,γ)=(**4**, **12**, √{square root over (2)}+1).

The MBRF ƒ(x,y,γ) for γ≠0 in *b*–**2** *d *is based upon the true path lengths between the scattering centers of *a *However, the coupling strengths between the scattering centers were selected in an ad hoc manner to be equal to that of the truth scattering centers themselves. Nevertheless, the MB techniques described herein apply generically for any specific quantitative rules governing the MB coupling strengths.

The true values of the MBRF ƒ(x,y,γ) shown in *a*–**2** *d *are applied within Eq. (20) in order to simulate the measurement function G(ξ, θ) shown in *a *and **3** *b*. The measurement functions shown in *a *and **3** *b *are coherent measurements, resulting from a quadrature demodulation of the received waveform, i.e., the reflected wave form. The x-axis is the measure of angle in radians, while the y, axis is spatial frequency. The measurement functions of *a *and **3** *b*, when inverted using the single bounce theory, give the result shown in *a*–**5** *d*, creating not only an identical replica of the desired image but, also creating higher delay planes or multiple bounce image planes that contain the information rich echo portions of the reflected wave form The signal-to-noise ratio in this embodiment is approximately 40 dB. As stated above, noise and interference play no greater a role in the IRAMS processing than in the single bounce processing. Consequently, one skilled in the art recognizes the standard signal-to-noise limitations that are applicable to IRAMS processing.

The results of Eq. (37)–(49) are used to determine the required sampling intervals and extents of both the spatial frequency ξ and the angular coordinate θ which are necessary to reconstruct the truth MBRF ƒ(x,y,γ) of *a*–**2** *d*. The desired image-space resolution is δ≡δ_{x}=δ_{y}δ_{γ}=1, so that Eq. (42) implies that a spatial frequency bandwidth of Δ_{ξ}=1/δ is sufficient for a well-behaved MB reconstruction. SAR measurements are collected over a narrow extent of measurement angles, which is chosen to be Δ_{θ}˜0.2 rad˜11.5° in this particular example. Then the spatial center frequency is selected to be

consistent with δ=1 and Δ_{θ}≅0.2 rad in Eq. (43). The desired reconstruction extents are given by Δ_{x}=Δ_{y}=16 and Δ_{γ}=4 for this example. Thus, Eq. (45) implies that the required sampling interval in spatial frequency is δ_{ξ}= 1/20, and Eq. (49) gives a required angular sampling interval of δ_{θ}≅1/720 rad≅0.08°.

*a*–**5** *d *show the application of the MB inversion of Eqs. (24) and (29) in order to estimate the MBRF ƒ(x,y,γ) based upon the simulated phase history data G(ξ, θ) of *a *and **3** *b*. A shown, they γ=0, γ=1, γ=2, and γ=3 planes of *a*–**5** *d *give an approximately identical reconstruction of the desired scattering center locations and strengths of *a*. Further, the extracted MB scattering events located within the γ≠0 planes can be used to augment the feature vectors applied to, for example, target recognition analysis.

For the sake of comparison, the desirable MB image reconstruction of *a*–**5** *d *is compared with that based upon the assumption of only SB scattering events. *a *and **3** *b*. Clearly, the SB technique reveals a significant degradation in the estimation of the object scattering centers of *a*. Although the object locations and strengths of the various scattering centers of *a *are well-reproduced, *a *and **3** *b*. Whereas the MB inversion technique accurately reconstructs a given MB scattering event characterized by (x,y,γ), the SB inversion method incorrectly projects such a point to (x+γ, y) for phase history data measured over a narrow angular extent about θ=0. For example, the MB scattering event of (x,y,γ)=(**12**, **4**, **1**) of *b *is incorrectly projected to the point (x,y)=(13, 4) within the SB estimate of

The ability to form a well-behaved MB inversion depends entirely upon the coordinate grids {x_{l}, y_{m}, γ_{n}} and {ξ_{p}, θ_{q}} selected for the desired MBRF f(l,m,n) and the measurements G(p,q). That is, the specific number of scattering centers and their MB coupling strengths within the true MBRF are irrelevant to the inversion process, so that examples containing a much higher density of scattering events can also be generated. The particular example presented herein was selected in order to demonstrate the most salient effects in the MB and SB image reconstructions.

The embodiment described above may be extended to include data from a higher number of spatial dimensions. Define r to be a vector in an

-dimensional vector space. Likewise, define k to be a unit vector in this -D vector space. The =2 case presented above characterizes the spatial vector via r≡[x,y]The generic

-D form of the MB projection equations (7) isThe corresponding

-D form of the MB transform-domain projection equation (13) becomesIn a similar fashion, the

-D form of the MB back-projection equation (15) isThis -D form of the back-projection function b(r, γ) can be expressed in the following convolutional form

in terms of the kernel function

λ(

Thus, the inversion for the MBRF yields

A similar set of generic

The multiple-bounce inversion technique yields excellent reconstructions of the multiple-bounce reflectivity function ƒ(x,y,γ). In fact, these multiple-bounce inversion methods will not degrade the reconstructed image for cases in which the phase history measurements G(ξ, θ) contain only single-bounce contributions. In contrast, the single-bounce inversion methods of conventional spotlight SAR theory yield spurious ghosting artifacts in the image reconstruction ƒ_{SB}(x,y) for cases in which multiple-bounce events contribute to the measured phase history data G(ξ, θ).

In an alternate embodiment of the present invention, *a*–**6** *d *refer to truth reflectivity functions identical to those shown in *a*–**3** *d*. *a*–**7** *b*, similar to *a*–**4** *b*, show the measurement data for G(ξ, θ) corresponding to the given ƒ(x,y,γ). The measurement data shown in *a*–**7** *b *differs from that shown in *a*–**4** *b*, in that the data is collected at low spatial frequencies from about ξ=0.5 to ξ=1.5 as opposed to the much higher spatial frequencies in *a*–**4** *b *which is from ξ=45.1 to ξ=46.1. Inversion of the measurement data using the MB reconstruction process described herein results in a virtually identical replica depicted in *a*–**9** *d *of the truth reflectivity function shown in *a*–**6** *d*. Whereas, the inversion of the measurement data using the SB reconstruction process shown in

The IRAMS process described herein is also applicable to near-field collection data, wherein the wavefronts are curved. For the 2-D problem above, assume that the radius and angle (in polar coordinates) of the sensor are given by R(η) and φ(η), respectively, in terms of a scalar parameter τ which can vary in any fashion with regard to the attributes of the scene of interest. Then the measured range-to-target with respect to the coordinate origin is

This equation replaces Eq. (1) for the near-field problem. The remainder of the analysis is straightforward, wherein the integrations/summations over θ are replaced by the corresponding integrations/summations over the scalar parameter η. It can also be verified by a Taylor series expansion that the near-field equation (56) reduces to the far-field equation (1) as the radius R(η) becomes much larger than the size of the scene of interest. Equation (56) can be further extended to apply for a non-planar collection surface by defining the sensor location in terms of the spherical coordinates (R(η), φ(η), ω(η)) parameterized by the scalar parameter η via

This type of modeling also permits targets to have different heights z.

Further, the location of the transmitter and receiver can be different. The required modifications for such a bistatic collection are well-known to those skilled in the art. There are two primary modifications required. First, the measurement angle θ for a two-dimensional monostatic collection (wherein the transmitter and receiver are co-located) in the far-field is replaced by the bisector angle between the angle of the transmitter and that of the receiver. Second, the measured spatial frequencies for this problem are scaled by the factor cos(β/2), with β equal to the angle between that of the transmitter and that of the receiver. Further extension of the bistatic problem to the near-field case and to a non-planar collection surface, as presented above for the monostatic case, can be accomplished by one who is skilled in the art.

The specific examples described above are not intended to be limiting. Alteration of the processes described above is contemplated by one skilled in the art for application of the IRAMS process to various types of reflection tomographic data, including radar, sonar, and the like.

Patent Citations

Cited Patent | Filing date | Publication date | Applicant | Title |
---|---|---|---|---|

US3561838 | Mar 24, 1967 | Feb 9, 1971 | Columbia Broadcasting Syst Inc | Holographic imaging |

US3635539 | Aug 18, 1969 | Jan 18, 1972 | Sperry Rand Corp | Wide-angle holographic apparatus |

US3740111 | Dec 27, 1971 | Jun 19, 1973 | Rca Corp | Holographic recording system for large objects |

US3757332 | Dec 28, 1971 | Sep 4, 1973 | Gen Dynamics Corp | Holographic system forming images in real time by use of non-coherent visible light reconstruction |

US3888561 | Aug 10, 1973 | Jun 10, 1975 | Nasa | Real time, large volume, moving scene holographic camera system |

US4095222 * | May 27, 1976 | Jun 13, 1978 | Westinghouse Electric Corp. | Post-detection stc in a medium prf pulse doppler radar |

US4855747 | Aug 17, 1987 | Aug 8, 1989 | Trustees Of The University Of Pennsylvania | Method of target imaging and identification |

US5061931 | Jul 23, 1990 | Oct 29, 1991 | Selenia Industrie Elettroniche Associate S.P.A. | Recursive system for image forming by means of a spotlight synthetic aperture radar |

US5160932 | Jul 13, 1990 | Nov 3, 1992 | The Boeing Company | Over-the-horizon synthetic aperture radar |

US5307070 | Aug 23, 1991 | Apr 26, 1994 | Deutsche Forschungsanstalt Fur Luft-Und Raumfahrt | Method for resolving ambiguity in the determination of antenna angle of view and Doppler frequency in synthetic aperture radar |

US5805098 | Nov 1, 1996 | Sep 8, 1998 | The United States Of America As Represented By The Secretary Of The Army | Method and system for forming image by backprojection |

US6018306 | Aug 21, 1998 | Jan 25, 2000 | Raytheon Company | Scalable range migration algorithm for high-resolution, large-area SAR imaging |

US6130641 | Sep 4, 1998 | Oct 10, 2000 | Simon Fraser University | Imaging methods and apparatus using model-based array signal processing |

US6222933 | Dec 21, 1998 | Apr 24, 2001 | DEUTSCHES ZENTRUM FüR LUFT-UND RAUMFAHRT E.V. | Method of processing spotlight SAR raw data |

Non-Patent Citations

Reference | ||
---|---|---|

1 | "The Spotlight Synthetic Aperture Radar Project" [online], Fact Sheet Library, Aerospace Radar, [retrieved on Jan. 10, 2002], 3 pp., Retrieved from Internet: http:www.dreo.dnd.ca/pages/factsheet/ar/ar0011<SUB>-</SUB>e.html. | |

2 | "What is Synthetic Aperture Radar?", [online], Sandia National Laboratories, [retrieved on Jan. 10, 2002], 3 pp, Retrieved from Internet: www.sandia.gov/radar/whatis.html. | |

3 | David C. Munson, Jr., James Dennis O'Brien, W. Kenneth Jenkins, A Tomographic Formulation of Spotlight-Mode Synthetic Aperture Radar, Proceedings of the IEEE, vol. 71, No. 8, Aug. 1983, p. 917-925. | |

4 | Donald Ludwig, The Radon Transform on Euclidean Space, Communications on Pure and Applied Mathematics, vol. XIX, pp. 49-81, 1966. | |

5 | Garren, David A., et al., "SAR Image Formation Algorithm with Multipath Reflectivity Estimation," IEEE, 6 pp., 2004. | |

6 | J. Meyer-Arendt, "Introduction to Classical and Modern Optics," Prentice-Hall, Inc., Englewood Cliffs, NJ, pp. 413-417, 1972. | |

7 | Kasischke, E.S., et al., "Monitoring Hydropatterns in South Florida Ecosystems Using ERS SAR Data" [online], 7 pp., [retrieved on Mar. 25, 2004], Retrieved from the Internet: http://earth1.esrin.esa.it/ers/symposia/ers97/papers/kasischke1/186c.htm. | |

8 | L. Gagnon, H. Oppenheim, P. Valin, R&D Activities in Airborne SAR Image Processing/Analysis at Lockheed Martin Canada, Proceedings SPIE #3491, Jul. 1998, p. 998-1003. | |

9 | P. R. Smith, T. M. Peters, R. H. T. Bates, Images Reconstruction from Finite Numbers of Projections, pp. 361-383. | |

10 | R. H. T. Bates, T. M. Peters, Towards Improvements in Tomography, New Zealand Journal of Science 14: pp. 883-896, 1971. | |

11 | Richard Gordon, A Tutorial on ART (Algebraic Reconstruction Techniques), IEEE Transactions on Nuclear Science, vol. NS-21, Jun. 1974, pp. 78-93. | |

12 | Weeks, Robin J., et al., "Surface Roughness, Radar Backscatter, and Visible and Near-Infrared Reflectance in Death Valley, California" [online], 1996 [retrieved on Mar. 25, 2004], 17 pp., Retrieved from the Internet: http://dana.geology.washington.edu/jgr/jgr.htm. | |

13 | Weissel, Jeffrey, et al., "Mapping Landslide Surfaces Using Fully Polarimetric SAR: AIRSAR Coverage of the 1999 Taiwan Landslides" [online], [retrieved on Mar. 25, 2004], 2 pp., Retrieved from the Internet: http://airsar.jpl.nasa.gov/documents/workshop2002/papers/P2.pdf. |

Referenced by

Citing Patent | Filing date | Publication date | Applicant | Title |
---|---|---|---|---|

US7302359 * | Feb 8, 2006 | Nov 27, 2007 | Honeywell International Inc. | Mapping systems and methods |

US7516039 | Oct 18, 2007 | Apr 7, 2009 | Honeywell International Inc. | Mapping systems and methods |

US8242949 * | Jun 30, 2010 | Aug 14, 2012 | Delaurentis John M | Multipath SAR imaging |

US20070185681 * | Feb 8, 2006 | Aug 9, 2007 | Honeywell International Inc. | Mapping systems and methods |

US20080040071 * | Oct 18, 2007 | Feb 14, 2008 | Honeywell International Inc. | Mapping systems and methods |

US20120001795 * | Jan 5, 2012 | Delaurentis John M | Multipath SAR imaging | |

CN101685154B | Sep 27, 2008 | Dec 26, 2012 | 清华大学 | Image fusion method of double/multiple base inverse synthetic aperture radar |

Classifications

U.S. Classification | 342/179, 342/25.00R, 342/195, 342/175, 342/176, 342/159 |

International Classification | G01S13/90, G01S13/89, G01S13/00 |

Cooperative Classification | G01S15/8906, G01S7/52077, G01S2013/9052, G01S15/8977, G01S13/9035 |

European Classification | G01S13/90S |

Legal Events

Date | Code | Event | Description |
---|---|---|---|

Oct 1, 2004 | AS | Assignment | Owner name: SCIENCE APPLICATIONS INTERNATIONAL CORP., CALIFORN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GARREN, DAVID;REEL/FRAME:015862/0125 Effective date: 20020222 |

Jun 12, 2007 | CC | Certificate of correction | |

Jun 22, 2010 | FPAY | Fee payment | Year of fee payment: 4 |

Apr 11, 2014 | AS | Assignment | Owner name: LEIDOS, INC., VIRGINIA Free format text: CHANGE OF NAME;ASSIGNOR:SCIENCE APPLICATIONS INTERNATIONAL CORPORATION;REEL/FRAME:032662/0712 Effective date: 20130927 |

Aug 5, 2014 | FPAY | Fee payment | Year of fee payment: 8 |

Rotate