|Publication number||US5760899 A|
|Application number||US 08/674,603|
|Publication date||Jun 2, 1998|
|Filing date||Sep 4, 1996|
|Priority date||Sep 4, 1996|
|Also published as||WO1998010254A1|
|Publication number||08674603, 674603, US 5760899 A, US 5760899A, US-A-5760899, US5760899 A, US5760899A|
|Inventors||Michael T. Eismann|
|Original Assignee||Erim International, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (3), Referenced by (150), Classifications (7), Legal Events (11)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This invention relates generally to imaging spectrometers and, more particularly, to a sensor configuration which combines dispersive and filtered TDI detector techniques to realize an improved, high-sensitivity configuration, particularly for airborne thermal/infrared applications.
The acquisition and processing of multispectral and hyperspectral data from airborne electro-optic/infrared (EO/IR) sensors has emerged in recent years as an important method for extracting information for remote imaging purposes. Examples range from geological studies and terrain classification to military target detection and identification. For the latter applications, there is considerable interest in applying multispectral techniques in the thermal infrared spectral region to support high confidence, day/night target detection and/or recognition.
Recent studies have indicated the presence of thermal multispectral signatures which theoretically enable such a capability. These color signatures in the thermal spectral region, however, are generally very subtle. Fortunately, the spectral correlation of backgrounds is generally sufficiently high to allow high confidence target detection even in the presence of relatively weak target color.
The requirements of an airborne thermal multispectral sensor are driven by the spectral and spatial properties of targets and backgrounds, and these requirements may be rather challenging if reliable multispectral signatures are to be preserved. From recent studies using sensitive, tower-based spectrometers, a measurement database relating to airborne sensor requirements has been developed. Thus far, the following primary requirements have been determined: (a) a very low sensor noise level; (b) moderately narrow spectral bands placed at specific locations (target and background dependent); (c) temporal simultaneity of the spectral channels; and (d) fine spatial registration between spectral channels.
Several sensor approaches have been developed and tested for airborne multispectral and hyperspectral imaging, each with its own merits and limitations. With respect to this invention, two design approaches in particular exhibit certain features of interest. The first approach is the dispersive imaging spectrometer, and the second is the filtered detector imaging spectrometer. Each will be discussed in turn.
FIG. 1 is a pictorial representation of a dispersive imaging spectrometer. The basic elements include a slit 102 at the image plane of the sensor fore-optics 104, a dispersive spectrometer module 106 containing a dispersive element 107, and a two-dimensional focal-plane sensor array 108. The slit 102 limits the field-of-view of the sensor 108 to a one-dimensional line of pixels, while the dispersive element 107 spreads the spectrum of these pixels in the cross-slit dimension onto the focal plane array of the sensor 108. As shown in FIG. 2, the result at any instant in time is a frame of data points containing a contiguous series of spectral channels, each with a one-dimensional image of the slit-limited field-of-view. In a conventional airborne sensor implementation, forward aircraft motion 101 is used to obtain the second image dimension from multiple frame sequences. Those of skill in the art are aware that there exists a variety of optical configurations for each of the various subassemblies.
The primary merits of the dispersive imaging spectrometer approach just described are: (1) no moving parts; (2) spectral channels which are sensed with essentially perfect simultaneity; and (3) very low noise performance. To achieve the low noise performance in the thermal spectral region, however, the sensor must be cryogenically cooled. When such cooling is provided, each detector element senses only radiation within the spectral channel passband. This results in minimal background noise, and is a favorable, distinguishing characteristic as compared to temporal or spatial Fourier transform spectrometer techniques.
Two important drivers associated with low noise include detector array performance and sensor throughput (etendue). Achieving high sensor throughput with a dispersive imaging spectrometer without seriously degrading spectral and spatial performance is the primary design challenge. Several spectrometer approaches have been studied to meet this challenge. The primary concerns of the dispersive imaging approach spectrometer are the effects of detector spatial noise and spatial-spectral distortion of the arrangement in terms of the spectral correlation of background measurements. Minimization of spatial-spectral distortion, in particular, is more difficult to achieve as sensor throughput is increased for better noise performance. This results in a constraining sensor trade-off for airborne operation where the allowable sensor dwell time is limited by platform dynamics. For example, consider a platform traveling at 120 knots (roughly 60 m/s) at an altitude of 1000 ft. With a 1 mrad IFOV (infrared field of view), the sensor must operate at 200 frames per second (5 msec dwell time) to achieve nominally 1 ft. of ground resolution. The theoretical lower limit to the cryogenically cooled sensor noise equivalent spectral radiance or NESR (i.e., background limit) is approximately ##EQU1## where L.sub.λ is the source spectral radiance, η is the detector quantum efficiency, AΩ is the sensor throughput (including optical transmission), Td is the dwell time, and αλ is the spectral bandwidth for the spectral channel.
Based upon existing throughput and detector characteristics (η=0.3 in LWIR, 0.1 in MWIR), along with a 5 msec dwell time and 100 nm spectral bandwidth, an NESR of 0.26 μW/cm2 μmsr is achievable at 4.7 microns and 0.23 μW/cm2 μmsr at 10 microns for a 300K source. This sensitivity is approximately 4 to 5 times inferior to the desired noise performance. Some small gains (about a factor of 2) may be made using higher quantum efficiency detectors, but with a potential penalty in terms of spatial noise. Increasing sensor throughput is also a potentially difficult task due to the stringent spatial-spectral distortion requirements. This leaves dwell time as the only remaining variable. To increase dwell time with this sensor approach, however either the platform must fly slower or the sensor must backscan. The former may not be practical and the latter involves a potentially complicated pointing system. In both cases, the rate of ground coverage is sacrificed. Moreover, since the NESR is inversely proportional to the square root of the dwell time, this reduction in ground coverage is likely to exceed an order of magnitude.
One alternative design approach to the dispersive imaging spectrometer is the filtered detector imaging spectrometer, which utilizes an arrangement of filtered detectors in the focal plane of an imaging system including fore-optics 304 and relay optics 306. FIG. 3 is a pictorial representative of this approach. The basic concept utilizes a series of one-dimensional focal plane arrays such as 302 in the image plane, each filtered to a different spectral band of interest. Due to the lateral separation between detectors, there is a field shift between spectral channels, which, in an airborne operation, results in a time lag between spectral images. If the platform dynamics are precisely known or controlled, however, it is theoretically possible to register the spectral images, though, in practice, this is a somewhat difficult task.
The advantage of the filtered detector approach is that time-delay-integrate (TDI) techniques may be used to increase the effective integration time. Making reference to the focal plane layout shown in FIG. 4, the idea behind TDI is to shift the sensed charges from each line of detectors in conjunction with the image motion to provide a larger effective dwell time than allowed by the spatial resolution constraint for a non-TDI image sensor. This TDI operation is not achievable with the dispersive imaging spectrometer because of the spectral dispersion in the image motion direction. Problems associated with the filtered detector approach include the lack of temporal simultaneity in the spectral measurements and spatial misregistration in actual practice. Both of these problems result in spectral decorrelation, which is a primary characteristic to be preserved.
In an imaging spectrometer of the type including a focal-plane array having a dispersive dimension, this invention improves upon the existing art by providing a focal-plane arrangement having one or more sets of detector array segments, each such segment being laterally shifted in the dispersive dimension and optically filtered to spatial register the dispersion associated therewith. Fore-optics are provided which enable each set of detector array segments to view a different field angle of a scene of interest, and electronic circuitry, coupled to the focal-plane arrangement, is operative to perform a time-delay-integrate (TDI) operation on a segment-by-segment basis and generate a spectral image representative of the scene of interest. In a typical configuration, at least the fore-optics and focal-plane arrangement are airborne to gather data in a second dimension during flight and image the data onto replicated sets of detector elements. Depending upon the application, the spectral image may be thermally based. In one embodiment, TDI operation is performed with respect to an individual segment to achieve a hyperspectral sensing configuration. In an alternative embodiment, the TDI operation is performed with respect to multiple, overlapping segments to achieve a multispectral sensing configuration. The invention is also applicable to other sensor arrangements, including dual-band framing.
A high-sensitivity imaging spectrometer according to the invention might therefore include:
a platform moving in a first spatial dimension relative to a field of interest;
fore-optics supported on the platform to collect optical energy in the form of a plurality of multispectral segments, each at a different field angle;
a dispersive module operative to wavelength separate each multispectral segment into a plurality of individual wavelength channels, each channel including a plurality of data points arranged along a second spatial dimension;
a focal-plane image sensor having a two-dimensional array of optoelectric detector elements arranged as rows and columns, the image sensor being supported relative to the dispersive module such that the wavelength channels of the multispectral segments fall onto different rows of the image sensor, with the data points within the wavelength channels falling onto different columns of the image sensor;
a plurality of wavelength-specific filters disposed in an optical path between the dispersive module and the focal-plane image sensor, each filter being matched to selectively pass the various individual wavelength channels; and
electronic circuitry in electrical communication with the optoelectric elements of the focal-plane image sensor, the circuitry being operative to generate a spectral image representative of the field of interest.
FIG. 1 is a schematic illustration of a prior-art dispersive imaging spectrometer arrangement;
FIG. 2 represents a focal plane layout of the dispersive imaging spectrometer of FIG. 1;
FIG. 3 is a pictorial of a prior-art filter detector imaging spectrometer;
FIG. 4 represents a focal plane layout of the filter detector imaging spectrometer of FIG. 3;
FIG. 5 is a pictorial of a time-delay-integrate (TDI) dispersive imaging spectrometer according to the present invention;
FIG. 6 represents a focal plane layout for a spectrometer according to this invention for use in a hyperspectral sensor application;
FIG. 7 represents a focal plane layout for a spectrometer according to this invention in a multispectral sensor application; and
FIG. 8 represents a focal plane layout for a dual-band framing sensor according to the present invention.
As discussed in the Background of this invention, the dispersive imaging spectrometer approach exhibits many attractive features for airborne hyperspectral or multispectral sensing, but is somewhat constrained in achieving an improved NESR. The instant invention improves upon the dispersive approach by allowing TDI operation, thereby achieving better noise performance without causing a reduction in sensor coverage or requiring higher sensor throughput (and degraded spatial-spectral properties).
As illustrated in FIG. 5, the optical train, which includes fore-optics 504 and a dispersive module 506, is dispersive, but without the slit. The focal plane arrangement 508, examples of which are described below, consists of a replicated set of detector array segments laterally shifted in the dispersion direction. Each array segment consists of a two-dimensional array of filtered detector elements, or alternatively, each segment may comprise a set of one-dimensional arrays arranged in the orthogonal dimension. For each segment, the filter characteristics are matched to the dispersion; that is, the spectral channels are spatially registered to view the same field angle. For a single detector segment, the configuration is analogous to a conventional dispersive spectrometer, assuming the filter bandwidths also match the spectral resolution of the spectrometer. But by using multiple segments which view different field angles, it is possible to increase the effective dwell time through segment-to-segment digital TDI. Thus, the invention preserves the important inter-band temporal simultaneity and spatial registration attributes of the dispersive spectrometer, while providing a path for increased dwell time, thereby reducing NESR, by virtue of the TDI. The TDI is preferably achieved off-chip; that is, the array is read out in frames and the proper shifted rows are digitally summed on a frame-to-frame basis.
For a hyperspectral sensor (characterized by measurement of the full spectrum across the spectral range), a multiple slit dispersive spectrometer arrangement may alternatively be employed. For multispectral operation (subset of spectral bands from hyperspectrum), the filtered concept provides additional degrees of freedom for design tradeoffs. This is illustrated in the following design examples.
In a hyperspectral configuration, the spectral channels form a continuum. As such, the TDI segments form a discrete set of non-contiguous, equally spaced field angles. An example of the focal plane arrangement is shown in FIG. 6. To help illustrate this example, consider the design of a hyperspectral imaging sensor for the LWIR (8-12 micron) spectral region with 100-nm spectral resolution and 50-nm spectral sampling. Further assume a focal plane array 603 with 640×480 detector elements, each 50 microns in size. Such an array may be segmented into 8 segments such as 606 and 608, each with, say, 480 detectors in the spatial direction 610 and 80, for example, in the spectral direction. For use in the infrared, each segment may be covered with a filter assembly which ramps in center wavelength from 8 to 12 microns across the array, with 100-nm bandwidth throughout. The filter assembly may be in the form of a discrete filter array or a linear variable filter, and fabricated either on a separate substrate or coated directly onto the detector array.
If the spectrometer optics can be modified while maintaining f/3 performance with 50% optical transmission (1.1×10-6 cm2 sr throughput), then a background limited NESR of 0.12 μW/cm2 μmsr is achievable at 10 microns with a low quantum-efficiency detector such a Si:As (η=0.3) or 0.09 μW/cm2 μmsr with a high quantum efficiency detector such as HgCdTe (η=0.6). If throughput is maintained at previously achievable levels, these results reduce to 0.09 μW/cm2 μmsr and 0.06 μW/cm2 μmsr, respectively, which come very close to the desired performance level. With a modestly reduced platform velocity it may be possible to achieve or exceed the desired NESR.
In addition to the need for a larger size, filtered focal plane array, the primary penalty of this approach is the need to stabilize the sensor over a longer time frame and match the v/h of the platform with the detector frame rate. The stabilization time is the product of the number of spectral channels, number of TDI segments, and the dwell time per pixel, or, for this example, 3.2 seconds. Using a half pixel criterion, the v/h match is one part in twice the product of the number of bands and TDI segments, or one part in 1280 for this example. These are both challenging, although it should be stressed that by design the spectral correlation characteristics are not degraded with stabilization and TDI rate match errors, but only the spatial resolution. Also, the raw detector array frames can be acquired such that: (1) the number of TDI segments can be adjusted in the data processing; and (2) the TDI segments can be reregistered prior to integration. The spectral channels within a segment are automatically registered to each other.
Measurement results have indicated that for specified detection problems, a small set of spectral bands may be used to provide excellent detection results. In this case, it is not necessary to acquire the entire hyperspectrum, and significant tradeoffs can be made simultaneously realized with the TDI dispersive sensor concept to improve performance and relax the detector, spectrometer, and stabilization requirements.
As an example, consider a detector array segment consisting of four rows of detectors filtered to 100 nm bandwidth with 9.35, 9.65, 9.95, and 10.25 micron band centers, which provides very good performance for various targets, weather conditions, and time of day. If the dispersion of the spectrometer subsystem is relaxed to provide only 300 nm dispersion between adjacent detector elements (a 6× reduction) replicating this 64 times results in a 256×N focal plane array, where N is chosen to obtain the desired cross-track FOV.
FIG. 7 illustrates the focal plane arrangement for three segments. The spectrometer design is less challenging because of the significantly reduced dispersion, making it possible to increase throughput. Even without increasing the throughput relative to the SEBASS sensor and using low-quantum-efficiency Si:As detectors, the NESR is reduced by the 64 TDI to 0.03 μW/cm2 μmsr. As a result of the reduced number of bands, the stabilization and TDI rate match requirements are relaxed by a factor of 2.5 relative to the hyperspectral case, even with the full 8× increase in TDI.
The ability to easily implement a multispectral sensor design using this technique depends on the locations of the spectral bands. In the above example, the three desired bands were separated by a multiple of 300 nm. Therefore, a four-band set could be easily implemented (assuming roughly constant angular dispersion) with an extra fourth band. There may be band combinations for which this will not work as well, although the hyperspectral case represents the worst-case situation.
In some instances, dual-band combinations offer substantial target detection performance gain relative to broadband or single-band image sensing. A framing sensor embodiment may represent an attractive approach for a dual-band forward-looking infrared radar (FLIR). Consider a design utilizing a 256×256 framing array with alternating striped filters along one direction with 9.25 and 9.5 micron band centers, and a dispersion of 250 nm per pixel in this same direction. In the forward-looking case, the image does not move quickly across the focal plane. Therefore, both focal plane directions could be used for imaging with TDI in the time dimension (i.e., frame averaging). Correlation tracking may also be used, if needed, to minimize spatial resolution loss through TDI.
The primary component requirements for fabricating a sensor of the type presented are: (1) dispersive module with low spatial-spectral distortion over a relatively large focal plane; (2) precisely fabricated wedge or patterned IR spectral filter assemblies; and (3) moderate- to large-area IR focal plane arrays.
The requirements of the dispersive module are similar to the performance of the SEBASS design. For the hyperspectral example, which is clearly the most challenging, there is an additional requirement to achieve acceptable spectrometer performance over a larger field in the dispersive direction to accommodate the multiple TDI segments. This may be particularly challenging but technologically feasible. For the multispectral and dual-band examples, the dispersive module components are somewhat relaxed relative to the SEBASS performance in terms of reduced dispersion with a similar or smaller image field. These cases do not present an extremely difficult dispersive module design.
The spectral filter assembly needs are directly in line with current technologies for pattered multilayer IR spectral filter fabrication. Wedge filters with similar characteristics to the hyperspectral segment have been demonstrated by spatially controlled coating processes, either on the IR focal plane array itself, or on an IR transmitting substrate which is then placed in front of the focal plane. In the latter case, the design may be spatially replicated by piecing together multiple filters, subject to alignment issues.
In the case of the multispectral and dual-band examples, the requirement is a patterned coating with discrete filters striped across the detector rows. Two-dimensional patterned IR bandpass filters have previously been fabricated using microlithographic patterning and liftoff techniques. This process is relatively expensive, but capable of providing filters with similar filter characteristics, as needed. The primary difficulty is achieving smaller filter element sizes. A 100-micron pitch has been demonstrated on a 500-micron substrate.
The IR focal plane array requirements are also in line with the current state-of-the-art. Once again, the hyperspectral example presents the greatest difficulty. While MWIR and LWIR arrays with 640×480 elements have been demonstrated, they generally have a detector element size on the order of 20 to 30 microns. A larger detector size is desired both to provide a higher sensor throughput (better sensitivity) and relax the filter requirements.
The multispectral and dual-band examples present less stressing focal plane array requirements. For these examples, the detector count can be on the order of 256×256 such that a larger detector element size is achievable. Of course, with advances in IR focal plane array and spectral filtering technologies, larger focal plane array sizes will be feasible, providing increased ground and/or spectral coverage.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5173748 *||Dec 5, 1991||Dec 22, 1992||Eastman Kodak Company||Scanning multichannel spectrometry using a charge-coupled device (CCD) in time-delay integration (TDI) mode|
|US5276321 *||Sep 12, 1992||Jan 4, 1994||Geophysical & Environmental Research Corp.||Airborne multiband imaging spectrometer|
|US5371353 *||Jul 23, 1993||Dec 6, 1994||Oki Electric Industry Co., Ltd.||Object detecting device having multiple optical sensors with a common output line and a common selection signal line|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US6104488 *||Aug 12, 1999||Aug 15, 2000||The United States Of America As Represented By The Secretary Of The Air Force||Multi-octave spectroscopy with multi-waveband infrared focal plane array|
|US6211955 *||Mar 29, 2000||Apr 3, 2001||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|US6249341 *||Jan 24, 2000||Jun 19, 2001||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|US6337472||Oct 19, 1998||Jan 8, 2002||The University Of Texas System Board Of Regents||Light imaging microscope having spatially resolved images|
|US6473176||Mar 29, 2001||Oct 29, 2002||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|US6507391||Aug 24, 2001||Jan 14, 2003||Amnis Corporation||Measuring the velocity of small moving objects such as cells|
|US6522404 *||Dec 15, 2000||Feb 18, 2003||Agilent Technologies, Inc.||Grating based communication switching|
|US6532061||Aug 24, 2001||Mar 11, 2003||Amnis Corporation||Measuring the velocity of small moving objects such as cells|
|US6552788 *||Jul 9, 2001||Apr 22, 2003||Ruda & Associates||Hyperspectral imaging using linear chromatic aberration|
|US6580504||Oct 12, 2000||Jun 17, 2003||Amnis Corporation||Multipass cavity for illumination and excitation of moving objects|
|US6580509 *||Apr 24, 2000||Jun 17, 2003||Optical Physics Company||High speed high resolution hyperspectral sensor|
|US6583865 *||Aug 17, 2001||Jun 24, 2003||Amnis Corporation||Alternative detector configuration and mode of operation of a time delay integration particle analyzer|
|US6608680 *||Aug 17, 2001||Aug 19, 2003||Amnis Corporation||TDI imaging system for kinetic studies|
|US6608682||Oct 12, 2001||Aug 19, 2003||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|US6640130||Jul 3, 2000||Oct 28, 2003||Hypermed, Inc.||Integrated imaging apparatus|
|US6671044||Nov 16, 2001||Dec 30, 2003||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells in broad flat flow|
|US6678048 *||Jul 20, 1999||Jan 13, 2004||Sandia Corporation||Information-efficient spectral imaging sensor with TDI|
|US6707551||Jan 29, 2003||Mar 16, 2004||Amnis Corporation||Multipass cavity for illumination and excitation of moving objects|
|US6747737||Jun 28, 2001||Jun 8, 2004||Carl Zeiss Jena Gmbh||Method for optical detection of an illuminated specimen in a plurality of detection channels|
|US6826358||Dec 6, 2002||Nov 30, 2004||Recon/Optical, Inc.||Dual band hyperspectral framing reconnaissance camera|
|US6831688||Apr 8, 2002||Dec 14, 2004||Recon/Optical, Inc.||Multispectral or hyperspectral imaging system and method for tactical reconnaissance|
|US6858852||Aug 7, 2001||Feb 22, 2005||Carl Zeiss Jena Gmbh||Method and apparatus for rapid change of fluorescence bands in the detection of dyes in fluorescence microscopy|
|US6875973||Apr 9, 2004||Apr 5, 2005||Amnis Corporation||Auto focus for a flow imaging system|
|US6891613||Apr 17, 2003||May 10, 2005||Carl Zeiss Jena Gmbh||Method for the detection of dyes in fluorescence microscopy|
|US6906792||Jun 10, 2004||Jun 14, 2005||Amnis Corporation||Methods of calibrating an imaging system using calibration beads|
|US6934408||Oct 12, 2001||Aug 23, 2005||Amnis Corporation||Method and apparatus for reading reporter labeled beads|
|US6947128 *||Jun 23, 2003||Sep 20, 2005||Amnis Corporation||Alternative detector configuration and mode of operation of a time delay integration particle analyzer|
|US6947133||Aug 7, 2001||Sep 20, 2005||Carl Zeiss Jena Gmbh||Method for increasing the spectral and spatial resolution of detectors|
|US6947136||Oct 21, 2003||Sep 20, 2005||Amnis Corporation||Multipass cavity for illumination and excitation of moving objects|
|US6958811||Jun 28, 2001||Oct 25, 2005||Carl Zeiss Jena Gmbh||Method for the detection of dyes in fluorescence microscopy|
|US6975400||Jul 28, 2003||Dec 13, 2005||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|US7006710||Feb 20, 2004||Feb 28, 2006||Amnis Corporation||Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging|
|US7057732||Feb 27, 2004||Jun 6, 2006||Amnis Corporation||Imaging platform for nanoparticle detection applied to SPR biomolecular interaction analysis|
|US7079708||Sep 12, 2005||Jul 18, 2006||Amnis Corporation||Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging|
|US7087877||Jan 28, 2005||Aug 8, 2006||Amnis Corporation||Auto focus for a flow imaging system|
|US7190832||Jul 17, 2002||Mar 13, 2007||Amnis Corporation||Computational methods for the segmentation of images of objects from background in a flow imaging instrument|
|US7221457||Apr 24, 2006||May 22, 2007||Amnis Corporation||Imaging platform for nanoparticle detection applied to SPR biomolecular interaction analysis|
|US7286719||May 18, 2006||Oct 23, 2007||Amnis Corporation||Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging|
|US7315357||Sep 20, 2005||Jan 1, 2008||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|US7315371||Jan 23, 2004||Jan 1, 2008||P&P Optica Inc.||Multi-channel spectrum analyzer|
|US7450229||May 4, 2005||Nov 11, 2008||Amnis Corporation||Methods for analyzing inter-cellular phenomena|
|US7456940||Jun 21, 2006||Nov 25, 2008||Sensing Strategies, Inc.||Methods and apparatus for locating and classifying optical radiation|
|US7522758||Feb 1, 2006||Apr 21, 2009||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US7528943 *||Dec 27, 2005||May 5, 2009||Kla-Tencor Technologies Corporation||Method and apparatus for simultaneous high-speed acquisition of multiple images|
|US7554586||Oct 20, 2000||Jun 30, 2009||Rochester Institute Of Technology||System and method for scene image acquisition and spectral estimation using a wide-band multi-channel image capture|
|US7567695||Mar 11, 2005||Jul 28, 2009||Amnis Corporation||Method and apparatus for reading reporter labeled beads|
|US7610942||Jan 15, 2004||Nov 3, 2009||Amnis Corporation||Cell suspension rotating fluidic pump|
|US7634125||Aug 20, 2008||Dec 15, 2009||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US7634126||Jan 29, 2009||Dec 15, 2009||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US7768641 *||Jan 24, 2007||Aug 3, 2010||California Institute Of Technology||Spatial image modulation to improve performance of computed tomography imaging spectrometer|
|US7876434 *||Dec 12, 2006||Jan 25, 2011||California Institute Of Technology||Color camera computed tomography imaging spectrometer for improved spatial-spectral image accuracy|
|US7889263||Apr 5, 2010||Feb 15, 2011||Amnis Corporation||System and method for high numeric aperture imaging systems|
|US7894058||Jan 12, 2009||Feb 22, 2011||California Institute Of Technology||Single-lens computed tomography imaging spectrometer and method of capturing spatial and spectral information|
|US7925069||Sep 29, 2009||Apr 12, 2011||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US8005314||Dec 11, 2006||Aug 23, 2011||Amnis Corporation||Extended depth of field imaging for high speed object analysis|
|US8009189||Jun 3, 2008||Aug 30, 2011||Amnis Corporation||Extended depth of field imaging for high speed object analysis|
|US8103080||Mar 16, 2005||Jan 24, 2012||Amnis Corporation||Method for imaging and differential analysis of cells|
|US8131053||Jul 28, 2008||Mar 6, 2012||Amnis Corporation||Detection of circulating tumor cells using imaging flow cytometry|
|US8150136||Mar 16, 2005||Apr 3, 2012||Amnis Corporation||Image based quantitation of molecular translocation|
|US8304730||Jun 1, 2010||Nov 6, 2012||The Aerospace Corporation||Nadir emissive hyperspectral measurement operation (NEHMO)|
|US8379136||Feb 14, 2011||Feb 19, 2013||Amnis Corporation||System and method for high numeric aperture imaging systems|
|US8406498||Dec 4, 2009||Mar 26, 2013||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US8451524||Sep 20, 2010||May 28, 2013||Amnis Corporation||Modifying the output of a laser to achieve a flat top in the laser's Gaussian beam intensity profile|
|US8548219||Feb 14, 2012||Oct 1, 2013||Amnis Corporation||Detection of circulating tumor cells using imaging flow cytometry|
|US8559011 *||Nov 15, 2011||Oct 15, 2013||The United States Of America, As Represented By The Secretary Of The Navy||Micro-spectral sensor|
|US8571294||Nov 22, 2011||Oct 29, 2013||Amnis Corporation||Method for imaging and differential analysis of cells|
|US8571295||Mar 13, 2013||Oct 29, 2013||Amnis Corporation||Method for imaging and differential analysis of cells|
|US8660332||Mar 13, 2013||Feb 25, 2014||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US8817115||May 5, 2011||Aug 26, 2014||Amnis Corporation||Spatial alignment of image data from a multichannel detector using a reference image|
|US8824770||Mar 13, 2013||Sep 2, 2014||Amnis Corporation||Method for imaging and differential analysis of cells|
|US8860942||Apr 29, 2011||Oct 14, 2014||The United States Of America As Represented By The Secretary Of The Air Force||Apparatus for multi-spectral imaging of point event detection|
|US8885913||Sep 27, 2013||Nov 11, 2014||Amnis Corporation||Detection of circulating tumor cells using imaging flow cytometry|
|US8953866||Apr 30, 2012||Feb 10, 2015||Amnis Corporation||Method for imaging and differential analysis of cells|
|US8964182||Apr 13, 2012||Feb 24, 2015||Raytheon Company||Adaptive multispectral imaging|
|US9318869||Dec 30, 2014||Apr 19, 2016||Kla-Tencor Corporation||193nm laser and inspection system|
|US9347890||May 8, 2014||May 24, 2016||Kla-Tencor Corporation||Low-noise sensor and an inspection system using a low-noise sensor|
|US9410901||Mar 10, 2015||Aug 9, 2016||Kla-Tencor Corporation||Image sensor, an inspection system and a method of inspecting an article|
|US9413134||Jun 29, 2015||Aug 9, 2016||Kla-Tencor Corporation||Multi-stage ramp-up annealing for frequency-conversion crystals|
|US9419407||Sep 18, 2015||Aug 16, 2016||Kla-Tencor Corporation||Laser assembly and inspection system using monolithic bandwidth narrowing apparatus|
|US9426397||Nov 12, 2014||Aug 23, 2016||EO Vista, LLC||Apparatus and methods for hyperspectral imaging with on-chip digital time delay and integration|
|US9426400||Dec 4, 2013||Aug 23, 2016||Kla-Tencor Corporation||Method and apparatus for high speed acquisition of moving images using pulsed illumination|
|US9478402||Mar 5, 2014||Oct 25, 2016||Kla-Tencor Corporation||Photomultiplier tube, image sensor, and an inspection system using a PMT or image sensor|
|US9496425||Mar 10, 2013||Nov 15, 2016||Kla-Tencor Corporation||Back-illuminated sensor with boron layer|
|US9528989||Mar 30, 2012||Dec 27, 2016||Amnis Corporation||Image-based quantitation of molecular translocation|
|US9529182||Jan 31, 2014||Dec 27, 2016||KLA—Tencor Corporation||193nm laser and inspection system|
|US9601299||Jul 22, 2013||Mar 21, 2017||Kla-Tencor Corporation||Photocathode including silicon substrate with boron layer|
|US9608399||Mar 13, 2014||Mar 28, 2017||Kla-Tencor Corporation||193 nm laser and an inspection system using a 193 nm laser|
|US9620341||Jun 22, 2016||Apr 11, 2017||Kla-Tencor Corporation||Photomultiplier tube, image sensor, and an inspection system using a PMT or image sensor|
|US9620547||Jul 1, 2016||Apr 11, 2017||Kla-Tencor Corporation||Image sensor, an inspection system and a method of inspecting an article|
|US9746376||Nov 12, 2014||Aug 29, 2017||EO Vista, LLC||Apparatus and methods for hyperspectral imaging with parallax measurement|
|US9748294||Jan 7, 2015||Aug 29, 2017||Hamamatsu Photonics K.K.||Anti-reflection layer for back-illuminated sensor|
|US9748729||Oct 1, 2015||Aug 29, 2017||Kla-Tencor Corporation||183NM laser and inspection system|
|US9767986||Aug 25, 2015||Sep 19, 2017||Kla-Tencor Corporation||Scanning electron microscope and methods of inspecting and reviewing samples|
|US9768577||Aug 21, 2015||Sep 19, 2017||Kla-Tencor Corporation||Semiconductor inspection and metrology system using laser pulse multiplier|
|US9793673||Jun 1, 2012||Oct 17, 2017||Kla-Tencor Corporation||Semiconductor inspection and metrology system using laser pulse multiplier|
|US9804101||Jun 9, 2014||Oct 31, 2017||Kla-Tencor Corporation||System and method for reducing the bandwidth of a laser and an inspection system and method using a laser|
|US9818887||Jun 14, 2016||Nov 14, 2017||Kla-Tencor Corporation||Back-illuminated sensor with boron layer|
|US20020036775 *||Aug 7, 2001||Mar 28, 2002||Carl Zeiss Jena Gmbh||Method for increasing the spectral and spatial resolution of detectors|
|US20020094116 *||Oct 12, 2001||Jul 18, 2002||Amnis Corporation||Method and apparatus for reading reporter labeled beads|
|US20020098431 *||Nov 5, 2001||Jul 25, 2002||Hiroyuki Fujikawa||Toner, image-forming apparatus, process cartridge and image forming method|
|US20020146734 *||Feb 21, 2002||Oct 10, 2002||Amnis Corporation||Method and apparatus for labeling and analyzing cellular components|
|US20030137661 *||Jan 29, 2003||Jul 24, 2003||Amnis Corporation||Multipass cavity for illumination and excitation of moving objects|
|US20040021868 *||Jul 28, 2003||Feb 5, 2004||Ortyn William E.||Imaging and analyzing parameters of small moving objects such as cells|
|US20040080748 *||Oct 21, 2003||Apr 29, 2004||Amnis Corporation||Multipass cavity for illumination and excitation of moving objects|
|US20040085527 *||Jun 23, 2003||May 6, 2004||Basiji David A.||Alternative detector configuration and mode of operation of a time delay integration particle analyzer|
|US20040161165 *||Feb 20, 2004||Aug 19, 2004||Amnis Corporation||Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging|
|US20040217256 *||Apr 9, 2004||Nov 4, 2004||Amnis Corporation||Auto focus for a flow imaging system|
|US20040218184 *||Feb 27, 2004||Nov 4, 2004||Amnis Corporation||Imaging platform for nanoparticle detection applied to SPR biomolecular interaction analysis|
|US20040220472 *||Jan 15, 2004||Nov 4, 2004||Amnis Corporation||Cell suspension rotating fluidic pump|
|US20040223135 *||Jun 10, 2004||Nov 11, 2004||Amnis Corporation||Methods of calibrating an imaging system using calibration beads|
|US20040236229 *||Oct 6, 2003||Nov 25, 2004||Freeman Jenny E.||Integrated imaging apparatus|
|US20050127271 *||Jan 28, 2005||Jun 16, 2005||Amnis Corporation||Auto focus for a flow imagin system|
|US20060002634 *||Sep 12, 2005||Jan 5, 2006||Amnis Corporation||Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging|
|US20060029267 *||Mar 11, 2005||Feb 9, 2006||Amnis Corporation||Method and apparatus for reading reporter labeled beads|
|US20060066837 *||Sep 20, 2005||Mar 30, 2006||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|US20060068371 *||May 4, 2005||Mar 30, 2006||Amnis Corporation||Methods for analyzing inter-cellular phenomena|
|US20060192955 *||Apr 24, 2006||Aug 31, 2006||Amnis Corporation||Imaging platform for nanoparticle detection applied to spr biomolecular interaction analysis|
|US20060198558 *||May 18, 2006||Sep 7, 2006||Amnis Corporation||Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging|
|US20060204071 *||Feb 1, 2006||Sep 14, 2006||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US20060257884 *||May 20, 2005||Nov 16, 2006||Amnis Corporation||Methods for preparing and analyzing cells having chromosomal abnormalities|
|US20070146693 *||Dec 27, 2005||Jun 28, 2007||Brown David L||Method and apparatus for simultaneous high-speed acquisition of multiple images|
|US20070146873 *||Dec 11, 2006||Jun 28, 2007||Amnis Corporation||Extended depth of field imaging for high speed object analysis|
|US20070165223 *||Dec 12, 2006||Jul 19, 2007||Wilson Daniel W||Color camera computed tomography imaging spectrometer for improved spatial-spectral image accuracy|
|US20070182962 *||Jan 24, 2007||Aug 9, 2007||Bearman Gregory H||Spatial image modulation to improve performance of computed tomography imaging spectrometer|
|US20080234984 *||Jun 3, 2008||Sep 25, 2008||Amnis Corporation||Extended depth of field imaging for high speed object analysis|
|US20080240539 *||Mar 16, 2005||Oct 2, 2008||Amins Corporation||Method For Imaging And Differential Analysis Of Cells|
|US20080317325 *||Jul 28, 2008||Dec 25, 2008||Amnis Corporation||Detection of circulating tumor cells using imaging flow cytometry|
|US20090003681 *||Aug 20, 2008||Jan 1, 2009||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US20090180115 *||Jan 12, 2009||Jul 16, 2009||Wilson Daniel W||Single-lens computed tomography imaging spectrometer and method of capturing spatial and spectral information|
|US20090190822 *||Jan 29, 2009||Jul 30, 2009||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US20100021039 *||Sep 29, 2009||Jan 28, 2010||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US20100232675 *||Dec 4, 2009||Sep 16, 2010||Amnis Corporation||Blood and cell analysis using an imaging flow cytometer|
|US20110085221 *||Sep 20, 2010||Apr 14, 2011||Amnis Corporation||Modifying the output of a laser to achieve a flat top in the laser's gaussian beam intensity profile|
|US20130120754 *||Nov 15, 2011||May 16, 2013||Michael Wilson||Micro-spectral sensor|
|US20130327942 *||Jun 6, 2012||Dec 12, 2013||Raytheon Company||Compact spectrometer for remote hydrocarbon detection|
|CN104660984A *||Jan 16, 2015||May 27, 2015||北京航空航天大学||On-board multispectral high-definition earth observation device|
|EP1257794A1 *||Oct 12, 2000||Nov 20, 2002||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|EP1257794A4 *||Oct 12, 2000||Dec 13, 2006||Amnis Corp||Imaging and analyzing parameters of small moving objects such as cells|
|EP1272822A1 *||Oct 12, 2000||Jan 8, 2003||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|EP1272822A4 *||Oct 12, 2000||Mar 12, 2008||Amnis Corp||Imaging and analyzing parameters of small moving objects such as cells|
|EP2866007A3 *||Oct 21, 2014||Jul 29, 2015||Goodrich Corporation||Row by row adjustable focal plane array for hyperspectral imagers|
|WO1999021123A1 *||Oct 19, 1998||Apr 29, 1999||The Secretary Of State For Defence||Optical filtering device|
|WO2000047949A1 *||Feb 9, 2000||Aug 17, 2000||Leica Geosystems Ag||Method and system for taking air-borne photogrammetric pictures (photogrammetry prism)|
|WO2001003050A1 *||Jul 3, 2000||Jan 11, 2001||Hypermed Imaging, Inc.||Imaging apparatus with means for fusing thermal and hyperspectral images|
|WO2001053783A1||Oct 12, 2000||Jul 26, 2001||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|WO2001053784A1 *||Oct 12, 2000||Jul 26, 2001||Amnis Corporation||Imaging and analyzing parameters of small moving objects such as cells|
|WO2002016894A1 *||Aug 24, 2001||Feb 28, 2002||Amnis Corporation||Tdi imaging system for kinetic studies|
|WO2002017622A1 *||Aug 24, 2001||Feb 28, 2002||Amnis Corporation|
|WO2003106917A2 *||Jan 24, 2003||Dec 24, 2003||Recon/Optical, Inc.||Multispectral or hyperspectral imaging system and method for tactical reconnaissance|
|WO2003106917A3 *||Jan 24, 2003||Jun 3, 2004||Recon Optical Inc||Multispectral or hyperspectral imaging system and method for tactical reconnaissance|
|U.S. Classification||356/326, 250/226|
|Cooperative Classification||G01J3/2823, G01J3/14, G01J3/0208|
|Jun 28, 1996||AS||Assignment|
Owner name: ENVIRONMENTAL RESEARCH INSTITUTE OF MICHIGAN, MICH
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EISMANN, MICHAEL T.;REEL/FRAME:008362/0299
Effective date: 19960612
|Feb 13, 1998||AS||Assignment|
Owner name: ERIM INTERNATIONAL, INC., MICHIGAN
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ENVIRONMENTAL RESEARCH INSTITUTE OF MICHIGAN;REEL/FRAME:008983/0426
Effective date: 19980205
|Aug 16, 1999||AS||Assignment|
Owner name: ERIM INTERNATIONAL, INC., MICHIGAN
Free format text: CONFIRMATORY ASSIGNMENT;ASSIGNOR:ENVIRONMENTAL RESEARCH INSTITUTE OF MICHIGAN;REEL/FRAME:010018/0259
Effective date: 19990811
|Dec 6, 1999||AS||Assignment|
Owner name: FIRST UNION NATIONAL BANK, NORTH CAROLINA
Free format text: GUARANTOR SECURITY AGREEMENT;ASSIGNOR:ERIM INTERNATIONAL, INC.;REEL/FRAME:010395/0907
Effective date: 19990903
|Nov 29, 2001||FPAY||Fee payment|
Year of fee payment: 4
|Jun 20, 2002||AS||Assignment|
Owner name: WACHOVIA BANK, NATIONAL, NORTH CAROLINA
Free format text: ASSIGNMENT OF SECURITY INTEREST;ASSIGNOR:VERIDIAN SYSTEMS DIVISION, INC.;REEL/FRAME:012991/0435
Effective date: 20020610
|Aug 21, 2003||AS||Assignment|
Owner name: VERIDIAN SYSTEMS DIVISION, INC., VIRGINIA
Free format text: SATISFACTION OF COLLATERAL AGREEMENT/TERMINATION OF SECURITY INTEREST;ASSIGNOR:WACHOVIA BANK, NATIONAL ASSOCIATION;REEL/FRAME:014420/0009
Effective date: 20030811
|Dec 21, 2005||REMI||Maintenance fee reminder mailed|
|Dec 22, 2005||AS||Assignment|
Owner name: ERIM INTERNATIONAL, INC., MICHIGAN
Free format text: SECURITY INTEREST;ASSIGNOR:WACHOVIA BANK, NATIONAL ASSOCIATION;REEL/FRAME:017105/0462
Effective date: 20051019
|Jun 2, 2006||LAPS||Lapse for failure to pay maintenance fees|
|Aug 1, 2006||FP||Expired due to failure to pay maintenance fee|
Effective date: 20060602