Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Page images | Web History | Sign in

Patents

  

MULTISPECTRAL IMAGING AND ANALYSIS
SYSTEM

BACKGROUND OF THE INVENTION 5

1. ORIGIN OF THE INVENTION

The invention described herein was made in the performance of work under a NASA contract and is subject to the provisions of Section 305 of the National Aeronautics and Space Act of 1958, Public Law 85-568 (72 Stat. 435; 42 U.S.C. 2457).

2. FIELD OF THE INVENTION

This invention generally relates to the field of analy- J5 sis of spectral reflectance data and devices used for obtaining and analyzing spectral reflectance data. More specifically, the present invention concerns a multispectral imaging and analysis system which takes advantage of charge coupled device (CCD) and linear detector 2Q array technology and which is designed to have data collected, analyzed and displayed on a real-time basis.

3. DESCRIPTION OF THE PRIOR ART

Geographical surveys of the earth's surface are today 25 conducted by numerous different airborne systems. As an example, satellite technology is the means by which substantial amounts of data concerning the earth's surface are collected. Specifically, the earth resources technology satellite (ERTS) now called LANDSAT 30 has produced images of the earth in four spectral bands with an instantaneous field of view of approximately 79 meters, i.e., the approximate size of a football field. As another example, the SKYLAB multispectral scanner produces an image in 13 spectral bands with a picture 35 element size generally similar to that of the earth resources technology satellite.

Data collected by such satellite-borne systems and other aircraft-borne systems are typically transmitted to earth stations after collection or during collection 40 thereof. The recorded data once received at the earth stations are then converted to a form that is useable with conventional general purpose computers and provided to users. At present, there is an approximate two months delay between the collection of data by satellite and 45 such data being provided to a user.

A part of the substantial delay is due to satellite-borne systems being designed to accommodate the requirements of several different users. For example, the LANDSAT satellites obtain data in broad spectral 50 bands continuously for a number of different applications. This being the case, the data collected is in large measure neither pertinent to nor useable by most of the users who are primarily interested in a small selected portion of the total data collected. Accordingly, once 55 the data is collected by the satellite and provided to the user, such data must still be processed with a general purpose computer for the purpose of isolating that data which is relevant to a user's specific requirements. The initial sorting process has been found to be very time 60 consuming and, of course, contributes to an increased cost of the data processing. At present, analyzing a single picture with a general purpose computer costs in the neighborhood of $2,000 to $5,000. Clearly, the time delay involved in obtaining the data and ultimately 65 having the data processed by a general purpose computer is, for many applications too long, and may even render the data untimely and substantially useless.

Satellite and airborne multispectral surveys of the earth's surface have been found to be useful in detecting geographic areas of hydrothermal alteration which may be indicative of base-metal mineralization. Specific algorithms, taking advantage of known spectral reflectance characteristics, are readily able to be formulated and converted into interchangeable microcircuit memory elements and used for analysis with micro-processors. There are known sets of algorithms which, when combined with predetermined sets of optical filters, may be used with the present invention to explore for, among others, oil spills, algae blooms in lakes and blight on vegetation, as well as mineralization.

It is, therefore, the intention of the present invention to provide an imaging and analysis system that may be readily carried aboard an aircraft or satellite, and which may be used to collect, analyze and record in real time, spectral reflectance data for target areas on the earth's surface.

OBJECTS AND SUMMARY OF THE
INVENTION

It is a primary object of the present invention to provide an imaging and analysis system which will serve to collect, analyze and record spectral reflectance data in real time.

It is another object of the present invention to provide a system for collecting spectral reflectance data that is portable and is capable of efficient usage to obtain accurate data that can be analyzed expeditiously and economically.

It is a further object of the present invention to provide a system which may be readily carried aboard an aircraft or satellite for conducting geographic surveys of the earth's surface.

It is yet another object of the present invention to provide a system which is compact and which may be readily used to survey for a plurality of different phenomena.

Briefly described, the present invention involves a portable, multispectral imaging and analysis system which is useful for collecting and analyzing spectral reflectance data of the earth's surface, which data is analyzed in real time.

More particularly, the subject invention includes an imaging system including a plurality of CCD detector arrays or linear detector arrays which are optically stacked and registered to be illuminated through an optical system wherein a plurality of matching filters are used to have only radiation in selected bandwidths incident on each different detector array. Collected spectral reflectance data is outputed to an on-board computer or micro-processor which serves to analyze the data in real time. Conventional data recorders and display units may be used to have the analyzed reflectance data concurrently displayed as a superimposition on a real image of the earth being surveyed.

Further objects and the many attendant advantages of the invention may be best understood by reference to the following detailed description taken in conjunction with the accompanying drawings in which like reference symbols designate like parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram illustrating a multispectral imaging and analysis system in accordance with the present invention.

3 4

FIG. 2 is a schematic block diagram illustrating ex- Each detector in an array has characteristics that may

emplary electronics that may be used in connection be different from every other detector. The differences

with the detector elements in each array for the purpose in characteristics reside primarily in the dark current

of normalizing output signals provided by the detectors. appearing as a DC offset and the inherent gain of the

FIGS. 3 and 3B illustrate a pair of graphs presenting 5 detector. Accordingly, the DC offset and the gain of

spectral reflectance data for certain unaltered and al- each individual detector in an array must be normalized,

tered rock samples, respectively. Referring to FIG. 2, an exemplary circuit that is

FIG. 4 is a schematic diagram illustrating a circuit suitable for normalizing the DC offset and gain of CCD

that may be used to implement an exemplary algorithm detectors or a conventional line array is illustrated. As

for analyzing spectral reflectance data such as is pres- 10 shown, the output of each detector 40 is applied to a

ented by FIGS. 3A and 3B. preamplifier 42 the output of which is applied as one of

two inputs to a differential amplifier 44 via a first input

DESCRIPTION OF THE PREFERRED lead 46. Assuming that the input signal applied to the

EMBODIMENT second input lead 48 of the differential amplifier 44 is

Referring to FIG. 1 of the drawings, solar energy at 15 initially zero, then the initial output of the detector 40 various wavelengths is reflected from terrain under from an image made while the lenses are capped can be observation and is received by an imaging system thus applied to an A to D converter circuit 50 and therethrough a plurality of lens systems 4, 6, 8 and 10. Data after aPPued to a memory 52 for storage. Normalization in the form of electrical signals which are provided at can thus be accomplished by having the dark current the output of the imaging system 2 may be applied via 20 f°r ■? detectors stored and thereafter subtracted from an appropriate electrical cable 12 to a computer or det<for signal coming from Uluminated terrain, micro-processor 14. The data output of the micro- Hence' *e 0UtPut <*the mem0ry 52 m?y therfffter ^ processor 14 may thereafter be applied in the form of aPPhed th?>uSh a ? *A cSvertf J"""*54 TM the suitable video signals to an infonnation recorder and ^ second of two mputs to the differential amplifier 44 via display unit 16 via an appropriate cable 18 for recorda- ^gj ^ a ... the dafk current on an /or l p ay. memory data is subtracted from each detector signal

As shown, the lenses 4 6 8 and 10 may each be pro- ^ . ^ovided when the detector is Uluminated and

vided with a changeable filter 20 22, 24 and 26 respec- ^ fa tfa normalized.

lively. Such filters 20, 22^24 and 26 serve to limit mc- M ^ UbaaA ^ ^ ... n fce ...

dent radiation transmitted through the corresponding normalized b a feed forward arrangement m which the

lens to preselected bandwidths chosen for use m the gaincmTentofthe ... ^igap*liedfromtfaeAto

analysis of data. ,,„...„ . D converter circuit 50 to a gain current memory 56 and

It is clear that the various lenses 4,6,8 and 10 may be t0 a divider circuit 58 which sefves tQ effectively nor.

of a conventional type and may be even replaced by an 35 the inherent gain of the detector 40 by dividing

optical system havmg a single lens which is followed 0utputted signals by the inherent gain,

optically by dichroic plates and lenses ma configuration ^ output of the divider circuit 58 would hence

similar to a color television camera wherein incident represent a normalized data output of the detector 40

light is split up into several primary colors for applica- which may ^ thereafter applied as an input to the com

tion to a plurality of color vidicons, in this case detector ^ pUter or micro-processor 14.

arrays. It is understood that all of the circuits discussed and

In the imaging system 2 shown in FIG. 1, each of the described heretofore with respect to FIG. 2 may be

lens systems 4, 6, 8 and 10 have associated therewith a conventional circuits, that are commercially available

separate CCD array 28, 30, 32 and 34. The outputs of ^ Gf a type that are well known in the prior art as to

the respective CCD arrays 28, 30, 32 and 34 may be 45 structure, operation and use.

appropriately connected electrically to a preamplifier it js noted that the dark current memory 52 and the

and signal conditioning system 36 which shall be de- gain current memory 56 may each be a small portion of

scribed in greater detail in connection with FIG. 2. a much larger memory circuit of conventional type that

Timing logic circuitry 38 of conventional design may may be used for the purpose of storing all of the data

be used in a manner well known in the prior art to have 50 from each of the detector arrays 28,30,32 and 34. In the

the data read out from the individual detector arrays in event that a single memory is used for such purpose it

parallel. must of course be assumed that the capacity of the mem

Conventionally, CCD arrays that are presently avail- 0ry is sufficiently large to accommodate storage of all of able may include 160,000 detector elements in a 400 X the data and other signals to be used for detector signal 400 array. Such CCD arrays may be thermo-electrically 55 normalization as has been heretofore discussed. It is cooled in a conventional manner. The present intended noted that the present state of the art permits any numapplication utilized four arrays 28, 30, 32 and 34 which ber of different procedures to be used for the purpose of are registered such that the same element located on accomplishing storage and/or retrieval of data in data each array receives radiation reflected from the same memory circuits, and any of the conventional techpoint on the targeted terrain. Information or data would 60 niques may be used as may be appropriate, be concurrently read out of each of the four CCD ar- With the exception of the memory circuits 52 and 56, rays 28, 30, 32 and 34 in parallel, that is, from corre- it may be regarded that the circuitry of FIG. 2 be a part sponding detector elements at the same time. The mean of the imaging system 2 that has been described in confer triggering each array to have data from successive junction with FIG. 1.

detectors outputted is well known in the art and there- 65 Referring now to FIGS. 3A and 3B, graphic presen

fore is not considered required to be explained in detail tations of spectral reflectance data for unaltered samples

herein. Data that is retrieved or outputted by the CCD A and B, and altered samples A and B are illustrated. It

arrays is analyzed by being applied to the computer 14. may be observed that the graphs pertinent to the unal5 6

tered and altered samples A may be readily distin- material being sought as well as its location on the ter

guished. The same holds true for the Samples B. Of the rain being covered by the airborne imaging system

several methods by which such graphs can be distin- would thus be indicated.

guished, taking certain ratios of the data values at prese- Operationally, the optical units 4, 6, 8 and 10 are

lected wavelengths is effective, accurate and possible to 5 mounted and aligned to have each of the arrays 28, 30,

be accommplished expeditiously. Selected wavelengths 32 and 34 optically stacked and registered at infinity,

are noted by the vertical lines indicated by the numerals When so registered, paralax is not considered to present

20, 22, 24 and 26 which correspond to the filters earlier a significant problem when the system is operated at a

referred to in conjunction with FIG. 1. It is anticipated reasonable altitude; i.e. 10,000 feet or higher,

that such filters 20,22,24 and 26 may each have a band- 10 . .^ the system m accordance with the subject

width of 0.02 microns and be centered at wavelengths invention is by m traveling at 140 miles

of 0.55 microns, 0.70 microns, 0.85 microns and 1.0 ^ houf ^ at m ... of l0 OQQ feet> the mstanta_

microns, respectively, neous field of view of each detector is approximately

Keternng to wu 4, a quasi-logic circuit representmg 2QQ which

corresponds to a resolution of

anexemplary algorithm which serves to implement die 15 Q fi ffle ... ^

above-mentioned calculation and comparison of ratios . ,. . . . . ..

to known data sets is shown. The algorithm may be J^T? f. aP?f ^te * ?50 "fTM Per houf j*

„„.-,„ „,„„,„m„„j • t„ „ „,;„,„ „ ° „„„ „ ' _ 40,000 feet will provide a resolution of approximately

readily programmed into a micro-processor or com- <»«♦/•♦ 1

puter 14. It is anticipated that, each algorithm be con- "meters/picture element.

structed in the form of an interchangeable microcircuit 20 A l\1810 * understood that the use of charge coupled

memory element devices of conventional type now available commer

The output of a detector from the array 28 associated cMv ^limit the operational bandwidth of the subject

with the filter 20 would be ratioed with the correspond- svstem to wavelengths accommodated by the detectors,

ing detector output of the array 30 associated with the i e > °-4 to 10 microns.

filter 22. Similar ratios are formed between detector 25 It is to be understood that although a square detector

outputs for the arrays 30 and 32 and detector outputs for array nas been described and discussed in the foregoing

the arrays 32 and 34. The calculation of such ratios may description, line arrays may be used equally well. When

be readily accomplished by the use of conventional a line array is used, rather than having a target picture

divider circuits 59, 61 and 63. taken at predetermined intervals, data would be contin

It is of course understood that such ratios simply 30 ually read out of the line array associated with each

provide an indication of the slope of the graphic data optical unit as it is swept across the target area beneath

between data points corresponding to the filters 20,22, the aircraft or satellite.

24 and 26. Increasing the number of different filters and From the foregoing discussion it is now clear that the

hence data points would, increase the accuracy of the subject invention provides an imaging and analysis sys

analysis. However, the use of four filters is anticipated 35 tem whereby spectral reflectance data may be collected

to be sufficient for most cases. by an airborne system and immediately processed in

The ratios produced are compared to known values real time such that the data can be also displayed in real

by having the ratio data signals applied to comparator time and recorded for future use. Clearly, the subject

circuits 60, 62 and 64. In this manner, the slope of data invention provides a compact system which is economi

graphs being analyzed can be accurately compared to 40 caUy useable to provide data on an immediate basis as

known data graphs for materials likely to be observed. compared to prior art systems which require a user to

As is well known in the prior art, the comparator cir- wajt a period of several months before having the col

cuits 60, 62 and 64 may include the use of threshold data made available for yet subsequent expensive

circuits which serve to provide output signals only analysis by having the data applied to general purpose

where a ratio value falls between pre-determined 45 ...

b°unds- . „ , While a preferred embodiment of the present inven

The outputs of the comparator circuits 60,62 and 64 ^ has been described hereinabove, it is intended that

may thereafter \k| applied as inputs to an AND gate 66 ^ matter ... m ^ above description and shown

A «°U^ ?? * C M 8 ?^ H <n m the accompanying drawings be interpreted as illustra

collected data favorably compares to a known standard. 50 .. , 0 ..f . „

Analyzed data would; be thereafter applied via the fe *** not mt a lumtf * m f^^'

cable 18 from the computer 14 to the monitor and film ^ons' instructionsi and^arrangements which fall within

recorder 16 for displacing and recordation for future th^°ff **. of the mventlon mav be made

use as shown in FIG. 1 What is claimed ,s:

Referring again to FIG. 1, the monitor 16 may be 55 !: A svstem forf receiving and analyzing incident

equipped to have applied thereto visible terrain data radiation reflected from the earth s surface m real time,

which may be provided from any of the optical units 4, wmch svstem *mable for geographic surveying from

6, 8 and/or 10. Such visible terrain data may simply be airborne vehicles, said system comprising:

unprocessed data from any of the optical units. As may imaging means for receivmg said incident radiation,

be desired, an additional camera may be used to provide 60 said imaging means including:

visible terrain data. a plurality of detector arrays maintained in opti

The monitor and recorder unit 16 may thus be used to cally stacked registration, said detector arrays

display both the visible terrain data, as well as the spec- each including an array of charge coupled de

tral reflectance data, for the sample being sought. When vices wherein said charge coupled devices of

spectral reflectance data is superimposed on the visible 65 each said array are maintained in registration

terrain data and displayed, materials or conditions being with corresponding devices in every other array,

sought and located may appear as dark spots or areas on said arrays providing detector signals indicative

the display of visible terrain data. The presence of such of radiation incident thereon,

8

optical means for permitting only incident radiation having different preselected wavelengths to be incident on each of said detector arrays; and normalizing circuit means for normalizing the dark current offset and the inherent gain of each said 5 charge coupled device in said detector arrays; data processing means for analyzing said detector signals applied thereto in accordance with preselected algorithms peculiar to the spectral reflec- ]q tance characteristics of selected materials for identifying said selected materials; said processing means providing data signals; and display means for receiving said data signals and detector signals for concurrently displaying said IS detector signals as an image of the earth's surface indicating the location of said selected materials. 2. The system defined by claim 1, said optical means including: 2Q a plurality of lens means for each directing incident radiation onto a different one of said detector arrays; and

a plurality of filter means for limiting the passage of incident radiation through a different one of said 25 plurality of lens means to radiation having preselected wavelengths.

3. The system defined by claim 2, said optical means including an equal number of lens means and filter means, each said filter means permitting the passage of radiation having different preselected wavelengths.

4. The system defined by claim 3, said system including a number of detector arrays that is equal to the number of lens means included in said system.

5. The system defined by claim 4, said detector arrays being square arrays.

6. The system defined by claim 4, said detector arrays being line arrays.

7. The system defined by claim 1, said detector signals being concurrently read out from corresponding charge coupled devices included in said plurality of detector arrays.

8. The system defined by claim 1, said normalizing circuit means including:

means for storing a dark current offset signal for a corresponding charge coupled device and having said dark current offset signal subtracted from the detector signal provided from said corresponding charge coupled device; and

means for storing a gain signal for a corresponding charge coupled device and having the detector signal provided by said charge coupled device divided by said gain signal.

30

35

40

45

50

55

60

65

« PreviousContinue »