|Publication number||US5349524 A|
|Application number||US 08/001,998|
|Publication date||Sep 20, 1994|
|Filing date||Jan 8, 1993|
|Priority date||Jan 8, 1993|
|Also published as||EP0630483A1, WO1994016341A1|
|Publication number||001998, 08001998, US 5349524 A, US 5349524A, US-A-5349524, US5349524 A, US5349524A|
|Inventors||Christopher M. W. Daft, Anne L. Hall, Sharbel E. Noujaim, Lewis J. Thomas, B. Welles II Kenneth|
|Original Assignee||General Electric Company|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (21), Non-Patent Citations (4), Referenced by (55), Classifications (14), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is related to commonly assigned Daft et al: application Ser. No. 08/002,000 filed Jan. 8, 1993.
This invention relates to acoustical imaging and, in particular, to the production of color flow images based on the Doppler shift of ultrasonic signals.
There are a number of modes in which vibratory energy, such as ultrasound can be used to produce images of objects. The ultrasound transmitter may be placed on one side of the object and the sound transmitted through the object to the ultrasound receiver placed on the other side ("transmission mode"). With transmission mode methods, an image may be produced in which the brightness of each pixel is a function of the amplitude of the ultrasound that reaches the receiver ("attenuation" mode), or the brightness of each pixel is a function of the time required for the sound to reach the receiver ("time-of-flight" or "speed of sound" mode). In the alternative, the receiver may be positioned on the same side of the object as the transmitter and an image may be produced in which the brightness of each pixel is a function of the amplitude or time-of-flight of the ultrasound reflected from the object back to the receiver ("reflection", "backscatter" or "echo" mode). The present invention relates to a backscatter method for producing ultrasound images.
There are a number of well known backscatter methods for acquiring ultrasound data. In the so-called "A-scan" method, an ultrasound pulse is directed into the object by the transducer and the amplitude of the reflected sound is recorded over a period of time. The amplitude of the echo signal is proportional to the scattering strength of the scatterers in the object and the time delay is proportional to the range of the scatterers from the transducer. In the so-called "B-scan" method, the transducer transmits a series of ultrasonic pulses as it is scanned across the object along a single axis of motion. The resulting echo signals are recorded as with the A-scan method and their amplitude is used to modulate the brightness of pixels on a display at the time delay. With the B-scan method, enough data are acquired from which an image of the scatterers can be reconstructed.
In the so-called C-scan method, the transducer is scanned across a plane above the object and only the echoes reflecting from the focal depth of the transducer are recorded. The sweep of the electron beam of a CRT display is synchronized to the scanning of the transducer so that the x and y coordinates of the transducer correspond to the x and y coordinates of the image.
Ultrasonic transducers for medical applications are constructed from one or more piezoelectric elements sandwiched between a pair of electrodes. Such piezoelectric elements are typically constructed of lead zirconate titanate (PZT), polyvinylidene difluoride (PVDF), or PZT ceramic/polymer composite. The electrodes are connected to a voltage source, and when a voltage waveform is applied, the piezoelectric elements change in size at a frequency corresponding to that of the applied voltage. When a voltage waveform is applied, the piezoelectric element emits an ultrasonic wave into the media to which it is coupled. Conversely, when an ultrasonic wave strikes the piezoelectric element, the element produces a corresponding voltage across its electrodes. Typically, the front of the element is covered with an acoustic matching layer that improves the coupling with the media in which the ultrasonic waves propagate. In addition, a backing material is coupled to the rear of the piezoelectric element to absorb ultrasonic waves that emerge from the back side of the element so that they do not interfere. A number of such ultrasonic transducer constructions are disclosed in U.S. Pat. Nos. 4,217,684; 4,425,525; 4,441,503; 4,470,305 and 4,569,231, all of which are assigned to the instant assignee.
When used for ultrasound imaging, the transducer typically has a number of piezoelectric elements arranged in an array and driven with separate voltages (apodizing). By controlling the time delay (or phase) and amplitude of the applied voltages, the ultrasonic waves produced by the piezoelectric elements combine to produce a net ultrasonic wave that travels along a preferred beam direction and is focused at a selected point along the beam. By controlling the time delay and amplitude of the applied voltages, the beam with its focal point can be moved in a plane to scan the subject.
The same principles apply when the transducer is employed to receive the reflected sound (receiver mode). That is, the voltages produced at the transducer elements in the array are summed together such that the net signal is indicative of the sound reflected from a single focal point in the subject. As with the transmission mode, this focused reception of the ultrasonic energy is achieved by imparting separate time delay (and/or phase shifts) and gains to the signal from each transducer array element.
This form of ultrasonic imaging is referred to as "phased array sector scanning", or "PASS". Such a scan is comprised of a series of measurements in which the steered ultrasonic wave is transmitted, the system switches to receive mode after a short time interval, and the reflected ultrasonic wave is received and stored. Typically, the transmission and reception are steered in the same direction (θ) during each measurement to acquire data from a series of points along an acoustic beam or scan line. The receiver is dynamically focused at a succession of ranges (R) along the scan line as the reflected ultrasonic waves are received. The time required to conduct the entire scan is a function of the time required to make each measurement and the number of measurements required to cover the entire region of interest at the desired resolution and signal-to-noise ratio. For example, a total of 128 scan lines may be acquired over a 90 degree sector, with each scan line being steered in increments of 0.70° . A number of such ultrasonic imaging systems are disclosed in U.S. Pat. Nos. 4,155,258; 4,155,260; 4,154,113; 4,155,259; 4,180,790; 4,470,303; 4,662,223; 4,669,314 and 4,809,184, all of which are assigned to the instant assignee.
The measurement of blood flow in the heart and vessels using the Doppler effect is well known. Whereas the amplitude of the reflected waves is employed to produce black and white images of the tissues, the frequency shift of the reflected waves may be used to measure the velocity of reflecting scatterers from tissue or blood. Color flow images are produced by superimposing a color image of the velocity of moving material, such as blood, over the black and white anatomical image. The measured velocity of flow at each pixel determines its color.
A major difficulty in making Doppler effect measurements of reflected ultrasonic waves from blood is that the received echo signal typically contains a large component produced by stationary or slowly moving tissues, whereas blood reflects ultrasound very weakly. The stationary tissues do not produce any frequency shift in the reflected waves and these components can easily be filtered out without affecting the flow measurement. However, the reflections produced by the moving tissue due to cardiac or respiratory motion are frequency shifted and may completely overwhelm signals from slowly flowing blood. Prior systems provide a "wall filter" which is manually adjusted by the operator to filter out a narrow band of frequencies in the echo signal centered on the carrier frequency where static signals lie. It is up to the operator to adjust the width of this filter in such a manner that the reflected, slow moving wall signals are eliminated without distorting the measurement of blood flow. If the filter is set too wide, signals from slowly moving blood may be eliminated. In addition, the filter setting is static, and is applied over the whole image. As a result, it may work satisfactorily at some locations in the field-of-view of the image, but it may not be the proper setting for other locations.
The present invention relates to a color flow processor for an ultrasonic imaging system, and particularly, to an adaptive wall filter which automatically adjusts its center frequency and bandwidth as a function of the received echo signal. More specifically, the color flow processor includes a first autocorrelation estimator which receives the demodulated, baseband echo signal and produces output signals which indicate the mean frequency thereof and the variance from the mean frequency. A complex mixer receives the baseband echo signal, receives the mean frequency signal at a reference input, and is operable to produce a modified echo signal which is shifted in frequency by an amount opposite to the mean frequency. A filter is connected to receive the modified echo signal and the variance signal and is operable to filter out of the modified echo signal a band of frequencies determined by the variance signal. A second autocorrelation estimator is connected to receive the filtered echo signal and produce an output signal which indicates the mean frequency thereof. Means responsive to the output signal of the second autocorrelation estimator are provided for producing a color signal indicative of flow velocity.
A general object of the invention is to improve the accuracy and sensitivity of color flow measurements based on the Doppler shift of ultrasonic signals. By automatically shifting the frequency of the received echo signal by an amount opposite to its measured mean frequency, the signal components therein due to moving walls of a filter are effectively shifted to the center of the filter. By automatically controlling the width of the stop band of the filter with the measured variance, the signal components produced by slowly moving tissue are completely filtered out. The remaining signal components are primarily due to flowing blood and may be measured without distortion from the much larger wall components.
Another object of the invention is to provide a wall filter which dynamically changes to meet a wide variety of operating conditions. Since the wall component of the echo signal typically dominates the measurement of mean frequency and variance, these measurements are used to dynamically control the wall filter characteristics and remove the wall signal components, regardless of their frequency or bandwidth.
Yet another object of the invention is to provide a time domain dynamic wall filter which is simple to manufacture. By shifting the frequency of the wall signal components, they can be filtered out of the echo signal with a simple, symmetric FIR filter or an antisymmetric filter.
Still another object of the invention is to provide a dynamic wall filter for a focused and demodulated echo signal. The invention is implemented in the mid-processor section of the receiver after the echo signal has been demodulated and dynamically focused into a single receive beam. Thus, it is not necessary to repeat the wall filter in each channel of a multi-channel PASS system.
The foregoing and other objects and advantages of the invention will appear from the following description. In the description, reference is made to the accompanying drawings which form a part hereof, and in which there is shown by way of illustration a preferred embodiment of the invention. Such embodiment does not necessarily represent the full scope of the invention, however, and reference is made therefore to the claims herein for interpreting the scope of the invention.
FIG. 1 is a block diagram of an ultrasonic imaging system which employs the present invention;
FIG. 2 is a block diagram of a transmitter which forms part of the system of FIG. 1;
FIGS. 2A and 2B are graphical representations of the signal in any of the channels of transmitter 50 of FIG. 2;
FIG. 3 is a block diagram of a receiver which forms part of the system of FIG. 1;
FIG. 4 is a block diagram of a display system which forms part of the system of FIG. 1;
FIG. 5 is a block diagram of a receiver channel which forms part of the receiver of FIG. 3;
FIG. 5A-5E are graphical illustrations of the signal at various points in the receiver channel of FIG. 5;
FIG. 6 is a schematic diagram of a color flow processor according to the present invention, which forms part of the receiver of FIG. 3; and
FIGS. 7A and 7B are graphic illustrations to help explain operation of the color flow processor of FIG. 6.
Referring particularly to FIG. 1, a vibratory energy imaging system includes a transducer array 11 comprised of a plurality of separately driven elements 12 which each produce a burst of ultrasonic energy when energized by a pulsed waveform produced by a transmitter 13. The ultrasonic energy reflected back to transducer array 11 from the subject under study is converted to an electrical signal by each transducer element 12 and applied separately to a receiver 14 through a set of transmit/receive (T/R) switches 15. Transmitter 13, receiver 14 and switches 15 are operated under control of a digital controller 16 responsive to commands by a human operator. A complete scan is performed by acquiring a series of echoes in which switches 15 are set to their transmit position, transmitter 13 is gated on momentarily to energize each transducer element 12, switches 15 are then set to their receive position, and the subsequent echo signals produced by each transducer element 12 are applied to receiver 14. The separate echo signals from each transducer element 12 are combined in receiver 14 to produce a single echo signal which is employed to produce a line in an image on a display system 17.
Transmitter 13 drives transducer array 11 such that the vibrational energy produced, e.g., ultrasonic energy, is directed, or steered, in a beam. A B-scan can therefore be performed by moving this beam through a set of angles from point-to-point rather than physically moving transducer array 11. To accomplish this, transmitter 13 imparts a time delay (Ti) to the respective pulsed waveforms 20 that are applied to successive transducer elements 12. If the time delay is zero (Ti =0), all the transducer elements 12 are energized simultaneously and the resulting ultrasonic beam is directed along an axis 21 normal to the transducer face and originating from the center of transducer array 11. As the time delay (Ti) is increased as illustrated in FIG. 1, the ultrasonic beam is directed downward from central axis 21 by an angle θ. The relationship between the time delay Ti applied to each ith signal from one end of the transducer array (i=l) to the other end (i=n) is given by the following relationship: ##EQU1## where: x=distance of center of transducer element 12 from center of transducer array,
θ=transmit beam angle,
c=velocity of sound in the object under study, and
RT =range at which transmit beam is focused.
The time delays Ti in equation (1) have the effect of steering the beam in the desired angle θ, and causing it to be focused at a fixed range RT. A sector scan is performed by progressively changing the time delays Ti in successive excitations. The angle θ is thus changed in increments to steer the transmitted beam in a succession of directions. When the direction of the beam is above central axis 21, the timing of pulses 20 is reversed, but the formula of equation (1) still applies.
Referring still to FIG. 1, the echo signals produced by each burst of ultrasonic energy emanate from reflecting objects located at successive positions (R) along the ultrasonic beam. These are sensed separately by each segment 12 of transducer array 11 and a sample of the magnitude of the echo signal at a particular point in time represents the amount of reflection occurring at a specific range (R). Due to the differences in the propagation paths between a reflecting point P and each transducer element 12, however, these echo signals will not occur simultaneously and their amplitudes will not be equal. The function of receiver 14 is to amplify and demodulate these separate echo signals, impart the proper time delay and phase shift to each and sum them together to provide a single echo signal which accurately indicates the total ultrasonic energy reflected from point P located at range R along the ultrasonic beam oriented at the angle θ.
To simultaneously sum the electrical signals produced by the echoes from each transducer element 12, time delays and phase shifts are introduced into each separate transducer element channel of receiver 14. The beam time delays for reception are the same delays (Ti) as the transmission delays described above. However, in order to dynamically focus, the time delay and phase shift of each receiver channel is continuously changing during reception of the echo to provide dynamic focusing of the received beam at the range R from which the echo signal emanates. The exact equation for the time delay Td imposed on the signal received by each transducer element is as follows: ##EQU2## where: t=elapsed time after transmission of sound from center of transducer array (i.e. START),
c=velocity of sound in the object under study,
θ=beam angle, and
x=distance of center of element from center of transducer array.
The same calculation, suitably scaled, also provides the correct phase shift.
Under direction of digital controller 16, receiver 14 provides delays during the scan such that steering of receiver 14 tracks with the direction θ of the beam steered by transmitter 13 and it samples the echo signals at a succession of ranges R and provides the proper delays and phase shifts to dynamically focus at points P along the beam. Thus, each emission of an ultrasonic pulse waveform results in the acquisition of a series of data points which represent the amount of reflected sound from a corresponding series of points P located along the ultrasonic beam.
Display system 17 receives the series of data points produced by receiver 14 and converts the data to a form producing the desired image. For example, if an A-scan is desired, the magnitude of the series of data points is merely graphed as a function of time. If a B-scan is desired, each data point in the series is used to control brightness of a pixel in the image, and a scan comprised of a series of measurements at successive steering angles (θ) is performed to provide the data necessary for display.
Referring to FIG. 2 in conjunction with FIG. 1, transmitter 13 includes a set of channel pulse code memories indicated collectively as memories 50. In the preferred embodiment there are 128 separate transducer elements 12, and therefore, there are 128 separate channel pulse code memories 50. Each pulse code memory 50 is typically a 1-bit by 512-bit memory which stores a bit pattern 51 that determines the frequency of the ultrasonic pulse 52 to be produced. In the preferred embodiment, this bit pattern is read out of each pulse code memory 50 by a 40 MHz master clock and applied to a driver 53 which amplifies the signal to a power level suitable for driving transducer 11. In the example shown in FIG. 2A, the bit pattern is a sequence of four "1" bits alternated with four "0" bits to produce a 5 MHz ultrasonic pulse 52; however, other carrier frequencies (F0) may be employed in the preferred embodiment, such as 2.5, 3.75, 6.25, 7.5, 8.75 and 10 MHz. Transducer elements 12 to which these ultrasonic pulses 52 are applied respond by producing ultrasonic energy. If all 512 bits are used, a pulse of bandwidth as narrow as 40 kHz centered on the carrier frequency (i.e. 5 MHz in the example) will be emitted.
As indicated above, to steer the transmitted beam of the ultrasonic energy in the desired direction (θ), pulses 52 for each of the n channels, such as shown in FIG. 2B, must be delayed by the proper amount. These delays are provided by a transmit control 54 which receives four control signals (START, MASTER CLOCK, RT and θ) from digital controller 16 (FIG. 1 ). Using the input control signal θ, the fixed transmit focus RT, and the above equation (1), transmit control 54 calculates the delay increment Ti required between successive transmit channels. When the START control signal is received, transmit control 54 gates one of four possible phases of the 40 MHz MASTER CLOCK signal through to the first transmit channel 50. At each successive delay time interval (Ti) thereafter, the 40 MHz MASTER CLOCK signal is gated through to the next channel pulse code memory 50 until all n=128 channels are producing their ultrasonic pulses 52. Each transmit channel 50 is reset after its entire bit pattern 51 has been transmitted and transmitter 13 then waits for the next θ and next START control signals from digital controller 16. As indicated above, in the preferred embodiment of the invention a complete B-scan is comprised of 128 ultrasonic pulses steered in Δθ increments of 0.70° through a 90° sector centered about central axis 21 (FIG. 1) of the transducer 11.
For a detailed description of the transmitter 13, reference is made to commonly assigned U.S. Pat. No. 5,014,712 issued May 14, 1991 and entitled "Coded Excitation For Transmission Dynamic Focusing of Vibratory Energy Beam" incorporated herein by reference.
Referring particularly to FIG. 3, receiver 14 is comprised of three sections: a time-gain control section 100, a receive beam forming section 101, and a mid processor 102. Time-gain control (or TGC) section 100 includes an amplifier 105 for each of the n=128 receiver channels and a time-gain control circuit 106. The input of each amplifier 105 is connected to a respective one of transducer elements 12 to receive and amplify the echo signal which it receives. The amount of amplification provided by amplifiers 105 is controlled through a control line 107 that is driven by TGC circuit 106. As is well known in the art, as the range of the echo signal increases, its amplitude is diminished. As a result, unless the echo signal emanating from more distant reflectors is amplified more than the echo signal from nearby reflectors, the brightness of the image diminishes rapidly as a function of range (R). This amplification is controlled by the operator who manually sets eight (typically) TGC linear potentiometers 108 to values which provide a relatively uniform brightness over the entire range of the sector scan. The time interval over which the echo signal is acquired determines the range from which it emanates, and this time interval is divided into eight segments by TGC circuit 106. The settings of the eight potentiometers are employed to set the gains of amplifiers 105 during each of the eight respective time intervals so that the echo signal is amplified in ever increasing amounts over the echo signal acquisition time interval.
The receive beam forming section 101 of receiver 14 includes n=128 separate receiver channels 110. As will be explained in more detail below, each receiver channel 110 receives the analog echo signal from one of amplifiers 105 at an input 111, and it produces a stream of digitized output values on an I bus 112 and a Q bus 113. Each of these I and Q values represents a demodulated sample of the echo signal envelope at a specific range (R). These samples have been delayed and phase shifted such that when they are summed at summing points 114 and 115 with the I and Q samples from each of the other receiver channels 110, they indicate the magnitude and phase of the echo signal reflected from a point P located at range R on the steered beam (θ). In the preferred embodiment, each echo signal is sampled at 150 micrometer increments over the entire range of the scan line (typically 40 to 200 millimeters).
For a more detailed description of receiver 14, reference is made to commonly assigned U.S. Pat. No. 4,983,970, issued Jan. 8, 1991 and entitled "Method And Apparatus for Digital Phase Array Imaging", which is incorporated herein by reference.
Referring still to FIG. 3, mid processor section 102 receives the beam samples from summing points 114 and 115. The I and Q values of each beam sample are 20-bit digital numbers representing the in-phase and quadrature components of the magnitude of the reflected sound from a point (R, θ) . Mid processor 102 can perform a variety of calculations on these beam samples, where choice is determined by the type of image to be reconstructed. For example, if a conventional magnitude image is to be produced, a detection processor 120 is implemented in which a digital magnitude M is calculated from each receive beam sample and produced at output 121 along with the R,θ coordinates of the reflection point, according to ##EQU3## Detection processor 120 may also implement correction methods such as that disclosed in commonly assigned U.S. Pat. No. 4,835,689, issued May 30, 1989 and entitled "Adaptive Coherent Energy Beam Formation Using Phase Conjugation." Such correction methods examine the received beam samples and calculate corrective values that can be used in subsequent measurements by transmitter 13 and receiver 14 to improve beam focusing and steering. Such corrections are necessary, for example, to account for the nonhomogeneity of the media through which the sound from each transducer element travels during a scan.
The present invention relates particularly to a color flow processor 123 which is also located in mid-processor 102. Color flow processor 123, which is described in more detail below with respect to FIG. 6, receives the I and Q values of each demodulated and focused echo signal sample from summing points 114 and 115, and produces a 12-bit flow value at the mid processor output 121. This flow signal controls the red, green and blue display colors, and is applied to display system 17 along with the magnitude M for the same point. As explained in more detail below, the color indicated by this flow value is a function of the velocity and direction of flow as measured by color flow processor 123.
Referring particularly to FIGS. 1 and 4, receiver 14 generates a stream of 8-bit digital numbers at its output 121, which is applied to the input of display system 17. Each output includes an 8-bit tissue magnitude and a 12-bit flow value. These "scan data" are stored in a memory 150 as an array, with the rows of scan data array 150 corresponding with the respective beam angles (θ) that are acquired, and the columns of scan data array 150 corresponding with the respective ranges (R) at which samples are acquired along each beam. The R and θ control signals 151 and 152 from receiver 14 indicate where each input value is to be stored in array 150, and a memory control circuit 153 writes that value to the proper memory location in array 150. The scan can be continuously repeated and the flow of values from receiver 14 will continuously update scan data array 150.
Referring still to FIG. 4, the scan data in array 150 are read by a digital scan converter 154 and converted to a form producing the desired image. If a conventional B-scan image is being produced, for example, the tissue magnitude and flow values M(R,θ) stored in the scan data array 150 are converted to values M(x,y) which indicate gray shade (for tissues) and color (for flow) at pixel locations (x,y) in the image. Such a polar coordinate to Cartesian coordinate conversion of the ultrasonic image data is described, for example, in an article by Steven C. Leavitt et al in Hewlett-Packard Journal, October 1983, pp. 30-33, entitled "A Scan Conversion Algorithm for Displaying Ultrasound Images."
Regardless of the particular conversion made by digital scan converter 154, the resulting image data are written to a memory 155 which stores a two-dimensional array of converted scan data. A memory control 156 provides dual-port access to memory 155 such that digital scan converter 154 can continuously update the values therein with fresh data while a display processor 157 reads the updated data. Display processor 157 is responsive to operator commands received from a control panel 158 to perform conventional image processing functions on the converted scan data in memory 155. For example, the range of brightness levels indicated by the converted scan data in memory 155 may far exceed the brightness range of display device 160. Indeed, the brightness resolution of the converted scan data in memory 155 may far exceed the brightness resolution of the human eye, and manually operable controls are typically provided which enable the operator to select a window of brightness values over which maximum image contrast is to be achieved. The display processor reads the converted scan data from memory 155, provides the desired image enhancement, and writes the enhanced values to a display memory 161.
Display memory 161 is shared with a display controller circuit 162 through a memory control circuit 163, and the values therein are mapped to control brightness and color of the corresponding pixels in display 160. Display controller 162 is a commercially available integrated circuit which is designed to operate the particular type of display 160 used. For example, display 160 may be a CRT (cathode ray tube), in which case display controller 162 is a CRT controller chip which provides the required sync pulses for the horizontal and vertical sweep circuits and maps the display data to the CRT at the appropriate time during the sweep.
It should be apparent to those skilled in the art that display system 17 may take one of many forms depending on the capability and flexibility of the particular ultrasound system. In the preferred embodiment described above, programmed microprocessors are employed to implement the digital scan converter and display processor functions, and the resulting display system is, therefore, very flexible and powerful.
As indicated above with reference to FIG. 3, beam forming section 101 of receiver 14 is comprised of a set of receiver channels 110--one for each element 12 of transducer 11 (FIG. 1). Referring particularly to FIG. 5, each receiver channel is responsive to a START command, a 40 MHz master clock, and a beam angle signal (θ) from digital controller 16 (FIG. 1 ) to perform the digital beam forming functions. These include: sampling the analog input signal 111 in an analog-to-digital converter 200, demodulating the sampled signal in a demodulator 201; filtering out the high frequency sum signals produced by demodulator 201 with low pass filters 202; reducing the data rate in decimators 203; and time delaying and phase adjusting the resulting digital data stream in delay FIFOs (i.e., first-in/first-out memories) 204 and phase rotator 205. All of these elements are controlled by a receive channel control 206 which produces the required clock and control signals in response to commands from digital controller 16 (FIG. 1). In the preferred embodiment all of these elements are contained on a single integrated circuit.
Referring still to FIG. 5, analog-to-digital converter 200 samples the analog signal, indicated graphically by waveform 210 in FIG. 5A, at regular intervals determined by the leading edge of a delayed sample clock signal from receive channel control 206 on line 211. In the preferred embodiment, the sample clock signal is a 40 MHz clock signal to enable use of ultrasonic frequencies up to 20 MHz without violating the Nyquist sampling criteria. When a 5 MHz ultrasonic carrier frequency is employed, for example, it is sampled eight times per carrier cycle and a 10-bit digital sample is produced at the output of the analog-to-digital converter at a 40 MHz rate. These samples are provided to demodulator 201 which mixes each sample with both a reference that is in-phase with the transmitted ultrasonic carrier, and with a reference in quadrature with the transmitted ultrasonic carrier. The demodulator reference signals are produced from stored SINE and COSINE tables that are read out of their respective ROM ("read only memory") memories by a 40 MHz reference clock signal from receive channel control 206. The SINE value is digitally multiplied by the sampled input signal to produce a demodulated, in-phase value (I) supplied to low pass filter 202, and the COSINE value is digitally multiplied by the same sampled input signal to produce a demodulated, quadrature phase value Q output signal to a separate low pass filter 202. The low pass filters 202 are finite impulse response filters which are tuned to pass the difference frequencies supplied by demodulator 201, but block the higher, sum frequencies. As shown by waveform 215 in FIG. 5B, the output signal of each low pass filter is, therefore, a 40 MHz stream of digital values which indicate the magnitude of the I or Q component of the echo signal envelope.
For a detailed description of an analog-to-digital converter, demodulator, and a low pass filter circuit, reference is made to commonly assigned U.S. Pat. No. 4,839,652, issued Jun. 13, 1989 and entitled "Method and Apparatus For High Speed Digital Phased Array Coherent Imaging System."
Referring still to FIG. 5, the rate at which the demodulated I and Q components of the echo signal is sampled is reduced by decimators 203. The 12-bit digital samples are supplied to the decimators at a 40 MHz rate which is unnecessarily high from an accuracy standpoint, and which is a difficult data rate to maintain throughout the system. Accordingly, decimators 203 select every eighth digital sample to reduce the data rate down to 5 MHz. This corresponds to the frequency of a baseband clock produced by receive channel control 206 and employed to operate the remaining elements in the receiver channel. The I and Q outputs of decimators 203 are thus digitized samples 219 of the echo signal envelope indicated by dashed line 220 in the graph of FIG. 5C. The decimation ratio and the baseband clock frequency can be changed to values other than 8:1 and 5 MHz.
The echo signal envelope represented by the demodulated and decimated digital samples is then delayed by delay FIFOs 204 and phase shifted by phase rotator 205 to provide the desired beam steering and beam focusing. Delay FIFOs 204 are memory devices into which the successive digital sample values are written as they are produced by decimators 203 at a rate of 5 MHz. These stored values are written into successive memory addresses and then read from the memory device and supplied to phase rotator 205. The amount of initial delay is determined by the difference between the memory location from which the digital sample is currently being supplied and the memory location into which the currently received digital sample is being stored. The 5 MHz baseband clock establishes 200 nanosecond intervals between stored digital samples and FIFOs 204 can, therefore, provide a time delay measured in 200 nanosecond increments up to their maximum of 25.6 microseconds. The time delay provided by delay FIFOs 204, illustrated graphically in FIG. 5D, may be dynamically changed during receipt of the echo signal by advancing the data points sampled by decimators 203. Each advancement of the sampled data effectively causes the data stream being supplied to delay FIFOs 204 to be delayed by an additional 25 nanoseconds (1/40 MHz). A signal from receive channel control 206 controls when each advancement of the sampled data should occur.
Phase rotator 205 enables the digitized representation of the echo signal to be phase rotated. The I and Q digital samples supplied to phase rotator 205 may be represented, as shown in FIG. 5E, by a phasor 221 and the rotated I and Q digital samples supplied by phase rotator 205 may be represented by phasor 222. The magnitude of the phasors (i.e. the vector sum of their I and Q components) are not changed, but the I and Q values are changed with respect to one another such that the output phasor 222 is rotated by an amount Δφ from the input phasor 221. The phase can be either advanced (+Δφ) or delayed (-Δφ) in response to a phase control signal received on a bus 223 from receive channel control 206. For a detailed description of phase rotator 205, reference is made to commonly assigned U.S. Pat. No. 4,896,287, issued Jan. 23, 1990 and entitled "Cordic Complex Multiplier" which is incorporated herein by reference.
For a general description of receiver channel 110 and a detailed description of how the I and Q output signals of each receiver channel 110 are summed together to form a beam signal, reference is also made to the aforementioned U.S. Pat. No. 4,983,970, issued Jan. 8, 1991. For a detailed description of receive channel control 206, reference is made to commonly assigned T. L. Rhyne U.S. Pat. No. 5,230,340, Jul. 27. 1993 and entitled "Ultrasound Imaging System With Improved Dynamic Focusing", which is also incorporated herein by reference.
Referring particularly to FIG. 6, color flow processor 123 of FIG. 3 may be constructed of commercially available integrated circuits. Processor 123 includes a buffer memory 300 which stores the I and Q samples of the demodulated echo signal produced by the beam forming section of the receiver and applies them to the I and Q inputs of an autocorrelation estimator circuit 301 and a delay FIFO 302. The autocorrelation estimator may be constructed, for example, from a complex conjugate multiplier, a pair of delays and a pair of integrators as described by C. Kasai et al in an article in IEEE Transactions on Sonics and Ultrasonics, VOL. SU-32, No. 3, May 1985, entitled "Real-Time Two-Dimensional Blood Flow Imaging Using Autocorrelation Technique", which is incorporated herein by reference. This circuit produces an output signal φ(T) which represents the mean value of the frequency of the n samples applied to its inputs. If there is no movement of the reflectors, there is no Doppler change in frequency of the echo samples and this output signal is zero. If there is motion in one direction, output signal φ(T) has a positive value, and if motion is in the opposite direction, φ(T) has a negative value.
The mean value output signal φ(T) is applied to the reference input of a complex mixer circuit 303. Simultaneously, the delayed I and Q values of the same demodulated echo signal sample used to produce signal φ(T) is applied to the inputs of complex mixer 303. Frequency shifted output signals I' and Q' are produced by complex mixer 303 according to the following equations:
I'=I cos φ(T)+Q sin φ(T) (4)
Q'=I sin φ(T)-Q cos φ(T) (5)
The effect of this complex mixing with mean frequency φ(T) is to shift all the demodulated echo signal frequencies by the value -φ(T). Since in most situations the filter wall signal components dominate the echo signal, the measured mean frequency of the wall signal components and the shift in frequency by complex mixer 303 in essence shifts the mean value of the wall signal frequency to zero, or D.C. As shown in FIG. 7A, for example, the echo signal may include a wall signal component 305 shifted in frequency in one direction from the carrier due to the Doppler effect. The echo signal also includes a much smaller flow signal component 306 which has been frequency shifted by the Doppler effect in the other direction. The measured mean frequency φ(T) of the total signal is essentially that of the much larger wall signal component 305, and the resulting shifted echo signal at the output of complex mixer 303 is indicated by the dashed lines 307 and 308. The large wall signal component has thus been shifted in frequency and is now substantially centered about D.C.
Referring again to FIG. 6, the shifted echo signal values I' and Q' are applied to the inputs of a high pass FIR (Finite Impulse Response) filter 310. FIR filter 310 is a commercially available integrated circuit, such as Plessey PDSP 16256A, which has a stop band centered at D.C., and has a filter characteristic 311 in FIG. 7B. The width of this stop band is determined by filter coefficients which are supplied by a filter coefficient LUT (look-up table) 316. For example, another set of applied filter coefficients may produce a filter characteristic 312, as shown in FIG. 7B, with a narrower stop band than filter characteristic 311.
A useful feature of the present invention is that it facilitates control of the width of the FIR filter stop band such that it matches the bandwidth of the centered wall signal component. Thus referring again to FIG. 6, autocorrelation estimator circuit 301 has two additional outputs R(O) and R(T) from which the variance of the unfiltered baseband echo signal can be calculated. This calculation is performed by a turbulence calculator circuit 313 in accordance with the following equation:
σ2 =(1-|R(T)|/R(O))/T2 (6)
where T is the emission interval of ultrasonic pulses. As shown in FIG. 7A, this variance (σ2) is an indication of the width of the wall signal components and, as shown in FIG. 6, it is provided to the address terminals of filter coefficient look-up table 316. The filter coefficient LUT 316 stores in each of its addressable memories a set of filter coefficients which are read out to FIR filter 310. These filter coefficients are preselected such that for any given variance (σ2) as an input signal, filter coefficient LUT 316 produces a set of filter coefficients which match the stop band of FIR filter 310 to the bandwidth of the applied echo signal. As a result, the output signal of FIR filter 310 is a filtered echo signal which is comprised primarily of the flow signal components 308 shown in FIG. 7A.
The filtered echo signal components I" and Q" produced by FIR filter 310 shown in FIG. 6 are supplied to a second autocorrelation estimator circuit 318. This circuit 318 is identical to autocorrelation estimator 301 and produces at one output 319 a mean value signal φ"(T) which is an estimate of the mean value of the shifted flow signal component frequencies. The frequency shift imposed on this flow signal component by complex mixer 303 is offset by adding the φ(T) output of autocorrelation estimator 301 to the signal φ"(T) in a digital adder 320. The resulting signal (v) is an estimate of the mean Doppler shift of the flowing reflectors, which in turn is proportional to their mean velocity.
The output signal (v) of adder 320 forms one component of the flow signal which is produced by color flow processor 123. This flow signal component (v), representing flow velocity, is applied to the least significant digit address inputs on a chrominance control look-up table memory 325 which resides in the display system (FIG. 4 ). Each addressable memory in look-up table 325 stores twenty four bits of data which are read out on a bus 328. For each pixel in the image to be produced, eight of these bits control the intensity of red, eight bits indicate the intensity of green, and eight bits control the intensity of blue. These bit patterns are preselected such that as the flow velocity, as represented by signal v, changes in direction or magnitude, the color of the pixel at the location R,θis changed. For example, flow toward the transducer may be indicated as red and flow away from the transducer may be indicated as blue. The faster the flow, the brighter the color.
To indicate the nature of the flowing scatterers, a turbulence calculator 326 is coupled to the second autocorrelation estimator 318 outputs R"(O) and R"(T). Turbulence calculator 326 is identical to turbulence calculator 315 described above and produces an output signal (σ2)" which indicates the frequency spread of the flow signal component of the baseband echo signal. This value is indicative of flow turbulence, since laminar flow has a very narrow range of velocities while turbulent flow is a mixture of many velocities. The 4-bit turbulence value (σ2)" is supplied from color flow processor 123 as another component of the flow signal on bus 121, and it is applied to the most significant digit address terminals on chrominance control LUT 325. The 4-bit turbulence value (σ2)" completes the address to select a memory in chrominance control LUT 325 for application to a bus 328. For example, for each red and blue value which is addressable by the velocity input signal (v) to chrominance control LUT 325, there is a set of sixteen entries in LUT 325 with different amounts of green. The amount of green is selected by the turbulence measurement (σ2)". As a result, the mean flow velocity at a point in the image is indicated by the amount of red or blue, and the degree of turbulence is indicated by the amount of green.
When the flow signal component in the baseband echo signal drops below a predetermined level, it is not possible to discern flow from the background noise. When this occurs, the color signal from chrominance control LUT 325 is disabled so that no color is produced and the pixel appears at a level or degree of darkness of gray determined solely by the echo signal magnitude. This is accomplished by a power threshold detector 330 which is coupled to the R"(O) output of autocorrelation estimator 318 and provides a logic signal to chrominance control LUT 325. The R"(O) signal produced by autocorrelation estimator 318 is indicative of the area under the flow signal components curve 308 (FIG. 7A), and is therefore indicative of the flow signal power. If the flow signal power exceeds a preset level, chrominance control LUT 325 is enabled by power threshold detector 330, and if it drops below that preset level, LUT 325 is disabled.
While only certain preferred features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US3869601 *||Jun 20, 1973||Mar 4, 1975||Solartron Electronic Group||Computing apparatus for tracking moving objects|
|US4835689 *||Sep 21, 1987||May 30, 1989||General Electric Company||Adaptive coherent energy beam formation using phase conjugation|
|US4839652 *||Jun 1, 1987||Jun 13, 1989||General Electric Company||Method and apparatus for high speed digital phased array coherent imaging system|
|US4896287 *||May 31, 1988||Jan 23, 1990||General Electric Company||Cordic complex multiplier|
|US4955386 *||Dec 27, 1989||Sep 11, 1990||Hitachi, Ltd.||Pulse doppler flow speed meter|
|US4983970 *||Mar 28, 1990||Jan 8, 1991||General Electric Company||Method and apparatus for digital phased array imaging|
|US5014712 *||Dec 26, 1989||May 14, 1991||General Electric Company||Coded excitation for transmission dynamic focusing of vibratory energy beam|
|US5058593 *||Sep 18, 1990||Oct 22, 1991||Diasonics, Inc.||Apparatus for processing and displaying ultrasonic data|
|US5109857 *||Mar 4, 1991||May 5, 1992||Duke University||Ultrasound time domain velocity detection method and apparatus|
|US5163434 *||Sep 20, 1990||Nov 17, 1992||Kabushiki Kaisha Toshiba||Ultrasonic diagnostic apparatus|
|US5165413 *||Oct 26, 1990||Nov 24, 1992||Acuson Corporation||Steered linear color doppler imaging|
|US5172343 *||Dec 6, 1991||Dec 15, 1992||General Electric Company||Aberration correction using beam data from a phased array ultrasonic scanner|
|US5183047 *||May 9, 1991||Feb 2, 1993||Kontron Instruments Holdings Nv||Doppler flow velocity meter|
|US5188112 *||Nov 16, 1990||Feb 23, 1993||Acoustic Imaging Technologies Corporation||Ultrasonic Doppler imaging systems with improved flow sensitivity|
|US5190044 *||Mar 29, 1991||Mar 2, 1993||Kabushiki Kaisha Toshiba||Ultrasonic blood flow imaging apparatus|
|US5197477 *||Oct 12, 1990||Mar 30, 1993||Advanced Technology Laboratories, Inc.||Ultrasonic doppler flow measurement system with tissue motion discrimination|
|US5220923 *||Aug 16, 1991||Jun 22, 1993||Matsushita Electric Industrial Co., Ltd.||Ultrasonic doppler blood flowmeter|
|US5228009 *||Apr 10, 1992||Jul 13, 1993||Diasonics, Inc.||Parametric clutter elimination|
|US5230340 *||Apr 13, 1992||Jul 27, 1993||General Electric Company||Ultrasound imaging system with improved dynamic focusing|
|US5245589 *||Mar 20, 1992||Sep 14, 1993||Abel Jonathan S||Method and apparatus for processing signals to extract narrow bandwidth features|
|US5246006 *||Oct 24, 1991||Sep 21, 1993||Hitachi Medical Corporation||Apparatus for ultrasonic color flow mapping|
|1||C. Kasai et al., "Real-Time Two-Dimensional Blood Flow Imaging Using an Autocorrelation Technique", IEEE Transactions on Sonics and Ultrasonics, vol. SU-32, No. 3, May 1985, pp. 458-463.|
|2||*||C. Kasai et al., Real Time Two Dimensional Blood Flow Imaging Using an Autocorrelation Technique , IEEE Transactions on Sonics and Ultrasonics, vol. SU 32, No. 3, May 1985, pp. 458 463.|
|3||S. Leavitt et al., "A Scan Conversion Algorithm for Displaying Ultrasound Images", Hewlett-Packard Journal, Oct. 1983, pp. 30-33.|
|4||*||S. Leavitt et al., A Scan Conversion Algorithm for Displaying Ultrasound Images , Hewlett Packard Journal, Oct. 1983, pp. 30 33.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5445156 *||Nov 2, 1994||Aug 29, 1995||General Electric Company||Method for adaptively filtering doppler signals using a complex time domain filter|
|US5446800 *||Jun 13, 1994||Aug 29, 1995||Diasonics Ultrasound, Inc.||Method and apparatus for displaying angiographic data in a topographic format|
|US5462059 *||May 25, 1994||Oct 31, 1995||The Regents Of The University Of California||Method for assessing and displaying vascular architecture using ultrasound|
|US5823964 *||Dec 30, 1996||Oct 20, 1998||Siemens Medical Systems, Inc.||Ultrasound doppler wall filter|
|US5846203 *||Mar 27, 1997||Dec 8, 1998||Siemens Medical Systems, Inc.||Method and apparatus for noise suppression in a doppler ultrasound system.|
|US5860930 *||Mar 10, 1997||Jan 19, 1999||Acuson Corporation||Energy weighted parameter spatial/temporal filter|
|US5899864 *||Apr 9, 1997||May 4, 1999||Acuson Corporation||Adaptive temporal filtering to enhance fluid flow or tissue motion imaging|
|US5910118 *||Oct 1, 1997||Jun 8, 1999||Kabushiki Kaisha Toshiba||Removal of clutter components in ultrasound color-doppler imaging|
|US5911160 *||Dec 27, 1996||Jun 8, 1999||Kabushiki Kaisha Toshiba||Ultrasound diagnostic apparatus|
|US6071241 *||Dec 31, 1998||Jun 6, 2000||General Electric Company||Ultrasound color flow display optimization by adjustment of threshold using sampling|
|US6139501 *||Jun 8, 1999||Oct 31, 2000||Atl Ultrasound, Inc.||Coincident tissue and motion ultrasonic diagnostic imaging|
|US6193665||Dec 31, 1998||Feb 27, 2001||General Electric Company||Doppler angle unfolding in ultrasound color flow and Doppler|
|US6210334||Mar 31, 1999||Apr 3, 2001||Acuson Corporation||Medical diagnostic ultrasound method and apparatus for harmonic detection using doppler processing|
|US6287258||Oct 6, 1999||Sep 11, 2001||Acuson Corporation||Method and apparatus for medical ultrasound flash suppression|
|US6309357||Aug 9, 1999||Oct 30, 2001||Acuson Corporation||Medical diagnostic ultrasound system and method for improved flow or movement detection with multiple clutter filters|
|US6535835||Jan 31, 2000||Mar 18, 2003||Ge Medical Systems Global Technology Company, Llc||Angle independent ultrasound volume flow measurement|
|US6577967 *||Nov 26, 2001||Jun 10, 2003||General Electric Company||Automatic adjustment of velocity scale and pulse repetition frequency for doppler ultrasound spectrograms|
|US6909668||Sep 16, 2002||Jun 21, 2005||Hubbell Incorporated||Ultrasonic displacement sensor using envelope detection|
|US6997876||Apr 16, 2004||Feb 14, 2006||Zonare Medical Systems, Inc.||Ultrasound clutter filtering with iterative high pass filter selection|
|US7027355||Jan 8, 2003||Apr 11, 2006||Hubbell Incorporated||Ultrasonic displacement sensor using digital signal processing detection|
|US7118532||May 6, 2004||Oct 10, 2006||General Electric Company||Data dependent color wall filters|
|US7212466 *||Jul 15, 2004||May 1, 2007||Imagenex Technology Corp.||Producing amplitude values for controlling pixel illumination on a sonar display|
|US7450470||Jan 12, 2005||Nov 11, 2008||Imagenex Technology Corp.||High resolution images from reflected wave energy|
|US7699781 *||Feb 4, 2004||Apr 20, 2010||Zonare Medical Systems, Inc.||System for phase inversion ultrasonic imaging|
|US8050476 *||Nov 1, 2011||General Electric Company||Heart rate demodulation of periodic movement in ultrasound data for object identification|
|US8098910 *||Jan 17, 2012||Siemens Medical Solutions Usa, Inc.||Adaptive motion imaging in medical diagnostic ultrasound imaging|
|US8226561||Jan 7, 2010||Jul 24, 2012||Zonare Medical Systems, Inc.||Ultrasound imaging system|
|US8454528||Jun 4, 2013||Kai Medical, Inc.||Non-contact physiologic motion sensors and methods for use|
|US8666118||May 20, 2009||Mar 4, 2014||Imagenex Technology Corp.||Controlling an image element in a reflected energy measurement system|
|US8679018||Nov 3, 2006||Mar 25, 2014||Zonare Medical Systems, Inc.||Broad-beam imaging|
|US8764661||Jan 7, 2010||Jul 1, 2014||Zonare Medical Systems, Inc.||Echolocation data generation|
|US8795179 *||Apr 12, 2011||Aug 5, 2014||Shenzhen Mindray Bio-Medical Electronics Co., Ltd.||Methods, modules, and systems for gain control in B-mode ultrasonic imaging|
|US8992429||Jan 31, 2008||Mar 31, 2015||Kabushiki Kaisha Toshiba||Ultrasonic diagnostic apparatus|
|US20040158149 *||Feb 4, 2004||Aug 12, 2004||Mclaughlin Glen||System for phase inversion ultrasonic imaging|
|US20040199078 *||Apr 16, 2004||Oct 7, 2004||Mo Larry Y. L.||System and method for adaptive clutter filtering in ultrasound color flow imaging|
|US20050054931 *||Sep 3, 2004||Mar 10, 2005||Clark David W.||Tracking clutter filter for spectral & audio doppler|
|US20050251034 *||May 6, 2004||Nov 10, 2005||David Dubberstein||Data dependent color wall filters|
|US20060013068 *||Jul 15, 2004||Jan 19, 2006||Imagenex Technology Corp.||Producing amplitude values for controlling pixel illumination on a sonar display|
|US20060013069 *||Jan 12, 2005||Jan 19, 2006||Imagenex Technology Corp.||High resolution images from reflected wave energy|
|US20060100520 *||Dec 19, 2005||May 11, 2006||Mo Larry Y L||Ultrasound system with iterative high pass filter selection|
|US20080103394 *||Oct 28, 2007||May 1, 2008||Mclaughlin Glen||Phase Inversion Ultrasonic Imaging|
|US20080119736 *||Nov 22, 2006||May 22, 2008||General Electric Company||Heart rate demodulation of periodic movement in ultrasound data for object identification|
|US20080188751 *||Jan 31, 2008||Aug 7, 2008||Kabushiki Kaisha Toshiba||Ultrasonic diagnostic apparatus|
|US20090069675 *||Sep 11, 2007||Mar 12, 2009||Siemens Medical Solutions Usa, Inc.||Adaptive motion imaging in medical diagnostic ultrasound imaging|
|US20100130873 *||Apr 3, 2009||May 27, 2010||Kai Sensors, Inc.||Non-contact physiologic motion sensors and methods for use|
|US20100240999 *||May 28, 2010||Sep 23, 2010||Kai Medical, Inc.||Systems and methods for point in time measurement of physiologic motion|
|US20100249630 *||Sep 30, 2010||Kai Medical, Inc.||Systems and methods for respiratory rate measurement|
|US20100249633 *||Sep 30, 2010||Kai Medical, Inc.||Systems and methods for determining regularity of respiration|
|US20100292568 *||May 28, 2010||Nov 18, 2010||Kai Medical, Inc.||Systems and methods for measurement of depth of breath and paradoxical breathing|
|US20120260736 *||Apr 12, 2011||Oct 18, 2012||Shenzhen Mindray Bio-Medical Electronics Co., Ltd.||Methods, modules, and systems for gain control in b-mode ultrasonic imaging|
|EP1016878A2 *||Dec 22, 1999||Jul 5, 2000||General Electric Company||Color flow imaging for enhancing segmentation and flow dynamics|
|EP1067400A2 *||Jul 7, 2000||Jan 10, 2001||General Electric Company||Method and apparatus for adaptive wall filtering in spectral doppler ultrasound imaging|
|WO1995031937A1 *||May 22, 1995||Nov 30, 1995||The Regents Of The University Of California||Ultrasound method for assessing vascular architecture|
|WO1996021196A1 *||Dec 15, 1995||Jul 11, 1996||Acuson Corporation||Adaptive temporal filtering to enhance fluid flow or tissue motion imaging|
|WO2000041002A1 *||Dec 6, 1999||Jul 13, 2000||General Electric Company||Doppler angle unfolding in ultrasound color flow and doppler|
|U.S. Classification||600/441, 367/7, 367/136, 600/454, 367/135, 600/453|
|International Classification||G01S15/58, G01S15/52, G01S15/89, G01S7/52|
|Cooperative Classification||G01S15/8981, G01S7/52071|
|European Classification||G01S7/52S8B4, G01S15/89D7A|
|Jan 8, 1993||AS||Assignment|
Owner name: GENERAL ELECTRIC COMPANY, NEW YORK
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNORS:DAFT, CHRISTOPHER M. W.;HALL, ANNE L.;NOUJAIM, SHARBEL E.;AND OTHERS;REEL/FRAME:006390/0916;SIGNING DATES FROM 19921201 TO 19921216
|Mar 26, 1998||SULP||Surcharge for late payment|
|Mar 26, 1998||FPAY||Fee payment|
Year of fee payment: 4
|Dec 19, 2001||FPAY||Fee payment|
Year of fee payment: 8
|Dec 8, 2005||FPAY||Fee payment|
Year of fee payment: 12