|Publication number||US5684720 A|
|Application number||US 08/444,422|
|Publication date||Nov 4, 1997|
|Filing date||May 19, 1995|
|Priority date||May 19, 1994|
|Also published as||DE4417628C1|
|Publication number||08444422, 444422, US 5684720 A, US 5684720A, US-A-5684720, US5684720 A, US5684720A|
|Original Assignee||Siemens Aktiengesellschaft|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (6), Referenced by (30), Classifications (15), Legal Events (4)|
|External Links: USPTO, USPTO Assignment, Espacenet|
1. Field of the Invention
The present invention is directed to a method and apparatus for adaptively producing noise-reduced digital image sequences.
2. Description of the Prior Art
An optimally effective elimination of noise influences plays a significant part in various applications of digital image processing, particularly when processing x-ray images within the scope of digital substraction angiography (DSA). As a result, for example, the x-ray dose can be lowered, permitting fine picture details such as small blood vessels or catheters to be clearly resolved in the image.
An object of the present invention is to provide a method for adaptive noise reduction for digital image sequences which supplies especially high-quality images from which noise influences have been largely eliminated, whereby fine image details such as blood vessels are optimally well-preserved in DSA images at the same time.
This objective is achieved in a method and apparatus wherein a pixel-by-pixel, temporal low-pass filtering is combined with spatial low-pass filtering, whereby the sequence of the filter coefficients of the temporal low-pass filtering is calculated on the basis of a spatially low-pass-filtered prediction error and an a priori probability for the appearance of motion.
The inventive method employs a new generalization of a temporal filter of the Kalman type with which the noise suppression and the detection of motion are achieved simultaneously in an approximately optimum way. The inventive method is especially well-suited for implementation using specific integrated circuits (ASICs) and can be implemented in real time in this case.
FIG. 1 is a block diagram showing the structure of an electronic system constructed in accordance with the principles of the present invention for the implementation of the inventive method.
The method and apparatus of the invention are directed to processing digital image sequences processing digital image sequences to obtain a high-quality image sequence, for example processing x-ray image sequences in digital subtraction angiography (DSA). The x-ray dose can be reduced by virtue of the noise suppression achieved with the inventive method and apparatus, permitting fine image details such as blood vessels or catheters to be preserved unmodified. FIG. 1 schematically shows the structure of an electronic system for the implementation of the inventive method.
As shown in FIG. 1, a first image sequence X is obtained from an image obtaining apparatus IOA, such as an x-ray apparatus which includes at least an x-ray source and a radiation detector, and an analog to digital converter so that the first sequence X is a digital sequence of images. The chronological location of each image in the sequence X is designated by n, so that the image obtaining apparatus IOA supplies an input X(n) to the remainder of the system shown in FIG. 1. The input sequence X(n) is supplied to a subtraction unit SUB as well as to a temporal (chronological) low pass filter TF. By means of the recursive procedure described below, the temporal filter TF produces a second sequence S of images, these images being reduced in noise compared to the input sequence X(n). Again, the index n identifies the chronological position of an individual image in the sequence S, thereby resulting in an output sequence S(n). This output sequence is supplied optionally to an image memory IM or to an output unit OU, and is also supplied, at another output of the temporal filter TF to an intermediate memory B. This is so that, when the next image in the sequence X(n) is supplied to the temporal filter TF, the previous image (now designated S(n-1) due to the current image being designated S(n)), can be subtracted from the current image in the input sequence X(n) in the subtraction unit SUB. This subtraction produces a difference image D(n), which is supplied to a spatial filter TPF. The difference image D(n) is a prediction error of the amount of movement in the subtracted images, and the spatially low pass filtered prediction error L(n) at the output of the spatial filter TPF is then supplied to a look up table LT. Based on a variance factor k(n) supplied from a gain buffer GB, the look up table LT produces a filter coefficient a(n) which is supplied both to the temporal filter TF and to the gain buffer GB.
The images X(n) of the sequence X are supplied to the temporal filtering unit TF and to subtraction unit SB (i.e, addition with one input inverted). In the subtraction unit SB, the image S(n-1) of the sequence S is subtracted pixel-by-pixel from the image X(n) of the sequence X, resulting in a difference image D(n) referred to as the prediction error. This prediction error is subjected to spatial low-pass filtering in a spatial low-pass filter TPF. Numerous versions of such low-pass filters are known to those skilled in the field of image processing. The selection of a suitable version can therefore be made by a person skilled in the art dependent on the specific application.
The output of the spatial low-pass filter TPF is a spatially low-pass-filtered prediction error L(n), which is employed together with a variance factor k(n) for calculating a filter coefficient a(n) for the temporal low-pass filter TF. This can occur using the indicated, recursire relationships or--more simply and faster--using a table LT (look up table). The variance factors are intermediately stored in a gain buffer GB; they are in turn temporally recursively calculated from the filter coefficients a(n).
The output S(n) from the temporal filter TF can be optionally supplied to one of an image memory IM for retention therein or an output unit OU such as a monitor or printer, or to both.
At the same time, FIG. 1 constitutes a flowchart of the inventive method itself. The temporal filter TF calculates a second image sequence (S) from a first image sequence (X) using a sequence of filter coefficients a(n). The output image sequence (S) is intermediately stored in an image memory (buffer B) and is subtracted from the input image sequence in a subtractor SUB for calculating difference images that follows this image memory. The result of this subtraction, the prediction error, is subsequently subjected to a pixel-by-pixel, spatial low-pass filtering (in the spatial low-pass filter TFP), and the low-pass-filtered prediction error L(n) is used for calculating the temporal sequence of filter coefficients a(n) for the temporal filtering. This preferably occurs with the assistance of a table LT (look up table) of filter coefficients in a memory provided for this purpose. To that end, a sequence of intermediate quantities, the variance factors k(n), is calculated in recursive fashion from the values of the filter coefficients a(n). In particular, the a priori probability (p) for the appearance of motion, the estimated noise power (C2) in the image sequence (X) and the area-wise size (U) of the low-pass filter TFP employed enter into the calculation of the filter coefficients a(n). The method illustrated by FIG. 1 means that the recursive procedure ##EQU1## is applied to the image sequences, whereby L(n) is a spatially low-pass-filtered prediction error D(n)=X(n)-S(n-1) over an environment of the size U of a pixel being observed, and
n=1,2, . . . a time index,
a(n)=a sequence of filter coefficients,
k(n)=a sequence of variance factors,
b(n)=a sequence of estimated a posterior probabilities for the occurrence of motion in a pixel being observed,
p=an a priori probability for the occurrence of motion in the pixel being observed,
U =the area-wise expanse of a low-pass filter mask (TFP) and
c2 =the estimated noise power in the image sequence X.
For simplifying the described method, numerical tables (look up tables) can be advantageously utilized. The complexity of the inventive method is determined by the low-pass filtering (TFP) and by the temporal filtering. For the temporal filtering, the calculation of the coefficient sequence a(n) as well as the calculation of the coefficient sequence k(n) can be simplified by employing tables. A few frequently required intermediate results are thereby calculated in advance, so that these no longer need be calculated during the method execution. To this end, the sequence of filter coefficients a(n) and the sequence of intermediate quantities k(n) is quantized in a suitable way, so that they can be presented by whole numbers. Typically, only 65 different values are thereby allowed for a(n), these being uniformly distributed within the interval between 0 and 1. A division into 50 different values, and thus 50 table entries, typically suffice for presentation of the variance factor k(n). The quantized values are thereby placed more densely as they come to be closer to 1, because a higher precision is required here. Accordingly, the spacings of the values become larger the farther these are from 1. The largest quantized value in the table could, for example, lie at 50. Using these quantized values, one obtains to matrix-like table which allocates a new value for each of a(n) and k(n) to every possible value of the prediction error and to every possible value of a given variance factor, Finally, the temporal filtering itself, wherein images are to be multiplied by filter coefficients and are to be subsequently added, can be implemented using a multiplication table.
Although modifications and changes may be suggested by those skilled in the art, it is the intention of the inventors to embody within the patent warranted hereon all changes and modifications as reasonably and properly come within the scope of their contribution to the art.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4240109 *||Feb 27, 1979||Dec 16, 1980||Micro Consultants, Limited||Video movement detection|
|US4367490 *||Apr 24, 1981||Jan 4, 1983||General Electric Company||Noise reduction in digital fluoroscopy systems|
|US5214510 *||Sep 5, 1991||May 25, 1993||Nec Corporation||Adaptive digital aperture compensation and noise cancel circuit|
|US5442407 *||Mar 22, 1994||Aug 15, 1995||Matsushita Electric Corporation Of America||Video signal noise reduction system using time-varying filter coefficients|
|US5467380 *||Jul 12, 1993||Nov 14, 1995||U.S. Philips Corporation||X-ray examination apparatus and means for noise reduction for use in an x-ray examination apparatus|
|EP0064192A2 *||Apr 16, 1982||Nov 10, 1982||General Electric Company||Device for noise reduction in digital fluoroscopy systems|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5909515 *||Jul 1, 1996||Jun 1, 1999||U.S. Philips Corporation||Method for the temporal filtering of the noise in an image of a sequence of digital images, and device for carrying out the method|
|US6169583 *||May 22, 1997||Jan 2, 2001||Matsushita Electric Industrial Co., Ltd.||Method and circuit to determine a noise value that corresponds to the noise in a signal|
|US6728310||Nov 5, 1999||Apr 27, 2004||Sony Corporation||Data processing apparatus and data processing method|
|US6778692||Aug 11, 2000||Aug 17, 2004||General Electric Company||Image processing method and apparatus including image improving circuit|
|US6970605||May 31, 2000||Nov 29, 2005||Sony Corporation||Image processing apparatus, image processing method, noise-amount estimate apparatus, noise-amount estimate method, and storage medium|
|US7031513||Nov 5, 1999||Apr 18, 2006||Sony Corporation||Data processing apparatus and data processing method|
|US7088768||Mar 18, 2004||Aug 8, 2006||Sony Corporation||Data processing apparatus and data processing method|
|US7106894||Feb 14, 2000||Sep 12, 2006||Ge Medical Systems Sa||Method for reducing X-ray noise|
|US7209595||Mar 16, 2005||Apr 24, 2007||Sony Corporation||Image processing apparatus, image processing method, noise-amount estimate apparatus, noise-amount estimate method, and storage medium|
|US7454083||Aug 15, 2006||Nov 18, 2008||Sony Corporation||Image processing apparatus, image processing method, noise-amount estimate apparatus, noise-amount estimate method, and storage medium|
|US7747069||Feb 7, 2006||Jun 29, 2010||Sony Corporation||Data processing apparatus and data processing method|
|US7813581 *||May 6, 2005||Oct 12, 2010||Fitzpatrick Ben G||Bayesian methods for noise reduction in image processing|
|US7912277||Jul 27, 2009||Mar 22, 2011||Sony Corporation||Data processing apparatus and data processing method|
|US8094897||Nov 10, 2008||Jan 10, 2012||General Electric Company||Method for the processing of images in interventional radioscopy|
|US8160318||Jun 16, 2008||Apr 17, 2012||General Electric Company||Method for processing images in interventional radioscopy to detect guiding instrumentation equipment|
|US8908989||Aug 12, 2013||Dec 9, 2014||Board Of Regents, The University Of Texas System||Recursive conditional means image denoising|
|US9300907 *||Jul 25, 2012||Mar 29, 2016||Unify Gmbh & Co. Kg||Method for handling interference during the transmission of a chronological succession of digital images|
|US20040174930 *||Mar 18, 2004||Sep 9, 2004||Tetsujiro Kondo||Data processing apparatus and data processing method|
|US20050157938 *||Mar 16, 2005||Jul 21, 2005||Tetsujiro Kondo|
|US20060126930 *||Feb 7, 2006||Jun 15, 2006||Tetsujiro Kondo||Data processing apparatus and data processing method|
|US20060274975 *||Aug 15, 2006||Dec 7, 2006||Tetsujiro Kondo|
|US20090022376 *||Jun 16, 2008||Jan 22, 2009||Vincent Bismuth||Method for processing images in interventional radioscopy to detect guiding instrumentation equipment|
|US20090136112 *||Nov 10, 2008||May 28, 2009||Vincent Bismuth||Method for the processing of images in interventional radioscopy|
|US20090285472 *||Jul 27, 2009||Nov 19, 2009||Tetsujiro Kondo||Data processing apparatus and data processing method|
|US20140232812 *||Jul 25, 2012||Aug 21, 2014||Unify Gmbh & Co. Kg||Method for handling interference during the transmission of a chronological succession of digital images|
|EP1001372A1 *||Nov 5, 1999||May 17, 2000||Sony Corporation||Data processing apparatus and data processing methods|
|EP1058210A2 *||May 30, 2000||Dec 6, 2000||Sony Corporation|
|EP1058210A3 *||May 30, 2000||Jul 12, 2006||Sony Corporation|
|WO2001031583A1 *||Oct 12, 2000||May 3, 2001||Koninklijke Philips Electronics N.V.||Image processing method, system and apparatus for noise reduction in an image sequence representing a threadlike structure|
|WO2014070489A1 *||Oct 18, 2013||May 8, 2014||Board Of Regents, The University Of Texas System||Recursive conditional means image denoising|
|U.S. Classification||702/185, 378/98.6, 348/E05.089, 700/300, 348/E05.077, 348/618|
|International Classification||H04N5/21, H03H21/00, H04N5/32|
|Cooperative Classification||H03H21/0012, H04N5/3205, H04N5/21|
|European Classification||H04N5/21, H04N5/32S, H03H21/00B|
|Jul 26, 1995||AS||Assignment|
Owner name: SIEMENS AKTIENGESELLSCHAFT, GERMANY
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HEIN, SOREN;REEL/FRAME:007560/0815
Effective date: 19950628
|Apr 24, 2001||FPAY||Fee payment|
Year of fee payment: 4
|Apr 8, 2005||FPAY||Fee payment|
Year of fee payment: 8
|Apr 10, 2009||FPAY||Fee payment|
Year of fee payment: 12