|Publication number||US6766048 B1|
|Application number||US 09/694,229|
|Publication date||Jul 20, 2004|
|Filing date||Oct 23, 2000|
|Priority date||Oct 26, 1999|
|Also published as||EP1096428A1, EP1096428B1|
|Publication number||09694229, 694229, US 6766048 B1, US 6766048B1, US-B1-6766048, US6766048 B1, US6766048B1|
|Inventors||Laurent Launay, Yves Trousset, Régis Vaillant|
|Original Assignee||Ge Medical Systems Sa|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (4), Referenced by (49), Classifications (9), Legal Events (4)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The invention concerns the multiresolution reconstruction of a three-dimensional image of an object particularly from a set of two-dimensional projected images of the object obtained for different positions of a camera around the object.
It has a particularly important application in the medical field, in which reconstruction of the internal structures of the patient under examination is undertaken, particularly the reconstruction of angiography images, that is, obtaining images of vasculature opacified by injection of a contrast medium.
The invention can, nevertheless, have applications in other fields, notably, in nondestructive industrial control, in which examinations of the same type as medical examinations are performed.
In the medical field the two-dimensional projected images of the object, a patient's head, for example, are generally obtained by rotation of an X-ray camera turning around the object.
There are essentially two types of reconstruction algorithms in X-ray imaging.
A first type concerns the so-called algebraic iterative methods of reconstruction.
A second type, with which the invention is concerned, provides for a calculation of filtering and back projection called analytical method. The analytical method uses a mathematical model of the system of acquisition of acquired two-dimensional images. Each pixel of an acquired two-dimensional image contains a gray level which represents the resultant of the intensity of an X-ray having crossed a group of tissues. That statement is then expressed in the form of an analytical equation from which an inverse equation is determined, making it possible to determine a volume representation from gray levels of pixels of two-dimensional images.
The analytical reconstruction of a three-dimensional image essentially uses two stages, a first filtering stage and a second back projection stage. Both stages result from the inverse equation. From a virtual volume, a cube, for example, divided into elementary volume elements called voxels, back projection makes it possible to take each voxel, project the voxel on the acquired two-dimensional images and find the sum of the gray levels of the pixels obtained by projection. The gray level assigned to the voxel is the sum of the gray levels of the pixels obtained by projection.
In general, the methods of reconstruction of analytical type employ an analytical algorithm that is directly applied on the acquired two-dimensional images.
The acquired two-dimensional images generally have a resolution equal to 512, that is, they contain 512 lines and 512 columns of pixels. To take best advantage of the total images acquired in 512 resolution, the image reconstruction algorithm can be applied with a resolution of 512, a treatment would thus be obtained on approximately 134 million (5123) voxels, which is much too great a number, necessitating a long calculation time and, in any case, not very useful, for the vascular structures that it is generally desired to visualize typically occupy approximately 2% to 5% of the virtual volume.
Methods of reconstruction of algebraic type are known, notably, that described in French patent No. 89 16906, which propose applying an iterative algorithm not directly on the acquired two-dimensional images, but on those images after modification. Modification consists of taking an average on each acquired two-dimensional image endowed with a given resolution, called high resolution (HR), so as to obtain an acquired two-dimensional image of lesser resolution called low resolution (LR). The algebraic algorithm is applied on that low-resolution two-dimensional image to form a low-resolution three-dimensional image with a very short calculation time. Then the low-resolution image is transformed into a high-resolution three-dimensional image (identical to the resolution of the initial acquired two-dimensional images) by using complex methods of trilinear interpolation. The algebraic algorithm is then applied by using the three-dimensional image of greater resolution and the initial acquired two-dimensional images (unmodified). That method of reconstruction applies only to algebraic algorithms.
The present invention is to apply the multiresolution technique to analytical type algorithms.
The invention is also intended to reduce the time of calculation of three-dimensional image reconstruction by using an analytical type algorithm.
The invention therefore proposes a method of three-dimensional image reconstruction from a set of two-dimensional images acquired by means of a camera. In order to do so, a subsampling is taken of the set of acquired two-dimensional images so as to reduce the resolution of the acquired two-dimensional images. That stage can be matched to a smoothing stage for which the final image obtained contains a number of pixels less than the initial acquired two-dimensional image.
A first analytical algorithm of three-dimensional image reconstruction from low-resolution (LR) acquired two-dimensional images is then applied in order to obtain a low-resolution three-dimensional image.
A reconstruction support is determined by selecting in the low-resolution three-dimensional image a set of particular voxels.
One then applies a second analytical algorithm of three-dimensional image reconstruction from acquired two-dimensional images and considering only the voxels of the reconstruction support. The first and second analytical algorithms can be identical or different. Preferably, the main characteristic of the first algorithm is speed, the quality of the image obtained being less important.
That method has the advantage of applying an analytical algorithm twice with a calculation time for each application in the order of eight times less than the standard application of an analytical algorithm directly on a high-resolution (HR) acquired two-dimensional image. The first application of the analytical algorithm is faster than a standard application, for the two-dimensional image from which the algorithm is made possesses a reduced resolution. The second application of the analytical algorithm is more rapid than a standard application, for the number of voxels used to reconstruct the high-resolution three-dimensional image is considerably limited.
According to one embodiment of the invention, the subsampling of an acquired two-dimensional image includes obtaining a low-resolution acquired two-dimensional image in which each pixel is composed of several pixels of the initial acquired two-dimensional image with the average gray level of the initial pixels as gray level.
According to one advantageous characteristic of the invention, the first and second analytical algorithms are so-called Feldkamp algorithms. That type of algorithm, well known to the expert, is described in the article “Practical cone-beam algorithm,” L. A. FELDKAMP, L. C. DAVIS and J. W. KRESS, Journal Optical Society of America, A/Vol. 1, No. 6, June 1984. In general, Feldkamp's analytical algorithm mainly comprises a filtering stage and a back projection stage.
The reconstruction support is advantageously determined by applying a threshold on the low-resolution three-dimensional image, so as to maintain a percentage of voxels having the greatest gray levels.
The invention also proposes a method of three-dimensional image reconstruction from a set of acquired two-dimensional images in which:
filtering of the set of acquired two-dimensional images is carried out so as to obtain filtered two-dimensional images,
subsampling of the set of filtered two-dimensional images is carried out so as to reduce the resolution of the filtered two-dimensional images,
a back projection of the subsampled two-dimensional images of low resolution, therefore, is carried out in order to obtain a low-resolution three-dimensional image,
a reconstruction support is determined by selecting in the low-resolution three-dimensional image a set of particular voxels, and
a back projection of the filtered two-dimensional images is carried out by considering only the voxels of the reconstruction support.
The filtering and back project ion stages are preferably carried out by applying Feldkamp's algorithm. In other words, Feldkamp's algorithm is applied the first time by inserting a subsampling stage between filtering and back projection. Then Feldkamp's algorithm is applied a second time by carrying out only the back projection stage. The filtering stage is carried out only in the second application of Feldkamp's algorithm, for the latter is applied on already filtered images. A time saving is thus obtained by economizing on a filtering stage.
Other advantages and characteristics of the invention will appear on examination of the detailed description of a nonlimitative embodiment and of the attached drawings, on which:
FIG. 1 schematically illustrates a set of two-dimensional projected images around an object,
FIG. 2 illustrates in more detail the acquisition of one of those two-dimensional projected images,
FIG. 3 illustrates an averaging operation, also called subsampling, in order to reduce the resolution of an acquired two-dimensional image according to the invention, and
FIG. 4 is a flow chart of an embodiment of the method according to the invention.
Referring, in particular, to FIGS. 1 and 2, it can be seen that the imaging system usable for applying the invention makes it possible to obtain a set of two-dimensional acquired images A1-An obtained in this case by 180° rotation around a patient's head 1, for example, by an X-ray source 2. In fact, as is standard in angiography, each acquired image Ai is a subtracted image which is, for example, obtained by a standard technique of logarithmic subtraction of two X-rays taken at the same angle of incidence before and after an injection of a contrast medium into the vasculature, the three-dimensional image of which it is desired to reconstruct.
A virtual volume VV which can contain the patient's head 1 is subdivided into voxels Vi.
Each acquired image Ai is obtained from a two-dimensional radiation detector, for example, of the luminance amplifier type used in radiology, placed opposite the X-ray tube in a so-called projection plane PPi. The different projection planes are obtained by the different angular positions of the detector rotating around the patient's head. The detector is connected to processing means 3 containing, notably, sampling means connected to a microprocessor incorporating as software in its associated program memory the analytical algorithm of image reconstruction used in the invention and, in general, all the functional means making possible the use of the method according to the invention.
FIG. 3 illustrates two networks of cells. Each network represents, very schematically, a two-dimensional image in which each cell is a pixel. Image 4 is a two-dimensional image acquired with a high resolution. The high resolution is, for example, the resolution desired by the user, that is, 512 line pixels and 512 column pixels. Image 9 is a two-dimensional image obtained after averaging of the acquired two-dimensional image so as to reduce the resolution. Image 9 is endowed with a low resolution, a pixel of image 9 typically being formed from four pixels of image 4, that is, 256 line pixels and 256 column pixels. Pixel 10, for example, possesses a gray level equal to the average gray level of pixels 5, 6, 7 and 8. The analytical algorithm will be applied a first time on the low-resolution image 9, this having the advantage of a considerable time saving over a high-resolution reconstruction. It is estimated, for example, that a reconstruction with a two-dimensional image resolution of 2562 pixels is approximately eight times more rapid than a reconstruction with a two-dimensional image resolution of 5122.
The method of an embodiment of the invention therefore employs a set of acquired two-dimensional images for the reconstruction of a vascular system, for example. In order to obtain a three-dimensional image according to the invention, it is necessary to subsample, in other words, to take an average of the acquired two-dimensional images according to the illustration of FIG. 3. The different stages of the method according to the invention are illustrated on FIG. 4, in which the high-resolution acquired two-dimensional images 11 are distinguished as initial element. These are images originating from the system of acquisition with a resolution desired by the user, that is, 5122, or 512 line pixels and 512 column pixels. Those acquired two-dimensional images 11 contain the vasculature having to be reconstructed. In stage 12 an averaging or subsampling operation is carried out, in accordance with the illustration of FIG. 3, on each two-dimensional image 11 in order to obtain a two-dimensional image 13 of low resolution, that is, 2562.
Feldkamp's analytical algorithm is applied a first time to stage 14 from the low-resolution two-dimensional images 13 and from a virtual volume 15, such as a cube containing 2563 voxels. The virtual volume 15 can also be a sphere.
Feldkamp's analytical algorithm is applied in standard manner, namely, a first stage of filtering of the low-resolution two-dimensional images 13 followed by a back projection stage. The back projection stage consists of taking each voxel of the cube 15, projecting it on the low-resolution two-dimensional images 13 and assigning to that voxel a gray level identical to the sum of the gray levels of the pixels on which the voxel is projected. The image 16 obtained is a low-resolution three-dimensional image containing 2563 voxels. The algorithmic treatment of stage 14 is rapid compared to the same algorithmic treatment directly introducing the acquired two-dimensional images 11, for the number of voxels to be considered is far less, 2563 instead of 5123.
A selection 17 is then made of useful voxels, that is, voxels obeying a predetermined criterion. The predetermined criterion is established so as to retain only voxels representing the vasculature. That predetermined criterion is, for example, the safeguard of 5% voxels having the greatest gray levels. However, only the coordinates of those 5% voxels are indispensable, and their gray levels are not retained. The voxels included in the 5% constitute the reconstruction support 18. The object of that first three-dimensional reconstruction is therefore the location of a pertinent region (the vasculature), characterized by a group of particular voxels constituting the reconstruction support. The reconstruction support 18 is considered low resolution, for it originates from a cube of 2563 voxels. The reconstruction support 18 can be considered identical to the cube 15 in which certain voxels are taken into account, that is, a hollow cube.
The selection of the reconstruction support 18 can be made in another manner, such as a segmentation.
In stage 19 a matching is made by dividing each voxel of the reconstruction support 18 so as to obtain a high-resolution support 20 inscribed in a cube of 5123 voxels. That matching operation is a simple operation of transformation of coordinates which enables the reconstruction support 18 to conform to the application of the subsequent stage 21 carried out with a resolution of 5123.
Feldkamp's analytical algorithm is then applied a second time to stage 21 from high-resolution acquired two-dimensional images 11 and from the high-resolution support 20. For that second application of Feldkamp's algorithm, the three-dimensional image resolution to be obtained is 5123. A filtering of the acquired two-dimensional images 11 is then carried out in standard manner and a back projection is undertaken solely of the voxels of the high-resolution support 20. In practice, each voxel of a cube of 5123 voxels is considered. If the coordinates of the voxel correspond to a voxel outside the support 20, the back projection is not performed. On the other hand, if the coordinates of the voxel correspond to a voxel in the support 20, the back projection is performed and a gray level is assigned to the voxel identical to the sum of the gray levels of the pixels of the acquired two-dimensional images 11 on which the voxel is projected.
Thus, by carrying out back projection only with a limited number of voxels, the time of calculation of the high-resolution three-dimensional image 22 is considerably reduced. Only the voxels characterizing the vasculature are taken into account. No three-dimensional reconstruction is made of the unnecessary regions not involved in the vasculature.
Although the invention has been described with a first application of the analytical algorithm on low-resolution images of 2562, it is also possible to apply an analytical algorithm a first time on low-resolution two-dimensional images of 642, so as to determine a first support, and to apply an analytical algorithm a second time on low-resolution two-dimensional images of 2562 by using the first support to determine a second support, and then to apply an algebraic algorithm one last time on the high-resolution two-dimensional images of 5122 by using the second support to reconstruct the final three-dimensional image. It is easy to understand that starting with too low a resolution of two-dimensional images multiplies the number of stages to be carried out and, therefore, the calculation time.
Various modifications in structure and/or steps and/or function may be made by one skilled in the art without departing from the scope of the invention.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5123056||Feb 2, 1990||Jun 16, 1992||Siemens Medical Systems, Inc.||Whole-leg x-ray image processing and display techniques|
|US5375156 *||Mar 31, 1992||Dec 20, 1994||Siemens Medical Systems, Inc.||Method and apparatus for 3-D computer tomography|
|US5568384||Oct 13, 1992||Oct 22, 1996||Mayo Foundation For Medical Education And Research||Biomedical imaging and analysis|
|US5782762||Oct 27, 1994||Jul 21, 1998||Wake Forest University||Method and system for producing interactive, three-dimensional renderings of selected body organs having hollow lumens to enable simulated movement through the lumen|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7142702 *||Nov 30, 2004||Nov 28, 2006||Hitachi, Ltd.||Data processing method and data processing apparatus|
|US7203352||Sep 25, 2006||Apr 10, 2007||Hitachi, Ltd.||Data processing method and data processing apparatus|
|US7394922||Mar 6, 2007||Jul 1, 2008||Hitachi, Ltd.||Data processing method and data processing apparatus|
|US7853061||Apr 26, 2007||Dec 14, 2010||General Electric Company||System and method to improve visibility of an object in an imaged subject|
|US7916828 *||Jan 6, 2010||Mar 29, 2011||General Electric Company||Method for image construction|
|US8000773||Oct 31, 2007||Aug 16, 2011||Spectrum Dynamics Llc||Radioimaging|
|US8036731||Jul 10, 2003||Oct 11, 2011||Spectrum Dynamics Llc||Ingestible pill for diagnosing a gastrointestinal tract|
|US8094894||Dec 1, 2006||Jan 10, 2012||Spectrum Dynamics Llc||Radioactive-emission-measurement optimization to specific body structures|
|US8111886||Jul 19, 2006||Feb 7, 2012||Spectrum Dynamics Llc||Reconstruction stabilizer and active vision|
|US8175115||Nov 17, 2006||May 8, 2012||General Electric Company||Method and system for iterative reconstruction|
|US8280124||Jun 1, 2005||Oct 2, 2012||Spectrum Dynamics Llc||Methods of view selection for radioactive emission measurements|
|US8288721 *||Apr 23, 2008||Oct 16, 2012||Decision Sciences International Corporation||Imaging and sensing based on muon tomography|
|US8338788||Jun 3, 2010||Dec 25, 2012||Spectrum Dynamics Llc||Method and system of optimized volumetric imaging|
|US8423125||Oct 31, 2007||Apr 16, 2013||Spectrum Dynamics Llc||Radioimaging|
|US8445851||Oct 31, 2007||May 21, 2013||Spectrum Dynamics Llc||Radioimaging|
|US8489176||Aug 21, 2000||Jul 16, 2013||Spectrum Dynamics Llc||Radioactive emission detector equipped with a position tracking system and utilization thereof with medical systems and in medical procedures|
|US8492725||Dec 24, 2012||Jul 23, 2013||Biosensors International Group Ltd.||Method and system of optimized volumetric imaging|
|US8521253||Oct 29, 2007||Aug 27, 2013||Spectrum Dynamics Llc||Prostate imaging|
|US8565860 *||Jul 10, 2003||Oct 22, 2013||Biosensors International Group, Ltd.||Radioactive emission detector equipped with a position tracking system|
|US8571881||May 17, 2007||Oct 29, 2013||Spectrum Dynamics, Llc||Radiopharmaceutical dispensing, administration, and imaging|
|US8586932||May 9, 2007||Nov 19, 2013||Spectrum Dynamics Llc||System and method for radioactive emission measurement|
|US8606349||Oct 31, 2007||Dec 10, 2013||Biosensors International Group, Ltd.||Radioimaging using low dose isotope|
|US8610075||Nov 13, 2007||Dec 17, 2013||Biosensors International Group Ltd.||Radioimaging applications of and novel formulations of teboroxime|
|US8615405||Oct 31, 2007||Dec 24, 2013||Biosensors International Group, Ltd.||Imaging system customization using data from radiopharmaceutical-associated data carrier|
|US8620046||Jan 8, 2012||Dec 31, 2013||Biosensors International Group, Ltd.||Radioactive-emission-measurement optimization to specific body structures|
|US8620679||Oct 31, 2007||Dec 31, 2013||Biosensors International Group, Ltd.||Radiopharmaceutical dispensing, administration, and imaging|
|US8644910||Jul 19, 2006||Feb 4, 2014||Biosensors International Group, Ltd.||Imaging protocols|
|US8676292||Jan 23, 2007||Mar 18, 2014||Biosensors International Group, Ltd.||Multi-dimensional image reconstruction|
|US8748826||Jun 10, 2013||Jun 10, 2014||Biosensor International Group, Ltd.||Radioimaging methods using teboroxime and thallium|
|US8748827||Jul 22, 2013||Jun 10, 2014||Biosensors International Group, Ltd.||Method and system of optimized volumetric imaging|
|US8837793||Jan 9, 2012||Sep 16, 2014||Biosensors International Group, Ltd.||Reconstruction stabilizer and active vision|
|US8894974||May 11, 2007||Nov 25, 2014||Spectrum Dynamics Llc||Radiopharmaceuticals for diagnosis and therapy|
|US8909325||Jul 11, 2001||Dec 9, 2014||Biosensors International Group, Ltd.||Radioactive emission detector equipped with a position tracking system and utilization thereof with medical systems and in medical procedures|
|US9040016||Jul 19, 2007||May 26, 2015||Biosensors International Group, Ltd.||Diagnostic kit and methods for radioimaging myocardial perfusion|
|US9275451||Dec 20, 2007||Mar 1, 2016||Biosensors International Group, Ltd.||Method, a system, and an apparatus for using and processing multidimensional data|
|US9316743||Nov 18, 2013||Apr 19, 2016||Biosensors International Group, Ltd.||System and method for radioactive emission measurement|
|US9370333||Dec 26, 2013||Jun 21, 2016||Biosensors International Group, Ltd.||Radioactive-emission-measurement optimization to specific body structures|
|US9470801||Dec 28, 2006||Oct 18, 2016||Spectrum Dynamics Llc||Gating with anatomically varying durations|
|US20050104904 *||Nov 30, 2004||May 19, 2005||Shouhei Numata||Data processing method and data processing apparatus|
|US20070154076 *||Mar 6, 2007||Jul 5, 2007||Hitachi, Ltd.||Data processing method and data processing apparatus|
|US20080118020 *||Nov 17, 2006||May 22, 2008||General Electric Company||Method and system for iterative reconstruction|
|US20080181355 *||Jan 31, 2007||Jul 31, 2008||Sectra Mamea Ab||Method and arrangement relating to x-ray imaging|
|US20080230705 *||Oct 31, 2007||Sep 25, 2008||Spectrum Dynamics Llc||Radioimaging|
|US20080260228 *||Jun 1, 2005||Oct 23, 2008||Eli Dichterman||Methods of View Selection for Radioactive Emission Measurements|
|US20080267490 *||Apr 26, 2007||Oct 30, 2008||General Electric Company||System and method to improve visibility of an object in an imaged subject|
|US20080315091 *||Apr 23, 2008||Dec 25, 2008||Decision Sciences Corporation Los Alamos National Security, LLC||Imaging and sensing based on muon tomography|
|US20110026685 *||Jun 3, 2010||Feb 3, 2011||Spectrum Dynamics Llc||Method and system of optimized volumetric imaging|
|WO2008067159A2 *||Nov 13, 2007||Jun 5, 2008||Purdue Research Foundation||Method and system for iterative reconstruction|
|WO2008067159A3 *||Nov 13, 2007||Aug 14, 2008||Samit Kumar Basu||Method and system for iterative reconstruction|
|U.S. Classification||382/154, 382/128|
|International Classification||G06T15/08, G06T11/00, G06T1/00, A61B6/02|
|Cooperative Classification||G06T11/006, G06T2211/404|
|Feb 12, 2004||AS||Assignment|
Owner name: GE MEDICAL SYSTEMS SA, FRANCE
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LAUNAY, LAURENT;TROUSSET, YVES;VAILLANT, REGIS;REEL/FRAME:014336/0514;SIGNING DATES FROM 20000804 TO 20000824
|Jul 25, 2007||FPAY||Fee payment|
Year of fee payment: 4
|Sep 23, 2011||FPAY||Fee payment|
Year of fee payment: 8
|Jan 20, 2016||FPAY||Fee payment|
Year of fee payment: 12