|Publication number||US7225011 B2|
|Application number||US 10/296,868|
|Publication date||May 29, 2007|
|Filing date||Mar 28, 2002|
|Priority date||Apr 2, 2001|
|Also published as||EP1377938A1, US20040002660, WO2002080108A1|
|Publication number||10296868, 296868, PCT/2002/1042, PCT/IB/2/001042, PCT/IB/2/01042, PCT/IB/2002/001042, PCT/IB/2002/01042, PCT/IB2/001042, PCT/IB2/01042, PCT/IB2001042, PCT/IB2002/001042, PCT/IB2002/01042, PCT/IB2002001042, PCT/IB200201042, PCT/IB201042, US 7225011 B2, US 7225011B2, US-B2-7225011, US7225011 B2, US7225011B2|
|Inventors||Pieter Maria Mielekamp|
|Original Assignee||Koninklijke Philips Electronics, N.V.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (16), Non-Patent Citations (1), Referenced by (17), Classifications (19), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The invention relates to a device for describing and evaluating a three-dimensional anatomical structure.
The invention further relates to a method for describing a three-dimensional anatomical structure.
The invention still further relates to a computer program for describing and evaluating a three-dimensional anatomical structure.
Devices are known which can calculate and output graphically a simulation of functional processes of anatomical structures, for example the flow of blood through an arterial system. If the simulation is to be matched to characteristics of an individual, for example if the aim is to examine constrictions or other abnormalities in the blood vessels with regard to their effects on the blood flow, it is required to input these abnormalities manually, for example by specifying the site of the abnormality and of a constriction of the flow cross section at this point.
However, such a device can be supplemented only within the framework of the prescribed model, and this signifies a limitation, particularly due to the fact that the anatomical structures vary strongly individually. Moreover, in many cases it is not necessary to obtain a simulation of the function of the anatomical structure, for example of an organ, it is merely desirable, rather, to obtain a storable and unambiguous evaluation of examination results that is as simple as possible.
It is an object of the invention to provide a device as described in the opening paragraph, wherein a reporting of the examination results is enabled in a simple way.
The device according to the invention comprises an input means to input said structure, an output means, to output a simplified two-dimensional image of said structure based on a pre-stored image template, said device being arranged to graphically supplement said image with individualized details, the device being further arranged to carry out an automated assignment of the details to the anatomical structure.
According to the technical measure of the invention the user can start from templates describing standard morphologies. These morphologies can be modified graphically byte user by means of the input means, such as a keyboard, a touch screen, a mouse or any other suitable input means. Such a modification can enable moving operations, adding deleting, cut/paste and transformation operations on the structures of the template. The template can comprise a graphical model of the clinically relevant structures. The structures can be annotated with relevant clinical information. For instance, coronary artery lesions can be described by their location, severity and classification. Additional information can be enabled, such as, by way of non-limiting example, a color coding of the severity of the stenosis. Due to the fact that in accordance with the invention the device supplies a simplified two-dimensional representation, this basic representation need not be prepared by the examining physician, something which signifies an easing of work. Further details which have been obtained, for example, via x-ray examinations or other imaging methods for a respective individual can then be supplemented on the basic structure output by the device. Due to the fact that the device carries out a classification of supplemented details relating to the anatomical structure in an automated fashion, the device takes over work which would otherwise have to be undertaken by the operator, for example a physician.
In an embodiment, the device according to the invention comprises evaluation means arranged to evaluate shape, size, nomenclature and/or type of the details in an automated fashion, said device further comprising means arranged to produce a text report comprising evaluation results. The template of a structure, for example of an artery tree can be stored electronically, printed-out, modified and published through a network. The text report can be stored in a database and can be made available via the database for further reporting. By means of incorporation of a document component technology, like activeX, the artery documents can be included as objects and in-place activated in container programs like document editors (Word or the like) and different Internet browsers (Explorer). The information content of the output text report is not limited to the graphic presentation, but it is possible for purposes of a statistical analysis, for example to make use of a text report which is of the same format in each case and therefore comparable between the patients. This transmission of the graphic representation in the text report can be undertaken without action by the user, and therefore without creating a workload. Additionally, it is advantageous to insert the tool in a more general workflow context, the artery information can be related to the Radiology Information System (RIS) information in this way it will be possible to create multi-media documents, where the model information and text report arc linked to real image data and can be simultaneously updated. An example of such a link is a hyperlink. According to this technical measure an automatic reporting is enabled. In order to support automatic report generation the document model must be supplied with a structure and nomenclature of The anatomic structure. This can be done by means of a hierarchical data structure, which will be explained in more detail with reference to figures.
A still further embodiment of the device according to the invention is characterized in that the device is arranged to undertake an automated amendment of an alpha-numerical information to the details or their parts. The automated assignment of supplemented details can consist with particular advantage of naming comprising an alpha-numerical information. For example, if the name of an artery is known, and the artery is divided into segments each segment can be named with the associated technical term using nomenclature available to the device. The data of the segment thus named can further be taken over into a text report in an automated fashion. The naming of the main artery can likewise be performed in an automated fashion, in which case, for example, the device puts forward a proposal for a name of the respective anatomical structure, for instance the main artery, with the aid of the marked geometry. This name can then be verified by the user, for example a physician, or changed as required. The names of the arteries are, thus, partly static partly dynamic parameters. The names of the main arteries, like Left Anterior Descending (LAD), Right Coronal Ascending (RCA) and Circumflex arc determined by the physiology and are prescribed automatically. The association of these names with the model of the simplified image can be made at forehand in the template. For naming of sub-segments a more detailed model is required. For instance, the boundaries between the proximal, mid and distal artery segments of the LAD are determined by the locations of the first and the third diagonal branch segments. The branches are ordered along their parent curves by means of the branch-index and this provides a solution for the dynamic naming of the artery segments.
A still further embodiment of the device according to the invention is characterized in that the device is arranged to undertake an automated assignment of the details to a front or a back surface of the anatomical structure. According to this technical measure the simplified two-dimensional image of the anatomical structure can be evaluated internally as a three-dimensional structure. For example, when inscribing a detail, such as an artery, which crosses an edge contour of the image, the artery is automatically judged as a connection between the front and the back of the structure and its course is appropriately indicated and stored.
A still further embodiment of the device according to the invention is characterized in that the device is arranged to undertake an automated calculation of a functionality of the anatomical structure with reference to abnormal regions. It is likewise particularly favorable in the case of marked abnormalities, for example in the case of occlusions, for the device to be able to represent in an automated fashion the blood flow downstream of the disorder as being reduced or stopped.
It must be noted that the device according to the invention is preferably arranged to allow an image manipulation by the user, for example a deformation of the structure and/or a displacement of structure elements relative to each other. The displacement of the arteries can optionally be undertaken particularly favorably with a constant inosculation angle over a curve, or with a constant position of the sub-artery, in which case the inosculation angle could then be changed in an automated fashion and calculated in each case by the device.
Further advantages and details of the invention follow from exemplary embodiments of the subject matter of the invention which are described below and illustrated in the drawings.
New arteries can be formed by using new spline control points, something which is possible, for example, via an input aid such as a mouse, a joystick or other drawing aids. Control points can be displaced, inserted and extinguished in order to vary the shape of an artery. It is possible in this case, for example, to click on the artery, which is illustrated by the spline function, in the near zone of one of its control points A, B, C, D, E, F, for example via a mouse, and to drag this near zone to a new site with the aid of the mouse. The control point is then displaced to the new site, the spline function on which the artery is based being correspondingly displaced. This displacement is terminated upon release of a depressed mouse key, for example.
If, by contrast, the artery is clicked on in an interspace between control points, a new control point is created (compare
It is not necessary in the case of this method for individual control points to be calculated or displaced, rather it is sufficient for the artery to be touched at any site by the drawing aid in order to match the spline function appropriately. The user therefore need not have any sort of knowledge of mathematical background.
A more elaborate presentation of an embodiment of a cardio-vascular tree is schematically given in
It follows therefrom that, for example, even in the case of the sub-artery 14 that is marked in
In addition, the artery 9 has been split up in
As is explained earlier the arteries are created by the indication of the control-points. All top-level arteries are constrained to the aorta. Their origin is forced to be within the boundary region of the aorta. Artery branches are created with reference to their parents, by indication of the connection point. This attachment position is converted to the branch-index along the destination spline. The discrimination of the arteries, as being connected to the aorta or as branches to other arteries is made on the basis of the position of the first point.
In order to interact with an individual artery, the target spline must be selected, in which case it is highlighted. A specific spline can be selected by the user by input means. The selection can be made undone by selecting another spline or by any other appropriate way. By changing the relative position of the control points along the selected spline the coarse of the corresponding artery can be modified.
It is also possible to change the position of the branches on the artery. To move a branch relative to a parent its index must be modified to a new position. By changing the index of the branch the branch can be moved along the parent artery. As follows from
Instead of the displacement of sub-arteries, for example, the sub-artery 14, it is also possible to vary the main artery, for example artery 9, the branching-off point 13 for the sub-artery 14 also being moved in this case such that, as may be seen from the mathematical model in
This has the following significance for a displacement of segment boundaries S1, S2 shown in
It can be clear from all of the above that removing an artery sub-tree simply involves removing the corresponding branch from its parent list. As described before a selected artery sub-tree can be moved relative to its parent artery by a modification of its branch index. Pasting/copying of a sub-tree to a destination artery can be done by attaching the sub-tree to a destination artery at a given index, which can be calculated from the indicated destination position.
As is illustrated in
The arterial length is calculated in each case along the spline functions, and a respective point thereon is stored as a percentage of the total length from the start of an artery at the aorta up to its point (apex) lying remote therefrom. Likewise, the lengths of the arterial segments and any abnormal elements are marked and stored in the same way by their relative position. The position of sub-arteries and diseased features is stored via their respective relative position, with reference to the length of the higher-level structure, for example the artery, in the direction of the blood flow. The origin of a sub-artery or the midpoint of a pathological disorder is used for this purpose.
Communication between the database 32, in which it is also possible, for example, to store data for stents or other aids in a clinically specific fashion takes place in such a way that the graphics part 30 (Coronary Artery System Tool) is available as a plug-in component of the respective database 32. The plug-in component 31 can be arranged to make customised annotations of data, which are not obligatory for the graphics part. The graphics part 30 is arranged to make an association to a respective parameter in the database 32. Therefore, the changes made in the graphics part 30 are automatically updated in the database 32 and can be reported correctly, for example by means of a text report. This automatically creates an interface for incorporating the data into the system of the respective hospital 32. The actual device need not be changed for this purpose. The graphics data can be created, for example, by CAST as a Bynary Large Object (Blob) or in the XML format, and be incorporated in these formats into the respective individual patient database and can be made available for external applications 33.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4945478 *||Nov 6, 1987||Jul 31, 1990||Center For Innovative Technology||Noninvasive medical imaging system and method for the identification and 3-D display of atherosclerosis and the like|
|US5151856||Aug 30, 1989||Sep 29, 1992||Technion R & D Found. Ltd.||Method of displaying coronary function|
|US5175733 *||Dec 27, 1990||Dec 29, 1992||Intel Corporation||Adaptive message routing for multi-dimensional networks|
|US5175773 *||Sep 7, 1989||Dec 29, 1992||General Electric Cgr S.A.||Method of three-dimensional reconstruction of arborescence by labeling|
|US5715449 *||Jun 20, 1994||Feb 3, 1998||Oceania, Inc.||Method for generating structured medical text through user selection of displayed text and rules|
|US5734739||Aug 26, 1996||Mar 31, 1998||University Of Washington||Method for determining the contour of an in vivo organ using multiple image frames of the organ|
|US5768405 *||Sep 26, 1996||Jun 16, 1998||U.S Philips Corporation||Digital image processing method for local determination of the center and the width of objects in the form of contrasting bands on a background|
|US5872861 *||Dec 23, 1996||Feb 16, 1999||U.S. Philips Corporation||Digital image processing method for automatic detection of stenoses|
|US5889524 *||Sep 9, 1996||Mar 30, 1999||University Of Washington||Reconstruction of three-dimensional objects using labeled piecewise smooth subdivision surfaces|
|US6047080 *||Jun 19, 1996||Apr 4, 2000||Arch Development Corporation||Method and apparatus for three-dimensional reconstruction of coronary vessels from angiographic images|
|US6047090 *||Jul 16, 1997||Apr 4, 2000||U.S. Philips Corporation||Method and device for automatic segmentation of a digital image using a plurality of morphological opening operation|
|US6073042 *||Sep 25, 1997||Jun 6, 2000||Siemens Medical Systems, Inc.||Display of three-dimensional MRA images in which arteries can be distinguished from veins|
|US6169917 *||Dec 29, 1998||Jan 2, 2001||Leonardo Masotti||Method and device for reconstructing three-dimensional images of blood vessels, particularly coronary arteries, or other three-dimensional structures|
|EP0383697A2||Feb 19, 1990||Aug 22, 1990||Nihon Kohden Corporation||Electrocardiographic process simulator|
|WO1999055233A1||Apr 22, 1999||Nov 4, 1999||University Of Washington||Automated delineation of heart contours|
|WO2000010034A1||Aug 13, 1999||Feb 24, 2000||Prato Frank S||Application of scatter and attenuation correction to emission tomography images using inferred anatomy from atlas|
|1||*||Smets et al.; 1990; International journal of Cardiac Imaging; vol. 5; pp. 145-154.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7453472 *||May 31, 2003||Nov 18, 2008||University Of Utah Research Foundation||System and method for visual annotation and knowledge representation|
|US7646901||Mar 15, 2004||Jan 12, 2010||Chase Medical, L.P.||System and method for facilitating cardiac intervention|
|US7689014 *||Jul 12, 2005||Mar 30, 2010||Z-Kat Inc||Apparatus and method for measuring anatomical objects using coordinated fluoroscopy|
|US7764817 *||Aug 10, 2006||Jul 27, 2010||Siemens Medical Solutions Usa, Inc.||Method for database guided simultaneous multi slice object detection in three dimensional volumetric data|
|US7773785 *||Mar 15, 2004||Aug 10, 2010||Chase Medical, L.P.||System and method for facilitating cardiac intervention|
|US7804990 *||Jan 19, 2007||Sep 28, 2010||Siemens Medical Solutions Usa, Inc.||System and method for labeling and identifying lymph nodes in medical images|
|US7804991||Dec 12, 2008||Sep 28, 2010||Mako Surgical Corp.||Apparatus and method for measuring anatomical objects using coordinated fluoroscopy|
|US8560057||May 28, 2007||Oct 15, 2013||Gripping Heart Ab||State machine interface system|
|US20040176678 *||Mar 15, 2004||Sep 9, 2004||Chase Medical, L.P.||System and method for facilitating cardiac intervention|
|US20040176679 *||Mar 15, 2004||Sep 9, 2004||Chase Medical, L.P.||System and method for facilitating cardiac intervention|
|US20060025681 *||Jul 12, 2005||Feb 2, 2006||Abovitz Rony A||Apparatus and method for measuring anatomical objects using coordinated fluoroscopy|
|US20060061595 *||May 31, 2003||Mar 23, 2006||Goede Patricia A||System and method for visual annotation and knowledge representation|
|US20070036414 *||Aug 10, 2006||Feb 15, 2007||Siemens Corporate Research Inc||Method for database guided simultaneous multi slice object detection in three dimensional volumetric data|
|US20070237373 *||Jan 19, 2007||Oct 11, 2007||Siemens Corporate Research, Inc.||System and Method For Labeling and Identifying Lymph Nodes In Medical Images|
|US20090209866 *||Dec 12, 2008||Aug 20, 2009||Z-Kat, Inc.||Apparatus and method for measuring anatomical objects using coordinated fluoroscopy|
|US20100030094 *||May 28, 2007||Feb 4, 2010||Gripping Heart Ab||State machine interface system|
|US20110182493 *||Feb 24, 2010||Jul 28, 2011||Martin Huber||Method and a system for image annotation|
|U.S. Classification||600/407, 345/419, 600/416, 382/156, 382/130, 382/154, 382/128|
|International Classification||G06F19/00, G06T17/40, G06T11/60, A61B5/00, A61B6/03, A61B5/05, G06T15/00, G06T17/00|
|Cooperative Classification||G06T17/00, G06F19/3437|
|European Classification||G06F19/34H, G06T17/00|
|Nov 26, 2002||AS||Assignment|
Owner name: KONINKLIJKE PHILIPS ELECTRONICS N.V., NETHERLANDS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KIELEKAMP, PIETER MARIA;REEL/FRAME:014232/0276
Effective date: 20021022
|Nov 26, 2010||FPAY||Fee payment|
Year of fee payment: 4
|Nov 26, 2014||FPAY||Fee payment|
Year of fee payment: 8