1
|
Zamzmi G, Hsu LY, Li W, Sachdev V, Antani S. Harnessing Machine Intelligence in Automatic Echocardiogram Analysis: Current Status, Limitations, and Future Directions. IEEE Rev Biomed Eng 2021; 14:181-203. [PMID: 32305938 PMCID: PMC8077725 DOI: 10.1109/rbme.2020.2988295] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Echocardiography (echo) is a critical tool in diagnosing various cardiovascular diseases. Despite its diagnostic and prognostic value, interpretation and analysis of echo images are still widely performed manually by echocardiographers. A plethora of algorithms has been proposed to analyze medical ultrasound data using signal processing and machine learning techniques. These algorithms provided opportunities for developing automated echo analysis and interpretation systems. The automated approach can significantly assist in decreasing the variability and burden associated with manual image measurements. In this paper, we review the state-of-the-art automatic methods for analyzing echocardiography data. Particularly, we comprehensively and systematically review existing methods of four major tasks: echo quality assessment, view classification, boundary segmentation, and disease diagnosis. Our review covers three echo imaging modes, which are B-mode, M-mode, and Doppler. We also discuss the challenges and limitations of current methods and outline the most pressing directions for future research. In summary, this review presents the current status of automatic echo analysis and discusses the challenges that need to be addressed to obtain robust systems suitable for efficient use in clinical settings or point-of-care testing.
Collapse
|
2
|
Ge R, Yang G, Chen Y, Luo L, Feng C, Ma H, Ren J, Li S. K-Net: Integrate Left Ventricle Segmentation and Direct Quantification of Paired Echo Sequence. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1690-1702. [PMID: 31765307 DOI: 10.1109/tmi.2019.2955436] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The integration of segmentation and direct quantification on the left ventricle (LV) from the paired apical views(i.e., apical 4-chamber and 2-chamber together) echo sequence clinically achieves the comprehensive cardiac assessment: multiview segmentation for anatomical morphology, and multidimensional quantification for contractile function. Direct quantification of LV, i.e., to automatically quantify multiple LV indices directly from the image via task-aware feature representation and regression, avoids accumulative error from the inter-step target. This integration sequentially makes a stereoscopical reflection of cardiac activity jointly from the paired orthogonal cross views sequences, overcoming limited observation with a single plane. We propose a K-shaped Unified Network (K-Net), the first end-to-end framework to simultaneously segment LV from apical 4-chamber and 2-chamber views, and directly quantify LV from major- and minor-axis dimensions (1D), area (2D), and volume (3D), in sequence. It works via four components: 1) the K-Net architecture with the Attention Junction enables heterogeneous tasks learning of segmentation task of pixel-wise classification, and direct quantification task of image-wise regression, by interactively introducing the information from segmentation to jointly promote spatial attention map to guide quantification focusing on LV-related region, and transferring quantification feedback to make global constraint on segmentation; 2) the Bi-ResLSTMs distributed in K-Net layer-by-layer hierarchically extract spatial-temporal information in echo sequence, with bidirectional recurrent and short-cut connection to model spatial-temporal information among all frames; 3) the Information Valve tailing the Bi-ResLSTMs selectively exchanges information among multiple views, by stimulating complementary information and suppressing redundant information to make the efficient cross-flow for each view; 4) the Evolution Loss comprehensively guides sequential data learning, with static constraint for frame values, and dynamic constraint for inter-frame value changes. The experiments show that our K-Net gains high performance with a Dice coefficient up to 91.44% and a mean absolute error of the major-axis dimension down to 2.74mm, which reveal its clinical potential.
Collapse
|
3
|
Dong S, Luo G, Tam C, Wang W, Wang K, Cao S, Chen B, Zhang H, Li S. Deep Atlas Network for Efficient 3D Left Ventricle Segmentation on Echocardiography. Med Image Anal 2020; 61:101638. [DOI: 10.1016/j.media.2020.101638] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2019] [Revised: 01/06/2020] [Accepted: 01/09/2020] [Indexed: 10/25/2022]
|
4
|
Dong S, Luo G, Wang K, Cao S, Li Q, Zhang H. A Combined Fully Convolutional Networks and Deformable Model for Automatic Left Ventricle Segmentation Based on 3D Echocardiography. BIOMED RESEARCH INTERNATIONAL 2018; 2018:5682365. [PMID: 30276211 PMCID: PMC6151364 DOI: 10.1155/2018/5682365] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/15/2017] [Revised: 06/17/2018] [Accepted: 07/29/2018] [Indexed: 11/17/2022]
Abstract
Segmentation of the left ventricle (LV) from three-dimensional echocardiography (3DE) plays a key role in the clinical diagnosis of the LV function. In this work, we proposed a new automatic method for the segmentation of LV, based on the fully convolutional networks (FCN) and deformable model. This method implemented a coarse-to-fine framework. Firstly, a new deep fusion network based on feature fusion and transfer learning, combining the residual modules, was proposed to achieve coarse segmentation of LV on 3DE. Secondly, we proposed a method of geometrical model initialization for a deformable model based on the results of coarse segmentation. Thirdly, the deformable model was implemented to further optimize the segmentation results with a regularization item to avoid the leakage between left atria and left ventricle to achieve the goal of fine segmentation of LV. Numerical experiments have demonstrated that the proposed method outperforms the state-of-the-art methods on the challenging CETUS benchmark in the segmentation accuracy and has a potential for practical applications.
Collapse
Affiliation(s)
- Suyu Dong
- School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
| | - Gongning Luo
- School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
| | - Kuanquan Wang
- School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
| | - Shaodong Cao
- Department of Radiology, The Fourth Hospital of Harbin Medical University, Harbin 150001, China
| | - Qince Li
- School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
| | - Henggui Zhang
- School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
- School of Physics and Astronomy, University of Manchester, Manchester, UK
- Space Institute of Southern China, Shenzhen, Guangdong, China
| |
Collapse
|
5
|
Abstract
Medical image segmentation is a fundamental and challenging problem for analyzing medical images. Among different existing medical image segmentation methods, graph-based approaches are relatively new and show good features in clinical applications. In the graph-based method, pixels or regions in the original image are interpreted into nodes in a graph. By considering Markov random field to model the contexture information of the image, the medical image segmentation problem can be transformed into a graph-based energy minimization problem. This problem can be solved by the use of minimum s-t cut/ maximum flow algorithm. This review is devoted to cut-based medical segmentation methods, including graph cuts and graph search for region and surface segmentation. Different varieties of cut-based methods, including graph-cuts-based methods, model integrated graph cuts methods, graph-search-based methods, and graph search/graph cuts based methods, are systematically reviewed. Graph cuts and graph search with deep learning technique are also discussed.
Collapse
|
6
|
|
7
|
Allan G, Nouranian S, Tsang T, Seitel A, Mirian M, Jue J, Hawley D, Fleming S, Gin K, Swift J, Rohling R, Abolmaesumi P. Simultaneous Analysis of 2D Echo Views for Left Atrial Segmentation and Disease Detection. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:40-50. [PMID: 27455520 DOI: 10.1109/tmi.2016.2593900] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We propose a joint information approach for automatic analysis of 2D echocardiography (echo) data. The approach combines a priori images, their segmentations and patient diagnostic information within a unified framework to determine various clinical parameters, such as cardiac chamber volumes, and cardiac disease labels. The main idea behind the approach is to employ joint Independent Component Analysis of both echo image intensity information and corresponding segmentation labels to generate models that jointly describe the image and label space of echo patients on multiple apical views, instead of independently. These models are then both used for segmentation and volume estimation of cardiac chambers such as the left atrium and for detecting pathological abnormalities such as mitral regurgitation. We validate the approach on a large cohort of echoes obtained from 6,993 studies. We report performance of the proposed approach in estimation of the left-atrium volume and detection of mitral-regurgitation severity. A correlation coefficient of 0.87 was achieved for volume estimation of the left atrium when compared to the clinical report. Moreover, we classified patients that suffer from moderate or severe mitral regurgitation with an average accuracy of 82%.
Collapse
|
8
|
Wu H, Huynh TT, Souvenir R. Phase-aware echocardiogram stabilization using keyframes. Med Image Anal 2016; 35:172-180. [PMID: 27428628 DOI: 10.1016/j.media.2016.06.039] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2015] [Revised: 06/28/2016] [Accepted: 06/30/2016] [Indexed: 11/29/2022]
Abstract
This paper presents an echocardiogram stabilization method designed to compensate for unwanted auxilliary motion. Echocardiograms contain both deformable cardiac motion and approximately rigid motion due to a number of factors. The goal of this work is to stabilize the video, while preserving the informative deformable cardiac motion. Our approach incorporates synchronized side information, extracted from electrocardiography (ECG), which provides a proxy for cardiac phase. To avoid the computational expense of pairwise alignment, we propose an efficient strategy for keyframe selection, formulated as a submodular optimization problem. We evaluate our approach quantitatively on synthetic data and demonstrate its benefit as a preprocessing step for two common echocardiogram applications: denoising and left ventricle segmentation. In both cases, preprocessing with our method improved the performance compared to no preprocessing or other alignment approaches.
Collapse
Affiliation(s)
- Hui Wu
- IBM Thomas J. Watson Research Center, United States.
| | - Toan T Huynh
- Department of General Surgery, Carolinas Medical Center, United States
| | - Richard Souvenir
- Department of Computer Science, University of North Carolina at Charlotte, United States
| |
Collapse
|
9
|
Santiago C, Nascimento JC, Marques JS. Automatic 3-D segmentation of endocardial border of the left ventricle from ultrasound images. IEEE J Biomed Health Inform 2015; 19:339-48. [PMID: 25561455 DOI: 10.1109/jbhi.2014.2308424] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The segmentation of the left ventricle (LV) is an important task to assess the cardiac function in ultrasound images of the heart. This paper presents a novel methodology for the segmentation of the LV in three-dimensional (3-D) echocardiographic images based on the probabilistic data association filter (PDAF). The proposed methodology begins by initializing a 3-D deformable model either semiautomatically, with user input, or automatically, and it comprises the following feature hierarchical approach: 1) edge detection in the vicinity of the surface (low-level features); 2) edge grouping to obtain potential LV surface patches (mid-level features); and 3) patch filtering using a shape-PDAF framework (high-level features). This method provides good performance accuracy in 20 echocardiographic volumes, and compares favorably with the state-of-the-art segmentation methodologies proposed in the recent literature.
Collapse
|
10
|
Lin D, French BA, Xu Y, Hossack JA, Holmes JW. An ultrasound-driven kinematic model for deformation of the infarcted mouse left ventricle incorporating a near-incompressibility constraint. ULTRASOUND IN MEDICINE & BIOLOGY 2015; 41:532-541. [PMID: 25542490 PMCID: PMC4297537 DOI: 10.1016/j.ultrasmedbio.2014.09.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2014] [Revised: 08/19/2014] [Accepted: 09/02/2014] [Indexed: 06/04/2023]
Abstract
Mathematical models of varying complexity have proved useful in fitting and interpreting regional cardiac displacements obtained from imaging methods such as ultrasound speckle tracking or MRI tagging. Simpler models, such as the classic thick-walled cylinder model of the left ventricle (LV), can be solved quickly and are easy to implement, but they ignore regional geometric variations and are difficult to adapt to the study of regional pathologies like myocardial infarctions. Complex, anatomically accurate finite-element models work well, but are computationally intensive and require specialized expertise to implement. We developed a kinematic model that offers a compromise between these two traditional approaches, assuming only that displacements in the left ventricle are polynomial functions of initial position and that the myocardium is nearly incompressible, while allowing myocardial motion to vary spatially as would be expected in an ischemic or dyssynchronous LV. Model parameters were determined using an objective function with adjustable weights to account for confidence in individual displacement components and desired strength of the incompressibility constraint. The model accurately represented the motion of both normal and infarcted mouse LVs during the cardiac cycle, with normalized root mean square errors in predicted deformed positions of 8.2 ± 2.3% and 7.4 ± 2.1% for normal and infarcted hearts, respectively.
Collapse
Affiliation(s)
- Dan Lin
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA
| | - Brent A French
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA; Department of Medicine, University of Virginia, Charlottesville, VA, USA; Robert M. Berne Cardiovascular Research Center, Charlottesville, VA, USA
| | - Yaqin Xu
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA
| | - John A Hossack
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA; Electrical and Computer Engineering, University of Virginia, Charlottesville, VA, USA; Robert M. Berne Cardiovascular Research Center, Charlottesville, VA, USA
| | - Jeffrey W Holmes
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA; Department of Medicine, University of Virginia, Charlottesville, VA, USA; Robert M. Berne Cardiovascular Research Center, Charlottesville, VA, USA.
| |
Collapse
|
11
|
de Korte CL, Nillesen MM, Saris AECM, Lopata RGP, Thijssen JM, Kapusta L. New developments in paediatric cardiac functional ultrasound imaging. J Med Ultrason (2001) 2014; 41:279-90. [PMID: 27277901 DOI: 10.1007/s10396-013-0513-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2013] [Accepted: 11/15/2013] [Indexed: 11/26/2022]
Abstract
Ultrasound imaging can be used to estimate the morphology as well as the motion and deformation of tissues. If the interrogated tissue is actively deforming, this deformation is directly related to its function and quantification of this deformation is normally referred as 'strain imaging'. Tissue can also be deformed by applying an internal or external force and the resulting, induced deformation is a function of the mechanical tissue characteristics. In combination with the load applied, these strain maps can be used to estimate or reconstruct the mechanical properties of tissue. This technique was named 'elastography' by Ophir et al. in 1991. Elastography can be used for atherosclerotic plaque characterisation, while the contractility of the heart or skeletal muscles can be assessed with strain imaging. Rather than using the conventional video format (DICOM) image information, radio frequency (RF)-based ultrasound methods enable estimation of the deformation at higher resolution and with higher precision than commercial methods using Doppler (tissue Doppler imaging) or video image data (2D speckle tracking methods). However, the improvement in accuracy is mainly achieved when measuring strain along the ultrasound beam direction, so it has to be considered a 1D technique. Recently, this method has been extended to multiple directions and precision further improved by using spatial compounding of data acquired at multiple beam steered angles. Using similar techniques, the blood velocity and flow can be determined. RF-based techniques are also beneficial for automated segmentation of the ventricular cavities. In this paper, new developments in different techniques of quantifying cardiac function by strain imaging, automated segmentation, and methods of performing blood flow imaging are reviewed and their application in paediatric cardiology is discussed.
Collapse
Affiliation(s)
- Chris L de Korte
- Medical UltraSound Imaging Centre (766 MUSIC), Radboud University Medical Centre, Nijmegen, The Netherlands.
| | - Maartje M Nillesen
- Medical UltraSound Imaging Centre (766 MUSIC), Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Anne E C M Saris
- Medical UltraSound Imaging Centre (766 MUSIC), Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Richard G P Lopata
- Medical UltraSound Imaging Centre (766 MUSIC), Radboud University Medical Centre, Nijmegen, The Netherlands
- Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Johan M Thijssen
- Medical UltraSound Imaging Centre (766 MUSIC), Radboud University Medical Centre, Nijmegen, The Netherlands
| | - Livia Kapusta
- Medical UltraSound Imaging Centre (766 MUSIC), Radboud University Medical Centre, Nijmegen, The Netherlands
- Tel Aviv Sorasky Medical Center (TASMC), Tel Aviv, Israel
| |
Collapse
|
12
|
Udupa JK, Odhner D, Zhao L, Tong Y, Matsumoto MMS, Ciesielski KC, Falcao AX, Vaideeswaran P, Ciesielski V, Saboury B, Mohammadianrasanani S, Sin S, Arens R, Torigian DA. Body-wide hierarchical fuzzy modeling, recognition, and delineation of anatomy in medical images. Med Image Anal 2014; 18:752-71. [PMID: 24835182 PMCID: PMC4086870 DOI: 10.1016/j.media.2014.04.003] [Citation(s) in RCA: 50] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2013] [Revised: 04/11/2014] [Accepted: 04/11/2014] [Indexed: 11/16/2022]
Abstract
To make Quantitative Radiology (QR) a reality in radiological practice, computerized body-wide Automatic Anatomy Recognition (AAR) becomes essential. With the goal of building a general AAR system that is not tied to any specific organ system, body region, or image modality, this paper presents an AAR methodology for localizing and delineating all major organs in different body regions based on fuzzy modeling ideas and a tight integration of fuzzy models with an Iterative Relative Fuzzy Connectedness (IRFC) delineation algorithm. The methodology consists of five main steps: (a) gathering image data for both building models and testing the AAR algorithms from patient image sets existing in our health system; (b) formulating precise definitions of each body region and organ and delineating them following these definitions; (c) building hierarchical fuzzy anatomy models of organs for each body region; (d) recognizing and locating organs in given images by employing the hierarchical models; and (e) delineating the organs following the hierarchy. In Step (c), we explicitly encode object size and positional relationships into the hierarchy and subsequently exploit this information in object recognition in Step (d) and delineation in Step (e). Modality-independent and dependent aspects are carefully separated in model encoding. At the model building stage, a learning process is carried out for rehearsing an optimal threshold-based object recognition method. The recognition process in Step (d) starts from large, well-defined objects and proceeds down the hierarchy in a global to local manner. A fuzzy model-based version of the IRFC algorithm is created by naturally integrating the fuzzy model constraints into the delineation algorithm. The AAR system is tested on three body regions - thorax (on CT), abdomen (on CT and MRI), and neck (on MRI and CT) - involving a total of over 35 organs and 130 data sets (the total used for model building and testing). The training and testing data sets are divided into equal size in all cases except for the neck. Overall the AAR method achieves a mean accuracy of about 2 voxels in localizing non-sparse blob-like objects and most sparse tubular objects. The delineation accuracy in terms of mean false positive and negative volume fractions is 2% and 8%, respectively, for non-sparse objects, and 5% and 15%, respectively, for sparse objects. The two object groups achieve mean boundary distance relative to ground truth of 0.9 and 1.5 voxels, respectively. Some sparse objects - venous system (in the thorax on CT), inferior vena cava (in the abdomen on CT), and mandible and naso-pharynx (in neck on MRI, but not on CT) - pose challenges at all levels, leading to poor recognition and/or delineation results. The AAR method fares quite favorably when compared with methods from the recent literature for liver, kidneys, and spleen on CT images. We conclude that separation of modality-independent from dependent aspects, organization of objects in a hierarchy, encoding of object relationship information explicitly into the hierarchy, optimal threshold-based recognition learning, and fuzzy model-based IRFC are effective concepts which allowed us to demonstrate the feasibility of a general AAR system that works in different body regions on a variety of organs and on different modalities.
Collapse
Affiliation(s)
- Jayaram K Udupa
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States.
| | - Dewey Odhner
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Liming Zhao
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Yubing Tong
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Monica M S Matsumoto
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Krzysztof C Ciesielski
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States; Department of Mathematics, West Virginia University, Morgantown, WV 26506-6310, United States
| | - Alexandre X Falcao
- LIV, Institute of Computing, University of Campinas, Av. Albert Einstein 1251, 13084-851 Campinas, SP, Brazil
| | - Pavithra Vaideeswaran
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Victoria Ciesielski
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Babak Saboury
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Syedmehrdad Mohammadianrasanani
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, 423 Guardian Drive, Blockley Hall, 4th Floor, Philadelphia, PA 19104, United States
| | - Sanghun Sin
- Division of Respiratory and Sleep Medicine, Children's Hospital at Montefiore, 3415 Bainbridge Avenue, Bronx, NY 10467, United States
| | - Raanan Arens
- Division of Respiratory and Sleep Medicine, Children's Hospital at Montefiore, 3415 Bainbridge Avenue, Bronx, NY 10467, United States
| | - Drew A Torigian
- Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104-4283, United States
| |
Collapse
|
13
|
Guo Y, Wang Y, Nie S, Yu J, Chen P. Automatic Segmentation of a Fetal Echocardiogram Using Modified Active Appearance Models and Sparse Representation. IEEE Trans Biomed Eng 2014; 61:1121-33. [DOI: 10.1109/tbme.2013.2295376] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
14
|
Saris AECM, Nillesen MM, Lopata RGP, de Korte CL. Correlation-based discrimination between cardiac tissue and blood for segmentation of the left ventricle in 3-D echocardiographic images. ULTRASOUND IN MEDICINE & BIOLOGY 2014; 40:596-610. [PMID: 24412178 DOI: 10.1016/j.ultrasmedbio.2013.09.025] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/09/2012] [Revised: 09/18/2013] [Accepted: 09/22/2013] [Indexed: 06/03/2023]
Abstract
For automated segmentation of 3-D echocardiographic images, incorporation of temporal information may be helpful. In this study, optimal settings for calculation of temporal cross-correlations between subsequent time frames were determined, to obtain the maximum cross-correlation (MCC) values that provided the best contrast between blood and cardiac tissue over the entire cardiac cycle. Both contrast and boundary gradient quality measures were assessed to optimize MCC values with respect to signal choice (radiofrequency or envelope data) and axial window size. Optimal MCC values were incorporated into a deformable model to automatically segment the left ventricular cavity. MCC values were tested against, and combined with, filtered, demodulated radiofrequency data. Results reveal that using envelope data in combination with a relatively small axial window (0.7-1.25 mm) at fine scale results in optimal contrast and boundary gradient between the two tissues over the entire cardiac cycle. Preliminary segmentation results indicate that incorporation of MCC values has additional value for automated segmentation of the left ventricle.
Collapse
Affiliation(s)
- Anne E C M Saris
- Medical Ultrasound Imaging Center (MUSIC), Department of Radiology, Radboud University Medical Center, Nijmegen, The Netherlands.
| | - Maartje M Nillesen
- Medical Ultrasound Imaging Center (MUSIC), Department of Radiology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Richard G P Lopata
- Cardiovascular Biomechanics, Department of BioMedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Chris L de Korte
- Medical Ultrasound Imaging Center (MUSIC), Department of Radiology, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|
15
|
Chen X, Udupa JK, Alavi A, Torigian DA. GC-ASM: Synergistic Integration of Graph-Cut and Active Shape Model Strategies for Medical Image Segmentation. COMPUTER VISION AND IMAGE UNDERSTANDING : CVIU 2013; 117:513-524. [PMID: 23585712 PMCID: PMC3622953 DOI: 10.1016/j.cviu.2012.12.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Image segmentation methods may be classified into two categories: purely image based and model based. Each of these two classes has its own advantages and disadvantages. In this paper, we propose a novel synergistic combination of the image based graph-cut (GC) method with the model based ASM method to arrive at the GC-ASM method for medical image segmentation. A multi-object GC cost function is proposed which effectively integrates the ASM shape information into the GC framework. The proposed method consists of two phases: model building and segmentation. In the model building phase, the ASM model is built and the parameters of the GC are estimated. The segmentation phase consists of two main steps: initialization (recognition) and delineation. For initialization, an automatic method is proposed which estimates the pose (translation, orientation, and scale) of the model, and obtains a rough segmentation result which also provides the shape information for the GC method. For delineation, an iterative GC-ASM algorithm is proposed which performs finer delineation based on the initialization results. The proposed methods are implemented to operate on 2D images and evaluated on clinical chest CT, abdominal CT, and foot MRI data sets. The results show the following: (a) An overall delineation accuracy of TPVF > 96%, FPVF < 0.6% can be achieved via GC-ASM for different objects, modalities, and body regions. (b) GC-ASM improves over ASM in its accuracy and precision to search region. (c) GC-ASM requires far fewer landmarks (about 1/3 of ASM) than ASM. (d) GC-ASM achieves full automation in the segmentation step compared to GC which requires seed specification and improves on the accuracy of GC. (e) One disadvantage of GC-ASM is its increased computational expense owing to the iterative nature of the algorithm.
Collapse
Affiliation(s)
- Xinjian Chen
- School of Electronics and Information Engineering, Soochow University, Suzhou, China 215006
| | - Jayaram K. Udupa
- Medical Image Processing Group, Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104
| | - Abass Alavi
- Hospital of the University of Pennsylvania, Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104
| | - Drew A. Torigian
- Hospital of the University of Pennsylvania, Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104
| |
Collapse
|
16
|
Yang L, Georgescu B, Zheng Y, Wang Y, Meer P, Comaniciu D. Prediction based collaborative trackers (PCT): a robust and accurate approach toward 3D medical object tracking. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:1921-1932. [PMID: 21642040 DOI: 10.1109/tmi.2011.2158440] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
Robust and fast 3D tracking of deformable objects, such as heart, is a challenging task because of the relatively low image contrast and speed requirement. Many existing 2D algorithms might not be directly applied on the 3D tracking problem. The 3D tracking performance is limited due to dramatically increased data size, landmarks ambiguity, signal drop-out or complex nonrigid deformation. In this paper, we present a robust, fast, and accurate 3D tracking algorithm: prediction based collaborative trackers (PCT). A novel one-step forward prediction is introduced to generate the motion prior using motion manifold learning. Collaborative trackers are introduced to achieve both temporal consistency and failure recovery. Compared with tracking by detection and 3D optical flow, PCT provides the best results. The new tracking algorithm is completely automatic and computationally efficient. It requires less than 1.5 s to process a 3D volume which contains millions of voxels. In order to demonstrate the generality of PCT, the tracker is fully tested on three large clinical datasets for three 3D heart tracking problems with two different imaging modalities: endocardium tracking of the left ventricle (67 sequences, 1134 3D volumetric echocardiography data), dense tracking in the myocardial regions between the epicardium and endocardium of the left ventricle (503 sequences, roughly 9000 3D volumetric echocardiography data), and whole heart four chambers tracking (20 sequences, 200 cardiac 3D volumetric CT data). Our datasets are much larger than most studies reported in the literature and we achieve very accurate tracking results compared with human experts' annotations and recent literature.
Collapse
Affiliation(s)
- Lin Yang
- Integrated Data Systems, Department of Siemens CorporateResearch, Princeton, NJ 08540 USA.
| | | | | | | | | | | |
Collapse
|
17
|
Nillesen MM, Lopata RGP, Huisman HJ, Thijssen JM, Kapusta L, de Korte CL. Correlation based 3-D segmentation of the left ventricle in pediatric echocardiographic images using radio-frequency data. ULTRASOUND IN MEDICINE & BIOLOGY 2011; 37:1409-1420. [PMID: 21683512 DOI: 10.1016/j.ultrasmedbio.2011.05.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2010] [Revised: 04/29/2011] [Accepted: 05/09/2011] [Indexed: 05/30/2023]
Abstract
Clinical diagnosis of heart disease might be substantially supported by automated segmentation of the endocardial surface in three-dimensional (3-D) echographic images. Because of the poor echogenicity contrast between blood and myocardial tissue in some regions and the inherent speckle noise, automated analysis of these images is challenging. A priori knowledge on the shape of the heart cannot always be relied on, e.g., in children with congenital heart disease, segmentation should be based on the echo features solely. The objective of this study was to investigate the merit of using temporal cross-correlation of radio-frequency (RF) data for automated segmentation of 3-D echocardiographic images. Maximum temporal cross-correlation (MCC) values were determined locally from the RF-data using an iterative 3-D technique. MCC values as well as a combination of MCC values and adaptive filtered, demodulated RF-data were used as an additional, external force in a deformable model approach to segment the endocardial surface and were tested against manually segmented surfaces. Results on 3-D full volume images (Philips, iE33) of 10 healthy children demonstrate that MCC values derived from the RF signal yield a useful parameter to distinguish between blood and myocardium in regions with low echogenicity contrast and incorporation of MCC improves the segmentation results significantly. Further investigation of the MCC over the whole cardiac cycle is required to exploit the full benefit of it for automated segmentation.
Collapse
Affiliation(s)
- Maartje M Nillesen
- Department of Pediatrics, Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands.
| | | | | | | | | | | |
Collapse
|
18
|
Leung KYE, Danilouchkine MG, van Stralen M, de Jong N, van der Steen AFW, Bosch JG. Left ventricular border tracking using cardiac motion models and optical flow. ULTRASOUND IN MEDICINE & BIOLOGY 2011; 37:605-616. [PMID: 21376448 DOI: 10.1016/j.ultrasmedbio.2011.01.010] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2010] [Revised: 01/14/2011] [Accepted: 01/14/2011] [Indexed: 05/30/2023]
Abstract
The use of automated methods is becoming increasingly important for assessing cardiac function quantitatively and objectively. In this study, we propose a method for tracking three-dimensional (3-D) left ventricular contours. The method consists of a local optical flow tracker and a global tracker, which uses a statistical model of cardiac motion in an optical-flow formulation. We propose a combination of local and global trackers using gradient-based weights. The algorithm was tested on 35 echocardiographic sequences, with good results (surface error: 1.35 ± 0.46 mm, absolute volume error: 5.4 ± 4.8 mL). This demonstrates the method's potential in automated tracking in clinical quality echocardiograms, facilitating the quantitative and objective assessment of cardiac function.
Collapse
Affiliation(s)
- K Y Esther Leung
- Biomedical Engineering, Thoraxcenter, Erasmus MC, The Netherlands.
| | | | | | | | | | | |
Collapse
|
19
|
Leung KE, Danilouchkine MG, van Stralen M, de Jong N, van der Steen AF, Bosch JG. Probabilistic framework for tracking in artifact-prone 3D echocardiograms. Med Image Anal 2010; 14:750-8. [DOI: 10.1016/j.media.2010.06.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2009] [Revised: 06/03/2010] [Accepted: 06/03/2010] [Indexed: 10/19/2022]
|
20
|
Chen X, Udupa JK, Alavi A, Torigian DA. Automatic anatomy recognition via multiobject oriented active shape models. Med Phys 2010; 37:6390-401. [PMID: 21302796 PMCID: PMC3003721 DOI: 10.1118/1.3515751] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2010] [Revised: 10/15/2010] [Accepted: 10/25/2010] [Indexed: 11/07/2022] Open
Abstract
PURPOSE This paper studies the feasibility of developing an automatic anatomy recognition (AAR) system in clinical radiology and demonstrates its operation on clinical 2D images. METHODS The anatomy recognition method described here consists of two main components: (a) multiobject generalization of OASM and (b) object recognition strategies. The OASM algorithm is generalized to multiple objects by including a model for each object and assigning a cost structure specific to each object in the spirit of live wire. The delineation of multiobject boundaries is done in MOASM via a three level dynamic programming algorithm, wherein the first level is at pixel level which aims to find optimal oriented boundary segments between successive landmarks, the second level is at landmark level which aims to find optimal location for the landmarks, and the third level is at the object level which aims to find optimal arrangement of object boundaries over all objects. The object recognition strategy attempts to find that pose vector (consisting of translation, rotation, and scale component) for the multiobject model that yields the smallest total boundary cost for all objects. The delineation and recognition accuracies were evaluated separately utilizing routine clinical chest CT, abdominal CT, and foot MRI data sets. The delineation accuracy was evaluated in terms of true and false positive volume fractions (TPVF and FPVF). The recognition accuracy was assessed (1) in terms of the size of the space of the pose vectors for the model assembly that yielded high delineation accuracy, (2) as a function of the number of objects and objects' distribution and size in the model, (3) in terms of the interdependence between delineation and recognition, and (4) in terms of the closeness of the optimum recognition result to the global optimum. RESULTS When multiple objects are included in the model, the delineation accuracy in terms of TPVF can be improved to 97%-98% with a low FPVF of 0.1%-0.2%. Typically, a recognition accuracy of > or = 90% yielded a TPVF > or = 95% and FPVF < or = 0.5%. Over the three data sets and over all tested objects, in 97% of the cases, the optimal solutions found by the proposed method constituted the true global optimum. CONCLUSIONS The experimental results showed the feasibility and efficacy of the proposed automatic anatomy recognition system. Increasing the number of objects in the model can significantly improve both recognition and delineation accuracy. More spread out arrangement of objects in the model can lead to improved recognition and delineation accuracy. Including larger objects in the model also improved recognition and delineation. The proposed method almost always finds globally optimum solutions.
Collapse
Affiliation(s)
- Xinjian Chen
- Radiology and Imaging Sciences, National Institutes of Health Clinical Center, Room 1C515, Building 10, Bethesda, Maryland 20892-1182, USA
| | | | | | | |
Collapse
|
21
|
|
22
|
Leung KYE, Bosch JG. Automated border detection in three-dimensional echocardiography: principles and promises. EUROPEAN JOURNAL OF ECHOCARDIOGRAPHY 2010; 11:97-108. [PMID: 20139440 DOI: 10.1093/ejechocard/jeq005] [Citation(s) in RCA: 74] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Several automated border detection approaches for three-dimensional echocardiography have been developed in recent years, allowing quantification of a range of clinically important parameters. In this review, the background and principles of these approaches and the different classes of methods are described from a practical perspective, as well as the research trends to achieve a robust method.
Collapse
Affiliation(s)
- K Y Esther Leung
- Thoraxcenter Biomedical Engineering, Erasmus Medical Center, Rotterdam, The Netherlands
| | | |
Collapse
|
23
|
Ren M, Tian JW, Leng XP, Wang HM, Wang Y, Wang ZZ. Assessment of global and regional left ventricular function after surgical revascularization in patients with coronary artery disease by real-time triplane echocardiography. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2009; 28:1175-1184. [PMID: 19710215 DOI: 10.7863/jum.2009.28.9.1175] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
OBJECTIVE The purpose of this study was to evaluate the capability of real-time triplane echocardiography (RT3PE) for monitoring global and regional systolic function of the left ventricle (LV) after surgical revascularization and for evaluating the effect of surgery and predicting restenosis. METHODS Forty-nine patients underwent RT3PE before and at 10 days and 1, 3, and 6 months after coronary artery bypass grafting (CABG). The global systolic function of the LV was assessed with the parameters of end-diastolic volume (EDV), end-systolic volume (ESV), ejection fraction (EF), and stroke volume (SV). The regional myocardial deformation was detected by triplane strain rate imaging. Recovery of myocardial function after surgery and the correlation between global and regional function were investigated. RESULTS In 41 of the 49 patients, the EDV and ESV decreased, and the EF and SV increased gradually and showed statistical significance at 3 and 6 months after surgery (P < .05; P < .01). The systolic strain rate (SR(sys)) and systolic strain (S(sys)) increased, and the postsystolic strain index (PSI) decreased progressively after CABG, with significant changes in almost all studied segments at 6 months (P < .05; P < .01). In addition, recovery of the SR(sys), S(sys), and PSI at each follow-up stage after surgery correlated well with EF improvement, with a positive correlation between the SR(sys), S(sys), and EF and a negative correlation between the PSI and EF. Restenosis was suspected in the other 8 patients. The sensitivity, specificity, and accuracy of RT3PE to predict restenosis were 75.00%, 89.47%, and 85.19%, respectively. CONCLUSIONS Real-time triplane echocardiography can be used to quantitatively assess global and regional myocardial function. It may represent a new, powerful method to monitor improvement of myocardial function after CABG and to predict restenosis.
Collapse
Affiliation(s)
- Min Ren
- Department of Ultrasound, Second Affiliated Hospital of Harbin Medical University, China
| | | | | | | | | | | |
Collapse
|
24
|
Hansegård J, Urheim S, Lunde K, Malm S, Rabben SI. Semi-automated quantification of left ventricular volumes and ejection fraction by real-time three-dimensional echocardiography. Cardiovasc Ultrasound 2009; 7:18. [PMID: 19379479 PMCID: PMC2678991 DOI: 10.1186/1476-7120-7-18] [Citation(s) in RCA: 53] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/09/2009] [Accepted: 04/20/2009] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Recent studies have shown that real-time three-dimensional (3D) echocardiography (RT3DE) gives more accurate and reproducible left ventricular (LV) volume and ejection fraction (EF) measurements than traditional two-dimensional methods. A new semi-automated tool (4DLVQ) for volume measurements in RT3DE has been developed. We sought to evaluate the accuracy and repeatability of this method compared to a 3D echo standard. METHODS LV end-diastolic volumes (EDV), end-systolic volumes (ESV), and EF measured using 4DLVQ were compared with a commercially available semi-automated analysis tool (TomTec 4D LV-Analysis ver. 2.2) in 35 patients. Repeated measurements were performed to investigate inter- and intra-observer variability. RESULTS Average analysis time of the new tool was 141s, significantly shorter than 261s using TomTec (p < 0.001). Bland Altman analysis revealed high agreement of measured EDV, ESV, and EF compared to TomTec (p = NS), with bias and 95% limits of agreement of 2.1 +/- 21 ml, -0.88 +/- 17 ml, and 1.6 +/- 11% for EDV, ESV, and EF respectively. Intra-observer variability of 4DLVQ vs. TomTec was 7.5 +/- 6.2 ml vs. 7.7 +/- 7.3 ml for EDV, 5.5 +/- 5.6 ml vs. 5.0 +/- 5.9 ml for ESV, and 3.0 +/- 2.7% vs. 2.1 +/- 2.0% for EF (p = NS). The inter-observer variability of 4DLVQ vs. TomTec was 9.0 +/- 5.9 ml vs. 17 +/- 6.3 ml for EDV (p < 0.05), 5.0 +/- 3.6 ml vs. 12 +/- 7.7 ml for ESV (p < 0.05), and 2.7 +/- 2.8% vs. 3.0 +/- 2.1% for EF (p = NS). CONCLUSION In conclusion, the new analysis tool gives rapid and reproducible measurements of LV volumes and EF, with good agreement compared to another RT3DE volume quantification tool.
Collapse
|