Cardiac image segmentation from cine cardiac MRI using graph cuts and shape priors

A new method incorporating deep learning with shape priors for left ventricular segmentation in myocardial perfusion SPECT images

Accurate segmentation of the left ventricle (LV) is crucial for evaluating myocardial perfusion SPECT (MPS) and assessing LV functions. In this study, a novel method combining deep learning with shape priors was developed and validated to extract the LV myocardium and automatically measure LV functional parameters. The method integrates a three-dimensional (3D) V-Net with a shape deformation module that incorporates shape priors generated by a dynamic programming (DP) algorithm to guide its output during training. A retrospective analysis was performed on an MPS dataset comprising 31 subjects without or with mild ischemia, 32 subjects with moderate ischemia, and 12 subjects with severe ischemia. Myocardial contours were manually annotated as the ground truth. A 5-fold stratified cross-validation was used to train and validate the models. The clinical performance was evaluated by measuring LV end-systolic volume (ESV), end-diastolic volume (EDV), left ventricular ejection fraction (LVEF), and scar burden from the extracted myocardial contours. There were excellent agreements between segmentation results by our proposed model and those from the ground truth, with a Dice similarity coefficient (DSC) of 0.9573 ± 0.0244, 0.9821 ± 0.0137, and 0.9903 ± 0.0041, as well as Hausdorff distances (HD) of 6.7529 ± 2.7334 mm, 7.2507 ± 3.1952 mm, and 7.6121 ± 3.0134 mm in extracting the LV endocardium, myocardium, and epicardium, respectively. Furthermore, the correlation coefficients between LVEF, ESV, EDV, stress scar burden, and rest scar burden measured from our model results and the ground truth were 0.92, 0.958, 0.952, 0.972, and 0.958, respectively. The proposed method achieved a high accuracy in extracting LV myocardial contours and assessing LV functions.

Left ventricle segmentation combining deep learning and deformable models with anatomical constraints

Segmentation of the left ventricle is a key approach in Cardiac Magnetic Resonance Imaging for calculating biomarkers in diagnosis. Since there is substantial effort required from the expert, many automatic segmentation methods have been proposed, in which deep learning networks have obtained remarkable performance. However, one of the main limitations of these approaches is the production of segmentations that contain anatomical errors. To avoid this limitation, we propose a new fully-automatic left ventricle segmentation method combining deep learning and deformable models. We propose a new level set energy formulation that includes exam-specific information estimated from the deep learning segmentation and shape constraints. The method is part of a pipeline containing pre-processing steps and a failure correction post-processing step. Experiments were conducted with the Sunnybrook and ACDC public datasets, and a private dataset. Results suggest that the method is competitive, that it can produce anatomically consistent segmentations, has good generalization ability, and is often able to estimate biomarkers close to the expert.

Left ventricle segmentation using a Bayesian approach with distance dependent shape priors

We propose a method for segmentation of the left ventricle in magnetic resonance cardiac images. The framework consists of an initial Bayesian segmentation of the central slice of the volume. This segmentation is used to locate a shape prior for the LV myocardial tissue. This shape prior is determined using the fact that the myocardium is approximately annular as seen in the short-axis. Then a second Bayesian segmentation is performed to obtain the final result. This procedure is repeated for the rest of the slices. An extrapolation of the area of the LV is used to determine a stopping criterion. The method was evaluated on the databases of the Cardiac Atlas project. Our results demonstrate a suitable accuracy for myocardial segmentation (≈0.8 Dice's coefficient). For the endocardium and the epicardium the Dice's coefficients are 0.94 and 0.9 respectively. The accuracy was also evaluated in terms of the Hausdorff distance and the average distance. For the myocardium we obtain 8 mm and 2 mm respectively. Our results demonstrate the capability and merits of the proposed method to estimate the structure of the LV. The method requires minimal user input and generates results with quality comparable to more complex approaches. This paper suggests a new efficient approach for automatic LV quantification based on a Bayesian technique with shape priors with errors comparable to state-of-the-art techniques.

Cardiac image segmentation using generalized polynomial chaos expansion and level set function

Cardiovascular Magnetic Resonance (CMR) images involves a great amount of uncertainties. Such uncertainties may originate from either intrinsic measurement limitations or heterogeneities among patients. Without properly considering these uncertainties, image analysis may provide inaccurate estimations of cardiac functions, and ultimately lead to false diagnosis and inappropriate treatment strategy. In this work, a stochastic image segmentation algorithm is developed to separate cardiac chambers from the background of CMR images. To account for noise and uncertainties in pixel values, a generalized polynomial chaos (gPC) expansion is integrated with a level set function to dynamically evolve boundaries of cardiac chambers. Two consecutive steps are developed: a deterministic segmentation to identify an immediate neighborhood of boundary, of which pixel values are used to calibrate the gPC model; and a stochastic segmentation applied to the neighborhood region to evolve boundaries of cardiac chambers in a stochastic manner. The proposed method can provide a probabilistic description of the segmented heart boundary, which will greatly improve the reliability of image analysis, and potentially enhanced cardiac function evaluation.

Investigation of random walks knee cartilage segmentation model using inter-observer reproducibility: Data from the osteoarthritis initiative

BACKGROUND

Existing knee cartilage segmentation methods have reported several technical drawbacks. In essence, graph cuts remains highly susceptible to image noise despite extended research interest; active shape model is often constraint by the selection of training data while shortest path have demonstrated shortcut problem in the presence of weak boundary, which is a common problem in medical images.

OBJECTIVES

The aims of this study is to investigate the capability of random walks as knee cartilage segmentation method.

METHODS

Experts would scribble on knee cartilage image to initialize random walks segmentation. Then, reproducibility of the method is assessed against manual segmentation by using Dice Similarity Index. The evaluation consists of normal cartilage and diseased cartilage sections which is divided into whole and single cartilage categories.

RESULTS

A total of 15 normal images and 10 osteoarthritic images were included. The results showed that random walks method has demonstrated high reproducibility in both normal cartilage (observer 1: 0.83±0.028 and observer 2: 0.82±0.026) and osteoarthritic cartilage (observer 1: 0.80±0.069 and observer 2: 0.83±0.029). Besides, results from both experts were found to be consistent with each other, suggesting the inter-observer variation is insignificant (Normal: P=0.21; Diseased: P=0.15).

CONCLUSION

The proposed segmentation model has overcame technical problems reported by existing semi-automated techniques and demonstrated highly reproducible and consistent results against manual segmentation method.

A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging

Cardiovascular magnetic resonance (CMR) has become a key imaging modality in clinical cardiology practice due to its unique capabilities for non-invasive imaging of the cardiac chambers and great vessels. A wide range of CMR sequences have been developed to assess various aspects of cardiac structure and function, and significant advances have also been made in terms of imaging quality and acquisition times. A lot of research has been dedicated to the development of global and regional quantitative CMR indices that help the distinction between health and pathology. The goal of this review paper is to discuss the structural and functional CMR indices that have been proposed thus far for clinical assessment of the cardiac chambers. We include indices definitions, the requirements for the calculations, exemplar applications in cardiovascular diseases, and the corresponding normal ranges. Furthermore, we review the most recent state-of-the art techniques for the automatic segmentation of the cardiac boundaries, which are necessary for the calculation of the CMR indices. Finally, we provide a detailed discussion of the existing literature and of the future challenges that need to be addressed to enable a more robust and comprehensive assessment of the cardiac chambers in clinical practice.

Automatic computation of left ventricular volume changes over a cardiac cycle from echocardiography images by nonlinear dimensionality reduction

Curve of left ventricular (LV) volume changes throughout the cardiac cycle is a fundamental parameter for clinical evaluation of various cardiovascular diseases. Currently, this evaluation is often performed manually which is tedious and time consuming and suffers from significant interobserver and intraobserver variability. This paper introduces a new automatic method, based on nonlinear dimensionality reduction (NLDR) for extracting the curve of the LV volume changes over a cardiac cycle from two-dimensional (2-D) echocardiography images. Isometric feature mapping (Isomap) is one of the most popular NLDR algorithms. In this study, a modified version of Isomap algorithm, where image to image distance metric is computed using nonrigid registration, is applied on 2-D echocardiography images of one cycle of heart. Using this approach, the nonlinear information of these images is embedded in a 2-D manifold and each image is characterized by a symbol on the constructed manifold. This new representation visualizes the relationship between these images based on LV volume changes and allows extracting the curve of the LV volume changes automatically. Our method in comparison to the traditional segmentation algorithms does not need any LV myocardial segmentation and tracking, particularly difficult in the echocardiography images. Moreover, a large data set under various diseases for training is not required. The results obtained by our method are quantitatively evaluated to those obtained manually by the highly experienced echocardiographer on ten healthy volunteers and six patients which depict the usefulness of the presented method.

Automatic cardiac segmentation using semantic information from random forests

We propose a fully automated method for segmenting the cardiac right ventricle (RV) from magnetic resonance (MR) images. Given a MR test image, it is first oversegmented into superpixels and each superpixel is analyzed to detect the presence of RV regions using random forest (RF) classifiers. The superpixels containing RV regions constitute the region of interest (ROI) which is used to segment the actual RV. Probability maps are generated for each ROI pixel using a second set of RF classifiers which give the probabilities of each pixel belonging to RV or background. The negative log-likelihood of these maps are used as penalty costs in a graph cut segmentation framework. Low-level features like intensity statistics, texture anisotropy and curvature asymmetry, and high level context features are used at different stages. Smoothness constraints are imposed based on semantic information (importance of each feature to the classification task) derived from the second set of learned RF classifiers. Experimental results show that compared to conventional method our algorithm achieves superior performance due to the inclusion of semantic knowledge and context information.

Cardiac MRI segmentation using mutual context information from left and right ventricle

In this paper, we propose a graphcut method to segment the cardiac right ventricle (RV) and left ventricle (LV) by using context information from each other. Contextual information is very helpful in medical image segmentation because the relative arrangement of different organs is the same. In addition to the conventional log-likelihood penalty, we also include a "context penalty" that captures the geometric relationship between the RV and LV. Contextual information for the RV is obtained by learning its geometrical relationship with respect to the LV. Similarly, RV provides geometrical context information for LV segmentation. The smoothness cost is formulated as a function of the learned context which helps in accurate labeling of pixels. Experimental results on real patient datasets from the STACOM database show the efficacy of our method in accurately segmenting the LV and RV. We also conduct experiments on simulated datasets to investigate our method's robustness to noise and inaccurate segmentations.