Interactive Hierarchical-Flow Segmentation of Scar Tissue From Late-Enhancement Cardiac MR Images

Deep learning for automatic volumetric segmentation of left ventricular myocardium and ischaemic scar from multi-slice late gadolinium enhancement cardiovascular magnetic resonance

AIMS

This study details application of deep learning for automatic volumetric segmentation of left ventricular (LV) myocardium and scar and automated quantification of myocardial ischaemic scar burden from late gadolinium enhancement cardiovascular magnetic resonance (LGE-CMR).

METHODS AND RESULTS

We included 501 images and manual segmentations of short-axis LGE-CMR from over 20 multinational sites, from which 377 studies were used for training and 124 studies from unique participants for internal validation. A third test set of 52 images was used for external evaluation. Three models, U-Net, Cascaded U-Net, and U-Net++, were trained with a novel adaptive weighted categorical cross-entropy loss function. Model performance was evaluated using concordance correlation coefficients (CCCs) for LV mass and per cent myocardial scar burden. Cascaded U-Net was found to be the best model for the quantification of LV mass and scar percentage. The model exhibited a mean difference of -5 ± 23 g for LV mass, -0.4 ± 11.2 g for scar mass, and -0.8 ± 7% for per cent scar. CCC were 0.87, 0.77, and 0.78 for LV mass, scar mass, and per cent scar burden, respectively, in the internal validation set and 0.75, 0.71, and 0.69, respectively, in the external test set. For segmental scar mass, CCC was 0.74 for apical scar, 0.91 for mid-ventricular scar, and 0.73 for basal scar, demonstrating moderate to strong agreement.

CONCLUSION

We successfully trained a convolutional neural network for volumetric segmentation and analysis of LV scar burden from LGE-CMR images in a large, multinational cohort of participants with ischaemic scar.

To predict the left ventricular endocardial scar tissue pattern using Radon descriptor-based machine learning

OBJECTIVE

Scar tissue is an identified cause for the development of malignant ventricular arrhythmias in patients of myocardial infarction, which ultimately leads to cardiac death, a fatal outcome. We aim to evaluate the left ventricular endocardial Scar tissue pattern using Radon descriptor-based machine learning. We performed automated Left ventricle (LV) segmentation to find the LV endocardial wall, performed morphological operations, and marked the region of the scar tissue on the endocardial wall of LV. Motivated by a Radon descriptor-based machine learning approach; the patches of 17 patients from Computer tomography (CT) images of the heart were used and categorized into "endocardial Scar tissue" and "normal tissue" groups. The ten feature vectors are extracted from patches using Radon descriptors and fed into a traditional machine learning model.

RESULTS

The decision tree has shown the best performance with 98.07% accuracy. This study is the first attempt to provide a Radon transform-based machine learning method to distinguish patterns between "endocardial Scar tissue" and "normal tissue" groups. Our proposed research method could be potentially used in advanced interventions.

Classification of myocardial fibrosis in DE-MRI based on semi-supervised semantic segmentation and dual attention mechanism

OBJECTIVE

It is essential to utilize cardiac delayed-enhanced magnetic resonance imaging (DE-MRI) to diagnose cardiovascular disease. By segmenting myocardium DE-MRI images, it provides critical information for the evaluation and treatment of myocardial infarction. As a consequence, it is vital to investigate the segmentation and classification technique of myocardial DE-MRI.

METHODS

Firstly, an end-to-end minimally supervised and semi-supervised semantic DE-MRI myocardial fibrosis segmentation framework is proposed, which combines image classification and semantic segmentation branches based on the self-attention mechanism. Following that, a residual hole network fused with the dual attention mechanism was built, and a double attention metabolic pathway classification method for cardiac fibrosis in DE-MRI images was developed.

RESULTS

By adding pixel-level labels to an extra 40 training images, the segmentation model may enhance semantic segmentation performance by 2.6 percent (from 61.2 percent to 63.8 percent). When the number of pixel-level labels is increased to 80, semi-supervised feature extraction increases by 4.7 percent when compared to weakly guided semantic segmentation. Adding an attention mechanism to the critical network DRN (Deep Residual Network) can increase the classifier's performance by a small amount. Experiments revealed that the models worked effectively.

CONCLUSION

This paper investigates the segmentation and classification of cardiac fibrosis in DE-MRI data using a semi-supervised semantic segmentation and dual attention mechanism, dealing with the issue that existing segmentation algorithms have difficulty segmenting myocardial fibrosis tissue. In the future, we can consider optimizing the design of the attention module to reduce the module computation.

Diagnostic utility of artificial intelligence for left ventricular scar identification using cardiac magnetic resonance imaging-A systematic review

Background

Accurate, rapid quantification of ventricular scar using cardiac magnetic resonance imaging (CMR) carries importance in arrhythmia management and patient prognosis. Artificial intelligence (AI) has been applied to other radiological challenges with success.

Objective

We aimed to assess AI methodologies used for left ventricular scar identification in CMR, imaging sequences used for training, and its diagnostic evaluation.

Methods

Following PRISMA recommendations, a systematic search of PubMed, Embase, Web of Science, CINAHL, OpenDissertations, arXiv, and IEEE Xplore was undertaken to June 2021 for full-text publications assessing left ventricular scar identification algorithms. No pre-registration was undertaken. Random-effect meta-analysis was performed to assess Dice Coefficient (DSC) overlap of learning vs predefined thresholding methods.

Results

Thirty-five articles were included for final review. Supervised and unsupervised learning models had similar DSC compared to predefined threshold models (0.616 vs 0.633, P = .14) but had higher sensitivity, specificity, and accuracy. Meta-analysis of 4 studies revealed standardized mean difference of 1.11; 95% confidence interval -0.16 to 2.38, P = .09, I² = 98% favoring learning methods.

Conclusion

Feasibility of applying AI to the task of scar detection in CMR has been demonstrated, but model evaluation remains heterogenous. Progression toward clinical application requires detailed, transparent, standardized model comparison and increased model generalizability.

Myocardial Infarction Quantification from Late Gadolinium Enhancement MRI Using Top-Hat Transforms and Neural Networks

Late gadolinium enhancement (LGE) MRI is the gold standard technique for myocardial viability assessment. Although the technique accurately reflects the damaged tissue, there is no clinical standard to quantify myocardial infarction (MI). Moreover, commercial software used in clinical practice are mostly semi-automatic, and hence require direct intervention of experts. In this work, a new automatic method for MI quantification from LGE-MRI is proposed. Our novel segmentation approach is devised for accurately detecting not only hyper-enhanced lesions, but also microvascular obstruction areas. Moreover, it includes a myocardial disease detection step which extends the algorithm for working under healthy scans. The method is based on a cascade approach where firstly, diseased slices are identified by a convolutional neural network (CNN). Secondly, by means of morphological operations a fast coarse scar segmentation is obtained. Thirdly, the segmentation is refined by a boundary-voxel reclassification strategy using an ensemble of very light CNNs. We tested the method on a LGE-MRI database with healthy (n = 20) and diseased (n = 80) cases following a 5-fold cross-validation scheme. Our approach segmented myocardial scars with an average Dice coefficient of 77.22 ± 14.3% and with a volumetric error of 1.0 ± 6.9 cm3. In a comparison against nine reference algorithms, the proposed method achieved the highest agreement in volumetric scar quantification with the expert delineations (p< 0.001 when compared to the other approaches). Moreover, it was able to reproduce the scar segmentation intra- and inter-rater variability. Our approach was shown to be a good first attempt towards automatic and accurate myocardial scar segmentation, although validation over larger LGE-MRI databases is needed.

Reproducibility of clinical late gadolinium enhancement magnetic resonance imaging in detecting left atrial scar after atrial fibrillation ablation

INTRODUCTION

Late gadolinium enhancement (LGE) cardiac magnetic resonance imaging (MRI) can be used to detect postablation atrial scar (PAAS) but its reproducibility and reliability in clinical scans across different magnetic flux densities and scar detection methods are unknown.

METHODS

Patients (n = 45) having undergone two consecutive MRIs (3 months apart) on 3T and 1.5T scanners were studied. We compared PAAS detection reproducibility using four methods of thresholding: simple thresholding, Otsu thresholding, 3.3 standard deviations (SD) above blood pool (BP) mean intensity, and image intensity ratio (IIR). We performed a texture study by dividing the left atrial wall intensity histogram into deciles and evaluated the correlation of the same decile of the two scans as well as to a randomized distribution of intensities, quantified using Dice Similarity Coefficient (DSC).

RESULTS

The choice of scanner did not significantly affect the reproducibility. The scar detection performed by Otsu thresholding (DSC of 71.26 ± 8.34) resulted in a better correlation of the two scans compared with the methods of 3.3 SD above BP mean intensity (DSC of 57.78 ± 21.2, p < .001) and IIR above 1.61 (DSC of 45.76 ± 29.55, p <.001). Texture analysis showed that correlation only for voxels with intensities in deciles above the 70th percentile of wall intensity histogram was better than random distribution (p < .001).

CONCLUSIONS

Our results demonstrate that clinical LGE-MRI can be reliably used for visualizing PAAS across different magnetic flux densities if the threshold is greater than 70th percentile of the wall intensity distribution. Also, atrial wall-based thresholding is better than BP-based thresholding for reproducible PAAS detection.

Machine Learning-Based Segmentation of Left Ventricular Myocardial Fibrosis from Magnetic Resonance Imaging

PURPOSE OF REVIEW

Myocardial fibrosis (MF) arises due to myocardial infarction and numerous cardiac diseases. MF may lead to several heart disorders, such as heart failure, arrhythmias, and ischemia. Cardiac magnetic resonance (CMR) imaging techniques, such as late gadolinium enhancement (LGE) CMR, enable non-invasive assessment of MF in the left ventricle (LV). Manual assessment of MF on CMR is a tedious and time-consuming task that is subject to high observer variability. Automated segmentation and quantification of MF is important for risk stratification and treatment planning in patients with heart disorders. This article aims to review the machine learning (ML)-based methodologies developed for MF quantification in the LV using CMR images.

RECENT FINDINGS

With the availability of relatively large labeled datasets supervised learning methods based on both conventional ML and state-of-the-art deep learning (DL) methods have been successfully applied for automated segmentation of MF. The incorporation of ML algorithms into imaging techniques such as 3D LGE CMR permits fast characterization of MF on CMR imaging and may enhance the diagnosis and prognosis of patients with heart disorders. Concurrently, the studies using cine CMR images have revealed that accurate segmentation of MF on non-contrast CMR imaging might be possible. The application of ML/DL tools in CMR image interpretation is likely to result in accurate and efficient quantification of MF.

Multivariate Mixture Model for Myocardial Segmentation Combining Multi-Source Images

The author proposes a method for simultaneous registration and segmentation of multi-source images, using the multivariate mixture model (MvMM) and maximum of log-likelihood (LL) framework. Specifically, the method is applied to the problem of myocardial segmentation combining the complementary information from multi-sequence (MS) cardiac magnetic resonance (CMR) images. For the image misalignment and incongruent data, the MvMM is formulated with transformations and is further generalized for dealing with the hetero-coverage multi-modality images (HC-MMIs). The segmentation of MvMM is performed in a virtual common space, to which all the images and misaligned slices are simultaneously registered. Furthermore, this common space can be divided into a number of sub-regions, each of which contains congruent data, thus the HC-MMIs can be modeled using a set of conventional MvMMs. Results show that MvMM obtained significantly better performance compared to the conventional approaches and demonstrated good potential for scar quantification as well as myocardial segmentation. The generalized MvMM has also demonstrated better robustness in the incongruent data, where some images may not fully cover the region of interest, and the full coverage can only be reconstructed combining the images from multiple sources.

An Efficient Melanoma Diagnosis Approach Using Integrated HMF Multi-Atlas Map Based Segmentation

Melanoma is a life threading disease when it grows outside the corium layer of the skin. Mortality rates of the Melanoma cases are maximum among the skin cancer patients. The cost required for the treatment of advanced melanoma cases is very high and the survival rate is low. Numerous computerized dermoscopy systems are developed based on the combination of shape, texture and color features to facilitate early diagnosis of melanoma. The availability and cost of the dermoscopic imaging system is still an issue. To mitigate this issue, this paper presented an integrated segmentation and Third Dimensional (3D) feature extraction approach for the accurate diagnosis of melanoma. A multi-atlas method is applied for the image segmentation. The patch-based label fusion model is expressed in a Bayesian framework to improve the segmentation accuracy. A depth map is obtained from the Two-dimensional (2D) dermoscopic image for reconstructing the 3D skin lesion represented as structure tensors. The 3D shape features including the relative depth features are obtained. Streaks are the significant morphological terms of the melanoma in the radial growth phase. The proposed method yields maximum segmentation accuracy, sensibility, specificity and minimum cost function than the existing segmentation technique and classifier.

Convolutional neural network-based approach for segmentation of left ventricle myocardial scar from 3D late gadolinium enhancement MR images

PURPOSE

Accurate three-dimensional (3D) segmentation of myocardial replacement fibrosis (i.e., scar) is emerging as a potentially valuable tool for risk stratification and procedural planning in patients with ischemic cardiomyopathy. The main purpose of this study was to develop a semiautomated method using a 3D convolutional neural network (CNN)-based for the segmentation of left ventricle (LV) myocardial scar from 3D late gadolinium enhancement magnetic resonance (LGE-MR) images.

METHODS

Our proposed CNN is built upon several convolutional and pooling layers aimed at choosing appropriate features from LGE-MR images to distinguish between myocardial scar and healthy tissues of the left ventricle. In contrast to previous methods that consider image intensity as the sole feature, CNN-based algorithms have the potential to improve the accuracy of scar segmentation through the creation of unconventional features that separate scar from normal myocardium in the feature space. The first step of our pipeline was to manually delineate the left ventricular myocardium, which was used as the region of interest for scar segmentation. Our developed algorithm was trained using 265,220 volume patches extracted from ten 3D LGE-MR images, then was validated on 450,454 patches from a testing dataset of 24 3D LGE-MR images, all obtained from patients with chronic myocardial infarction. We evaluated our method in the context of several alternative methods by comparing algorithm-generated segmentations to manual delineations performed by experts.

RESULTS

Our CNN-based method reported an average Dice similarity coefficient (DSC) and Jaccard Index (JI) of 93.63% ± 2.6% and 88.13% ± 4.70%. In comparison to several previous methods, including K-nearest neighbor (KNN), hierarchical max flow (HMF), full width at half maximum (FWHM), and signal threshold to reference mean (STRM), the developed algorithm reported significantly higher accuracy for DSC with a P-value less than 0.0001.

CONCLUSIONS

Our experimental results demonstrated that our CNN-based proposed method yielded the highest accuracy of all contemporary LV myocardial scar segmentation methodologies, inclusive of the most widely used signal intensity-based methods, such as FWHM and STRM. To our knowledge, this is the first description of LV myocardial scar tissue segmentation from 3D LGE-MR images using a CNN-based method.

Myocardium Segmentation From DE MRI Using Multicomponent Gaussian Mixture Model and Coupled Level Set

Objective: In this paper, we propose a fully automatic framework for myocardium segmentation of delayed-enhancement (DE) MRI images without relying on prior patient-specific information. Methods: We employ a multicomponent Gaussian mixture model to deal with the intensity heterogeneity of myocardium caused by the infarcts. To differentiate the myocardium from other tissues with similar intensities, while at the same time maintain spatial continuity, we introduce a coupled level set (CLS) to regularize the posterior probability. The CLS, as a spatial regularization, can be adapted to the image characteristics dynamically. We also introduce an image intensity gradient based term into the CLS, adding an extra force to the posterior probability based framework, to improve the accuracy of myocardium boundary delineation. The prebuilt atlases are propagated to the target image to initialize the framework. Results: The proposed method was tested on datasets of 22 clinical cases, and achieved Dice similarity coefficients of 87.43 ± 5.62% (endocardium), 90.53 ± 3.20% (epicardium) and 73.58 ± 5.58% (myocardium), which have outperformed three variants of the classic segmentation methods. Conclusion: The results can provide a benchmark for the myocardial segmentation in the literature. Significance: DE MRI provides an important tool to assess the viability of myocardium. The accurate segmentation of myocardium, which is a prerequisite for further quantitative analysis of myocardial infarction (MI) region, can provide important support for the diagnosis and treatment management for MI patients.Objective: In this paper, we propose a fully automatic framework for myocardium segmentation of delayed-enhancement (DE) MRI images without relying on prior patient-specific information. Methods: We employ a multicomponent Gaussian mixture model to deal with the intensity heterogeneity of myocardium caused by the infarcts. To differentiate the myocardium from other tissues with similar intensities, while at the same time maintain spatial continuity, we introduce a coupled level set (CLS) to regularize the posterior probability. The CLS, as a spatial regularization, can be adapted to the image characteristics dynamically. We also introduce an image intensity gradient based term into the CLS, adding an extra force to the posterior probability based framework, to improve the accuracy of myocardium boundary delineation. The prebuilt atlases are propagated to the target image to initialize the framework. Results: The proposed method was tested on datasets of 22 clinical cases, and achieved Dice similarity coefficients of 87.43 ± 5.62% (endocardium), 90.53 ± 3.20% (epicardium) and 73.58 ± 5.58% (myocardium), which have outperformed three variants of the classic segmentation methods. Conclusion: The results can provide a benchmark for the myocardial segmentation in the literature. Significance: DE MRI provides an important tool to assess the viability of myocardium. The accurate segmentation of myocardium, which is a prerequisite for further quantitative analysis of myocardial infarction (MI) region, can provide important support for the diagnosis and treatment management for MI patients.

Joint segmentation of bones and muscles using an intensity and histogram-based energy minimization approach

BACKGROUND AND OBJECTIVES

The segmentation of muscle and bone structures in CT is of interest to physicians and surgeons for surgical planning, disease diagnosis and/or the analysis of fractures or bone/muscle densities. Recently, the issue has been addressed in many research works. However, most studies have focused on only one of the two tissues and on the segmentation of one particular bone or muscle. This work addresses the segmentation of muscle and bone structures in 3D CT volumes.

METHODS

The proposed bone and muscle segmentation algorithm is based on a three-label convex relaxation approach. The main novelty is that the proposed energy function to be minimized includes distance to histogram models of bone and muscle structures combined with gray-level information.

RESULTS

27 CT volumes corresponding to different sections from 20 different patients were manually segmented and used as ground-truth for training and evaluation purposes. Different metrics (Dice index, Jaccard index, Sensitivity, Specificity, Positive Predictive Value, accuracy and computational cost) were computed and compared with those used in some state-of-the art algorithms. The proposed algorithm outperformed the other methods, obtaining a Dice coefficient of 0.88 ± 0.14, a Jaccard index of 0.80 ± 0.19, a Sensitivity of 0.94 ± 0.15 and a Specificity of 0.95 ± 0.04 for bone segmentation, and 0.78 ± 0.12, 0.65 ± 0.16, 0.94 ± 0.04 and 0.95 ± 0.04 for muscle tissue.

CONCLUSIONS

A fast, generalized method has been presented for segmenting muscle and bone structures in 3D CT volumes using a multilabel continuous convex relaxation approach. The results obtained show that the proposed algorithm outperforms some state-of-the art methods. The algorithm will help physicians and surgeons in surgical planning, disease diagnosis and/or the analysis of fractures or bone/muscle densities.

Three-dimensional continuous max flow optimization-based serous retinal detachment segmentation in SD-OCT for central serous chorioretinopathy

Assessment of serous retinal detachment plays an important role in the diagnosis of central serous chorioretinopathy (CSC). In this paper, we propose an automatic, three-dimensional segmentation method to detect both neurosensory retinal detachment (NRD) and pigment epithelial detachment (PED) in spectral domain optical coherence tomography (SD-OCT) images. The proposed method involves constructing a probability map from training samples using random forest classification. The probability map is constructed from a linear combination of structural texture, intensity, and layer thickness information. Then, a continuous max flow optimization algorithm is applied to the probability map to segment the retinal detachment-associated fluid regions. Experimental results from 37 retinal SD-OCT volumes from cases of CSC demonstrate the proposed method can achieve a true positive volume fraction (TPVF), false positive volume fraction (FPVF), positive predicative value (PPV), and dice similarity coefficient (DSC) of 92.1%, 0.53%, 94.7%, and 93.3%, respectively, for NRD segmentation and 92.5%, 0.14%, 80.9%, and 84.6%, respectively, for PED segmentation. The proposed method can be an automatic tool to evaluate serous retinal detachment and has the potential to improve the clinical evaluation of CSC.

Longitudinal Analysis of Pre-Term Neonatal Cerebral Ventricles From 3D Ultrasound Images Using Spatial-Temporal Deformable Registration

Preterm neonates with a very low birth weight of less than 1,500 grams are at increased risk for developing intraventricular hemorrhage (IVH), which is a major cause of brain injury in preterm neonates. Quantitative measurements of ventricular dilatation or shrinkage play an important role in monitoring patients and evaluating treatment options. 3D ultrasound (US) has been developed to monitor ventricle volume as a biomarker for ventricular changes. However, ventricle volume as a global indicator does not allow for precise analysis of local ventricular changes, which could be linked to specific neurological problems often seen in the patient population later in life. In this work, a 3D+t spatial-temporal deformable registration approachis proposed, which is applied to the analysis of the detailed local changes of preterm IVH neonatal ventricles from 3D US images. In particular, a novel sequential convex/dual optimization algorithm is introduced to extract the optimal 3D+t spatial-temporal deformable field, which simultaneously optimizes the sequence of 3D deformation fieldswhile enjoying both efficiencyand simplicity in numerics. The developed registration technique was evaluated by comparing two manually extracted ventricle surfaces from the baseline and the registered follow-up images using the metrics of Dice similarity coefficient (DSC), mean absolute surface distance (MAD), and maximum absolute surface distance (MAXD). The performed experiments using 14 patients with 5 time-point images per patient show that the proposed 3D+t registration approach accurately recovered the longitudinal deformation of ventricle surfaces from 3D US images. The proposed approach may be potentially used to analyse the change pattern of cerebral ventricles of IVH patients, their response to different treatment options, and to elucidate the deficiencies that a patient could have later in life. To the best of our knowledge, this paper reports the first study on the longitudinalanalysis of neonatal ventricular system from 3D US images.

DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks

In this paper, we propose DeepCut, a method to obtain pixelwise object segmentations given an image dataset labelled weak annotations, in our case bounding boxes. It extends the approach of the well-known GrabCut [1] method to include machine learning by training a neural network classifier from bounding box annotations. We formulate the problem as an energy minimisation problem over a densely-connected conditional random field and iteratively update the training targets to obtain pixelwise object segmentations. Additionally, we propose variants of the DeepCut method and compare those to a naïve approach to CNN training under weak supervision. We test its applicability to solve brain and lung segmentation problems on a challenging fetal magnetic resonance dataset and obtain encouraging results in terms of accuracy.

Optimization-based interactive segmentation interface for multiregion problems

Interactive segmentation is becoming of increasing interest to the medical imaging community in that it combines the positive aspects of both manual and automated segmentation. However, general-purpose tools have been lacking in terms of segmenting multiple regions simultaneously with a high degree of coupling between groups of labels. Hierarchical max-flow segmentation has taken advantage of this coupling for individual applications, but until recently, these algorithms were constrained to a particular hierarchy and could not be considered general-purpose. In a generalized form, the hierarchy for any given segmentation problem is specified in run-time, allowing different hierarchies to be quickly explored. We present an interactive segmentation interface, which uses generalized hierarchical max-flow for optimization-based multiregion segmentation guided by user-defined seeds. Applications in cardiac and neonatal brain segmentation are given as example applications of its generality.

Myocardial Infarct Segmentation From Magnetic Resonance Images for Personalized Modeling of Cardiac Electrophysiology

Accurate representation of myocardial infarct geometry is crucial to patient-specific computational modeling of the heart in ischemic cardiomyopathy. We have developed a methodology for segmentation of left ventricular (LV) infarct from clinically acquired, two-dimensional (2D), late-gadolinium enhanced cardiac magnetic resonance (LGE-CMR) images, for personalized modeling of ventricular electrophysiology. The infarct segmentation was expressed as a continuous min-cut optimization problem, which was solved using its dual formulation, the continuous max-flow (CMF). The optimization objective comprised of a smoothness term, and a data term that quantified the similarity between image intensity histograms of segmented regions and those of a set of training images. A manual segmentation of the LV myocardium was used to initialize and constrain the developed method. The three-dimensional geometry of infarct was reconstructed from its segmentation using an implicit, shape-based interpolation method. The proposed methodology was extensively evaluated using metrics based on geometry, and outcomes of individualized electrophysiological simulations of cardiac dys(function). Several existing LV infarct segmentation approaches were implemented, and compared with the proposed method. Our results demonstrated that the CMF method was more accurate than the existing approaches in reproducing expert manual LV infarct segmentations, and in electrophysiological simulations. The infarct segmentation method we have developed and comprehensively evaluated in this study constitutes an important step in advancing clinical applications of personalized simulations of cardiac electrophysiology.

Image-based reconstruction of three-dimensional myocardial infarct geometry for patient-specific modeling of cardiac electrophysiology

PURPOSE

Accurate three-dimensional (3D) reconstruction of myocardial infarct geometry is crucial to patient-specific modeling of the heart aimed at providing therapeutic guidance in ischemic cardiomyopathy. However, myocardial infarct imaging is clinically performed using two-dimensional (2D) late-gadolinium enhanced cardiac magnetic resonance (LGE-CMR) techniques, and a method to build accurate 3D infarct reconstructions from the 2D LGE-CMR images has been lacking. The purpose of this study was to address this need.

METHODS

The authors developed a novel methodology to reconstruct 3D infarct geometry from segmented low-resolution (Lo-res) clinical LGE-CMR images. Their methodology employed the so-called logarithm of odds (LogOdds) function to implicitly represent the shape of the infarct in segmented image slices as LogOdds maps. These 2D maps were then interpolated into a 3D image, and the result transformed via the inverse of LogOdds to a binary image representing the 3D infarct geometry. To assess the efficacy of this method, the authors utilized 39 high-resolution (Hi-res) LGE-CMR images, including 36 in vivo acquisitions of human subjects with prior myocardial infarction and 3 ex vivo scans of canine hearts following coronary ligation to induce infarction. The infarct was manually segmented by trained experts in each slice of the Hi-res images, and the segmented data were downsampled to typical clinical resolution. The proposed method was then used to reconstruct 3D infarct geometry from the downsampled images, and the resulting reconstructions were compared with the manually segmented data. The method was extensively evaluated using metrics based on geometry as well as results of electrophysiological simulations of cardiac sinus rhythm and ventricular tachycardia in individual hearts. Several alternative reconstruction techniques were also implemented and compared with the proposed method.

RESULTS

The accuracy of the LogOdds method in reconstructing 3D infarct geometry, as measured by the Dice similarity coefficient, was 82.10% ± 6.58%, a significantly higher value than those of the alternative reconstruction methods. Among outcomes of electrophysiological simulations with infarct reconstructions generated by various methods, the simulation results corresponding to the LogOdds method showed the smallest deviation from those corresponding to the manual reconstructions, as measured by metrics based on both activation maps and pseudo-ECGs.

CONCLUSIONS

The authors have developed a novel method for reconstructing 3D infarct geometry from segmented slices of Lo-res clinical 2D LGE-CMR images. This method outperformed alternative approaches in reproducing expert manual 3D reconstructions and in electrophysiological simulations.

Three-dimensional segmentation of retroperitoneal masses using continuous convex relaxation and accumulated gradient distance for radiotherapy planning

An innovative algorithm has been developed for the segmentation of retroperitoneal tumors in 3D radiological images. This algorithm makes it possible for radiation oncologists and surgeons semiautomatically to select tumors for possible future radiation treatment and surgery. It is based on continuous convex relaxation methodology, the main novelty being the introduction of accumulated gradient distance, with intensity and gradient information being incorporated into the segmentation process. The algorithm was used to segment 26 CT image volumes. The results were compared with manual contouring of the same tumors. The proposed algorithm achieved 90 % sensitivity, 100 % specificity and 84 % positive predictive value, obtaining a mean distance to the closest point of 3.20 pixels. The algorithm's dependence on the initial manual contour was also analyzed, with results showing that the algorithm substantially reduced the variability of the manual segmentation carried out by different specialists. The algorithm was also compared with four benchmark algorithms (thresholding, edge-based level-set, region-based level-set and continuous max-flow with two labels). To the best of our knowledge, this is the first time the segmentation of retroperitoneal tumors for radiotherapy planning has been addressed.

Nested Graph Cut for Automatic Segmentation of High-Frequency Ultrasound Images of the Mouse Embryo

We propose a fully automatic segmentation method called nested graph cut to segment images (2D or 3D) that contain multiple objects with a nested structure. Compared to other graph-cut-based methods developed for multiple regions, our method can work well for nested objects without requiring manual selection of initial seeds, even if different objects have similar intensity distributions and some object boundaries are missing. Promising results were obtained for separating the brain ventricles, the head, and the uterus region in the mouse-embryo head images obtained using high-frequency ultrasound imaging. The proposed method achieved mean Dice similarity coefficients of 0.87 ±0.04 and 0.89 ±0.06 for segmenting BVs and the head, respectively, compared to manual segmentation results by experts on 40 3D images over five gestation stages.

Lung Lesion Extraction Using a Toboggan Based Growing Automatic Segmentation Approach

The accurate segmentation of lung lesions from computed tomography (CT) scans is important for lung cancer research and can offer valuable information for clinical diagnosis and treatment. However, it is challenging to achieve a fully automatic lesion detection and segmentation with acceptable accuracy due to the heterogeneity of lung lesions. Here, we propose a novel toboggan based growing automatic segmentation approach (TBGA) with a three-step framework, which are automatic initial seed point selection, multi-constraints 3D lesion extraction and the final lesion refinement. The new approach does not require any human interaction or training dataset for lesion detection, yet it can provide a high lesion detection sensitivity (96.35%) and a comparable segmentation accuracy with manual segmentation (P > 0.05), which was proved by a series assessments using the LIDC-IDRI dataset (850 lesions) and in-house clinical dataset (121 lesions). We also compared TBGA with commonly used level set and skeleton graph cut methods, respectively. The results indicated a significant improvement of segmentation accuracy . Furthermore, the average time consumption for one lesion segmentation was under 8 s using our new method. In conclusion, we believe that the novel TBGA can achieve robust, efficient and accurate lung lesion segmentation in CT images automatically.

MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans

Many methods have been proposed for tissue segmentation in brain MRI scans. The multitude of methods proposed complicates the choice of one method above others. We have therefore established the MRBrainS online evaluation framework for evaluating (semi)automatic algorithms that segment gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) on 3T brain MRI scans of elderly subjects (65–80 y). Participants apply their algorithms to the provided data, after which their results are evaluated and ranked. Full manual segmentations of GM, WM, and CSF are available for all scans and used as the reference standard. Five datasets are provided for training and fifteen for testing. The evaluated methods are ranked based on their overall performance to segment GM, WM, and CSF and evaluated using three evaluation metrics (Dice, H95, and AVD) and the results are published on the MRBrainS13 website. We present the results of eleven segmentation algorithms that participated in the MRBrainS13 challenge workshop at MICCAI, where the framework was launched, and three commonly used freeware packages: FreeSurfer, FSL, and SPM. The MRBrainS evaluation framework provides an objective and direct comparison of all evaluated algorithms and can aid in selecting the best performing method for the segmentation goal at hand.

Ultrasound guidance for beating heart mitral valve repair augmented by synthetic dynamic CT

Minimally invasive valvular intervention commonly requires intra-procedural navigation to provide spatial and temporal information of relevant cardiac structures and device components. Recently intra-procedural trans-esophageal echocardiography (TEE) has been exploited for this purpose due to its accessibility, low cost, ease of use, and real-time imaging capacity. However, the position and orientation of tissue targets relative to surgical tools can be challenging to perceive, particularly using 2D imaging planes. In this paper, we propose the use of CT images to provide a high-quality 3D context to enhance ultrasound images through image registration, providing an augmented guidance system with minimal impact on standard clinical workflow. We also describe an approach to generate synthetic 4D CT images through non-rigid registration of available ultrasound. This can be employed to avoid a requirement for higher radiation. Synthetic CT images were validated through direct comparison of synthetic and real multi-phase CT images. Validation of CT and ultrasound image registration was performed for both dynamic and synthetic CT image datasets. Our results demonstrated that the synthetically generated dynamic CT images provide similar anatomical representation for relevant cardiac anatomy relative to real dynamic CT images, and similar high registration accuracy that can be achieved for intra-procedural TEE to this versus real dynamic CT images.

Hierarchical max-flow segmentation framework for multi-atlas segmentation with Kohonen self-organizing map based Gaussian mixture modeling

The incorporation of intensity, spatial, and topological information into large-scale multi-region segmentation has been a topic of ongoing research in medical image analysis. Multi-region segmentation problems, such as segmentation of brain structures, pose unique challenges in image segmentation in which regions may not have a defined intensity, spatial, or topological distinction, but rely on a combination of the three. We propose a novel framework within the Advanced segmentation tools (ASETS)(2), which combines large-scale Gaussian mixture models trained via Kohonen self-organizing maps, with deformable registration, and a convex max-flow optimization algorithm incorporating region topology as a hierarchy or tree. Our framework is validated on two publicly available neuroimaging datasets, the OASIS and MRBrainS13 databases, against the more conventional Potts model, achieving more accurate segmentations. Each component is accelerated using general-purpose programming on graphics processing Units to ensure computational feasibility.

Image-based Reconstruction of 3D Myocardial Infarct Geometry for Patient Specific Applications

Accurate reconstruction of the three-dimensional (3D) geometry of a myocardial infarct from two-dimensional (2D) multi-slice image sequences has important applications in the clinical evaluation and treatment of patients with ischemic cardiomyopathy. However, this reconstruction is challenging because the resolution of common clinical scans used to acquire infarct structure, such as short-axis, late-gadolinium enhanced cardiac magnetic resonance (LGE-CMR) images, is low, especially in the out-of-plane direction. In this study, we propose a novel technique to reconstruct the 3D infarct geometry from low resolution clinical images. Our methodology is based on a function called logarithm of odds (LogOdds), which allows the broader class of linear combinations in the LogOdds vector space as opposed to being limited to only a convex combination in the binary label space. To assess the efficacy of the method, we used high-resolution LGE-CMR images of 36 human hearts in vivo, and 3 canine hearts ex vivo. The infarct was manually segmented in each slice of the acquired images, and the manually segmented data were downsampled to clinical resolution. The developed method was then applied to the downsampled image slices, and the resulting reconstructions were compared with the manually segmented data. Several existing reconstruction techniques were also implemented, and compared with the proposed method. The results show that the LogOdds method significantly outperforms all the other tested methods in terms of region overlap.

A mitral annulus tracking approach for navigation of off-pump beating heart mitral valve repair

PURPOSE

To develop and validate a real-time mitral valve annulus (MVA) tracking approach based on biplane transesophageal echocardiogram (TEE) data and magnetic tracking systems (MTS) to be used in minimally invasive off-pump beating heart mitral valve repair (MVR).

METHODS

The authors' guidance system consists of three major components: TEE, magnetic tracking system, and an image guidance software platform. TEE provides real-time intraoperative images to show the cardiac motion and intracardiac surgical tools. The magnetic tracking system tracks the TEE probe and the surgical tools. The software platform integrates the TEE image planes and the virtual model of the tools and the MVA model on the screen. The authors' MVA tracking approach, which aims to update the MVA model in near real-time, comprises of three steps: image based gating, predictive reinitialization, and registration based MVA tracking. The image based gating step uses a small patch centered at each MVA point in the TEE images to identify images at optimal cardiac phases for updating the position of the MVA. The predictive reinitialization step uses the position and orientation of the TEE probe provided by the magnetic tracking system to predict the position of the MVA points in the TEE images and uses them for the initialization of the registration component. The registration based MVA tracking step aims to locate the MVA points in the images selected by the image based gating component by performing image based registration.

RESULTS

The validation of the MVA tracking approach was performed in a phantom study and a retrospective study on porcine data. In the phantom study, controlled translations were applied to the phantom and the tracked MVA was compared to its "true" position estimated based on a magnetic sensor attached to the phantom. The MVA tracking accuracy was 1.29 ± 0.58 mm when the translation distance is about 1 cm, and increased to 2.85 ± 1.19 mm when the translation distance is about 3 cm. In the study on porcine data, the authors compared the tracked MVA to a manually segmented MVA. The overall accuracy is 2.37 ± 1.67 mm for single plane images and 2.35 ± 1.55 mm for biplane images. The interoperator variation in manual segmentation was 2.32 ± 1.24 mm for single plane images and 1.73 ± 1.18 mm for biplane images. The computational efficiency of the algorithm on a desktop computer with an Intel(®) Xeon(®) CPU @3.47 GHz and an NVIDIA GeForce 690 graphic card is such that the time required for registering four MVA points was about 60 ms.

CONCLUSIONS

The authors developed a rapid MVA tracking algorithm for use in the guidance of off-pump beating heart transapical mitral valve repair. This approach uses 2D biplane TEE images and was tested on a dynamic heart phantom and interventional porcine image data. Results regarding the accuracy and efficiency of the authors' MVA tracking algorithm are promising, and fulfill the requirements for surgical navigation.

High-resolution 3-dimensional late gadolinium enhancement scar imaging in surgically corrected Tetralogy of Fallot: clinical feasibility of volumetric quantification and visualization

BACKGROUND

The extent of surgical scarring in Tetralogy of Fallot (TOF) may be a marker of adverse outcomes and provide substrate for ventricular arrhythmia. In this study we evaluate the feasibility of high resolution three dimensional (3D) late gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) for volumetric scar quantification in patients with surgically corrected TOF.

METHODS

Fifteen consecutive patients underwent 3D LGE imaging with 3 Tesla CMR using a whole-heart, respiratory-navigated technique. A novel, signal-histogram based segmentation technique was tested for the quantification and modeling of surgical scar. Total scar volume was compared to the gold standard manual expert segmentation. The feasibility of segmented scar fusion to matched coronary CMR data for volumetric display was explored.

RESULTS

Image quality sufficient for 3D scar segmentation was acquired in fourteen patients. Mean patient age was 32.2 ± 11.9 years (range 21 to 57 years) with mean right ventricle (RV) ejection fraction (EF) of 53.9 ± 9.2% and mean RV end diastolic volume of 117.0 ± 41.5 mL/m². The mean total scar volume was 11.1 ± 8.2 mL using semi-automated 3D segmentation with excellent correlation to manual expert segmentation (r = 0.99, bias = 0.89 mL, 95% CI -1.66 to 3.44). The mean segmentation time was significantly reduced using the novel semi-automated segmentation technique (10.1 ± 2.6 versus 45.8 ± 12.6 minutes). Excellent intra-observer and good inter-observer reproducibility was observed.

CONCLUSION

3D high resolution LGE imaging with semi-automated scar segmentation is clinically feasible among patients with surgically corrected TOF and shows excellent accuracy and reproducibility. This approach may offer a valuable clinical tool for risk prediction and procedural planning among this growing population.

Myocardial infarct segmentation and reconstruction from 2D late-gadolinium enhanced magnetic resonance images

In this paper, we propose a convex optimization-based algorithm for segmenting myocardial infarct from clinical 2D late-gadolinium enhanced magnetic resonance (LGE-MR) images. Previously segmented left ventricular (LV) myocardium was used to define a region of interest for the infarct segmentation. The infarct segmentation problem was formulated as a continuous min-cut problem, which was solved using its dual formulation, the continuous max-flow (CMF). Bhattacharyya intensity distribution matching was used as the data term, where the prior intensity distributions were computed based on a training data set LGE-MR images from seven patients. The algorithm was parallelized and implemented in a graphics processing unit for reduced computation time. Three-dimensional (3D) volumes of the infarcts were then reconstructed using an interpolation technique we developed based on logarithm of odds. The algorithm was validated using LGE-MR images from 47 patients (309 slices) by comparing computed 2D segmentations and 3D reconstructions to manually generated ones. In addition, the developed algorithm was compared to several previously reported segmentation techniques. The CMF algorithm outperformed the previously reported methods in terms of Dice similarity coefficient.