Three-dimensional cardiovascular image analysis

Fully Automatic initialization and segmentation of left and right ventricles for large-scale cardiac MRI using a deeply supervised network and 3D-ASM

BACKGROUND AND OBJECTIVE

The sheer volume of data generated by population imaging studies is unparalleled by current capabilities to extract objective and quantitative cardiac phenotypes; subjective and time-consuming manual image analysis remains the gold standard. Automated image analytics to compute quantitative imaging biomarkers of cardiac function are desperately needed. Data volumes and their variability pose a challenge to most state-of-the-art methods for endo- and epicardial contours, which lack robustness when applied to very large datasets. Our aim is to develop an analysis pipeline for the automatic quantification of cardiac function from cine magnetic resonance imaging data.

METHOD

This work adopt 4,638 cardiac MRI cases coming from UK Biobank with ground truth available for left and RV contours. A hybrid and robust algorithm is proposed to improve the accuracy of automatic left and right ventricle segmentation by harnessing the localization accuracy of deep learning and the morphological accuracy of 3D-ASM (three-dimensional active shape models). The contributions of this paper are three-fold. First, a fully automatic method is proposed for left and right ventricle initialization and cardiac MRI segmentation by taking full advantage of spatiotemporal constraint. Second, a deeply supervised network is introduced to train and segment the heart. Third, the 3D-ASM image search procedure is improved by combining image intensity models with convolutional neural network (CNN) derived distance maps improving endo- and epicardial edge localization.

RESULTS

The proposed architecture outperformed the state of the art for cardiac MRI segmentation from UK Biobank. The statistics of RV landmarks detection errors for Triscuspid valve and RV apex are 4.17 mm and 5.58 mm separately. The overlap metric, mean contour distance, Hausdorff distance and cardiac functional parameters are calculated for the LV (Left Ventricle) and RV (Right Ventricle) contour segmentation. Bland-Altman analysis for clinical parameters shows that the results from our automated image analysis pipelines are in good agreement with results from expert manual analysis.

CONCLUSIONS

Our hybrid scheme combines deep learning and statistical shape modeling for automatic segmentation of the LV/RV from cardiac MRI datasets is effective and robust and can compute cardiac functional indexes from population imaging.

Groupwise rigid registration of wrist bones

We present an extension of the symmetric ICP algorithm that is unbiased for an arbitrary number (N > or = 2) of shapes, using rigid transformations and scaling. The method does not require the selection of a reference shape or registration order and hence it is unbiased towards any of the registered shapes. The functional to be minimized is non-linear in the transformation parameters and thus computationally complex. We therefore propose a first order approximation that estimates the transformation parameters in a closed form, with computational complexity (see text for symbol)(N2). Using a set of wrist bones, we show that the least-squares minimization and the proposed approximation converge to the same solution. Experiments also show that the proposed algorithms lead to smaller registration errors than algorithms that select a reference shape or register to an evolving mean shape. The low computational cost and trivial parallelization enable the alignment of large numbers of bones.

Model-based fusion of multi-modal volumetric images: application to transcatheter valve procedures

Minimal invasive procedures such as transcatheter valve interventions are substituting conventional surgical techniques. Thus, novel operating rooms have been designed to augment traditional surgical equipment with advanced imaging systems to guide the procedures. We propose a novel method to fuse pre-operative and intra-operative information by jointly estimating anatomical models from multiple image modalities. Thereby high-quality patient-specific models are integrated into the imaging environment of operating rooms to guide cardiac interventions. Robust and fast machine learning techniques are utilized to guide the estimation process. Our method integrates both the redundant and complementary multimodal information to achieve a comprehensive modeling and simultaneously reduce the estimation uncertainty. Experiments performed on 28 patients with pairs of multimodal volumetric data are used to demonstrate high quality intra-operative patient-specific modeling of the aortic valve with a precision of 1.09mm in TEE and 1.73mm in 3D C-arm CT. Within a processing time of 10 seconds we additionally obtain model sensitive mapping between the pre- and intraoperative images.

Constrained registration of the wrist joint

Comparing wrist shapes of different individuals requires alignment of these wrists into the same pose. Unconstrained registration of the carpal bones results in anatomically nonfeasible wrists. In this paper, we propose to constrain the registration using the shapes of adjacent bones, by keeping the width of the gap between adjacent bones constant. The registration is formulated as an optimization involving two terms. One term aligns the wrist bones by minimizing the distances between corresponding bone surfaces. The second term constrains the registration by minimizing the distances between adjacent sliding surfaces. The registration is based on the Iterative Closest Point algorithm. All bones are registered concurrently so that no bias is introduced towards any of the bones. The proposed registration method delivers anatomically correct configurations of the bones. The registration errors are in the order of the voxel size of the acquired CT data (0.3 x 0.3 x 0.3 mm(3)). The standard deviation in the widths of gaps between adjacent bones is in the order of 10% with an insignificant bias. This is a large improvement over the standard deviations of 30%-80% encountered in unconstrained registration. The value of this method is its capability of accurately registering joints in varying poses resulting in physiological joint configurations.

Four-chamber heart modeling and automatic segmentation for 3-D cardiac CT volumes using marginal space learning and steerable features

We propose an automatic four-chamber heart segmentation system for the quantitative functional analysis of the heart from cardiac computed tomography (CT) volumes. Two topics are discussed: heart modeling and automatic model fitting to an unseen volume. Heart modeling is a nontrivial task since the heart is a complex nonrigid organ. The model must be anatomically accurate, allow manual editing, and provide sufficient information to guide automatic detection and segmentation. Unlike previous work, we explicitly represent important landmarks (such as the valves and the ventricular septum cusps) among the control points of the model. The control points can be detected reliably to guide the automatic model fitting process. Using this model, we develop an efficient and robust approach for automatic heart chamber segmentation in 3-D CT volumes. We formulate the segmentation as a two-step learning problem: anatomical structure localization and boundary delineation. In both steps, we exploit the recent advances in learning discriminative models. A novel algorithm, marginal space learning (MSL), is introduced to solve the 9-D similarity transformation search problem for localizing the heart chambers. After determining the pose of the heart chambers, we estimate the 3-D shape through learning-based boundary delineation. The proposed method has been extensively tested on the largest dataset (with 323 volumes from 137 patients) ever reported in the literature. To the best of our knowledge, our system is the fastest with a speed of 4.0 s per volume (on a dual-core 3.2-GHz processor) for the automatic segmentation of all four chambers.

Toward patient-specific myocardial models of the heart

This article presents a framework for building patient-specific models of the myocardium, to help diagnosis, therapy planning, and procedure guidance. The aim is to be able to introduce such models in clinical applications. Thus, there is a need to design models that can be adjusted from clinical data, images, or signals, which are sparse and noisy. The authors describe the three main components of a myocardial model: the anatomy, the electrophysiology, and the biomechanics. For each of these components, the authors try to obtain the best balance between prior knowledge and observable parameters to be able to adjust these models to patient data. To achieve this, there is a need to design models with the right level of complexity and a computational cost compatible with clinical constraints.

A non-rigid registration approach for quantifying myocardial contraction in tagged MRI using generalized information measures

We address the problem of quantitatively assessing myocardial function from tagged MRI sequences. We develop a two-step method comprising (i) a motion estimation step using a novel variational non-rigid registration technique based on generalized information measures, and (ii) a measurement step, yielding local and segmental deformation parameters over the whole myocardium. Experiments on healthy and pathological data demonstrate that this method delivers, within a reasonable computation time and in a fully unsupervised way, reliable measurements for normal subjects and quantitative pathology-specific information. Beyond cardiac MRI, this work redefines the foundations of variational non-rigid registration for information-theoretic similarity criteria with potential interest in multimodal medical imaging.

Stochastic finite element framework for simultaneous estimation of cardiac kinematic functions and material parameters

A stochastic finite element framework is presented for the simultaneous estimation of the cardiac kinematic functions and material model parameters from periodic medical image sequences. While existing biomechanics studies of the myocardial material constitutive laws have assumed known tissue kinematic measurements, and image analysis efforts on cardiac kinematic functions have relied on fixed constraining models of mathematical or mechanical nature, we illustrate through synthetic data that a probabilistic joint estimation strategy is needed to achieve more robust and accurate analysis of the kinematic functions and material parameters at the same time. For a particular a priori constraining material model with uncertain subject-dependent parameters and a posteriori noisy imaging based observations, our strategy combines the stochastic differential equations of the myocardial dynamics with the finite element method, and the material parameters and the imaging data are treated as random variables with known prior statistics. After the conversion to state space representation, the extended Kalman filtering procedures are adopted to linearize the equations and to provide the joint estimates in an approximate optimal sense. The estimation bias and convergence issues are addressed, and we conclude experimentally that it is possible to adopt this biomechanical model based multiframe estimation approach to achieve converged estimates because of the periodic nature of the cardiac dynamics. The effort is validated using synthetic data sequence with known kinematics and material parameters. Further, under linear elastic material model, estimation results using canine magnetic resonance phase contrast image sequences are presented, which are in very good agreement with histological tissue staining results, the current gold standards.