Neural network-based left ventricle geometry prediction from CMR images with application in biomechanics

DeepMesh: Mesh-Based Cardiac Motion Tracking Using Deep Learning

3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and the diagnosis of cardiovascular diseases. Current state-of-the art methods focus on estimating dense pixel-/voxel-wise motion fields in image space, which ignores the fact that motion estimation is only relevant and useful within the anatomical objects of interest, e.g., the heart. In this work, we model the heart as a 3D mesh consisting of epi- and endocardial surfaces. We propose a novel learning framework, DeepMesh, which propagates a template heart mesh to a subject space and estimates the 3D motion of the heart mesh from CMR images for individual subjects. In DeepMesh, the heart mesh of the end-diastolic frame of an individual subject is first reconstructed from the template mesh. Mesh-based 3D motion fields with respect to the end-diastolic frame are then estimated from 2D short- and long-axis CMR images. By developing a differentiable mesh-to-image rasterizer, DeepMesh is able to leverage 2D shape information from multiple anatomical views for 3D mesh reconstruction and mesh motion estimation. The proposed method estimates vertex-wise displacement and thus maintains vertex correspondences between time frames, which is important for the quantitative assessment of cardiac function across different subjects and populations. We evaluate DeepMesh on CMR images acquired from the UK Biobank. We focus on 3D motion estimation of the left ventricle in this work. Experimental results show that the proposed method quantitatively and qualitatively outperforms other image-based and mesh-based cardiac motion tracking methods.

Using LDDMM and a kinematic cardiac growth model to quantify growth and remodelling in rat hearts under PAH

Pulmonary arterial hypertension (PAH) is a rapidly progressive and fatal disease, with right ventricular failure being the primary cause of death in patients with PAH. This study aims to determine the mechanical stimuli that may initiate heart growth and remodelling (G&R). To achieve this, two bi-ventricular models were constructed: one for a control rat heart and another for a rat heart with PAH. The growth of the diseased heart was estimated by warping it to the control heart using an improved large deformation diffeomorphic metric mapping (LDDMM) framework. Correlation analysis was then performed between mechanical cues (stress and strain) and growth tensors, which revealed that principal strains may serve as a triggering stimulus for myocardial growth and remodelling under PAH. The growth tensors, estimated from in vivo images, could explain 84.3% of the observed geometrical changes in the diseased heart with PAH by using a kinematic cardiac growth model. Our approach has the potential to quantify G&R using sparse in vivo images and to provide insights into the underlying mechanism of triggering right heart failure from a biomechanical perspective.

A benchmark study of convolutional neural networks in fully automatic segmentation of aortic root

Recent clinical studies have suggested that introducing 3D patient-specific aortic root models into the pre-operative assessment procedure of transcatheter aortic valve replacement (TAVR) would reduce the incident rate of peri-operative complications. Tradition manual segmentation is labor-intensive and low-efficient, which cannot meet the clinical demands of processing large data volumes. Recent developments in machine learning provided a viable way for accurate and efficient medical image segmentation for 3D patient-specific models automatically. This study quantitively evaluated the auto segmentation quality and efficiency of the four popular segmentation-dedicated three-dimensional (3D) convolutional neural network (CNN) architectures, including 3D UNet, VNet, 3D Res-UNet and SegResNet. All the CNNs were implemented in PyTorch platform, and low-dose CTA image sets of 98 anonymized patients were retrospectively selected from the database for training and testing of the CNNs. The results showed that despite all four 3D CNNs having similar recall, Dice similarity coefficient (DSC), and Jaccard index on the segmentation of the aortic root, the Hausdorff distance (HD) of the segmentation results from 3D Res-UNet is 8.56 ± 2.28, which is only 9.8% higher than that of VNet, but 25.5% and 86.4% lower than that of 3D UNet and SegResNet, respectively. In addition, 3D Res-UNet and VNet also performed better in the 3D deviation location of interest analysis focusing on the aortic valve and the bottom of the aortic root. Although 3D Res-UNet and VNet are evenly matched in the aspect of classical segmentation quality evaluation metrics and 3D deviation location of interest analysis, 3D Res-UNet is the most efficient CNN architecture with an average segmentation time of 0.10 ± 0.04 s, which is 91.2%, 95.3% and 64.3% faster than 3D UNet, VNet and SegResNet, respectively. The results from this study suggested that 3D Res-UNet is a suitable candidate for accurate and fast automatic aortic root segmentation for pre-operative assessment of TAVR.

Image-based estimation of the left ventricular cavity volume using deep learning and Gaussian process with cardio-mechanical applications

In this investigation, an image-based method has been developed to estimate the volume of the left ventricular cavity using cardiac magnetic resonance (CMR) imaging data. Deep learning and Gaussian processes have been applied to bring the estimations closer to the cavity volumes manually extracted. CMR data from 339 patients and healthy volunteers have been used to train a stepwise regression model that can estimate the volume of the left ventricular cavity at the beginning and end of diastole. We have decreased the root mean square error (RMSE) of cavity volume estimation approximately from 13 to 8 ml compared to the common practice in the literature. Considering the RMSE of manual measurements is approximately 4 ml on the same dataset, 8 ml of error is notable for a fully automated estimation method, which needs no supervision or user-hours once it has been trained. Additionally, to demonstrate a clinically relevant application of automatically estimated volumes, we inferred the passive material properties of the myocardium given the volume estimates using a well-validated cardiac model. These material properties can be further used for patient treatment planning and diagnosis.

Bayesian optimisation for efficient parameter inference in a cardiac mechanics model of the left ventricle

We consider parameter inference in cardio-mechanic models of the left ventricle, in particular the one based on the Holtzapfel-Ogden (HO) constitutive law, using clinical in vivo data. The equations underlying these models do not admit closed form solutions and hence need to be solved numerically. These numerical procedures are computationally expensive making computational run times associated with numerical optimisation or sampling excessive for the uptake of the models in the clinical practice. To address this issue, we adopt the framework of Bayesian optimisation (BO), which is an efficient statistical technique of global optimisation. BO seeks the optimum of an unknown black-box function by sequentially training a statistical surrogate-model and using it to select the next query point by leveraging the associated exploration-exploitation trade-off. To guarantee that the estimates based on the in vivo data are realistic also for high-pressures, unobservable in vivo, we include a penalty term based on a previously published empirical law developed using ex vivo data. Two case studies based on real data demonstrate that the proposed BO procedure outperforms the state-of-the-art inference algorithm for the HO constitutive law.