Quantitative CMR population imaging on 20,000 subjects of the UK Biobank imaging study: LV/RV quantification pipeline and its evaluation

A history of cardiovascular magnetic resonance imaging in clinical practice and population science

Cardiovascular magnetic resonance (CMR) imaging has become an invaluable clinical and research tool. Starting from the discovery of nuclear magnetic resonance, this article provides a brief overview of the key developments that have led to CMR as it is today, and how it became the modality of choice for large-scale population studies.

Unsupervised ensemble-based phenotyping enhances discoverability of genes related to left-ventricular morphology

Recent genome-wide association studies have successfully identified associations between genetic variants and simple cardiac morphological parameters derived from cardiac magnetic resonance images. However, the emergence of large databases, including genetic data linked to cardiac magnetic resonance facilitates the investigation of more nuanced patterns of cardiac shape variability than those studied so far. Here we propose a framework for gene discovery coined unsupervised phenotype ensembles. The unsupervised phenotype ensemble builds a redundant yet highly expressive representation by pooling a set of phenotypes learnt in an unsupervised manner, using deep learning models trained with different hyperparameters. These phenotypes are then analysed via genome-wide association studies, retaining only highly confident and stable associations across the ensemble. We applied our approach to the UK Biobank database to extract geometric features of the left ventricle from image-derived three-dimensional meshes. We demonstrate that our approach greatly improves the discoverability of genes that influence left ventricle shape, identifying 49 loci with study-wide significance and 25 with suggestive significance. We argue that our approach would enable more extensive discovery of gene associations with image-derived phenotypes for other organs or image modalities.

A Deep Learning-Based Integrated Framework for Quality-Aware Undersampled Cine Cardiac MRI Reconstruction and Analysis

Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this article, we present a fully-automated, quality-controlled integrated framework for reconstruction, segmentation and downstream analysis of undersampled cine CMR data. The framework produces high quality reconstructions and segmentations, leading to undersampling factors that are optimised on a scan-by-scan basis. This results in reduced scan times and automated analysis, enabling robust and accurate estimation of functional biomarkers. To demonstrate the feasibility of the proposed approach, we perform simulations of radial k-space acquisitions using in-vivo cine CMR data from 270 subjects from the UK Biobank (with synthetic phase) and in-vivo cine CMR data from 16 healthy subjects (with real phase). The results demonstrate that the optimal undersampling factor varies for different subjects by approximately 1 to 2 seconds per slice. We show that our method can produce quality-controlled images in a mean scan time reduced from 12 to 4 seconds per slice, and that image quality is sufficient to allow clinically relevant parameters to be automatically estimated to lie within 5% mean absolute difference.

AI approach to biventricular function assessment in cine-MRI: an ultra-small training dataset and multivendor study

Objective. It was a great challenge to train an excellent and generalized model on an ultra-small data set composed of multi-orientation cardiac cine magnetic resonance imaging (MRI) images. We try to develop a 3D deep learning method based on an ultra-small training data set from muti-orientation cine MRI images and assess its performance of automated biventricular structure segmentation and function assessment in multivendor.Approach. We completed the training and testing of our deep learning networks using only heart datasets of 150 cases (90 cases for training and 60 cases for testing). This datasets were obtained from three different MRI vendors and each subject included two phases of the cardiac cycle and three cine sequences. A 3D deep learning algorithm combining Transformers and U-Net was trained. The performance of the segmentation was evaluated using the Dice metric and Hausdorff distance (HD). Based on this, the manual and automatic results of cardiac function parameters were compared with Pearson correlation, intraclass correlation coefficient (ICC) and Bland-Altman analysis in multivendor.Main results. The results show that the average Dice of 0.92, 0.92, 0.94 and HD95 of 2.50, 1.36, 1.37 for three sequences. The automatic and manual results of seven parameters were excellently correlated with the lowestr2 value of 0.824 and the highest of 0.983. The ICC (0.908-0.989,P< 0.001) showed that the results were highly consistent. Bland-Altman with a 95% limit of agreement showed there was no significant difference except for the difference in RVESV (P= 0.005) and LVM (P< 0.001).Significance. The model had high accuracy in segmentation and excellent correlation and consistency in function assessment. It provides a fast and effective method for studying cardiac MRI and heart disease.

Fully Automatic initialization and segmentation of left and right ventricles for large-scale cardiac MRI using a deeply supervised network and 3D-ASM

BACKGROUND AND OBJECTIVE

The sheer volume of data generated by population imaging studies is unparalleled by current capabilities to extract objective and quantitative cardiac phenotypes; subjective and time-consuming manual image analysis remains the gold standard. Automated image analytics to compute quantitative imaging biomarkers of cardiac function are desperately needed. Data volumes and their variability pose a challenge to most state-of-the-art methods for endo- and epicardial contours, which lack robustness when applied to very large datasets. Our aim is to develop an analysis pipeline for the automatic quantification of cardiac function from cine magnetic resonance imaging data.

METHOD

This work adopt 4,638 cardiac MRI cases coming from UK Biobank with ground truth available for left and RV contours. A hybrid and robust algorithm is proposed to improve the accuracy of automatic left and right ventricle segmentation by harnessing the localization accuracy of deep learning and the morphological accuracy of 3D-ASM (three-dimensional active shape models). The contributions of this paper are three-fold. First, a fully automatic method is proposed for left and right ventricle initialization and cardiac MRI segmentation by taking full advantage of spatiotemporal constraint. Second, a deeply supervised network is introduced to train and segment the heart. Third, the 3D-ASM image search procedure is improved by combining image intensity models with convolutional neural network (CNN) derived distance maps improving endo- and epicardial edge localization.

RESULTS

The proposed architecture outperformed the state of the art for cardiac MRI segmentation from UK Biobank. The statistics of RV landmarks detection errors for Triscuspid valve and RV apex are 4.17 mm and 5.58 mm separately. The overlap metric, mean contour distance, Hausdorff distance and cardiac functional parameters are calculated for the LV (Left Ventricle) and RV (Right Ventricle) contour segmentation. Bland-Altman analysis for clinical parameters shows that the results from our automated image analysis pipelines are in good agreement with results from expert manual analysis.

CONCLUSIONS

Our hybrid scheme combines deep learning and statistical shape modeling for automatic segmentation of the LV/RV from cardiac MRI datasets is effective and robust and can compute cardiac functional indexes from population imaging.

Prediction of incident cardiovascular events using machine learning and CMR radiomics

OBJECTIVES

Evaluation of the feasibility of using cardiovascular magnetic resonance (CMR) radiomics in the prediction of incident atrial fibrillation (AF), heart failure (HF), myocardial infarction (MI), and stroke using machine learning techniques.

METHODS

We identified participants from the UK Biobank who experienced incident AF, HF, MI, or stroke during the continuous longitudinal follow-up. The CMR indices and the vascular risk factors (VRFs) as well as the CMR images were obtained for each participant. Three-segmented regions of interest (ROIs) were computed: right ventricle cavity, left ventricle (LV) cavity, and LV myocardium in end-systole and end-diastole phases. Radiomics features were extracted from the 3D volumes of the ROIs. Seven integrative models were built for each incident cardiovascular disease (CVD) as an outcome. Each model was built with VRF, CMR indices, and radiomics features and a combination of them. Support vector machine was used for classification. To assess the model performance, the accuracy, sensitivity, specificity, and AUC were reported.

RESULTS

AF prediction model using the VRF+CMR+Rad model (accuracy: 0.71, AUC 0.76) obtained the best result. However, the AUC was similar to the VRF+Rad model. HF showed the most significant improvement with the inclusion of CMR metrics (VRF+CMR+Rad: 0.79, AUC 0.84). Moreover, adding only the radiomics features to the VRF reached an almost similarly good performance (VRF+Rad: accuracy 0.77, AUC 0.83). Prediction models looking into incident MI and stroke reached slightly smaller improvement.

CONCLUSIONS

Radiomics features may provide incremental predictive value over VRF and CMR indices in the prediction of incident CVDs.

KEY POINTS

• Prediction of incident atrial fibrillation, heart failure, stroke, and myocardial infarction using machine learning techniques. • CMR radiomics, vascular risk factors, and standard CMR indices will be considered in the machine learning models. • The experiments show that radiomics features can provide incremental predictive value over VRF and CMR indices in the prediction of incident cardiovascular diseases.

Reducing segmentation failures in cardiac MRI via late feature fusion and GAN-based augmentation

Cardiac magnetic resonance (CMR) image segmentation is an integral step in the analysis of cardiac function and diagnosis of heart related diseases. While recent deep learning-based approaches in automatic segmentation have shown great promise to alleviate the need for manual segmentation, most of these are not applicable to realistic clinical scenarios. This is largely due to training on mainly homogeneous datasets, without variation in acquisition, which typically occurs in multi-vendor and multi-site settings, as well as pathological data. Such approaches frequently exhibit a degradation in prediction performance, particularly on outlier cases commonly associated with difficult pathologies, artifacts and extensive changes in tissue shape and appearance. In this work, we present a model aimed at segmenting all three cardiac structures in a multi-center, multi-disease and multi-view scenario. We propose a pipeline, addressing different challenges with segmentation of such heterogeneous data, consisting of heart region detection, augmentation through image synthesis and a late-fusion segmentation approach. Extensive experiments and analysis demonstrate the ability of the proposed approach to tackle the presence of outlier cases during both training and testing, allowing for better adaptation to unseen and difficult examples. Overall, we show that the effective reduction of segmentation failures on outlier cases has a positive impact on not only the average segmentation performance, but also on the estimation of clinical parameters, leading to a better consistency in derived metrics.

Left Ventricle Detection from Cardiac Magnetic Resonance Relaxometry Images Using Visual Transformer

Left Ventricle (LV) detection from Cardiac Magnetic Resonance (CMR) imaging is a fundamental step, preliminary to myocardium segmentation and characterization. This paper focuses on the application of a Visual Transformer (ViT), a novel neural network architecture, to automatically detect LV from CMR relaxometry sequences. We implemented an object detector based on the ViT model to identify LV from CMR multi-echo T2* sequences. We evaluated performances differentiated by slice location according to the American Heart Association model using 5-fold cross-validation and on an independent dataset of CMR T2*, T2, and T1 acquisitions. To the best of our knowledge, this is the first attempt to localize LV from relaxometry sequences and the first application of ViT for LV detection. We collected an Intersection over Union (IoU) index of 0.68 and a Correct Identification Rate (CIR) of blood pool centroid of 0.99, comparable with other state-of-the-art methods. IoU and CIR values were significantly lower in apical slices. No significant differences in performances were assessed on independent T2* dataset (IoU = 0.68, p = 0.405; CIR = 0.94, p = 0.066). Performances were significantly worse on the T2 and T1 independent datasets (T2: IoU = 0.62, CIR = 0.95; T1: IoU = 0.67, CIR = 0.98), but still encouraging considering the different types of acquisition. This study confirms the feasibility of the application of ViT architectures in LV detection and defines a benchmark for relaxometry imaging.

Conventional and genetic associations between resting heart rate, cardiac morphology and function as assessed by magnetic resonance imaging: Insights from the UK biobank population study

Aim

To examine the direction, strength and causality of the associations of resting heart rate (RHR) with cardiac morphology and function in 20,062 UK Biobank participants.

Methods and results

Participants underwent cardiac magnetic resonance (CMR) and we extracted CMR biventricular structural and functional metrics using automated pipelines. Multivariate linear regression adjusted for the main cardiovascular risk factors and Two-sample Mendelian Randomization analyses were performed to assess the potential relationship, grouped by heart rate and stratified by sex. Each 10 beats per minute increase in RHR was linked with smaller ventricular structure (lower biventricular end-diastolic volume and end-systolic volume), poorer left ventricular (LV) function (lower LV ejection fraction, global longitude strain and global function index) and unhealthy pattern of LV remodeling (higher values of myocardial contraction fraction), but there is no statistical difference in LV wall thickness. These trends are more pronounced among males and consistent with the causal effect direction of genetic variants interpretation. These observations reflect that RHR has an independent and broad impact on LV remodeling, however, genetically-predicted RHR is not statistically related to heart failure.

Conclusion

We demonstrate higher RHR cause smaller ventricular chamber volume, poorer systolic function and unhealthy cardiac remodeling pattern. Our findings provide effective evidence for the potential mechanism of cardiac remodeling and help to explore the potential scope or benefit of intervention.

Towards automatic classification of cardiovascular magnetic resonance Task Force Criteria for diagnosis of arrhythmogenic right ventricular cardiomyopathy

BACKGROUND

Arrhythmogenic right ventricular cardiomyopathy (ARVC) is diagnosed according to the Task Force Criteria (TFC) in which cardiovascular magnetic resonance (CMR) imaging plays an important role. Our study aims to apply an automatic deep learning-based segmentation for right and left ventricular CMR assessment and evaluate this approach for classification of the CMR TFC.

METHODS

We included 227 subjects suspected of ARVC who underwent CMR. Subjects were classified into (1) ARVC patients fulfilling TFC; (2) at-risk family members; and (3) controls. To perform automatic segmentation, a Bayesian Dilated Residual Neural Network was trained and tested. Performance of automatic versus manual segmentation was assessed using Dice-coefficient and Hausdorff distance. Since automatic segmentation is most challenging in basal slices, manual correction of the automatic segmentation in the most basal slice was simulated (automatic^-basal). CMR TFC calculated using manual and automatic^-basal segmentation were compared using Cohen's Kappa (κ).

RESULTS

Automatic segmentation was trained on CMRs of 70 subjects (39.6 ± 18.1 years, 47% female) and tested on 157 subjects (36.9 ± 17.6 years, 59% female). Dice-coefficient and Hausdorff distance showed good agreement between manual and automatic segmentations (≥ 0.89 and ≤ 10.6 mm, respectively) which further improved after simulated correction of the most basal slice (≥ 0.92 and ≤ 9.2 mm, p < 0.001). Pearson correlation of volumetric and functional CMR measurements was good to excellent (automatic (r = 0.78-0.99, p < 0.001) and automatic^-basal (r = 0.88-0.99, p < 0.001) measurements). CMR TFC classification using automatic^-basal segmentations was comparable to manual segmentations (κ 0.98 ± 0.02) with comparable diagnostic performance.

CONCLUSIONS

Combining automatic segmentation of CMRs with correction of the most basal slice results in accurate CMR TFC classification of subjects suspected of ARVC.

Automated imaging-based abdominal organ segmentation and quality control in 20,000 participants of the UK Biobank and German National Cohort Studies

Large epidemiological studies such as the UK Biobank (UKBB) or German National Cohort (NAKO) provide unprecedented health-related data of the general population aiming to better understand determinants of health and disease. As part of these studies, Magnetic Resonance Imaging (MRI) is performed in a subset of participants allowing for phenotypical and functional characterization of different organ systems. Due to the large amount of imaging data, automated image analysis is required, which can be performed using deep learning methods, e. g. for automated organ segmentation. In this paper we describe a computational pipeline for automated segmentation of abdominal organs on MRI data from 20,000 participants of UKBB and NAKO and provide results of the quality control process. We found that approx. 90% of data sets showed no relevant segmentation errors while relevant errors occurred in a varying proportion of data sets depending on the organ of interest. Image-derived features based on automated organ segmentations showed relevant deviations of varying degree in the presence of segmentation errors. These results show that large-scale, deep learning-based abdominal organ segmentation on MRI data is feasible with overall high accuracy, but visual quality control remains an important step ensuring the validity of down-stream analyses in large epidemiological imaging studies.

Automatic 3D+t four-chamber CMR quantification of the UK biobank: integrating imaging and non-imaging data priors at scale

Accurate 3D modelling of cardiac chambers is essential for clinical assessment of cardiac volume and function, including structural, and motion analysis. Furthermore, to study the correlation between cardiac morphology and other patient information within a large population, it is necessary to automatically generate cardiac mesh models of each subject within the population. In this study, we introduce MCSI-Net (Multi-Cue Shape Inference Network), where we embed a statistical shape model inside a convolutional neural network and leverage both phenotypic and demographic information from the cohort to infer subject-specific reconstructions of all four cardiac chambers in 3D. In this way, we leverage the ability of the network to learn the appearance of cardiac chambers in cine cardiac magnetic resonance (CMR) images, and generate plausible 3D cardiac shapes, by constraining the prediction using a shape prior, in the form of the statistical modes of shape variation learned a priori from a subset of the population. This, in turn, enables the network to generalise to samples across the entire population. To the best of our knowledge, this is the first work that uses such an approach for patient-specific cardiac shape generation. MCSI-Net is capable of producing accurate 3D shapes using just a fraction (about 23% to 46%) of the available image data, which is of significant importance to the community as it supports the acceleration of CMR scan acquisitions. Cardiac MR images from the UK Biobank were used to train and validate the proposed method. We also present the results from analysing 40,000 subjects of the UK Biobank at 50 time-frames, totalling two million image volumes. Our model can generate more globally consistent heart shape than that of manual annotations in the presence of inter-slice motion and shows strong agreement with the reference ranges for cardiac structure and function across cardiac ventricles and atria.

Estimation of biological heart age using cardiovascular magnetic resonance radiomics

We developed a novel interpretable biological heart age estimation model using cardiovascular magnetic resonance radiomics measures of ventricular shape and myocardial character. We included 29,996 UK Biobank participants without cardiovascular disease. Images were segmented using an automated analysis pipeline. We extracted 254 radiomics features from the left ventricle, right ventricle, and myocardium of each study. We then used Bayesian ridge regression with tenfold cross-validation to develop a heart age estimation model using the radiomics features as the model input and chronological age as the model output. We examined associations of radiomics features with heart age in men and women, observing sex-differential patterns. We subtracted actual age from model estimated heart age to calculate a "heart age delta", which we considered as a measure of heart aging. We performed a phenome-wide association study of 701 exposures with heart age delta. The strongest correlates of heart aging were measures of obesity, adverse serum lipid markers, hypertension, diabetes, heart rate, income, multimorbidity, musculoskeletal health, and respiratory health. This technique provides a new method for phenotypic assessment relating to cardiovascular aging; further studies are required to assess whether it provides incremental risk information over current approaches.

A Survey on the Role of Artificial Intelligence in Biobanking Studies: A Systematic Review

Introduction: In biobanks, participants' biological samples are stored for future research. The application of artificial intelligence (AI) involves the analysis of data and the prediction of any pathological outcomes. In AI, models are used to diagnose diseases as well as classify and predict disease risks. Our research analyzed AI's role in the development of biobanks in the healthcare industry, systematically. Methods: The literature search was conducted using three digital reference databases, namely PubMed, CINAHL, and WoS. Guidelines for preferred reporting elements for systematic reviews and meta-analyses (PRISMA)-2020 in conducting the systematic review were followed. The search terms included "biobanks", "AI", "machine learning", and "deep learning", as well as combinations such as "biobanks with AI", "deep learning in the biobanking field", and "recent advances in biobanking". Only English-language papers were included in the study, and to assess the quality of selected works, the Newcastle-Ottawa scale (NOS) was used. The good quality range (NOS ≥ 7) is only considered for further review. Results: A literature analysis of the above entries resulted in 239 studies. Based on their relevance to the study's goal, research characteristics, and NOS criteria, we included 18 articles for reviewing. In the last decade, biobanks and artificial intelligence have had a relatively large impact on the medical system. Interestingly, UK biobanks account for the highest percentage of high-quality works, followed by Qatar, South Korea, Singapore, Japan, and Denmark. Conclusions: Translational bioinformatics probably represent a future leader in precision medicine. AI and machine learning applications to biobanking research may contribute to the development of biobanks for the utility of health services and citizens.

Associations of cognitive performance with cardiovascular magnetic resonance phenotypes in the UK Biobank

AIMS

Existing evidence suggests links between brain and cardiovascular health. We investigated associations between cognitive performance and cardiovascular magnetic resonance (CMR) phenotypes in the UK Biobank, considering a range of potential confounders.

METHODS AND RESULTS

We studied 29 763 participants with CMR and cognitive testing, specifically, fluid intelligence (FI, 13 verbal-numeric reasoning questions), and reaction time (RT, a timed pairs matching exercise); both were considered continuous variables for modelling. We included the following CMR metrics: left and right ventricular (LV and RV) volumes in end-diastole and end-systole, LV/RV ejection fractions, LV/RV stroke volumes, LV mass, and aortic distensibility. Multivariable linear regression models were used to estimate the association of each CMR measure with FI and RT, adjusting for age, sex, smoking, education, deprivation, diabetes, hypertension, high cholesterol, prior myocardial infarction, alcohol intake, and exercise level. We report standardized beta-coefficients, 95% confidence intervals, and P-values adjusted for multiple testing. In this predominantly healthy cohort (average age 63.0 ± 7.5 years), better cognitive performance (higher FI, lower RT) was associated with larger LV/RV volumes, higher LV/RV stroke volumes, greater LV mass, and greater aortic distensibility in fully adjusted models. There was some evidence of non-linearity in the relationship between FI and LV end-systolic volume, with reversal of the direction of association at very high volumes. Associations were consistent for men and women and in different ages.

CONCLUSION

Better cognitive performance is associated with CMR measures likely representing a healthier cardiovascular phenotype. These relationships remained significant after adjustment for a range of cardiometabolic, lifestyle, and demographic factors, suggesting possible involvement of alternative disease mechanisms.

From Accuracy to Reliability and Robustness in Cardiac Magnetic Resonance Image Segmentation: A Review

Since the rise of deep learning (DL) in the mid-2010s, cardiac magnetic resonance (CMR) image segmentation has achieved state-of-the-art performance. Despite achieving inter-observer variability in terms of different accuracy performance measures, visual inspections reveal errors in most segmentation results, indicating a lack of reliability and robustness of DL segmentation models, which can be critical if a model was to be deployed into clinical practice. In this work, we aim to bring attention to reliability and robustness, two unmet needs of cardiac image segmentation methods, which are hampering their translation into practice. To this end, we first study the performance accuracy evolution of CMR segmentation, illustrate the improvements brought by DL algorithms and highlight the symptoms of performance stagnation. Afterwards, we provide formal definitions of reliability and robustness. Based on the two definitions, we identify the factors that limit the reliability and robustness of state-of-the-art deep learning CMR segmentation techniques. Finally, we give an overview of the current set of works that focus on improving the reliability and robustness of CMR segmentation, and we categorize them into two families of methods: quality control methods and model improvement techniques. The first category corresponds to simpler strategies that only aim to flag situations where a model may be incurring poor reliability or robustness. The second one, instead, directly tackles the problem by bringing improvements into different aspects of the CMR segmentation model development process. We aim to bring the attention of more researchers towards these emerging trends regarding the development of reliable and robust CMR segmentation frameworks, which can guarantee the safe use of DL in clinical routines and studies.

Assessment of right ventricular size and function from cardiovascular magnetic resonance images using artificial intelligence

BACKGROUND

Theoretically, artificial intelligence can provide an accurate automatic solution to measure right ventricular (RV) ejection fraction (RVEF) from cardiovascular magnetic resonance (CMR) images, despite the complex RV geometry. However, in our recent study, commercially available deep learning (DL) algorithms for RVEF quantification performed poorly in some patients. The current study was designed to test the hypothesis that quantification of RV function could be improved in these patients by using more diverse CMR datasets in addition to domain-specific quantitative performance evaluation metrics during the cross-validation phase of DL algorithm development.

METHODS

We identified 100 patients from our prior study who had the largest differences between manually measured and automated RVEF values. Automated RVEF measurements were performed using the original version of the algorithm (DL1), an updated version (DL2) developed from a dataset that included a wider range of RV pathology and validated using multiple domain-specific quantitative performance evaluation metrics, and conventional methodology performed by a core laboratory (CORE). Each of the DL-RVEF approaches was compared against CORE-RVEF reference values using linear regression and Bland-Altman analyses. Additionally, RVEF values were classified into 3 categories: ≤ 35%, 35-50%, and ≥ 50%. Agreement between RVEF classifications made by the DL approaches and the CORE measurements was tested.

RESULTS

CORE-RVEF and DL-RVEFs were obtained in all patients (feasibility of 100%). DL2-RVEF correlated with CORE-RVEF better than DL1-RVEF (r = 0.87 vs. r = 0.42), with narrower limits of agreement. As a result, DL2 algorithm also showed increasing accuracy from 0.53 to 0.80 for categorizing RV function.

CONCLUSIONS

The use of a new DL algorithm cross-validated on a dataset with a wide range of RV pathology using multiple domain-specific metrics resulted in a considerable improvement in the accuracy of automated RVEF measurements. This improvement was demonstrated in patients whose images were the most challenging and resulted in the largest RVEF errors. These findings underscore the critical importance of this strategy in the development of DL approaches for automated CMR measurements.

A Systematic Quality Scoring Analysis to Assess Automated Cardiovascular Magnetic Resonance Segmentation Algorithms

Background

The quantitative measures used to assess the performance of automated methods often do not reflect the clinical acceptability of contouring. A quality-based assessment of automated cardiac magnetic resonance (CMR) segmentation more relevant to clinical practice is therefore needed.

Objective

We propose a new method for assessing the quality of machine learning (ML) outputs. We evaluate the clinical utility of the proposed method as it is employed to systematically analyse the quality of an automated contouring algorithm.

Methods

A dataset of short-axis (SAX) cine CMR images from a clinically heterogeneous population (n = 217) were manually contoured by a team of experienced investigators. On the same images we derived automated contours using a ML algorithm. A contour quality scoring application randomly presented manual and automated contours to four blinded clinicians, who were asked to assign a quality score from a predefined rubric. Firstly, we analyzed the distribution of quality scores between the two contouring methods across all clinicians. Secondly, we analyzed the interobserver reliability between the raters. Finally, we examined whether there was a variation in scores based on the type of contour, SAX slice level, and underlying disease.

Results

The overall distribution of scores between the two methods was significantly different, with automated contours scoring better than the manual (OR (95% CI) = 1.17 (1.07–1.28), p = 0.001; n = 9401). There was substantial scoring agreement between raters for each contouring method independently, albeit it was significantly better for automated segmentation (automated: AC2 = 0.940, 95% CI, 0.937–0.943 vs manual: AC2 = 0.934, 95% CI, 0.931–0.937; p = 0.006). Next, the analysis of quality scores based on different factors was performed. Our approach helped identify trends patterns of lower segmentation quality as observed for left ventricle epicardial and basal contours with both methods. Similarly, significant differences in quality between the two methods were also found in dilated cardiomyopathy and hypertension.

Conclusions

Our results confirm the ability of our systematic scoring analysis to determine the clinical acceptability of automated contours. This approach focused on the contours' clinical utility could ultimately improve clinicians' confidence in artificial intelligence and its acceptability in the clinical workflow.

Cardiac Magnetic Resonance Radiomics Reveal Differential Impact of Sex, Age, and Vascular Risk Factors on Cardiac Structure and Myocardial Tissue

Background: Cardiovascular magnetic resonance (CMR) radiomics analysis provides multiple quantifiers of ventricular shape and myocardial texture, which may be used for detailed cardiovascular phenotyping. Objectives: We studied variation in CMR radiomics phenotypes by age and sex in healthy UK Biobank participants. Then, we examined independent associations of classical vascular risk factors (VRFs: smoking, diabetes, hypertension, high cholesterol) with CMR radiomics features, considering potential sex and age differential relationships. Design: Image acquisition was with 1.5 Tesla scanners (MAGNETOM Aera, Siemens). Three regions of interest were segmented from short axis stack images using an automated pipeline: right ventricle, left ventricle, myocardium. We extracted 237 radiomics features from each study using Pyradiomics. In a healthy subset of participants (n = 14,902) without cardiovascular disease or VRFs, we estimated independent associations of age and sex with each radiomics feature using linear regression models adjusted for body size. We then created a sample comprising individuals with at least one VRF matched to an equal number of healthy participants (n = 27,400). We linearly modelled each radiomics feature against age, sex, body size, and all the VRFs. Bonferroni adjustment for multiple testing was applied to all p-values. To aid interpretation, we organised the results into six feature clusters. Results: Amongst the healthy subset, men had larger ventricles with dimmer and less texturally complex myocardium than women. Increasing age was associated with smaller ventricles and greater variation in myocardial intensities. Broadly, all the VRFs were associated with dimmer, less varied signal intensities, greater uniformity of local intensity levels, and greater relative presence of low signal intensity areas within the myocardium. Diabetes and high cholesterol were also associated with smaller ventricular size, this association was of greater magnitude in men than women. The pattern of alteration of radiomics features with the VRFs was broadly consistent in men and women. However, the associations between intensity based radiomics features with both diabetes and hypertension were more prominent in women than men. Conclusions: We demonstrate novel independent associations of sex, age, and major VRFs with CMR radiomics phenotypes. Further studies into the nature and clinical significance of these phenotypes are needed.

Brain age estimation at tract group level and its association with daily life measures, cardiac risk factors and genetic variants

Brain age can be estimated using different Magnetic Resonance Imaging (MRI) modalities including diffusion MRI. Recent studies demonstrated that white matter (WM) tracts that share the same function might experience similar alterations. Therefore, in this work, we sought to investigate such issue focusing on five WM bundles holding that feature that is Association, Brainstem, Commissural, Limbic and Projection fibers, respectively. For each tract group, we estimated brain age for 15,335 healthy participants from United Kingdom Biobank relying on diffusion MRI data derived endophenotypes, Bayesian ridge regression modeling and 10 fold-cross validation. Furthermore, we estimated brain age for an Ensemble model that gathers all the considered WM bundles. Association analysis was subsequently performed between the estimated brain age delta as resulting from the six models, that is for each tract group as well as for the Ensemble model, and 38 daily life style measures, 14 cardiac risk factors and cardiovascular magnetic resonance imaging features and genetic variants. The Ensemble model that used all tracts from all fiber groups (FG) performed better than other models to estimate brain age. Limbic tracts based model reached the highest accuracy with a Mean Absolute Error (MAE) of 5.08, followed by the Commissural ([Formula: see text]), Association ([Formula: see text]), and Projection ([Formula: see text]) ones. The Brainstem tracts based model was the less accurate achieving a MAE of 5.86. Accordingly, our study suggests that the Limbic tracts experience less brain aging or allows for more accurate estimates compared to other tract groups. Moreover, the results suggest that Limbic tract leads to the largest number of significant associations with daily lifestyle factors than the other tract groups. Lastly, two SNPs were significantly (p value [Formula: see text]) associated with brain age delta in the Projection fibers. Those SNPs are mapped to HIST1H1A and SLC17A3 genes.

A probabilistic deep motion model for unsupervised cardiac shape anomaly assessment

Automatic shape anomaly detection in large-scale imaging data can be useful for screening suboptimal segmentations and pathologies altering the cardiac morphology without intensive manual labour. We propose a deep probabilistic model for local anomaly detection in sequences of heart shapes, modelled as point sets, in a cardiac cycle. A deep recurrent encoder-decoder network captures the spatio-temporal dependencies to predict the next shape in the cycle and thus derive the outlier points that are attributed to excessive deviations from the network prediction. A predictive mixture distribution models the inlier and outlier classes via Gaussian and uniform distributions, respectively. A Gibbs sampling Expectation-Maximisation (EM) algorithm computes soft anomaly scores of the points via the posterior probabilities of each class in the E-step and estimates the parameters of the network and the predictive distribution in the M-step. We demonstrate the versatility of the method using two shape datasets derived from: (i) one million biventricular CMR images from 20,000 participants in the UK Biobank (UKB), and (ii) routine diagnostic imaging from Multi-Centre, Multi-Vendor, and Multi-Disease Cardiac Image (M&Ms). Experiments show that the detected shape anomalies in the UKB dataset are mostly associated with poor segmentation quality, and the predicted shape sequences show significant improvement over the input sequences. Furthermore, evaluations on U-Net based shapes from the M&Ms dataset reveals that the anomalies are attributable to the underlying pathologies that affect the ventricles. The proposed model can therefore be used as an effective mechanism to sift shape anomalies in large-scale cardiac imaging pipelines for further analysis.

New Imaging Signatures of Cardiac Alterations in Ischaemic Heart Disease and Cerebrovascular Disease Using CMR Radiomics

Background: Ischaemic heart disease (IHD) and cerebrovascular disease are two closely inter-related clinical entities. Cardiovascular magnetic resonance (CMR) radiomics may capture subtle cardiac changes associated with these two diseases providing new insights into the brain-heart interactions. Objective: To define the CMR radiomics signatures for IHD and cerebrovascular disease and study their incremental value for disease discrimination over conventional CMR indices. Methods: We analysed CMR images of UK Biobank's subjects with pre-existing IHD, ischaemic cerebrovascular disease, myocardial infarction (MI), and ischaemic stroke (IS) (n = 779, 267, 525, and 107, respectively). Each disease group was compared with an equal number of healthy controls. We extracted 446 shape, first-order, and texture radiomics features from three regions of interest (right ventricle, left ventricle, and left ventricular myocardium) in end-diastole and end-systole defined from segmentation of short-axis cine images. Systematic feature selection combined with machine learning (ML) algorithms (support vector machine and random forest) and 10-fold cross-validation tests were used to build the radiomics signature for each condition. We compared the discriminatory power achieved by the radiomics signature with conventional indices for each disease group, using the area under the curve (AUC), receiver operating characteristic (ROC) analysis, and paired t-test for statistical significance. A third model combining both radiomics and conventional indices was also evaluated. Results: In all the study groups, radiomics signatures provided a significantly better disease discrimination than conventional indices, as suggested by AUC (IHD:0.82 vs. 0.75; cerebrovascular disease: 0.79 vs. 0.77; MI: 0.87 vs. 0.79, and IS: 0.81 vs. 0.72). Similar results were observed with the combined models. In IHD and MI, LV shape radiomics were dominant. However, in IS and cerebrovascular disease, the combination of shape and intensity-based features improved the disease discrimination. A notable overlap of the radiomics signatures of IHD and cerebrovascular disease was also found. Conclusions: This study demonstrates the potential value of CMR radiomics over conventional indices in detecting subtle cardiac changes associated with chronic ischaemic processes involving the brain and heart, even in the presence of more heterogeneous clinical pictures. Radiomics analysis might also improve our understanding of the complex mechanisms behind the brain-heart interactions during ischaemia.

An Implementation of Patient-Specific Biventricular Mechanics Simulations With a Deep Learning and Computational Pipeline

Parameterised patient-specific models of the heart enable quantitative analysis of cardiac function as well as estimation of regional stress and intrinsic tissue stiffness. However, the development of personalised models and subsequent simulations have often required lengthy manual setup, from image labelling through to generating the finite element model and assigning boundary conditions. Recently, rapid patient-specific finite element modelling has been made possible through the use of machine learning techniques. In this paper, utilising multiple neural networks for image labelling and detection of valve landmarks, together with streamlined data integration, a pipeline for generating patient-specific biventricular models is applied to clinically-acquired data from a diverse cohort of individuals, including hypertrophic and dilated cardiomyopathy patients and healthy volunteers. Valve motion from tracked landmarks as well as cavity volumes measured from labelled images are used to drive realistic motion and estimate passive tissue stiffness values. The neural networks are shown to accurately label cardiac regions and features for these diverse morphologies. Furthermore, differences in global intrinsic parameters, such as tissue anisotropy and normalised active tension, between groups illustrate respective underlying changes in tissue composition and/or structure as a result of pathology. This study shows the successful application of a generic pipeline for biventricular modelling, incorporating artificial intelligence solutions, within a diverse cohort.

Applications of artificial intelligence in cardiovascular imaging

Research into artificial intelligence (AI) has made tremendous progress over the past decade. In particular, the AI-powered analysis of images and signals has reached human-level performance in many applications owing to the efficiency of modern machine learning methods, in particular deep learning using convolutional neural networks. Research into the application of AI to medical imaging is now very active, especially in the field of cardiovascular imaging because of the challenges associated with acquiring and analysing images of this dynamic organ. In this Review, we discuss the clinical questions in cardiovascular imaging that AI can be used to address and the principal methodological AI approaches that have been developed to solve the related image analysis problems. Some approaches are purely data-driven and rely mainly on statistical associations, whereas others integrate anatomical and physiological information through additional statistical, geometric and biophysical models of the human heart. In a structured manner, we provide representative examples of each of these approaches, with particular attention to the underlying computational imaging challenges. Finally, we discuss the remaining limitations of AI approaches in cardiovascular imaging (such as generalizability and explainability) and how they can be overcome.

Spatio-Temporal Multi-Task Learning for Cardiac MRI Left Ventricle Quantification

Quantitative assessment of cardiac left ventricle (LV) morphology is essential to assess cardiac function and improve the diagnosis of different cardiovascular diseases. In current clinical practice, LV quantification depends on the measurement of myocardial shape indices, which is usually achieved by manual contouring of the endo- and epicardial. However, this process subjected to inter and intra-observer variability, and it is a time-consuming and tedious task. In this article, we propose a spatio-temporal multi-task learning approach to obtain a complete set of measurements quantifying cardiac LV morphology, regional-wall thickness (RWT), and additionally detecting the cardiac phase cycle (systole and diastole) for a given 3D Cine-magnetic resonance (MR) image sequence. We first segment cardiac LVs using an encoder-decoder network and then introduce a multitask framework to regress 11 LV indices and classify the cardiac phase, as parallel tasks during model optimization. The proposed deep learning model is based on the 3D spatio-temporal convolutions, which extract spatial and temporal features from MR images. We demonstrate the efficacy of the proposed method using cine-MR sequences of 145 subjects and comparing the performance with other state-of-the-art quantification methods. The proposed method obtained high prediction accuracy, with an average mean absolute error (MAE) of 129 mm ², 1.23 mm, 1.76 mm, Pearson correlation coefficient (PCC) of 96.4%, 87.2%, and 97.5% for LV and myocardium (Myo) cavity regions, 6 RWTs, 3 LV dimensions, and an error rate of 9.0% for phase classification. The experimental results highlight the robustness of the proposed method, despite varying degrees of cardiac morphology, image appearance, and low contrast in the cardiac MR sequences.

Associations of Meat and Fish Consumption With Conventional and Radiomics Cardiovascular Magnetic Resonance Phenotypes in the UK Biobank

Background: Greater red and processed meat consumption has been linked to adverse cardiovascular outcomes. However, the impact of these exposures on cardiovascular magnetic resonance (CMR) phenotypes has not been adequately studied.

Objective: We describe novel associations of meat intake with cardiovascular phenotypes and investigate underlying mechanisms through consideration of a range of covariates.

Design: We studied 19,408 UK Biobank participants with CMR data available. Average daily red and processed meat consumption was determined through food frequency questionnaires and expressed as a continuous variable. Oily fish was studied as a comparator, previously associated with favourable cardiac outcomes. We considered associations with conventional CMR indices (ventricular volumes, ejection fraction, stroke volume, left ventricular mass), novel CMR radiomics features (shape, first-order, texture), and arterial compliance measures (arterial stiffness index, aortic distensibility). We used multivariable linear regression to investigate relationships between meat intake and cardiovascular phenotypes, adjusting for confounders (age, sex, deprivation, educational level, smoking, alcohol intake, exercise) and potential covariates on the causal pathway (hypertension, hypercholesterolaemia, diabetes, body mass index).

Results: Greater red and processed meat consumption was associated with an unhealthy pattern of biventricular remodelling, worse cardiac function, and poorer arterial compliance. In contrast, greater oily fish consumption was associated with a healthier cardiovascular phenotype and better arterial compliance. There was partial attenuation of associations between red meat and conventional CMR indices with addition of covariates potentially on the causal pathway, indicating a possible mechanistic role for these cardiometabolic morbidities. However, other associations were not altered with inclusion of these covariates, suggesting importance of alternative biological mechanisms underlying these relationships. Radiomics analysis provided deeper phenotyping, demonstrating association of the different dietary habits with distinct ventricular geometry and left ventricular myocardial texture patterns.

Conclusions: Greater red and processed meat consumption is associated with impaired cardiovascular health, both in terms of markers of arterial disease and of cardiac structure and function. Cardiometabolic morbidities appeared to have a mechanistic role in the associations of red meat with ventricular phenotypes, but less so for other associations suggesting importance of alternative mechanism for these relationships.

Cardiovascular magnetic resonance imaging in the UK Biobank: a major international health research resource

The UK Biobank (UKB) is a health research resource of major international importance, incorporating comprehensive characterization of >500 000 men and women recruited between 2006 and 2010 from across the UK. There is prospective tracking of health outcomes for all participants through linkages with national cohorts (death registers, cancer registers, electronic hospital records, and primary care records). The dataset has been enhanced with the UKB imaging study, which aims to scan a subset of 100 000 participants. The imaging protocol includes magnetic resonance imaging of the brain, heart, and abdomen, carotid ultrasound, and whole-body dual X-ray absorptiometry. Since its launch in 2015, over 48 000 participants have completed the imaging study with scheduled completion in 2023. Repeat imaging of 10 000 participants has been approved and commenced in 2019. The cardiovascular magnetic resonance (CMR) scan provides detailed assessment of cardiac structure and function comprising bright blood anatomic assessment (sagittal, coronal, and axial), left and right ventricular cine images (long and short axes), myocardial tagging, native T1 mapping, aortic flow, and imaging of the thoracic aorta. The UKB is an open access resource available to health researchers across all scientific disciplines from both academia and industry with no preferential access or exclusivity. In this paper, we consider how we may best utilize the UKB CMR data to advance cardiovascular research and review notable achievements to date.

Kidney segmentation in neck-to-knee body MRI of 40,000 UK Biobank participants

The UK Biobank is collecting extensive data on health-related characteristics of over half a million volunteers. The biological samples of blood and urine can provide valuable insight on kidney function, with important links to cardiovascular and metabolic health. Further information on kidney anatomy could be obtained by medical imaging. In contrast to the brain, heart, liver, and pancreas, no dedicated Magnetic Resonance Imaging (MRI) is planned for the kidneys. An image-based assessment is nonetheless feasible in the neck-to-knee body MRI intended for abdominal body composition analysis, which also covers the kidneys. In this work, a pipeline for automated segmentation of parenchymal kidney volume in UK Biobank neck-to-knee body MRI is proposed. The underlying neural network reaches a relative error of 3.8%, with Dice score 0.956 in validation on 64 subjects, close to the 2.6% and Dice score 0.962 for repeated segmentation by one human operator. The released MRI of about 40,000 subjects can be processed within one day, yielding volume measurements of left and right kidney. Algorithmic quality ratings enabled the exclusion of outliers and potential failure cases. The resulting measurements can be studied and shared for large-scale investigation of associations and longitudinal changes in parenchymal kidney volume.

Recovering from missing data in population imaging - Cardiac MR image imputation via conditional generative adversarial nets

Accurate ventricular volume measurements are the primary indicators of normal/abnor- mal cardiac function and are dependent on the Cardiac Magnetic Resonance (CMR) volumes being complete. However, missing or unusable slices owing to the presence of image artefacts such as respiratory or motion ghosting, aliasing, ringing and signal loss in CMR sequences, significantly hinder accuracy of anatomical and functional cardiac quantification, and recovering from those is insufficiently addressed in population imaging. In this work, we propose a new robust approach, coined Image Imputation Generative Adversarial Network (I2-GAN), to learn key features of cardiac short axis (SAX) slices near missing information, and use them as conditional variables to infer missing slices in the query volumes. In I2-GAN, the slices are first mapped to latent vectors with position features through a regression net. The latent vector corresponding to the desired position is then projected onto the slice manifold, conditioned on intensity features through a generator net. The generator comprises residual blocks with normalisation layers that are modulated with auxiliary slice information, enabling propagation of fine details through the network. In addition, a multi-scale discriminator was implemented, along with a discriminator-based feature matching loss, to further enhance performance and encourage the synthesis of visually realistic slices. Experimental results show that our method achieves significant improvements over the state-of-the-art, in missing slice imputation for CMR, with an average SSIM of 0.872. Linear regression analysis yields good agreement between reference and imputed CMR images for all cardiac measurements, with correlation coefficients of 0.991 for left ventricular volume, 0.977 for left ventricular mass and 0.961 for right ventricular volume.

Virtual clinical trials in medical imaging: a review

The accelerating complexity and variety of medical imaging devices and methods have outpaced the ability to evaluate and optimize their design and clinical use. This is a significant and increasing challenge for both scientific investigations and clinical applications. Evaluations would ideally be done using clinical imaging trials. These experiments, however, are often not practical due to ethical limitations, expense, time requirements, or lack of ground truth. Virtual clinical trials (VCTs) (also known as in silico imaging trials or virtual imaging trials) offer an alternative means to efficiently evaluate medical imaging technologies virtually. They do so by simulating the patients, imaging systems, and interpreters. The field of VCTs has been constantly advanced over the past decades in multiple areas. We summarize the major developments and current status of the field of VCTs in medical imaging. We review the core components of a VCT: computational phantoms, simulators of different imaging modalities, and interpretation models. We also highlight some of the applications of VCTs across various imaging modalities.

Explainable Anatomical Shape Analysis Through Deep Hierarchical Generative Models

Quantification of anatomical shape changes currently relies on scalar global indexes which are largely insensitive to regional or asymmetric modifications. Accurate assessment of pathology-driven anatomical remodeling is a crucial step for the diagnosis and treatment of many conditions. Deep learning approaches have recently achieved wide success in the analysis of medical images, but they lack interpretability in the feature extraction and decision processes. In this work, we propose a new interpretable deep learning model for shape analysis. In particular, we exploit deep generative networks to model a population of anatomical segmentations through a hierarchy of conditional latent variables. At the highest level of this hierarchy, a two-dimensional latent space is simultaneously optimised to discriminate distinct clinical conditions, enabling the direct visualisation of the classification space. Moreover, the anatomical variability encoded by this discriminative latent space can be visualised in the segmentation space thanks to the generative properties of the model, making the classification task transparent. This approach yielded high accuracy in the categorisation of healthy and remodelled left ventricles when tested on unseen segmentations from our own multi-centre dataset as well as in an external validation set, and on hippocampi from healthy controls and patients with Alzheimer's disease when tested on ADNI data. More importantly, it enabled the visualisation in three-dimensions of both global and regional anatomical features which better discriminate between the conditions under exam. The proposed approach scales effectively to large populations, facilitating high-throughput analysis of normal anatomy and pathology in large-scale studies of volumetric imaging.

The UK Biobank imaging enhancement of 100,000 participants: rationale, data collection, management and future directions

UK Biobank is a population-based cohort of half a million participants aged 40-69 years recruited between 2006 and 2010. In 2014, UK Biobank started the world's largest multi-modal imaging study, with the aim of re-inviting 100,000 participants to undergo brain, cardiac and abdominal magnetic resonance imaging, dual-energy X-ray absorptiometry and carotid ultrasound. The combination of large-scale multi-modal imaging with extensive phenotypic and genetic data offers an unprecedented resource for scientists to conduct health-related research. This article provides an in-depth overview of the imaging enhancement, including the data collected, how it is managed and processed, and future directions.

Machine Learning Approaches for Myocardial Motion and Deformation Analysis

Information about myocardial motion and deformation is key to differentiate normal and abnormal conditions. With the advent of approaches relying on data rather than pre-conceived models, machine learning could either improve the robustness of motion quantification or reveal patterns of motion and deformation (rather than single parameters) that differentiate pathologies. We review machine learning strategies for extracting motion-related descriptors and analyzing such features among populations, keeping in mind constraints specific to the cardiac application.