Mini Review: Deep Learning for Atrial Segmentation From Late Gadolinium-Enhanced MRIs

The beating heart: artificial intelligence for cardiovascular application in the clinic

Artificial intelligence (AI) integration in cardiac magnetic resonance imaging presents new and exciting avenues for advancing patient care, automating post-processing tasks, and enhancing diagnostic precision and outcomes. The use of AI significantly streamlines the examination workflow through the reduction of acquisition and postprocessing durations, coupled with the automation of scan planning and acquisition parameters selection. This has led to a notable improvement in examination workflow efficiency, a reduction in operator variability, and an enhancement in overall image quality. Importantly, AI unlocks new possibilities to achieve spatial resolutions that were previously unattainable in patients. Furthermore, the potential for low-dose and contrast-agent-free imaging represents a stride toward safer and more patient-friendly diagnostic procedures. Beyond these benefits, AI facilitates precise risk stratification and prognosis evaluation by adeptly analysing extensive datasets. This comprehensive review article explores recent applications of AI in the realm of cardiac magnetic resonance imaging, offering insights into its transformative potential in the field.

Usformer: A small network for left atrium segmentation of 3D LGE MRI

Left atrial (LA) fibrosis plays a vital role as a mediator in the progression of atrial fibrillation. 3D late gadolinium-enhancement (LGE) MRI has been proven effective in identifying LA fibrosis. Image analysis of 3D LA LGE involves manual segmentation of the LA wall, which is both lengthy and challenging. Automated segmentation poses challenges owing to the diverse intensities in data from various vendors, the limited contrast between LA and surrounding tissues, and the intricate anatomical structures of the LA. Current approaches relying on 3D networks are computationally intensive since 3D LGE MRIs and the networks are large. Regarding this issue, most researchers came up with two-stage methods: initially identifying the LA center using a scaled-down version of the MRIs and subsequently cropping the full-resolution MRIs around the LA center for final segmentation. We propose a lightweight transformer-based 3D architecture, Usformer, designed to precisely segment LA volume in a single stage, eliminating error propagation associated with suboptimal two-stage training. The transposed attention facilitates capturing the global context in large 3D volumes without significant computation requirements. Usformer outperforms the state-of-the-art supervised learning methods in terms of accuracy and speed. First, with the smallest Hausdorff Distance (HD) and Average Symmetric Surface Distance (ASSD), it achieved a dice score of 93.1% and 92.0% in the 2018 Atrial Segmentation Challenge and our local institutional dataset, respectively. Second, the number of parameters and computation complexity are largely reduced by 2.8x and 3.8x, respectively. Moreover, Usformer does not require a large dataset. When only 16 labeled MRI scans are used for training, Usformer achieves a 92.1% dice score in the challenge dataset. The proposed Usformer delineates the boundaries of the LA wall relatively accurately, which may assist in the clinical translation of LA LGE for planning catheter ablation of atrial fibrillation.

Multi-modality cardiac image computing: A survey

Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and improves the efficacy of cardiovascular interventions and clinical outcomes. Fully-automated processing and quantitative analysis of multi-modality cardiac images could have a direct impact on clinical research and evidence-based patient management. However, these require overcoming significant challenges including inter-modality misalignment and finding optimal methods to integrate information from different modalities. This paper aims to provide a comprehensive review of multi-modality imaging in cardiology, the computing methods, the validation strategies, the related clinical workflows and future perspectives. For the computing methodologies, we have a favored focus on the three tasks, i.e., registration, fusion and segmentation, which generally involve multi-modality imaging data, either combining information from different modalities or transferring information across modalities. The review highlights that multi-modality cardiac imaging data has the potential of wide applicability in the clinic, such as trans-aortic valve implantation guidance, myocardial viability assessment, and catheter ablation therapy and its patient selection. Nevertheless, many challenges remain unsolved, such as missing modality, modality selection, combination of imaging and non-imaging data, and uniform analysis and representation of different modalities. There is also work to do in defining how the well-developed techniques fit in clinical workflows and how much additional and relevant information they introduce. These problems are likely to continue to be an active field of research and the questions to be answered in the future.

Successes and challenges of artificial intelligence in cardiology

In the past decades there has been a substantial evolution in data management and data processing techniques. New data architectures made analysis of big data feasible, healthcare is orienting towards personalized medicine with digital health initiatives, and artificial intelligence (AI) is becoming of increasing importance. Despite being a trendy research topic, only very few applications reach the stage where they are implemented in clinical practice. This review provides an overview of current methodologies and identifies clinical and organizational challenges for AI in healthcare.

Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review

In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.

Role of advanced imaging with cardiac computed tomography and MRI in atrial and ventricular ablation

PURPOSE OF REVIEW

Increasing evidence supports the use of advanced imaging with cardiac computed tomography (CCT) and cardiac magnetic resonance (CMR) in the work-up of patients with arrythmias being considered for ablation.

RECENT FINDINGS

Advances in imaging technology and postprocessing are facilitating the use of advanced imaging before, during and after ablation in patients with both atrial and ventricular arrhythmias.In atrial arrythmias, quantitative assessment of left atrial wall thickness on CCT and quantification of late gadolinium enhancement (LGE) on CMR identify patients more likely to develop recurrent atrial arrythmias following ablation. In addition, in patients with recurrent arrythmia post ablation, LGE CMR can potentially identify targets for repeat ablation.In ventricular arrythmias, qualitative assessment of LGE can aide in determining the optimal ablation approach and predicts likelihood of ventricular arrythmias inducibility. Quantitative assessment of LGE can identify conduction channels that can be targeted for ablation. On CCT, quantitative assessment of left ventricular wall thickness can demonstrate myocardial ridges associated with re-entrant circuits for ablation.

SUMMARY

This review focuses on the utility of CCT and CMR in identifying key anatomical components and arrhythmogenic substrate contributing to both atrial and ventricular arrhythmias in patients being considered for ablation. Advanced imaging has the potential to improve procedural outcomes, decrease complications and shorten procedural time.

Associations between fully-automated, 3D-based functional analysis of the left atrium and classification schemes in atrial fibrillation

Background

Atrial fibrillation (AF) has been linked to left atrial (LA) enlargement. Whereas most studies focused on 2D-based estimation of static LA volume (LAV), we used a fully-automatic convolutional neural network (CNN) for time-resolved (CINE) volumetry of the whole LA on cardiac MRI (cMRI). Aim was to investigate associations between functional parameters from fully-automated, 3D-based analysis of the LA and current classification schemes in AF.

Methods

We retrospectively analyzed consecutive AF patients who underwent cMRI on 1.5T systems including a stack of oblique-axial CINE series covering the whole LA. The LA was automatically segmented by a validated CNN. In the resulting volume-time curves, maximum, minimum and LAV before atrial contraction were automatically identified. Active, passive and total LA emptying fractions (LAEF) were calculated and compared to clinical classifications (AF Burden score (AFBS), increased stroke risk (CHA₂DS₂VASc≥2), AF type (paroxysmal/persistent), EHRA score, and AF risk factors). Moreover, multivariable linear regression models (mLRM) were used to identify associations with AF risk factors.

Results

Overall, 102 patients (age 61±9 years, 17% female) were analyzed. Active LAEF (LAEF_active) decreased significantly with an increase of AFBS (minimal: 44.0%, mild: 36.2%, moderate: 31.7%, severe: 20.8%, p<0.003) which was primarily caused by an increase of minimum LAV. Likewise, LAEF_active was lower in patients with increased stroke risk (30.7% vs. 38.9%, p = 0.002). AF type and EHRA score did not show significant differences between groups. In mLRM, a decrease of LAEF_active was associated with higher age (per year: -0.3%, p = 0.02), higher AFBS (per category: -4.2%, p<0.03) and heart failure (-12.1%, p<0.04).

Conclusions

Fully-automatic morphometry of the whole LA derived from cMRI showed significant relationships between LAEF_active with increased stroke risk and severity of AFBS. Furthermore, higher age, higher AFBS and presence of heart failure were independent predictors of reduced LAEF_active, indicating its potential usefulness as an imaging biomarker.

Uncertainty-guided symmetric multi-level supervision network for 3D left atrium segmentation in late gadolinium-enhanced MRI

PURPOSE

Atrial fibrillation is a common arrhythmia and requires volumetric imaging to guide the therapy procedure. Late gadolinium-enhanced magnetic resonance imaging (LGE MRI) is an efficient non-invasive technology for imaging the diseased heart. Three-dimensional segmentation of the left atrium (LA) in LGE MRI is a fundamental step for guiding the therapy of patients with atrial fibrillation. However, the low contrast and fuzzy surface of the LA in LGE MRI make accurate and objective LA segmentation challenge. The purpose of this study is to propose an automatic and efficient LA segmentation model based on a convolutional neural network to obtain a more accurate predicted surface and improve the LA segmentation results.

METHODS

In this study, we proposed an uncertainty-guided symmetric multi-level supervision network for 3D LA segmentation in LGE MRI. Firstly, we constructed a symmetric multi-level supervision structure to combine the corresponding features from the encoding and decoding stages to learn the multi-scale representation of LA. Secondly, we formulated the discrepancy of predictions of our model as model uncertainty. Then we proposed an uncertainty-guided objective function to further increase the segmentation accuracy on the surface.

RESULTS

We evaluated our proposed model on the public LA segmentation database using four universal metrics. The proposed model achieved Hausdorff Distance of 11.68 mm, average symmetric surface distance of 0.92 mm, Dice score of 0.92, and Jaccard of 0.85. Compared with state-of-the-art models, our model achieved the best Hausdorff Distance that is sensitive to surface accuracy. For the other three metrics, our model also achieved better or comparable performance.

CONCLUSIONS

We proposed an efficient automatic LA segmentation model that consisted of a symmetric multi-level supervision structure and an uncertainty-guided objective function. Compared to other models, we designed an additional supervision branch in the encoding stage to learn more detailed representations of LA while learning global context information through the multi-level structure of each supervision branch. To address the fuzzy surface challenge of LA segmentation in LGE MRI, we leveraged the model uncertainty to enhance the distinguishing ability of the model on the surface, thereby the predicted accuracy of the LA surface can be further increased. We conducted extensive ablation and comparative experiments with state-of-the-art models. The experiment results demonstrated that our proposed model could handle the complex structure of LA and had superior advantages in improving the segmentation performance on the surface. This article is protected by copyright. All rights reserved.

Convolutional Neural Networks for Mechanistic Driver Detection in Atrial Fibrillation

The maintaining and initiating mechanisms of atrial fibrillation (AF) remain controversial. Deep learning is emerging as a powerful tool to better understand AF and improve its treatment, which remains suboptimal. This paper aims to provide a solution to automatically identify rotational activity drivers in endocardial electrograms (EGMs) with convolutional recurrent neural networks (CRNNs). The CRNN model was compared with two other state-of-the-art methods (SimpleCNN and attention-based time-incremental convolutional neural network (ATI-CNN)) for different input signals (unipolar EGMs, bipolar EGMs, and unipolar local activation times), sampling frequencies, and signal lengths. The proposed CRNN obtained a detection score based on the Matthews correlation coefficient of 0.680, an ATI-CNN score of 0.401, and a SimpleCNN score of 0.118, with bipolar EGMs as input signals exhibiting better overall performance. In terms of signal length and sampling frequency, no significant differences were found. The proposed architecture opens the way for new ablation strategies and driver detection methods to better understand the AF problem and its treatment.

Medical image analysis on left atrial LGE MRI for atrial fibrillation studies: A review

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is commonly used to visualize and quantify left atrial (LA) scars. The position and extent of LA scars provide important information on the pathophysiology and progression of atrial fibrillation (AF). Hence, LA LGE MRI computing and analysis are essential for computer-assisted diagnosis and treatment stratification of AF patients. Since manual delineations can be time-consuming and subject to intra- and inter-expert variability, automating this computing is highly desired, which nevertheless is still challenging and under-researched. This paper aims to provide a systematic review on computing methods for LA cavity, wall, scar, and ablation gap segmentation and quantification from LGE MRI, and the related literature for AF studies. Specifically, we first summarize AF-related imaging techniques, particularly LGE MRI. Then, we review the methodologies of the four computing tasks in detail and summarize the validation strategies applied in each task as well as state-of-the-art results on public datasets. Finally, the possible future developments are outlined, with a brief survey on the potential clinical applications of the aforementioned methods. The review indicates that the research into this topic is still in the early stages. Although several methods have been proposed, especially for the LA cavity segmentation, there is still a large scope for further algorithmic developments due to performance issues related to the high variability of enhancement appearance and differences in image acquisition.

Current Advancement in Diagnosing Atrial Fibrillation by Utilizing Wearable Devices and Artificial Intelligence: A Review Study

Atrial fibrillation (AF) is a common arrhythmia affecting 8–10% of the population older than 80 years old. The importance of early diagnosis of atrial fibrillation has been broadly recognized since arrhythmias significantly increase the risk of stroke, heart failure and tachycardia-induced cardiomyopathy with reduced cardiac function. However, the prevalence of atrial fibrillation is often underestimated due to the high frequency of clinically silent atrial fibrillation as well as paroxysmal atrial fibrillation, both of which are hard to catch by routine physical examination or 12-lead electrocardiogram (ECG). The development of wearable devices has provided a reliable way for healthcare providers to uncover undiagnosed atrial fibrillation in the population, especially those most at risk. Furthermore, with the advancement of artificial intelligence and machine learning, the technology is now able to utilize the database in assisting detection of arrhythmias from the data collected by the devices. In this review study, we compare the different wearable devices available on the market and review the current advancement in artificial intelligence in diagnosing atrial fibrillation. We believe that with the aid of the progressive development of technologies, the diagnosis of atrial fibrillation shall be made more effectively and accurately in the near future.

LA-Net: A Multi-Task Deep Network for the Segmentation of the Left Atrium

Although atrial fibrillation (AF) is the most common sustained atrial arrhythmia, treatment success for this condition remains suboptimal. Information from magnetic resonance imaging (MRI) has the potential to improve treatment efficacy, but there are currently few automatic tools for the segmentation of the atria in MR images. In the study, we propose a LA-Net, a multi-task network optimised to simultaneously generate left atrial segmentation and edge masks from MRI. LA-Net includes cross attention modules (CAMs) and enhanced decoder modules (EDMs) to purposefully select the most meaningful edge information for segmentation and smoothly incorporate it into segmentation masks at multiple-scales. We evaluate the performance of LA-Net on two MR sequences: late gadolinium enhanced (LGE) atrial MRI and atrial short axis balanced steady state free precession (bSSFP) MRI. LA-Net gives Hausdorff distances of 12.43 mm and Dice scores of 0.92 on the LGE (STACOM 2018) dataset and Hausdorff distances of 17.41 mm and Dice scores of 0.90 on the bSSFP (in-house) dataset without any post-processing, surpassing previously proposed segmentation networks, including U-Net and SEGANet. Our method allows automatic extraction of information about the LA from MR images, which can play an important role in the management of AF patients.

Recent Advances in Fibrosis and Scar Segmentation From Cardiac MRI: A State-of-the-Art Review and Future Perspectives

Segmentation of cardiac fibrosis and scars is essential for clinical diagnosis and can provide invaluable guidance for the treatment of cardiac diseases. Late Gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) has been successful in guiding the clinical diagnosis and treatment reliably. For LGE CMR, many methods have demonstrated success in accurately segmenting scarring regions. Co-registration with other non-contrast-agent (non-CA) modalities [e.g., balanced steady-state free precession (bSSFP) cine magnetic resonance imaging (MRI)] can further enhance the efficacy of automated segmentation of cardiac anatomies. Many conventional methods have been proposed to provide automated or semi-automated segmentation of scars. With the development of deep learning in recent years, we can also see more advanced methods that are more efficient in providing more accurate segmentations. This paper conducts a state-of-the-art review of conventional and current state-of-the-art approaches utilizing different modalities for accurate cardiac fibrosis and scar segmentation.

Understanding PITX2-Dependent Atrial Fibrillation Mechanisms through Computational Models

Atrial fibrillation (AF) is a common arrhythmia. Better prevention and treatment of AF are needed to reduce AF-associated morbidity and mortality. Several major mechanisms cause AF in patients, including genetic predispositions to AF development. Genome-wide association studies have identified a number of genetic variants in association with AF populations, with the strongest hits clustering on chromosome 4q25, close to the gene for the homeobox transcription PITX2. Because of the inherent complexity of the human heart, experimental and basic research is insufficient for understanding the functional impacts of PITX2 variants on AF. Linking PITX2 properties to ion channels, cells, tissues, atriums and the whole heart, computational models provide a supplementary tool for achieving a quantitative understanding of the functional role of PITX2 in remodelling atrial structure and function to predispose to AF. It is hoped that computational approaches incorporating all we know about PITX2-related structural and electrical remodelling would provide better understanding into its proarrhythmic effects leading to development of improved anti-AF therapies. In the present review, we discuss advances in atrial modelling and focus on the mechanistic links between PITX2 and AF. Challenges in applying models for improving patient health are described, as well as a summary of future perspectives.

Supervised Domain Adaptation for Automated Semantic Segmentation of the Atrial Cavity

Atrial fibrillation (AF) is the most common cardiac arrhythmia. At present, cardiac ablation is the main treatment procedure for AF. To guide and plan this procedure, it is essential for clinicians to obtain patient-specific 3D geometrical models of the atria. For this, there is an interest in automatic image segmentation algorithms, such as deep learning (DL) methods, as opposed to manual segmentation, an error-prone and time-consuming method. However, to optimize DL algorithms, many annotated examples are required, increasing acquisition costs. The aim of this work is to develop automatic and high-performance computational models for left and right atrium (LA and RA) segmentation from a few labelled MRI volumetric images with a 3D Dual U-Net algorithm. For this, a supervised domain adaptation (SDA) method is introduced to infer knowledge from late gadolinium enhanced (LGE) MRI volumetric training samples (80 LA annotated samples) to a network trained with balanced steady-state free precession (bSSFP) MR images of limited number of annotations (19 RA and LA annotated samples). The resulting knowledge-transferred model SDA outperformed the same network trained from scratch in both RA (Dice equals 0.9160) and LA (Dice equals 0.8813) segmentation tasks.

Whole-Heart High-Resolution Late Gadolinium Enhancement: Techniques and Clinical Applications

In cardiovascular magnetic resonance, late gadolinium enhancement (LGE) has become the cornerstone of myocardial tissue characterization. It is widely used in clinical routine to diagnose and characterize the myocardial tissue in a wide range of ischemic and nonischemic cardiomyopathies. The recent growing interest in imaging left atrial fibrosis has led to the development of novel whole‐heart high‐resolution late gadolinium enhancement (HR‐LGE) techniques. Indeed, conventional LGE is acquired in multiple breath‐holds with limited spatial resolution: ~1.4–1.8 mm in plane and 6–8 mm slice thickness, according to the Society for Cardiovascular Magnetic Resonance standardized guidelines. Such large voxel size prevents its use in thin structures such as the atrial or right ventricular walls. Whole‐heart 3D HR‐LGE images are acquired in free breathing to increase the spatial resolution (up to 1.3 × 1.3 × 1.3 mm³) and offer a better detection and depiction of focal atrial fibrosis. The downside of this increased resolution is the extended scan time of around 10 min, which hampers the spread of HR‐LGE in clinical practice. Initially introduced for atrial fibrosis imaging, HR‐LGE interest has evolved to be a tool to detect small scars in the ventricles and guide ablation procedures. Indeed, the detection of scars, nonvisible with conventional LGE, can be crucial in the diagnosis of myocardial infarction with nonobstructed coronary arteries, in the detection of the arrhythmogenic substrate triggering ventricular arrhythmia, and improve the confidence of clinicians in the challenging diagnoses such as the arrhythmogenic right ventricular cardiomyopathy. HR‐LGE also offers a precise visualization of left ventricular scar morphology that is particularly useful in planning ablation procedures and guiding them through the fusion of HR‐LGE images with electroanatomical mapping systems. In this narrative review, we attempt to summarize the technical particularities of whole‐heart HR‐LGE acquisition and provide an overview of its clinical applications with a particular focus on the ventricles.

Artificial intelligence for a personalized diagnosis and treatment of atrial fibrillation

Although atrial fibrillation (AF) is the most common cardiac arrhythmia, its early identification, diagnosis, and treatment is still challenging. Due to its heterogeneous mechanisms and risk factors, targeting an individualized treatment of AF demands a large amount of patient data to identify specific patterns. Artificial intelligence (AI) algorithms are particularly well suited for treating high-dimensional data, predicting outcomes, and eventually, optimizing strategies for patient management. The analysis of large patient samples combining different sources of information such as blood biomarkers, electrical signals, and medical images opens a new paradigm for improving diagnostic algorithms. In this review, we summarize suitable AI techniques for this purpose. In particular, we describe potential applications for understanding the structural and functional bases of the disease, as well as for improving early noninvasive diagnosis, developing more efficient therapies, and predicting long-term clinical outcomes of patients with AF.