Fully Automatic Left Atrium Segmentation From Late Gadolinium Enhanced Magnetic Resonance Imaging Using a Dual Fully Convolutional Neural Network

The role of artificial intelligence in cardiovascular magnetic resonance imaging

Cardiovascular magnetic resonance (CMR) imaging is the gold standard test for myocardial tissue characterization and chamber volumetric and functional evaluation. However, manual CMR analysis can be time-consuming and is subject to intra- and inter-observer variability. Artificial intelligence (AI) is a field that permits automated task performance through the identification of high-level and complex data relationships. In this review, we review the rapidly growing role of AI in CMR, including image acquisition, sequence prescription, artifact detection, reconstruction, segmentation, and data reporting and analysis including quantification of volumes, function, myocardial infarction (MI) and scar detection, and prediction of outcomes. We conclude with a discussion of the emerging challenges to widespread adoption and solutions that will allow for successful, broader uptake of this powerful technology.

RAS Dataset: A 3D Cardiac LGE-MRI Dataset for Segmentation of Right Atrial Cavity

The current challenge in effectively treating atrial fibrillation (AF) stems from a limited understanding of the intricate structure of the human atria. The objective and quantitative interpretation of the right atrium (RA) in late gadolinium-enhanced magnetic resonance imaging (LGE-MRI) scans relies heavily on its precise segmentation. Leveraging the potential of artificial intelligence (AI) for RA segmentation presents a promising solution. However, the successful implementation of AI in this context necessitates access to a substantial volume of annotated LGE-MRI images for model training. In this paper, we present a comprehensive 3D cardiac dataset comprising 50 high-resolution LGE-MRI scans, each meticulously annotated at the pixel level. The annotation process underwent rigorous standardization through crowdsourcing among a panel of medical experts, ensuring the accuracy and consistency of the annotations. Our dataset represents a significant contribution to the field, providing a valuable resource for advancing RA segmentation methods.

Usformer: A small network for left atrium segmentation of 3D LGE MRI

Left atrial (LA) fibrosis plays a vital role as a mediator in the progression of atrial fibrillation. 3D late gadolinium-enhancement (LGE) MRI has been proven effective in identifying LA fibrosis. Image analysis of 3D LA LGE involves manual segmentation of the LA wall, which is both lengthy and challenging. Automated segmentation poses challenges owing to the diverse intensities in data from various vendors, the limited contrast between LA and surrounding tissues, and the intricate anatomical structures of the LA. Current approaches relying on 3D networks are computationally intensive since 3D LGE MRIs and the networks are large. Regarding this issue, most researchers came up with two-stage methods: initially identifying the LA center using a scaled-down version of the MRIs and subsequently cropping the full-resolution MRIs around the LA center for final segmentation. We propose a lightweight transformer-based 3D architecture, Usformer, designed to precisely segment LA volume in a single stage, eliminating error propagation associated with suboptimal two-stage training. The transposed attention facilitates capturing the global context in large 3D volumes without significant computation requirements. Usformer outperforms the state-of-the-art supervised learning methods in terms of accuracy and speed. First, with the smallest Hausdorff Distance (HD) and Average Symmetric Surface Distance (ASSD), it achieved a dice score of 93.1% and 92.0% in the 2018 Atrial Segmentation Challenge and our local institutional dataset, respectively. Second, the number of parameters and computation complexity are largely reduced by 2.8x and 3.8x, respectively. Moreover, Usformer does not require a large dataset. When only 16 labeled MRI scans are used for training, Usformer achieves a 92.1% dice score in the challenge dataset. The proposed Usformer delineates the boundaries of the LA wall relatively accurately, which may assist in the clinical translation of LA LGE for planning catheter ablation of atrial fibrillation.

Multi-network approach for image segmentation in non-contrast enhanced cardiac 3D MRI of arrhythmic patients

Left atrial appendage (LAA) is the source of thrombi formation in more than 90% of strokes in patients with nonvalvular atrial fibrillation. Catheter-based LAA occlusion is being increasingly applied as a treatment strategy to prevent stroke. Anatomical complexity of LAA makes percutaneous occlusion commonly performed under transesophageal echocardiography (TEE) and X-ray (XR) guidance especially challenging. Image fusion techniques integrating 3D anatomical models derived from pre-procedural imaging into the live XR fluoroscopy can be applied to guide each step of the LAA closure. Cardiac magnetic resonance (CMR) imaging gains in importance for radiation-free evaluation of cardiac morphology as alternative to gold-standard TEE or computed tomography angiography (CTA). Manual delineation of cardiac structures from non-contrast enhanced CMR is, however, labor-intensive, tedious, and challenging due to the rather low contrast. Additionally, arrhythmia often impairs the image quality in ECG synchronized acquisitions causing blurring and motion artifacts. Thus, for cardiac segmentation in arrhythmic patients, there is a strong need for an automated image segmentation method. Deep learning-based methods have shown great promise in medical image analysis achieving superior performance in various imaging modalities and different clinical applications. Fully-convolutional neural networks (CNNs), especially U-Net, have become the method of choice for cardiac segmentation. In this paper, we propose an approach for automatic segmentation of cardiac structures from non-contrast enhanced CMR images of arrhythmic patients based on CNNs implemented in a multi-stage pipeline. Two-stage implementation allows subdividing the task into localization of the relevant cardiac structures and segmentation of these structures from the cropped sub-regions obtained from previous step leading to efficient and effective way of automated cardiac segmentation.

Artificial Intelligence in the Image-Guided Care of Atrial Fibrillation

Atrial fibrillation arises mainly due to abnormalities in the cardiac conduction system and is associated with anatomical remodeling of the atria and the pulmonary veins. Cardiovascular imaging techniques, such as echocardiography, computed tomography, and magnetic resonance imaging, are crucial in the management of atrial fibrillation, as they not only provide anatomical context to evaluate structural alterations but also help in determining treatment strategies. However, interpreting these images requires significant human expertise. The potential of artificial intelligence in analyzing these images has been repeatedly suggested due to its ability to automate the process with precision comparable to human experts. This review summarizes the benefits of artificial intelligence in enhancing the clinical care of patients with atrial fibrillation through cardiovascular image analysis. It provides a detailed overview of the two most critical steps in image-guided AF management, namely, segmentation and classification. For segmentation, the state-of-the-art artificial intelligence methodologies and the factors influencing the segmentation performance are discussed. For classification, the applications of artificial intelligence in the diagnosis and prognosis of atrial fibrillation are provided. Finally, this review also scrutinizes the current challenges hindering the clinical applicability of these methods, with the aim of guiding future research toward more effective integration into clinical practice.

Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review

In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.

Automatic Segmentation of the Left Atrium from Computed Tomography Angiography Images

The left atrial appendage (LAA) causes 91% of thrombi in atrial fibrillation patients, a potential harbinger of stroke. Leveraging computed tomography angiography (CTA) images, radiologists interpret the left atrium (LA) and LAA geometries to stratify stroke risk. Nevertheless, accurate LA segmentation remains a time-consuming task with high inter-observer variability. Binary masks of the LA and their corresponding CTA images were used to train and test a 3D U-Net to automate LA segmentation. One model was trained using the entire unified-image-volume while a second model was trained on regional patch-volumes which were run for inference and then assimilated back into the full volume. The unified-image-volume U-Net achieved median DSCs of 0.92 and 0.88 for the train and test sets, respectively; the patch-volume U-Net achieved median DSCs of 0.90 and 0.89 for the train and test sets, respectively. This indicates that the unified-image-volume and patch-volume U-Net models captured up to 88 and 89% of the LA/LAA boundary's regional complexity, respectively. Additionally, the results indicate that the LA/LAA were fully captured in most of the predicted segmentations. By automating the segmentation process, our deep learning model can expedite LA/LAA shape, informing stratification of stroke risk.

Cardiac Magnetic Resonance Image Segmentation Method Based on Multi-Scale Feature Fusion and Sequence Relationship Learning

Accurate segmentation of the left atrial structure using magnetic resonance images provides an important basis for the diagnosis of atrial fibrillation (AF) and its treatment using robotic surgery. In this study, an image segmentation method based on sequence relationship learning and multi-scale feature fusion is proposed for 3D to 2D sequence conversion in cardiac magnetic resonance images and the varying scales of left atrial structures within different slices. Firstly, a convolutional neural network layer with an attention module was designed to extract and fuse contextual information at different scales in the image, to strengthen the target features using the correlation between features in different regions within the image, and to improve the network's ability to distinguish the left atrial structure. Secondly, a recurrent neural network layer oriented to two-dimensional images was designed to capture the correlation of left atrial structures in adjacent slices by simulating the continuous relationship between sequential image slices. Finally, a combined loss function was constructed to reduce the effect of positive and negative sample imbalance and improve model stability. The Dice, IoU, and Hausdorff distance values reached 90.73%, 89.37%, and 4.803 mm, respectively, based on the LASC2013 (left atrial segmentation challenge in 2013) dataset; the corresponding values reached 92.05%, 89.41% and 9.056 mm, respectively, based on the ASC2018 (atrial segmentation challenge at 2018) dataset.

GCW-UNet segmentation of cardiac magnetic resonance images for evaluation of left atrial enlargement

BACKGROUND AND OBJECTIVE

Left atrial enlargement (LAE) is an anatomical variation of the left atrium and the result of the long-term increase of left atrial pressure. Most of the increase in stress or volume is due to potential cardiovascular disease. Studies have shown that LAE can independently predict the development of clinically significant cardiovascular disease and heart failure. If the left atrial volume is accurately measured, it will be an essential indicator of human health and an essential means for doctors to find patients' potential diseases. We can analyze the dynamic changes in the left atrial structure and analyze left atrial dilation. However, manual segmentation was inefficient and error-prone before the 3D reconstruction of the left atrium. In order to solve this problem, a convolution neural network (CNN) method based on cardiac magnetic resonance image (MRI) is proposed to automatically segment the left atrial region.

METHODOLOGY

In this paper, we have proposed and developed a novel U-Net with Gaussian blur and channel weight neural network (GCW-UNet) to automatically segment the left atrial region in the MRI of a patient with LAE. After Gaussian blur, different resolutions of the MRI are obtained. High-resolution MRI clearly shows the detailed features of the left atrium, while low-resolution MRI clearly shows the overall outline of the left atrium, which can solve the problem of more minor MRI features. Adaptive channel weights can enhance the atrial segmentation capability of the network.

RESULTS

Compared with the state-of-the-art left atrial segmentation methods, our CNN-based technique results in the segmentation of the left atrium being closer to the manual segmentation by an experienced radiologist. On the test datasets, the mean Dice similarity coefficient reaches 93.57%.

CONCLUSION

Firstly, MRI has a small number of imaging artifacts, which results in low segmentation accuracy. Our method successfully solves the problem. Secondly, due to the high similarity between the background (the area outside the left atrium) and the foreground (the left atrium) in MRI, traditional neural networks misclassify the background as the foreground. Our GCW-Unit can address the imbalanced number of pixels between the foreground and background. Finally, after segmenting the left atrium in the MRI by GCW-Unit, we reconstructed the left atrium to model a three-dimensional heart of a patient suffering from LAE. Based on the different time frames of one heartbeat, we could present the dynamics of the left atrial structure during a cardiac cycle. This can better assist in the evaluation of LAE in heart patients.

The Applications of Artificial Intelligence in Cardiovascular Magnetic Resonance-A Comprehensive Review

Cardiovascular disease remains an integral field on which new research in both the biomedical and technological fields is based, as it remains the leading cause of mortality and morbidity worldwide. However, despite the progress of cardiac imaging techniques, the heart remains a challenging organ to study. Artificial intelligence (AI) has emerged as one of the major innovations in the field of diagnostic imaging, with a dramatic impact on cardiovascular magnetic resonance imaging (CMR). AI will be increasingly present in the medical world, with strong potential for greater diagnostic efficiency and accuracy. Regarding the use of AI in image acquisition and reconstruction, the main role was to reduce the time of image acquisition and analysis, one of the biggest challenges concerning magnetic resonance; moreover, it has been seen to play a role in the automatic correction of artifacts. The use of these techniques in image segmentation has allowed automatic and accurate quantification of the volumes and masses of the left and right ventricles, with occasional need for manual correction. Furthermore, AI can be a useful tool to directly help the clinician in the diagnosis and derivation of prognostic information of cardiovascular diseases. This review addresses the applications and future prospects of AI in CMR imaging, from image acquisition and reconstruction to image segmentation, tissue characterization, diagnostic evaluation, and prognostication.

Automatic 3D Surface Reconstruction of the Left Atrium From Clinically Mapped Point Clouds Using Convolutional Neural Networks

Point clouds are a widely used format for storing information in a memory-efficient and easily manipulatable representation. However, research in the application of point cloud mapping and subsequent organ reconstruction with deep learning, is limited. In particular, current methods for left atrium (LA) visualization using point clouds recorded from clinical mapping during cardiac ablation are proprietary and remain difficult to validate. Many clinics rely on additional imaging such as MRIs/CTs to improve the accuracy of LA mapping. In this study, for the first time, we proposed a novel deep learning framework for the automatic 3D surface reconstruction of the LA directly from point clouds acquired via widely used clinical mapping systems. The backbone of our framework consists of a 30-layer 3D fully convolutional neural network (CNN). The architecture contains skip connections that perform multi-resolution processing to maximize information extraction from the point clouds and ensure a high-resolution prediction by combining features at different receptive levels. We used large kernels with increased receptive fields to address the sparsity of the point clouds. Residual blocks and activation normalization were further implemented to improve the feature learning on sparse inputs. By utilizing a light-weight design with low-depth layers, our CNN took approximately 10 s per patient. Independent testing on two cross-modality clinical datasets showed excellent dice scores of 93% and surface-to-surface distances below 1 pixel. Overall, our study may provide a more efficient, cost-effective 3D LA reconstruction approach during ablation procedures, and potentially lead to improved treatment of cardiac diseases.

Medical image analysis on left atrial LGE MRI for atrial fibrillation studies: A review

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is commonly used to visualize and quantify left atrial (LA) scars. The position and extent of LA scars provide important information on the pathophysiology and progression of atrial fibrillation (AF). Hence, LA LGE MRI computing and analysis are essential for computer-assisted diagnosis and treatment stratification of AF patients. Since manual delineations can be time-consuming and subject to intra- and inter-expert variability, automating this computing is highly desired, which nevertheless is still challenging and under-researched. This paper aims to provide a systematic review on computing methods for LA cavity, wall, scar, and ablation gap segmentation and quantification from LGE MRI, and the related literature for AF studies. Specifically, we first summarize AF-related imaging techniques, particularly LGE MRI. Then, we review the methodologies of the four computing tasks in detail and summarize the validation strategies applied in each task as well as state-of-the-art results on public datasets. Finally, the possible future developments are outlined, with a brief survey on the potential clinical applications of the aforementioned methods. The review indicates that the research into this topic is still in the early stages. Although several methods have been proposed, especially for the LA cavity segmentation, there is still a large scope for further algorithmic developments due to performance issues related to the high variability of enhancement appearance and differences in image acquisition.

LA-Net: A Multi-Task Deep Network for the Segmentation of the Left Atrium

Although atrial fibrillation (AF) is the most common sustained atrial arrhythmia, treatment success for this condition remains suboptimal. Information from magnetic resonance imaging (MRI) has the potential to improve treatment efficacy, but there are currently few automatic tools for the segmentation of the atria in MR images. In the study, we propose a LA-Net, a multi-task network optimised to simultaneously generate left atrial segmentation and edge masks from MRI. LA-Net includes cross attention modules (CAMs) and enhanced decoder modules (EDMs) to purposefully select the most meaningful edge information for segmentation and smoothly incorporate it into segmentation masks at multiple-scales. We evaluate the performance of LA-Net on two MR sequences: late gadolinium enhanced (LGE) atrial MRI and atrial short axis balanced steady state free precession (bSSFP) MRI. LA-Net gives Hausdorff distances of 12.43 mm and Dice scores of 0.92 on the LGE (STACOM 2018) dataset and Hausdorff distances of 17.41 mm and Dice scores of 0.90 on the bSSFP (in-house) dataset without any post-processing, surpassing previously proposed segmentation networks, including U-Net and SEGANet. Our method allows automatic extraction of information about the LA from MR images, which can play an important role in the management of AF patients.

Adaptive Hierarchical Dual Consistency for Semi-Supervised Left Atrium Segmentation on Cross-Domain Data

Semi-supervised learning provides great significance in left atrium (LA) segmentation model learning with insufficient labelled data. Generalising semi-supervised learning to cross-domain data is of high importance to further improve model robustness. However, the widely existing distribution difference and sample mismatch between different data domains hinder the generalisation of semi-supervised learning. In this study, we alleviate these problems by proposing an Adaptive Hierarchical Dual Consistency (AHDC) for the semi-supervised LA segmentation on cross-domain data. The AHDC mainly consists of a Bidirectional Adversarial Inference module (BAI) and a Hierarchical Dual Consistency learning module (HDC). The BAI overcomes the difference of distributions and the sample mismatch between two different domains. It mainly learns two mapping networks adversarially to obtain two matched domains through mutual adaptation. The HDC investigates a hierarchical dual learning paradigm for cross-domain semi-supervised segmentation based on the obtained matched domains. It mainly builds two dual-modelling networks for mining the complementary information in both intra-domain and inter-domain. For the intra-domain learning, a consistency constraint is applied to the dual-modelling targets to exploit the complementary modelling information. For the inter-domain learning, a consistency constraint is applied to the LAs modelled by two dual-modelling networks to exploit the complementary knowledge among different data domains. We demonstrated the performance of our proposed AHDC on four 3D late gadolinium enhancement cardiac MR (LGE-CMR) datasets from different centres and a 3D CT dataset. Compared to other state-of-the-art methods, our proposed AHDC achieved higher segmentation accuracy, which indicated its capability in the cross-domain semi-supervised LA segmentation.

AtrialJSQnet: A New framework for joint segmentation and quantification of left atrium and scars incorporating spatial and shape information

Left atrial (LA) and atrial scar segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is an important task in clinical practice. The automatic segmentation is however still challenging due to the poor image quality, the various LA shapes, the thin wall, and the surrounding enhanced regions. Previous methods normally solved the two tasks independently and ignored the intrinsic spatial relationship between LA and scars. In this work, we develop a new framework, namely AtrialJSQnet, where LA segmentation, scar projection onto the LA surface, and scar quantification are performed simultaneously in an end-to-end style. We propose a mechanism of shape attention (SA) via an implicit surface projection to utilize the inherent correlation between LA cavity and scars. In specific, the SA scheme is embedded into a multi-task architecture to perform joint LA segmentation and scar quantification. Besides, a spatial encoding (SE) loss is introduced to incorporate continuous spatial information of the target in order to reduce noisy patches in the predicted segmentation. We evaluated the proposed framework on 60 post-ablation LGE MRIs from the MICCAI2018 Atrial Segmentation Challenge. Moreover, we explored the domain generalization ability of the proposed AtrialJSQnet on 40 pre-ablation LGE MRIs from this challenge and 30 post-ablation multi-center LGE MRIs from another challenge (ISBI2012 Left Atrium Fibrosis and Scar Segmentation Challenge). Extensive experiments on public datasets demonstrated the effect of the proposed AtrialJSQnet, which achieved competitive performance over the state-of-the-art. The relatedness between LA segmentation and scar quantification was explicitly explored and has shown significant performance improvements for both tasks. The code has been released via https://zmiclab.github.io/projects.html.

JAS-GAN: Generative Adversarial Network Based Joint Atrium and Scar Segmentations on Unbalanced Atrial Targets

Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter-cascade generative adversarial network, namely JAS-GAN, to segment the unbalanced atrial targets from LGE CMR images automatically and accurately in an end-to-end way. Firstly, JAS-GAN investigates an adaptive attention cascade to automatically correlate the segmentation tasks of the unbalanced atrial targets. The adaptive attention cascade mainly models the inclusion relationship of the two unbalanced atrial targets, where the estimated LA acts as the attention map to adaptively focus on the small atrial scars roughly. Then, an adversarial regularization is applied to the segmentation tasks of the unbalanced atrial targets for making a consistent optimization. It mainly forces the estimated joint distribution of LA and atrial scars to match the real ones. We evaluated the performance of our JAS-GAN on a 3D LGE CMR dataset with 192 scans. Compared with the state-of-the-art methods, our proposed approach yielded better segmentation performance (Average Dice Similarity Coefficient (DSC) values of 0.946 and 0.821 for LA and atrial scars, respectively), which indicated the effectiveness of our proposed approach for segmenting unbalanced atrial targets.

Applying an adaptive Otsu-based initialization algorithm to optimize active contour models for skin lesion segmentation

BACKGROUND

Medical image processing has gained much attention in developing computer-aided diagnosis (CAD) of diseases. CAD systems require deep understanding of X-rays, MRIs, CT scans and other medical images. The segmentation of the region of interest (ROI) from those images is one of the most crucial tasks.

OBJECTIVE

Although active contour model (ACM) is a popular method to segment ROIs in medical images, the final segmentation results highly depend on the initial placement of the contour. In order to overcome this challenge, the objective of this study is to investigate feasibility of developing a fully automated initialization process that can be optimally used in ACM to more effectively segment ROIs.

METHODS

In this study, a fully automated initialization algorithm namely, an adaptive Otsu-based initialization (AOI) method is proposed. Using this proposed method, an initial contour is produced and further refined by the ACM to produce accurate segmentation. For evaluation of the proposed algorithm, the ISIC-2017 Skin Lesion dataset is used due to its challenging complexities.

RESULTS

Four different supervised performance evaluation metrics are employed to measure the accuracy and robustness of the proposed algorithm. Using this AOI algorithm, the ACM significantly (p≤0.05) outperforms Otsu thresholding method with 0.88 Dice Score Coefficients (DSC) and 0.79 Jaccard Index (JI) and computational complexity of 0(mn).

CONCLUSIONS

After comparing proposed method with other state-of-the-art methods, our study demonstrates that the proposed methods is superior to other skin lesion segmentation methods, and it requires no training time, which also makes the new method more efficient than other deep learning and machine learning methods.

Left atrial evaluation by cardiovascular magnetic resonance: sensitive and unique biomarkers

Left atrial (LA) imaging is still not routinely used for diagnosis and risk stratification, although recent studies have emphasized its importance as an imaging biomarker. Cardiovascular magnetic resonance is able to evaluate LA structure and function, metrics that serve as early indicators of disease, and provide prognostic information, e.g. regarding diastolic dysfunction, and atrial fibrillation (AF). MR angiography defines atrial anatomy, useful for planning ablation procedures, and also for characterizing atrial shapes and sizes that might predict cardiovascular events, e.g. stroke. Long-axis cine images can be evaluated to define minimum, maximum, and pre-atrial contraction LA volumes, and ejection fractions (EFs). More modern feature tracking of these cine images provides longitudinal LA strain through the cardiac cycle, and strain rates. Strain may be a more sensitive marker than EF and can predict post-operative AF, AF recurrence after ablation, outcomes in hypertrophic cardiomyopathy, stratification of diastolic dysfunction, and strain correlates with atrial fibrosis. Using high-resolution late gadolinium enhancement (LGE), the extent of fibrosis in the LA can be estimated and post-ablation scar can be evaluated. The LA LGE method is widely available, its reproducibility is good, and validations with voltage-mapping exist, although further scan-rescan studies are needed, and consensus regarding atrial segmentation is lacking. Using LGE, scar patterns after ablation in AF subjects can be reproducibly defined. Evaluation of 'pre-existent' atrial fibrosis may have roles in predicting AF recurrence after ablation, predicting new-onset AF and diastolic dysfunction in patients without AF. LA imaging biomarkers are ready to enter into diagnostic clinical practice.

Artificial intelligence with deep learning in nuclear medicine and radiology

The use of deep learning in medical imaging has increased rapidly over the past few years, finding applications throughout the entire radiology pipeline, from improved scanner performance to automatic disease detection and diagnosis. These advancements have resulted in a wide variety of deep learning approaches being developed, solving unique challenges for various imaging modalities. This paper provides a review on these developments from a technical point of view, categorizing the different methodologies and summarizing their implementation. We provide an introduction to the design of neural networks and their training procedure, after which we take an extended look at their uses in medical imaging. We cover the different sections of the radiology pipeline, highlighting some influential works and discussing the merits and limitations of deep learning approaches compared to other traditional methods. As such, this review is intended to provide a broad yet concise overview for the interested reader, facilitating adoption and interdisciplinary research of deep learning in the field of medical imaging.

Convolutional Neural Network-Processed MRI Images in the Diagnosis of Plastic Bronchitis in Children

Objective

The study focused on the features of the convolutional neural networks- (CNN-) processed magnetic resonance imaging (MRI) images for plastic bronchitis (PB) in children.

Methods

30 PB children were selected as subjects, including 19 boys and 11 girls. They all received the MRI examination for the chest. Then, a CNN-based algorithm was constructed and compared with Active Appearance Model (AAM) algorithm for segmentation effects of MRI images in 30 PB children, factoring into occurring simultaneously than (OST), Dice, and Jaccard coefficient.

Results

The maximum Dice coefficient of CNN algorithm reached 0.946, while that of active AAM was 0.843, and the Jaccard coefficient of CNN algorithm was also higher (0.894 vs. 0.758, P < 0.05). The MRI images showed pulmonary inflammation in all subjects. Of 30 patients, 14 (46.66%) had complicated pulmonary atelectasis, 9 (30%) had the complicated pleural effusion, 3 (10%) had pneumothorax, 2 (6.67%) had complicated mediastinal emphysema, and 2 (6.67%) had complicated pneumopericardium. Also, of 30 patients, 19 (63.33%) had lung consolidation and atelectasis in a single lung lobe and 11 (36.67%) in both two lung lobes.

Conclusion

The algorithm based on CNN can significantly improve the segmentation accuracy of MRI images for plastic bronchitis in children. The pleural effusion was a dangerous factor for the occurrence and development of PB.

Recent Advances in Fibrosis and Scar Segmentation From Cardiac MRI: A State-of-the-Art Review and Future Perspectives

Segmentation of cardiac fibrosis and scars is essential for clinical diagnosis and can provide invaluable guidance for the treatment of cardiac diseases. Late Gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) has been successful in guiding the clinical diagnosis and treatment reliably. For LGE CMR, many methods have demonstrated success in accurately segmenting scarring regions. Co-registration with other non-contrast-agent (non-CA) modalities [e.g., balanced steady-state free precession (bSSFP) cine magnetic resonance imaging (MRI)] can further enhance the efficacy of automated segmentation of cardiac anatomies. Many conventional methods have been proposed to provide automated or semi-automated segmentation of scars. With the development of deep learning in recent years, we can also see more advanced methods that are more efficient in providing more accurate segmentations. This paper conducts a state-of-the-art review of conventional and current state-of-the-art approaches utilizing different modalities for accurate cardiac fibrosis and scar segmentation.

Understanding PITX2-Dependent Atrial Fibrillation Mechanisms through Computational Models

Atrial fibrillation (AF) is a common arrhythmia. Better prevention and treatment of AF are needed to reduce AF-associated morbidity and mortality. Several major mechanisms cause AF in patients, including genetic predispositions to AF development. Genome-wide association studies have identified a number of genetic variants in association with AF populations, with the strongest hits clustering on chromosome 4q25, close to the gene for the homeobox transcription PITX2. Because of the inherent complexity of the human heart, experimental and basic research is insufficient for understanding the functional impacts of PITX2 variants on AF. Linking PITX2 properties to ion channels, cells, tissues, atriums and the whole heart, computational models provide a supplementary tool for achieving a quantitative understanding of the functional role of PITX2 in remodelling atrial structure and function to predispose to AF. It is hoped that computational approaches incorporating all we know about PITX2-related structural and electrical remodelling would provide better understanding into its proarrhythmic effects leading to development of improved anti-AF therapies. In the present review, we discuss advances in atrial modelling and focus on the mechanistic links between PITX2 and AF. Challenges in applying models for improving patient health are described, as well as a summary of future perspectives.

How to do left atrial late gadolinium enhancement: a review

BACKGROUND

Quantification of left atrial late gadolinium enhancement is a powerful clinical and research tool. Fibrosis burden has been shown to predict the success of pulmonary vein isolation, post-ablation reoccurrence, and major adverse cardiovascular events such as stroke.

OVERVIEW

The standardized cardiovascular magnetic resonance imaging protocols 2020 update describes the key components of the examination. This review is a more in-depth guide, geared toward building left atrial late gadolinium enhancement imaging from the ground up. The standard protocol consists of the following: localization, pulmonary vein magnetic resonance angiography, cardiac cines, left ventricular, and atrial late gadolinium enhancement. We also review typical segmentation and post-processing techniques, as well as discuss pitfalls, limitations, and potential future innovations in this area.

CONCLUSIONS

With sufficient experience and optimized protocols, left atrial late gadolinium enhancement imaging is a strong addition to the cardiac magnetic resonance imaging repertoire.

Advances in Deep Learning-Based Medical Image Analysis

Importance. With the booming growth of artificial intelligence (AI), especially the recent advancements of deep learning, utilizing advanced deep learning-based methods for medical image analysis has become an active research area both in medical industry and academia. This paper reviewed the recent progress of deep learning research in medical image analysis and clinical applications. It also discussed the existing problems in the field and provided possible solutions and future directions.Highlights. This paper reviewed the advancement of convolutional neural network-based techniques in clinical applications. More specifically, state-of-the-art clinical applications include four major human body systems: the nervous system, the cardiovascular system, the digestive system, and the skeletal system. Overall, according to the best available evidence, deep learning models performed well in medical image analysis, but what cannot be ignored are the algorithms derived from small-scale medical datasets impeding the clinical applicability. Future direction could include federated learning, benchmark dataset collection, and utilizing domain subject knowledge as priors.Conclusion. Recent advanced deep learning technologies have achieved great success in medical image analysis with high accuracy, efficiency, stability, and scalability. Technological advancements that can alleviate the high demands on high-quality large-scale datasets could be one of the future developments in this area.

How machine learning is impacting research in atrial fibrillation: implications for risk prediction and future management

There has been an exponential growth of artificial intelligence (AI) and machine learning (ML) publications aimed at advancing our understanding of atrial fibrillation (AF), which has been mainly driven by the confluence of two factors: the advances in deep neural networks (DeepNNs) and the availability of large, open access databases. It is observed that most of the attention has centred on applying ML for dvsetecting AF, particularly using electrocardiograms (ECGs) as the main data modality. Nearly a third of them used DeepNNs to minimize or eliminate the need for transforming the ECGs to extract features prior to ML modelling; however, we did not observe a significant advantage in following this approach. We also found a fraction of studies using other data modalities, and others centred in aims, such as risk prediction, AF management, and others. From the clinical perspective, AI/ML can help expand the utility of AF detection and risk prediction, especially for patients with additional comorbidities. The use of AI/ML for detection and risk prediction into applications and smart mobile health (mHealth) technology would enable ‘real time’ dynamic assessments. AI/ML could also adapt to treatment changes over time, as well as incident risk factors. Incorporation of a dynamic AI/ML model into mHealth technology would facilitate ‘real time’ assessment of stroke risk, facilitating mitigation of modifiable risk factors (e.g. blood pressure control). Overall, this would lead to an improvement in clinical care for patients with AF.

Statistical shape analysis of the left atrial appendage predicts stroke in atrial fibrillation

The shape of the left atrium (LA) and left atrial appendage (LAA) have been shown to predict stroke in patients with atrial fibrillation (AF). Prior studies rely on qualitative assessment of shape, which limits reproducibility and clinical utility. Statistical shape analysis (SSA) allows for quantitative assessment of shape. We use this method to assess the shape of the LA and LAA and predict stroke in patients with AF. From a database of AF patients who had previously undergone MRI of the LA, we identified 43 patients with AF who subsequently had an ischemic stroke. We also identified a cohort of 201 controls with AF who did not have a stroke after the MRI. We performed SSA of the LA and LAA shape to quantify the shape of these structures. We found three of the candidate LAA shape parameters to be predictive of stroke, while none of the LA shape parameters predicted stroke. When the three predictive LAA shape parameters were added to a logistic regression model that included the CHA₂DS₂-VASc score, the area under the ROC curve increased from 0.640 to 0.778 (p = .003). The shape of the LA and LAA can be assessed quantitatively using SSA. LAA shape predicts stroke in AF patients, while LA shape does not. Additionally, LAA shape predicts stroke independent of CHA₂DS₂-VASc score. SSA for assessment of LAA shape may improve stroke risk stratification and clinical decision making for AF patients.

A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises

Since its renaissance, deep learning has been widely used in various medical imaging tasks and has achieved remarkable success in many medical imaging applications, thereby propelling us into the so-called artificial intelligence (AI) era. It is known that the success of AI is mostly attributed to the availability of big data with annotations for a single task and the advances in high performance computing. However, medical imaging presents unique challenges that confront deep learning approaches. In this survey paper, we first present traits of medical imaging, highlight both clinical needs and technical challenges in medical imaging, and describe how emerging trends in deep learning are addressing these issues. We cover the topics of network architecture, sparse and noisy labels, federating learning, interpretability, uncertainty quantification, etc. Then, we present several case studies that are commonly found in clinical practice, including digital pathology and chest, brain, cardiovascular, and abdominal imaging. Rather than presenting an exhaustive literature survey, we instead describe some prominent research highlights related to these case study applications. We conclude with a discussion and presentation of promising future directions.

Barriers and Enablers for Artificial Intelligence in Dental Diagnostics: A Qualitative Study

The present study aimed to identify barriers and enablers for the implementation of artificial intelligence (AI) in dental, specifically radiographic, diagnostics. Semi-structured phone interviews with dentists and patients were conducted between the end of May and the end of June 2020 (convenience/snowball sampling). A questionnaire developed along the Theoretical Domains Framework (TDF) and the Capabilities, Opportunities and Motivations influencing Behaviors model (COM-B) was used to guide interviews. Mayring's content analysis was employed to point out barriers and enablers. We identified 36 barriers, conflicting themes or enablers, covering nine of the fourteen domains of the TDF and all three determinants of behavior (COM). Both stakeholders emphasized chances and hopes for AI. A range of enablers for implementing AI in dental diagnostics were identified (e.g., the chance for higher diagnostic accuracy, a reduced workload, more comprehensive reporting and better patient-provider communication). Barriers related to reliance on AI and responsibility for medical decisions, as well as the explainability of AI and the related option to de-bug AI applications, emerged. Decision-makers and industry may want to consider these aspects to foster implementation of AI in dentistry.

Cardiac magnetic resonance image diagnosis of hypertrophic obstructive cardiomyopathy based on a double-branch neural network

OBJECTIVE

Cardiac magnetic resonance (CMR) imaging is a well-established technique for diagnosis of hypertrophic obstructive cardiomyopathy (HOCM) and evaluation of cardiac function, but the process is complicated and time consuming. Therefore, this paper proposes a cardiomyopathy recognition algorithm using a multi-task learning mechanism and a double-branch deep learning neural network.

METHOD

We implemented a double-branch neural network CMR-based HOCM recognition algorithm. Compared with the traditional classification algorithms such as the ResNet, DenseNet network, contrast the accuracy of network classification of cardiomyopathy is higher by 10.11%.

RESULT

The loss curve of the algorithm basically converges in 100 rounds, and the convergence speed of the algorithm is twice that of the traditional algorithm. The accuracy of this algorithm to classify cardiomyopathy is 96.79%, and the sensitivity is 95.24%, which is 10.11% higher than the conventional algorithm.

CONCLUSION

The CMR imaging automatic recognition algorithm for HOCM capture static morphological and motion characteristics of the heart, and comprehensively enhances recognition accuracy when the sample size is limited.

A global benchmark of algorithms for segmenting the left atrium from late gadolinium-enhanced cardiac magnetic resonance imaging

Segmentation of medical images, particularly late gadolinium-enhanced magnetic resonance imaging (LGE-MRI) used for visualizing diseased atrial structures, is a crucial first step for ablation treatment of atrial fibrillation. However, direct segmentation of LGE-MRIs is challenging due to the varying intensities caused by contrast agents. Since most clinical studies have relied on manual, labor-intensive approaches, automatic methods are of high interest, particularly optimized machine learning approaches. To address this, we organized the 2018 Left Atrium Segmentation Challenge using 154 3D LGE-MRIs, currently the world's largest atrial LGE-MRI dataset, and associated labels of the left atrium segmented by three medical experts, ultimately attracting the participation of 27 international teams. In this paper, extensive analysis of the submitted algorithms using technical and biological metrics was performed by undergoing subgroup analysis and conducting hyper-parameter analysis, offering an overall picture of the major design choices of convolutional neural networks (CNNs) and practical considerations for achieving state-of-the-art left atrium segmentation. Results show that the top method achieved a Dice score of 93.2% and a mean surface to surface distance of 0.7 mm, significantly outperforming prior state-of-the-art. Particularly, our analysis demonstrated that double sequentially used CNNs, in which a first CNN is used for automatic region-of-interest localization and a subsequent CNN is used for refined regional segmentation, achieved superior results than traditional methods and machine learning approaches containing single CNNs. This large-scale benchmarking study makes a significant step towards much-improved segmentation methods for atrial LGE-MRIs, and will serve as an important benchmark for evaluating and comparing the future works in the field. Furthermore, the findings from this study can potentially be extended to other imaging datasets and modalities, having an impact on the wider medical imaging community.

Fully Automatic Atrial Fibrosis Assessment Using a Multilabel Convolutional Neural Network

Supplemental Digital Content is available in the text.

Background:

Pathological atrial fibrosis is a major contributor to sustained atrial fibrillation. Currently, late gadolinium enhancement (LGE) scans provide the only noninvasive estimate of atrial fibrosis. However, widespread adoption of atrial LGE has been hindered partly by nonstandardized image processing techniques, which can be operator and algorithm dependent. Minimal validation and limited access to transparent software platforms have also exacerbated the problem. This study aims to estimate atrial fibrosis from cardiac magnetic resonance scans using a reproducible operator-independent fully automatic open-source end-to-end pipeline.

Methods:

A multilabel convolutional neural network was designed to accurately delineate atrial structures including the blood pool, pulmonary veins, and mitral valve. The output from the network removed the operator dependent steps in a reproducible pipeline and allowed for automated estimation of atrial fibrosis from LGE-cardiac magnetic resonance scans. The pipeline results were compared against manual fibrosis burdens, calculated using published thresholds: image intensity ratio 0.97, image intensity ratio 1.61, and mean blood pool signal +3.3 SD.

Results:

We validated our methods on a large 3-dimensional LGE-cardiac magnetic resonance data set from 207 labeled scans. Automatic atrial segmentation achieved a 91% Dice score, compared with the mutual agreement of 85% in Dice seen in the interobserver analysis of operators. Intraclass correlation coefficients of the automatic pipeline with manually generated results were excellent and better than or equal to interobserver correlations for all 3 thresholds: 0.94 versus 0.88, 0.99 versus 0.99, 0.99 versus 0.96 for image intensity ratio 0.97, image intensity ratio 1.61, and +3.3 SD thresholds, respectively. Automatic analysis required 3 minutes per case on a standard workstation. The network and the analysis software are publicly available.

Conclusions:

Our pipeline provides a fully automatic estimation of fibrosis burden from LGE-cardiac magnetic resonance scans that is comparable to manual analysis. This removes one key source of variability in the measurement of atrial fibrosis.

Translational applications of computational modelling for patients with cardiac arrhythmias

Cardiac arrhythmia is associated with high morbidity, and its underlying mechanisms are poorly understood. Computational modelling and simulation approaches have the potential to improve standard-of-care therapy for these disorders, offering deeper understanding of complex disease processes and sophisticated translational tools for planning clinical procedures. This review provides a clinician-friendly summary of recent advancements in computational cardiology. Organ-scale models automatically generated from clinical-grade imaging data are used to custom tailor our understanding of arrhythmia drivers, estimate future arrhythmogenic risk and personalise treatment plans. Recent mechanistic insights derived from atrial and ventricular arrhythmia simulations are highlighted, and the potential avenues to patient care (eg, by revealing new antiarrhythmic drug targets) are covered. Computational approaches geared towards improving outcomes in resynchronisation therapy have used simulations to elucidate optimal patient selection and lead location. Technology to personalise catheter ablation procedures are also covered, specifically preliminary outcomes form early-stage or pilot clinical studies. To conclude, future developments in computational cardiology are discussed, including improving the representation of patient-specific fibre orientations and fibrotic remodelling characterisation and how these might improve understanding of arrhythmia mechanisms and provide transformative tools for patient-specific therapy.

A Semi-Automatic Method To Segment The Left Atrium in MR Volumes With Varying Slice Numbers

Atrial fibrillation (AF) is the most common sustained arrhythmia and is associated with dramatic increases in mortality and morbidity. Atrial cine MR images are increasingly used in the management of this condition, but there are few specific tools to aid in the segmentation of such data. Some characteristics of atrial cine MR (thick slices, variable number of slices in a volume) preclude the direct use of traditional segmentation tools. When combined with scarcity of labelled data and similarity of the intensity and texture of the left atrium (LA) to other cardiac structures, the segmentation of the LA in CINE MRI becomes a difficult task. To deal with these challenges, we propose a semi-automatic method to segment the left atrium (LA) in MR images, which requires an initial user click per volume. The manually given location information is used to generate a chamber location map to roughly locate the LA, which is then used as an input to a deep network with slightly over 0.5 million parameters. A tracking method is introduced to pass the location information across a volume and to remove unwanted structures in segmentation maps. According to the results of our experiments conducted in an in-house MRI dataset, the proposed method outperforms the U-Net [1] with a margin of 20 mm on Hausdorff distance and 0.17 on Dice score, with limited manual interaction.

A fully automated left atrium segmentation approach from late gadolinium enhanced magnetic resonance imaging based on a convolutional neural network

Background

Several studies suggest that the evaluation of left atrial (LA) fibrosis is a relevant information for the assessment of the appropriate strategy in catheter ablation in atrial fibrillation (AF). Late gadolinium enhanced (LGE) cardiac magnetic resonance imaging (MRI) is a non-invasive technique, which might be employed for the non-invasive quantification of LA myocardial fibrotic tissue in patients with AF. Nowadays, the analysis of LGE MRI relies on manual tracing of LA boundaries and this procedure is time-consuming and prone to high inter-observer variability given the different degrees of observers' experience, LA wall thickness and data resolution. Therefore, an automated segmentation approach of the atrial cavity for the quantification of scar tissue would be highly desirable.

Methods

This study focuses on the design of a fully automated LGE MRI segmentation pipeline which includes a convolutional neural network (CNN) based on the successful architecture U-Net. The CNN was trained, validated and tested end-to-end with the data available from the Statistical Atlases and Computational Modelling of the Heart 2018 Atrial Segmentation Challenge (100 cardiac data). Two different approaches were tested: using both stacks of 2-D axial slices and using 3-D data (with the appropriate changes in the baseline architecture). In the latter approach, thanks to the 3-D convolution operator, all the information underlying 3-D data can be exploited. Once the training was completed using 80 cardiac data, a post-processing step was applied on 20 predicted segmentations belonging to the test set.

Results

By applying the 2-D and 3-D approaches, average Dice coefficient and mean Hausdorff distances were 0.896, 0.914, and 8.98 mm, 8.34 mm, respectively. Volumes of the anatomical LA meshes from the automated analysis were highly correlated with the volumes from ground truth [2-D: r=0.978, y=0.94x+0.07, bias=3.5 ml (5.6%), SD=5.3 mL (8.5%); 3-D: r=0.982, y=0.92x+2.9, bias=2.1 mL (3.5%), SD=5.2 mL (8.4%)].

Conclusions

These results suggest the proposed approach is feasible and provides accurate results. Despite the increase of the number of trainable parameters, the proposed 3-D CNN learns better features leading to higher performance, feasible for a real clinical application.

Artificial Intelligence and Machine Learning in Arrhythmias and Cardiac Electrophysiology

Artificial intelligence (AI) and machine learning (ML) in medicine are currently areas of intense exploration, showing potential to automate human tasks and even perform tasks beyond human capabilities. Literacy and understanding of AI/ML methods are becoming increasingly important to researchers and clinicians. The first objective of this review is to provide the novice reader with literacy of AI/ML methods and provide a foundation for how one might conduct an ML study. We provide a technical overview of some of the most commonly used terms, techniques, and challenges in AI/ML studies, with reference to recent studies in cardiac electrophysiology to illustrate key points. The second objective of this review is to use examples from recent literature to discuss how AI and ML are changing clinical practice and research in cardiac electrophysiology, with emphasis on disease detection and diagnosis, prediction of patient outcomes, and novel characterization of disease. The final objective is to highlight important considerations and challenges for appropriate validation, adoption, and deployment of AI technologies into clinical practice.

Fully Automated 3D Cardiac MRI Localisation and Segmentation Using Deep Neural Networks

Cardiac magnetic resonance (CMR) imaging is used widely for morphological assessment and diagnosis of various cardiovascular diseases. Deep learning approaches based on 3D fully convolutional networks (FCNs), have improved state-of-the-art segmentation performance in CMR images. However, previous methods have employed several pre-processing steps and have focused primarily on segmenting low-resolutions images. A crucial step in any automatic segmentation approach is to first localize the cardiac structure of interest within the MRI volume, to reduce false positives and computational complexity. In this paper, we propose two strategies for localizing and segmenting the heart ventricles and myocardium, termed multi-stage and end-to-end, using a 3D convolutional neural network. Our method consists of an encoder–decoder network that is first trained to predict a coarse localized density map of the target structure at a low resolution. Subsequently, a second similar network employs this coarse density map to crop the image at a higher resolution, and consequently, segment the target structure. For the latter, the same two-stage architecture is trained end-to-end. The 3D U-Net with some architectural changes (referred to as 3D DR-UNet) was used as the base architecture in this framework for both the multi-stage and end-to-end strategies. Moreover, we investigate whether the incorporation of coarse features improves the segmentation. We evaluate the two proposed segmentation strategies on two cardiac MRI datasets, namely, the Automatic Cardiac Segmentation Challenge (ACDC) STACOM 2017, and Left Atrium Segmentation Challenge (LASC) STACOM 2018. Extensive experiments and comparisons with other state-of-the-art methods indicate that the proposed multi-stage framework consistently outperforms the rest in terms of several segmentation metrics. The experimental results highlight the robustness of the proposed approach, and its ability to generate accurate high-resolution segmentations, despite the presence of varying degrees of pathology-induced changes to cardiac morphology and image appearance, low contrast, and noise in the CMR volumes.

Generalizing Deep Learning for Medical Image Segmentation to Unseen Domains via Deep Stacked Transformation

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, application of these models in clinically realistic environments can result in poor generalization and decreased accuracy, mainly due to the domain shift across different hospitals, scanner vendors, imaging protocols, and patient populations etc. Common transfer learning and domain adaptation techniques are proposed to address this bottleneck. However, these solutions require data (and annotations) from the target domain to retrain the model, and is therefore restrictive in practice for widespread model deployment. Ideally, we wish to have a trained (locked) model that can work uniformly well across unseen domains without further training. In this paper, we propose a deep stacked transformation approach for domain generalization. Specifically, a series of n stacked transformations are applied to each image during network training. The underlying assumption is that the "expected" domain shift for a specific medical imaging modality could be simulated by applying extensive data augmentation on a single source domain, and consequently, a deep model trained on the augmented "big" data (BigAug) could generalize well on unseen domains. We exploit four surprisingly effective, but previously understudied, image-based characteristics for data augmentation to overcome the domain generalization problem. We train and evaluate the BigAug model (with n=9 transformations) on three different 3D segmentation tasks (prostate gland, left atrial, left ventricle) covering two medical imaging modalities (MRI and ultrasound) involving eight publicly available challenge datasets. The results show that when training on relatively small dataset (n = 10~32 volumes, depending on the size of the available datasets) from a single source domain: (i) BigAug models degrade an average of 11%(Dice score change) from source to unseen domain, substantially better than conventional augmentation (degrading 39%) and CycleGAN-based domain adaptation method (degrading 25%), (ii) BigAug is better than "shallower" stacked transforms (i.e. those with fewer transforms) on unseen domains and demonstrates modest improvement to conventional augmentation on the source domain, (iii) after training with BigAug on one source domain, performance on an unseen domain is similar to training a model from scratch on that domain when using the same number of training samples. When training on large datasets (n = 465 volumes) with BigAug, (iv) application to unseen domains reaches the performance of state-of-the-art fully supervised models that are trained and tested on their source domains. These findings establish a strong benchmark for the study of domain generalization in medical imaging, and can be generalized to the design of highly robust deep segmentation models for clinical deployment.

Simultaneous left atrium anatomy and scar segmentations via deep learning in multiview information with attention

Three-dimensional late gadolinium enhanced (LGE) cardiac MR (CMR) of left atrial scar in patients with atrial fibrillation (AF) has recently emerged as a promising technique to stratify patients, to guide ablation therapy and to predict treatment success. This requires a segmentation of the high intensity scar tissue and also a segmentation of the left atrium (LA) anatomy, the latter usually being derived from a separate bright-blood acquisition. Performing both segmentations automatically from a single 3D LGE CMR acquisition would eliminate the need for an additional acquisition and avoid subsequent registration issues. In this paper, we propose a joint segmentation method based on multiview two-task (MVTT) recursive attention model working directly on 3D LGE CMR images to segment the LA (and proximal pulmonary veins) and to delineate the scar on the same dataset. Using our MVTT recursive attention model, both the LA anatomy and scar can be segmented accurately (mean Dice score of 93% for the LA anatomy and 87% for the scar segmentations) and efficiently ( ∼ 0.27 s to simultaneously segment the LA anatomy and scars directly from the 3D LGE CMR dataset with 60-68 2D slices). Compared to conventional unsupervised learning and other state-of-the-art deep learning based methods, the proposed MVTT model achieved excellent results, leading to an automatic generation of a patient-specific anatomical model combined with scar segmentation for patients in AF.

Mini Review: Deep Learning for Atrial Segmentation From Late Gadolinium-Enhanced MRIs

Segmentation and 3D reconstruction of the human atria is of crucial importance for precise diagnosis and treatment of atrial fibrillation, the most common cardiac arrhythmia. However, the current manual segmentation of the atria from medical images is a time-consuming, labor-intensive, and error-prone process. The recent emergence of artificial intelligence, particularly deep learning, provides an alternative solution to the traditional methods that fail to accurately segment atrial structures from clinical images. This has been illustrated during the recent 2018 Atrial Segmentation Challenge for which most of the challengers developed deep learning approaches for atrial segmentation, reaching high accuracy (>90% Dice score). However, as significant discrepancies exist between the approaches developed, many important questions remain unanswered, such as which deep learning architectures and methods to ensure reliability while achieving the best performance. In this paper, we conduct an in-depth review of the current state-of-the-art of deep learning approaches for atrial segmentation from late gadolinium-enhanced MRIs, and provide critical insights for overcoming the main hindrances faced in this task.

Quantifying atrial anatomy uncertainty from clinical data and its impact on electro-physiology simulation predictions

Patient-specific computational models of structure and function are increasingly being used to diagnose disease and predict how a patient will respond to therapy. Models of anatomy are often derived after segmentation of clinical images or from mapping systems which are affected by image artefacts, resolution and contrast. Quantifying the impact of uncertain anatomy on model predictions is important, as models are increasingly used in clinical practice where decisions need to be made regardless of image quality. We use a Bayesian probabilistic approach to estimate the anatomy and to quantify the uncertainty about the shape of the left atrium derived from Cardiac Magnetic Resonance images. We show that we can quantify uncertain shape, encode uncertainty about the left atrial shape due to imaging artefacts, and quantify the effect of uncertain shape on simulations of left atrial activation times.

Deep Learning for Cardiac Image Segmentation: A Review

Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound and major anatomical structures of interest (ventricles, atria, and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the challenges and limitations with current deep learning-based approaches (scarcity of labels, model generalizability across different domains, interpretability) and suggest potential directions for future research.

Atrial scar quantification via multi-scale CNN in the graph-cuts framework

•

Propose a fully automatic method for left atrial scar quantification, with promising performance.

•

Formulate a new framework of scar quantification based on surface projection and graph-cuts framework.

•

Propose the multi-scale learning CNN, combined with the random shift training strategy, to learn and predict the graph potentials, which significantly improves the performance of the proposed method, and enables the full automation of the framework.

•

Provide thorough validation and parameter studies for the proposed techniques using fifty-eight clinical images.

Late gadolinium enhancement magnetic resonance imaging (LGE MRI) appears to be a promising alternative for scar assessment in patients with atrial fibrillation (AF). Automating the quantification and analysis of atrial scars can be challenging due to the low image quality. In this work, we propose a fully automated method based on the graph-cuts framework, where the potentials of the graph are learned on a surface mesh of the left atrium (LA) using a multi-scale convolutional neural network (MS-CNN). For validation, we have included fifty-eight images with manual delineations. MS-CNN, which can efficiently incorporate both the local and global texture information of the images, has been shown to evidently improve the segmentation accuracy of the proposed graph-cuts based method. The segmentation could be further improved when the contribution between the t-link and n-link weights of the graph is balanced. The proposed method achieves a mean accuracy of 0.856 ± 0.033 and mean Dice score of 0.702 ± 0.071 for LA scar quantification. Compared to the conventional methods, which are based on the manual delineation of LA for initialization, our method is fully automatic and has demonstrated significantly better Dice score and accuracy (p < 0.01). The method is promising and can be potentially useful in diagnosis and prognosis of AF.

A robust computational framework for estimating 3D Bi-Atrial chamber wall thickness

Atrial fibrillation (AF) is the most prevalent form of cardiac arrhythmia. The atrial wall thickness (AWT) can potentially improve our understanding of the mechanism underlying atrial structure that drives AF and provides important clinical information. However, most existing studies for estimating AWT rely on ruler-based measurements performed on only a few selected locations in 2D or 3D using digital calipers. Only a few studies have developed automatic approaches to estimate the AWT in the left atrium, and there are currently no methods to robustly estimate the AWT of both atrial chambers. Therefore, we have developed a computational pipeline to automatically calculate the 3D AWT across bi-atrial chambers and extensively validated our pipeline on both ex vivo and in vivo human atria data. The atrial geometry was first obtained by segmenting the atrial wall from the MRIs using a novel machine learning approach. The epicardial and endocardial surfaces were then separated using a multi-planar convex hull approach to define boundary conditions, from which, a Laplace equation was solved numerically to automatically separate bi-atrial chambers. To robustly estimate the AWT in each atrial chamber, coupled partial differential equations by coupling the Laplace solution with two surface trajectory functions were formulated and solved. Our pipeline enabled the reconstruction and visualization of the 3D AWT for bi-atrial chambers with a relative error of 8% and outperformed existing algorithms by >7%. Our approach can potentially lead to improved clinical diagnosis, patient stratification, and clinical guidance during ablation treatment for patients with AF.

Deep Learning for Quantitative Cardiac MRI

OBJECTIVE. The recent advancement of deep learning techniques has profoundly impacted research on quantitative cardiac MRI analysis. The purpose of this article is to introduce the concept of deep learning, review its current applications on quantitative cardiac MRI, and discuss its limitations and challenges. CONCLUSION. Deep learning has shown state-of-the-art performance on quantitative analysis of multiple cardiac MRI sequences and holds great promise for future use in clinical practice and scientific research.