Machine learning derived segmentation of phase velocity encoded cardiovascular magnetic resonance for fully automated aortic flow quantification

Prospective Human Validation of Artificial Intelligence Interventions in Cardiology: A Scoping Review

Background

Despite the potential of artificial intelligence (AI) in enhancing cardiovascular care, its integration into clinical practice is limited by a lack of evidence on its effectiveness with respect to human experts or gold standard practices in real-world settings.

Objectives

The purpose of this study was to identify AI interventions in cardiology that have been prospectively validated against human expert benchmarks or gold standard practices, assessing their effectiveness, and identifying future research areas.

Methods

We systematically reviewed Scopus and MEDLINE to identify peer-reviewed publications that involved prospective human validation of AI-based interventions in cardiology from January 2015 to December 2023.

Results

Of 2,351 initial records, 64 studies were included. Among these studies, 59 (92.2%) were published after 2020. A total of 11 (17.2%) randomized controlled trials were published. AI interventions in 44 articles (68.75%) reported definite clinical or operational improvements over human experts. These interventions were mostly used in imaging (n = 14, 21.9%), ejection fraction (n = 10, 15.6%), arrhythmia (n = 9, 14.1%), and coronary artery disease (n = 12, 18.8%) application areas. Convolutional neural networks were the most common predictive model (n = 44, 69%), and images were the most used data type (n = 38, 54.3%). Only 22 (34.4%) studies made their models or data accessible.

Conclusions

This review identifies the potential of AI in cardiology, with models often performing equally well as human counterparts for specific and clearly scoped tasks suitable for such models. Nonetheless, the limited number of randomized controlled trials emphasizes the need for continued validation, especially in real-world settings that closely examine joint human AI decision-making.

Impact of training data composition on the generalizability of convolutional neural network aortic cross-section segmentation in four-dimensional magnetic resonance flow imaging

BACKGROUND

Four-dimensional cardiovascular magnetic resonance flow imaging (4D flow CMR) plays an important role in assessing cardiovascular diseases. However, the manual or semi-automatic segmentation of aortic vessel boundaries in 4D flow data introduces variability and limits the reproducibility of aortic hemodynamics visualization and quantitative flow-related parameter computation. This paper explores the potential of deep learning to improve 4D flow CMR segmentation by developing models for automatic segmentation and analyzes the impact of the training data on the generalization of the model across different sites, scanner vendors, sequences, and pathologies.

METHODS

The study population consists of 260 4D flow CMR datasets, including subjects without known aortic pathology, healthy volunteers, and patients with bicuspid aortic valve (BAV) examined at different hospitals. The dataset was split to train segmentation models on subsets with different representations of characteristics, such as pathology, gender, age, scanner model, vendor, and field strength. An enhanced three-dimensional U-net convolutional neural network (CNN) architecture with residual units was trained for time-resolved two-dimensional aortic cross-sectional segmentation. Model performance was evaluated using Dice score, Hausdorff distance, and average symmetric surface distance on test data, datasets with characteristics not represented in the training set (model-specific), and an overall evaluation set. Standard diagnostic flow parameters were computed and compared with manual segmentation results using Bland-Altman analysis and interclass correlation.

RESULTS

The representation of technical factors, such as scanner vendor and field strength, in the training dataset had the strongest influence on the overall segmentation performance. Age had a greater impact than gender. Models solely trained on BAV patients' datasets performed well on datasets of healthy subjects but not vice versa.

CONCLUSION

This study highlights the importance of considering a heterogeneous dataset for the training of widely applicable automatic CNN segmentations in 4D flow CMR, with a particular focus on the inclusion of different pathologies and technical aspects of data acquisition.

The role of artificial intelligence in cardiovascular magnetic resonance imaging

Cardiovascular magnetic resonance (CMR) imaging is the gold standard test for myocardial tissue characterization and chamber volumetric and functional evaluation. However, manual CMR analysis can be time-consuming and is subject to intra- and inter-observer variability. Artificial intelligence (AI) is a field that permits automated task performance through the identification of high-level and complex data relationships. In this review, we review the rapidly growing role of AI in CMR, including image acquisition, sequence prescription, artifact detection, reconstruction, segmentation, and data reporting and analysis including quantification of volumes, function, myocardial infarction (MI) and scar detection, and prediction of outcomes. We conclude with a discussion of the emerging challenges to widespread adoption and solutions that will allow for successful, broader uptake of this powerful technology.

Improving the efficiency and accuracy of cardiovascular magnetic resonance with artificial intelligence-review of evidence and proposition of a roadmap to clinical translation

BACKGROUND

Cardiovascular magnetic resonance (CMR) is an important imaging modality for the assessment of heart disease; however, limitations of CMR include long exam times and high complexity compared to other cardiac imaging modalities. Recently advancements in artificial intelligence (AI) technology have shown great potential to address many CMR limitations. While the developments are remarkable, translation of AI-based methods into real-world CMR clinical practice remains at a nascent stage and much work lies ahead to realize the full potential of AI for CMR.

METHODS

Herein we review recent cutting-edge and representative examples demonstrating how AI can advance CMR in areas such as exam planning, accelerated image reconstruction, post-processing, quality control, classification and diagnosis.

RESULTS

These advances can be applied to speed up and simplify essentially every application including cine, strain, late gadolinium enhancement, parametric mapping, 3D whole heart, flow, perfusion and others. AI is a unique technology based on training models using data. Beyond reviewing the literature, this paper discusses important AI-specific issues in the context of CMR, including (1) properties and characteristics of datasets for training and validation, (2) previously published guidelines for reporting CMR AI research, (3) considerations around clinical deployment, (4) responsibilities of clinicians and the need for multi-disciplinary teams in the development and deployment of AI in CMR, (5) industry considerations, and (6) regulatory perspectives.

CONCLUSIONS

Understanding and consideration of all these factors will contribute to the effective and ethical deployment of AI to improve clinical CMR.

The Role of Artificial Intelligence in Cardiac Imaging

Artificial intelligence (AI) is having a significant impact in medical imaging, advancing almost every aspect of the field, from image acquisition and postprocessing to automated image analysis with outreach toward supporting decision making. Noninvasive cardiac imaging is one of the main and most exciting fields for AI development. The aim of this review is to describe the main applications of AI in cardiac imaging, including CT and MR imaging, and provide an overview of recent advancements and available clinical applications that can improve clinical workflow, disease detection, and prognostication in cardiac disease.

Recent Advances in Cardiac Magnetic Resonance for Imaging of Acute Myocardial Infarction

Acute myocardial infarction (AMI) is one of the primary causes of death worldwide, with a high incidence and mortality rate. Assessment of the infarcted and surviving myocardium, along with microvascular obstruction, is crucial for risk stratification, treatment, and prognosis in patients with AMI. Nonionizing radiation, excellent soft tissue contrast resolution, a large field of view, and multiplane imaging make cardiac magnetic resonance (CMR) a "one-stop" method for assessing cardiac structure, function, perfusion, and metabolism. Hence, this imaging technology is considered the "gold standard" for evaluating myocardial function and viability in AMI. This review critically compares the advantages and disadvantages of CMR with other cardiac imaging technologies, and relates the imaging findings to the underlying pathophysiological processes in AMI. A more thorough understanding of CMR technology will clarify their advanced clinical diagnosis and prognostic assessment applications, and assess the future approaches and challenges of CMR in the setting of AMI.

Speckle tracking echocardiography for diagnosis of right ventricular failure in children with totally corrected tetralogy of Fallot in Sulaimani, Iraq

Objectives

The study was aimed at using speckle tracking echocardiography as a novel technique to diagnose right ventricular failure (RVF) in children with total correction of tetralogy of Fallot (TOF) through surgery.

Methods

A quasi-experimental study was performed at the Children's Heart Hospital of Sulaimani for 9 months. A total of 150 children with completely repaired TOF were enrolled to investigate RVF. Conventional echocardiographic data were recorded, including right ventricular (RV) ejection fraction (EF), tricuspid annular plane systolic excursion (TAPSE), myocardial performance index (MPI), and RV end-systolic and diastolic volume (RVESV and RVEDV). Additionally, speckle tracking was performed for the regional and longitudinal strain and strain rate in four-chamber apical view. RVF diagnosis was determined on the basis of electrocardiography measurement of P-wave dispersion, T-wave dispersion, and QRS duration.

Results

Children with repaired TOF who were diagnosed with RVF through conventional echocardiography exhibited abnormalities with respect to children with normal RV function, including a TAPSE of 1.3 ± 0.11 cm, RVEF of 35.5 ± 6.72, RVESV of 69.8 ± 15.13 ml, RVEDV of 110.1 ± 14.13 ml, MPI of 0.60 ± 0.12, and Pmax of 52.4 ± 14.08. The use of speckle tracking in RVF diagnosis revealed a relatively lower longitudinal strain and strain rate (-12.1 ± 2.3 and -0.9 ± 0.3, respectively) in the children with RVF. Moreover, longitudinal right ventricular strain was positively correlated with TAPSE (r = 0.656) and EF (r = 0.675), and negatively correlated with RVEDV (r = -0.684), RVESV (r = -0.718), MPI (r = -0.735), and Pmax (r = -0.767).

Conclusions

The application of speckle tracking with the longitudinal RV strain and strain rate to estimate RV function in children with repaired TOF is a new advanced method that, compared with conventional echo, significantly improves the diagnosis of regional myocardial deformations and cardiac muscle motion velocity.

Artificial Intelligence in Heart Failure: Friend or Foe?

In recent times, there have been notable changes in cardiovascular medicine, propelled by the swift advancements in artificial intelligence (AI). The present work provides an overview of the current applications and challenges of AI in the field of heart failure. It emphasizes the "garbage in, garbage out" issue, where AI systems can produce inaccurate results with skewed data. The discussion covers issues in heart failure diagnostic algorithms, particularly discrepancies between existing models. Concerns about the reliance on the left ventricular ejection fraction (LVEF) for classification and treatment are highlighted, showcasing differences in current scientific perceptions. This review also delves into challenges in implementing AI, including variable considerations and biases in training data. It underscores the limitations of current AI models in real-world scenarios and the difficulty in interpreting their predictions, contributing to limited physician trust in AI-based models. The overarching suggestion is that AI can be a valuable tool in clinicians' hands for treating heart failure patients, as far as existing medical inaccuracies have been addressed before integrating AI into these frameworks.

Artificial Intelligence in the Screening, Diagnosis, and Management of Aortic Stenosis

The integration of artificial intelligence (AI) into clinical management of aortic stenosis (AS) has redefined our approach to the assessment and management of this heterogenous valvular heart disease (VHD). While the large-scale early detection of valvular conditions is limited by socioeconomic constraints, AI offers a cost-effective alternative solution for screening by utilizing conventional tools, including electrocardiograms and community-level auscultations, thereby facilitating early detection, prevention, and treatment of AS. Furthermore, AI sheds light on the varied nature of AS, once considered a uniform condition, allowing for more nuanced, data-driven risk assessments and treatment plans. This presents an opportunity to re-evaluate the complexity of AS and to refine treatment using data-driven risk stratification beyond traditional guidelines. AI can be used to support treatment decisions including device selection, procedural techniques, and follow-up surveillance of transcatheter aortic valve replacement (TAVR) in a reproducible manner. While recognizing notable AI achievements, it is important to remember that AI applications in AS still require collaboration with human expertise due to potential limitations such as its susceptibility to bias, and the critical nature of healthcare. This synergy underpins our optimistic view of AI's promising role in the AS clinical pathway.

Assessment of the Severity of Aortic Regurgitation by Noninvasive Imaging : Non-invasive MMI for AR

PURPOSE OF THE REVIEW

The role of multimodality imaging in the evaluation of patients with aortic regurgitation is summarized in this review.

RECENT FINDINGS

The etiology (mechanism) of the aortic regurgitation and the severity of aortic regurgitation and hemodynamic consequences are key in the decision making of patients with severe aortic regurgitation. While echocardiography remains as the leading technique to assess all these parameters, other imaging techniques have become essential for the accurate assessment of aortic regurgitation severity and the timing of aortic intervention. The anatomic suitability of transcatheter aortic valve implantation in inoperable patients with severe aortic regurgitation is usually assessed with computed tomography. Aortic regurgitation is a prevalent disease with various pathophysiological mechanisms that need a personalized treatment. The evaluation of the mechanism and severity of aortic regurgitation can be initially performed with echocardiography. Three-dimensional techniques, including echocardiography, have become very relevant for accurate assessment of the regurgitation severity and its hemodynamic consequences. Assessment of myocardial tissue characteristics with cardiac magnetic resonance is key in the risk stratification of patients and in the timing of aortic intervention. Computed tomography is important in the assessment of aortic dimensions and selection of patients for transcatheter aortic valve implantation.

Deep Learning for Cardiovascular Imaging: A Review

Importance

Artificial intelligence (AI), driven by advances in deep learning (DL), has the potential to reshape the field of cardiovascular imaging (CVI). While DL for CVI is still in its infancy, research is accelerating to aid in the acquisition, processing, and/or interpretation of CVI across various modalities, with several commercial products already in clinical use. It is imperative that cardiovascular imagers are familiar with DL systems, including a basic understanding of how they work, their relative strengths compared with other automated systems, and possible pitfalls in their implementation. The goal of this article is to review the methodology and application of DL to CVI in a simple, digestible fashion toward demystifying this emerging technology.

Observations

At its core, DL is simply the application of a series of tunable mathematical operations that translate input data into a desired output. Based on artificial neural networks that are inspired by the human nervous system, there are several types of DL architectures suited to different tasks; convolutional neural networks are particularly adept at extracting valuable information from CVI data. We survey some of the notable applications of DL to tasks across the spectrum of CVI modalities. We also discuss challenges in the development and implementation of DL systems, including avoiding overfitting, preventing systematic bias, improving explainability, and fostering a human-machine partnership. Finally, we conclude with a vision of the future of DL for CVI.

Conclusions and Relevance

Deep learning has the potential to meaningfully affect the field of CVI. Rather than a threat, DL could be seen as a partner to cardiovascular imagers in reducing technical burden and improving efficiency and quality of care. High-quality prospective evidence is still needed to demonstrate how the benefits of DL CVI systems may outweigh the risks.

Virtual healthcare solutions in heart failure: a literature review

The widespread adoption of mobile technologies offers an opportunity for a new approach to post-discharge care for patients with heart failure (HF). By enabling non-invasive remote monitoring and two-way, real-time communication between the clinic and home-based patients, as well as a host of other capabilities, mobile technologies have a potential to significantly improve remote patient care. This literature review summarizes clinical evidence related to virtual healthcare (VHC), defined as a care team + connected devices + a digital solution in post-release care of patients with HF. Searches were conducted on Embase (06/12/2020). A total of 171 studies were included for data extraction and evidence synthesis: 96 studies related to VHC efficacy, and 75 studies related to AI in HF. In addition, 15 publications were included from the search on studies scaling up VHC solutions in HF within the real-world setting. The most successful VHC interventions, as measured by the number of reported significant results, were those targeting reduction in rehospitalization rates. In terms of relative success rate, the two most effective interventions targeted patient self-care and all-cause hospital visits in their primary endpoint. Among the three categories of VHC identified in this review (telemonitoring, remote patient management, and patient self-empowerment) the integrated approach in remote patient management solutions performs the best in decreasing HF patients' re-admission rates and overall hospital visits. Given the increased amount of data generated by VHC technologies, artificial intelligence (AI) is being investigated as a tool to aid decision making in the context of primary diagnostics, identifying disease phenotypes, and predicting treatment outcomes. Currently, most AI algorithms are developed using data gathered in clinic and only a few studies deploy AI in the context of VHC. Most successes have been reported in predicting HF outcomes. Since the field of VHC in HF is relatively new and still in flux, this is not a typical systematic review capturing all published studies within this domain. Although the standard methodology for this type of reviews was followed, the nature of this review is qualitative. The main objective was to summarize the most promising results and identify potential research directions.

Latest Developments in Adapting Deep Learning for Assessing TAVR Procedures and Outcomes

Aortic valve defects are among the most prevalent clinical conditions. A severely damaged or non-functioning aortic valve is commonly replaced with a bioprosthetic heart valve (BHV) via the transcatheter aortic valve replacement (TAVR) procedure. Accurate pre-operative planning is crucial for a successful TAVR outcome. Assessment of computational fluid dynamics (CFD), finite element analysis (FEA), and fluid-solid interaction (FSI) analysis offer a solution that has been increasingly utilized to evaluate BHV mechanics and dynamics. However, the high computational costs and the complex operation of computational modeling hinder its application. Recent advancements in the deep learning (DL) domain can offer a real-time surrogate that can render hemodynamic parameters in a few seconds, thus guiding clinicians to select the optimal treatment option. Herein, we provide a comprehensive review of classical computational modeling approaches, medical imaging, and DL approaches for planning and outcome assessment of TAVR. Particularly, we focus on DL approaches in previous studies, highlighting the utilized datasets, deployed DL models, and achieved results. We emphasize the critical challenges and recommend several future directions for innovative researchers to tackle. Finally, an end-to-end smart DL framework is outlined for real-time assessment and recommendation of the best BHV design for TAVR. Ultimately, deploying such a framework in future studies will support clinicians in minimizing risks during TAVR therapy planning and will help in improving patient care.

Segmentation of 4D Flow MRI: Comparison between 3D Deep Learning and Velocity-Based Level Sets

A thoracic aortic aneurysm is an abnormal dilatation of the aorta that can progress and lead to rupture. The decision to conduct surgery is made by considering the maximum diameter, but it is now well known that this metric alone is not completely reliable. The advent of 4D flow magnetic resonance imaging has allowed for the calculation of new biomarkers for the study of aortic diseases, such as wall shear stress. However, the calculation of these biomarkers requires the precise segmentation of the aorta during all phases of the cardiac cycle. The objective of this work was to compare two different methods for automatically segmenting the thoracic aorta in the systolic phase using 4D flow MRI. The first method is based on a level set framework and uses the velocity field in addition to 3D phase contrast magnetic resonance imaging. The second method is a U-Net-like approach that is only applied to magnitude images from 4D flow MRI. The used dataset was composed of 36 exams from different patients, with ground truth data for the systolic phase of the cardiac cycle. The comparison was performed based on selected metrics, such as the Dice similarity coefficient (DSC) and Hausdorf distance (HD), for the whole aorta and also three aortic regions. Wall shear stress was also assessed and the maximum wall shear stress values were used for comparison. The U-Net-based approach provided statistically better results for the 3D segmentation of the aorta, with a DSC of 0.92 ± 0.02 vs. 0.86 ± 0.5 and an HD of 21.49 ± 24.8 mm vs. 35.79 ± 31.33 mm for the whole aorta. The absolute difference between the wall shear stress and ground truth slightly favored the level set method, but not significantly (0.754 ± 1.07 Pa vs. 0.737 ± 0.79 Pa). The results showed that the deep learning-based method should be considered for the segmentation of all time steps in order to evaluate biomarkers based on 4D flow MRI.

A benchmark study of convolutional neural networks in fully automatic segmentation of aortic root

Recent clinical studies have suggested that introducing 3D patient-specific aortic root models into the pre-operative assessment procedure of transcatheter aortic valve replacement (TAVR) would reduce the incident rate of peri-operative complications. Tradition manual segmentation is labor-intensive and low-efficient, which cannot meet the clinical demands of processing large data volumes. Recent developments in machine learning provided a viable way for accurate and efficient medical image segmentation for 3D patient-specific models automatically. This study quantitively evaluated the auto segmentation quality and efficiency of the four popular segmentation-dedicated three-dimensional (3D) convolutional neural network (CNN) architectures, including 3D UNet, VNet, 3D Res-UNet and SegResNet. All the CNNs were implemented in PyTorch platform, and low-dose CTA image sets of 98 anonymized patients were retrospectively selected from the database for training and testing of the CNNs. The results showed that despite all four 3D CNNs having similar recall, Dice similarity coefficient (DSC), and Jaccard index on the segmentation of the aortic root, the Hausdorff distance (HD) of the segmentation results from 3D Res-UNet is 8.56 ± 2.28, which is only 9.8% higher than that of VNet, but 25.5% and 86.4% lower than that of 3D UNet and SegResNet, respectively. In addition, 3D Res-UNet and VNet also performed better in the 3D deviation location of interest analysis focusing on the aortic valve and the bottom of the aortic root. Although 3D Res-UNet and VNet are evenly matched in the aspect of classical segmentation quality evaluation metrics and 3D deviation location of interest analysis, 3D Res-UNet is the most efficient CNN architecture with an average segmentation time of 0.10 ± 0.04 s, which is 91.2%, 95.3% and 64.3% faster than 3D UNet, VNet and SegResNet, respectively. The results from this study suggested that 3D Res-UNet is a suitable candidate for accurate and fast automatic aortic root segmentation for pre-operative assessment of TAVR.

Aortic shape variation after frozen elephant trunk procedure predicts aortic events: Principal component analysis study

Objective

The frozen elephant trunk procedure is a well-established technique for the repair of type A ascending aortic dissection and complex aortic arch pathology. The ultimate shape created by the repair may have consequences in long-term complications. The purpose of this study was to apply a machine learning technique to comprehensively describe 3-dimensional aortic shape variations after the frozen elephant trunk procedure and associate these variations with aortic events.

Methods

Computed tomography angiography acquired before discharge of patients (n = 93) who underwent the frozen elephant trunk procedure for type A ascending aortic dissection or ascending aortic arch aneurysm was preprocessed to yield patient-specific aortic models and centerlines. Aortic centerlines were subjected to principal component analysis to describe principal components and aortic shape modulators. Patient-specific shape scores were correlated with outcomes defined by composite aortic event, including aortic rupture, aortic root dissection or pseudoaneurysm, new type B dissection, new thoracic or thoracoabdominal pathologies, residual descending aortic dissection with residual false lumen flow, or thoracic endovascular aortic repair complications.

Results

The first 3 principal components accounted for 36.4%, 26.4%, and 11.6% of aortic shape variance, respectively, and cumulatively for 74.5% of the total shape variation in all patients. The first principal component described variation in arch height-to-length ratio, the second principal component described angle at the isthmus, and the third principal component described variation in anterior-to-posterior arch tilt. Twenty-one aortic events (22.6%) were encountered. The degree of aortic angle at the isthmus described by the second principal component was associated with aortic events in logistic regression (hazard ratio, 0.98; 95% confidence interval, 0.97-0.99; P = .046).

Conclusions

The second principal component, describing angulation at the region of the aortic isthmus, was associated with adverse aortic events. Observed shape variation should be evaluated in the context of aortic biomechanical properties and flow hemodynamics.

Cerebrovascular super-resolution 4D Flow MRI - Sequential combination of resolution enhancement by deep learning and physics-informed image processing to non-invasively quantify intracranial velocity, flow, and relative pressure

The development of cerebrovascular disease is tightly coupled to regional changes in intracranial flow and relative pressure. Image-based assessment using phase contrast magnetic resonance imaging has particular promise for non-invasive full-field mapping of cerebrovascular hemodynamics. However, estimations are complicated by the narrow and tortuous intracranial vasculature, with accurate image-based quantification directly dependent on sufficient spatial resolution. Further, extended scan times are required for high-resolution acquisitions, and most clinical acquisitions are performed at comparably low resolution (>1 mm) where biases have been observed with regard to the quantification of both flow and relative pressure. The aim of our study was to develop an approach for quantitative intracranial super-resolution 4D Flow MRI, with effective resolution enhancement achieved by a dedicated deep residual network, and with accurate quantification of functional relative pressures achieved by subsequent physics-informed image processing. To achieve this, our two-step approach was trained and validated in a patient-specific in-silico cohort, showing good accuracy in estimating velocity (relative error: 15.0 ± 0.1%, mean absolute error (MAE): 0.07 ± 0.06 m/s, and cosine similarity: 0.99 ± 0.06 at peak velocity) and flow (relative error: 6.6 ± 4.7%, root mean square error (RMSE): 0.56 mL/s at peak flow), and with the coupled physics-informed image analysis allowing for maintained recovery of functional relative pressure throughout the circle of Willis (relative error: 11.0 ± 7.3%, RMSE: 0.3 ± 0.2 mmHg). Furthermore, the quantitative super-resolution approach is applied to an in-vivo volunteer cohort, effectively generating intracranial flow images at <0.5 mm resolution and showing reduced low-resolution bias in relative pressure estimation. Our work thus presents a promising two-step approach to non-invasively quantify cerebrovascular hemodynamics, being applicable to dedicated clinical cohorts in the future.

Neural Network in the Analysis of the MR Signal as an Image Segmentation Tool for the Determination of T1 and T2 Relaxation Times with Application to Cancer Cell Culture

Artificial intelligence has been entering medical research. Today, manufacturers of diagnostic instruments are including algorithms based on neural networks. Neural networks are quickly entering all branches of medical research and beyond. Analyzing the PubMed database from the last 5 years (2017 to 2021), we see that the number of responses to the query "neural network in medicine" exceeds 10,500 papers. Deep learning algorithms are of particular importance in oncology. This paper presents the use of neural networks to analyze the magnetic resonance imaging (MRI) images used to determine MRI relaxometry of the samples. Relaxometry is becoming an increasingly common tool in diagnostics. The aim of this work was to optimize the processing time of DICOM images by using a neural network implemented in the MATLAB package by The MathWorks with the patternnet function. The application of a neural network helps to eliminate spaces in which there are no objects with characteristics matching the phenomenon of longitudinal or transverse MRI relaxation. The result of this work is the elimination of aerated spaces in MRI images. The whole algorithm was implemented as an application in the MATLAB package.

Fully-automated deep learning-based flow quantification of 2D CINE phase contrast MRI

OBJECTIVES

Time-resolved, 2D-phase-contrast MRI (2D-CINE-PC-MRI) enables in vivo blood flow analysis. However, accurate vessel contour delineation (VCD) is required to achieve reliable results. We sought to evaluate manual analysis (MA) compared to the performance of a deep learning (DL) application for fully-automated VCD and flow quantification and corrected semi-automated analysis (corSAA).

METHODS

We included 97 consecutive patients (age = 52.9 ± 16 years, 41 female) with 2D-CINE-PC-MRI imaging on 1.5T MRI systems at sinotubular junction (STJ), and 28/97 also received 2D-CINE-PC at main pulmonary artery (PA). A cardiovascular radiologist performed MA (reference) and corSAA (built-in tool) in commercial software for all cardiac time frames (median: 20, total contours per analysis: 2358 STJ, 680 PA). DL-analysis automatically performed VCD, followed by net flow (NF) and peak velocity (PV) quantification. Contours were compared using Dice similarity coefficients (DSC). Discrepant cases (> ± 10 mL or > ± 10 cm/s) were reviewed in detail.

RESULTS

DL was successfully applied to 97% (121/125) of the 2D-CINE-PC-MRI series (STJ: 95/97, 98%, PA: 26/28, 93%). Compared to MA, mean DSC were 0.91 ± 0.02 (DL), 0.94 ± 0.02 (corSAA) at STJ, and 0.85 ± 0.08 (DL), 0.93 ± 0.02 (corSAA) at PA; this indicated good to excellent DL-performance. Flow quantification revealed similar NF at STJ (p = 0.48) and PA (p > 0.05) between methods while PV assessment was significantly different (STJ: p < 0.001, PA: p = 0.04). A detailed review showed noisy voxels in MA and corSAA impacted PV results. Overall, DL analysis compared to human assessments was accurate in 113/121 (93.4%) cases.

CONCLUSIONS

Fully-automated DL-analysis of 2D-CINE-PC-MRI provided flow quantification at STJ and PA at expert level in > 93% of cases with results being available instantaneously.

KEY POINTS

• Deep learning performed flow quantification on clinical 2D-CINE-PC series at the sinotubular junction and pulmonary artery at the expert level in > 93% of cases. • Location detection and contouring of the vessel boundaries were performed fully-automatic with results being available instantaneously compared to human assessments which approximately takes three minutes per location. • The evaluated tool indicates usability in daily practice.

Advances in machine learning applications for cardiovascular 4D flow MRI

Four-dimensional flow magnetic resonance imaging (MRI) has evolved as a non-invasive imaging technique to visualize and quantify blood flow in the heart and vessels. Hemodynamic parameters derived from 4D flow MRI, such as net flow and peak velocities, but also kinetic energy, turbulent kinetic energy, viscous energy loss, and wall shear stress have shown to be of diagnostic relevance for cardiovascular diseases. 4D flow MRI, however, has several limitations. Its long acquisition times and its limited spatio-temporal resolutions lead to inaccuracies in velocity measurements in small and low-flow vessels and near the vessel wall. Additionally, 4D flow MRI requires long post-processing times, since inaccuracies due to the measurement process need to be corrected for and parameter quantification requires 2D and 3D contour drawing. Several machine learning (ML) techniques have been proposed to overcome these limitations. Existing scan acceleration methods have been extended using ML for image reconstruction and ML based super-resolution methods have been used to assimilate high-resolution computational fluid dynamic simulations and 4D flow MRI, which leads to more realistic velocity results. ML efforts have also focused on the automation of other post-processing steps, by learning phase corrections and anti-aliasing. To automate contour drawing and 3D segmentation, networks such as the U-Net have been widely applied. This review summarizes the latest ML advances in 4D flow MRI with a focus on technical aspects and applications. It is divided into the current status of fast and accurate 4D flow MRI data generation, ML based post-processing tools for phase correction and vessel delineation and the statistical evaluation of blood flow.

A clinical decision support system for predicting coronary artery stenosis in patients with suspected coronary heart disease

Invasive coronary angiography imposes risks and high medical costs. Therefore, accurate, reliable, non-invasive, and cost-effective methods for diagnosing coronary stenosis are required. We designed a machine learning-based risk-prediction system as an accurate, noninvasive, and cost-effective alternative method for evaluating suspected coronary heart disease (CHD) patients. Electronic medical record data were collected from suspected CHD patients undergoing coronary angiography between May 1, 2017, and December 31, 2019. Multi-Class XGBoost, LightGBM, Random Forest, NGBoost, logistic models and MLP were constructed to identify patients with normal coronary arteries (class 0: no coronary artery stenosis), minimum coronary artery stenosis (class 1: 0 < stenosis <50%), and CHD (class 2: stenosis ≥50%). Model stability was verified externally. A risk-assessment and management system was established for patient-specific intervention guidance. Of 1577 suspected CHD patients, 81 (5.14%) had normal coronary arteries. The XGBoost model demonstrated the best overall classification performance (micro-average receiver operating characteristic [ROC] curve: 0.92, macro-average ROC curve: 0.89, class 0 ROC curve: 0.88, class 1 ROC curve: 0.90, class 2 ROC curve: 0.89), with good external verification. In class-specific classification, the XGBoost model yielded F1 values of 0.636, 0.850, and 0.858, for Classes 0, 1, and 2, respectively. The visualization system allowed disease diagnosis and probability estimation, and identified the intervention focus for individual patients. Thus, the system distinguished coronary artery stenosis well in suspected CHD patients. Personalized probability curves provide individualized intervention guidance. This may reduce the number of invasive inspections in negative patients, while facilitating decision-making regarding appropriate medical intervention, improving patient prognosis.

Synthesis of patient-specific multipoint 4D flow MRI data of turbulent aortic flow downstream of stenotic valves

We propose to synthesize patient-specific 4D flow MRI datasets of turbulent flow paired with ground truth flow data to support training of inference methods. Turbulent blood flow is computed based on the Navier-Stokes equations with moving domains using realistic boundary conditions for aortic shapes, wall displacements and inlet velocities obtained from patient data. From the simulated flow, synthetic multipoint 4D flow MRI data is generated with user-defined spatiotemporal resolutions and reconstructed with a Bayesian approach to compute time-varying velocity and turbulence maps. For MRI data synthesis, a fixed hypothetical scan time budget is assumed and accordingly, changes to spatial resolution and time averaging result in corresponding scaling of signal-to-noise ratios (SNR). In this work, we focused on aortic stenotic flow and quantification of turbulent kinetic energy (TKE). Our results show that for spatial resolutions of 1.5 and 2.5 mm and time averaging of 5 ms as encountered in 4D flow MRI in practice, peak total turbulent kinetic energy downstream of a 50, 75 and 90% stenosis is overestimated by as much as 23, 15 and 14% (1.5 mm) and 38, 24 and 23% (2.5 mm), demonstrating the importance of paired ground truth and 4D flow MRI data for assessing accuracy and precision of turbulent flow inference using 4D flow MRI exams.

Modern Approaches for the Treatment of Heart Failure: Recent Advances and Future Perspectives

Heart failure (HF) is a progressively deteriorating medical condition that significantly reduces both the patients' life expectancy and quality of life. Even though real progress was made in the past decades in the discovery of novel pharmacological treatments for HF, the prevention of premature deaths has only been marginally alleviated. Despite the availability of a plethora of pharmaceutical approaches, proper management of HF is still challenging. Thus, a myriad of experimental and clinical studies focusing on the discovery of new and provocative underlying mechanisms of HF physiopathology pave the way for the development of novel HF therapeutic approaches. Furthermore, recent technological advances made possible the development of various interventional techniques and device-based approaches for the treatment of HF. Since many of these modern approaches interfere with various well-known pathological mechanisms in HF, they have a real ability to complement and or increase the efficiency of existing medications and thus improve the prognosis and survival rate of HF patients. Their promising and encouraging results reported to date compel the extension of heart failure treatment beyond the classical view. The aim of this review was to summarize modern approaches, new perspectives, and future directions for the treatment of HF.

Prediction of SARS-CoV-2-positivity from million-scale complete blood counts using machine learning

Background

The Complete Blood Count (CBC) is a commonly used low-cost test that measures white blood cells, red blood cells, and platelets in a person's blood. It is a useful tool to support medical decisions, as intrinsic variations of each analyte bring relevant insights regarding potential diseases. In this study, we aimed at developing machine learning models for COVID-19 diagnosis through CBCs, unlocking the predictive power of non-linear relationships between multiple blood analytes.

Methods

We collected 809,254 CBCs and 1,088,385 RT-PCR tests for SARS-Cov-2, of which 21% (234,466) were positive, from 900,220 unique individuals. To properly screen COVID-19, we also collected 120,807 CBCs of 16,940 individuals who tested positive for other respiratory viruses. We proposed an ensemble procedure that combines machine learning models for different respiratory infections and analyzed the results in both the first and second waves of COVID-19 cases in Brazil.

Results

We obtain a high-performance AUROC of 90 + % for validations in both scenarios. We show that models built solely of SARS-Cov-2 data are biased, performing poorly in the presence of infections due to other RNA respiratory viruses.

Conclusions

We demonstrate the potential of a novel machine learning approach for COVID-19 diagnosis based on a CBC and show that aggregating information about other respiratory diseases was essential to guarantee robustness in the results. Given its versatile nature, low cost, and speed, we believe that our tool can be particularly useful in a variety of scenarios-both during the pandemic and after.

Multi-constraints based deep learning model for automated segmentation and diagnosis of coronary artery disease in X-ray angiographic images

BACKGROUND

The detection of coronary artery disease (CAD) from the X-ray coronary angiography is a crucial process which is hindered by various issues such as presence of noise, insufficient contrast of the input images along with the uncertainties caused by the motion due to respiration and variation of angles of vessels.

METHODS

In this article, an Automated Segmentation and Diagnosis of Coronary Artery Disease (ASCARIS) model is proposed in order to overcome the prevailing challenges in detection of CAD from the X-ray images. Initially, the preprocessing of the input images was carried out by using the modified wiener filter for the removal of both internal and external noise pixels from the images. Then, the enhancement of contrast was carried out by utilizing the optimized maximum principal curvature to preserve the edge information thereby contributing to increasing the segmentation accuracy. Further, the binarization of enhanced images was executed by the means of OTSU thresholding. The segmentation of coronary arteries was performed by implementing the Attention-based Nested U-Net, in which the attention estimator was incorporated to overcome the difficulties caused by intersections and overlapped arteries. The increased segmentation accuracy was achieved by performing angle estimation. Finally, the VGG-16 based architecture was implemented to extract threefold features from the segmented image to perform classification of X-ray images into normal and abnormal classes.

RESULTS

The experimentation of the proposed ASCARIS model was carried out in the MATLAB R2020a simulation tool and the evaluation of the proposed model was compared with several existing approaches in terms of accuracy, sensitivity, specificity, revised contrast to noise ratio, mean square error, dice coefficient, Jaccard similarity, Hausdorff distance, Peak signal-to-noise ratio (PSNR), segmentation accuracy and ROC curve.

DISCUSSION

The results obtained conclude that the proposed model outperforms the existing approaches in all the evaluation metrics thereby achieving optimized classification of CAD. The proposed method removes the large number of background artifacts and obtains a better vascular structure.

The Role of Cardiac Magnetic Resonance in Aortic Stenosis and Regurgitation

Cardiac magnetic resonance (CMR) imaging is a well-set diagnostic technique for assessment of valvular heart diseases and is gaining ground in current clinical practice. It provides high-quality images without the administration of ionizing radiation and occasionally without the need of contrast agents. It offers the unique possibility of a comprehensive stand-alone assessment of the heart including biventricular function, left ventricle remodeling, myocardial fibrosis, and associated valvulopathies. CMR is the recognized reference for the quantification of ventricular volumes, mass, and function. A particular strength is the ability to quantify flow, especially with new techniques which allow accurate measurement of stenosis and regurgitation. Furthermore, tissue mapping enables the visualization and quantification of structural changes in the myocardium. In this way, CMR has the potential to yield important prognostic information predicting those patients who will progress to surgery and impact outcomes. In this review, the fundamentals of CMR in assessment of aortic valve diseases (AVD) are described, together with its strengths and weaknesses. This state-of-the-art review provides an updated overview of CMR potentials in all AVD issues, including valve anatomy, flow quantification, ventricular volumes and function, and tissue characterization.

Improving the accuracy and robustness of carotid-femoral pulse wave velocity measurement using a simplified tube-load model

Arterial stiffness, as measured by pulse wave velocity, for the early non-invasive screening of cardiovascular disease is becoming ever more widely used and is an independent prognostic indicator for a variety of pathologies including arteriosclerosis. Carotid-femoral pulse wave velocity (cfPWV) is regarded as the gold standard for aortic stiffness. Existing algorithms for cfPWV estimation have been shown to have good repeatability and accuracy, however, further assessment is needed, especially when signal quality is compromised. We propose a method for calculating cfPWV based on a simplified tube-load model, which allows for the propagation and reflection of the pulse wave. In-vivo cfPWV measurements from 57 subjects and numerical cfPWV data based on a one-dimensional model were used to assess the method and its performance was compared to three other existing approaches (waveform matching, intersecting tangent, and cross-correlation). The cfPWV calculated using the simplified tube-load model had better repeatability than the other methods (Intra-group Correlation Coefficient, ICC = 0.985). The model was also more accurate than other methods (deviation, 0.13 ms⁻¹) and was more robust when dealing with noisy signals. We conclude that the determination of cfPWV based on the proposed model can accurately and robustly evaluate arterial stiffness.

Deep Learning-based Automated Aortic Area and Distensibility Assessment: the Multi-Ethnic Study of Atherosclerosis (MESA)

This study details application of deep learning for automatic segmentation of the ascending and descending aorta from 2D phase-contrast cine magnetic resonance imaging for automatic aortic analysis on the large MESA cohort with assessment on an external cohort of thoracic aortic aneurysm (TAA) patients. This study includes images and corresponding analysis of the ascending and descending aorta at the pulmonary artery bifurcation from the MESA study. Train, validation, and internal test sets consisted of 1123 studies (24,282 images), 374 studies (8067 images), and 375 studies (8069 images), respectively. The external test set of TAAs consisted of 37 studies (3224 images). CNN performance was evaluated utilizing a dice coefficient and concordance correlation coefficients (CCC) of geometric parameters. Dice coefficients were as high as 97.55% (CI: 97.47-97.62%) and 93.56% (CI: 84.63-96.68%) on the internal and external test of TAAs, respectively. CCC for maximum and minimum and ascending aortic area were 0.969 and 0.950, respectively, on the internal test set and 0.997 and 0.995, respectively, for the external test. The absolute differences between manual and deep learning segmentations for ascending and descending aortic distensibility were 0.0194 × 10^-4 ± 9.67 × 10^-4 and 0.002 ± 0.001 mmHg^-1, respectively, on the internal test set and 0.44 × 10^-4 ± 20.4 × 10^-4 and 0.002 ± 0.001 mmHg^-1, respectively, on the external test set. We successfully developed a U-Net-based aortic segmentation and analysis algorithm in both MESA and in external cases of TAA.

Artificial Intelligence in Cardiac MRI: Is Clinical Adoption Forthcoming?

Artificial intelligence (AI) refers to the area of knowledge that develops computerised models to perform tasks that typically require human intelligence. These algorithms are programmed to learn and identify patterns from "training data," that can be subsequently applied to new datasets, without being explicitly programmed to do so. AI is revolutionising the field of medical imaging and in particular of Cardiovascular Magnetic Resonance (CMR) by providing deep learning solutions for image acquisition, reconstruction and analysis, ultimately supporting the clinical decision making. Numerous methods have been developed over recent years to enhance and expedite CMR data acquisition, image reconstruction, post-processing and analysis; along with the development of promising AI-based biomarkers for a wide spectrum of cardiac conditions. The exponential rise in the availability and complexity of CMR data has fostered the development of different AI models. Integration in clinical routine in a meaningful way remains a challenge. Currently, innovations in this field are still mostly presented in proof-of-concept studies with emphasis on the engineering solutions; often recruiting small patient cohorts or relying on standardised databases such as Multi-ethnic Study on atherosclerosis (MESA), UK Biobank and others. The wider incorporation of clinically valid endpoints such as symptoms, survival, need and response to treatment remains to be seen. This review briefly summarises the current principles of AI employed in CMR and explores the relevant prospective observational studies in cardiology patient cohorts. It provides an overview of clinical studies employing undersampled reconstruction techniques to speed up the scan encompassing cine imaging, whole-heart imaging, multi-parametric mapping and magnetic resonance fingerprinting along with the clinical utility of AI applications in image post-processing, and analysis. Specific focus is given to studies that have incorporated CMR-derived prediction models for prognostication in cardiac disease. It also discusses current limitations and proposes potential developments to enable multi-disciplinary collaboration for improved evidence-based medicine. AI is an extremely promising field and the timely integration of clinician's input in the ingenious technical investigator's paradigm holds promise for a bright future in the medical field.

The role of artificial intelligence in paediatric cardiovascular magnetic resonance imaging

Artificial intelligence (AI) offers the potential to change many aspects of paediatric cardiac imaging. At present, there are only a few clinically validated examples of AI applications in this field. This review focuses on the use of AI in paediatric cardiovascular MRI, using examples from paediatric cardiovascular MRI, adult cardiovascular MRI and other radiologic experience.

Leveraging the potential of machine learning for assessing vascular ageing: state-of-the-art and future research

Vascular ageing biomarkers have been found to be predictive of cardiovascular risk independently of classical risk factors, yet are not widely used in clinical practice. In this review, we present two basic approaches for using machine learning (ML) to assess vascular age: parameter estimation and risk classification. We then summarize their role in developing new techniques to assess vascular ageing quickly and accurately. We discuss the methods used to validate ML-based markers, the evidence for their clinical utility, and key directions for future research. The review is complemented by case studies of the use of ML in vascular age assessment which can be replicated using freely available data and code.

Clinically-Driven Virtual Patient Cohorts Generation: An Application to Aorta

The combination of machine learning methods together with computational modeling and simulation of the cardiovascular system brings the possibility of obtaining very valuable information about new therapies or clinical devices through in-silico experiments. However, the application of machine learning methods demands access to large cohorts of patients. As an alternative to medical data acquisition and processing, which often requires some degree of manual intervention, the generation of virtual cohorts made of synthetic patients can be automated. However, the generation of a synthetic sample can still be computationally demanding to guarantee that it is clinically meaningful and that it reflects enough inter-patient variability. This paper addresses the problem of generating virtual patient cohorts of thoracic aorta geometries that can be used for in-silico trials. In particular, we focus on the problem of generating a cohort of patients that meet a particular clinical criterion, regardless the access to a reference sample of that phenotype. We formalize the problem of clinically-driven sampling and assess several sampling strategies with two goals, sampling efficiency, i.e., that the generated individuals actually belong to the target population, and that the statistical properties of the cohort can be controlled. Our results show that generative adversarial networks can produce reliable, clinically-driven cohorts of thoracic aortas with good efficiency. Moreover, non-linear predictors can serve as an efficient alternative to the sometimes expensive evaluation of anatomical or functional parameters of the organ of interest.

Artificial intelligence and machine learning in aortic disease

PURPOSE OF REVIEW

Discuss foundational concepts for artificial intelligence (AI) and review recent literature on its application to aortic disease.

RECENT FINDINGS

Machine learning (ML) techniques are rapidly evolving for the evaluation of aortic disease - broadly categorized as algorithms for aortic segmentation, detection of pathology, and risk stratification. Advances in deep learning, particularly U-Net architectures, have revolutionized segmentation of the aorta and show potential for monitoring the size of aortic aneurysm and characterizing aortic dissection. These algorithms also facilitate application of more complex technologies including analysis of flow dynamics with 4D Flow magnetic resonance imaging (MRI) and computational simulation of fluid dynamics for aortic coarctation. In addition, AI algorithms have been proposed to assist in 'opportunistic' screening from routine imaging exams, including automated aortic calcification score, which has emerged as a strong predictor of cardiovascular risk. Finally, several ML algorithms are being explored for risk stratification of patients with aortic aneurysm and dissection, in addition to prediction of postprocedural complications.

SUMMARY

Multiple ML techniques have potential for characterization and risk prediction of aortic aneurysm, dissection, coarctation, and atherosclerotic disease on computed tomography and MRI. This nascent field shows considerable promise with many applications in development and in early preclinical evaluation.

Aortography Keypoint Tracking for Transcatheter Aortic Valve Implantation Based on Multi-Task Learning

Currently, transcatheter aortic valve implantation (TAVI) represents the most efficient treatment option for patients with aortic stenosis, yet its clinical outcomes largely depend on the accuracy of valve positioning that is frequently complicated when routine imaging modalities are applied. Therefore, existing limitations of perioperative imaging underscore the need for the development of novel visual assistance systems enabling accurate procedures. In this paper, we propose an original multi-task learning-based algorithm for tracking the location of anatomical landmarks and labeling critical keypoints on both aortic valve and delivery system during TAVI. In order to optimize the speed and precision of labeling, we designed nine neural networks and then tested them to predict 11 keypoints of interest. These models were based on a variety of neural network architectures, namely MobileNet V2, ResNet V2, Inception V3, Inception ResNet V2 and EfficientNet B5. During training and validation, ResNet V2 and MobileNet V2 architectures showed the best prediction accuracy/time ratio, predicting keypoint labels and coordinates with 97/96% accuracy and 4.7/5.6% mean absolute error, respectively. Our study provides evidence that neural networks with these architectures are capable to perform real-time predictions of aortic valve and delivery system location, thereby contributing to the proper valve positioning during TAVI.

A deep learning pipeline for automatic analysis of multi-scan cardiovascular magnetic resonance

BACKGROUND

Cardiovascular magnetic resonance (CMR) sequences are commonly used to obtain a complete description of the function and structure of the heart, provided that accurate measurements are extracted from images. New methods of extraction of information are being developed, among them, deep neural networks are powerful tools that showed the ability to perform fast and accurate segmentation. Iq1n order to reduce the time spent by reading physicians to process data and minimize intra- and inter-observer variability, we propose a fully automatic multi-scan CMR image analysis pipeline.

METHODS

Sequence specific U-Net 2D models were trained to perform the segmentation of the left ventricle (LV), right ventricle (RV) and aorta in cine short-axis, late gadolinium enhancement (LGE), native T1 map, post-contrast T1, native T2 map and aortic flow sequences depending on the need. The models were trained and tested on a set of data manually segmented by experts using semi-automatic and manual tools. A set of parameters were computed from the resulting segmentations such as the left ventricular and right ventricular ejection fraction (EF), LGE scar percentage, the mean T1, T1 post, T2 values within the myocardium, and aortic flow. The Dice similarity coefficient, Hausdorff distance, mean surface distance, and Pearson correlation coefficient R were used to assess and compare the results of the U-Net based pipeline with intra-observer variability. Additionally, the pipeline was validated on two clinical studies.

RESULTS

The sequence specific U-Net 2D models trained achieved fast (≤ 0.2 s/image on GPU) and precise segmentation over all the targeted region of interest with high Dice scores (= 0.91 for LV, = 0.92 for RV, = 0.93 for Aorta in average) comparable to intra-observer Dice scores (= 0.86 for LV, = 0.87 for RV, = 0.95 for aorta flow in average). The automatically and manually computed parameters were highly correlated (R = 0.91 in average) showing results superior to the intra-observer variability (R = 0.85 in average) for every sequence presented here.

CONCLUSION

The proposed pipeline allows for fast and robust analysis of large CMR studies while guaranteeing reproducibility, hence potentially improving patient's diagnosis as well as clinical studies outcome.

Potential Role of Artificial Intelligence in Cardiac Magnetic Resonance Imaging: Can It Help Clinicians in Making a Diagnosis?

In the era of modern medicine, artificial intelligence (AI) is a growing field of interest which is experiencing a steady development. Several applications of AI have been applied to various aspects of cardiac magnetic resonance to assist clinicians and engineers in reducing the costs of exams and, at the same time, to improve image acquisition and reconstruction, thus simplifying their analysis, interpretation, and decision-making process as well. In fact, the role of AI and machine learning in cardiovascular imaging relies on evaluating images more quickly, improving their quality, nulling intraobserver and interobserver variability in their interpretation, upgrading the understanding of the stage of the disease, and providing with a personalized approach to cardiovascular care. In addition, AI algorithm could be directed toward workflow management. This article presents an overview of the existing AI literature in cardiac magnetic resonance, with its strengths and limitations, recent applications, and promising developments. We conclude that AI is very likely be used in all the various process of diagnosis routine mode for cardiac care of patients.

Fully-automated global and segmental strain analysis of DENSE cardiovascular magnetic resonance using deep learning for segmentation and phase unwrapping

BACKGROUND

Cardiovascular magnetic resonance (CMR) cine displacement encoding with stimulated echoes (DENSE) measures heart motion by encoding myocardial displacement into the signal phase, facilitating high accuracy and reproducibility of global and segmental myocardial strain and providing benefits in clinical performance. While conventional methods for strain analysis of DENSE images are faster than those for myocardial tagging, they still require manual user assistance. The present study developed and evaluated deep learning methods for fully-automatic DENSE strain analysis.

METHODS

Convolutional neural networks (CNNs) were developed and trained to (a) identify the left-ventricular (LV) epicardial and endocardial borders, (b) identify the anterior right-ventricular (RV)-LV insertion point, and (c) perform phase unwrapping. Subsequent conventional automatic steps were employed to compute strain. The networks were trained using 12,415 short-axis DENSE images from 45 healthy subjects and 19 heart disease patients and were tested using 10,510 images from 25 healthy subjects and 19 patients. Each individual CNN was evaluated, and the end-to-end fully-automatic deep learning pipeline was compared to conventional user-assisted DENSE analysis using linear correlation and Bland Altman analysis of circumferential strain.

RESULTS

LV myocardial segmentation U-Nets achieved a DICE similarity coefficient of 0.87 ± 0.04, a Hausdorff distance of 2.7 ± 1.0 pixels, and a mean surface distance of 0.41 ± 0.29 pixels in comparison with manual LV myocardial segmentation by an expert. The anterior RV-LV insertion point was detected within 1.38 ± 0.9 pixels compared to manually annotated data. The phase-unwrapping U-Net had similar or lower mean squared error vs. ground-truth data compared to the conventional path-following method for images with typical signal-to-noise ratio (SNR) or low SNR (p < 0.05), respectively. Bland-Altman analyses showed biases of 0.00 ± 0.03 and limits of agreement of - 0.04 to 0.05 or better for deep learning-based fully-automatic global and segmental end-systolic circumferential strain vs. conventional user-assisted methods.

CONCLUSIONS

Deep learning enables fully-automatic global and segmental circumferential strain analysis of DENSE CMR providing excellent agreement with conventional user-assisted methods. Deep learning-based automatic strain analysis may facilitate greater clinical use of DENSE for the quantification of global and segmental strain in patients with cardiac disease.

Artificial Intelligence and Transcatheter Interventions for Structural Heart Disease: A glance at the (near) future

With innovations in therapeutic technologies and changes in population demographics, transcatheter interventions for structural heart disease have become the preferred treatment and will keep growing. Yet, a thorough clinical selection and efficient pathway from diagnosis to treatment and follow-up are mandatory. In this review we reflect on how artificial intelligence may help to improve patient selection, pre-procedural planning, procedure execution and follow-up so to establish efficient and high quality health care in an increasing number of patients.

Reference ranges ("normal values") for cardiovascular magnetic resonance (CMR) in adults and children: 2020 update

Cardiovascular magnetic resonance (CMR) enables assessment and quantification of morphological and functional parameters of the heart, including chamber size and function, diameters of the aorta and pulmonary arteries, flow and myocardial relaxation times. Knowledge of reference ranges ("normal values") for quantitative CMR is crucial to interpretation of results and to distinguish normal from disease. Compared to the previous version of this review published in 2015, we present updated and expanded reference values for morphological and functional CMR parameters of the cardiovascular system based on the peer-reviewed literature and current CMR techniques. Further, databases and references for deep learning methods are included.

Automated detection of left ventricle in arterial input function images for inline perfusion mapping using deep learning: A study of 15,000 patients

PURPOSE

Quantification of myocardial perfusion has the potential to improve the detection of regional and global flow reduction. Significant effort has been made to automate the workflow, where one essential step is the arterial input function (AIF) extraction. Failure to accurately identify the left ventricle (LV) prevents AIF estimation required for quantification, therefore high detection accuracy is required. This study presents a robust LV detection method using the convolutional neural network (CNN).

METHODS

CNN models were trained by assembling 25,027 scans (N = 12,984 patients) from three hospitals, seven scanners. Performance was evaluated using a hold-out test set of 5721 scans (N = 2805 patients). Model inputs were a time series of AIF images (2D+T). Two variations were investigated: (1) two classes (2CS) for background and foreground (LV mask), and (2) three classes (3CS) for background, LV, and RV. The final model was deployed on MRI scanners using the Gadgetron reconstruction software framework.

RESULTS

Model loading on the MRI scanner took ~340 ms and applying the model took ~180 ms. The 3CS model successfully detected the LV in 99.98% of all test cases (1 failure out of 5721). The mean Dice ratio for 3CS was 0.87 ± 0.08 with 92.0% of all cases having Dice >0.75. The 2CS model gave a lower Dice ratio of 0.82 ± 0.22 (P < 1e-5). There was no significant difference in foot-time, peak-time, first-pass duration, peak value, and area-under-curve (P > .2) comparing automatically extracted AIF signals with signals from manually drawn contours.

CONCLUSIONS

A CNN-based solution to detect the LV blood pool from the arterial input function image series was developed, validated, and deployed. A high LV detection accuracy of 99.98% was achieved.

Left Atrial Strain Impairment Precedes Geometric Remodeling as a Marker of Post-Myocardial Infarction Diastolic Dysfunction

OBJECTIVES

The aims of this study were to test the magnitude of agreement between echocardiography (echo)- and cardiac magnetic resonance (CMR)-derived left atrial (LA) strain and to study their relative diagnostic performance in discriminating diastolic dysfunction (DD) and predicting atrial fibrillation (AF).

BACKGROUNDS

Peak atrial longitudinal strain (PALS) is a novel performance index. Utility of echo-quantified LA strain has yet to be prospectively tested in relation to current DD guidelines or compared to CMR.

METHODS

The study population comprised 257 post-myocardial infarction (MI) patients undergoing echo and CMR, including prospective derivation (n = 157) and clinical validation (n = 100) cohorts. DD was graded on echo using established consensus guidelines blinded to strain results.

RESULTS

PALS on both echo and CMR was nearly 2-fold lower among patients with versus no DD (p < 0.001) and was significantly different in those with mild versus no DD (p < 0.01). In contrast, LA geometric parameters including echo- and CMR-derived volumes were significantly different between advanced versus no DD groups (p < 0.001) but not between groups with mild versus no DD (all p > 0.05). Echo and CMR PALS yielded small differences irrespective of orientation and similar diagnostic performance for DD in the derivation (area under the curve [AUC]: 0.70 to 0.78) and validation (AUC: 0.75 to 0.78) cohorts. Impaired PALS on both modalities was independently associated with MI size (p < 0.001). During 4.4 ± 3.8 years of follow-up in the derivation cohort, 8% developed AF. Both 2-chamber echo- and CMR-derived PALS stratified arrhythmic risk (p = 0.004 and p = 0.02, respectively), including a 4-fold difference among patients in the lowest versus remainder of quartiles of echo-derived PALS (24% vs. 6%). Similarly, echo and CMR PALS were lower (both p < 0.05) among patients with subsequent heart failure hospitalizations.

CONCLUSIONS

Echo-derived PALS parallels results of CMR, yields incremental diagnostic utility versus LA geometry for stratifying presence and severity of DD, and improves prediction of AF and congestive heart failure after MI.

Integration of artificial intelligence into clinical patient management: focus on cardiac imaging

Cardiac imaging is a crucial component in the management of patients with heart disease, and as such it influences multiple, inter-related parts of the clinical workflow: physician-patient contact, image acquisition, image pre- and postprocessing, study reporting, diagnostics and outcome predictions, medical interventions, and, finally, knowledge-building through clinical research. With the gradual and ubiquitous infiltration of artificial intelligence into cardiology, it has become clear that, when used appropriately, it will influence and potentially improve-through automation, standardization and data integration-all components of the clinical workflow. This review aims to present a comprehensive view of full integration of artificial intelligence into the standard clinical patient management-with a focus on cardiac imaging, but applicable to all information handling-and to discuss current barriers that remain to be overcome before its widespread implementation and integration.

4D Flow when and how?

4D Flow is an emerging MR technique enabling three-dimensional and cardiac phase-resolved flowmetry with ECG-gated phase-contrast MRI that increased the speed of data acquisitions, accuracy and robustness. The method is promoting researches in areas that have not been fully addressed before in the cardiovascular system, such as flowmetry of the bloodstream across the valves, within the heart chambers, complexed flow dynamics such as vortex, helical or retrograde. Wall shear stress and other potential biomarkers derived from 4D Flow are known to be related to vascular wall diseases such as atherosclerosis. In this review, fundamental concepts of 4D Flow technique and post-processing, benefits and limitations as well as its clinical applications are discussed, and the importance of quality control and validation of the method is emphasized. New ideas inspired by 4D Flow can help clinicians and MR scientists further understand the role of flow dynamics in health sciences, diseases and various aspects of cardiovascular physiology.

Fully automated 3D aortic segmentation of 4D flow MRI for hemodynamic analysis using deep learning

PURPOSE

To generate fully automated and fast 4D-flow MRI-based 3D segmentations of the aorta using deep learning for reproducible quantification of aortic flow, peak velocity, and dimensions.

METHODS

A total of 1018 subjects with aortic 4D-flow MRI (528 with bicuspid aortic valve, 376 with tricuspid aortic valve and aortic dilation, 114 healthy controls) comprised the data set. A convolutional neural network was trained to generate 3D aortic segmentations from 4D-flow data. Manual segmentations served as the ground truth (N = 499 training, N = 101 validation, N = 418 testing). Dice scores, Hausdorff distance, and average symmetrical surface distance were calculated to assess performance. Aortic flow, peak velocity, and lumen dimensions were quantified at the ascending, arch, and descending aorta and compared using Bland-Altman analysis. Interobserver variability of manual analysis was assessed on a subset of 40.

RESULTS

Convolutional neural network segmentation required 0.438 ± 0.355 seconds versus 630 ± 254 seconds for manual analysis and demonstrated excellent performance with a median Dice score of 0.951 (0.930-0.966), Hausdorff distance of 2.80 (2.13-4.35), and average symmetrical surface distance of 0.176 (0.119-0.290). Excellent agreement was found for flow, peak velocity, and dimensions with low bias and limits of agreement less than 10% difference versus manual analysis. For aortic volume, limits of agreement were moderate within 16.3%. Interobserver variability (median Dice score: 0.950; Hausdorff distance: 2.45; and average symmetrical surface distance: 0.145) and convolutional neural network-based analysis (median Dice score: 0.953-0.959; Hausdorff distance: 2.24-2.91; and average symmetrical surface distance: 0.145-1.98 to observers) demonstrated similar reproducibility.

CONCLUSIONS

Deep learning enabled fast and automated 3D aortic segmentation from 4D-flow MRI, demonstrating its potential for efficient clinical workflows. Future studies should investigate its utility for other vasculature and multivendor applications.

Artificial Intelligence Will Transform Cardiac Imaging-Opportunities and Challenges

Artificial intelligence (AI) using machine learning techniques will change healthcare as we know it. While healthcare AI applications are currently trailing behind popular AI applications, such as personalized web-based advertising, the pace of research and deployment is picking up and about to become disruptive. Overcoming challenges such as patient and public support, transparency over the legal basis for healthcare data use, privacy preservation, technical challenges related to accessing large-scale data from healthcare systems not designed for Big Data analysis, and deployment of AI in routine clinical practice will be crucial. Cardiac imaging and imaging of other body parts is likely to be at the frontier for the development of applications as pattern recognition and machine learning are a significant strength of AI with practical links to image processing. Many opportunities in cardiac imaging exist where AI will impact patients, medical staff, hospitals, commissioners and thus, the entire healthcare system. This perspective article will outline our vision for AI in cardiac imaging with examples of potential applications, challenges and some lessons learnt in recent years.

Toward a grey box approach for cardiovascular physiome

The physiomic approach is now widely used in the diagnosis of cardiovascular diseases. There are two possible methods for cardiovascular physiome: the traditional mathematical model and the machine learning (ML) algorithm. ML is used in almost every area of society for various tasks formerly performed by humans. Specifically, various ML techniques in cardiovascular medicine are being developed and improved at unprecedented speed. The benefits of using ML for various tasks is that the inner working mechanism of the system does not need to be known, which can prove convenient in situations where determining the inner workings of the system can be difficult. The computation speed is also often higher than that of the traditional mathematical models. The limitations with ML are that it inherently leads to an approximation, and special care must be taken in cases where a high accuracy is required. Traditional mathematical models are, however, constructed based on underlying laws either proven or assumed. The results from the mathematical models are accurate as long as the model is. Combining the advantages of both the mathematical models and ML would increase both the accuracy and efficiency of the simulation for many problems. In this review, examples of cardiovascular physiome where approaches of mathematical modeling and ML can be combined are introduced.