Automated Echocardiographic Quantification of Left Ventricular Ejection Fraction Without Volume Measurements Using a Machine Learning Algorithm Mimicking a Human Expert

Broadening Perspectives of Artificial Intelligence in Echocardiography

Echocardiography frequently serves as the first-line treatment of diagnostic imaging for several pathological entities in cardiology. Artificial intelligence (AI) has been growing substantially in information technology and various commercial industries. Machine learning (ML), a branch of AI, has been shown to expand the capabilities and potential of echocardiography. ML algorithms expand the field of echocardiography by automated assessment of the ejection fraction and left ventricular function, integrating novel approaches such as speckle tracking or tissue Doppler echocardiography or vector flow mapping, improved phenotyping, distinguishing between cardiac conditions, and incorporating information from mobile health and genomics. In this review article, we assess the impact of AI and ML in echocardiography.

How Will Artificial Intelligence Shape the Future of Decision-Making in Congenital Heart Disease?

Improvements in medical technology have significantly changed the management of congenital heart disease (CHD), offering novel tools to predict outcomes and personalize follow-up care. By using sophisticated imaging modalities, computational models and machine learning algorithms, clinicians can experiment with unprecedented insights into the complex anatomy and physiology of CHD. These tools enable early identification of high-risk patients, thus allowing timely, tailored interventions and improved outcomes. Additionally, the integration of genetic testing offers valuable prognostic information, helping in risk stratification and treatment optimisation. The birth of telemedicine platforms and remote monitoring devices facilitates customised follow-up care, enhancing patient engagement and reducing healthcare disparities. Taking into consideration challenges and ethical issues, clinicians can make the most of the full potential of artificial intelligence (AI) to further refine prognostic models, personalize care and improve long-term outcomes for patients with CHD. This narrative review aims to provide a comprehensive illustration of how AI has been implemented as a new technological method for enhancing the management of CHD.

Leveraging the Capabilities of AI: Novice Neurology-Trained Operators Performing Cardiac POCUS in Patients with Acute Brain Injury

BACKGROUND

Cardiac point-of-care ultrasound (cPOCUS) can aid in the diagnosis and treatment of cardiac disorders. Such disorders can arise as complications of acute brain injury, but most neurologic intensive care unit (NICU) providers do not receive formal training in cPOCUS. Caption artificial intelligence (AI) uses a novel deep learning (DL) algorithm to guide novice cPOCUS users in obtaining diagnostic-quality cardiac images. The primary objective of this study was to determine how often NICU providers with minimal cPOCUS experience capture quality images using DL-guided cPOCUS as well as the association between DL-guided cPOCUS and change in management and time to formal echocardiograms in the NICU.

METHODS

From September 2020 to November 2021, neurology-trained physician assistants, residents, and fellows used DL software to perform clinically indicated cPOCUS scans in an academic tertiary NICU. Certified echocardiographers evaluated each scan independently to assess the quality of images and global interpretability of left ventricular function, right ventricular function, inferior vena cava size, and presence of pericardial effusion. Descriptive statistics with exact confidence intervals were used to calculate proportions of obtained images that were of adequate quality and that changed management. Time to first adequate cardiac images (either cPOCUS or formal echocardiography) was compared using a similar population from 2018.

RESULTS

In 153 patients, 184 scans were performed for a total of 943 image views. Three certified echocardiographers deemed 63.4% of scans as interpretable for a qualitative assessment of left ventricular size and function, 52.6% of scans as interpretable for right ventricular size and function, 34.8% of scans as interpretable for inferior vena cava size and variability, and 47.2% of scans as interpretable for the presence of pericardial effusion. Thirty-seven percent of screening scans changed management, most commonly adjusting fluid goals (81.2%). Time to first adequate cardiac images decreased significantly from 3.1 to 1.7 days (p < 0.001).

CONCLUSIONS

With DL guidance, neurology providers with minimal to no cPOCUS training were often able to obtain diagnostic-quality cardiac images, which informed management changes and significantly decreased time to cardiac imaging.

Closing the Last Mile Gap in Access to Multimodality Imaging in Rural Settings: Design of the Imaging Core of the Risk Underlying Rural Areas Longitudinal Study

Achieving optimal cardiovascular health in rural populations can be challenging for several reasons including decreased access to care with limited availability of imaging modalities, specialist physicians, and other important health care team members. Therefore, innovative solutions are needed to optimize health care and address cardiovascular health disparities in rural areas. Mobile examination units can bring imaging technology to underserved or remote communities with limited access to health care services. Mobile examination units can be equipped with a wide array of assessment tools and multiple imaging modalities such as computed tomography scanning and echocardiography. The detailed structural assessment of cardiovascular and lung pathology, as well as the detection of extracardiac pathology afforded by computed tomography imaging combined with the functional and hemodynamic assessments acquired by echocardiography, yield deep phenotyping of heart and lung disease for populations historically underrepresented in epidemiological studies. Moreover, by bringing the mobile examination unit to local communities, innovative approaches are now possible including engagement with local professionals to perform these imaging assessments, thereby augmenting local expertise and experience. However, several challenges exist before mobile examination unit-based examinations can be effectively integrated into the rural health care setting including standardizing acquisition protocols, maintaining consistent image quality, and addressing ethical and privacy considerations. Herein, we discuss the potential importance of cardiac multimodality imaging to improve cardiovascular health in rural regions, outline the emerging experience in this field, highlight important current challenges, and offer solutions based on our experience in the RURAL (Risk Underlying Rural Areas Longitudinal) cohort study.

Automatic classification of heart failure based on Cine-CMR images

PURPOSE

Heart failure (HF) is a serious and complex syndrome with a high mortality rate. In clinical diagnosis, the correct classification of HF is helpful. In our previous work, we proposed a self-supervised learning framework of HF classification (SSLHF) on cine cardiac magnetic resonance images (Cine-CMR). However, this method lacks the integration of three dimensions of spatial information and temporal information. Thus, this study aims at proposing an automatic 4D HF classification algorithm.

METHODS

To construct a 4D classification model, we proposed an extensional framework called 4D-SSLHF. It mainly consists of self-supervised image restoration and HF classification. The image restoration proxy task utilizes three image transformation methods to enhance the exploration of spatial and temporal information in the Cine-CMR. In the classification task, we proposed a Siamese Conv-LSTM network by combining the Siamese network and bi-directional Conv-LSTM to integrate the features of the four dimensions simultaneously.

RESULTS

Experimental results on 184 patients from Shanghai Chest Hospital achieved an AUC of 0.8794 and an ACC of 0.8402 in the five-fold cross-validation. Compared with our previous work, the improvements in AUC and ACC were 2.89 % and 1.94 %, respectively.

CONCLUSIONS

In this study, we proposed a novel self-supervised learning framework named 4D-SSLHF for HF classification based on Cine-CMR. The proposed 4D-SSLHF can mine 3D spatial information and temporal information in Cine-CMR images well and accurately classify different categories of HF. The good classification results show our method's potential to assist physicians in choosing personalized treatment.

Using Artificial Intelligence for Rheumatic Heart Disease Detection by Echocardiography: Focus on Mitral Regurgitation

BACKGROUND

Identification of children with latent rheumatic heart disease (RHD) by echocardiography, before onset of symptoms, provides an opportunity to initiate secondary prophylaxis and prevent disease progression. There have been limited artificial intelligence studies published assessing the potential of machine learning to detect and analyze mitral regurgitation or to detect the presence of RHD on standard portable echocardiograms.

METHODS AND RESULTS

We used 511 echocardiograms in children, focusing on color Doppler images of the mitral valve. Echocardiograms were independently reviewed by an expert adjudication panel. Among 511 cases, 229 were normal, and 282 had RHD. Our automated method included harmonization of echocardiograms to localize the left atrium during systole using convolutional neural networks and RHD detection using mitral regurgitation jet analysis and deep learning models with an attention mechanism. We identified the correct view with an average accuracy of 0.99 and the correct systolic frame with an average accuracy of 0.94 (apical) and 0.93 (parasternal long axis). It localized the left atrium with an average Dice coefficient of 0.88 (apical) and 0.9 (parasternal long axis). Maximum mitral regurgitation jet measurements were similar to expert manual measurements (P value=0.83) and a 9-feature mitral regurgitation analysis showed an area under the receiver operating characteristics curve of 0.93, precision of 0.83, recall of 0.92, and F1 score of 0.87. Our deep learning model showed an area under the receiver operating characteristics curve of 0.84, precision of 0.78, recall of 0.98, and F1 score of 0.87.

CONCLUSIONS

Artificial intelligence has the potential to detect RHD as accurately as expert cardiologists and to improve with more data. These innovative approaches hold promise to scale echocardiography screening for RHD.

A Novel Automatic Algorithm to Support Lung Ultrasound Non-Expert Physicians in Interstitial Pneumonia Evaluation: A Single-Center Study

INTRODUCTION

Lung ultrasound (LUS) is widely used in clinical practice for identifying interstitial lung diseases (ILDs) and assessing their progression. Although high-resolution computed tomography (HRCT) remains the gold standard for evaluating the severity of ILDs, LUS can be performed as a screening method or as a follow-up tool post-HRCT. Minimum training is needed to better identify typical lesions, and the integration of innovative artificial intelligence (AI) automatic algorithms may enhance diagnostic efficiency.

AIM

This study aims to assess the effectiveness of a novel AI algorithm in automatic ILD recognition and scoring in comparison to an expert LUS sonographer. The "SensUS Lung" device, equipped with an automatic algorithm, was employed for the automatic recognition of the typical ILD patterns and to calculate an index grading of the interstitial involvement.

METHODS

We selected 33 Caucasian patients in follow-up for ILDs exhibiting typical HRCT patterns (honeycombing, ground glass, fibrosis). An expert physician evaluated all patients with LUS on twelve segments (six per side). Next, blinded to the previous evaluation, an untrained operator, a non-expert in LUS, performed the exam with the SensUS device equipped with the automatic algorithm ("SensUS Lung") using the same protocol. Pulmonary functional tests (PFT) and DLCO were conducted for all patients, categorizing them as having reduced or preserved DLCO. The SensUS device indicated different grades of interstitial involvement named Lung Staging that were scored from 0 (absent) to 4 (peak), which was compared to the Lung Ultrasound Score (LUS score) by dividing it by the number of segments evaluated. Statistical analyses were done with Wilcoxon tests for paired values or Mann-Whitney for unpaired samples, and correlations were performed using Spearman analysis; p < 0.05 was considered significant.

RESULTS

Lung Staging was non-inferior to LUS score in identifying the risk of ILDs (median SensUS 1 [0-2] vs. LUS 0.67 [0.25-1.54]; p = 0.84). Furthermore, the grade of interstitial pulmonary involvement detected with the SensUS device is directly related to the LUS score (r = 0.607, p = 0.002). Lung Staging values were inversely correlated with forced expiratory volume at first second (FEV1%, r = -0.40, p = 0.027), forced vital capacity (FVC%, r = -0.39, p = 0.03) and forced expiratory flow (FEF) at 25th percentile (FEF25%, r = -0.39, p = 0.02) while results directly correlated with FEF25-75% (r = 0.45, p = 0.04) and FEF75% (r = 0.43, p = 0.01). Finally, in patients with reduced DLCO, the Lung Staging was significantly higher, overlapping the LUS (reduced median 1 [1-2] vs. preserved 0 [0-1], p = 0.001), and overlapping the LUS (reduced median 18 [4-20] vs. preserved 5.5 [2-9], p = 0.035).

CONCLUSIONS

Our data suggest that the considered AI automatic algorithm may assist non-expert physicians in LUS, resulting in non-inferior-to-expert LUS despite a tendency to overestimate ILD lesions. Therefore, the AI algorithm has the potential to support physicians, particularly non-expert LUS sonographers, in daily clinical practice to monitor patients with ILDs. The adopted device is user-friendly, offering a fully automatic real-time analysis. However, it needs proper training in basic skills.

Detecting anteriorly displaced temporomandibular joint discs using super-resolution magnetic resonance imaging: a multi-center study

Background: Magnetic resonance imaging (MRI) plays a crucial role in diagnosing anterior disc displacement (ADD) of the temporomandibular joint (TMJ). The primary objective of this study is to enhance diagnostic accuracy in two common disease subtypes of ADD of the TMJ on MRI, namely, ADD with reduction (ADDWR) and ADD without reduction (ADDWoR). To achieve this, we propose the development of transfer learning (TL) based on Convolutional Neural Network (CNN) models, which will aid in accurately identifying and distinguishing these subtypes. Methods: A total of 668 TMJ MRI scans were obtained from two medical centers. High-resolution (HR) MRI images were subjected to enhancement through a deep TL, generating super-resolution (SR) images. Naive Bayes (NB) and Logistic Regression (LR) models were applied, and performance was evaluated using receiver operating characteristic (ROC) curves. The model's outcomes in the test cohort were compared with diagnoses made by two clinicians. Results: The NB model utilizing SR reconstruction with 400 × 400 pixel images demonstrated superior performance in the validation cohort, exhibiting an area under the ROC curve (AUC) of 0.834 (95% CI: 0.763-0.904) and an accuracy rate of 0.768. Both LR and NB models, with 200 × 200 and 400 × 400 pixel images after SR reconstruction, outperformed the clinicians' diagnoses. Conclusion: The ResNet152 model's commendable AUC in detecting ADD highlights its potential application for pre-treatment assessment and improved diagnostic accuracy in clinical settings.

Improved assessment of left ventricular ejection fraction using artificial intelligence in echocardiography: A comparative analysis with cardiac magnetic resonance imaging

BACKGROUND

Left ventricular ejection fraction (LVEF) measurement in echocardiography (Echo) using the recommended modified biplane Simpson (MBS) method is operator-dependent and exhibits variability. We aimed to assess the accuracy of a novel fully automated (Auto) artificial intelligence (AI) in view selection and biplane LVEF calculation compared to MBS-Echo, with cardiac magnetic resonance imaging (CMR) as reference.

METHODS

Each of the 301 consecutive patients underwent CMR and Echo on the same day. LVEF was measured independently by Auto-Echo, MBS-Echo and CMR. Interobserver (n = 40) and test-retest (n = 14) analysis followed.

RESULTS

A total of 229 patients (76%) underwent complete analysis. Auto-Echo and MBS-Echo showed high correlations with CMR (R = 0.89 and 0.89) and with each other (R = 0.93). Auto underestimated LVEF (bias: 2.2%; limits of agreement [LOA]: -13.5 to 17.9%), while MBS overestimated it (bias: -2.2%; LOA: 18.6 to 14.1%). Despite comparable areas under the curves of Auto- and MBS-Echo (0.93 and 0.92), 46% (n = 70) of MBS-Echo misclassified LVEF by ≥5% units in patients with a reduced CMR-LVEF <51%. Although LVEF bias variability across different LV function ranges was significant (p < 0.001), Auto-Echo was closer to CMR for patients with reduced LVEF, wall motion abnormalities, and poor image quality than MBS-Echo. The interobserver correlation coefficient of Auto-Echo was excellent compared to MBS-Echo (1.00 vs. <0.91) for different readers. True test-retest variability was higher for MBS-Echo than for Auto-Echo (7.9% vs. 2.5%).

CONCLUSION

The tested AI has the potential to improve the clinical utility of Echo by reducing user-related variability, providing more accurate and reliable results than MBS.

Automated 2-D and 3-D Left Atrial Volume Measurements Using Deep Learning

OBJECTIVE

Echocardiography, a critical tool for assessing left atrial (LA) volume, often relies on manual or semi-automated measurements. This study introduces a fully automated, real-time method for measuring LA volume in both 2-D and 3-D imaging, in the aim of offering accuracy comparable to that of expert assessments while saving time and reducing operator variability.

METHODS

We developed an automated pipeline comprising a network to identify the end-systole (ES) time point and robust 2-D and 3-D U-Nets for segmentation. We employed data sets of 789 2-D images and 286 3-D recordings and explored various training regimes, including recurrent networks and pseudo-labeling, to estimate volume curves.

RESULTS

Our baseline results revealed an average volume difference of 2.9 mL for 2-D and 7.8 mL for 3-D, respectively, compared with manual methods. The application of pseudo-labeling to all frames in the cine loop generally led to more robust volume curves and notably improved ES measurement in cases with limited data.

CONCLUSION

Our results highlight the potential of automated LA volume estimation in clinical practice. The proposed prototype application, capable of processing real-time data from a clinical ultrasound scanner, provides valuable temporal volume curve information in the echo lab.

The Role of Artificial Intelligence in Echocardiography: A Clinical Update

PURPOSE OF REVIEW

In echocardiography, there has been robust development of artificial intelligence (AI) tools for image recognition, automated measurements, image segmentation, and patient prognostication that has created a monumental shift in the study of AI and machine learning models. However, integrating these measurements into complex disease recognition and therapeutic interventions remains challenging. While the tools have been developed, there is a lack of evidence regarding implementing heterogeneous systems for guiding clinical decision-making and therapeutic action.

RECENT FINDINGS

Newer AI modalities have shown concrete positive data in terms of user-guided image acquisition and processing, precise determination of both basic and advanced quantitative echocardiographic features, and the potential to construct predictive models, all with the possibility of seamless integration into clinical decision support systems. AI in echocardiography is a powerful and ever-growing tool with the potential for revolutionary effects on the practice of cardiology. In this review article, we explore the growth of AI and its applications in echocardiography, along with clinical implications and the associated regulatory, legal, and ethical considerations.

Real-Time Artificial Intelligence-Based Guidance of Echocardiographic Imaging by Novices: Image Quality and Suitability for Diagnostic Interpretation and Quantitative Analysis

BACKGROUND

We aimed to assess in a prospective multicenter study the quality of echocardiographic exams performed by inexperienced users guided by a new artificial intelligence software and evaluate their suitability for diagnostic interpretation of basic cardiac pathology and quantitative analysis of cardiac chamber and function.

METHODS

The software (UltraSight, Ltd) was embedded into a handheld imaging device (Lumify; Philips). Six nurses and 3 medical residents, who underwent minimal training, scanned 240 patients (61±16 years; 63% with cardiac pathology) in 10 standard views. All patients were also scanned by expert sonographers using the same device without artificial intelligence guidance. Studies were reviewed by 5 certified echocardiographers blinded to the imager's identity, who evaluated the ability to assess left and right ventricular size and function, pericardial effusion, valve morphology, and left atrial and inferior vena cava sizes. Finally, apical 4-chamber images of adequate quality, acquired by novices and sonographers in 100 patients, were analyzed to measure left ventricular volumes, ejection fraction, and global longitudinal strain by an expert reader using conventional methodology. Measurements were compared between novices' and experts' images.

RESULTS

Of the 240 studies acquired by novices, 99.2%, 99.6%, 92.9%, and 100% had sufficient quality to assess left ventricular size and function, right ventricular size, and pericardial effusion, respectively. Valve morphology, right ventricular function, and left atrial and inferior vena cava size were visualized in 67% to 98% exams. Images obtained by novices and sonographers yielded concordant diagnostic interpretation in 83% to 96% studies. Quantitative analysis was feasible in 83% images acquired by novices and resulted in high correlations (r≥0.74) and small biases, compared with those obtained by sonographers.

CONCLUSIONS

After minimal training with the real-time guidance software, novice users can acquire images of diagnostic quality approaching that of expert sonographers in most patients. This technology may increase adoption and improve accuracy of point-of-care cardiac ultrasound.

Deep Learning for Cardiovascular Imaging: A Review

Importance

Artificial intelligence (AI), driven by advances in deep learning (DL), has the potential to reshape the field of cardiovascular imaging (CVI). While DL for CVI is still in its infancy, research is accelerating to aid in the acquisition, processing, and/or interpretation of CVI across various modalities, with several commercial products already in clinical use. It is imperative that cardiovascular imagers are familiar with DL systems, including a basic understanding of how they work, their relative strengths compared with other automated systems, and possible pitfalls in their implementation. The goal of this article is to review the methodology and application of DL to CVI in a simple, digestible fashion toward demystifying this emerging technology.

Observations

At its core, DL is simply the application of a series of tunable mathematical operations that translate input data into a desired output. Based on artificial neural networks that are inspired by the human nervous system, there are several types of DL architectures suited to different tasks; convolutional neural networks are particularly adept at extracting valuable information from CVI data. We survey some of the notable applications of DL to tasks across the spectrum of CVI modalities. We also discuss challenges in the development and implementation of DL systems, including avoiding overfitting, preventing systematic bias, improving explainability, and fostering a human-machine partnership. Finally, we conclude with a vision of the future of DL for CVI.

Conclusions and Relevance

Deep learning has the potential to meaningfully affect the field of CVI. Rather than a threat, DL could be seen as a partner to cardiovascular imagers in reducing technical burden and improving efficiency and quality of care. High-quality prospective evidence is still needed to demonstrate how the benefits of DL CVI systems may outweigh the risks.

Using computed tomography fusion imaging as learning data for sonographer training in identification of left ventricular endocardial boundaries

BACKGROUND

We hypothesized that if computed tomography (CT) images were used as learning data, we could overcome volume underestimation by echocardiography, improving the accuracy of left ventricular (LV) volume measurements.

METHODS

We utilized a fusion imaging modality consisting of echocardiography with superimposed CT images for 37 consecutive patients to identify the endocardial boundary. We compared LV volumes obtained with and without CT learning trace-lines (TLs). Furthermore, 3D echocardiography was used to compare LV volumes obtained with and without CT learning for endocardial identification. The mean difference between the echocardiography and CT-derived LV volumes and the coefficient of variation were compared pre- and post-learning. Bland-Altman analysis was used to assess the differences in LV volume (mL) obtained from the 2D pre-learning TL and 3D post-learning TL.

RESULTS

The post-learning TL was located closer to the epicardium than the pre-learning TL. This trend was particularly pronounced in the lateral and the anterior wall. The post-learning TL was along the inner side of the high echoic layer in the basal-lateral wall in the four-chamber view. CT fusion imaging determined that the difference in LV volume between 2D echocardiography and CT was small (-25.6 ± 14.4 mL before learning, -6.9 ± 11.5 mL after learning) and that CT learning improved the coefficient of variation (10.9 % before learning, 7.8 % after learning). Significant improvements were observed during 3D echocardiography; the difference in LV volume between 3D echocardiography and CT was slight (-20.5 ± 15.1 mL before learning, 3.8 ± 15.7 mL after learning), and the coefficient of variation improved (11.5 % before learning, 9.3 % after learning).

CONCLUSIONS

Differences between the LV volumes obtained using CT and echocardiography either disappeared or were reduced after CT fusion imaging. Fusion imaging is useful in training regimens for accurate LV volume quantification using echocardiography and may contribute to quality control.

Embracing AI: The Imperative Tool for Echo Labs to Stay Ahead of the Curve

Advancements in artificial intelligence (AI) have rapidly transformed various sectors, and the field of echocardiography is no exception. AI-driven technologies hold immense potential to revolutionize echo labs' diagnostic capabilities and improve patient care. This paper explores the importance for echo labs to embrace AI and stay ahead of the curve in harnessing its power. Our manuscript provides an overview of the growing impact of AI on medical imaging, specifically echocardiography. It highlights how AI-driven algorithms can enhance image quality, automate measurements, and accurately diagnose cardiovascular diseases. Additionally, we emphasize the importance of training echo lab professionals in AI implementation to optimize its integration into routine clinical practice. By embracing AI, echo labs can overcome challenges such as workload burden and diagnostic accuracy variability, improving efficiency and patient outcomes. This paper highlights the need for collaboration between echocardiography laboratory experts, AI researchers, and industry stakeholders to drive innovation and establish standardized protocols for implementing AI in echocardiography. In conclusion, this article emphasizes the importance of AI adoption in echocardiography labs, urging practitioners to proactively integrate AI technologies into their workflow and take advantage of their present opportunities. Embracing AI is not just a choice but an imperative for echo labs to maintain their leadership and excel in delivering state-of-the-art cardiac care in the era of advanced medical technologies.

Artificial intelligence and heart failure: A state-of-the-art review

Heart failure (HF) is a heterogeneous syndrome affecting more than 60 million individuals globally. Despite recent advancements in understanding of the pathophysiology of HF, many issues remain including residual risk despite therapy, understanding the pathophysiology and phenotypes of patients with HF and preserved ejection fraction, and the challenges related to integrating a large amount of disparate information available for risk stratification and management of these patients. Risk prediction algorithms based on artificial intelligence (AI) may have superior predictive ability compared to traditional methods in certain instances. AI algorithms can play a pivotal role in the evolution of HF care by facilitating clinical decision making to overcome various challenges such as allocation of treatment to patients who are at highest risk or are more likely to benefit from therapies, prediction of adverse outcomes, and early identification of patients with subclinical disease or worsening HF. With the ability to integrate and synthesize large amounts of data with multidimensional interactions, AI algorithms can supply information with which physicians can improve their ability to make timely and better decisions. In this review, we provide an overview of the AI algorithms that have been developed for establishing early diagnosis of HF, phenotyping HF with preserved ejection fraction, and stratifying HF disease severity. This review also discusses the challenges in clinical deployment of AI algorithms in HF, and the potential path forward for developing future novel learning-based algorithms to improve HF care.

Evaluation of Wearable Acoustic Sensors and Machine Learning Algorithms for Automated Measurement of Left Ventricular Ejection Fraction

Left ventricular ejection fraction (EF) is a predictor of mortality and guides clinical decisions. Although transthoracic echocardiography (TTE) is commonly used for measuring EF, it has limitations, such as subjectivity and requires expert personnel. Advancements in biosensor technology and artificial intelligence are allowing systems capable of determining left ventricular function and providing automated measurement of EF. In this study, we tested new wearable automated real-time biosensors (Cardiac Performance System [CPS]) that compute EF using waveform machine learning on cardiac acoustic signals. The primary aim was to compare the accuracy of CPS EF with TTE EF. Adult patients presenting to cardiology, presurgical, and diagnostic radiology clinical settings in an academic center were enrolled. TTE examination was performed by a sonographer, followed immediately by a 3-minute recording of acoustic signals from CPS biosensors placed on the chest by nonexpert personnel. TTE EF was calculated offline using the Simpson biplane method. A total of 81 patients (aged 19 to 88 years, 27 women, 20% to 80% EF) were included. Deming regression and Bland-Altman analysis were performed to assess the accuracy of CPS EF against TTE EF. Both Deming regression (slope 0.9981; intercept 0.03415%) and Bland-Altman analysis (bias -0.0247%; limits of agreement [-11.65, 11.60]%) demonstrated equivalency between CPS EF and TTE EF. The receiver operating characteristic for measuring sensitivity and specificity of CPS in identifying subjects with abnormal EF showed an area under the curve value of 0.974 for identifying EF <35% and 0.916 for detecting EF <50% CPS EF intraoperator and interoperator assessments demonstrated low variability. In conclusion, this technology measuring cardiac function from noninvasive biosensors and machine learning on acoustic signals provides an accurate EF measurement that is automated, real-time, and acquired rapidly by personnel with minimal training.

The Use of Artificial Intelligence Guidance for Rheumatic Heart Disease Screening by Novices

INTRODUCTION

A novel technology utilizing artificial intelligence (AI) to provide real-time image-acquisition guidance, enabling novices to obtain diagnostic echocardiographic images, holds promise to expand the reach of echo screening for rheumatic heart disease (RHD). We evaluated the ability of nonexperts to obtain diagnostic-quality images in patients with RHD using AI guidance with color Doppler.

METHODS

Novice providers without prior ultrasound experience underwent a 1-day training curriculum to complete a 7-view screening protocol using AI guidance in Kampala, Uganda. All trainees then scanned 8 to 10 volunteer patients using AI guidance, half RHD and half normal. The same patients were scanned by 2 expert sonographers without the use of AI guidance. Images were evaluated by expert blinded cardiologists to assess (1) diagnostic quality to determine presence/absence of RHD and (2) valvular function and (3) to assign an American College of Emergency Physicians score of 1 to 5 for each view.

RESULTS

Thirty-six novice participants scanned a total of 50 patients, resulting in a total of 462 echocardiogram studies, 362 obtained by nonexperts using AI guidance and 100 obtained by expert sonographers without AI guidance. Novice images enabled diagnostic interpretation in >90% of studies for presence/absence of RHD, abnormal MV morphology, and mitral regurgitation (vs 99% by experts, P ≤ .001). Images were less diagnostic for aortic valve disease (79% for aortic regurgitation, 50% for aortic stenosis, vs 99% and 91% by experts, P < .001). The American College of Emergency Physicians scores of nonexpert images were highest in the parasternal long-axis images (mean, 3.45; 81% ≥ 3) compared with lower scores for apical 4-chamber (mean, 3.20; 74% ≥ 3) and apical 5-chamber images (mean, 2.43; 38% ≥ 3).

CONCLUSIONS

Artificial intelligence guidance with color Doppler is feasible to enable RHD screening by nonexperts, performing significantly better for assessment of the mitral than aortic valve. Further refinement is needed to optimize acquisition of color Doppler apical views.

The Emerging Role of Artificial Intelligence in Valvular Heart Disease

Valvular heart disease (VHD) is a morbid condition in which timely identification and evidence-based treatments can lead to improved outcomes. Artificial intelligence broadly refers to the ability for computers to perform tasks and problem solve like the human mind. Studies applying AI to VHD have used a variety of structured (eg, sociodemographic, clinical) and unstructured (eg, electrocardiogram, phonocardiogram, and echocardiograms) and machine learning modeling approaches. Additional researches in diverse populations, including prospective clinical trials, are needed to evaluate the effectiveness and value of AI-enabled medical technologies in clinical care for patients with VHD.

Current role and future perspectives of artificial intelligence in echocardiography

Echocardiography is an essential tool in diagnostic cardiology and is fundamental to clinical care. Artificial intelligence (AI) can help health care providers serving as a valuable diagnostic tool for physicians in the field of echocardiography specially on the automation of measurements and interpretation of results. In addition, it can help expand the capabilities of research and discover alternative pathways in medical management specially on prognostication. In this review article, we describe the current role and future perspectives of AI in echocardiography.

Ejection Fraction Estimation from Echocardiograms Using Optimal Left Ventricle Feature Extraction Based on Clinical Methods

Echocardiography is one of the imaging systems most often utilized for assessing heart anatomy and function. Left ventricle ejection fraction (LVEF) is an important clinical variable assessed from echocardiography via the measurement of left ventricle (LV) parameters. Significant inter-observer and intra-observer variability is seen when LVEF is quantified by cardiologists using huge echocardiography data. Machine learning algorithms have the capability to analyze such extensive datasets and identify intricate patterns of structure and function of the heart that highly skilled observers might overlook, hence paving the way for computer-assisted diagnostics in this field. In this study, LV segmentation is performed on echocardiogram data followed by feature extraction from the left ventricle based on clinical methods. The extracted features are then subjected to analysis using both neural networks and traditional machine learning algorithms to estimate the LVEF. The results indicate that employing machine learning techniques on the extracted features from the left ventricle leads to higher accuracy than the utilization of Simpson's method for estimating the LVEF. The evaluations are performed on a publicly available echocardiogram dataset, EchoNet-Dynamic. The best results are obtained when DeepLab, a convolutional neural network architecture, is used for LV segmentation along with Long Short-Term Memory Networks (LSTM) for the regression of LVEF, obtaining a dice similarity coefficient of 0.92 and a mean absolute error of 5.736%.

Single-Site Experience with an Automated Artificial Intelligence Application for Left Ventricular Ejection Fraction Measurement in Echocardiography

Left ventricular ejection fraction (LVEF) is a key parameter in evaluating left ventricular (LV) function using echocardiography (Echo), but its manual measurement by the modified biplane Simpson (MBS) method is time consuming and operator dependent. We investigated the feasibility of a server-based, commercially available and ready-to use-artificial intelligence (AI) application based on convolutional neural network methods that integrate fully automatic view selection and measurement of LVEF from an entire Echo exam into a single workflow. We prospectively enrolled 1083 consecutive patients who had been referred to Echo for diagnostic or therapeutic purposes. LVEF was measured independently using MBS and AI. Test–retest variability was assessed in 40 patients. The reliability, repeatability, and time efficiency of LVEF measurements were compared between the two methods. Overall, 889 Echos were analyzed by cardiologists with the MBS method and by the AI. Over the study period of 10 weeks, the feasibility of both automatic view classification and seamlessly measured LVEF rose to 81% without user involvement. LVEF, LV end-diastolic and end-systolic volumes correlated strongly between MBS and AI (R = 0.87, 0.89 and 0.93, p < 0.001 for all) with a mean bias of +4.5% EF, −12 mL and −11 mL, respectively, due to impaired image quality and the extent of LV function. Repeatability and reliability of LVEF measurement (n = 40, test–retest) by AI was excellent compared to MBS (coefficient of variation: 3.2% vs. 5.9%), although the median analysis time of the AI was longer than that of the operator-dependent MBS method (258 s vs. 171 s). This AI has succeeded in identifying apical LV views and measuring EF in one workflow with comparable results to the MBS method and shows excellent reproducibility. It offers realistic perspectives for fully automated AI-based measurement of LVEF in routine clinical settings.

A cardiologist's guide to machine learning in cardiovascular disease prognosis prediction

A modern-day physician is faced with a vast abundance of clinical and scientific data, by far surpassing the capabilities of the human mind. Until the last decade, advances in data availability have not been accompanied by analytical approaches. The advent of machine learning (ML) algorithms might improve the interpretation of complex data and should help to translate the near endless amount of data into clinical decision-making. ML has become part of our everyday practice and might even further change modern-day medicine. It is important to acknowledge the role of ML in prognosis prediction of cardiovascular disease. The present review aims on preparing the modern physician and researcher for the challenges that ML might bring, explaining basic concepts but also caveats that might arise when using these methods. Further, a brief overview of current established classical and emerging concepts of ML disease prediction in the fields of omics, imaging and basic science is presented.

Recognized and Unrecognized Value of Echocardiography in Guideline and Consensus Documents Regarding Patients With Chest Pain

Guideline and consensus documents have recently been published on the important topic of the noninvasive evaluation of patients presenting with chest pain (CP) or patients with known acute or chronic coronary syndromes. Authors for these documents have included members representing multispecialty imaging societies, yet the process of generating consensus and the need to produce concise written documents have led to a situation where the particular advantages of echocardiography are overlooked. Broad guidelines such as these can be helpful when it comes to "when to do" noninvasive cardiac testing, but they do not pretend to offer nuances on "how to do" noninvasive cardiac testing. This report details the particular value of echocardiography and potential explanations for its understated role in recent guidelines. This report is categorized into the following sections: (1) impact of the level of evidence on guideline creation; (2) versatility of echocardiography in the assessment of CP and the inimitable role for echo Doppler echocardiography in the assessment of dyspnea; (3) value of point-of-care ultrasound in assessing CP and dyspnea; and (4) the future role of echocardiography in ischemic heart disease.

Artificial Intelligence and Cardiovascular Risk Prediction: All That Glitters is not Gold

Artificial intelligence (AI) is a broad term referring to any automated systems that need 'intelligence' to carry out specific tasks. During the last decade, AI-based techniques have been gaining popularity in a vast range of biomedical fields, including the cardiovascular setting. Indeed, the dissemination of cardiovascular risk factors and the better prognosis of patients experiencing cardiovascular events resulted in an increase in the prevalence of cardiovascular disease (CVD), eliciting the need for precise identification of patients at increased risk for development and progression of CVD. AI-based predictive models may overcome some of the limitations that hinder the performance of classic regression models. Nonetheless, the successful application of AI in this field requires knowledge of the potential pitfalls of the AI techniques, to guarantee their safe and effective use in daily clinical practice. The aim of the present review is to summarise the pros and cons of different AI methods and their potential application in the cardiovascular field, with a focus on the development of predictive models and risk assessment tools.

Machine learning for the real-time assessment of left ventricular ejection fraction in critically ill patients: a bedside evaluation by novices and experts in echocardiography

BACKGROUND

Machine learning algorithms have recently been developed to enable the automatic and real-time echocardiographic assessment of left ventricular ejection fraction (LVEF) and have not been evaluated in critically ill patients.

METHODS

Real-time LVEF was prospectively measured in 95 ICU patients with a machine learning algorithm installed on a cart-based ultrasound system. Real-time measurements taken by novices (LVEF_Nov) and by experts (LVEF_Exp) were compared with LVEF reference measurements (LVEF_Ref) taken manually by echo experts.

RESULTS

LVEF_Ref ranged from 26 to 80% (mean 54 ± 12%), and the reproducibility of measurements was 9 ± 6%. Thirty patients (32%) had a LVEF_Ref < 50% (left ventricular systolic dysfunction). Real-time LVEF_Exp and LVEF_Nov measurements ranged from 31 to 68% (mean 54 ± 10%) and from 28 to 70% (mean 54 ± 9%), respectively. The reproducibility of measurements was comparable for LVEF_Exp (5 ± 4%) and for LVEF_Nov (6 ± 5%) and significantly better than for reference measurements (p < 0.001). We observed a strong relationship between LVEF_Ref and both real-time LVEF_Exp (r = 0.86, p < 0.001) and LVEF_Nov (r = 0.81, p < 0.001). The average difference (bias) between real time and reference measurements was 0 ± 6% for LVEF_Exp and 0 ± 7% for LVEF_Nov. The sensitivity to detect systolic dysfunction was 70% for real-time LVEF_Exp and 73% for LVEF_Nov. The specificity to detect systolic dysfunction was 98% both for LVEF_Exp and LVEF_Nov.

CONCLUSION

Machine learning-enabled real-time measurements of LVEF were strongly correlated with manual measurements obtained by experts. The accuracy of real-time LVEF measurements was excellent, and the precision was fair. The reproducibility of LVEF measurements was better with the machine learning system. The specificity to detect left ventricular dysfunction was excellent both for experts and for novices, whereas the sensitivity could be improved.

TRIAL REGISTRATION

NCT05336448. Retrospectively registered on April 19, 2022.

Development of deep learning segmentation models for coronary X-ray angiography: Quality assessment by a new global segmentation score and comparison with human performance

INTRODUCTION AND OBJECTIVES

Although automatic artificial intelligence (AI) coronary angiography (CAG) segmentation is arguably the first step toward future clinical application, it is underexplored. We aimed to (1) develop AI models for CAG segmentation and (2) assess the results using similarity scores and a set of criteria defined by expert physicians.

METHODS

Patients undergoing CAG were randomly selected in a retrospective study at a single center. Per incidence, an ideal frame was segmented, forming a baseline human dataset (BH), used for training a baseline AI model (BAI). Enhanced human segmentation (EH) was created by combining the best of both. An enhanced AI model (EAI) was trained using the EH. Results were assessed by experts using 11 weighted criteria, combined into a Global Segmentation Score (GSS: 0-100 points). Generalized Dice Score (GDS) and Dice Similarity Coefficient (DSC) were also used for AI models assessment.

RESULTS

1664 processed images were generated. GSS for BH, EH, BAI and EAI were 96.9+/-5.7; 98.9+/-3.1; 86.1+/-10.1 and 90+/-7.6, respectively (95% confidence interval, p<0.001 for both paired and global differences). The GDS for the BAI and EAI was 0.9234±0.0361 and 0.9348±0.0284, respectively. The DSC for the coronary tree was 0.8904±0.0464 and 0.9134±0.0410 for the BAI and EAI, respectively. The EAI outperformed the BAI in all coronary segmentation tasks, but performed less well in some catheter segmentation tasks.

CONCLUSIONS

We successfully developed AI models capable of CAG segmentation, with good performance as assessed by all scores.

A formal validation of a deep learning-based automated workflow for the interpretation of the echocardiogram

This study compares a deep learning interpretation of 23 echocardiographic parameters-including cardiac volumes, ejection fraction, and Doppler measurements-with three repeated measurements by core lab sonographers. The primary outcome metric, the individual equivalence coefficient (IEC), compares the disagreement between deep learning and human readers relative to the disagreement among human readers. The pre-determined non-inferiority criterion is 0.25 for the upper bound of the 95% confidence interval. Among 602 anonymised echocardiographic studies from 600 people (421 with heart failure, 179 controls, 69% women), the point estimates of IEC are all <0 and the upper bound of the 95% confidence intervals below 0.25, indicating that the disagreement between the deep learning and human measures is lower than the disagreement among three core lab readers. These results highlight the potential of deep learning algorithms to improve efficiency and reduce the costs of echocardiography.

Clinician's guide to trustworthy and responsible artificial intelligence in cardiovascular imaging

A growing number of artificial intelligence (AI)-based systems are being proposed and developed in cardiology, driven by the increasing need to deal with the vast amount of clinical and imaging data with the ultimate aim of advancing patient care, diagnosis and prognostication. However, there is a critical gap between the development and clinical deployment of AI tools. A key consideration for implementing AI tools into real-life clinical practice is their "trustworthiness" by end-users. Namely, we must ensure that AI systems can be trusted and adopted by all parties involved, including clinicians and patients. Here we provide a summary of the concepts involved in developing a "trustworthy AI system." We describe the main risks of AI applications and potential mitigation techniques for the wider application of these promising techniques in the context of cardiovascular imaging. Finally, we show why trustworthy AI concepts are important governing forces of AI development.

Artificial intelligence for automated evaluation of aortic measurements in 2D echocardiography: Feasibility, accuracy, and reproducibility

AIMS

This study sought to examine the feasibility, accuracy and reproducibility of a novel, fully automated 2D transthoracic echocardiography (2D TTE) parasternal long axis (PLAX) view aortic measurements quantification software compared to board-certified cardiologists in controlled clinical setting.

METHODS AND RESULTS

Aortic Annulus (AoA), Aortic Sinus (AoS), Sinotubular Junction (STJ) and Proximal Ascending Aorta (AAo) diameter measurements were performed retrospectively on each of 58 subjects in two different ways: twice using a fully automated software (Ligence Heart version 2) and twice manually by three cardiologists (ORG) and one expert cardiologist (EC). Out of 58 studies AoA was measured in 54 (93%), AoS in 55 (95%), STJ in 55 (95%) and AAo in 54 (93%) studies. Automated measurements had a stronger correlation with EC when compared to ORG with the largest correlation difference of .1 for STJ measurements and lowest difference of .01 for AoS measurements. Automated software was in higher agreement with ground truth intervals (ORG measurements mean +- SEM) in three out of four measurements.

CONCLUSION

Fully automated 2D TTE PLAX view aortic measurements using a novel AI-based quantification software are feasible and yield results that are in close agreement with what experienced readers measure manually while providing better reproducibility. This approach may prove to have important clinical implications in the automation of the aortic root and ascending aorta assessment to improve workflow efficiency.

Automated analysis of limited echocardiograms: Feasibility and relationship to outcomes in COVID-19

Background

As automated echocardiographic analysis is increasingly utilized, continued evaluation within hospital settings is important to further understand its potential value. The importance of cardiac involvement in patients hospitalized with COVID-19 provides an opportunity to evaluate the feasibility and clinical relevance of automated analysis applied to limited echocardiograms.

Methods

In this multisite US cohort, the feasibility of automated AI analysis was evaluated on 558 limited echocardiograms in patients hospitalized with COVID-19. Reliability of automated assessment of left ventricular (LV) volumes, ejection fraction (EF), and LV longitudinal strain (LS) was assessed against clinically obtained measures and echocardiographic findings. Automated measures were evaluated against patient outcomes using ROC analysis, survival modeling, and logistic regression for the outcomes of 30-day mortality and in-hospital sequelae.

Results

Feasibility of automated analysis for both LVEF and LS was 87.5% (488/558 patients). AI analysis was performed with biplane method in 300 (61.5%) and single plane apical 4- or 2-chamber analysis in 136 (27.9%) and 52 (10.7%) studies, respectively. Clinical LVEF was assessed using visual estimation in 192 (39.3%), biplane in 163 (33.4%), and single plane or linear methods in 104 (21.2%) of the 488 studies; 29 (5.9%) studies did not have clinically reported LVEF. LV LS was clinically reported in 80 (16.4%). Consistency between automated and clinical values demonstrated Pearson's R, root mean square error (RMSE) and intraclass correlation coefficient (ICC) of 0.61, 11.3% and 0.72, respectively, for LVEF; 0.73, 3.9% and 0.74, respectively for LS; 0.76, 24.4ml and 0.87, respectively, for end-diastolic volume; and 0.82, 12.8 ml, and 0.91, respectively, for end-systolic volume. Abnormal automated measures of LVEF and LS were associated with LV wall motion abnormalities, left atrial enlargement, and right ventricular dysfunction. Automated analysis was associated with outcomes, including survival.

Conclusion

Automated analysis was highly feasible on limited echocardiograms using abbreviated protocols, consistent with equivalent clinically obtained metrics, and associated with echocardiographic abnormalities and patient outcomes.

Human vs Artificial Intelligence-Based Echocardiography Analysis as Predictor of Outcomes: An analysis from the World Alliance Societies of Echocardiography COVID study

Background

Transthoracic echocardiography is the leading cardiac imaging modality for patients admitted with COVID-19, a condition of high short-term mortality. The aim of this study was to test the hypothesis that artificial intelligence (AI)–based analysis of echocardiographic images could predict mortality more accurately than conventional analysis by a human expert.

Methods

Patients admitted to 13 hospitals for acute COVID-19 who underwent transthoracic echocardiography were included. Left ventricular ejection fraction (LVEF) and left ventricular longitudinal strain (LVLS) were obtained manually by multiple expert readers and by automated AI software. The ability of the manual and AI analyses to predict all-cause mortality was compared.

Results

In total, 870 patients were enrolled. The mortality rate was 27.4% after a mean follow-up period of 230 ± 115 days. AI analysis had lower variability than manual analysis for both LVEF (P = .003) and LVLS (P = .005). AI-derived LVEF and LVLS were predictors of mortality in univariable and multivariable regression analysis (odds ratio, 0.974 [95% CI, 0.956-0.991; P = .003] for LVEF; odds ratio, 1.060 [95% CI, 1.019-1.105; P = .004] for LVLS), but LVEF and LVLS obtained by manual analysis were not. Direct comparison of the predictive value of AI versus manual measurements of LVEF and LVLS showed that AI was significantly better (P = .005 and P = .003, respectively). In addition, AI-derived LVEF and LVLS had more significant and stronger correlations to other objective biomarkers of acute disease than manual reads.

Conclusions

AI-based analysis of LVEF and LVLS had similar feasibility as manual analysis, minimized variability, and consequently increased the statistical power to predict mortality. AI-based, but not manual, analyses were a significant predictor of in-hospital and follow-up mortality.

Artificial intelligence in echocardiography: Review and limitations including epistemological concerns

BACKGROUND AND PURPOSE

In this review we describe the use of artificial intelligence in the field of echocardiography. Various aspects and terminologies used in artificial intelligence are explained in an easy-to-understand manner and supplemented with illustrations related to echocardiography. Limitations of artificial intelligence, including epistemologic concerns from a philosophical standpoint, are also discussed.

METHODS

A narrative review of relevant papers was conducted.

CONCLUSION

We provide an overview of the usefulness of artificial intelligence in echocardiography and focus on how it can supplement current day-to-day clinical practice in the assessment of various cardiovascular disease entities. On the other hand, there are significant limitations, including epistemological concerns, which need to be kept in perspective.

Artificial Intelligence-Enhanced Echocardiography for Systolic Function Assessment

The accurate assessment of left ventricular systolic function is crucial in the diagnosis and treatment of cardiovascular diseases. Left ventricular ejection fraction (LVEF) and global longitudinal strain (GLS) are the most critical indexes of cardiac systolic function. Echocardiography has become the mainstay of cardiac imaging for measuring LVEF and GLS because it is non-invasive, radiation-free, and allows for bedside operation and real-time processing. However, the human assessment of cardiac function depends on the sonographer’s experience, and despite their years of training, inter-observer variability exists. In addition, GLS requires post-processing, which is time consuming and shows variability across different devices. Researchers have turned to artificial intelligence (AI) to address these challenges. The powerful learning capabilities of AI enable feature extraction, which helps to achieve accurate identification of cardiac structures and reliable estimation of the ventricular volume and myocardial motion. Hence, the automatic output of systolic function indexes can be achieved based on echocardiographic images. This review attempts to thoroughly explain the latest progress of AI in assessing left ventricular systolic function and differential diagnosis of heart diseases by echocardiography and discusses the challenges and promises of this new field.

Explicit and automatic ejection fraction assessment on 2D cardiac ultrasound with a deep learning-based approach

BACKGROUND

Ejection fraction (EF) is a key parameter for assessing cardiovascular functions in cardiac ultrasound, but its manual assessment is time-consuming and subject to high inter and intra-observer variability. Deep learning-based methods have the potential to perform accurate fully automatic EF predictions but suffer from a lack of explainability and interpretability. This study proposes a fully automatic method to reliably and explicitly evaluate the biplane left ventricular EF on 2D echocardiography following the recommended modified Simpson's rule.

METHODS

A deep learning model was trained on apical 4 and 2-chamber echocardiography to segment the left ventricle and locate the mitral valve. Predicted segmentations are then validated with a statistical shape model, which detects potential failures that could impact the EF evaluation. Finally, the end-diastolic and end-systolic frames are identified based on the remaining LV segmentations' areas and EF is estimated on all available cardiac cycles.

RESULTS

Our approach was trained on a dataset of 783 patients. Its performances were evaluated on an internal and external dataset of respectively 200 and 450 patients. On the internal dataset, EF assessment achieved a mean absolute error of 6.10% and a bias of 1.56 ± 7.58% using multiple cardiac cycles. The approach evaluated EF with a mean absolute error of 5.39% and a bias of -0.74 ± 7.12% on the external dataset.

CONCLUSION

Following the recommended guidelines, we proposed an end-to-end fully automatic approach that achieves state-of-the-art performance in biplane EF evaluation while giving explicit details to clinicians.

Artificial Intelligence in Echocardiography

Artificial intelligence in diagnostic cardiac-imaging platforms is advancing rapidly. In particular, artificial intelligence algorithms have increased the efficiency and accuracy of echocardiographic cardiovascular imaging, resulting in more complex echocardiographic imaging techniques and expanded use among noncardiologists. Here, we provide an overview of real-world applications of artificial intelligence in echocardiography including automatic high-quality computer-optimized image acquisition sequences, automated measurements, and algorithms for the rapid and accurate interpretation of cardiac physiology. These advances will not replace physicians but will improve their productivity, workflow, and diagnostic performance.

Assessment and validation of a novel fast fully automated artificial intelligence left ventricular ejection fraction quantification software

BACKGROUND

Quantification of left ventricular ejection fraction (LVEF) by transthoracic echocardiography (TTE) is operator-dependent, time-consuming, and error-prone. LVivoEF by DIA is a new artificial intelligence (AI) software, which displays the tracking of endocardial borders and rapidly quantifies LVEF. We sought to assess the accuracy of LVivoEF compared to cardiac magnetic resonance imaging (cMRI) as the reference standard and to compare LVivoEF to the standard-of-care physician-measured LVEF (MD-EF) including studies with ultrasound enhancing agents (UEAs).

METHODS

In 273 consecutive patients, we compared MD-EF and AI-derived LVEF to cMRI. AI-derived LVEF was obtained from a non-UEA four-chamber view without manual correction. Thirty-one patients were excluded: 25 had interval interventions or incomplete TTE or cMRI studies and six had uninterpretable non-UEA apical views.

RESULTS

In the 242 subjects, the correlation between AI and cMRI was r = .890, similar to MD-EF and cMRI with r = .891 (p = 0.48). Of the 126 studies performed with UEAs, the correlation of AI using the unenhanced four-chamber view was r = .89, similar to MD-EF with r = .90. In the 116 unenhanced studies, AI correlation was r = .87, similar to MD-EF with r = .84. From Bland-Altman analysis, LVivoEF underreported the LVEF with a bias of 3.63 ± 7.40% EF points compared to cMRI while MD-EF to cMRI had a bias of .33 ± 7.52% (p = 0.80).

CONCLUSIONS

Compared to cMRI, LVivoEF can accurately quantify LVEF from a standard apical four-chamber view without manual correction. Thus, LVivoEF has the ability to improve and expedite LVEF quantification.

Artificial intelligence for the echocardiographic assessment of valvular heart disease

Developments in artificial intelligence (AI) have led to an explosion of studies exploring its application to cardiovascular medicine. Due to the need for training and expertise, one area where AI could be impactful would be in the diagnosis and management of valvular heart disease. This is because AI can be applied to the multitude of data generated from clinical assessments, imaging and biochemical testing during the care of the patient. In the area of valvular heart disease, the focus of AI has been on the echocardiographic assessment and phenotyping of patient populations to identify high-risk groups. AI can assist image acquisition, view identification for review, and segmentation of valve and cardiac structures for automated analysis. Using image recognition algorithms, aortic and mitral valve disease states have been directly detected from the images themselves. Measurements obtained during echocardiographic valvular assessment have been integrated with other clinical data to identify novel aortic valve disease subgroups and describe new predictors of aortic valve disease progression. In the future, AI could integrate echocardiographic parameters with other clinical data for precision medical management of patients with valvular heart disease.

Radiomics in Cardiovascular Disease Imaging: from Pixels to the Heart of the Problem

Purpose of Review

This review of the literature aims to present potential applications of radiomics in cardiovascular radiology and, in particular, in cardiac imaging.

Recent Findings

Radiomics and machine learning represent a technological innovation which may be used to extract and analyze quantitative features from medical images. They aid in detecting hidden pattern in medical data, possibly leading to new insights in pathophysiology of different medical conditions. In the recent literature, radiomics and machine learning have been investigated for numerous potential applications in cardiovascular imaging. They have been proposed to improve image acquisition and reconstruction, for anatomical structure automated segmentation or automated characterization of cardiologic diseases.

Summary

The number of applications for radiomics and machine learning is continuing to rise, even though methodological and implementation issues still limit their use in daily practice. In the long term, they may have a positive impact in patient management.

Current and Future Applications of Artificial Intelligence in Coronary Artery Disease

Cardiovascular diseases (CVDs) carry significant morbidity and mortality and are associated with substantial economic burden on healthcare systems around the world. Coronary artery disease, as one disease entity under the CVDs umbrella, had a prevalence of 7.2% among adults in the United States and incurred a financial burden of 360 billion US dollars in the years 2016–2017. The introduction of artificial intelligence (AI) and machine learning over the last two decades has unlocked new dimensions in the field of cardiovascular medicine. From automatic interpretations of heart rhythm disorders via smartwatches, to assisting in complex decision-making, AI has quickly expanded its realms in medicine and has demonstrated itself as a promising tool in helping clinicians guide treatment decisions. Understanding complex genetic interactions and developing clinical risk prediction models, advanced cardiac imaging, and improving mortality outcomes are just a few areas where AI has been applied in the domain of coronary artery disease. Through this review, we sought to summarize the advances in AI relating to coronary artery disease, current limitations, and future perspectives.

Clinical validation of an artificial intelligence-assisted algorithm for automated quantification of left ventricular ejection fraction in real time by a novel handheld ultrasound device

Aims

We sought to evaluate the reliability and diagnostic accuracy of a novel handheld ultrasound device (HUD) with artificial intelligence (AI) assisted algorithm to automatically calculate ejection fraction (autoEF) in a real-world patient population.

Methods and results

We studied 100 consecutive patients (57 ± 15 years old, 61% male), including 38 with abnormal left ventricular (LV) function [LV ejection fraction (LVEF) < 50%]. The autoEF results acquired using the HUD were independently compared with manually traced biplane Simpson's rule measurements on cart-based systems to assess method agreement using intra-class correlation coefficient (ICC), linear regression analysis, and Bland-Altman analysis. The diagnostic accuracy for the detection of LVEF <50% was also calculated. Test-retest reliability of measured EF by the HUD was assessed by calculating the ICC and the minimal detectable change (MDC). The ICC, linear regression analysis, and Bland-Altman analysis revealed good agreement between autoEF and reference manual EF (ICC = 0.85; r = 0.87, P < 0.001; mean bias -1.42% with limits of agreement 14.5%, respectively). Detection of abnormal LV function (EF < 50%) by autoEF algorithm was feasible with sensitivity 90% (95% CI 75-97%), specificity 87% (95% CI 76-94%), PPV 81% (95% CI 66-91%), NPV 93% (95% CI 83-98%), and a total diagnostic accuracy of 88%. Test-retest reliability was excellent (ICC = 0.91, P < 0.001; r = 0.91, P < 0.001; mean difference ± SD: 0.54% ± 5.27%, P = 0.308) and MDC for LVEF measurement by autoEF was calculated at 4.38%.

Conclusion

Use of a novel HUD with AI-enabled capabilities provided similar LVEF results with those derived by manual biplane Simpson's method on cart-based systems and shows clinical potential.

Myocardial strain analysis of echocardiography based on deep learning

BACKGROUND

Strain analysis provides more thorough spatiotemporal signatures for myocardial contraction, which is helpful for early detection of cardiac insufficiency. The use of deep learning (DL) to automatically measure myocardial strain from echocardiogram videos has garnered recent attention. However, the development of key techniques including segmentation and motion estimation remains a challenge. In this work, we developed a novel DL-based framework for myocardial segmentation and motion estimation to generate strain measures from echocardiogram videos.

METHODS

Three-dimensional (3D) Convolutional Neural Network (CNN) was developed for myocardial segmentation and optical flow network for motion estimation. The segmentation network was used to define the region of interest (ROI), and the optical flow network was used to estimate the pixel motion in the ROI. We performed a model architecture search to identify the optimal base architecture for motion estimation. The final workflow design and associated hyperparameters are the result of a careful implementation. In addition, we compared the DL model with a traditional speck tracking algorithm on an independent, external clinical data. Each video was double-blind measured by an ultrasound expert and a DL expert using speck tracking echocardiography (STE) and DL method, respectively.

RESULTS

The DL method successfully performed automatic segmentation, motion estimation, and global longitudinal strain (GLS) measurements in all examinations. The 3D segmentation has better spatio-temporal smoothness, average dice correlation reaches 0.82, and the effect of target frame is better than that of previous 2D networks. The best motion estimation network achieved an average end-point error of 0.05 ± 0.03 mm per frame, better than previously reported state-of-the-art. The DL method showed no significant difference relative to the traditional method in GLS measurement, Spearman correlation of 0.90 (p < 0.001) and mean bias -1.2 ± 1.5%.

CONCLUSION

In conclusion, our method exhibits better segmentation and motion estimation performance and demonstrates the feasibility of DL method for automatic strain analysis. The DL approach helps reduce time consumption and human effort, which holds great promise for translational research and precision medicine efforts.

Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study

BACKGROUND

Echocardiography is the diagnostic modality for assessing cardiac systolic and diastolic function to diagnose and manage heart failure. However, manual interpretation of echocardiograms can be time consuming and subject to human error. Therefore, we developed a fully automated deep learning workflow to classify, segment, and annotate two-dimensional (2D) videos and Doppler modalities in echocardiograms.

METHODS

We developed the workflow using a training dataset of 1145 echocardiograms and an internal test set of 406 echocardiograms from the prospective heart failure research platform (Asian Network for Translational Research and Cardiovascular Trials; ATTRaCT) in Asia, with previous manual tracings by expert sonographers. We validated the workflow against manual measurements in a curated dataset from Canada (Alberta Heart Failure Etiology and Analysis Research Team; HEART; n=1029 echocardiograms), a real-world dataset from Taiwan (n=31 241), the US-based EchoNet-Dynamic dataset (n=10 030), and in an independent prospective assessment of the Asian (ATTRaCT) and Canadian (Alberta HEART) datasets (n=142) with repeated independent measurements by two expert sonographers.

FINDINGS

In the ATTRaCT test set, the automated workflow classified 2D videos and Doppler modalities with accuracies (number of correct predictions divided by the total number of predictions) ranging from 0·91 to 0·99. Segmentations of the left ventricle and left atrium were accurate, with a mean Dice similarity coefficient greater than 93% for all. In the external datasets (n=1029 to 10 030 echocardiograms used as input), automated measurements showed good agreement with locally measured values, with a mean absolute error range of 9-25 mL for left ventricular volumes, 6-10% for left ventricular ejection fraction (LVEF), and 1·8-2·2 for the ratio of the mitral inflow E wave to the tissue Doppler e' wave (E/e' ratio); and reliably classified systolic dysfunction (LVEF <40%, area under the receiver operating characteristic curve [AUC] range 0·90-0·92) and diastolic dysfunction (E/e' ratio ≥13, AUC range 0·91-0·91), with narrow 95% CIs for AUC values. Independent prospective evaluation confirmed less variance of automated compared with human expert measurements, with all individual equivalence coefficients being less than 0 for all measurements.

INTERPRETATION

Deep learning algorithms can automatically annotate 2D videos and Doppler modalities with similar accuracy to manual measurements by expert sonographers. Use of an automated workflow might accelerate access, improve quality, and reduce costs in diagnosing and managing heart failure globally.

FUNDING

A*STAR Biomedical Research Council and A*STAR Exploit Technologies.

Echocardiographic Advances in Dilated Cardiomyopathy

Although the overall survival of patients with dilated cardiomyopathy (DCM) has improved significantly in the last decades, a non-negligible proportion of DCM patients still shows an unfavorable prognosis. DCM patients not only need imaging techniques that are effective in diagnosis, but also suitable for long-term follow-up with frequent re-evaluations. The exponential growth of echocardiography’s technology and performance in recent years has resulted in improved diagnostic accuracy, stratification, management and follow-up of patients with DCM. This review summarizes some new developments in echocardiography and their promising applications in DCM. Although nowadays cardiac magnetic resonance (CMR) remains the gold standard technique in DCM, the echocardiographic advances and novelties proposed in the manuscript, if properly integrated into clinical practice, could bring echocardiography closer to CMR in terms of accuracy and may certify ultrasound as the technique of choice in the follow-up of DCM patients. The application in DCM patients of novel echocardiographic techniques represents an interesting emergent research area for scholars in the near future.

Feasibility and Accuracy of the Automated Software for Dynamic Quantification of Left Ventricular and Atrial Volumes and Function in a Large Unselected Population

We aimed to evaluate the feasibility and accuracy of machine learning-based automated dynamic quantification of left ventricular (LV) and left atrial (LA) volumes in an unselected population. We enrolled 600 unselected patients (12% in atrial fibrillation) clinically referred for transthoracic echocardiography (2DTTE), who also underwent 3D echocardiography (3DE) imaging. LV ejection fraction (EF), LV, and LA volumes were obtained from 2D images; 3D images were analyzed using dynamic heart model (DHM) software (Philips) resulting in LV and LA volume–time curves. A subgroup of 140 patients also underwent cardiac magnetic resonance (CMR) imaging. Average time of analysis, feasibility, and image quality were recorded, and results were compared between 2DTTE, DHM, and CMR. The use of DHM was feasible in 522/600 cases (87%). When feasible, the boundary position was considered accurate in 335/522 patients (64%), while major (n = 38) or minor (n = 149) border corrections were needed. The overall time required for DHM datasets was approximately 40 seconds. As expected, DHM LV volumes were larger than 2D ones (end-diastolic volume: 173 ± 64 vs. 142 ± 58 mL, respectively), while no differences were found for LV EF and LA volumes (EF: 55% ± 12 vs. 56% ± 14; LA volume 89 ± 36 vs. 89 ± 38 mL, respectively). The comparison between DHM and CMR values showed a high correlation for LV volumes (r = 0.70 and r = 0.82, p < 0.001 for end-diastolic and end-systolic volume, respectively) and an excellent correlation for EF (r = 0.82, p < 0.001) and LA volumes. The DHM software is feasible, accurate, and quick in a large series of unselected patients, including those with suboptimal 2D images or in atrial fibrillation.

Artificial intelligence applied to support medical decisions for the automatic analysis of echocardiogram images: A systematic review

The echocardiogram is a test that is widely used in Heart Disease Diagnoses. However, its analysis is largely dependent on the physician's experience. In this regard, artificial intelligence has become an essential technology to assist physicians. This study is a Systematic Literature Review (SLR) of primary state-of-the-art studies that used Artificial Intelligence (AI) techniques to automate echocardiogram analyses. Searches on the leading scientific article indexing platforms using a search string returned approximately 1400 articles. After applying the inclusion and exclusion criteria, 118 articles were selected to compose the detailed SLR. This SLR presents a thorough investigation of AI applied to support medical decisions for the main types of echocardiogram (Transthoracic, Transesophageal, Doppler, Stress, and Fetal). The article's data extraction indicated that the primary research interest of the studies comprised four groups: 1) Improvement of image quality; 2) identification of the cardiac window vision plane; 3) quantification and analysis of cardiac functions, and; 4) detection and classification of cardiac diseases. The articles were categorized and grouped to show the main contributions of the literature to each type of ECHO. The results indicate that the Deep Learning (DL) methods presented the best results for the detection and segmentation of the heart walls, right and left atrium and ventricles, and classification of heart diseases using images/videos obtained by echocardiography. The models that used Convolutional Neural Network (CNN) and its variations showed the best results for all groups. The evidence produced by the results presented in the tabulation of the studies indicates that the DL contributed significantly to advances in echocardiogram automated analysis processes. Although several solutions were presented regarding the automated analysis of ECHO, this area of research still has great potential for further studies to improve the accuracy of results already known in the literature.