Predicting post-operative right ventricular failure using video-based deep learning

Overview and Clinical Applications of Artificial Intelligence and Machine Learning in Cardiac Anesthesiology

Artificial intelligence- (AI) and machine learning (ML)-based applications are becoming increasingly pervasive in the healthcare setting. This has in turn challenged clinicians, hospital administrators, and health policymakers to understand such technologies and develop frameworks for safe and sustained clinical implementation. Within cardiac anesthesiology, challenges and opportunities for AI/ML to support patient care are presented by the vast amounts of electronic health data, which are collected rapidly, interpreted, and acted upon within the periprocedural area. To address such challenges and opportunities, in this article, the authors review 3 recent applications relevant to cardiac anesthesiology, including depth of anesthesia monitoring, operating room resource optimization, and transthoracic/transesophageal echocardiography, as conceptual examples to explore strengths and limitations of AI/ML within healthcare, and characterize this evolving landscape. Through reviewing such applications, the authors introduce basic AI/ML concepts and methodologies, as well as practical considerations and ethical concerns for initiating and maintaining safe clinical implementation of AI/ML-based algorithms for cardiac anesthesia patient care.

Artificial Intelligence Approaches for Predicting the Risks of Durable Mechanical Circulatory Support Therapy and Cardiac Transplantation

Background: The use of AI-driven technologies in probing big data to generate better risk prediction models has been an ongoing and expanding area of investigation. The AI-driven models may perform better as compared to linear models; however, more investigations are needed in this area to refine their predictability and applicability to the field of durable MCS and cardiac transplantation. Methods: A literature review was carried out using Google Scholar/PubMed from 2000 to 2023. Results: This review defines the knowledge gaps and describes different AI-driven approaches that may be used to further our understanding. Conclusions: The limitations of current models are due to missing data, data imbalances, and the uneven distribution of variables in the datasets from which the models are derived. There is an urgent need for predictive models that can integrate a large number of clinical variables from multicenter data to account for the variability in patient characteristics that influence patient selection, outcomes, and survival for both durable MCS and HT; this may be fulfilled by AI-driven risk prediction models.

Deep learning from latent spatiotemporal information of the heart: Identifying advanced bioimaging markers from echocardiograms

A key strength of echocardiography lies in its integration of comprehensive spatiotemporal cardiac imaging data in real-time, to aid frontline or bedside patient risk stratification and management. Nonetheless, its acquisition, processing, and interpretation are known to all be subject to heterogeneity from its reliance on manual and subjective human tracings, which challenges workflow and protocol standardization and final interpretation accuracy. In the era of advanced computational power, utilization of machine learning algorithms for big data analytics in echocardiography promises reduction in cost, cognitive errors, and intra- and inter-observer variability. Novel spatiotemporal deep learning (DL) models allow the integration of temporal arm information based on unlabeled pixel echocardiographic data for convolution of an adaptive semantic spatiotemporal calibration to construct personalized 4D heart meshes, assess global and regional cardiac function, detect early valve pathology, and differentiate uncommon cardiovascular disorders. Meanwhile, data visualization on spatiotemporal DL prediction models helps extract latent temporal imaging features to develop advanced imaging biomarkers in early disease stages and advance our understanding of pathophysiology to support the development of personalized prevention or treatment strategies. Since portable echocardiograms have been increasingly used as point-of-care imaging tools to aid rural care delivery, the application of these new spatiotemporal DL techniques show the potentials in streamlining echocardiographic acquisition, processing, and data analysis to improve workflow standardization and efficiencies, and provide risk stratification and decision supporting tools in real-time, to prompt the building of new imaging diagnostic networks to enhance rural healthcare engagement.

Deep learning from atrioventricular plane displacement in patients with Takotsubo syndrome: lighting up the black-box

Aims

The spatiotemporal deep convolutional neural network (DCNN) helps reduce echocardiographic readers' erroneous 'judgement calls' on Takotsubo syndrome (TTS). The aim of this study was to improve the interpretability of the spatiotemporal DCNN to discover latent imaging features associated with causative TTS pathophysiology.

Methods and results

We applied gradient-weighted class activation mapping analysis to visualize an established spatiotemporal DCNN based on the echocardiographic videos to differentiate TTS (150 patients) from anterior wall ST-segment elevation myocardial infarction (STEMI, 150 patients). Forty-eight human expert readers interpreted the same echocardiographic videos and prioritized the regions of interest on myocardium for the differentiation. Based on visualization results, we completed optical flow measurement, myocardial strain, and Doppler/tissue Doppler echocardiography studies to investigate regional myocardial temporal dynamics and diastology. While human readers' visualization predominantly focused on the apex of the heart in TTS patients, the DCNN temporal arm's saliency visualization was attentive on the base of the heart, particularly at the atrioventricular (AV) plane. Compared with STEMI patients, TTS patients consistently showed weaker peak longitudinal displacement (in pixels) in the basal inferoseptal (systolic: 2.15 ± 1.41 vs. 3.10 ± 1.66, P < 0.001; diastolic: 2.36 ± 1.71 vs. 2.97 ± 1.69, P = 0.004) and basal anterolateral (systolic: 2.70 ± 1.96 vs. 3.44 ± 2.13, P = 0.003; diastolic: 2.73 ± 1.70 vs. 3.45 ± 2.20, P = 0.002) segments, and worse longitudinal myocardial strain in the basal inferoseptal (-8.5 ± 3.8% vs. -9.9 ± 4.1%, P = 0.013) and basal anterolateral (-8.6 ± 4.2% vs. -10.4 ± 4.1%, P = 0.006) segments. Meanwhile, TTS patients showed worse diastolic mechanics than STEMI patients (E'/septal: 5.1 ± 1.2 cm/s vs. 6.3 ± 1.5 cm/s, P < 0.001; S'/septal: 5.8 ± 1.3 cm/s vs. 6.8 ± 1.4 cm/s, P < 0.001; E'/lateral: 6.0 ± 1.4 cm/s vs. 7.9 ± 1.6 cm/s, P < 0.001; S'/lateral: 6.3 ± 1.4 cm/s vs. 7.3 ± 1.5 cm/s, P < 0.001; E/E': 15.5 ± 5.6 vs. 12.5 ± 3.5, P < 0.001).

Conclusion

The spatiotemporal DCNN saliency visualization helps identify the pattern of myocardial temporal dynamics and navigates the quantification of regional myocardial mechanics. Reduced AV plane displacement in TTS patients likely correlates with impaired diastolic mechanics.

Right heart failure after durable left ventricular assist device implantation

INTRODUCTION

Right heart failure (RHF) is a well-known complication after left ventricular assist device (LVAD) implantation and portends increased morbidity and mortality. Understanding the mechanisms and predictors of RHF in this clinical setting may offer ideas for early identification and aggressive management to minimize poor outcomes. A variety of medical therapies and mechanical circulatory support options are currently available for the management of post-LVAD RHF.

AREAS COVERED

We reviewed the existing definitions of RHF including its potential mechanisms in the context of durable LVAD implantation and currently available medical and device therapies. We performed a literature search using PubMed (from 2010 to 2023).

EXPERT OPINION

RHF remains a common complication after LVAD implantation. However, existing knowledge gaps limit clinicians' ability to adequately address its consequences. Early identification and management are crucial to reducing the risk of poor outcomes, but existing risk stratification tools perform poorly and have limited clinical applicability. This is an area ripe for investigation with the potential for major improvements in identification and targeted therapy in an effort to improve outcomes.

Adopting artificial intelligence in cardiovascular medicine: a scoping review

Recent years have witnessed significant transformations in cardiovascular medicine, driven by the rapid evolution of artificial intelligence (AI). This scoping review was conducted to capture the breadth of AI applications within cardiovascular science. Employing a structured approach, we sourced relevant articles from PubMed, with an emphasis on journals encompassing general cardiology and digital medicine. We applied filters to highlight cardiovascular articles published in journals focusing on general internal medicine, cardiology and digital medicine, thereby identifying the prevailing trends in the field. Following a comprehensive full-text screening, a total of 140 studies were identified. Over the preceding 5 years, cardiovascular medicine's interplay with AI has seen an over tenfold augmentation. This expansive growth encompasses multiple cardiovascular subspecialties, including but not limited to, general cardiology, ischemic heart disease, heart failure, and arrhythmia. Deep learning emerged as the predominant methodology. The majority of AI endeavors in this domain have been channeled toward enhancing diagnostic and prognostic capabilities, utilizing resources such as hospital datasets, electrocardiograms, and echocardiography. A significant uptrend was observed in AI's application for omics data analysis. However, a clear gap persists in AI's full-scale integration into the clinical decision-making framework. AI, particularly deep learning, has demonstrated robust applications across cardiovascular subspecialties, indicating its transformative potential in this field. As we continue on this trajectory, ensuring the alignment of technological progress with medical ethics becomes crucial. The abundant digital health data today further accentuates the need for meticulous systematic reviews, tailoring them to each cardiovascular subspecialty.

The Role of Artificial Intelligence and Machine Learning in the Prediction of Right Heart Failure after Left Ventricular Assist Device Implantation: A Comprehensive Review

One of the most challenging and prevalent side effects of LVAD implantation is that of right heart failure (RHF) that may develop afterwards. The purpose of this study is to review and highlight recent advances in the uses of AI in evaluating RHF after LVAD implantation. The available literature was scanned using certain key words (artificial intelligence, machine learning, left ventricular assist device, prediction of right heart failure after LVAD) was scanned within Pubmed, Web of Science, and Google Scholar databases. Conventional risk scoring systems were also summarized, with their pros and cons being included in the results section of this study in order to provide a useful contrast with AI-based models. There are certain interesting and innovative ML approaches towards RHF prediction among the studies reviewed as well as more straightforward approaches that identified certain important predictive clinical parameters. Despite their accomplishments, the resulting AUC scores were far from ideal for these methods to be considered fully sufficient. The reasons for this include the low number of studies, standardized data availability, and lack of prospective studies. Another topic briefly discussed in this study is that relating to the ethical and legal considerations of using AI-based systems in healthcare. In the end, we believe that it would be beneficial for clinicians to not ignore these developments despite the current research indicating more time is needed for AI-based prediction models to achieve a better performance.

Deep learning for transesophageal echocardiography view classification

Transesophageal echocardiography (TEE) imaging is a vital tool used in the evaluation of complex cardiac pathology and the management of cardiac surgery patients. A key limitation to the application of deep learning strategies to intraoperative and intraprocedural TEE data is the complexity and unstructured nature of these images. In the present study, we developed a deep learning-based, multi-category TEE view classification model that can be used to add structure to intraoperative and intraprocedural TEE imaging data. More specifically, we trained a convolutional neural network (CNN) to predict standardized TEE views using labeled intraoperative and intraprocedural TEE videos from Cedars-Sinai Medical Center (CSMC). We externally validated our model on intraoperative TEE videos from Stanford University Medical Center (SUMC). Accuracy of our model was high across all labeled views. The highest performance was achieved for the Trans-Gastric Left Ventricular Short Axis View (area under the receiver operating curve [AUC] = 0.971 at CSMC, 0.957 at SUMC), the Mid-Esophageal Long Axis View (AUC = 0.954 at CSMC, 0.905 at SUMC), the Mid-Esophageal Aortic Valve Short Axis View (AUC = 0.946 at CSMC, 0.898 at SUMC), and the Mid-Esophageal 4-Chamber View (AUC = 0.939 at CSMC, 0.902 at SUMC). Ultimately, we demonstrate that our deep learning model can accurately classify standardized TEE views, which will facilitate further downstream deep learning analyses for intraoperative and intraprocedural TEE imaging.

The Echocardiographic Evaluation of the Right Heart: Current and Future Advances

PURPOSE OF REVIEW

To discuss physiologic and methodologic advances in the echocardiographic assessment of right heart (RH) function, including the emergence of artificial intelligence (AI) and point-of-care ultrasound.

RECENT FINDINGS

Recent studies have highlighted the prognostic value of right ventricular (RV) longitudinal strain, RV end-systolic dimensions, and right atrial (RA) size and function in pulmonary hypertension and heart failure. While RA pressure is a central marker of right heart diastolic function, the recent emphasis on venous excess imaging (VExUS) has provided granularity to the systemic consequences of RH failure. Several methodological advances are also changing the landscape of RH imaging including post-processing 3D software to delineate the non-longitudinal (radial, anteroposterior, and circumferential) components of RV function, as well as AI segmentation- and non-segmentation-based quantification. Together with recent guidelines and advances in AI technology, the field is shifting from specific RV functional metrics to integrated RH disease-specific phenotypes. A modern echocardiographic evaluation of RH function should focus on the entire cardiopulmonary venous unit-from the venous to the pulmonary arterial system. Together, a multi-parametric approach, guided by physiology and AI algorithms, will help define novel integrated RH profiles for improved disease detection and monitoring.

Deep Learning to Estimate Left Ventricular Ejection Fraction From Routine Coronary Angiographic Images

Background

Cine images during coronary angiography contain a wealth of information besides the assessment of coronary stenosis. We hypothesized that deep learning (DL) can discern moderate-severe left ventricular dysfunction among patients undergoing coronary angiography.

Objectives

The purpose of this study was to assess the ability of machine learning models in estimating left ventricular ejection fraction (LVEF) from routine coronary angiographic images.

Methods

We developed a combined 3D-convolutional neural network (CNN) and transformer to estimate LVEF for diagnostic coronary angiograms of the left coronary artery (LCA). Two angiograms, left anterior oblique (LAO)-caudal and right anterior oblique (RAO)-cranial projections, were fed into the model simultaneously. The model classified LVEF as significantly reduced (LVEF ≤40%) vs normal or mildly reduced (LVEF>40%). Echocardiogram performed within 30 days served as the gold standard for LVEF.

Results

A collection of 18,809 angiograms from 17,346 patients from Mayo Clinic were included (mean age 67.29; 35% women). Each patient appeared only in the training (70%), validation (10%), or testing set (20%). The model exhibited excellent performance (area under the receiver operator curve [AUC] 0.87; sensitivity 0.77; specificity 0.80) in the training set. The model's performance exceeded human expert assessment (AUC, sensitivity, and specificity of 0.86, 0.76, and 0.77, respectively) vs (AUC, sensitivity, and specificity of 0.76-0.77, 0.50-0.44, and 0.90-0.93, respectively). In additional sensitivity analyses, combining the LAO and RAO views yielded a higher AUC, sensitivity, and specificity than utilizing either LAO or RAO individually. The original model combining CNN and transformer was superior to DL models using either 3D-CNN or transformers.

Conclusions

A novel DL algorithm demonstrated rapid and accurate assessment of LVEF from routine coronary angiography. The algorithm can be used to support clinical decision-making and form the foundation for future models that could extract meaningful data from routine angiography studies.

Deep Learning for Cardiovascular Imaging: A Review

Importance

Artificial intelligence (AI), driven by advances in deep learning (DL), has the potential to reshape the field of cardiovascular imaging (CVI). While DL for CVI is still in its infancy, research is accelerating to aid in the acquisition, processing, and/or interpretation of CVI across various modalities, with several commercial products already in clinical use. It is imperative that cardiovascular imagers are familiar with DL systems, including a basic understanding of how they work, their relative strengths compared with other automated systems, and possible pitfalls in their implementation. The goal of this article is to review the methodology and application of DL to CVI in a simple, digestible fashion toward demystifying this emerging technology.

Observations

At its core, DL is simply the application of a series of tunable mathematical operations that translate input data into a desired output. Based on artificial neural networks that are inspired by the human nervous system, there are several types of DL architectures suited to different tasks; convolutional neural networks are particularly adept at extracting valuable information from CVI data. We survey some of the notable applications of DL to tasks across the spectrum of CVI modalities. We also discuss challenges in the development and implementation of DL systems, including avoiding overfitting, preventing systematic bias, improving explainability, and fostering a human-machine partnership. Finally, we conclude with a vision of the future of DL for CVI.

Conclusions and Relevance

Deep learning has the potential to meaningfully affect the field of CVI. Rather than a threat, DL could be seen as a partner to cardiovascular imagers in reducing technical burden and improving efficiency and quality of care. High-quality prospective evidence is still needed to demonstrate how the benefits of DL CVI systems may outweigh the risks.

Deep Learning-Based Prediction of Right Ventricular Ejection Fraction Using 2D Echocardiograms

BACKGROUND

Evidence has shown the independent prognostic value of right ventricular (RV) function, even in patients with left-sided heart disease. The most widely used imaging technique to measure RV function is echocardiography; however, conventional 2-dimensional (2D) echocardiographic assessment is unable to leverage the same clinical information that 3-dimensional (3D) echocardiography-derived right ventricular ejection fraction (RVEF) can provide.

OBJECTIVES

The authors aimed to implement a deep learning (DL)-based tool to estimate RVEF from 2D echocardiographic videos. In addition, they benchmarked the tool's performance against human expert reading and evaluated the prognostic power of the predicted RVEF values.

METHODS

The authors retrospectively identified 831 patients with RVEF measured by 3D echocardiography. All 2D apical 4-chamber view echocardiographic videos of these patients were retrieved (n = 3,583), and each subject was assigned to either the training or the internal validation set (80:20 ratio). Using the videos, several spatiotemporal convolutional neural networks were trained to predict RVEF. The 3 best-performing networks were combined into an ensemble model, which was further evaluated in an external data set containing 1,493 videos of 365 patients with a median follow-up time of 1.9 years.

RESULTS

The ensemble model predicted RVEF with a mean absolute error of 4.57 percentage points in the internal and 5.54 percentage points in the external validation set. In the latter, the model identified RV dysfunction (defined as RVEF <45%) with an accuracy of 78.4%, which was comparable to an expert reader's visual assessment (77.0%; P = 0.678). The DL-predicted RVEF values were associated with major adverse cardiac events independent of age, sex, and left ventricular systolic function (HR: 0.924 [95% CI: 0.862-0.990]; P = 0.025).

CONCLUSIONS

Using 2D echocardiographic videos alone, the proposed DL-based tool can accurately assess RV function, with similar diagnostic and prognostic power as 3D imaging.

Assessment and diagnosis of right ventricular failure-retrospection and future directions

The right ventricle (RV) has a critical role in hemodynamics and right ventricular failure (RVF) often leads to poor clinical outcome. Despite the clinical importance of RVF, its definition and recognition currently rely on patients' symptoms and signs, rather than on objective parameters from quantifying RV dimensions and function. A key challenge is the geometrical complexity of the RV, which often makes it difficult to assess RV function accurately. There are several assessment modalities currently utilized in the clinical settings. Each diagnostic investigation has both advantages and limitations according to its characteristics. The purpose of this review is to reflect on the current diagnostic tools, consider the potential technological advancements and propose how to improve the assessment of right ventricular failure. Advanced technique such as automatic evaluation with artificial intelligence and 3-dimensional assessment for the complex RV structure has a potential to improve RV assessment by increasing accuracy and reproducibility of the measurements. Further, noninvasive assessments for RV-pulmonary artery coupling and right and left ventricular interaction are also warranted to overcome the load-related limitations for the accurate evaluation of RV contractile function. Future studies to cross-validate the advanced technologies in various populations are required.

Deep Learning for Echocardiography: Introduction for Clinicians and Future Vision: State-of-the-Art Review

Exponential growth in data storage and computational power is rapidly narrowing the gap between translating findings from advanced clinical informatics into cardiovascular clinical practice. Specifically, cardiovascular imaging has the distinct advantage in providing a great quantity of data for potentially rich insights, but nuanced interpretation requires a high-level skillset that few individuals possess. A subset of machine learning, deep learning (DL), is a modality that has shown promise, particularly in the areas of image recognition, computer vision, and video classification. Due to a low signal-to-noise ratio, echocardiographic data tend to be challenging to classify; however, utilization of robust DL architectures may help clinicians and researchers automate conventional human tasks and catalyze the extraction of clinically useful data from the petabytes of collected imaging data. The promise is extending far and beyond towards a contactless echocardiographic exam-a dream that is much needed in this time of uncertainty and social distancing brought on by a stunning pandemic culture. In the current review, we discuss state-of-the-art DL techniques and architectures that can be used for image and video classification, and future directions in echocardiographic research in the current era.

Value of deep learning models based on ultrasonic dynamic videos for distinguishing thyroid nodules

Objective

This study was designed to distinguish benign and malignant thyroid nodules by using deep learning(DL) models based on ultrasound dynamic videos.

Methods

Ultrasound dynamic videos of 1018 thyroid nodules were retrospectively collected from 657 patients in Zhejiang Cancer Hospital from January 2020 to December 2020 for the tests with 5 DL models.

Results

In the internal test set, the area under the receiver operating characteristic curve (AUROC) was 0.929(95% CI: 0.888,0.970) for the best-performing model LSTM Two radiologists interpreted the dynamic video with AUROC values of 0.760 (95% CI: 0.653, 0.867) and 0.815 (95% CI: 0.778, 0.853). In the external test set, the best-performing DL model had AUROC values of 0.896(95% CI: 0.847,0.945), and two ultrasound radiologist had AUROC values of 0.754 (95% CI: 0.649,0.850) and 0.833 (95% CI: 0.797,0.869).

Conclusion

This study demonstrates that the DL model based on ultrasound dynamic videos performs better than the ultrasound radiologists in distinguishing thyroid nodules.

Artificial intelligence guidance of advanced heart failure therapies: A systematic scoping review

Introduction

Artificial intelligence can recognize complex patterns in large datasets. It is a promising technology to advance heart failure practice, as many decisions rely on expert opinions in the absence of high-quality data-driven evidence.

Methods

We searched Embase, Web of Science, and PubMed databases for articles containing "artificial intelligence," "machine learning," or "deep learning" and any of the phrases "heart transplantation," "ventricular assist device," or "cardiogenic shock" from inception until August 2022. We only included original research addressing post heart transplantation (HTx) or mechanical circulatory support (MCS) clinical care. Review and data extraction were performed in accordance with PRISMA-Scr guidelines.

Results

Of 584 unique publications detected, 31 met the inclusion criteria. The majority focused on outcome prediction post HTx (n = 13) and post durable MCS (n = 7), as well as post HTx and MCS management (n = 7, n = 3, respectively). One study addressed temporary mechanical circulatory support. Most studies advocated for rapid integration of AI into clinical practice, acknowledging potential improvements in management guidance and reliability of outcomes prediction. There was a notable paucity of external data validation and integration of multiple data modalities.

Conclusion

Our review showed mounting innovation in AI application in management of MCS and HTx, with the largest evidence showing improved mortality outcome prediction.

Contemporary Applications of Machine Learning for Device Therapy in Heart Failure

Despite a better understanding of the underlying pathogenesis of heart failure (HF), pharmacotherapy, surgical, and percutaneous interventions do not prevent disease progression in all patients, and a significant proportion of patients end up requiring advanced therapies. Machine learning (ML) is gaining wider acceptance in cardiovascular medicine because of its ability to incorporate large, complex, and multidimensional data and to potentially facilitate the creation of predictive models not constrained by many of the limitations of traditional statistical approaches. With the coexistence of "big data" and novel advanced analytic techniques using ML, there is ever-increasing research into applying ML in the context of HF with the goal of improving patient outcomes. Through this review, the authors describe the basics of ML and summarize the existing published reports regarding contemporary applications of ML in device therapy for HF while highlighting the limitations to widespread implementation and its future promises.

Machine learning-based 3D modeling and volumetry of human posterior vitreous cavity of optical coherence tomographic images

The structure of the human vitreous varies considerably because of age-related liquefactions of the vitreous gel. These changes are poorly studied in vivo mainly because their high transparency and mobility make it difficult to obtain reliable and repeatable images of the vitreous. Optical coherence tomography can detect the boundaries between the vitreous gel and vitreous fluid, but it is difficult to obtain high resolution images that can be used to convert the images to three-dimensional (3D) images. Thus, the purpose of this study was to determine the shape and characteristics of the vitreous fluid using machine learning-based 3D modeling in which manually labelled fluid areas were used to train deep convolutional neural network (DCNN). The trained DCNN labelled vitreous fluid automatically and allowed us to obtain 3D vitreous model and to quantify the vitreous fluidic cavities. The mean volume and surface area of posterior vitreous fluidic cavities are 19.6 ± 7.8 mm³ and 104.0 ± 18.9 mm² in eyes of 17 school children. The results suggested that vitreous fluidic cavities expanded as the cavities connects with each other, and this modeling system provided novel imaging markers for aging and eye diseases.

Artificial intelligence in echocardiography: Review and limitations including epistemological concerns

BACKGROUND AND PURPOSE

In this review we describe the use of artificial intelligence in the field of echocardiography. Various aspects and terminologies used in artificial intelligence are explained in an easy-to-understand manner and supplemented with illustrations related to echocardiography. Limitations of artificial intelligence, including epistemologic concerns from a philosophical standpoint, are also discussed.

METHODS

A narrative review of relevant papers was conducted.

CONCLUSION

We provide an overview of the usefulness of artificial intelligence in echocardiography and focus on how it can supplement current day-to-day clinical practice in the assessment of various cardiovascular disease entities. On the other hand, there are significant limitations, including epistemological concerns, which need to be kept in perspective.

Medical professional enhancement using explainable artificial intelligence in fetal cardiac ultrasound screening (supplementary)

Diagnostic support tools based on artificial intelligence (AI) have exhibited high performance in various medical fields. However, their clinical application remains challenging because of the lack of explanatory power in AI decisions (black box problem), making it difficult to build trust with medical professionals. Nevertheless, visualizing the internal representation of deep neural networks will increase explanatory power and improve the confidence of medical professionals in AI decisions. We propose a novel deep learning-based explainable representation “graph chart diagram” to support fetal cardiac ultrasound screening, which has low detection rates of congenital heart diseases due to the difficulty in mastering the technique. Screening performance improves using this representation from 0.966 to 0.975 for experts, 0.829 to 0.890 for fellows, and 0.616 to 0.748 for residents in the arithmetic mean of area under the curve of a receiver operating characteristic curve. This is the first demonstration wherein examiners used deep learning-based explainable representation to improve the performance of fetal cardiac ultrasound screening, highlighting the potential of explainable AI to augment examiner capabilities.

Prospects for cardiovascular medicine using artificial intelligence

As the importance of artificial intelligence (AI) in the clinical setting increases, the need for clinicians to understand AI is also increasing. This review focuses on the fundamental principles of AI and the current state of cardiovascular AI. Various types of cardiovascular AI have been developed for evaluating examinations such as X-rays, electrocardiogram, echocardiography, computed tomography, and magnetic resonance imaging. Cardiovascular AI achieves high accuracy in diagnostic support and prognosis prediction. Furthermore, it can even detect abnormalities that were previously difficult for cardiologists to detect. Randomized controlled trials begin to be reported to verify the usefulness of cardiovascular AI. The day is approaching when cardiovascular AI will be commonly used in clinical practice. Various types of medical AI will be used for cardiovascular care; however, it will not replace medical doctors. We need to understand the strengths and weaknesses of medical AI so that cardiologists can effectively use AI to improve the medical care of patients.