Steps to use artificial intelligence in echocardiography

A multi-task deep learning approach for real-time view classification and quality assessment of echocardiographic images

High-quality standard views in two-dimensional echocardiography are essential for accurate cardiovascular disease diagnosis and treatment decisions. However, the quality of echocardiographic images is highly dependent on the practitioner's experience. Ensuring timely quality control of echocardiographic images in the clinical setting remains a significant challenge. In this study, we aimed to propose new quality assessment criteria and develop a multi-task deep learning model for real-time multi-view classification and image quality assessment (six standard views and "others"). A total of 170,311 echocardiographic images collected between 2015 and 2022 were utilized to develop and evaluate the model. On the test set, the model achieved an overall classification accuracy of 97.8% (95%CI 97.7-98.0) and a mean absolute error of 6.54 (95%CI 6.43-6.66). A single-frame inference time of 2.8 ms was achieved, meeting real-time requirements. We also analyzed pre-stored images from three distinct groups of echocardiographers (junior, senior, and expert) to evaluate the clinical feasibility of the model. Our multi-task model can provide objective, reproducible, and clinically significant view quality assessment results for echocardiographic images, potentially optimizing the clinical image acquisition process and improving AI-assisted diagnosis accuracy.

Broadening Perspectives of Artificial Intelligence in Echocardiography

Echocardiography frequently serves as the first-line treatment of diagnostic imaging for several pathological entities in cardiology. Artificial intelligence (AI) has been growing substantially in information technology and various commercial industries. Machine learning (ML), a branch of AI, has been shown to expand the capabilities and potential of echocardiography. ML algorithms expand the field of echocardiography by automated assessment of the ejection fraction and left ventricular function, integrating novel approaches such as speckle tracking or tissue Doppler echocardiography or vector flow mapping, improved phenotyping, distinguishing between cardiac conditions, and incorporating information from mobile health and genomics. In this review article, we assess the impact of AI and ML in echocardiography.

Exploring the Role of ChatGPT in Cardiology: A Systematic Review of the Current Literature

Chat Generative Pre-Trained Transformer (ChatGPT) is a chatbot based on a large language model that has gained public interest since its release in November 2022. This systematic review examines the current literature on the potential applications of ChatGPT in cardiology. A systematic literature search was conducted to retrieve all publications on ChatGPT in PubMed, Scopus, MedRxiv, and the Cochrane Library published on or before September 30, 2023. Search terms relating to ChatGPT and cardiology were used. Publications without relevance to ChatGPT and cardiology were excluded. The included publications were divided into cohorts. Cohort A examined ChatGPT's role in improving patient health literacy. Cohort B explored ChatGPT's role in clinical care. Cohort C examined ChatGPT's role in future literature and research. Cohort D included case reports that used ChatGPT. A total of 115 publications were found across all databases. Twenty-four publications met the inclusion criteria and were included in the review. Cohort A-C included a total of 14 records comprised of editorials/letters to the editor (29%), research letters/correspondence (21%), review papers (21%), observational studies (7%), research studies (7%), and short reports (7%). Cohort D included 10 case reports. No relevant systematic literature reviews, meta-analyses, or randomized controlled trials were identified in the search.  Based on this review of the literature, ChatGPT has the potential to enhance patient education, support clinicians providing clinical care, and enhance the development of future literature. However, further studies are needed to understand the potential applications of ChatGPT in cardiology and to address ethical concerns regarding the delivery of medical advice and the authoring of manuscripts.

Can Artificial Intelligence Revolutionize the Diagnosis and Management of the Atrial Septal Defect in Children?

Atrial septal defects (ASDs) present a significant healthcare challenge, demanding accurate and timely diagnosis and precise management to ensure optimal patient outcomes. Artificial intelligence (AI) applications in healthcare are rapidly evolving, offering promise for enhanced medical decision-making and patient care. In the context of cardiology, the integration of AI promises to provide more efficient and accurate diagnosis and personalized treatment strategies for ASD patients. In interventional cardiology, sometimes the lack of precise measurement of the cardiac rims evaluated by transthoracic echocardiography combined with the floppy aspect of the rims can mislead and result in complications. AI software can be created to generate responses for difficult tasks, like which device is the most suitable for different shapes and dimensions to prevent embolization or erosion. This paper reviews the current state of AI in healthcare and its applications in cardiology, emphasizing the specific opportunities and challenges in applying AI to ASD diagnosis and management. By exploring the capabilities and limitations of AI in ASD diagnosis and management. This paper highlights the evolution of medical practice towards a more AI-augmented future, demonstrating the capacity of AI to unlock new possibilities for healthcare professionals and patients alike.

Revolution of echocardiographic reporting: the new era of artificial intelligence and natural language processing

Artificial intelligence (AI) has been making a significant impact on cardiovascular imaging, transforming everything from data capture to report generation. In the field of echocardiography, AI offers the potential to enhance accuracy, speed up reporting, and reduce the workload of physicians. This is an advantage because, compared to computed tomography and magnetic resonance imaging, echocardiograms tend to exhibit higher observer variability in interpretation. This review takes a comprehensive viewpoint at AI-based reporting systems and their application in echocardiography, emphasizing the need for automated diagnoses. The integration of natural language processing (NLP) technologies, including ChatGPT, could provide revolutionary advancements. One of the exciting prospects of AI integration is its potential to accelerate reporting, thereby improving patient outcomes and access to treatment, while also mitigating physician burnout. However, AI introduces new challenges like ensuring data quality, managing potential over-reliance on AI, addressing legal and ethical concerns, and balancing significant costs against benefits. As we navigate these complexities, it's important for cardiologists to stay updated with AI advancements and learn to utilize them effectively. AI has the potential to be integrated into daily clinical practice, becoming a valuable tool for healthcare professionals dealing with heart diseases, provided it's approached with careful consideration.

Current role and future perspectives of artificial intelligence in echocardiography

Echocardiography is an essential tool in diagnostic cardiology and is fundamental to clinical care. Artificial intelligence (AI) can help health care providers serving as a valuable diagnostic tool for physicians in the field of echocardiography specially on the automation of measurements and interpretation of results. In addition, it can help expand the capabilities of research and discover alternative pathways in medical management specially on prognostication. In this review article, we describe the current role and future perspectives of AI in echocardiography.

Evaluation of the Accuracy of ChatGPT in Answering Clinical Questions on the Japanese Society of Hypertension Guidelines

BACKGROUND

To assist healthcare providers in interpreting guidelines, clinical questions (CQ) are often included, but not always, which can make interpretation difficult for non-expert clinicians. We evaluated the ability of ChatGPT to accurately answer CQs on the Japanese Society of Hypertension Guidelines for the Management of Hypertension (JSH 2019).

METHODS AND RESULTS

We conducted an observational study using data from JSH 2019. The accuracy rate for CQs and limited evidence-based questions of the guidelines (Qs) were evaluated. ChatGPT demonstrated a higher accuracy rate for CQs than for Qs (80% vs. 36%, P value: 0.005).

CONCLUSIONS

ChatGPT has the potential to be a valuable tool for clinicians in the management of hypertension.

Real-time guiding by deep learning during echocardiography to reduce left ventricular foreshortening and measurement variability

Aims

Apical foreshortening leads to an underestimation of left ventricular (LV) volumes and an overestimation of LV ejection fraction and global longitudinal strain. Real-time guiding using deep learning (DL) during echocardiography to reduce foreshortening could improve standardization and reduce variability. We aimed to study the effect of real-time DL guiding during echocardiography on measures of LV foreshortening and inter-observer variability.

Methods and results

Patients (n = 88) in sinus rhythm referred for echocardiography without indication for contrast were included. All participants underwent three echocardiograms. The first two examinations were performed by sonographers, and the third by cardiologists. In Period 1, the sonographers were instructed to provide high-quality echocardiograms. In Period 2, the DL guiding was used by the second sonographer. One blinded expert measured LV length in all recordings. Tri-plane recordings by cardiologists were used as reference. Apical foreshortening was calculated at the end-diastole. Both sonographer groups significantly foreshortened the LV in Period 1 (mean foreshortening: Sonographer 1: 4 mm; Sonographer 2: 3 mm, both P < 0.001 vs. reference) and reduced foreshortening in Period 2 (2 and 0 mm, respectively. Period 1 vs. Period 2, P < 0.05). Sonographers using DL guiding did not foreshorten more than cardiologists (P ≥ 0.409). Real-time guiding did not improve intra-class correlation (ICC) [LV end-diastolic volume ICC, (95% confidence interval): DL guiding 0.87 (0.77-0.93) vs. no guiding 0.92 (0.88-0.95)].

Conclusion

Real-time guiding reduced foreshortening among experienced operators and has the potential to improve image standardization. Even though the effect on inter-operator variability was minimal among experienced users, real-time guiding may improve test-retest variability among less experienced users.

Clinical trial registration

ClinicalTrials.gov, Identifier: NCT04580095.

Artificial intelligence to estimate the tear film breakup time and diagnose dry eye disease

The use of artificial intelligence (AI) in the diagnosis of dry eye disease (DED) remains limited due to the lack of standardized image formats and analysis models. To overcome these issues, we used the Smart Eye Camera (SEC), a video-recordable slit-lamp device, and collected videos of the anterior segment of the eye. This study aimed to evaluate the accuracy of the AI algorithm in estimating the tear film breakup time and apply this model for the diagnosis of DED according to the Asia Dry Eye Society (ADES) DED diagnostic criteria. Using the retrospectively corrected DED videos of 158 eyes from 79 patients, 22,172 frames were annotated by the DED specialist to label whether or not the frame had breakup. The AI algorithm was developed using the training dataset and machine learning. The DED criteria of the ADES was used to determine the diagnostic performance. The accuracy of tear film breakup time estimation was 0.789 (95% confidence interval (CI) 0.769-0.809), and the area under the receiver operating characteristic curve of this AI model was 0.877 (95% CI 0.861-0.893). The sensitivity and specificity of this AI model for the diagnosis of DED was 0.778 (95% CI 0.572-0.912) and 0.857 (95% CI 0.564-0.866), respectively. We successfully developed a novel AI-based diagnostic model for DED. Our diagnostic model has the potential to enable ophthalmology examination outside hospitals and clinics.

Assisted probe guidance in cardiac ultrasound: A review

Echocardiography is the most frequently used imaging modality in cardiology. However, its acquisition is affected by inter-observer variability and largely dependent on the operator's experience. In this context, artificial intelligence techniques could reduce these variabilities and provide a user independent system. In recent years, machine learning (ML) algorithms have been used in echocardiography to automate echocardiographic acquisition. This review focuses on the state-of-the-art studies that use ML to automate tasks regarding the acquisition of echocardiograms, including quality assessment (QA), recognition of cardiac views and assisted probe guidance during the scanning process. The results indicate that performance of automated acquisition was overall good, but most studies lack variability in their datasets. From our comprehensive review, we believe automated acquisition has the potential not only to improve accuracy of diagnosis, but also help novice operators build expertise and facilitate point of care healthcare in medically underserved areas.

Artificial Intelligence in Congenital Heart Disease: Current State and Prospects

The current era of big data offers a wealth of new opportunities for clinicians to leverage artificial intelligence to optimize care for pediatric and adult patients with a congenital heart disease. At present, there is a significant underutilization of artificial intelligence in the clinical setting for the diagnosis, prognosis, and management of congenital heart disease patients. This document is a call to action and will describe the current state of artificial intelligence in congenital heart disease, review challenges, discuss opportunities, and focus on the top priorities of artificial intelligence-based deployment in congenital heart disease.

Three-Dimensional Echocardiographic Deconstruction: Feasibility of Clinical Evaluation from Two-Dimensional Views Derived from a Three-Dimensional Data Set

BACKGROUND

Three-dimensional echocardiography (3DE) makes it possible to capture the entire heart in a single data set that theoretically could be used to extract any two-dimensional (2D) views and potentially replace the standard practice of serial 2D acquisitions. The aim of this study was to test the hypothesis that the quality of 3DE-derived 2D images is sufficient to allow the visualization of the left ventricular (LV), right ventricular (RV), and left atrial (LA) endocardium, on par with images from conventional two-dimensional echocardiography (2DE), and potentially more accurate quantification of chamber size and function.

METHODS

First, the investigators prospectively studied 36 patients who underwent 2DE in 14 standard views, and full-volume data sets from 3DE, from which the same views were extracted offline. The ability to visualize the LV endocardium, RV free wall, and LA endocardium was scored. LV linear dimensions, LV volumes, and LV ejection fraction (LVEF), LA volume, and RV basal dimension were measured and compared between both types of images. Thereafter, 40 patients who underwent 2DE, 3DE, and cardiac magnetic resonance (CMR) imaging on the same day were retrospectively studied. LV volumes and LVEF derived from 2DE and 3DE were compared side by side against the CMR reference.

RESULTS

Intertechnique agreement in visualization scores was 87% for LV segments, 86% for the RV free wall, and 83% for the LA endocardium. The correlations between 2DE- and 3DE-derived measurements were 0.95, 0.97, and 0.97 for LV volumes and LVEF, respectively, and 0.88 for RV basal dimension. Three-dimensional echocardiography-derived measurements of LV volumes and LVEF were more similar to those on CMR than those obtained on conventional 2DE.

CONCLUSIONS

The feasibility of segmental assessment of cardiac chambers using 3DE-derived 2D views is similar to that using conventional 2DE. This approach provides similar quantitative information, including more accurate LV volumes and LVEF measurements compared with CMR, and thus promises to significantly shorten the duration of the echocardiographic examination.

Artificial intelligence applied to cardiovascular imaging, a critical focus on echocardiography: The point-of-view from "the other side of the coin"

Cardiovascular imaging has achieved a crucial role in the management of cardiovascular diseases. In this field, echocardiography advantages include wide availability, portability, and affordability, at a relatively low cost. However, echocardiographic assessment requires highly trained operators, and implies high observer variability, as compared with the other cardiac imaging modalities. Hence, artificial intelligence might be extremely helpful. From the point-of-view of the peripheral "Spoke" Hospital potential user ("the other side of the coin"), artificial intelligence development appears very slow in the clinical arena. Many limitations are still present, and require full involvement, cooperation, and coordination of professional operators into Hub-and-Spoke network.

Fully automated quantification of cardiac chamber and function assessment in 2-D echocardiography: clinical feasibility of deep learning-based algorithms

We aimed to compare the segmentation performance of the current prominent deep learning (DL) algorithms with ground-truth segmentations and to validate the reproducibility of the manually created 2D echocardiographic four cardiac chamber ground-truth annotation. Recently emerged DL based fully-automated chamber segmentation and function assessment methods have shown great potential for future application in aiding image acquisition, quantification, and suggestion for diagnosis. However, the performance of current DL algorithms have not previously been compared with each other. In addition, the reproducibility of ground-truth annotations which are the basis of these algorithms have not yet been fully validated. We retrospectively enrolled 500 consecutive patients who underwent transthoracic echocardiogram (TTE) from December 2019 to December 2020. Simple U-net, Res-U-net, and Dense-U-net algorithms were compared for the segmentation performances and clinical indices such as left atrial volume (LAV), left ventricular end diastolic volume (LVEDV), left ventricular end systolic volume (LVESV), LV mass, and ejection fraction (EF) were evaluated. The inter- and intra-observer variability analysis was performed by two expert sonographers for a randomly selected echocardiographic view in 100 patients (apical 2-chamber, apical 4-chamber, and parasternal short axis views). The overall performance of all DL methods was excellent [average dice similarity coefficient (DSC) 0.91 to 0.95 and average Intersection over union (IOU) 0.83 to 0.90], with the exception of LV wall area on PSAX view (average DSC of 0.83, IOU 0.72). In addition, there were no significant difference in clinical indices between ground truth and automated DL measurements. For inter- and intra-observer variability analysis, the overall intra observer reproducibility was excellent: LAV (ICC = 0.995), LVEDV (ICC = 0.996), LVESV (ICC = 0.997), LV mass (ICC = 0.991) and EF (ICC = 0.984). The inter-observer reproducibility was slightly lower as compared to intraobserver agreement: LAV (ICC = 0.976), LVEDV (ICC = 0.982), LVESV (ICC = 0.970), LV mass (ICC = 0.971), and EF (ICC = 0.899). The three current prominent DL-based fully automated methods are able to reliably perform four-chamber segmentation and quantification of clinical indices. Furthermore, we were able to validate the four cardiac chamber ground-truth annotation and demonstrate an overall excellent reproducibility, but still with some degree of inter-observer variability.

Using deep learning method to identify left ventricular hypertrophy on echocardiography

BACKGROUND

Left ventricular hypertrophy (LVH) is an independent prognostic factor for cardiovascular events and it can be detected by echocardiography in the early stage. In this study, we aim to develop a semi-automatic diagnostic network based on deep learning algorithms to detect LVH.

METHODS

We retrospectively collected 1610 transthoracic echocardiograms, included 724 patients [189 hypertensive heart disease (HHD), 218 hypertrophic cardiomyopathy (HCM), and 58 cardiac amyloidosis (CA), along with 259 controls]. The diagnosis of LVH was defined by two experienced clinicians. For the deep learning architecture, we introduced ResNet and U-net++ to complete classification and segmentation tasks respectively. The models were trained and validated independently. Then, we connected the best-performing models to form the final framework and tested its capabilities.

RESULTS

In terms of individual networks, the view classification model produced AUC = 1.0. The AUC of the LVH detection model was 0.98 (95% CI 0.94-0.99), with corresponding sensitivity and specificity of 94.0% (95% CI 85.3-98.7%) and 91.6% (95% CI 84.6-96.1%) respectively. For etiology identification, the independent model yielded good results with AUC = 0.90 (95% CI 0.82-0.95) for HCM, AUC = 0.94 (95% CI 0.88-0.98) for CA, and AUC = 0.88 (95% CI 0.80-0.93) for HHD. Finally, our final integrated framework automatically classified four conditions (Normal, HCM, CA, and HHD), which achieved an average of AUC 0.91, with an average sensitivity and specificity of 83.7% and 90.0%.

CONCLUSION

Deep learning architecture has the ability to detect LVH and even distinguish the latent etiology of LVH.

The Use of Artificial Intelligence in Automation in the Fields of Gynaecology and Obstetrics - an Assessment of the State of Play

The long-awaited progress in digitalisation is generating huge amounts of medical data every day, and manual analysis and targeted, patient-oriented evaluation of this data is becoming increasingly difficult or even infeasible. This state of affairs and the associated, increasingly complex requirements for individualised precision medicine underline the need for modern software solutions and algorithms across the entire healthcare system. The utilisation of state-of-the-art equipment and techniques in almost all areas of medicine over the past few years has now indeed enabled automation processes to enter - at least in part - into routine clinical practice. Such systems utilise a wide variety of artificial intelligence (AI) techniques, the majority of which have been developed to optimise medical image reconstruction, noise reduction, quality assurance, triage, segmentation, computer-aided detection and classification and, as an emerging field of research, radiogenomics. Tasks handled by AI are completed significantly faster and more precisely, clearly demonstrated by now in the annual findings of the ImageNet Large-Scale Visual Recognition Challenge (ILSVCR), first conducted in 2015, with error rates well below those of humans. This review article will discuss the potential capabilities and currently available applications of AI in gynaecological-obstetric diagnostics. The article will focus, in particular, on automated techniques in prenatal sonographic diagnostics.

Artificial Intelligence Based Multimodality Imaging: A New Frontier in Coronary Artery Disease Management

Coronary artery disease (CAD) represents one of the most important causes of death around the world. Multimodality imaging plays a fundamental role in both diagnosis and risk stratification of acute and chronic CAD. For example, the role of Coronary Computed Tomography Angiography (CCTA) has become increasingly important to rule out CAD according to the latest guidelines. These changes and others will likely increase the request for appropriate imaging tests in the future. In this setting, artificial intelligence (AI) will play a pivotal role in echocardiography, CCTA, cardiac magnetic resonance and nuclear imaging, making multimodality imaging more efficient and reliable for clinicians, as well as more sustainable for healthcare systems. Furthermore, AI can assist clinicians in identifying early predictors of adverse outcome that human eyes cannot see in the fog of “big data.” AI algorithms applied to multimodality imaging will play a fundamental role in the management of patients with suspected or established CAD. This study aims to provide a comprehensive overview of current and future AI applications to the field of multimodality imaging of ischemic heart disease.

Machine Learning and Precision Medicine in Emergency Medicine: The Basics

As machine learning (ML) and precision medicine become more readily available and used in practice, emergency physicians must understand the potential advantages and limitations of the technology. This narrative review focuses on the key components of machine learning, artificial intelligence, and precision medicine in emergency medicine (EM). Based on the content expertise, we identified articles from EM literature. The authors provided a narrative summary of each piece of literature. Next, the authors provided an introduction of the concepts of ML, artificial intelligence as an extension of ML, and precision medicine. This was followed by concrete examples of their applications in practice and research. Subsequently, we shared our thoughts on how to consume the existing research in these subjects and conduct high-quality research for academic emergency medicine. We foresee that the EM community will continue to adapt machine learning, artificial intelligence, and precision medicine in research and practice. We described several key components using our expertise.

How to standardize the measurement of left ventricular ejection fraction

Despite recent advances in imaging for myocardial deformation, left ventricular ejection fraction (LVEF) is still the most important index for systolic function in daily practice. Its role in multiple fields (e.g., valvular heart disease, myocardial infarction, cancer therapy-related cardiac dysfunction) has been a mainstay in guidelines. In addition, assessment of LVEF is vital to clinical decision-making in patients with heart failure. However, notable limitations to LVEF include poor inter-observer reproducibility dependent on observer skill, poor acoustic windows, and variations in measurement techniques. To solve these problems, methods for standardization of LVEF by sharing reference images among observers and artificial intelligence for accurate measurements have been developed. In this review, we focus on the standardization of LVEF using reference images and automated LVEF using artificial intelligence.

Artificial Intelligence and Echocardiography

Artificial intelligence (AI) is evolving in the field of diagnostic medical imaging, including echocardiography. Although the dynamic nature of echocardiography presents challenges beyond those of static images from X-ray, computed tomography, magnetic resonance, and radioisotope imaging, AI has influenced all steps of echocardiography, from image acquisition to automatic measurement and interpretation. Considering that echocardiography often is affected by inter-observer variability and shows a strong dependence on the level of experience, AI could be extremely advantageous in minimizing observer variation and providing reproducible measures, enabling accurate diagnosis. Currently, most reported AI applications in echocardiographic measurement have focused on improved image acquisition and automation of repetitive and tedious tasks; however, the role of AI applications should not be limited to conventional processes. Rather, AI could provide clinically important insights from subtle and non-specific data, such as changes in myocardial texture in patients with myocardial disease. Recent initiatives to develop large echocardiographic databases can facilitate development of AI applications. The ultimate goal of applying AI to echocardiography is automation of the entire process of echocardiogram analysis. Once automatic analysis becomes reliable, workflows in clinical echocardiographic will change radically. The human expert will remain the master controlling the overall diagnostic process, will not be replaced by AI, and will obtain significant support from AI systems to guide acquisition, perform measurements, and integrate and compare data on request.

There is No Substitute for Human Intelligence

How to cite this article: Kumar V. There is No Substitute for Human Intelligence. Indian J Crit Care Med 2021;25(5):486-488.

Routine Echocardiography and Artificial Intelligence Solutions

Introduction: Echocardiography is widely used because of its portability, high temporal resolution, absence of radiation, and due to the low-costs. Over the past years, echocardiography has been recommended by the European Society of Cardiology in most cardiac diseases for both diagnostic and prognostic purposes. These recommendations have led to an increase in number of performed studies each requiring diligent processing and reviewing. The standard work pattern of image analysis including quantification and reporting has become highly resource intensive and time consuming. Existence of a large number of datasets with digital echocardiography images and recent advent of AI technology have created an environment in which artificial intelligence (AI) solutions can be developed successfully to automate current manual workflow. Methods and Results: We report on published AI solutions for echocardiography analysis on methods' performance, characteristics of the used data and imaged population. Contemporary AI applications are available for automation and advent in the image acquisition, analysis, reporting and education. AI solutions have been developed for both diagnostic and predictive tasks in echocardiography. Left ventricular function assessment and quantification have been most often performed. Performance of automated image view classification, image quality enhancement, cardiac function assessment, disease classification, and cardiac event prediction was overall good but most studies lack external evaluation. Conclusion: Contemporary AI solutions for image acquisition, analysis, reporting and education are developed for relevant tasks with promising performance. In the future major benefit of AI in echocardiography is expected from improvements in automated analysis and interpretation to reduce workload and improve clinical outcome. Some of the challenges have yet to be overcome, however, none of them are insurmountable.