Cardiac Rhythm Device Identification Using Neural Networks

Enhancing transvenous lead extraction risk prediction: Integrating imaging biomarkers into machine learning models

BACKGROUND

Machine learning (ML) models have been proposed to predict risk related to transvenous lead extraction (TLE).

OBJECTIVE

The purpose of this study was to test whether integrating imaging data into an existing ML model increases its ability to predict major adverse events (MAEs; procedure-related major complications and procedure-related deaths) and lengthy procedures (≥100 minutes).

METHODS

We hypothesized certain features-(1) lead angulation, (2) coil percentage inside the superior vena cava (SVC), and (3) number of overlapping leads in the SVC-detected from a pre-TLE plain anteroposterior chest radiograph (CXR) would improve prediction of MAE and long procedural times. A deep-learning convolutional neural network was developed to automatically detect these CXR features.

RESULTS

A total of 1050 cases were included, with 24 MAEs (2.3%) . The neural network was able to detect (1) heart border with 100% accuracy; (2) coils with 98% accuracy; and (3) acute angle in the right ventricle and SVC with 91% and 70% accuracy, respectively. The following features significantly improved MAE prediction: (1) ≥50% coil within the SVC; (2) ≥2 overlapping leads in the SVC; and (3) acute lead angulation. Balanced accuracy (0.74-0.87), sensitivity (68%-83%), specificity (72%-91%), and area under the curve (AUC) (0.767-0.962) all improved with imaging biomarkers. Prediction of lengthy procedures also improved: balanced accuracy (0.76-0.86), sensitivity (75%-85%), specificity (63%-87%), and AUC (0.684-0.913).

CONCLUSION

Risk prediction tools integrating imaging biomarkers significantly increases the ability of ML models to predict risk of MAE and long procedural time related to TLE.

Role of Machine Learning and Artificial Intelligence in Arrhythmias and Electrophysiology

Machine learning (ML), a subset of artificial intelligence (AI) centered on machines learning from extensive datasets, stands at the forefront of a technological revolution shaping various facets of society. Cardiovascular medicine has emerged as a key domain for ML applications, with considerable efforts to integrate these innovations into routine clinical practice. Within cardiac electrophysiology, ML applications, especially in the automated interpretation of electrocardiograms, have garnered substantial attention in existing literature. However, less recognized are the diverse applications of ML in cardiac electrophysiology and arrhythmias, spanning basic science research on arrhythmia mechanisms, both experimental and computational, as well as contributions to enhanced techniques for mapping cardiac electrical function and translational research related to arrhythmia management. This comprehensive review delves into various ML applications within the scope of this journal, organized into 3 parts. The first section provides a fundamental understanding of general ML principles and methodologies, serving as a foundational resource for readers interested in exploring ML applications in arrhythmia research. The second part offers an in-depth review of studies in arrhythmia and electrophysiology that leverage ML methodologies, showcasing the broad potential of ML approaches. Each subject is thoroughly outlined, accompanied by a review of notable ML research advancements. Finally, the review delves into the primary challenges and future perspectives surrounding ML-driven cardiac electrophysiology and arrhythmias research.

Use of Artificial Intelligence in Improving Outcomes in Heart Disease: A Scientific Statement From the American Heart Association

A major focus of academia, industry, and global governmental agencies is to develop and apply artificial intelligence and other advanced analytical tools to transform health care delivery. The American Heart Association supports the creation of tools and services that would further the science and practice of precision medicine by enabling more precise approaches to cardiovascular and stroke research, prevention, and care of individuals and populations. Nevertheless, several challenges exist, and few artificial intelligence tools have been shown to improve cardiovascular and stroke care sufficiently to be widely adopted. This scientific statement outlines the current state of the art on the use of artificial intelligence algorithms and data science in the diagnosis, classification, and treatment of cardiovascular disease. It also sets out to advance this mission, focusing on how digital tools and, in particular, artificial intelligence may provide clinical and mechanistic insights, address bias in clinical studies, and facilitate education and implementation science to improve cardiovascular and stroke outcomes. Last, a key objective of this scientific statement is to further the field by identifying best practices, gaps, and challenges for interested stakeholders.

The use of low dose CT scouts for MR safety screening: A multi-reader evaluation

INTRODUCTION

Plain film radiographs are recommended to assist in MRI safety screening of patients with unknown medical histories, especially in an emergency setting where patients might be unable to answer a safety questionnaire. This study assesses the performance of CT scout images, which have low radiation dose and are faster and easier to acquire compared to plain film radiographs, in finding and naming a range of head and body implants.

METHODS

A retrospective analysis of 40 CT Head and Neck (HN) scout images and 40 CT Chest, Abdomen and Pelvis (CAP) scout images was undertaken. A subset of these were chosen to include a range of common internal implants not identifiable externally to the patient. The images were assessed by three readers with varying levels of clinical experience in MRI who were asked to find and name any implants seen.

RESULTS

Collectively, all readers reached a sensitivity of 85 % in finding internal implants, regardless of their clinical experience or experience in reviewing CT images, and a minimum specificity of 95 %. Implants were correctly named in 74 % of the images presented.

CONCLUSION

CT scout images were able to reveal most of the implants included. However, clinical experience in reviewing the images enhances a reader's ability to identify the type of implant.

IMPLICATIONS FOR PRACTICE

In an emergency setting, imaging can be critical in the management of patients presenting with acute illnesses. In the unconscious or unresponsive patient, the use of CT scouts, where this is the only option available, could provide valuable MRI safety information prior to a scan, improving access to the MRI scan in a timely manner.

Chest X-ray Foreign Objects Detection Using Artificial Intelligence

Diagnostic imaging has become an integral part of the healthcare system. In recent years, scientists around the world have been working on artificial intelligence-based tools that help in achieving better and faster diagnoses. Their accuracy is crucial for successful treatment, especially for imaging diagnostics. This study used a deep convolutional neural network to detect four categories of objects on digital chest X-ray images. The data were obtained from the publicly available National Institutes of Health (NIH) Chest X-ray (CXR) Dataset. In total, 112,120 CXRs from 30,805 patients were manually checked for foreign objects: vascular port, shoulder endoprosthesis, necklace, and implantable cardioverter-defibrillator (ICD). Then, they were annotated with the use of a computer program, and the necessary image preprocessing was performed, such as resizing, normalization, and cropping. The object detection model was trained using the You Only Look Once v8 architecture and the Ultralytics framework. The results showed not only that the obtained average precision of foreign object detection on the CXR was 0.815 but also that the model can be useful in detecting foreign objects on the CXR images. Models of this type may be used as a tool for specialists, in particular, with the growing popularity of radiology comes an increasing workload. We are optimistic that it could accelerate and facilitate the work to provide a faster diagnosis.

Pre-deployment assessment of an AI model to assist radiologists in chest X-ray detection and identification of lead-less implanted electronic devices for pre-MRI safety screening: realized implementation needs and proposed operational solutions

Purpose

Chest X-ray (CXR) use in pre-MRI safety screening, such as for lead-less implanted electronic device (LLIED) recognition, is common. To assist CXR interpretation, we "pre-deployed" an artificial intelligence (AI) model to assess (1) accuracies in LLIED-type (and consequently safety-level) identification, (2) safety implications of LLIED nondetections or misidentifications, (3) infrastructural or workflow requirements, and (4) demands related to model adaptation to real-world conditions.

Approach

A two-tier cascading methodology for LLIED detection/localization and identification on a frontal CXR was applied to evaluate the performance of the original nine-class AI model. With the unexpected early appearance of LLIED types during simulated real-world trialing, retraining of a newer 12-class version preceded retrialing. A zero footprint (ZF) graphical user interface (GUI)/viewer with DICOM-based output was developed for inference-result display and adjudication, supporting end-user engagement and model continuous learning and/or modernization.

Results

During model testing or trialing using both the nine-class and 12-class models, robust detection/localization was consistently 100%, with mAP 0.99 from fivefold cross-validation. Safety-level categorization was high during both testing ( AUC ≥ 0.98 and ≥ 0.99 , respectively) and trialing (accuracy 98% and 97%, respectively). LLIED-type identifications by the two models during testing (1) were 98.9% and 99.5% overall correct and (2) consistently showed AUC ≥ 0.92 (1.00 for 8/9 and 9/12 LLIED-types, respectively). Pre-deployment trialing of both models demonstrated overall type-identification accuracies of 94.5% and 95%, respectively. Of the small number of misidentifications, none involved MRI-stringently conditional or MRI-unsafe types of LLIEDs. Optimized ZF GUI/viewer operations led to greater user-friendliness for radiologist engagement.

Conclusions

Our LLIED-related AI methodology supports (1) 100% detection sensitivity, (2) high identification (including MRI-safety) accuracy, and (3) future model deployment with facilitated inference-result display and adjudication for ongoing model adaptation to future real-world experiences.

Neural Network Detection of Pacemakers for MRI Safety

Flagging the presence of cardiac devices such as pacemakers before an MRI scan is essential to allow appropriate safety checks. We assess the accuracy with which a machine learning model can classify the presence or absence of a pacemaker on pre-existing chest radiographs. A total of 7973 chest radiographs were collected, 3996 with pacemakers visible and 3977 without. Images were identified from information available on the radiology information system (RIS) and correlated with report text. Manual review of images by two board certified radiologists was performed to ensure correct labeling. The data set was divided into training, validation, and a hold-back test set. The data were used to retrain a pre-trained image classification neural network. Final model performance was assessed on the test set. Accuracy of 99.67% on the test set was achieved. Re-testing the final model on the full training and validation data revealed a few additional misclassified examples which are further analyzed. Neural network image classification could be used to screen for the presence of cardiac devices, in addition to current safety processes, providing notification of device presence in advance of safety questionnaires. Computational power to run the model is low. Further work on misclassified examples could improve accuracy on edge cases. The focus of many healthcare applications of computer vision techniques has been for diagnosis and guiding management. This work illustrates an application of computer vision image classification to enhance current processes and improve patient safety.

Determining Carina and Clavicular Distance-Dependent Positioning of Endotracheal Tube in Critically Ill Patients: An Artificial Intelligence-Based Approach

Early and accurate prediction of endotracheal tube (ETT) location is pivotal for critically ill patients. Automatic and timely detection of faulty ETT locations from chest X-ray images may avert patients' morbidity and mortality. Therefore, we designed convolutional neural network (CNN)-based algorithms to evaluate ETT position appropriateness relative to four detected key points, including tracheal tube end, carina, and left/right clavicular heads on chest radiographs. We estimated distances from the tube end to tracheal carina and the midpoint of clavicular heads. A DenseNet121 encoder transformed images into embedding features, and a CNN-based decoder generated the probability distributions. Based on four sets of tube-to-carina distance-dependent parameters (i.e., (i) 30-70 mm, (ii) 30-60 mm, (iii) 20-60 mm, and (iv) 20-55 mm), corresponding models were generated, and their accuracy was evaluated through the predicted L1 distance to ground-truth coordinates. Based on tube-to-carina and tube-to-clavicle distances, the highest sensitivity, and specificity of 92.85% and 84.62% respectively, were revealed for 20-55 mm. This implies that tube-to-carina distance between 20 and 55 mm is optimal for an AI-based key point appropriateness detection system and is empirically comparable to physicians' consensus.

Big Data in electrophysiology

The quantity of data produced and captured in medicine today is unprecedented. Technological improvements and automation have expanded the traditional statistical methods and enabled the analysis of Big Data. This has permitted the discovery of new associations with a granularity that was previously hidden to human eyes. In the first part of this review, the authors would like to provide an overview of basic Machine Learning (ML) principles and techniques in order to better understand their application in recent publications about cardiac arrhythmias. In the second part, ML-enabled advances in disease detection and diagnosis, outcome prediction, and novel disease characterization in topics like electrocardiography, atrial fibrillation, ventricular arrhythmias, and cardiac devices are presented. Finally, the limitations and challenges of applying ML in clinical practice, such as validation, replication, generalizability, and regulatory issues, are discussed. More carefully designed studies and collaborations are needed for ML to become feasible, trustworthy, accurate, and reproducible and to reach its full potential for patient-oriented precision medicine.

Using Transfer Learning Method to Develop an Artificial Intelligence Assisted Triaging for Endotracheal Tube Position on Chest X-ray

Endotracheal tubes (ETTs) provide a vital connection between the ventilator and patient; however, improper placement can hinder ventilation efficiency or injure the patient. Chest X-ray (CXR) is the most common approach to confirming ETT placement; however, technicians require considerable expertise in the interpretation of CXRs, and formal reports are often delayed. In this study, we developed an artificial intelligence-based triage system to enable the automated assessment of ETT placement in CXRs. Three intensivists performed a review of 4293 CXRs obtained from 2568 ICU patients. The CXRs were labeled "CORRECT" or "INCORRECT" in accordance with ETT placement. A region of interest (ROI) was also cropped out, including the bilateral head of the clavicle, the carina, and the tip of the ETT. Transfer learning was used to train four pre-trained models (VGG16, INCEPTION_V3, RESNET, and DENSENET169) and two models developed in the current study (VGG16_Tensor Projection Layer and CNN_Tensor Projection Layer) with the aim of differentiating the placement of ETTs. Only VGG16 based on ROI images presented acceptable performance (AUROC = 92%, F1 score = 0.87). The results obtained in this study demonstrate the feasibility of using the transfer learning method in the development of AI models by which to assess the placement of ETTs in CXRs.

Knee Implant Identification by Fine-Tuning Deep Learning Models

BACKGROUND

Identification of implant model from primary knee arthroplasty in pre-op planning of revision surgery is a challenging task with added delay. The direct impact of this inability to identify the implants in time leads to the increase in complexity in surgery. Deep learning in the medical field for diagnosis has shown promising results in getting better with every iteration. This study aims to find an optimal solution for the problem of identification of make and model of knee arthroplasty prosthesis using automated deep learning models.

METHODS

Deep learning algorithms were used to classify knee arthroplasty implant models. The training, validation and test comprised of 1078 radiographs with a total of 6 knee arthroplasty implant models with anterior-posterior (AP) and lateral views. The performance of the model was calculated using accuracy, sensitivity, and area under the receiver-operating characteristic curve (AUC), which were compared against multiple models trained for comparative in-depth analysis with saliency maps for visualization.

RESULTS

After training for a total of 30 epochs on all 6 models, the model performing the best obtained an accuracy of 96.38%, the sensitivity of 97.2% and AUC of 0.985 on an external testing dataset consisting of 162 radiographs. The best performing model correctly and uniquely identified the implants which could be visualized using saliency maps.

CONCLUSION

Deep learning models can be used to differentiate between 6 knee arthroplasty implant models. Saliency maps give us a better understanding of which regions the model is focusing on while predicting the results.

Comparing sensitivity and specificity of pacemaker ID application and cardiac rhythm management device-finder application in identifying cardiac implantable electronic device manufacturer using chest radiograph - An observational study

Background

Smartphone-based applications to identify cardiac implantable electronic devices (CIED) are extremely useful in circumstances, where urgent device interrogation is needed, and a device identification card is not available. Few studies have provided insights regarding the utility of these applications. We have studied two widely available applications i.e., Pacemaker ID app (PMIDa) or Cardiac Rhythm Management Device-Finder (CRMD-f) to identify device manufacturers in CIEDs.

Methods

547 patients who underwent CIED implantation from the year 2016-2020 in our institute were enrolled. There were 438 Medtronic and 109 St. Jude's devices. All chest radiographs were de-identified and resized into 225*225 pixels focusing on the CIED. PMIDa and CRMD-f applications were used to identify the CIED. Accuracy, sensitivity, specificity, negative predictive value, and positive predictive value for both applications were calculated and compared.

Results

Overall, CRMD-f application has higher specificity (93.58 vs. 82.5%) but lower sensitivity (53.6 vs. 55%) than PMIDa. The accuracy of both applications was comparable (61.6% vs. 60.5%). Accuracy varied with CIED model and type tested, and radiograph projection used. Accuracy is greatest with Cardiac-Resynchronization-Therapy (CRT) devices for both applications, followed by a single lead pacemaker.

Conclusion

CRMD-f has higher accuracy and specificity for CIED manufacturer identification. Both PMIDa and CRMD-f are specific tools to identify CIED but have low sensitivity.

Deep Learning-Based Algorithm for the Detection and Characterization of MRI Safety of Cardiac Implantable Electronic Devices on Chest Radiographs

Objective

With the recent development of various MRI-conditional cardiac implantable electronic devices (CIEDs), the accurate identification and characterization of CIEDs have become critical when performing MRI in patients with CIEDs. We aimed to develop and evaluate a deep learning-based algorithm (DLA) that performs the detection and characterization of parameters, including MRI safety, of CIEDs on chest radiograph (CR) in a single step and compare its performance with other related algorithms that were recently developed.

Materials and Methods

We developed a DLA (X-ray CIED identification [XCID]) using 9912 CRs of 958 patients with 968 CIEDs comprising 26 model groups from 4 manufacturers obtained between 2014 and 2019 from one hospital. The performance of XCID was tested with an external dataset consisting of 2122 CRs obtained from a different hospital and compared with the performance of two other related algorithms recently reported, including PacemakerID (PID) and Pacemaker identification with neural networks (PPMnn).

Results

The overall accuracies of XCID for the manufacturer classification, model group identification, and MRI safety characterization using the internal test dataset were 99.7% (992/995), 97.2% (967/995), and 98.9% (984/995), respectively. These were 95.8% (2033/2122), 85.4% (1813/2122), and 92.2% (1956/2122), respectively, with the external test dataset. In the comparative study, the accuracy for the manufacturer classification was 95.0% (152/160) for XCID and 91.3% for PPMnn (146/160), which was significantly higher than that for PID (80.0%,128/160; p < 0.001 for both). XCID demonstrated a higher accuracy (88.1%; 141/160) than PPMnn (80.0%; 128/160) in identifying model groups (p < 0.001).

Conclusion

The remarkable and consistent performance of XCID suggests its applicability for detection, manufacturer and model identification, as well as MRI safety characterization of CIED on CRs. Further studies are warranted to guarantee the safe use of XCID in clinical practice.

Artificial intelligence in the diagnosis and management of arrhythmias

The field of cardiac electrophysiology (EP) had adopted simple artificial intelligence (AI) methodologies for decades. Recent renewed interest in deep learning techniques has opened new frontiers in electrocardiography analysis including signature identification of diseased states. Artificial intelligence advances coupled with simultaneous rapid growth in computational power, sensor technology, and availability of web-based platforms have seen the rapid growth of AI-aided applications and big data research. Changing lifestyles with an expansion of the concept of internet of things and advancements in telecommunication technology have opened doors to population-based detection of atrial fibrillation in ways, which were previously unimaginable. Artificial intelligence-aided advances in 3D cardiac imaging heralded the concept of virtual hearts and the simulation of cardiac arrhythmias. Robotics, completely non-invasive ablation therapy, and the concept of extended realities show promise to revolutionize the future of EP. In this review, we discuss the impact of AI and recent technological advances in all aspects of arrhythmia care.

Analysis of Potential for User Errors in Mobile Deployment of Radiology Deep Learning for Cardiac Rhythm Device Detection

We examine how convolutional neural networks (CNNs) for cardiac rhythm device detection can exhibit failures in performance under suboptimal deployment scenarios and examine how medically adversarial image presentation can further impair neural network performance. We validated the publicly available Pacemaker-ID web server and mobile app on 43 local hospital emergency department (ED) cases of patients presenting with a cardiac rhythm device on anterior-posterior (AP) chest radiograph and assessed performance using Cohen's kappa coefficient for inter-rater reliability. To illustrate adversarial performance concerns, we then produced example CNN models using the 65,379 patient MIMIC-CXR chest radiograph retrospective database and evaluated performance with area under the receiver operating characteristic (AUROC). In retrospective review of 43 patients with cardiac rhythm devices on AP chest radiographs during our study period (January 1, 2020 to March 1, 2020), 74.4% (32/43) had device manufacturer information readily available within the electronic medical record. A total of 25.6% of patients (11/43) did not have this information documented in the patient chart and could ostensibly benefit from CNN-based identification of device manufacturer. For patients with known device manufacturer, the Pacemaker-ID prediction was accurate in 87.5% of cases (28/32). Mobile app accuracy varied from 62.5 to 93.75% depending on image capture settings and presentation. Cohen's kappa coefficient varied from 0.448 to 0.897 depending on mobile image capture conditions. For our additional analysis of medically adversarial performance failures with a DenseNet121 trained on MIMIC-CXR images, we showed that an AUROC of 0.9807 ± 0.0051 could be achieved on an example testing dataset while masking a 30% false positive rate in identification of cardiac rhythm devices versus clinically distinct entities such as vagal nerve stimulators. Despite the promise of CNN approaches for cardiac rhythm device analysis on chest radiographs, further study is warranted to assess potential for errors driven by user misuse when deploying these models to mobile devices as well as for cases when performance can be impaired by the presence of other support apparatuses.

A Head-to Head Comparison of Machine Learning Algorithms for Identification of Implanted Cardiac Devices

Application of artificial intelligence techniques in medicine has rapidly expanded in recent years. Two algorithms for identification of cardiac implantable electronic devices using chest radiography were recently developed: The PacemakerID algorithm, available as a mobile phone application (PIDa) and a web platform (PIDw) and The Pacemaker Identification with Neural Networks (PPMnn), available via web platform. In this study, we assessed the relative accuracy of these algorithms. The machine learning algorithms (PIDa, PIDw, PPMnn) were used to predict device manufacturer using chest X-rays for patients with implanted devices. Each prediction was considered correct if predicted certainty was >75%. For comparative purposes, accuracy of each prediction was compared to the result using the CARDIA-X algorithm. 500 X-rays were included from a convenience sample. Raw accuracy was PIDa 89%, PIDw 73%, PPMnn 71% and CARDIA-X 85%. In conclusion, machine learning algorithms for identification of cardiac devices are accurate at determining device manufacturer, have capacity for improved accuracy with additional training sets and can utilize simple user interfaces. These algorithms have clinical utility in limiting potential infectious exposures and facilitate rapid identification of devices as needed for device reprogramming.

Automated Identification of Orthopedic Implants on Radiographs Using Deep Learning

Accurate identification of metallic orthopedic implant design is important for preoperative planning of revision arthroplasty. Surgical records of implant models are frequently unavailable. The aim of this study was to develop and evaluate a convolutional neural network for identifying orthopedic implant models using radiographs. In this retrospective study, 427 knee and 922 hip unilateral anteroposterior radiographs, including 12 implant models from 650 patients, were collated from an orthopedic center between March 2015 and November 2019 to develop classification networks. A total of 198 images paired with autogenerated image masks were used to develop a U-Net segmentation network to automatically zero-mask around the implants on the radiographs. Classification networks processing original radiographs, and two-channel conjoined original and zero-masked radiographs, were ensembled to provide a consensus prediction. Accuracies of five senior orthopedic specialists assisted by a reference radiographic gallery were compared with network accuracy using McNemar exact test. When evaluated on a balanced unseen dataset of 180 radiographs, the final network achieved a 98.9% accuracy (178 of 180) and 100% top-three accuracy (180 of 180). The network performed superiorly to all five specialists (76.1% [137 of 180] median accuracy and 85.6% [154 of 180] best accuracy; both P < .001), with robustness to scan quality variation and difficult to distinguish implants. A neural network model was developed that outperformed senior orthopedic specialists at identifying implant models on radiographs; real-world application can now be readily realized through training on a broader range of implants and joints, supported by all code and radiographs being made freely available. Supplemental material is available for this article. Keywords: Neural Networks, Skeletal-Appendicular, Knee, Hip, Computer Applications-General (Informatics), Prostheses, Technology Assess-ment, Observer Performance © RSNA, 2021.

Image similarity-based cardiac rhythm device identification from X-rays using feature point matching

AIMS

Identifying the manufacturer and the type of cardiac implantable electronic devices (CIEDs) is important in emergent clinical settings. Recent studies have illustrated that artificial neural network models can successfully recognize CIEDs from chest X-ray images. However, all existing methods require a vast amount of medical data to train the classification model. Here, we have proposed a novel method to retrieve an identical CIED image from an image database by employing the feature point matching algorithm.

METHODS AND RESULTS

A total of 653 unique X-ray images from 456 patients who visited our pacemaker clinic between April 2012 and August 2020 were collected. The device images were manually square-shaped, and was thereafter resized to 224 × 224 pixels. A scale-invariant feature transform (SIFT) algorithm was used to extract the keypoints from the query image and reference images. Paired feature points were selected via brute-force matching, and the average Euclidean distance was calculated. The image with the shortest average distance was defined as the most similar image. The classification performance was indicated by accuracy, precision, recall, and F1-score for detecting the manufacturers and model groups, respectively. The average accuracy, precision, recall, and F-1 score for the manufacturer classification were 97.0%, 0.97, 0.96, and 0.96, respectively. For the model classification task, the average accuracy, precision, recall, and F-1 score were 93.2%, 0.94, 0.92, and 0.93, respectively, all of which were higher than those of the previously reported machine learning models.

CONCLUSION

Feature point matching is useful for identifying CIEDs from X-ray images.

Automated analysis and detection of abnormalities in transaxial anatomical cardiovascular magnetic resonance images: a proof of concept study with potential to optimize image acquisition

The large number of available MRI sequences means patients cannot realistically undergo them all, so the range of sequences to be acquired during a scan are protocolled based on clinical details. Adapting this to unexpected findings identified early on in the scan requires experience and vigilance. We investigated whether deep learning of the images acquired in the first few minutes of a scan could provide an automated early alert of abnormal features. Anatomy sequences from 375 CMR scans were used as a training set. From these, we annotated 1500 individual slices and used these to train a convolutional neural network to perform automatic segmentation of the cardiac chambers, great vessels and any pleural effusions. 200 scans were used as a testing set. The system then assembled a 3D model of the thorax from which it made clinical measurements to identify important abnormalities. The system was successful in segmenting the anatomy slices (Dice 0.910) and identified multiple features which may guide further image acquisition. Diagnostic accuracy was 90.5% and 85.5% for left and right ventricular dilatation, 85% for left ventricular hypertrophy and 94.4% for ascending aorta dilatation. The area under ROC curve for diagnosing pleural effusions was 0.91. We present proof-of-concept that a neural network can segment and derive accurate clinical measurements from a 3D model of the thorax made from transaxial anatomy images acquired in the first few minutes of a scan. This early information could lead to dynamic adaptive scanning protocols, and by focusing scanner time appropriately and prioritizing cases for supervision and early reporting, improve patient experience and efficiency.

Machine Learning in Arrhythmia and Electrophysiology

Machine learning (ML), a branch of artificial intelligence, where machines learn from big data, is at the crest of a technological wave of change sweeping society. Cardiovascular medicine is at the forefront of many ML applications, and there is a significant effort to bring them into mainstream clinical practice. In the field of cardiac electrophysiology, ML applications have also seen a rapid growth and popularity, particularly the use of ML in the automatic interpretation of ECGs, which has been extensively covered in the literature. Much lesser known are the other aspects of ML application in cardiac electrophysiology and arrhythmias, such as those in basic science research on arrhythmia mechanisms, both experimental and computational; in the development of better techniques for mapping of cardiac electrical function; and in translational research related to arrhythmia management. In the current review, we examine comprehensively such ML applications as they match the scope of this journal. The current review is organized in 3 parts. The first provides an overview of general ML principles and methodologies that will afford readers of the necessary information on the subject, serving as the foundation for inviting further ML applications in arrhythmia research. The basic information we provide can serve as a guide on how one might design and conduct an ML study. The second part is a review of arrhythmia and electrophysiology studies in which ML has been utilized, highlighting the broad potential of ML approaches. For each subject, we outline comprehensively the general topics, while reviewing some of the research advances utilizing ML under the subject. Finally, we discuss the main challenges and the perspectives for ML-driven cardiac electrophysiology and arrhythmia research.

Machine learning in cardiovascular radiology: ESCR position statement on design requirements, quality assessment, current applications, opportunities, and challenges

Abstract

Machine learning offers great opportunities to streamline and improve clinical care from the perspective of cardiac imagers, patients, and the industry and is a very active scientific research field. In light of these advances, the European Society of Cardiovascular Radiology (ESCR), a non-profit medical society dedicated to advancing cardiovascular radiology, has assembled a position statement regarding the use of machine learning (ML) in cardiovascular imaging. The purpose of this statement is to provide guidance on requirements for successful development and implementation of ML applications in cardiovascular imaging. In particular, recommendations on how to adequately design ML studies and how to report and interpret their results are provided. Finally, we identify opportunities and challenges ahead. While the focus of this position statement is ML development in cardiovascular imaging, most considerations are relevant to ML in radiology in general.

Key Points

• Development and clinical implementation of machine learning in cardiovascular imaging is a multidisciplinary pursuit.

• Based on existing study quality standard frameworks such as SPIRIT and STARD, we propose a list of quality criteria for ML studies in radiology.

• The cardiovascular imaging research community should strive for the compilation of multicenter datasets for the development, evaluation, and benchmarking of ML algorithms.

Supplementary Information

The online version contains supplementary material available at (10.1007/s00330-020-07417-0).

Artificial Intelligence-Enabled ECG Algorithm to Identify Patients With Left Ventricular Systolic Dysfunction Presenting to the Emergency Department With Dyspnea

BACKGROUND

Identification of systolic heart failure among patients presenting to the emergency department (ED) with acute dyspnea is challenging. The reasons for dyspnea are often multifactorial. A focused physical evaluation and diagnostic testing can lack sensitivity and specificity. The objective of this study was to assess the accuracy of an artificial intelligence-enabled ECG to identify patients presenting with dyspnea who have left ventricular systolic dysfunction (LVSD).

METHODS

We retrospectively applied a validated artificial intelligence-enabled ECG algorithm for the identification of LVSD (defined as LV ejection fraction ≤35%) to a cohort of patients aged ≥18 years who were evaluated in the ED at a Mayo Clinic site with dyspnea. Patients were included if they had at least one standard 12-lead ECG acquired on the date of the ED visit and an echocardiogram performed within 30 days of presentation. Patients with prior LVSD were excluded. We assessed the model performance using area under the receiver operating characteristic curve, accuracy, sensitivity, and specificity.

RESULTS

A total of 1606 patients were included. Median time from ECG to echocardiogram was 1 day (Q1: 1, Q3: 2). The artificial intelligence-enabled ECG algorithm identified LVSD with an area under the receiver operating characteristic curve of 0.89 (95% CI, 0.86-0.91) and accuracy of 85.9%. Sensitivity, specificity, negative predictive value, and positive predictive value were 74%, 87%, 97%, and 40%, respectively. To identify an ejection fraction <50%, the area under the receiver operating characteristic curve, accuracy, sensitivity, and specificity were 0.85 (95% CI, 0.83-0.88), 86%, 63%, and 91%, respectively. NT-proBNP (N-terminal pro-B-type natriuretic peptide) alone at a cutoff of >800 identified LVSD with an area under the receiver operating characteristic curve of 0.80 (95% CI, 0.76-0.84).

CONCLUSIONS

The ECG is an inexpensive, ubiquitous, painless test which can be quickly obtained in the ED. It effectively identifies LVSD in selected patients presenting to the ED with dyspnea when analyzed with artificial intelligence and outperforms NT-proBNP. Graphic Abstract: A graphic abstract is available for this article.

Artificial Intelligence and Machine Learning in Arrhythmias and Cardiac Electrophysiology

Artificial intelligence (AI) and machine learning (ML) in medicine are currently areas of intense exploration, showing potential to automate human tasks and even perform tasks beyond human capabilities. Literacy and understanding of AI/ML methods are becoming increasingly important to researchers and clinicians. The first objective of this review is to provide the novice reader with literacy of AI/ML methods and provide a foundation for how one might conduct an ML study. We provide a technical overview of some of the most commonly used terms, techniques, and challenges in AI/ML studies, with reference to recent studies in cardiac electrophysiology to illustrate key points. The second objective of this review is to use examples from recent literature to discuss how AI and ML are changing clinical practice and research in cardiac electrophysiology, with emphasis on disease detection and diagnosis, prediction of patient outcomes, and novel characterization of disease. The final objective is to highlight important considerations and challenges for appropriate validation, adoption, and deployment of AI technologies into clinical practice.

Discriminating electrocardiographic responses to His-bundle pacing using machine learning

BACKGROUND

His-bundle pacing (HBP) has emerged as an alternative to conventional ventricular pacing because of its ability to deliver physiological ventricular activation. Pacing at the His bundle produces different electrocardiographic (ECG) responses: selective His-bundle pacing (S-HBP), non-selective His bundle pacing (NS-HBP), and myocardium-only capture (MOC). These 3 capture types must be distinguished from each other, which can be challenging and time-consuming even for experts.

OBJECTIVE

The purpose of this study was to use artificial intelligence (AI) in the form of supervised machine learning using a convolutional neural network (CNN) to automate HBP ECG interpretation.

METHODS

We identified patients who had undergone HBP and extracted raw 12-lead ECG data during S-HBP, NS-HBP, and MOC. A CNN was trained, using 3-fold cross-validation, on 75% of the segmented QRS complexes labeled with their capture type. The remaining 25% was kept aside as a testing dataset.

RESULTS

The CNN was trained with 1297 QRS complexes from 59 patients. Cohen kappa for the neural network's performance on the 17-patient testing set was 0.59 (95% confidence interval 0.30 to 0.88; P <.0001), with an overall accuracy of 75%. The CNN's accuracy in the 17-patient testing set was 67% for S-HBP, 71% for NS-HBP, and 84% for MOC.

CONCLUSION

We demonstrated proof of concept that a neural network can be trained to automate discrimination between HBP ECG responses. When a larger dataset is trained to higher accuracy, automated AI ECG analysis could facilitate HBP implantation and follow-up and prevent complications resulting from incorrect HBP ECG analysis.

Improving ultrasound video classification: an evaluation of novel deep learning methods in echocardiography

Echocardiography is the commonest medical ultrasound examination, but automated interpretation is challenging and hinges on correct recognition of the 'view' (imaging plane and orientation). Current state-of-the-art methods for identifying the view computationally involve 2-dimensional convolutional neural networks (CNNs), but these merely classify individual frames of a video in isolation, and ignore information describing the movement of structures throughout the cardiac cycle. Here we explore the efficacy of novel CNN architectures, including time-distributed networks and two-stream networks, which are inspired by advances in human action recognition. We demonstrate that these new architectures more than halve the error rate of traditional CNNs from 8.1% to 3.9%. These advances in accuracy may be due to these networks' ability to track the movement of specific structures such as heart valves throughout the cardiac cycle. Finally, we show the accuracies of these new state-of-the-art networks are approaching expert agreement (3.6% discordance), with a similar pattern of discordance between views.

Artificial Intelligence for Cardiac Imaging-Genetics Research

Cardiovascular conditions remain the leading cause of mortality and morbidity worldwide, with genotype being a significant influence on disease risk. Cardiac imaging-genetics aims to identify and characterize the genetic variants that influence functional, physiological, and anatomical phenotypes derived from cardiovascular imaging. High-throughput DNA sequencing and genotyping have greatly accelerated genetic discovery, making variant interpretation one of the key challenges in contemporary clinical genetics. Heterogeneous, low-fidelity phenotyping and difficulties integrating and then analyzing large-scale genetic, imaging and clinical datasets using traditional statistical approaches have impeded process. Artificial intelligence (AI) methods, such as deep learning, are particularly suited to tackle the challenges of scalability and high dimensionality of data and show promise in the field of cardiac imaging-genetics. Here we review the current state of AI as applied to imaging-genetics research and discuss outstanding methodological challenges, as the field moves from pilot studies to mainstream applications, from one dimensional global descriptors to high-resolution models of whole-organ shape and function, from univariate to multivariate analysis and from candidate gene to genome-wide approaches. Finally, we consider the future directions and prospects of AI imaging-genetics for ultimately helping understand the genetic and environmental underpinnings of cardiovascular health and disease.