Improving explainability of deep neural network-based electrocardiogram interpretation using variational auto-encoders. Eur Heart J Digit Health 2022;3:390-404. [PMID: 36712164 PMCID: PMC9707974 DOI: 10.1093/ehjdh/ztac038]

Delineation of 12-Lead ECG Representative Beats Using Convolutional Encoder-Decoders with Residual and Recurrent Connections

The aim of this study is to address the challenge of 12-lead ECG delineation by different encoder-decoder architectures of deep neural networks (DNNs). This study compares four concepts for encoder-decoders based on a fully convolutional architecture (CED-Net) and its modifications with a recurrent layer (CED-LSTM-Net), residual connections between symmetrical encoder and decoder feature maps (CED-U-Net), and sequential residual blocks (CED-Res-Net). All DNNs transform 12-lead representative beats to three diagnostic ECG intervals (P-wave, QRS-complex, QT-interval) used for the global delineation of the representative beat (P-onset, P-offset, QRS-onset, QRS-offset, T-offset). All DNNs were trained and optimized using the large PhysioNet ECG database (PTB-XL) under identical conditions, applying an advanced approach for machine-based supervised learning with a reference algorithm for ECG delineation (ETM, Schiller AG, Baar, Switzerland). The test results indicate that all DNN architectures are equally capable of reproducing the reference delineation algorithm's measurements in the diagnostic PTB database with an average P-wave detection accuracy (96.6%) and time and duration errors: mean values (-2.6 to 2.4 ms) and standard deviations (2.9 to 11.4 ms). The validation according to the standard-based evaluation practices of diagnostic electrocardiographs with the CSE database outlines a CED-Net model, which measures P-duration (2.6 ± 11.0 ms), PQ-interval (0.9 ± 5.8 ms), QRS-duration (-2.4 ± 5.4 ms), and QT-interval (-0.7 ± 10.3 ms), which meet all standard tolerances. Noise tests with high-frequency, low-frequency, and power-line frequency noise (50/60 Hz) confirm that CED-Net, CED-Res-Net, and CED-LSTM-Net are robust to all types of noise, mostly presenting a mean duration error < 2.5 ms when compared to measurements without noise. Reduced noise immunity is observed for the U-net architecture. Comparative analysis with other published studies scores this research within the lower range of time errors, highlighting its competitive performance.

ECG-only explainable deep learning algorithm predicts the risk for malignant ventricular arrhythmia in phospholamban cardiomyopathy

BACKGROUND

Phospholamban (PLN) p.(Arg14del) variant carriers are at risk for development of malignant ventricular arrhythmia (MVA). Accurate risk stratification allows timely implantation of intracardiac defibrillators and is currently performed with a multimodality prediction model.

OBJECTIVE

This study aimed to investigate whether an explainable deep learning-based approach allows risk prediction with only electrocardiogram (ECG) data.

METHODS

A total of 679 PLN p.(Arg14del) carriers without MVA at baseline were identified. A deep learning-based variational auto-encoder, trained on 1.1 million ECGs, was used to convert the 12-lead baseline ECG into its FactorECG, a compressed version of the ECG that summarizes it into 32 explainable factors. Prediction models were developed by Cox regression.

RESULTS

The deep learning-based ECG-only approach was able to predict MVA with a C statistic of 0.79 (95% CI, 0.76-0.83), comparable to the current prediction model (C statistic, 0.83 [95% CI, 0.79-0.88]; P = .054) and outperforming a model based on conventional ECG parameters (low-voltage ECG and negative T waves; C statistic, 0.65 [95% CI, 0.58-0.73]; P < .001). Clinical simulations showed that a 2-step approach, with ECG-only screening followed by a full workup, resulted in 60% less additional diagnostics while outperforming the multimodal prediction model in all patients. A visualization tool was created to provide interactive visualizations (https://pln.ecgx.ai).

CONCLUSION

Our deep learning-based algorithm based on ECG data only accurately predicts the occurrence of MVA in PLN p.(Arg14del) carriers, enabling more efficient stratification of patients who need additional diagnostic testing and follow-up.

Artificial intelligence-enhanced electrocardiography derived body mass index as a predictor of future cardiometabolic disease

The electrocardiogram (ECG) can capture obesity-related cardiac changes. Artificial intelligence-enhanced ECG (AI-ECG) can identify subclinical disease. We trained an AI-ECG model to predict body mass index (BMI) from the ECG alone. Developed from 512,950 12-lead ECGs from the Beth Israel Deaconess Medical Center (BIDMC), a secondary care cohort, and validated on UK Biobank (UKB) (n = 42,386), the model achieved a Pearson correlation coefficient (r) of 0.65 and 0.62, and an R2 of 0.43 and 0.39 in the BIDMC cohort and UK Biobank, respectively for AI-ECG BMI vs. measured BMI. We found delta-BMI, the difference between measured BMI and AI-ECG-predicted BMI (AI-ECG-BMI), to be a biomarker of cardiometabolic health. The top tertile of delta-BMI showed increased risk of future cardiometabolic disease (BIDMC: HR 1.15, p < 0.001; UKB: HR 1.58, p < 0.001) and diabetes mellitus (BIDMC: HR 1.25, p < 0.001; UKB: HR 2.28, p < 0.001) after adjusting for covariates including measured BMI. Significant enhancements in model fit, reclassification and improvements in discriminatory power were observed with the inclusion of delta-BMI in both cohorts. Phenotypic profiling highlighted associations between delta-BMI and cardiometabolic diseases, anthropometric measures of truncal obesity, and pericardial fat mass. Metabolic and proteomic profiling associates delta-BMI positively with valine, lipids in small HDL, syntaxin-3, and carnosine dipeptidase 1, and inversely with glutamine, glycine, colipase, and adiponectin. A genome-wide association study revealed associations with regulators of cardiovascular/metabolic traits, including SCN10A, SCN5A, EXOG and RXRG. In summary, our AI-ECG-BMI model accurately predicts BMI and introduces delta-BMI as a non-invasive biomarker for cardiometabolic risk stratification.

Artificial Intelligence Interpretation of the Electrocardiogram: A State-of-the-Art Review

PURPOSE OF REVIEW

Artificial intelligence (AI) is transforming electrocardiography (ECG) interpretation. AI diagnostics can reach beyond human capabilities, facilitate automated access to nuanced ECG interpretation, and expand the scope of cardiovascular screening in the population. AI can be applied to the standard 12-lead resting ECG and single-lead ECGs in external monitors, implantable devices, and direct-to-consumer smart devices. We summarize the current state of the literature on AI-ECG.

RECENT FINDINGS

Rhythm classification was the first application of AI-ECG. Subsequently, AI-ECG models have been developed for screening structural heart disease including hypertrophic cardiomyopathy, cardiac amyloidosis, aortic stenosis, pulmonary hypertension, and left ventricular systolic dysfunction. Further, AI models can predict future events like development of systolic heart failure and atrial fibrillation. AI-ECG exhibits potential in acute cardiac events and non-cardiac applications, including acute pulmonary embolism, electrolyte abnormalities, monitoring drugs therapy, sleep apnea, and predicting all-cause mortality. Many AI models in the domain of cardiac monitors and smart watches have received Food and Drug Administration (FDA) clearance for rhythm classification, while others for identification of cardiac amyloidosis, pulmonary hypertension and left ventricular dysfunction have received breakthrough device designation. As AI-ECG models continue to be developed, in addition to regulatory oversight and monetization challenges, thoughtful clinical implementation to streamline workflows, avoiding information overload and overwhelming of healthcare systems with false positive results is necessary. Research to demonstrate and validate improvement in healthcare efficiency and improved patient outcomes would be required before widespread adoption of any AI-ECG model.

An Explainable Artificial Intelligence-enabled ECG Framework for the Prediction of Subclinical Coronary Atherosclerosis

Coronary artery calcium (CAC) as assessed by computed tomography (CT) is a marker of subclinical coronary atherosclerosis. However, routine application of CAC scoring via CT is limited by high costs and accessibility. An electrocardiogram (ECG) is a widely-used, sensitive, cost-effective, non-invasive, and radiation-free diagnostic tool. Considering this, if artificial intelligence (AI)-enabled electrocardiograms (ECGs) could opportunistically detect CAC, it would be particularly beneficial for the asymptomatic or subclinical populations, acting as an initial screening measure, paving the way for further confirmatory tests and preventive strategies, a step ahead of conventional practices. With this aim, we developed an AI-enabled ECG framework that not only predicts a CAC score ≥400 but also offers a visual explanation of the associated potential morphological ECG changes, and tested its efficacy on individuals undergoing health checkups, a group primarily comprising healthy or subclinical individuals. To ensure broader applicability, we performed external validation at a separate institution.

Longer and better lives for patients with atrial fibrillation: the 9th AFNET/EHRA consensus conference

AIMS

Recent trial data demonstrate beneficial effects of active rhythm management in patients with atrial fibrillation (AF) and support the concept that a low arrhythmia burden is associated with a low risk of AF-related complications. The aim of this document is to summarize the key outcomes of the 9th AFNET/EHRA Consensus Conference of the Atrial Fibrillation NETwork (AFNET) and the European Heart Rhythm Association (EHRA).

METHODS AND RESULTS

Eighty-three international experts met in Münster for 2 days in September 2023. Key findings are as follows: (i) Active rhythm management should be part of the default initial treatment for all suitable patients with AF. (ii) Patients with device-detected AF have a low burden of AF and a low risk of stroke. Anticoagulation prevents some strokes and also increases major but non-lethal bleeding. (iii) More research is needed to improve stroke risk prediction in patients with AF, especially in those with a low AF burden. Biomolecules, genetics, and imaging can support this. (iv) The presence of AF should trigger systematic workup and comprehensive treatment of concomitant cardiovascular conditions. (v) Machine learning algorithms have been used to improve detection or likely development of AF. Cooperation between clinicians and data scientists is needed to leverage the potential of data science applications for patients with AF.

CONCLUSIONS

Patients with AF and a low arrhythmia burden have a lower risk of stroke and other cardiovascular events than those with a high arrhythmia burden. Combining active rhythm control, anticoagulation, rate control, and therapy of concomitant cardiovascular conditions can improve the lives of patients with AF.

Adopting artificial intelligence in cardiovascular medicine: a scoping review

Recent years have witnessed significant transformations in cardiovascular medicine, driven by the rapid evolution of artificial intelligence (AI). This scoping review was conducted to capture the breadth of AI applications within cardiovascular science. Employing a structured approach, we sourced relevant articles from PubMed, with an emphasis on journals encompassing general cardiology and digital medicine. We applied filters to highlight cardiovascular articles published in journals focusing on general internal medicine, cardiology and digital medicine, thereby identifying the prevailing trends in the field. Following a comprehensive full-text screening, a total of 140 studies were identified. Over the preceding 5 years, cardiovascular medicine's interplay with AI has seen an over tenfold augmentation. This expansive growth encompasses multiple cardiovascular subspecialties, including but not limited to, general cardiology, ischemic heart disease, heart failure, and arrhythmia. Deep learning emerged as the predominant methodology. The majority of AI endeavors in this domain have been channeled toward enhancing diagnostic and prognostic capabilities, utilizing resources such as hospital datasets, electrocardiograms, and echocardiography. A significant uptrend was observed in AI's application for omics data analysis. However, a clear gap persists in AI's full-scale integration into the clinical decision-making framework. AI, particularly deep learning, has demonstrated robust applications across cardiovascular subspecialties, indicating its transformative potential in this field. As we continue on this trajectory, ensuring the alignment of technological progress with medical ethics becomes crucial. The abundant digital health data today further accentuates the need for meticulous systematic reviews, tailoring them to each cardiovascular subspecialty.

Artificial intelligence-based identification of left ventricular systolic dysfunction from 12-lead electrocardiograms: external validation and advanced application of an existing model

Aims

The diagnostic application of artificial intelligence (AI)-based models to detect cardiovascular diseases from electrocardiograms (ECGs) evolves, and promising results were reported. However, external validation is not available for all published algorithms. The aim of this study was to validate an existing algorithm for the detection of left ventricular systolic dysfunction (LVSD) from 12-lead ECGs.

Methods and results

Patients with digitalized data pairs of 12-lead ECGs and echocardiography (at intervals of ≤7 days) were retrospectively selected from the Heart Center Leipzig ECG and electronic medical records databases. A previously developed AI-based model was applied to ECGs and calculated probabilities for LVSD. The area under the receiver operating characteristic curve (AUROC) was computed overall and in cohorts stratified for baseline and ECG characteristics. Repeated echocardiography studies recorded ≥3 months after index diagnostics were used for follow-up (FU) analysis. At baseline, 42 291 ECG-echocardiography pairs were analysed, and AUROC for LVSD detection was 0.88. Sensitivity and specificity were 82% and 77% for the optimal LVSD probability cut-off based on Youden's J. AUROCs were lower in ECG subgroups with tachycardia, atrial fibrillation, and wide QRS complexes. In patients without LVSD at baseline and available FU, model-generated high probability for LVSD was associated with a four-fold increased risk of developing LVSD during FU.

Conclusion

We provide the external validation of an existing AI-based ECG-analysing model for the detection of LVSD with robust performance metrics. The association of false positive LVSD screenings at baseline with a deterioration of ventricular function during FU deserves a further evaluation in prospective trials.

Dynamic prediction of malignant ventricular arrhythmias using neural networks in patients with an implantable cardioverter-defibrillator

BACKGROUND

Risk stratification for ventricular arrhythmias currently relies on static measurements that fail to adequately capture dynamic interactions between arrhythmic substrate and triggers over time. We trained and internally validated a dynamic machine learning (ML) model and neural network that extracted features from longitudinally collected electrocardiograms (ECG), and used these to predict the risk of malignant ventricular arrhythmias.

METHODS

A multicentre study in patients implanted with an implantable cardioverter-defibrillator (ICD) between 2007 and 2021 in two academic hospitals was performed. Variational autoencoders (VAEs), which combine neural networks with variational inference principles, and can learn patterns and structure in data without explicit labelling, were trained to encode the mean ECG waveforms from the limb leads into 16 variables. Supervised dynamic ML models using these latent ECG representations and clinical baseline information were trained to predict malignant ventricular arrhythmias treated by the ICD. Model performance was evaluated on a hold-out set, using time-dependent receiver operating characteristic (ROC) and calibration curves.

FINDINGS

2942 patients (61.7 ± 13.9 years, 25.5% female) were included, with a total of 32,129 ECG recordings during a mean follow-up of 43.9 ± 35.9 months. The mean time-varying area under the ROC curve for the dynamic model was 0.738 ± 0.07, compared to 0.639 ± 0.03 for a static (i.e. baseline-only model). Feature analyses indicated dynamic changes in latent ECG representations, particularly those affecting the T-wave morphology, were of highest importance for model predictions.

INTERPRETATION

Dynamic ML models and neural networks effectively leverage routinely collected longitudinal ECG recordings for personalised and updated predictions of malignant ventricular arrhythmias, outperforming static models.

FUNDING

This publication is part of the project DEEP RISK ICD (with project number 452019308) of the research programme Rubicon which is (partly) financed by the Dutch Research Council (NWO). This research is partly funded by the Amsterdam Cardiovascular Sciences (personal grant F.V.Y.T).

Automatic triage of twelve-lead electrocardiograms using deep convolutional neural networks: a first implementation study

Aims

Expert knowledge to correctly interpret electrocardiograms (ECGs) is not always readily available. An artificial intelligence (AI)-based triage algorithm (DELTAnet), able to support physicians in ECG prioritization, could help reduce current logistic burden of overreading ECGs and improve time to treatment for acute and life-threatening disorders. However, the effect of clinical implementation of such AI algorithms is rarely investigated.

Methods and results

Adult patients at non-cardiology departments who underwent ECG testing as a part of routine clinical care were included in this prospective cohort study. DELTAnet was used to classify 12-lead ECGs into one of the following triage classes: normal, abnormal not acute, subacute, and acute. Performance was compared with triage classes based on the final clinical diagnosis. Moreover, the associations between predicted classes and clinical outcomes were investigated. A total of 1061 patients and ECGs were included. Performance was good with a mean concordance statistic of 0.96 (95% confidence interval 0.95-0.97) when comparing DELTAnet with the clinical triage classes. Moreover, zero ECGs that required a change in policy or referral to the cardiologist were missed and there was a limited number of cases predicted as acute that did not require follow-up (2.6%).

Conclusion

This study is the first to prospectively investigate the impact of clinical implementation of an ECG-based AI triage algorithm. It shows that DELTAnet is efficacious and safe to be used in clinical practice for triage of 12-lead ECGs in non-cardiology hospital departments.

Electrocardiogram-based deep learning improves outcome prediction following cardiac resynchronization therapy

AIMS

This study aims to identify and visualize electrocardiogram (ECG) features using an explainable deep learning-based algorithm to predict cardiac resynchronization therapy (CRT) outcome. Its performance is compared with current guideline ECG criteria and QRSAREA.

METHODS AND RESULTS

A deep learning algorithm, trained on 1.1 million ECGs from 251 473 patients, was used to compress the median beat ECG, thereby summarizing most ECG features into only 21 explainable factors (FactorECG). Pre-implantation ECGs of 1306 CRT patients from three academic centres were converted into their respective FactorECG. FactorECG predicted the combined clinical endpoint of death, left ventricular assist device, or heart transplantation [c-statistic 0.69, 95% confidence interval (CI) 0.66-0.72], significantly outperforming QRSAREA and guideline ECG criteria [c-statistic 0.61 (95% CI 0.58-0.64) and 0.57 (95% CI 0.54-0.60), P < 0.001 for both]. The addition of 13 clinical variables was of limited added value for the FactorECG model when compared with QRSAREA (Δ c-statistic 0.03 vs. 0.10). FactorECG identified inferolateral T-wave inversion, smaller right precordial S- and T-wave amplitude, ventricular rate, and increased PR interval and P-wave duration to be important predictors for poor outcome. An online visualization tool was created to provide interactive visualizations (https://crt.ecgx.ai).

CONCLUSION

Requiring only a standard 12-lead ECG, FactorECG held superior discriminative ability for the prediction of clinical outcome when compared with guideline criteria and QRSAREA, without requiring additional clinical variables. End-to-end automated visualization of ECG features allows for an explainable algorithm, which may facilitate rapid uptake of this personalized decision-making tool in CRT.