Novel ECG features and machine learning to optimize culprit lesion detection in patients with suspected acute coronary syndrome

Diagnostic and Prognostic Models Based on Electrocardiograms for Rapid Clinical Applications

Leveraging artificial intelligence (AI) for the analysis of electrocardiograms (ECG) has the potential to transform diagnosis and estimate the prognosis of not only cardiac but, increasingly, non-cardiac conditions. In this review, we summarize clinical studies and AI-enhanced ECG-based clinical applications in the early detection, diagnosis, and estimating prognosis of cardiovascular diseases (CVD) in the last five years (2019-2023). With advancements in deep learning and the rapid increased use of ECG technologies, a large number of clinical studies have been published. However, a majority of these studies are single-center, retrospective, proof-of-concept studies that lack external validation. Prospective studies that progress from development toward deployment in clinical settings account for <15% of the studies. Successful implementations of ECG-based AI applications that have received approval from the Food and Drug Administration (FDA) have been developed through commercial collaborations, with about half of them being for mobile or wearable devices. The field is in its early stages, and overcoming several obstacles is essential, such as prospective validation in multi-center large datasets, addressing technical issues, bias, privacy, data security, model generalizability, and global scalability. This review concludes with a discussion of these challenges and potential solutions. By providing a holistic view of the state of AI in ECG analysis, this review aims to set a foundation for future research directions, emphasizing the need for comprehensive, clinically integrated, and globally deployable AI solutions in CVD management.

Applications and Performance of Machine Learning Algorithms in Emergency Medical Services: A Scoping Review

OBJECTIVE

The aim of this study was to summarize the literature on the applications of machine learning (ML) and their performance in Emergency Medical Services (EMS).

METHODS

Four relevant electronic databases were searched (from inception through January 2024) for all original studies that employed EMS-guided ML algorithms to enhance the clinical and operational performance of EMS. Two reviewers screened the retrieved studies and extracted relevant data from the included studies. The characteristics of included studies, employed ML algorithms, and their performance were quantitively described across primary domains and subdomains.

RESULTS

This review included a total of 164 studies published from 2005 through 2024. Of those, 125 were clinical domain focused and 39 were operational. The characteristics of ML algorithms such as sample size, number and type of input features, and performance varied between and within domains and subdomains of applications. Clinical applications of ML algorithms involved triage or diagnosis classification (n = 62), treatment prediction (n = 12), or clinical outcome prediction (n = 50), mainly for out-of-hospital cardiac arrest/OHCA (n = 62), cardiovascular diseases/CVDs (n = 19), and trauma (n = 24). The performance of these ML algorithms varied, with a median area under the receiver operating characteristic curve (AUC) of 85.6%, accuracy of 88.1%, sensitivity of 86.05%, and specificity of 86.5%. Within the operational studies, the operational task of most ML algorithms was ambulance allocation (n = 21), followed by ambulance detection (n = 5), ambulance deployment (n = 5), route optimization (n = 5), and quality assurance (n = 3). The performance of all operational ML algorithms varied and had a median AUC of 96.1%, accuracy of 90.0%, sensitivity of 94.4%, and specificity of 87.7%. Generally, neural network and ensemble algorithms, to some degree, out-performed other ML algorithms.

CONCLUSION

Triaging and managing different prehospital medical conditions and augmenting ambulance performance can be improved by ML algorithms. Future reports should focus on a specific clinical condition or operational task to improve the precision of the performance metrics of ML models.

Electrocardiogram Interpretation Using Artificial Intelligence: Diagnosis of Cardiac and Extracardiac Pathologic Conditions. How Far Has Machine Learning Reached?

Artificial intelligence (AI) is already widely used in different fields of medicine, making possible the integration of the paraclinical exams with the clinical findings in patients, for a more accurate and rapid diagnosis and treatment decision. The electrocardiogram remains one of the most important, fastest, cheapest, and noninvasive methods of diagnosis in cardiology, despite the rapid development and progression of the technology. Even if studied a long time ago, it still has a lot of less understood features that, with a better understanding, can give more clues to a correct and prompt diagnosis in a short time. The use of AI in the interpretation of the ECG improved the accuracy and the time to diagnosis in different cardiovascular diseases, and more than this, explaining the decision to make AI diagnosis improved the human understanding of the different features of the ECG that might be considered for a more accurate diagnosis. The purpose of this article is to provide an overview of the most recently published articles about the use of AI in ECG interpretation.

Artificial intelligence in emergency medicine. A systematic literature review

Motivation and objective: Emergency medicine is becoming a popular application area for artificial intelligence methods but remains less investigated than other healthcare branches. The need for time-sensitive decision-making on the basis of high data volumes makes the use of quantitative technologies inevitable. However, the specifics of healthcare regulations impose strict requirements for such applications. Published contributions cover separate parts of emergency medicine and use disparate data and algorithms. This study aims to systematize the relevant contributions, investigate the main obstacles to artificial intelligence applications in emergency medicine, and propose directions for further studies.

METHODS

The contributions selection process was conducted with systematic electronic databases querying and filtering with respect to established exclusion criteria. Among the 380 papers gathered from IEEE Xplore, ACM Digital Library, Springer Library, ScienceDirect, and Nature databases 116 were considered to be a part of the survey. The main features of the selected papers are the focus on emergency medicine and the use of machine learning or deep learning algorithms.

FINDINGS AND DISCUSSION

The selected papers were classified into two branches: diagnostics-specific and triage-specific. The former ones are focused on either diagnosis prediction or decision support. The latter covers such applications as mortality, outcome, admission prediction, condition severity estimation, and urgent care prediction. The observed contributions are highly specialized within a single disease or medical operation and often use privately collected retrospective data, making them incomparable. These and other issues can be addressed by creating an end-to-end solution based on human-machine interaction.

CONCLUSION

Artificial intelligence applications are finding their place in emergency medicine, while most of the corresponding studies remain isolated and lack higher generalization and more sophisticated methodology, which can be a matter of forthcoming improvements.

Machine learning for the diagnosis of acute coronary syndrome using a 12-lead ECG: a systematic review

OBJECTIVES

Prompt diagnosis of acute coronary syndrome (ACS) using a 12-lead electrocardiogram (ECG) is a critical task for emergency physicians. While computerized algorithms for ECG interpretation are limited in their accuracy, machine learning (ML) models have shown promise in several areas of clinical medicine. We performed a systematic review to compare the performance of ML-based ECG analysis to clinician or non-ML computerized ECG interpretation in the diagnosis of ACS for emergency department (ED) or prehospital patients.

METHODS

We searched Medline, Embase, Cochrane Central, and CINAHL databases from inception to May 18, 2022. We included studies that compared ML algorithms to either clinicians or non-ML based software in their ability to diagnose ACS using only a 12-lead ECG, in adult patients experiencing chest pain or symptoms concerning for ACS in the ED or prehospital setting. We used QUADAS-2 for risk of bias assessment. Prospero registration CRD42021264765.

RESULTS

Our search yielded 1062 abstracts. 10 studies met inclusion criteria. Five model types were tested, including neural networks, random forest, and gradient boosting. In five studies with complete performance data, ML models were more sensitive but less specific (sensitivity range 0.59-0.98, specificity range 0.44-0.95) than clinicians (sensitivity range 0.22-0.93, specificity range 0.63-0.98) in diagnosing ACS. In four studies that reported it, ML models had better discrimination (area under ROC curve range 0.79-0.98) than clinicians (area under ROC curve 0.67-0.78). Heterogeneity in both methodology and reporting methods precluded a meta-analysis. Several studies had high risk of bias due to patient selection, lack of external validation, and unreliable reference standards for ACS diagnosis.

CONCLUSIONS

ML models have overall higher discrimination and sensitivity but lower specificity than clinicians and non-ML software in ECG interpretation for the diagnosis of ACS. ML-based ECG interpretation could potentially serve a role as a "safety net", alerting emergency care providers to a missed acute MI when it has not been diagnosed. More rigorous primary research is needed to definitively demonstrate the ability of ML to outperform clinicians at ECG interpretation.

Artificial intelligence and machine learning in prehospital emergency care: A scoping review

Our scoping review provides a comprehensive analysis of the landscape of artificial intelligence (AI) applications in prehospital emergency care (PEC). It contributes to the field by highlighting the most studied AI applications and identifying the most common methodological approaches across 106 included studies. The findings indicate a promising future for AI in PEC, with many unique use cases, such as prognostication, demand prediction, resource optimization, and the Internet of Things continuous monitoring systems. Comparisons with other approaches showed AI outperforming clinicians and non-AI algorithms in most cases. However, most studies were internally validated and retrospective, highlighting the need for rigorous prospective validation of AI applications before implementation in clinical settings. We identified knowledge and methodological gaps using an evidence map, offering a roadmap for future investigators. We also discussed the significance of explainable AI for establishing trust in AI systems among clinicians and facilitating real-world validation of AI models.

Comparison of discrimination and calibration performance of ECG-based machine learning models for prediction of new-onset atrial fibrillation

BACKGROUND

Machine learning (ML) methods to build prediction models starting from electrocardiogram (ECG) signals are an emerging research field. The aim of the present study is to investigate the performances of two ML approaches based on ECGs for the prediction of new-onset atrial fibrillation (AF), in terms of discrimination, calibration and sample size dependence.

METHODS

We trained two models to predict new-onset AF: a convolutional neural network (CNN), that takes as input the raw ECG signals, and an eXtreme Gradient Boosting model (XGB), that uses the signal's extracted features. A penalized logistic regression model (LR) was used as a benchmark. Discrimination was evaluated with the area under the ROC curve, while calibration with the integrated calibration index. We investigated the dependence of models' performances on the sample size and on class imbalance corrections introduced with random under-sampling.

RESULTS

CNN's discrimination was the most affected by the sample size, outperforming XGB and LR only around n = 10.000 observations. Calibration showed only a small dependence on the sample size for all the models considered. Balancing the training set with random undersampling did not improve discrimination in any of the models. Instead, the main effect of imbalance corrections was to worsen the models' calibration (for CNN, integrated calibration index from 0.014 [0.01, 0.018] to 0.17 [0.16, 0.19]). The sample size emerged as a fundamental point for developing the CNN model, especially in terms of discrimination (AUC = 0.75 [0.73, 0.77] when n = 10.000, AUC = 0.80 [0.79, 0.81] when n = 150.000). The effect of the sample size on the other two models was weaker. Imbalance corrections led to poorly calibrated models, for all the approaches considered, reducing the clinical utility of the models.

CONCLUSIONS

Our results suggest that the choice of approach in the analysis of ECG should be based on the amount of data available, preferring more standard models for small datasets. Moreover, imbalance correction methods should be avoided when developing clinical prediction models, where calibration is crucial.

Emerging ECG methods for acute coronary syndrome detection: Recommendations & future opportunities

Despite being the mainstay for the initial noninvasive assessment of patients with symptomatic coronary artery disease, the 12‑lead ECG remains a suboptimal diagnostic tool for myocardial ischemia detection with only acceptable sensitivity and specificity scores. Although myocardial ischemia affects the configuration of the QRS complex and the STT waveform, current guidelines primarily focus on ST segment amplitude, which constitutes a missed opportunity and may explain the suboptimal diagnostic performance of the ECG. This possible opportunity and the low cost and ease of use of the ECG provide compelling motivation to enhance the diagnostic accuracy of the ECG to ischemia detection. This paper describes numerous computational ECG methods and approaches that have been shown to dramatically increase ECG sensitivity to ischemia detection. Briefly, these emerging approaches can be conceptually grouped into one of the following four approaches: (1) leveraging novel ECG waveform features and signatures indicative of ischemic injury other than the classical ST-T amplitude measures; (2) applying body surface potentials mapping (BSPM)-based approaches to enhance the spatial coverage of the surface ECG to detecting ischemia; (3) developing an inverse ECG solution to reconstruct anatomical models of activation and recovery pathways to detect and localize injury currents; and (4) exploring artificial intelligence (AI)-based techniques to harvest ECG waveform signatures of ischemia. We present recent advances, shortcomings, and future opportunities for each of these emerging ECG methods. Future research should focus on the prospective clinical testing of these approaches to establish clinical utility and to expedite potential translation into clinical practice.