Multiclass classification of myocardial infarction with convolutional and recurrent neural networks for portable ECG devices

Automatic detection of cardiac conditions from photos of electrocardiogram captured by smartphones

BACKGROUND

Researchers have developed machine learning-based ECG diagnostic algorithms that match or even surpass cardiologist level of performance. However, most of them cannot be used in real-world, as older generation ECG machines do not permit installation of new algorithms.

OBJECTIVE

To develop a smartphone application that automatically extract ECG waveforms from photos and to convert them to voltage-time series for downstream analysis by a variety of diagnostic algorithms built by researchers.

METHODS

A novel approach of using objective detection and image segmentation models to automatically extract ECG waveforms from photos taken by clinicians was devised. Modular machine learning models were developed to sequentially perform waveform identification, gridline removal, and scale calibration. The extracted data were then analysed using a machine learning-based cardiac rhythm classifier.

RESULTS

Waveforms from 40 516 scanned and 444 photographed ECGs were automatically extracted. 12 828 of 13 258 (96.8%) scanned and 5399 of 5743 (94.0%) photographed waveforms were correctly cropped and labelled. 11 604 of 12 735 (91.1%) scanned and 5062 of 5752 (88.0%) photographed waveforms achieved successful voltage-time signal extraction after automatic gridline and background noise removal. In a proof-of-concept demonstration, an atrial fibrillation diagnostic algorithm achieved 91.3% sensitivity, 94.2% specificity, 95.6% positive predictive value, 88.6% negative predictive value and 93.4% F1 score, using photos of ECGs as input.

CONCLUSION

Object detection and image segmentation models allow automatic extraction of ECG signals from photos for downstream diagnostics. This novel pipeline circumvents the need for costly ECG hardware upgrades, thereby paving the way for large-scale implementation of machine learning-based diagnostic algorithms.

Integrating Phenotypic Information of Obstructive Sleep Apnea and Deep Representation of Sleep-Event Sequences for Cardiovascular Risk Prediction

Background

Advances in mobile, wearable and machine learning (ML) technologies for gathering and analyzing long-term health data have opened up new possibilities for predicting and preventing cardiovascular diseases (CVDs). Meanwhile, the association between obstructive sleep apnea (OSA) and CV risk has been well-recognized. This study seeks to explore effective strategies of incorporating OSA phenotypic information and overnight physiological information for precise CV risk prediction in the general population.

Methods

1,874 participants without a history of CVDs from the MESA dataset were included for the 5-year CV risk prediction. Four OSA phenotypes were first identified by the K-mean clustering based on static polysomnographic (PSG) features. Then several phenotype-agnostic and phenotype-specific ML models, along with deep learning (DL) models that integrate deep representations of overnight sleep-event feature sequences, were built for CV risk prediction. Finally, feature importance analysis was conducted by calculating SHapley Additive exPlanations (SHAP) values for all features across the four phenotypes to provide model interpretability.

Results

All ML models showed improved performance after incorporating the OSA phenotypic information. The DL model trained with the proposed phenotype-contrastive training strategy performed the best, achieving an area under the Receiver Operating Characteristic (ROC) curve of 0.877. Moreover, PSG and FOOD FREQUENCY features were recognized as significant CV risk factors across all phenotypes, with each phenotype emphasizing unique features.

Conclusion

Models that are aware of OSA phenotypes are preferred, and lifestyle factors should be a greater focus for precise CV prevention and risk management in the general population.

Pre-Processing techniques and artificial intelligence algorithms for electrocardiogram (ECG) signals analysis: A comprehensive review

Electrocardiogram (ECG) are the physiological signals and a standard test to measure the heart's electrical activity that depicts the movement of cardiac muscles. A review study has been conducted on ECG signals analysis with the help of artificial intelligence (AI) methods over the last ten years i.e., 2012-22. Primarily, the method of ECG analysis by software systems was divided into classical signal processing (e.g. spectrograms or filters), machine learning (ML) and deep learning (DL), including recursive models, transformers and hybrid. Secondly, the data sources and benchmark datasets were depicted. Authors grouped resources by ECG acquisition methods into hospital-based portable machines and wearable devices. Authors also included new trends like advanced pre-processing, data augmentation, simulations and agent-based modeling. The study found improvement in ECG examination perfection made each year through ML, DL, hybrid models, and transformers. Convolutional neural networks and hybrid models were more targeted and proved efficient. The transformer model extended the accuracy from 90% to 98%. The Physio-Net library helps acquire ECG signals, including the popular benchmark databases such as MIT-BIH, PTB, and challenging datasets. Similarly, wearable devices have been established as a appropriate option for monitoring patient health without the time and place limitations and are also helpful for AI model calibration with so far accuracy of 82%-83% on Samsung smartwatch. In the pre-processing signals, spectrogram generation through Fourier and wavelet transformations are erected leading approaches promoting on average accuracy of 90%-95%. Likewise, data enhancement using geometrical techniques is well-considered; however, extraction and concatenation-based methods need attention. As the what-if analysis in healthcare or cardiac issues can be performed using a complex simulation, the study reviews agent-based modeling and simulation approaches for cardiovascular risk event assessment.

Autonomous detection of myocarditis based on the fusion of improved quantum genetic algorithm and adaptive differential evolution optimization back propagation neural network

Myocarditis is cardiac damage caused by a viral infection. Its result often leads to a variety of arrhythmias. However, rapid and reliable identification of myocarditis has a great impact on early diagnosis, expedited treatment, and improved patient survival rates. Therefore, a novel strategy for the autonomous detection of myocarditis is suggested in this work. First, the improved quantum genetic algorithm (IQGA) is proposed to extract the optimal features of ECG beat and heart rate variability (HRV) from raw ECG signals. Second, the backpropagation neural network (BPNN) is optimized using the adaptive differential evolution (ADE) algorithm to classify various ECG signal types with high accuracy. This study examines analogies among five different ECG signal types: normal, abnormal, myocarditis, myocardial infarction (MI), and prior myocardial infarction (PMI). Additionally, the study uses binary and multiclass classification to group myocarditis with other cardiovascular disorders in order to assess how well the algorithm performs in categorization. The experimental results demonstrate that the combination of IQGA and ADE-BPNN can effectively increase the precision and accuracy of myocarditis autonomous diagnosis. In addition, HRV assesses the method's robustness, and the classification tool can detect viruses in myocarditis patients one week before symptoms worsen. The model can be utilized in intensive care units or wearable monitoring devices and has strong performance in the detection of myocarditis.

Deep learning for ECG Arrhythmia detection and classification: an overview of progress for period 2017-2023

Cardiovascular diseases are a leading cause of mortality globally. Electrocardiography (ECG) still represents the benchmark approach for identifying cardiac irregularities. Automatic detection of abnormalities from the ECG can aid in the early detection, diagnosis, and prevention of cardiovascular diseases. Deep Learning (DL) architectures have been successfully employed for arrhythmia detection and classification and offered superior performance to traditional shallow Machine Learning (ML) approaches. This survey categorizes and compares the DL architectures used in ECG arrhythmia detection from 2017-2023 that have exhibited superior performance. Different DL models such as Convolutional Neural Networks (CNNs), Multilayer Perceptrons (MLPs), Transformers, and Recurrent Neural Networks (RNNs) are reviewed, and a summary of their effectiveness is provided. This survey provides a comprehensive roadmap to expedite the acclimation process for emerging researchers willing to develop efficient algorithms for detecting ECG anomalies using DL models. Our tailored guidelines bridge the knowledge gap allowing newcomers to align smoothly with the prevailing research trends in ECG arrhythmia detection. We shed light on potential areas for future research and refinement in model development and optimization, intending to stimulate advancement in ECG arrhythmia detection and classification.

Automatic cardiac arrhythmias classification using CNN and attention-based RNN network

Cardiac disease has become a severe threat to public health according to the government report. In China, there are 0.29 billion cardiac patients and early diagnosis will greatly reduce mortality and improve life quality. Electrocardiogram (ECG) signal is a priority tool in the diagnosis of heart diseases because it is non-invasive and easily available with a simple diagnostic tool of low cost. The paper proposes an automatic classification model by combing convolutional neural network (CNN) and recurrent neural network (RNN) to distinguish different types of cardiac arrhythmias. Morphology features of the raw ECG signals are extracted by CNN blocks and fed into a bidirectional gated recurrent unit (GRU) network. Attention mechanism is used to highlight specific features of the input sequence and contribute to the performance improvement of classification. The model is evaluated with two datasets considering the class imbalance problem constructed with records from MIT-BIH arrhythmia database and China Physiological Signal Challenge 2018 database. Experimental results show that this model achieves good performance with an average F1 score of 0.9110 on public dataset and 0.9082 on subject-specific dataset, which may have potential practical applications.

Applying Artificial Intelligence to Wearable Sensor Data to Diagnose and Predict Cardiovascular Disease: A Review

Cardiovascular disease (CVD) is the world's leading cause of mortality. There is significant interest in using Artificial Intelligence (AI) to analyse data from novel sensors such as wearables to provide an earlier and more accurate prediction and diagnosis of heart disease. Digital health technologies that fuse AI and sensing devices may help disease prevention and reduce the substantial morbidity and mortality caused by CVD worldwide. In this review, we identify and describe recent developments in the application of digital health for CVD, focusing on AI approaches for CVD detection, diagnosis, and prediction through AI models driven by data collected from wearables. We summarise the literature on the use of wearables and AI in cardiovascular disease diagnosis, followed by a detailed description of the dominant AI approaches applied for modelling and prediction using data acquired from sensors such as wearables. We discuss the AI algorithms and models and clinical applications and find that AI and machine-learning-based approaches are superior to traditional or conventional statistical methods for predicting cardiovascular events. However, further studies evaluating the applicability of such algorithms in the real world are needed. In addition, improvements in wearable device data accuracy and better management of their application are required. Lastly, we discuss the challenges that the introduction of such technologies into routine healthcare may face.

Artificial intelligence-assisted remote detection of ST-elevation myocardial infarction using a mini-12-lead electrocardiogram device in prehospital ambulance care

Objective

To implement an all-day online artificial intelligence (AI)-assisted detection of ST-elevation myocardial infarction (STEMI) by prehospital 12-lead electrocardiograms (ECGs) to facilitate patient triage for timely reperfusion therapy.

Methods

The proposed AI model combines a convolutional neural network and long short-term memory (CNN-LSTM) to predict STEMI on prehospital 12-lead ECGs obtained from mini-12-lead ECG devices equipped in ambulance vehicles in Central Taiwan. Emergency medical technicians (EMTs) from the 14 AI-implemented fire stations performed the on-site 12-lead ECG examinations using the mini portable device. The 12-lead ECG signals were transmitted to the AI center of China Medical University Hospital to classify the recordings as "STEMI" or "Not STEMI". In 11 non-AI fire stations, the ECG data were transmitted to a secure network and read by available on-line emergency physicians. The response time was defined as the time interval between the ECG transmission and ECG interpretation feedback.

Results

Between July 17, 2021, and March 26, 2022, the AI model classified 362 prehospital 12-lead ECGs obtained from 275 consecutive patients who had called the 119 dispatch centers of fire stations in Central Taiwan for symptoms of chest pain or shortness of breath. The AI's response time to the EMTs in ambulance vehicles was 37.2 ± 11.3 s, which was shorter than the online physicians' response time from 11 other fire stations with no AI implementation (113.2 ± 369.4 s, P < 0.001) after analyzing another set of 335 prehospital 12-lead ECGs. The evaluation metrics including accuracy, precision, specificity, recall, area under the receiver operating characteristic curve, and F1 score to assess the overall AI performance in the remote detection of STEMI were 0.992, 0.889, 0.994, 0.941, 0.997, and 0.914, respectively. During the study period, the AI model promptly identified 10 STEMI patients who underwent primary percutaneous coronary intervention (PPCI) with a median contact-to-door time of 18.5 (IQR: 16-20.8) minutes.

Conclusion

Implementation of an all-day real-time AI-assisted remote detection of STEMI on prehospital 12-lead ECGs in the field is feasible with a high diagnostic accuracy rate. This approach may help minimize preventable delays in contact-to-treatment times for STEMI patients who require PPCI.

An Adaptive ECG Noise Removal Process Based on Empirical Mode Decomposition (EMD)

The electrocardiogram (ECG) is a generally used instrument for examining cardiac disorders. For proper interpretation of cardiac illnesses, a noise-free ECG is often preferred. ECG signals, on the other hand, are suffering from numerous noises throughout gathering and programme. This article suggests an empirical mode decomposition-based adaptive ECG noise removal technique (EMD). The benefits of the proposed methods are used to dip noise in ECG signals with the least amount of distortion. For decreasing high-frequency noises, traditional EMD-based approaches either cast off the preliminary fundamental functions or use a window-based methodology. The signal quality is then improved via an adaptive process. The simulation study uses ECG data from the universal MIT-BIH database as well as the Brno University of Technology ECG Quality Database (BUT QDB). The proposed method's efficiency is measured using three typical evaluation metrics: mean square error, output SNR change, and ratio root mean square alteration at various SNR levels (signal to noise ratio). The suggested noise removal approach is compatible with other commonly used ECG noise removal techniques. A detailed examination reveals that the proposed method could be served as an effective means of noise removal ECG signals, resulting in enhanced diagnostic functions in automated medical systems.

Application of artificial intelligence techniques for automated detection of myocardial infarction: a review

Myocardial infarction (MI) results in heart muscle injury due to receiving insufficient blood flow. MI is the most common cause of mortality in middle-aged and elderly individuals worldwide. To diagnose MI, clinicians need to interpret electrocardiography (ECG) signals, which requires expertise and is subject to observer bias. Artificial intelligence-based methods can be utilized to screen for or diagnose MI automatically using ECG signals. In this work, we conducted a comprehensive assessment of artificial intelligence-based approaches for MI detection based on ECG and some other biophysical signals, including machine learning (ML) and deep learning (DL) models. The performance of traditional ML methods relies on handcrafted features and manual selection of ECG signals, whereas DL models can automate these tasks. The review observed that deep convolutional neural networks (DCNNs) yielded excellent classification performance for MI diagnosis, which explains why they have become prevalent in recent years. To our knowledge, this is the first comprehensive survey of artificial intelligence techniques employed for MI diagnosis using ECG and some other biophysical signals.

A systematic review and Meta-data analysis on the applications of Deep Learning in Electrocardiogram

The success of deep learning over the traditional machine learning techniques in handling artificial intelligence application tasks such as image processing, computer vision, object detection, speech recognition, medical imaging and so on, has made deep learning the buzz word that dominates Artificial Intelligence applications. From the last decade, the applications of deep learning in physiological signals such as electrocardiogram (ECG) have attracted a good number of research. However, previous surveys have not been able to provide a systematic comprehensive review including biometric ECG based systems of the applications of deep learning in ECG with respect to domain of applications. To address this gap, we conducted a systematic literature review on the applications of deep learning in ECG including biometric ECG based systems. The study analyzed systematically, 150 primary studies with evidence of the application of deep learning in ECG. The study shows that the applications of deep learning in ECG have been applied in different domains. We presented a new taxonomy of the domains of application of the deep learning in ECG. The paper also presented discussions on biometric ECG based systems and meta-data analysis of the studies based on the domain, area, task, deep learning models, dataset sources and preprocessing methods. Challenges and potential research opportunities were highlighted to enable novel research. We believe that this study will be useful to both new researchers and expert researchers who are seeking to add knowledge to the already existing body of knowledge in ECG signal processing using deep learning algorithm.

Supplementary information

The online version contains supplementary material available at 10.1007/s12652-022-03868-z.

Deep Learning for Detecting and Locating Myocardial Infarction by Electrocardiogram: A Literature Review

Myocardial infarction is a common cardiovascular disorder caused by prolonged ischemia, and early diagnosis of myocardial infarction (MI) is critical for lifesaving. ECG is a simple and non-invasive approach in MI detection, localization, diagnosis, and prognosis. Population-based screening with ECG can detect MI early and help prevent it but this method is too labor-intensive and time-consuming to carry out in practice unless artificial intelligence (AI) would be able to reduce the workload. Recent advances in using deep learning (DL) for ECG screening might rekindle this hope. This review aims to take stock of 59 major DL studies applied to the ECG for MI detection and localization published in recent 5 years, covering convolutional neural network (CNN), long short-term memory (LSTM), convolutional recurrent neural network (CRNN), gated recurrent unit (GRU), residual neural network (ResNet), and autoencoder (AE). In this period, CNN obtained the best popularity in both MI detection and localization, and the highest performance has been obtained from CNN and ResNet model. The reported maximum accuracies of the six different methods are all beyond 97%. Considering the usage of different datasets and ECG leads, the network that trained on 12 leads ECG data of PTB database has obtained higher accuracy than that on smaller number leads data of other datasets. In addition, some limitations and challenges of the DL techniques are also discussed in this review.

A Powerful Paradigm for Cardiovascular Risk Stratification Using Multiclass, Multi-Label, and Ensemble-Based Machine Learning Paradigms: A Narrative Review

Background and Motivation: Cardiovascular disease (CVD) causes the highest mortality globally. With escalating healthcare costs, early non-invasive CVD risk assessment is vital. Conventional methods have shown poor performance compared to more recent and fast-evolving Artificial Intelligence (AI) methods. The proposed study reviews the three most recent paradigms for CVD risk assessment, namely multiclass, multi-label, and ensemble-based methods in (i) office-based and (ii) stress-test laboratories. Methods: A total of 265 CVD-based studies were selected using the preferred reporting items for systematic reviews and meta-analyses (PRISMA) model. Due to its popularity and recent development, the study analyzed the above three paradigms using machine learning (ML) frameworks. We review comprehensively these three methods using attributes, such as architecture, applications, pro-and-cons, scientific validation, clinical evaluation, and AI risk-of-bias (RoB) in the CVD framework. These ML techniques were then extended under mobile and cloud-based infrastructure. Findings: Most popular biomarkers used were office-based, laboratory-based, image-based phenotypes, and medication usage. Surrogate carotid scanning for coronary artery risk prediction had shown promising results. Ground truth (GT) selection for AI-based training along with scientific and clinical validation is very important for CVD stratification to avoid RoB. It was observed that the most popular classification paradigm is multiclass followed by the ensemble, and multi-label. The use of deep learning techniques in CVD risk stratification is in a very early stage of development. Mobile and cloud-based AI technologies are more likely to be the future. Conclusions: AI-based methods for CVD risk assessment are most promising and successful. Choice of GT is most vital in AI-based models to prevent the RoB. The amalgamation of image-based strategies with conventional risk factors provides the highest stability when using the three CVD paradigms in non-cloud and cloud-based frameworks.

Detection and Localization of Myocardial Infarction Based on Multi-Scale ResNet and Attention Mechanism

PURPOSE

Myocardial infarction (MI) is one of the most common cardiovascular diseases, frequently resulting in death. Early and accurate diagnosis is therefore important, and the electrocardiogram (ECG) is a simple and effective method for achieving this. However, it requires assessment by a specialist; so many recent works have focused on the automatic assessment of ECG signals.

METHODS

For the detection and localization of MI, deep learning models have been proposed, but the diagnostic accuracy of this approaches still need to be improved. Moreover, with deep learning methods the way in which a given result was achieved lacks interpretability. In this study, ECG data was obtained from the PhysioBank open access database, and was analyzed as follows. Firstly, the 12-lead ECG signal was preprocessed to identify each beat and obtain each heart interval. Secondly, a multi-scale deep learning model combined with a residual network and attention mechanism was proposed, where the input was the 12-lead ECG recording. Through the SENet model and the Grad-CAM algorithm, the weighting of each lead was calculated and visualized. Using existing knowledge of the way in which different types of MI gave characteristic patterns in specific ECG leads, the model was used to provisionally diagnose the type of MI according to the characteristics of each of the 12 ECG leads.

RESULTS

Ten types of MI anterior, anterior lateral, anterior septal, inferior, inferior lateral, inferior posterior, inferior posterior lateral, lateral, posterior, and posterior lateral were diagnosed. The average accuracy, sensitivity, and specificity for MI detection of all lesion types was 99.98, 99.94, and 99.98%, respectively; and the average accuracy, sensitivity, and specificity for MI localization was 99.79, 99.88, and 99.98%, respectively.

CONCLUSION

When compared to existing models based on traditional machine learning methods, convolutional neural networks and recurrent neural networks, the results showed that the proposed model had better diagnostic performance, being superior in accuracy, sensitivity, and specificity.

Deep learning-based electrocardiogram rhythm and beat features for heart abnormality classification

BACKGROUND

Electrocardiogram (ECG) signal classification plays a critical role in the automatic diagnosis of heart abnormalities. While most ECG signal patterns cannot be recognized by a human interpreter, they can be detected with precision using artificial intelligence approaches, making the ECG a powerful non-invasive biomarker. However, performing rapid and accurate ECG signal classification is difficult due to the low amplitude, complexity, and non-linearity. The widely-available deep learning (DL) method we propose has presented an opportunity to substantially improve the accuracy of automated ECG classification analysis using rhythm or beat features. Unfortunately, a comprehensive and general evaluation of the specific DL architecture for ECG analysis across a wide variety of rhythm and beat features has not been previously reported. Some previous studies have been concerned with detecting ECG class abnormalities only through rhythm or beat features separately.

METHODS

This study proposes a single architecture based on the DL method with one-dimensional convolutional neural network (1D-CNN) architecture, to automatically classify 24 patterns of ECG signals through both rhythm and beat. To validate the proposed model, five databases which consisted of nine-class of ECG-base rhythm and 15-class of ECG-based beat were used in this study. The proposed DL network was applied and studied with varying datasets with different frequency samplings in intra and inter-patient scheme.

RESULTS

Using a 10-fold cross-validation scheme, the performance results had an accuracy of 99.98%, a sensitivity of 99.90%, a specificity of 99.89%, a precision of 99.90%, and an F1-score of 99.99% for ECG rhythm classification. Additionally, for ECG beat classification, the model obtained an accuracy of 99.87%, a sensitivity of 96.97%, a specificity of 99.89%, a precision of 92.23%, and an F1-score of 94.39%. In conclusion, this study provides clinicians with an advanced methodology for detecting and discriminating heart abnormalities between different ECG rhythm and beat assessments by using one outstanding proposed DL architecture.

Machine Learning for Cardiovascular Outcomes From Wearable Data: Systematic Review From a Technology Readiness Level Point of View

BACKGROUND

Wearable technology has the potential to improve cardiovascular health monitoring by using machine learning. Such technology enables remote health monitoring and allows for the diagnosis and prevention of cardiovascular diseases. In addition to the detection of cardiovascular disease, it can exclude this diagnosis in symptomatic patients, thereby preventing unnecessary hospital visits. In addition, early warning systems can aid cardiologists in timely treatment and prevention.

OBJECTIVE

This study aims to systematically assess the literature on detecting and predicting outcomes of patients with cardiovascular diseases by using machine learning with data obtained from wearables to gain insights into the current state, challenges, and limitations of this technology.

METHODS

We searched PubMed, Scopus, and IEEE Xplore on September 26, 2020, with no restrictions on the publication date and by using keywords such as "wearables," "machine learning," and "cardiovascular disease." Methodologies were categorized and analyzed according to machine learning-based technology readiness levels (TRLs), which score studies on their potential to be deployed in an operational setting from 1 to 9 (most ready).

RESULTS

After the removal of duplicates, application of exclusion criteria, and full-text screening, 55 eligible studies were included in the analysis, covering a variety of cardiovascular diseases. We assessed the quality of the included studies and found that none of the studies were integrated into a health care system (TRL<6), prospective phase 2 and phase 3 trials were absent (TRL<7 and 8), and group cross-validation was rarely used. These issues limited these studies' ability to demonstrate the effectiveness of their methodologies. Furthermore, there seemed to be no agreement on the sample size needed to train these studies' models, the size of the observation window used to make predictions, how long participants should be observed, and the type of machine learning model that is suitable for predicting cardiovascular outcomes.

CONCLUSIONS

Although current studies show the potential of wearables to monitor cardiovascular events, their deployment as a diagnostic or prognostic cardiovascular clinical tool is hampered by the lack of a realistic data set and proper systematic and prospective evaluation.

Detection and Location of Myocardial Infarction from Electrocardiogram Signals Using Median Complexes and Convolutional Neural Networks

When doctors judge myocardial infarction (MI), they often introduce 12 leads as the basis for judgment. However, the repetitive labeling of nonlinear ECG signals is time-consuming and laborious. There is a need of computer-aided techniques for automatic ECG signal analysis. In this paper, we proposed a new method based on median complexes and convolutional neural networks (CNNs) for MI detection and location. Median complexes were extracted which retained the morphological features of MIs. Then, the CNN was used to determine whether each lead presented MI characteristics. Finally, the information of the 12 leads was synthesized to realize the location of MIs. Six types of MI recognition were performed, including inferior, lateral, anterolateral, anterior, and anteroseptal MIs, and non-MI. We investigated cross-database performance for MI detection and location by the proposed method, with the CNN models trained on a local database and validated by the open PTB database. Experimental results showed that the proposed method yielded F1 scores of 84.6% and 80.4% for the local and PTB test datasets, respectively. The proposed method outperformed the traditional hand-crafted method. With satisfying cross-database and generalization performance, the proposed CNN method may be used as a new method for improved MI detection and location in ECG signals.

Applications of deep learning methods in digital biomarker research using noninvasive sensing data

Introduction: Noninvasive digital biomarkers are critical elements in digital healthcare in terms of not only the ease of measurement but also their use of raw data. In recent years, deep learning methods have been put to use to analyze these diverse heterogeneous data; these methods include representation learning for feature extraction and supervised learning for the prediction of these biomarkers. Methods: We introduce clinical cases of digital biomarkers and various deep-learning methods applied according to each data type. In addition, deep learning methods for the integrated analysis of multidimensional heterogeneous data are introduced, and the utility of these data as an integrated digital biomarker is presented. The current status of digital biomarker research is examined by surveying research cases applied to various types of data as well as modeling methods. Results: We present a future research direction for using data from heterogeneous sources together by introducing deep learning methods for dimensionality reduction and mode integration from multimodal digital biomarker studies covering related domains. The integration of multimodality has led to advances in research through the improvement of performance and complementarity between modes. Discussion: The integrative digital biomarker will be more useful for research on diseases that require data from multiple sources to be treated together. Since delicate signals from patients are not missed and the interaction effects between signals are also considered, it will be helpful for immediate detection and more accurate prediction of symptoms.

Real-time frequency-independent single-Lead and single-beat myocardial infarction detection

This study proposes a novel real-time frequency-independent myocardial infarction detector for Lead II electrocardiograms. The underlying Deep-LSTM network is trained using the PTB-XL database, the largest to date publicly available electrocardiography dataset, and is tested over the same and the older PTB database. By testing the model over distinct datasets, collected under different conditions and from different patients, a more realistic measure of the performance can be gauged from the deployed system. The detector is trained over 3589 myocardial infarction (MI) patients and 7115 healthy controls (HC) while it is evaluated on 1076 MIs and 1840 HCs. The proposed algorithm, achieved an accuracy of 77.12%, recall/sensitivity of 75.85%, and a specificity of 83.02% over the entire PTB database; 85.07%, 81.54%, 87.31% over the PTB-XL validation set (fold 9), and 84.17%, 78.37%, 87.55% over the PTB-XL test set (fold 10). The model also achieves stable performance metrics over the frequency range of 202 Hz to 2.8 kHz. The processing time is dependent on the sampling frequency, ranging from 130 ms at 202 Hz to 1.8 s at 2.8 kHz. Such outcome is within the time required for real-time processing (less than 300 ms for fast heartbeats), between 202 Hz and 500 Hz making the algorithm practically real-time. Therefore, the proposed MI detector could be readily deployed onto existing wearable and/or portable devices and test instruments; potentially having significant societal and clinical impact in the lives of patients at risk for myocardial infarction.

Interpretable Detection and Location of Myocardial Infarction Based on Ventricular Fusion Rule Features

Myocardial infarction (MI) is one of the most common cardiovascular diseases threatening human life. In order to accurately distinguish myocardial infarction and have a good interpretability, the classification method that combines rule features and ventricular activity features is proposed in this paper. Specifically, according to the clinical diagnosis rule and the pathological changes of myocardial infarction on the electrocardiogram, the local information extracted from the Q wave, ST segment, and T wave is computed as the rule feature. All samples of the QT segment are extracted as ventricular activity features. Then, in order to reduce the computational complexity of the ventricular activity features, the effects of Discrete Wavelet Transform (DWT), Principal Component Analysis (PCA), and Locality Preserving Projections (LPP) on the extracted ventricular activity features are compared. Combining rule features and ventricular activity features, all the 12 leads features are fused as the ultimate feature vector. Finally, eXtreme Gradient Boosting (XGBoost) is used to identify myocardial infarction, and the overall accuracy rate of 99.86% is obtained on the Physikalisch-Technische Bundesanstalt (PTB) database. This method has a good medical diagnosis basis while improving the accuracy, which is very important for clinical decision-making.

Detection and Classification of Myocardial Infarction with Support Vector Machine Classifier Using Grasshopper Optimization Algorithm

Background:

Providing a noninvasive, rapid, and cost-effective approach to diagnose of myocardial infarction (MI) is essential in the early stages of electrocardiogram (ECG) signaling. In this article, we proposed the new optimization method for support vector machine (SVM) classifier to MI classification.

Methods:

After preprocessing ECG signal and noise removal, three features such as Q-wave integral, T-wave integral, and QRS-complex integral have been extracted in this study. After that, different statistical tests have evaluated the matrix of these features. To more accurately detect and classify the MI disease, optimizing the SVM classification parameters using the grasshopper optimization algorithm (GOA) was first used in this study (that called SVM-GOA).

Results:

After applying the GOA on the SVM classifier for all three kernels, the final results of MI detection for sensitivity, specificity, and accuracy were 100% ± 0%, 100% ± 0%, and 100% ± 0%, respectively. The final results of different MI types' classification after applying the GOA on SVM for polynomial kernel were obtained 100% ± 0%, 97.37% ± 0%, and 94.2% ± 0.2% for sensitivity and specificity and accuracy, respectively. However, the results of both linear and RBF kernels that were used for the SVM classifier method have also shown a significant increase after using GOA.

Conclusion:

This article's results show the highly desirable effect of applying a GOA to optimize different kernel parameters used in the SVM classifier for accurate detection and classification of MI. The proposed algorithm's final results show that the proposed system has a relatively higher performance than other previous studies.

Evaluation of Deep Learning against Conventional Limit Equilibrium Methods for Slope Stability Analysis

This paper presents a comparison study between methods of deep learning as a new category of slope stability analysis, built upon the recent advances in artificial intelligence and conventional limit equilibrium analysis methods. For this purpose, computer code was developed to calculate the factor of safety (FS) using four limit equilibrium methods: Bishop’s simplified method, the Fellenius method, Janbu’s simplified method, and Janbu’s corrected method. The code was verified against Slide2 in RocScience. Subsequently, the average FS values were used to approximate the “true” FS of the slopes for labeling the images for deep learning. Using this code, a comprehensive dataset of slope images with wide ranges of geometries and soil properties was created. The average FS values were used to label the images for implementing two deep learning models: a multiclass classification and a regression model. After training, the deep learning models were used to predict the FS of an independent set of slope images. Finally, the performance of the models was compared to that of the conventional methods. This study found that deep learning methods can reach accuracies as high as 99.71% while improving computational efficiency by more than 18 times compared with conventional methods.

Automated detection of coronary artery disease, myocardial infarction and congestive heart failure using GaborCNN model with ECG signals

Cardiovascular diseases (CVDs) are main causes of death globally with coronary artery disease (CAD) being the most important. Timely diagnosis and treatment of CAD is crucial to reduce the incidence of CAD complications like myocardial infarction (MI) and ischemia-induced congestive heart failure (CHF). Electrocardiogram (ECG) signals are most commonly employed as the diagnostic screening tool to detect CAD. In this study, an automated system (AS) was developed for the automated categorization of electrocardiogram signals into normal, CAD, myocardial infarction (MI) and congestive heart failure (CHF) classes using convolutional neural network (CNN) and unique GaborCNN models. Weight balancing was used to balance the imbalanced dataset. High classification accuracies of more than 98.5% were obtained by the CNN and GaborCNN models respectively, for the 4-class classification of normal, coronary artery disease, myocardial infarction and congestive heart failure classes. GaborCNN is a more preferred model due to its good performance and reduced computational complexity as compared to the CNN model. To the best of our knowledge, this is the first study to propose GaborCNN model for automated categorizing of normal, coronary artery disease, myocardial infarction and congestive heart failure classes using ECG signals. Our proposed system is equipped to be validated with bigger database and has the potential to aid the clinicians to screen for CVDs using ECG signals.

Automatic Classification of Myocardial Infarction Using Spline Representation of Single-Lead Derived Vectorcardiography

Myocardial infarction (MI) is one of the most prevalent cardiovascular diseases worldwide and most patients suffer from MI without awareness. Therefore, early diagnosis and timely treatment are crucial to guarantee the life safety of MI patients. Most wearable monitoring devices only provide single-lead electrocardiography (ECG), which represents a major limitation for their applicability in diagnosis of MI. Incorporating the derived vectorcardiography (VCG) techniques can help monitor the three-dimensional electrical activities of human hearts. This study presents a patient-specific reconstruction method based on long short-term memory (LSTM) network to exploit both intra- and inter-lead correlations of ECG signals. MI-induced changes in the morphological and temporal wave features are extracted from the derived VCG using spline approximation. After the feature extraction, a classifier based on multilayer perceptron network is used for MI classification. Experiments on PTB diagnostic database demonstrate that the proposed system achieved satisfactory performance to differentiating MI patients from healthy subjects and to localizing the infarcted area.

Machine learning-based prediction of acute coronary syndrome using only the pre-hospital 12-lead electrocardiogram

Prompt identification of acute coronary syndrome is a challenge in clinical practice. The 12-lead electrocardiogram (ECG) is readily available during initial patient evaluation, but current rule-based interpretation approaches lack sufficient accuracy. Here we report machine learning-based methods for the prediction of underlying acute myocardial ischemia in patients with chest pain. Using 554 temporal-spatial features of the 12-lead ECG, we train and test multiple classifiers on two independent prospective patient cohorts (n = 1244). While maintaining higher negative predictive value, our final fusion model achieves 52% gain in sensitivity compared to commercial interpretation software and 37% gain in sensitivity compared to experienced clinicians. Such an ultra-early, ECG-based clinical decision support tool, when combined with the judgment of trained emergency personnel, would help to improve clinical outcomes and reduce unnecessary costs in patients with chest pain.

Evaluation of Vertical Ground Reaction Forces Pattern Visualization in Neurodegenerative Diseases Identification Using Deep Learning and Recurrence Plot Image Feature Extraction

To diagnose neurodegenerative diseases (NDDs), physicians have been clinically evaluating symptoms. However, these symptoms are not very dependable—particularly in the early stages of the diseases. This study has therefore proposed a novel classification algorithm that uses a deep learning approach to classify NDDs based on the recurrence plot of gait vertical ground reaction force (vGRF) data. The irregular gait patterns of NDDs exhibited by vGRF data can indicate different variations of force patterns compared with healthy controls (HC). The classification algorithm in this study comprises three processes: a preprocessing, feature transformation and classification. In the preprocessing process, the 5-min vGRF data divided into 10-s successive time windows. In the feature transformation process, the time-domain vGRF data are modified into an image using a recurrence plot. The total recurrence plots are 1312 plots for HC (16 subjects), 1066 plots for ALS (13 patients), 1230 plots for PD (15 patients) and 1640 plots for HD (20 subjects). The principal component analysis (PCA) is used in this stage for feature enhancement. Lastly, the convolutional neural network (CNN), as a deep learning classifier, is employed in the classification process and evaluated using the leave-one-out cross-validation (LOOCV). Gait data from HC subjects and patients with amyotrophic lateral sclerosis (ALS), Huntington’s disease (HD) and Parkinson’s disease (PD) obtained from the PhysioNet Gait Dynamics in Neurodegenerative disease were used to validate the proposed algorithm. The experimental results included two-class and multiclass classifications. In the two-class classification, the results included classification of the NDD and the HC groups and classification among the NDDs. The classification accuracy for (HC vs. ALS), (HC vs. HD), (HC vs. PD), (ALS vs. PD), (ALS vs. HD), (PD vs. HD) and (NDDs vs. HC) were 100%, 98.41%, 100%, 95.95%, 100%, 97.25% and 98.91%, respectively. In the multiclass classification, a four-class gait classification among HC, ALS, PD and HD was conducted and the classification accuracy of HC, ALS, PD and HD were 98.99%, 98.32%, 97.41% and 96.74%, respectively. The proposed method can achieve high accuracy compare to the existing results, but with shorter length of input signal (Input of existing literature using the same database is 5-min gait signal, but the proposed method only needs 10-s gait signal).

ML-ResNet: A novel network to detect and locate myocardial infarction using 12 leads ECG

BACKGROUND AND OBJECTIVE

Myocardial infarction (MI) is one of the most threatening cardiovascular diseases for human beings, which can be diagnosed by electrocardiogram (ECG). Automated detection methods based on ECG focus on extracting handcrafted features. However, limited by the performance of traditional methods and individual differences between patients, it's difficult for predesigned features to detect MI with high performance.

METHODS

The paper presents a novel method to detect and locate MI combining a multi-lead residual neural network (ML-ResNet) structure with three residual blocks and feature fusion via 12 leads ECG records. Specifically, single lead feature branch network is trained to automatically learn the representative features of different levels between different layers, which exploits local characteristics of ECG to characterize the spatial information representation. Then all the lead features are fused together as global features. To evaluate the generalization of proposed method and clinical utility, two schemes including the intra-patient scheme and inter-patient scheme are all employed.

RESULTS

Experimental results based on PTB (Physikalisch-Technische Bundesanstalt) database shows that our model achieves superior results with the accuracy of 95.49%, the sensitivity of 94.85%, the specificity of 97.37%, and the F1 score of 96.92% for MI detection under the inter-patient scheme compared to the state-of-the-art. By contrast, the accuracy is 99.92% and the F1 score is 99.94% based on 5-fold cross validation under the intra-patient scheme. As for five types of MI location, the proposed method also yields an average accuracy of 99.72% and F1 of 99.67% in the intra-patient scheme.

CONCLUSIONS

The proposed method for MI detection and location has achieved superior results compared to other detection methods. However, further promotion of the performance based on MI location for the inter-patient scheme still depends significantly on the mass data and the novel model which reflects spatial location information of different leads subtly.

Hybrid Network with Attention Mechanism for Detection and Location of Myocardial Infarction Based on 12-Lead Electrocardiogram Signals

The electrocardiogram (ECG) is a non-invasive, inexpensive, and effective tool for myocardial infarction (MI) diagnosis. Conventional detection algorithms require solid domain expertise and rely heavily on handcrafted features. Although previous works have studied deep learning methods for extracting features, these methods still neglect the relationships between different leads and the temporal characteristics of ECG signals. To handle the issues, a novel multi-lead attention (MLA) mechanism integrated with convolutional neural network (CNN) and bidirectional gated recurrent unit (BiGRU) framework (MLA-CNN-BiGRU) is therefore proposed to detect and locate MI via 12-lead ECG records. Specifically, the MLA mechanism automatically measures and assigns the weights to different leads according to their contribution. The two-dimensional CNN module exploits the interrelated characteristics between leads and extracts discriminative spatial features. Moreover, the BiGRU module extracts essential temporal features inside each lead. The spatial and temporal features from these two modules are fused together as global features for classification. In experiments, MI location and detection were performed under both intra-patient scheme and inter-patient scheme to test the robustness of the proposed framework. Experimental results indicate that our intelligent framework achieved satisfactory performance and demonstrated vital clinical significance.

Comprehensive electrocardiographic diagnosis based on deep learning

Cardiovascular disease (CVD) is the leading cause of death worldwide, and coronary artery disease (CAD) is a major contributor. Early-stage CAD can progress if undiagnosed and left untreated, leading to myocardial infarction (MI) that may induce irreversible heart muscle damage, resulting in heart chamber remodeling and eventual congestive heart failure (CHF). Electrocardiography (ECG) signals can be useful to detect established MI, and may also be helpful for early diagnosis of CAD. For the latter especially, the ECG perturbations can be subtle and potentially misclassified during manual interpretation and/or when analyzed by traditional algorithms found in ECG instrumentation. For automated diagnostic systems (ADS), deep learning techniques are favored over conventional machine learning techniques, due to the automatic feature extraction and selection processes involved. This paper highlights various deep learning algorithms exploited for the classification of ECG signals into CAD, MI, and CHF conditions. The Convolutional Neural Network (CNN), followed by combined CNN and Long Short-Term Memory (LSTM) models, appear to be the most useful architectures for classification. A 16-layer LSTM model was developed in our study and validated using 10-fold cross-validation. A classification accuracy of 98.5% was achieved. Our proposed model has the potential to be a useful diagnostic tool in hospitals for the classification of abnormal ECG signals.

Automated interpretable detection of myocardial infarction fusing energy entropy and morphological features

BACKGROUND AND OBJECTIVE

The 12 leads electrocardiogram (ECG) is an effective tool to diagnose myocardial infarction (MI) on account of its inexpensive, noninvasive and convenient. Many methodologies have been widely adopted to detect it. However, much existing method did not integrate with diagnostic logic of clinician and practical application. The aim of the paper is to provide an automated interpretable detection method of myocardial infarction.

METHODS

The paper presents a novel method fusing energy entropy and morphological features for MI detection via 12 leads ECG. Specifically, ECG signals are firstly decomposed by maximal overlap discrete wavelet packet transform (MODWPT), then energy entropy is calculated from the decomposed coefficients as global features. Area, kurtosis coefficient, skewness coefficient and standard deviation extracted from QRS wave and ST-T segment of ECG beat are computed as local morphological features. Combining global features based on record and local features based on beat for single lead, all the 12 leads features are fused as the ultimate feature vector. What's more, different methods including principal component analysis (PCA), linear discriminant analysis (LDA) and locality preserving projection (LPP) are employed to reduce the computational complexity and redundant information. Meanwhile, principal component features are ranked by F-value. To evaluate the proposed method, PTB (Physikalisch-Technische Bundesanstalt) database and inter-patient paradigm are employed.

RESULTS

Compared with different algorithms, support vector machine (SVM) using radial basis kernel function combined with 10-fold cross validation achieves the best average performance with accuracy of 99.81%, sensitivity of 99.56%, precision of 99.74% and F1 of 99.70% based on 18 features in the intra-patient paradigm. By contrast, the accuracy is 92.69% with only 22 features for the inter-patient paradigm.

CONCLUSIONS

The experimental results present a superior performance compared to the state-of-the-art method. Meanwhile, above approach has the characteristic of interpretability according with diagnostic logic and strategy of clinician and specific change of ECG for MI.

Deep Learning with a Recurrent Network Structure in the Sequence Modeling of Imbalanced Data for ECG-Rhythm Classifier

The interpretation of Myocardial Infarction (MI) via electrocardiogram (ECG) signal is a challenging task. ECG signals’ morphological view show significant variation in different patients under different physical conditions. Several learning algorithms have been studied to interpret MI. However, the drawback of machine learning is the use of heuristic features with shallow feature learning architectures. To overcome this problem, a deep learning approach is used for learning features automatically, without conventional handcrafted features. This paper presents sequence modeling based on deep learning with recurrent network for ECG-rhythm signal classification. The recurrent network architecture such as a Recurrent Neural Network (RNN) is proposed to automatically interpret MI via ECG signal. The performance of the proposed method is compared to the other recurrent network classifiers such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). The objective is to obtain the best sequence model for ECG signal processing. This paper also aims to study a proper data partitioning ratio for the training and testing sets of imbalanced data. The large imbalanced data are obtained from MI and healthy control of PhysioNet: The PTB Diagnostic ECG Database 15-lead ECG signals. According to the comparison result, the LSTM architecture shows better performance than standard RNN and GRU architecture with identical hyper-parameters. The LSTM architecture also shows better classification compared to standard recurrent networks and GRU with sensitivity, specificity, precision, F1-score, BACC, and MCC is 98.49%, 97.97%, 95.67%, 96.32%, 97.56%, and 95.32%, respectively. Apparently, deep learning with the LSTM technique is a potential method for classifying sequential data that implements time steps in the ECG signal.