Mixed convolutional and long short-term memory network for the detection of lethal ventricular arrhythmia

Artificial intelligence to support out-of-hospital cardiac arrest care: A scoping review

Background

Artificial intelligence (AI) has demonstrated significant potential in supporting emergency medical services personnel during out-of-hospital cardiac arrest (OHCA) care; however, the extent of research evaluating this topic is unknown. This scoping review examines the breadth of literature on the application of AI in early OHCA care.

Methods

We conducted a search of PubMed®, Embase, and Web of Science in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews guidelines. Articles focused on non-traumatic OHCA and published prior to January 18th, 2023 were included. Studies were excluded if they did not use an AI intervention (including machine learning, deep learning, or natural language processing), or did not utilize data from the prehospital phase of care.

Results

Of 173 unique articles identified, 54 (31%) were included after screening. Of these studies, 15 (28%) were from the year 2022 and with an increasing trend annually starting in 2019. The majority were carried out by multinational collaborations (20/54, 38%) with additional studies from the United States (10/54, 19%), Korea (5/54, 10%), and Spain (3/54, 6%). Studies were classified into three major categories including ECG waveform classification and outcome prediction (24/54, 44%), early dispatch-level detection and outcome prediction (7/54, 13%), return of spontaneous circulation and survival outcome prediction (15/54, 20%), and other (9/54, 16%). All but one study had a retrospective design.

Conclusions

A small but growing body of literature exists describing the use of AI to augment early OHCA care.

MVKT-ECG: Efficient single-lead ECG classification for multi-label arrhythmia by multi-view knowledge transferring

Electrocardiogram (ECG) is a widely used technique for diagnosing cardiovascular disease. The widespread emergence of smart ECG devices has sparked the demand for intelligent single-lead ECG-based diagnostic systems. However, it is challenging to develop a single-lead-based ECG interpretation model for multiple disease diagnosis due to the lack of some key disease information. We aim to improve the diagnostic capabilities of single-lead ECG for multi-label disease classification in a new teacher-student manner, where the teacher trained by multi-lead ECG educates a student who observes only single-lead ECG We present a new disease-aware Contrastive Lead-information Transferring (CLT) to improve the mutual disease information between the single-lead-based ECG interpretation model and multi-lead-based ECG interpretation model. Moreover, We modify the traditional Knowledge Distillation into Multi-label disease Knowledge Distillation (MKD) to make it applicable for multi-label disease diagnosis. The whole knowledge transferring process is inter-lead Multi-View Knowledge Transferring of ECG (MVKT-ECG). By employing the training strategy, we can effectively transfer comprehensive disease knowledge from various views of ECG, such as the 12-lead ECG, to a single-lead-based ECG interpretation model. This enables the model to extract intricate details from single-lead ECG signals and enhances the model's capability of diagnosing and identifying single-lead signals. Extensive experiments on two commonly used public multi-label datasets, ICBEB2018 and PTB-XL demonstrate that our MVKT-ECG yields exceptional diagnostic performance improvements for single-lead ECG. The student outperforms its baseline observably on the PTB-XL dataset (1.3 % on PTB.super, and 1.4 % on PTB.sub), and on ICBEB2018 dataset (3.2 %).

Artificial intelligence and machine learning in prehospital emergency care: A scoping review

Our scoping review provides a comprehensive analysis of the landscape of artificial intelligence (AI) applications in prehospital emergency care (PEC). It contributes to the field by highlighting the most studied AI applications and identifying the most common methodological approaches across 106 included studies. The findings indicate a promising future for AI in PEC, with many unique use cases, such as prognostication, demand prediction, resource optimization, and the Internet of Things continuous monitoring systems. Comparisons with other approaches showed AI outperforming clinicians and non-AI algorithms in most cases. However, most studies were internally validated and retrospective, highlighting the need for rigorous prospective validation of AI applications before implementation in clinical settings. We identified knowledge and methodological gaps using an evidence map, offering a roadmap for future investigators. We also discussed the significance of explainable AI for establishing trust in AI systems among clinicians and facilitating real-world validation of AI models.

Diagnosis of sudden cardiac arrest using principal component analysis in automated external defibrillators

Sudden cardiac arrest (SCA) consisting of ventricular fibrillation and ventricular tachycardia considered as shockable rhythms is a life-threatening heart disease, which is treated efficiently by the automated external defibrillator (AED). This work proposes a novel design of the SAA, which includes a k-nearest neighbors model and a subset of 8 features extracted from the ECG segments, for the SCA diagnosis on the electrocardiogram (ECG) signal. These features are addressed as the most productive subset among 31 input features based on the evaluation of the feature correlation. The recursive feature elimination algorithm combined with the Boosting model and wise-patient fivefold cross-validation method is adopted for the calculation of the average feature importance, which shows the degree of feature correlation, to construct various input feature subsets. Moreover, component feature combinations known as the representatives of the input feature subsets with an enormous level of correlation and independence are transformed from the input subsets by the principal component analysis method. The wise-patient fivefold cross-validation procedure is used for the evaluation of these component feature combinations on the validation set. The proposed SAA is certainly efficient for SCA detection with a small number of the extracted feature and relatively high diagnosis performance such as accuracy of 99.52%, sensitivity of 97.69%, and specificity of 99.91%.

Deep Learning Strategy for Sliding ECG Analysis during Cardiopulmonary Resuscitation: Influence of the Hands-Off Time on Accuracy

This study aims to present a novel deep learning algorithm for a sliding shock advisory decision during cardiopulmonary resuscitation (CPR) and its performance evaluation as a function of the cumulative hands-off time. We retrospectively used 13,570 CPR episodes from out-of-hospital cardiac arrest (OHCA) interventions reviewed in a period of interest from 30 s before to 10 s after regular analysis of automated external defibrillators (AEDs). Three convolutional neural networks (CNNs) with raw ECG input (duration of 5, 10, and 15 s) were applied for the shock advisory decision during CPR in 26 sequential analyses shifted by 1 s. The start and stop of chest compressions (CC) can occur at arbitrary times in sequential slides; therefore, the sliding hands-off time (sHOT) quantifies the cumulative CC-free portion of the analyzed ECG. An independent test with CPR episodes in 393 ventricular fibrillations (VF), 177 normal sinus rhythms (NSR), 1848 other non-shockable rhythms (ONR), and 3979 asystoles (ASYS) showed a substantial improvement of VF sensitivity when increasing the analysis duration from 5 s to 10 s. Specificity was not dependent on the ECG analysis duration. The 10 s CNN model presented the best performance: 92-94.4% (VF), 92.2-94% (ASYS), 96-97% (ONR), and 98.2-99.5% (NSR) for sliding decision times during CPR; 98-99% (VF), 98.2-99.8% (ASYS), 98.8-99.1 (ONR), and 100% (NSR) for sliding decision times after end of CPR. We identified the importance of sHOT as a reliable predictor of performance, accounting for the minimal sHOT interval of 2-3 s that provides a reliable rhythm detection satisfying the American Heart Association (AHA) standards for AED rhythm analysis. The presented technology for sliding shock advisory decision during CPR achieved substantial performance improvement in short hands-off periods (>2 s), such as insufflations or pre-shock pauses. The performance was competitive despite 1-2.8% point lower ASYS detection during CPR than the standard requirement (95%) for non-noisy ECG signals. The presented deep learning strategy is a basis for improved CPR practices involving both continuous CC and CC with insufflations, associated with minimal CC interruptions for reconfirmation of non-shockable rhythms (minimum hands-off time) and early treatment of VF (minimal pre-shock pauses).

Current and Future Use of Artificial Intelligence in Electrocardiography

Artificial intelligence (AI) is increasingly used in electrocardiography (ECG) to assist in diagnosis, stratification, and management. AI algorithms can help clinicians in the following areas: (1) interpretation and detection of arrhythmias, ST-segment changes, QT prolongation, and other ECG abnormalities; (2) risk prediction integrated with or without clinical variables (to predict arrhythmias, sudden cardiac death, stroke, and other cardiovascular events); (3) monitoring ECG signals from cardiac implantable electronic devices and wearable devices in real time and alerting clinicians or patients when significant changes occur according to timing, duration, and situation; (4) signal processing, improving ECG quality and accuracy by removing noise/artifacts/interference, and extracting features not visible to the human eye (heart rate variability, beat-to-beat intervals, wavelet transforms, sample-level resolution, etc.); (5) therapy guidance, assisting in patient selection, optimizing treatments, improving symptom-to-treatment times, and cost effectiveness (earlier activation of code infarction in patients with ST-segment elevation, predicting the response to antiarrhythmic drugs or cardiac implantable devices therapies, reducing the risk of cardiac toxicity, etc.); (6) facilitating the integration of ECG data with other modalities (imaging, genomics, proteomics, biomarkers, etc.). In the future, AI is expected to play an increasingly important role in ECG diagnosis and management, as more data become available and more sophisticated algorithms are developed.

Convolution Neural Network Algorithm for Shockable Arrhythmia Classification Within a Digitally Connected Automated External Defibrillator

Background Diagnosis of shockable rhythms leading to defibrillation remains integral to improving out-of-hospital cardiac arrest outcomes. New machine learning techniques have emerged to diagnose arrhythmias on ECGs. In out-of-hospital cardiac arrest, an algorithm within an automated external defibrillator is the major determinant to deliver defibrillation. This study developed and validated the performance of a convolution neural network (CNN) to diagnose shockable arrhythmias within a novel, miniaturized automated external defibrillator. Methods and Results There were 26 464 single-lead ECGs that comprised the study data set. ECGs of 7-s duration were retrospectively adjudicated by 3 physician readers (N=18 total readers). After exclusions (N=1582), ECGs were divided into training (N=23 156), validation (N=721), and test data sets (N=1005). CNN performance to diagnose shockable and nonshockable rhythms was reported with area under the receiver operating characteristic curve analysis, F1, and sensitivity and specificity calculations. The duration for the CNN to output was reported with the algorithm running within the automated external defibrillator. Internal and external validation analyses included CNN performance among arrhythmias, often mistaken for shockable rhythms, and performance among ECGs modified with noise to mimic artifacts. The CNN algorithm achieved an area under the receiver operating characteristic curve of 0.995 (95% CI, 0.990-1.0), sensitivity of 98%, and specificity of 100% to diagnose shockable rhythms. The F1 scores were 0.990 and 0.995 for shockable and nonshockable rhythms, respectively. After input of a 7-s ECG, the CNN generated an output in 383±29 ms (total time of 7.383 s). The CNN outperformed adjudicators in classifying atrial arrhythmias as nonshockable (specificity of 99.3%-98.1%) and was robust against noise artifacts (area under the receiver operating characteristic curve range, 0.871-0.999). Conclusions We demonstrate high diagnostic performance of a CNN algorithm for shockable and nonshockable rhythm arrhythmia classifications within a digitally connected automated external defibrillator. Registration URL: https://clinicaltrials.gov/ct2/show/NCT03662802; Unique identifier: NCT03662802.

Real-time amplitude spectrum area estimation during chest compression from the ECG waveform using a 1D convolutional neural network

Introduction: Amplitude spectrum area (AMSA) is a well-established measure than can predict defibrillation outcome and guiding individualized resuscitation of ventricular fibrillation (VF) patients. However, accurate AMSA can only be calculated during cardiopulmonary resuscitation (CPR) pause due to artifacts produced by chest compression (CC). In this study, we developed a real-time AMSA estimation algorithm using a convolutional neural network (CNN). Methods: Data were collected from 698 patients, and the AMSA calculated from the uncorrupted signals served as the true value for both uncorrupted and the adjacent corrupted signals. An architecture consisting of a 6-layer 1D CNN and 3 fully connected layers was developed for AMSA estimation. A 5-fold cross-validation procedure was used to train, validate and optimize the algorithm. An independent testing set comprised of simulated data, real-life CC corrupted data, and preshock data was used to evaluate the performance. Results: The mean absolute error, root mean square error, percentage root mean square difference and correlation coefficient were 2.182/1.951 mVHz, 2.957/2.574 mVHz, 22.887/28.649% and 0.804/0.888 for simulated and real-life testing data, respectively. The area under the receiver operating characteristic curve regarding predicting defibrillation success was 0.835, which was comparable to that of 0.849 using the true value of the AMSA. Conclusions: AMSA can be accurately estimated during uninterrupted CPR using the proposed method.

A systematic review and Meta-data analysis on the applications of Deep Learning in Electrocardiogram

The success of deep learning over the traditional machine learning techniques in handling artificial intelligence application tasks such as image processing, computer vision, object detection, speech recognition, medical imaging and so on, has made deep learning the buzz word that dominates Artificial Intelligence applications. From the last decade, the applications of deep learning in physiological signals such as electrocardiogram (ECG) have attracted a good number of research. However, previous surveys have not been able to provide a systematic comprehensive review including biometric ECG based systems of the applications of deep learning in ECG with respect to domain of applications. To address this gap, we conducted a systematic literature review on the applications of deep learning in ECG including biometric ECG based systems. The study analyzed systematically, 150 primary studies with evidence of the application of deep learning in ECG. The study shows that the applications of deep learning in ECG have been applied in different domains. We presented a new taxonomy of the domains of application of the deep learning in ECG. The paper also presented discussions on biometric ECG based systems and meta-data analysis of the studies based on the domain, area, task, deep learning models, dataset sources and preprocessing methods. Challenges and potential research opportunities were highlighted to enable novel research. We believe that this study will be useful to both new researchers and expert researchers who are seeking to add knowledge to the already existing body of knowledge in ECG signal processing using deep learning algorithm.

Supplementary information

The online version contains supplementary material available at 10.1007/s12652-022-03868-z.

Role of artificial intelligence in defibrillators: a narrative review

Automated external defibrillators (AEDs) and implantable cardioverter defibrillators (ICDs) are used to treat life-threatening arrhythmias. AEDs and ICDs use shock advice algorithms to classify ECG tracings as shockable or non-shockable rhythms in clinical practice. Machine learning algorithms have recently been assessed for shock decision classification with increasing accuracy. Outside of rhythm classification alone, they have been evaluated in diagnosis of causes of cardiac arrest, prediction of success of defibrillation and rhythm classification without the need to interrupt cardiopulmonary resuscitation. This review explores the many applications of machine learning in AEDs and ICDs. While these technologies are exciting areas of research, there remain limitations to their widespread use including high processing power, cost and the ‘black-box’ phenomenon.

Similarity Maps for Ventricular Arrhythmia Classification

Ventricular arrhythmias are the primary arrhythmias that cause sudden cardiac death. In current clinical and preclinical research, the discovery of new therapies and their translation is hampered by the lack of consistency in diagnostic criteria for distinguishing between ventricular tachycardia (VT) and ventricular fibrillation (VF). This study develops a new set of features, similarity maps, for discrimination between VT and VF using deep neural network architectures. The similarity maps are designed to capture the similarity and the regularity within an ECG trace. Our experiments show that the similarity maps lead to a substantial improvement in distinguishing VT and VF.

Clinical Applications of Artificial Intelligence-An Updated Overview

Artificial intelligence has the potential to revolutionize modern society in all its aspects. Encouraged by the variety and vast amount of data that can be gathered from patients (e.g., medical images, text, and electronic health records), researchers have recently increased their interest in developing AI solutions for clinical care. Moreover, a diverse repertoire of methods can be chosen towards creating performant models for use in medical applications, ranging from disease prediction, diagnosis, and prognosis to opting for the most appropriate treatment for an individual patient. In this respect, the present paper aims to review the advancements reported at the convergence of AI and clinical care. Thus, this work presents AI clinical applications in a comprehensive manner, discussing the recent literature studies classified according to medical specialties. In addition, the challenges and limitations hindering AI integration in the clinical setting are further pointed out.

A review of progress and an advanced method for shock advice algorithms in automated external defibrillators

Shock advice algorithm plays a vital role in the detection of sudden cardiac arrests on electrocardiogram signals and hence, brings about survival improvement by delivering prompt defibrillation. The last decade has witnessed a surge of research efforts in racing for efficient shock advice algorithms, in this context. On one hand, it has been reported that the classification performance of traditional threshold-based methods has not complied with the American Heart Association recommendations. On the other hand, the rise of machine learning and deep learning-based counterparts is paving the new ways for the development of intelligent shock advice algorithms. In this paper, we firstly provide a comprehensive survey on the development of shock advice algorithms for rhythm analysis in automated external defibrillators. Shock advice algorithms are categorized into three groups based on the classification methods in which the detection performance is significantly improved by the use of machine learning and/or deep learning techniques instead of threshold-based approaches. Indeed, in threshold-based shock advice algorithms, a parameter is calculated as a threshold to distinguish shockable rhythms from non-shockable ones. In contrast, machine learning-based methods combine multiple parameters of conventional threshold-based approaches as a set of features to recognize sudden cardiac arrest. Noticeably, those features are possibly extracted from stand-alone ECGs, alternative signals using various decomposition techniques, or fully augmented ECG segments. Moreover, these signals can be also used directly as the input channels of deep learning-based shock advice algorithm designs. Then, we propose an advanced shock advice algorithm using a support vector machine classifier and a feature set extracted from a fully augmented ECG segment with its shockable and non-shockable signals. The relatively high detection performance of the proposed shock advice algorithm implies a potential application for the automated external defibrillator in the practical clinic environment. Finally, we outline several interesting yet challenging research problems for further investigation.

Machine learning techniques for arrhythmic risk stratification: a review of the literature

Ventricular arrhythmias (VAs) and sudden cardiac death (SCD) are significant adverse events that affect the morbidity and mortality of both the general population and patients with predisposing cardiovascular risk factors. Currently, conventional disease-specific scores are used for risk stratification purposes. However, these risk scores have several limitations, including variations among validation cohorts, the inclusion of a limited number of predictors while omitting important variables, as well as hidden relationships between predictors. Machine learning (ML) techniques are based on algorithms that describe intervariable relationships. Recent studies have implemented ML techniques to construct models for the prediction of fatal VAs. However, the application of ML study findings is limited by the absence of established frameworks for its implementation, in addition to clinicians’ unfamiliarity with ML techniques. This review, therefore, aims to provide an accessible and easy-to-understand summary of the existing evidence about the use of ML techniques in the prediction of VAs. Our findings suggest that ML algorithms improve arrhythmic prediction performance in different clinical settings. However, it should be emphasized that prospective studies comparing ML algorithms to conventional risk models are needed while a regulatory framework is required prior to their implementation in clinical practice.

Can Prehospital Data Improve Early Identification of Sepsis in Emergency Department? An Integrative Review of Machine Learning Approaches

BACKGROUND

Sepsis is associated with high mortality, especially during the novel coronavirus disease 2019 (COVID-19) pandemic. Along with high monetary health care costs for sepsis treatment, there is a lasting impact on lives of sepsis survivors and their caregivers. Early identification is necessary to reduce the negative impact of sepsis and to improve patient outcomes. Prehospital data are among the earliest information collected by health care systems. Using these untapped sources of data in machine learning (ML)-based approaches can identify patients with sepsis earlier in emergency department (ED).

OBJECTIVES

This integrative literature review aims to discuss the importance of utilizing prehospital data elements in ED, summarize their current use in developing ML-based prediction models, and specifically identify those data elements that can potentially contribute to early identification of sepsis in ED when used in ML-based approaches.

METHOD

Literature search strategy includes following two separate searches: (1) use of prehospital data in ML models in ED; and (2) ML models that are developed specifically to predict/detect sepsis in ED. In total, 24 articles are used in this review.

RESULTS

A summary of prehospital data used to identify time-sensitive conditions earlier in ED is provided. Literature related to use of ML models for early identification of sepsis in ED is limited and no studies were found related to ML models using prehospital data in prediction/early identification of sepsis in ED. Among those using ED data, ML models outperform traditional statistical models. In addition, the use of the free-text elements and natural language processing (NLP) methods could result in better prediction of sepsis in ED.

CONCLUSION

This study reviews the use of prehospital data in early decision-making in ED and suggests that researchers utilize such data elements for prediction/early identification of sepsis in ML-based approaches.

A Primer on the Present State and Future Prospects for Machine Learning and Artificial Intelligence Applications in Cardiology

The artificial intelligence (AI) revolution is well underway, including in the medical field, and has dramatically transformed our lives. An understanding of the basics of AI applications, their development, and challenges to their clinical implementation is important for clinicians to fully appreciate the possibilities of AI. Such a foundation would ensure that clinicians have a good grasp and realistic expectations for AI in medicine and prevent discrepancies between the promised and real-world impact. When quantifying the track record for AI applications in cardiology, we found that a substantial number of AI systems are never deployed in clinical practice, although there certainly are many success stories. Successful implementations shared the following: they came from clinical areas where large amount of training data was available; were deployable into a single diagnostic modality; prediction models generally had high performance on external validation; and most were developed as part of collaborations with medical device manufacturers who had substantial experience with implementation of new technology. When looking into the current processes used for developing AI-based systems, we suggest that expanding the analytic framework to address potential deployment and implementation issues at project outset will improve the rate of successful implementation, and will be a necessary next step for AI to achieve its full potential in cardiovascular medicine.

A deep learning algorithm to translate and classify cardiac electrophysiology

The development of induced pluripotent stem cell-derived cardiomyocytes (iPSC-CMs) has been a critical in vitro advance in the study of patient-specific physiology, pathophysiology, and pharmacology. We designed a new deep learning multitask network approach intended to address the low throughput, high variability, and immature phenotype of the iPSC-CM platform. The rationale for combining translation and classification tasks is because the most likely application of the deep learning technology we describe here is to translate iPSC-CMs following application of a perturbation. The deep learning network was trained using simulated action potential (AP) data and applied to classify cells into the drug-free and drugged categories and to predict the impact of electrophysiological perturbation across the continuum of aging from the immature iPSC-CMs to the adult ventricular myocytes. The phase of the AP extremely sensitive to perturbation due to a steep rise of the membrane resistance was found to contain the key information required for successful network multitasking. We also demonstrated successful translation of both experimental and simulated iPSC-CM AP data validating our network by prediction of experimental drug-induced effects on adult cardiomyocyte APs by the latter.

Optimization of End-to-End Convolutional Neural Networks for Analysis of Out-of-Hospital Cardiac Arrest Rhythms during Cardiopulmonary Resuscitation

High performance of the shock advisory analysis of the electrocardiogram (ECG) during cardiopulmonary resuscitation (CPR) in out-of-hospital cardiac arrest (OHCA) is important for better management of the resuscitation protocol. It should provide fewer interruptions of chest compressions (CC) for non-shockable organized rhythms (OR) and Asystole, or prompt CC stopping for early treatment of shockable ventricular fibrillation (VF). Major disturbing factors are strong CC artifacts corrupting raw ECG, which we aimed to analyze with optimized end-to-end convolutional neural network (CNN) without pre-filtering or additional sensors. The hyperparameter random search of 1500 CNN models with 2-7 convolutional layers, 5-50 filters and 5-100 kernel sizes was done on large databases from independent OHCA interventions for training (3001 samples) and validation (2528 samples). The best model, named CNN3-CC-ECG network with three convolutional layers (filters@kernels: 5@5,25@20,50@20) presented Sensitivity Se(VF) = 89%(268/301), Specificity Sp(OR) = 91.7%(1504/1640), Sp(Asystole) = 91.1%(3325/3650) on an independent test OHCA database. CNN3-CC-ECG's ability to effectively extract features from raw ECG signals during CPR was comprehensively demonstrated, and the dependency on the CPR corruption level in ECG was tested. We denoted a significant drop of Se(VF) = 74.2% and Sp(OR) = 84.6% in very strong CPR artifacts with a signal-to-noise ratio of SNR < -9 dB, p < 0.05. Otherwise, for strong, moderate and weak CC artifacts (SNR > -9 dB, -6 dB, -3 dB), we observed insignificant performance differences: Se(VF) = 92.5-96.3%, Sp(OR) = 93.4-95.5%, Sp(Asystole) = 92.6-94.0%, p > 0.05. Performance stability with respect to CC rate was validated. Generalizable application of the optimized computationally efficient CNN model was justified by an independent OHCA database, which to our knowledge is the largest test dataset with real-life cardiac arrest rhythms during CPR.

Heartbeat Classification Based on Multifeature Combination and Stacking-DWKNN Algorithm

Arrhythmia is one of the most common abnormal symptoms that can threaten human life. In order to distinguish arrhythmia more accurately, the classification strategy of the multifeature combination and Stacking-DWKNN algorithm is proposed in this paper. The method consists of four modules. In the preprocessing module, the signal is denoised and segmented. Then, multiple different features are extracted based on single heartbeat morphology, P length, QRS length, T length, PR interval, ST segment, QT interval, RR interval, R amplitude, and T amplitude. Subsequently, the features are combined and normalized, and the effect of different feature combinations on heartbeat classification is analyzed to select the optimal feature combination. Finally, the four types of normal and abnormal heartbeats were identified using the Stacking-DWKNN algorithm. This method is performed on the MIT-BIH arrhythmia database. The result shows a sensitivity of 89.42% and a positive predictive value of 94.90% of S-type beats and a sensitivity of 97.21% and a positive predictive value of 97.07% of V-type beats. The obtained average accuracy is 99.01%. Compared to other models with the same features, this method can improve accuracy and has a higher positive predictive value and sensitivity, which is important for clinical decision-making.

Detection of ventricular arrhythmia using hybrid time-frequency-based features and deep neural network

Sudden cardiac death (SCD) is a major cause of death among patients with heart diseases. It occurs mainly due to ventricular tachyarrhythmia (VTA) which includes ventricular tachycardia (VT) and ventricular fibrillation (VF) conditions. The main challenging task is to predict the VTA condition at a faster rate and timely application of automatic external defibrillator (AED) for saving lives. In this study, a VF/VT classification scheme has been proposed using a deep neural network (DNN) approach using hybrid time-frequency-based features. Two annotated public domain ECG databases (CUDB and VFDB) were used as training, test, and validation of datasets. The main motivation of this study was to implement a deep learning model for the classification of the VF/VT conditions and compared the results with other standard machine learning algorithms. The signal is decomposed with the wavelet transform, empirical mode decomposition (EMD) and variable mode decomposition (VMD) approaches and twenty-four are extracted to form a hybrid model from a window of length 5 s length. The DNN classifier achieved an accuracy (Acc) of 99.2%, sensitivity (Se) of 98.8%, and specificity (Sp) of 99.3% which is comparatively better than the results of the standard classifier. The proposed algorithm can detect VTA conditions accurately, hence could reduce the rate of misinterpretations by human experts and improves the efficiency of cardiac diagnosis by ECG signal analysis.

A Novel Method for Quantitative Analysis of C-Reactive Protein Lateral Flow Immunoassays Images via CMOS Sensor and Recurrent Neural Networks

Objective: To design and implement an easy-to-use, Point-of-Care (PoC) lateral flow immunoassays (LFA) reader and data analysis system, which provides a more in-depth quantitative analysis for LFA images than conventional approaches thereby supporting efficient decision making for potential early risk assessment of cardiovascular disease (CVD). Methods and procedures: A novel end-to-end system was developed including a portable device with CMOS camera integrated with optimized illumination and optics to capture the LFA images produced using high-sensitivity C-Reactive Protein (hsCRP) (concentration level < 5 mg/L). The images were transmitted via WiFi to a back-end server system for image analysis and classification. Unlike common image classification approaches which are based on averaging image intensity from a region-of-interest (ROI), a novel approach was developed which considered the signal along the sample’s flow direction as a time series and, consequently, no need for ROI detection. Long Short-Term Memory (LSTM) networks were deployed for multilevel classification. The features based on Dynamic Time Warping (DTW) and histogram bin counts (HBC) were explored for classification. Results: For the classification of hsCRP, the LSTM outperformed the traditional machine learning classifiers with or without DTW and HBC features performed the best (with mean accuracy of 94%) compared to other features. Application of the proposed method to human plasma also suggests that HBC features from LFA time series performed better than the mean from ROI and raw LFA data. Conclusion: As a proof of concept, the results demonstrate the capability of the proposed framework for quantitative analysis of LFA images and suggest the potential for early risk assessment of CVD. Clinical impact: The hsCRP levels < 5 mg/L were aligned with clinically actionable categories for early risk assessment of CVD. The outcomes demonstrated the real-world applicability of the proposed system for quantitative analysis of LFA images, which is potentially useful for more LFA applications beyond presented in this study.

Deep learning to find colorectal polyps in colonoscopy: A systematic literature review

Colorectal cancer has a great incidence rate worldwide, but its early detection significantly increases the survival rate. Colonoscopy is the gold standard procedure for diagnosis and removal of colorectal lesions with potential to evolve into cancer and computer-aided detection systems can help gastroenterologists to increase the adenoma detection rate, one of the main indicators for colonoscopy quality and predictor for colorectal cancer prevention. The recent success of deep learning approaches in computer vision has also reached this field and has boosted the number of proposed methods for polyp detection, localization and segmentation. Through a systematic search, 35 works have been retrieved. The current systematic review provides an analysis of these methods, stating advantages and disadvantages for the different categories used; comments seven publicly available datasets of colonoscopy images; analyses the metrics used for reporting and identifies future challenges and recommendations. Convolutional neural networks are the most used architecture together with an important presence of data augmentation strategies, mainly based on image transformations and the use of patches. End-to-end methods are preferred over hybrid methods, with a rising tendency. As for detection and localization tasks, the most used metric for reporting is the recall, while Intersection over Union is highly used in segmentation. One of the major concerns is the difficulty for a fair comparison and reproducibility of methods. Even despite the organization of challenges, there is still a need for a common validation framework based on a large, annotated and publicly available database, which also includes the most convenient metrics to report results. Finally, it is also important to highlight that efforts should be focused in the future on proving the clinical value of the deep learning based methods, by increasing the adenoma detection rate.

Opportunities and challenges of deep learning methods for electrocardiogram data: A systematic review

BACKGROUND

The electrocardiogram (ECG) is one of the most commonly used diagnostic tools in medicine and healthcare. Deep learning methods have achieved promising results on predictive healthcare tasks using ECG signals.

OBJECTIVE

This paper presents a systematic review of deep learning methods for ECG data from both modeling and application perspectives.

METHODS

We extracted papers that applied deep learning (deep neural network) models to ECG data that were published between January 1st of 2010 and February 29th of 2020 from Google Scholar, PubMed, and the Digital Bibliography & Library Project. We then analyzed each article according to three factors: tasks, models, and data. Finally, we discuss open challenges and unsolved problems in this area.

RESULTS

The total number of papers extracted was 191. Among these papers, 108 were published after 2019. Different deep learning architectures have been used in various ECG analytics tasks, such as disease detection/classification, annotation/localization, sleep staging, biometric human identification, and denoising.

CONCLUSION

The number of works on deep learning for ECG data has grown explosively in recent years. Such works have achieved accuracy comparable to that of traditional feature-based approaches and ensembles of multiple approaches can achieve even better results. Specifically, we found that a hybrid architecture of a convolutional neural network and recurrent neural network ensemble using expert features yields the best results. However, there are some new challenges and problems related to interpretability, scalability, and efficiency that must be addressed. Furthermore, it is also worth investigating new applications from the perspectives of datasets and methods.

SIGNIFICANCE

This paper summarizes existing deep learning research using ECG data from multiple perspectives and highlights existing challenges and problems to identify potential future research directions.

Rhythm Analysis during Cardiopulmonary Resuscitation Using Convolutional Neural Networks

Chest compressions during cardiopulmonary resuscitation (CPR) induce artifacts in the ECG that may provoque inaccurate rhythm classification by the algorithm of the defibrillator. The objective of this study was to design an algorithm to produce reliable shock/no-shock decisions during CPR using convolutional neural networks (CNN). A total of 3319 ECG segments of 9 s extracted during chest compressions were used, whereof 586 were shockable and 2733 nonshockable. Chest compression artifacts were removed using a Recursive Least Squares (RLS) filter, and the filtered ECG was fed to a CNN classifier with three convolutional blocks and two fully connected layers for the shock/no-shock classification. A 5-fold cross validation architecture was adopted to train/test the algorithm, and the proccess was repeated 100 times to statistically characterize the performance. The proposed architecture was compared to the most accurate algorithms that include handcrafted ECG features and a random forest classifier (baseline model). The median (90% confidence interval) sensitivity, specificity, accuracy and balanced accuracy of the method were 95.8% (94.6-96.8), 96.1% (95.8-96.5), 96.1% (95.7-96.4) and 96.0% (95.5-96.5), respectively. The proposed algorithm outperformed the baseline model by 0.6-points in accuracy. This new approach shows the potential of deep learning methods to provide reliable diagnosis of the cardiac rhythm without interrupting chest compression therapy.

Fully Convolutional Deep Neural Networks with Optimized Hyperparameters for Detection of Shockable and Non-Shockable Rhythms

Deep neural networks (DNN) are state-of-the-art machine learning algorithms that can be learned to self-extract significant features of the electrocardiogram (ECG) and can generally provide high-output diagnostic accuracy if subjected to robust training and optimization on large datasets at high computational cost. So far, limited research and optimization of DNNs in shock advisory systems is found on large ECG arrhythmia databases from out-of-hospital cardiac arrests (OHCA). The objective of this study is to optimize the hyperparameters (HPs) of deep convolutional neural networks (CNN) for detection of shockable (Sh) and nonshockable (NSh) rhythms, and to validate the best HP settings for short and long analysis durations (2-10 s). Large numbers of (Sh + NSh) ECG samples were used for training (720 + 3170) and validation (739 + 5921) from Holters and defibrillators in OHCA. An end-to-end deep CNN architecture was implemented with one-lead raw ECG input layer (5 s, 125 Hz, 2.5 uV/LSB), configurable number of 5 to 23 hidden layers and output layer with diagnostic probability p ∈ [0: Sh,1: NSh]. The hidden layers contain N convolutional blocks × 3 layers (Conv1D (filters = Fi, kernel size = Ki), max-pooling (pool size = 2), dropout (rate = 0.3)), one global max-pooling and one dense layer. Random search optimization of HPs = {N, Fi, Ki}, i = 1, … N in a large grid of N = [1, 2, … 7], Fi = [5;50], Ki = [5;100] was performed. During training, the model with maximal balanced accuracy BAC = (Sensitivity + Specificity)/2 over 400 epochs was stored. The optimization principle is based on finding the common HPs space of a few top-ranked models and prediction of a robust HP setting by their median value. The optimal models for 1-7 CNN layers were trained with different learning rates LR = [10-5; 10-2] and the best model was finally validated on 2-10 s analysis durations. A number of 4216 random search models were trained. The optimal models with more than three convolutional layers did not exhibit substantial differences in performance BAC = (99.31-99.5%). Among them, the best model was found with {N = 5, Fi = {20, 15, 15, 10, 5}, Ki = {10, 10, 10, 10, 10}, 7521 trainable parameters} with maximal validation performance for 5-s analysis (BAC = 99.5%, Se = 99.6%, Sp = 99.4%) and tolerable drop in performance (<2% points) for very short 2-s analysis (BAC = 98.2%, Se = 97.6%, Sp = 98.7%). DNN application in future-generation shock advisory systems can improve the detection performance of Sh and NSh rhythms and can considerably shorten the analysis duration complying with resuscitation guidelines for minimal hands-off pauses.

Deep learning in Emergency Medicine: Recent contributions and methodological challenges

In the last few years, artificial intelligence (AI) technology has grown dramatically impacting several fields of human knowledge and medicine in particular. Among other approaches, deep learning, which is a subset of AI based on specific computational models, such as deep convolutional neural networks and recurrent neural networks, has shown exceptional performance in images and signals processing. Accordingly, emergency medicine will benefit from the adoption of this technology. However, a particular attention should be devoted to the review of these papers in order to exclude overoptimistic results from clinically transferable ones. We presented a group of studies recently published on PubMed and selected by keywords ‘deep learning emergency medicine’ and ‘artificial intelligence emergency medicine’ with the aim of highlighting their methodological strengths and weaknesses, as well as their clinical usefulness.

Deep Learning in Physiological Signal Data: A Survey

Deep Learning (DL), a successful promising approach for discriminative and generative tasks, has recently proved its high potential in 2D medical imaging analysis; however, physiological data in the form of 1D signals have yet to be beneficially exploited from this novel approach to fulfil the desired medical tasks. Therefore, in this paper we survey the latest scientific research on deep learning in physiological signal data such as electromyogram (EMG), electrocardiogram (ECG), electroencephalogram (EEG), and electrooculogram (EOG). We found 147 papers published between January 2018 and October 2019 inclusive from various journals and publishers. The objective of this paper is to conduct a detailed study to comprehend, categorize, and compare the key parameters of the deep-learning approaches that have been used in physiological signal analysis for various medical applications. The key parameters of deep-learning approach that we review are the input data type, deep-learning task, deep-learning model, training architecture, and dataset sources. Those are the main key parameters that affect system performance. We taxonomize the research works using deep-learning method in physiological signal analysis based on: (1) physiological signal data perspective, such as data modality and medical application; and (2) deep-learning concept perspective such as training architecture and dataset sources.