Monitoring significant ST changes through deep learning

Machine learning based hybrid anomaly detection technique for automatic diagnosis of cardiovascular diseases using cardiac sympathetic nerve activity and electrocardiogram

OBJECTIVES

Coronary artery diseases (CADs) are the leading cause of death worldwide and early diagnosis is crucial for timely treatment. To address this, our study presents a novel automated Artificial Intelligence (AI)-based Hybrid Anomaly Detection (AIHAD) technique that combines various signal processing, feature extraction, supervised, and unsupervised machine learning methods. By jointly and simultaneously analyzing 12-lead cardiac sympathetic nerve activity (CSNA) and electrocardiogram (ECG) data, the automated AIHAD technique performs fast, early, and accurate diagnosis of CADs.

METHODS

In order to develop and evaluate the proposed automated AIHAD technique, we utilized the fully labeled STAFF III and PTBD databases, which contain the 12-lead wideband raw recordings non-invasively acquired from 260 subjects. Using these wideband raw recordings, we developed a signal processing technique that simultaneously detects the 12-lead CSNA and ECG signals of all subjects. Using the pre-processed 12-lead CSNA and ECG signals, we developed a time-domain feature extraction technique that extracts the statistical CSNA and ECG features critical for the reliable diagnosis of CADs. Using the extracted discriminative features, we developed a supervised classification technique based on Artificial Neural Networks (ANNs) that simultaneously detects anomalies in the 12-lead CSNA and ECG data. Furthermore, we developed an unsupervised clustering technique based on Gaussian mixture models (GMMs) and Neyman-Pearson criterion, which robustly detects outliers corresponding to CADs.

RESULTS

Using the automated AIHAD technique, we have, for the first time, demonstrated a significant association between the increase in CSNA signals and anomalies in ECG signals during CADs. The AIHAD technique achieved highly reliable detection of CADs with a sensitivity of 98.48 %, specificity of 97.73 %, accuracy of 98.11 %, positive predictive value of 97.74 %, negative predictive value of 98.47 %, and F1-score of 98.11 %. Hence, the automated AIHAD technique demonstrates superior performance compared to the gold standard diagnostic test ECG in the diagnosis of CADs. Additionally, it outperforms other techniques developed in this study that separately utilize either only CSNA data or only ECG data. Therefore, it significantly increases the detection performance of CADs by taking advantage of the diversity in different data types and leveraging their strengths. Furthermore, its performance is comparatively better than that of most previously proposed machine and deep learning methods that exclusively used ECG data to diagnose or classify CADs. Additionally, it has a very low implementation time, which is highly desirable for real-time detection of CADs.

CONCLUSIONS

The proposed automated AIHAD technique may serve as an efficient decision-support system to increase physicians' success in fast, early, and accurate diagnosis of CADs. It may be highly beneficial and valuable, particularly for asymptomatic patients, for whom the diagnostic information provided by ECG alone is not sufficient to reliably diagnose the disease. Hence, it may significantly improve patient outcomes by enabling timely treatments and considerably reducing the mortality of cardiovascular diseases (CVDs).

Materials-Driven Soft Wearable Bioelectronics for Connected Healthcare

In the era of Internet-of-things, many things can stay connected; however, biological systems, including those necessary for human health, remain unable to stay connected to the global Internet due to the lack of soft conformal biosensors. The fundamental challenge lies in the fact that electronics and biology are distinct and incompatible, as they are based on different materials via different functioning principles. In particular, the human body is soft and curvilinear, yet electronics are typically rigid and planar. Recent advances in materials and materials design have generated tremendous opportunities to design soft wearable bioelectronics, which may bridge the gap, enabling the ultimate dream of connected healthcare for anyone, anytime, and anywhere. We begin with a review of the historical development of healthcare, indicating the significant trend of connected healthcare. This is followed by the focal point of discussion about new materials and materials design, particularly low-dimensional nanomaterials. We summarize material types and their attributes for designing soft bioelectronic sensors; we also cover their synthesis and fabrication methods, including top-down, bottom-up, and their combined approaches. Next, we discuss the wearable energy challenges and progress made to date. In addition to front-end wearable devices, we also describe back-end machine learning algorithms, artificial intelligence, telecommunication, and software. Afterward, we describe the integration of soft wearable bioelectronic systems which have been applied in various testbeds in real-world settings, including laboratories that are preclinical and clinical environments. Finally, we narrate the remaining challenges and opportunities in conjunction with our perspectives.

Deep Learning for Detecting and Locating Myocardial Infarction by Electrocardiogram: A Literature Review

Myocardial infarction is a common cardiovascular disorder caused by prolonged ischemia, and early diagnosis of myocardial infarction (MI) is critical for lifesaving. ECG is a simple and non-invasive approach in MI detection, localization, diagnosis, and prognosis. Population-based screening with ECG can detect MI early and help prevent it but this method is too labor-intensive and time-consuming to carry out in practice unless artificial intelligence (AI) would be able to reduce the workload. Recent advances in using deep learning (DL) for ECG screening might rekindle this hope. This review aims to take stock of 59 major DL studies applied to the ECG for MI detection and localization published in recent 5 years, covering convolutional neural network (CNN), long short-term memory (LSTM), convolutional recurrent neural network (CRNN), gated recurrent unit (GRU), residual neural network (ResNet), and autoencoder (AE). In this period, CNN obtained the best popularity in both MI detection and localization, and the highest performance has been obtained from CNN and ResNet model. The reported maximum accuracies of the six different methods are all beyond 97%. Considering the usage of different datasets and ECG leads, the network that trained on 12 leads ECG data of PTB database has obtained higher accuracy than that on smaller number leads data of other datasets. In addition, some limitations and challenges of the DL techniques are also discussed in this review.

DeepMI: Deep multi-lead ECG fusion for identifying myocardial infarction and its occurrence-time

Myocardial Infarction (MI) has the highest mortality of all cardiovascular diseases (CVDs). Detection of MI and information regarding its occurrence-time in particular, would enable timely interventions that may improve patient outcomes, thereby reducing the global rise in CVD deaths. Electrocardiogram (ECG) recordings are currently used to screen MI patients. However, manual inspection of ECGs is time-consuming and prone to subjective bias. Machine learning methods have been adopted for automated ECG diagnosis, but most approaches require extraction of ECG beats or consider leads independently of one another. We propose an end-to-end deep learning approach, DeepMI, to classify MI from Normal cases as well as identifying the time-occurrence of MI (defined as Acute, Recent and Old), using a collection of fusion strategies on 12 ECG leads at data-, feature-, and decision-level. In order to minimise computational overhead, we employ transfer learning using existing computer vision networks. Moreover, we use recurrent neural networks to encode the longitudinal information inherent in ECGs. We validated DeepMI on a dataset collected from 17,381 patients, in which over 323,000 samples were extracted per ECG lead. We were able to classify Normal cases as well as Acute, Recent and Old onset cases of MI, with AUROCs of 96.7%, 82.9%, 68.6% and 73.8%, respectively. We have demonstrated a multi-lead fusion approach to detect the presence and occurrence-time of MI. Our end-to-end framework provides flexibility for different levels of multi-lead ECG fusion and performs feature extraction via transfer learning.

[Research on electrocardiogram classification using deep residual network with pyramid convolution structure]

Recently, deep neural networks (DNNs) have been widely used in the field of electrocardiogram (ECG) signal classification, but the previous models have limited ability to extract features from raw ECG data. In this paper, a deep residual network model based on pyramidal convolutional layers (PC-DRN) was proposed to implement ECG signal classification. The pyramidal convolutional (PC) layer could simultaneously extract multi-scale features from the original ECG data. And then, a deep residual network was designed to train the classification model for arrhythmia detection. The public dataset provided by the physionet computing in cardiology challenge 2017(CinC2017) was used to validate the classification experiment of 4 types of ECG data. In this paper, the harmonic mean F 1 of classification accuracy and recall was selected as the evaluation indexes. The experimental results showed that the average sequence level F 1 ( SeqF 1) of PC-DRN was improved from 0.857 to 0.920, and the average set level F 1 ( SetF 1) was improved from 0.876 to 0.925. Therefore, the PC-DRN model proposed in this paper provided a promising way for the feature extraction and classification of ECG signals, and provided an effective tool for arrhythmia classification.

Opportunities and challenges of deep learning methods for electrocardiogram data: A systematic review

BACKGROUND

The electrocardiogram (ECG) is one of the most commonly used diagnostic tools in medicine and healthcare. Deep learning methods have achieved promising results on predictive healthcare tasks using ECG signals.

OBJECTIVE

This paper presents a systematic review of deep learning methods for ECG data from both modeling and application perspectives.

METHODS

We extracted papers that applied deep learning (deep neural network) models to ECG data that were published between January 1st of 2010 and February 29th of 2020 from Google Scholar, PubMed, and the Digital Bibliography & Library Project. We then analyzed each article according to three factors: tasks, models, and data. Finally, we discuss open challenges and unsolved problems in this area.

RESULTS

The total number of papers extracted was 191. Among these papers, 108 were published after 2019. Different deep learning architectures have been used in various ECG analytics tasks, such as disease detection/classification, annotation/localization, sleep staging, biometric human identification, and denoising.

CONCLUSION

The number of works on deep learning for ECG data has grown explosively in recent years. Such works have achieved accuracy comparable to that of traditional feature-based approaches and ensembles of multiple approaches can achieve even better results. Specifically, we found that a hybrid architecture of a convolutional neural network and recurrent neural network ensemble using expert features yields the best results. However, there are some new challenges and problems related to interpretability, scalability, and efficiency that must be addressed. Furthermore, it is also worth investigating new applications from the perspectives of datasets and methods.

SIGNIFICANCE

This paper summarizes existing deep learning research using ECG data from multiple perspectives and highlights existing challenges and problems to identify potential future research directions.

Photoplethysmography based atrial fibrillation detection: a review

Atrial fibrillation (AF) is a cardiac rhythm disorder associated with increased morbidity and mortality. It is the leading risk factor for cardioembolic stroke and its early detection is crucial in both primary and secondary stroke prevention. Continuous monitoring of cardiac rhythm is today possible thanks to consumer-grade wearable devices, enabling transformative diagnostic and patient management tools. Such monitoring is possible using low-cost easy-to-implement optical sensors that today equip the majority of wearables. These sensors record blood volume variations-a technology known as photoplethysmography (PPG)-from which the heart rate and other physiological parameters can be extracted to inform about user activity, fitness, sleep, and health. Recently, new wearable devices were introduced as being capable of AF detection, evidenced by large prospective trials in some cases. Such devices would allow for early screening of AF and initiation of therapy to prevent stroke. This review is a summary of a body of work on AF detection using PPG. A thorough account of the signal processing, machine learning, and deep learning approaches used in these studies is presented, followed by a discussion of their limitations and challenges towards clinical applications.

Deep learning approaches for plethysmography signal quality assessment in the presence of atrial fibrillation

OBJECTIVE

Photoplethysmography (PPG) monitoring has been implemented in many portable and wearable devices we use daily for health and fitness tracking. Its simplicity and cost-effectiveness has enabled a variety of biomedical applications, such as continuous long-term monitoring of heart arrhythmias, fitness, and sleep tracking, and hydration monitoring. One major issue that can hinder PPG-based applications is movement artifacts, which can lead to false interpretations. In many implementations, noisy PPG signals are discarded. Misinterpreted or discarded PPG signals pose a problem in applications where the goal is to increase the yield of detecting physiological events, such as in the case of paroxysmal atrial fibrillation (AF)-a common episodic heart arrhythmia and a leading risk factor for stroke. In this work, we compared a traditional machine learning and deep learning approaches for PPG quality assessment in the presence of AF, in order to find the most robust method for PPG quality assessment.

APPROACH

The training data set was composed of 78 278 30 s long PPG recordings from 3764 patients using bedside patient monitors. Two different representations of PPG signals were employed-a time-series based (1D) one and an image-based (2D) one. Trained models were tested on an independent set of 2683 30 s PPG signals from 13 stroke patients.

MAIN RESULTS

ResNet18 showed a higher performance (0.985 accuracy, 0.979 specificity, and 0.988 sensitivity) than SVM and other deep learning approaches. 2D-based models were generally more accurate than 1D-based models.

SIGNIFICANCE

2D representation of PPG signal enhances the accuracy of PPG signal quality assessment.

Deep Learning in Cardiology

The medical field is creating large amount of data that physicians are unable to decipher and use efficiently. Moreover, rule-based expert systems are inefficient in solving complicated medical tasks or for creating insights using big data. Deep learning has emerged as a more accurate and effective technology in a wide range of medical problems such as diagnosis, prediction, and intervention. Deep learning is a representation learning method that consists of layers that transform data nonlinearly, thus, revealing hierarchical relationships and structures. In this review, we survey deep learning application papers that use structured data, and signal and imaging modalities from cardiology. We discuss the advantages and limitations of applying deep learning in cardiology that also apply in medicine in general, while proposing certain directions as the most viable for clinical use.