A Deep-Learning Approach to ECG Classification Based on Adversarial Domain Adaptation

Enhancing ECG Heartbeat classification with feature fusion neural networks and dynamic minority-biased batch weighting loss function

Objective.This study aims to address the challenges of imbalanced heartbeat classification using electrocardiogram (ECG). In this proposed novel deep-learning method, the focus is on accurately identifying minority classes in conditions characterized by significant imbalances in ECG data.Approach.We propose a feature fusion neural network enhanced by a dynamic minority-biased batch weighting loss function. This network comprises three specialized branches: the complete ECG data branch for a comprehensive view of ECG signals, the local QRS wave branch for detailed features of the QRS complex, and theRwave information branch to analyzeRwave characteristics. This structure is designed to extract diverse aspects of ECG data. The dynamic loss function prioritizes minority classes while maintaining the recognition of majority classes, adjusting the network's learning focus without altering the original data distribution. Together, this fusion structure and adaptive loss function significantly improve the network's ability to distinguish between various heartbeat classes, enhancing the accuracy of minority class identification.Main results.The proposed method demonstrated balanced performance within the MIT-BIH dataset, especially for minority classes. Under the intra-patient paradigm, the accuracy, sensitivity, specificity, and positive predictive value for Supraventricular ectopic beat were 99.63%, 93.62%, 99.81%, and 92.98%, respectively, and for Fusion beat were 99.76%, 85.56%, 99.87%, and 84.16%, respectively. Under the inter-patient paradigm, these metrics were 96.56%, 89.16%, 96.84%, and 51.99%for Supraventricular ectopic beat, and 96.10%, 77.06%, 96.25%, and 13.92%for Fusion beat, respectively.Significance.This method effectively addresses the class imbalance in ECG datasets. By leveraging diverse ECG signal information and a novel loss function, this approach offers a promising tool for aiding in the diagnosis and treatment of cardiac conditions.

ECG-based data-driven solutions for diagnosis and prognosis of cardiovascular diseases: A systematic review

Cardiovascular diseases (CVD) are a leading cause of death globally, and result in significant morbidity and reduced quality of life. The electrocardiogram (ECG) plays a crucial role in CVD diagnosis, prognosis, and prevention; however, different challenges still remain, such as an increasing unmet demand for skilled cardiologists capable of accurately interpreting ECG. This leads to higher workload and potential diagnostic inaccuracies. Data-driven approaches, such as machine learning (ML) and deep learning (DL) have emerged to improve existing computer-assisted solutions and enhance physicians' ECG interpretation of the complex mechanisms underlying CVD. However, many ML and DL models used to detect ECG-based CVD suffer from a lack of explainability, bias, as well as ethical, legal, and societal implications (ELSI). Despite the critical importance of these Trustworthy Artificial Intelligence (AI) aspects, there is a lack of comprehensive literature reviews that examine the current trends in ECG-based solutions for CVD diagnosis or prognosis that use ML and DL models and address the Trustworthy AI requirements. This review aims to bridge this knowledge gap by providing a systematic review to undertake a holistic analysis across multiple dimensions of these data-driven models such as type of CVD addressed, dataset characteristics, data input modalities, ML and DL algorithms (with a focus on DL), and aspects of Trustworthy AI like explainability, bias and ethical considerations. Additionally, within the analyzed dimensions, various challenges are identified. To these, we provide concrete recommendations, equipping other researchers with valuable insights to understand the current state of the field comprehensively.

Deep learning-based regional ECG diagnosis platform

OBJECTIVE

To enable the intelligent diagnosis of a variety of common Electrocardiogram (ECG), we investigate the deep learning-based ECG diagnosis system.

METHODS

From January 2015 to December 2019, four consecutive years of 100,120 conventional 12-lead ECG data were collected in our hospital. Utilizing this dataset, we constructed a deep learning model designed to intelligently diagnose prevalent ECG anomalies by employing a multi-task learning framework. The system performance was evaluated using various metrics, including sensitivity, specificity, negative predictive value, positive predictive value, and so forth. Additionally, we employed an ECG intelligent diagnostic platform for clinical application to undertake real-time online analysis of 2500 conventional 12-lead ECG samples in June 2020, aiming to validate our model. At this stage, we compared the performance of our model against the traditional manual identification method.

RESULTS

The efficacy of the ECG intelligent diagnostic model was notably high for common and straightforward ECG patterns, such as sinus rhythm (F1 = 98.01%), sinus tachycardia (F1 = 96.26%), sinus bradycardia (F1 = 94.88%), and a normal electrocardiogram (F1 = 91.71%), as well as for Premature Ventricular Contractions (F1 = 91.62%). Nevertheless, when diagnosing rarer and more intricate ECG anomalies, the system requires an increased number of samples to refine the deep learning models. During the validation stage, our model exhibited better efficiency in terms of accuracy, labor time and labor cost when compared to the manual identification approach.

CONCLUSIONS

Our deep learning-driven intelligent ECG diagnostic model clearly demonstrates significant clinical utility. The integrated artificial intelligence diagnosis system not only has the potential to augment physicians in their diagnostic processes but also offers a viable avenue to reduce associated labor costs.

Real-time mental stress detection using multimodality expressions with a deep learning framework

Mental stress is becoming increasingly widespread and gradually severe in modern society, threatening people’s physical and mental health. To avoid the adverse effects of stress on people, it is imperative to detect stress in time. Many studies have demonstrated the effectiveness of using objective indicators to detect stress. Over the past few years, a growing number of researchers have been trying to use deep learning technology to detect stress. However, these works usually use single-modality for stress detection and rarely combine stress-related information from multimodality. In this paper, a real-time deep learning framework is proposed to fuse ECG, voice, and facial expressions for acute stress detection. The framework extracts the stress-related information of the corresponding input through ResNet50 and I3D with the temporal attention module (TAM), where TAM can highlight the distinguishing temporal representation for facial expressions about stress. The matrix eigenvector-based approach is then used to fuse the multimodality information about stress. To validate the effectiveness of the framework, a well-established psychological experiment, the Montreal imaging stress task (MIST), was applied in this work. We collected multimodality data from 20 participants during MIST. The results demonstrate that the framework can combine stress-related information from multimodality to achieve 85.1% accuracy in distinguishing acute stress. It can serve as a tool for computer-aided stress detection.

State-of-the-art Deep Learning Methods on Electrocardiogram Data: A Systematic Review (Preprint)

Background

Electrocardiogram (ECG) is one of the most common noninvasive diagnostic tools that can provide useful information regarding a patient’s health status. Deep learning (DL) is an area of intense exploration that leads the way in most attempts to create powerful diagnostic models based on physiological signals.

Objective

This study aimed to provide a systematic review of DL methods applied to ECG data for various clinical applications.

Methods

The PubMed search engine was systematically searched by combining “deep learning” and keywords such as “ecg,” “ekg,” “electrocardiogram,” “electrocardiography,” and “electrocardiology.” Irrelevant articles were excluded from the study after screening titles and abstracts, and the remaining articles were further reviewed. The reasons for article exclusion were manuscripts written in any language other than English, absence of ECG data or DL methods involved in the study, and absence of a quantitative evaluation of the proposed approaches.

Results

We identified 230 relevant articles published between January 2020 and December 2021 and grouped them into 6 distinct medical applications, namely, blood pressure estimation, cardiovascular disease diagnosis, ECG analysis, biometric recognition, sleep analysis, and other clinical analyses. We provide a complete account of the state-of-the-art DL strategies per the field of application, as well as major ECG data sources. We also present open research problems, such as the lack of attempts to address the issue of blood pressure variability in training data sets, and point out potential gaps in the design and implementation of DL models.

Conclusions

We expect that this review will provide insights into state-of-the-art DL methods applied to ECG data and point to future directions for research on DL to create robust models that can assist medical experts in clinical decision-making.

A particle swarm optimization improved BP neural network intelligent model for electrocardiogram classification

BACKGROUND

As proven to reflect the work state of heart and physiological situation objectively, electrocardiogram (ECG) is widely used in the assessment of human health, especially the diagnosis of heart disease. The accuracy and reliability of abnormal ECG (AECG) decision depend to a large extent on the feature extraction. However, it is often uneasy or even impossible to obtain accurate features, as the detection process of ECG is easily disturbed by the external environment. And AECG got many species and great variation. What's more, the ECG result obtained after a long time past, which can not reach the purpose of early warning or real-time disease diagnosis. Therefore, developing an intelligent classification model with an accurate feature extraction method to identify AECG is of quite significance. This study aimed to explore an accurate feature extraction method of ECG and establish a suitable model for identifying AECG and the diagnosis of heart disease.

METHODS

In this research, the wavelet combined with four operations and adaptive threshold methods were applied to filter the ECG and extract its feature waves first. Then, a BP neural network (BPNN) intelligent model and a particle swarm optimization (PSO) improved BPNN (PSO-BPNN) intelligent model based on MIT-BIH open database was established to identify ECG. To reduce the complexity of the model, the principal component analysis (PCA) was used to minimize the feature dimension.

RESULTS

Wavelet transforms combined four operations and adaptive threshold methods were capable of ECG filtering and feature extraction. PCA can significantly deduce the modeling feature dimension to minimize the complexity and save classification time. The PSO-BPNN intelligent model was suitable for identifying five types of ECG and showed better effects while comparing it with the BPNN model.

CONCLUSION

In summary, it was further concluded that the PSO-BPNN intelligent model would be a suitable way to identify AECG and provide a tool for the diagnosis of heart disease.