1
|
Ansari MY, Qaraqe M, Righetti R, Serpedin E, Qaraqe K. Enhancing ECG-based heart age: impact of acquisition parameters and generalization strategies for varying signal morphologies and corruptions. Front Cardiovasc Med 2024; 11:1424585. [PMID: 39027006 PMCID: PMC11254851 DOI: 10.3389/fcvm.2024.1424585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Accepted: 06/04/2024] [Indexed: 07/20/2024] Open
Abstract
Electrocardiogram (ECG) is a non-invasive approach to capture the overall electrical activity produced by the contraction and relaxation of the cardiac muscles. It has been established in the literature that the difference between ECG-derived age and chronological age represents a general measure of cardiovascular health. Elevated ECG-derived age strongly correlates with cardiovascular conditions (e.g., atherosclerotic cardiovascular disease). However, the neural networks for ECG age estimation are yet to be thoroughly evaluated from the perspective of ECG acquisition parameters. Additionally, deep learning systems for ECG analysis encounter challenges in generalizing across diverse ECG morphologies in various ethnic groups and are susceptible to errors with signals that exhibit random or systematic distortions To address these challenges, we perform a comprehensive empirical study to determine the threshold for the sampling rate and duration of ECG signals while considering their impact on the computational cost of the neural networks. To tackle the concern of ECG waveform variability in different populations, we evaluate the feasibility of utilizing pre-trained and fine-tuned networks to estimate ECG age in different ethnic groups. Additionally, we empirically demonstrate that finetuning is an environmentally sustainable way to train neural networks, and it significantly decreases the ECG instances required (by more than 100 × ) for attaining performance similar to the networks trained from random weight initialization on a complete dataset. Finally, we systematically evaluate augmentation schemes for ECG signals in the context of age estimation and introduce a random cropping scheme that provides best-in-class performance while using shorter-duration ECG signals. The results also show that random cropping enables the networks to perform well with systematic and random ECG signal corruptions.
Collapse
Affiliation(s)
- Mohammed Yusuf Ansari
- Electrical and Computer Engineering, Texas A&M University, College Station, TX, United States
- Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, Qatar
| | - Marwa Qaraqe
- Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, Qatar
- Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - Raffaella Righetti
- Electrical and Computer Engineering, Texas A&M University, College Station, TX, United States
| | - Erchin Serpedin
- Electrical and Computer Engineering, Texas A&M University, College Station, TX, United States
| | - Khalid Qaraqe
- Electrical and Computer Engineering, Texas A&M University at Qatar, Doha, Qatar
| |
Collapse
|
2
|
Kim J, Lim MH, Kim K, Yoon HJ. Continual learning framework for a multicenter study with an application to electrocardiogram. BMC Med Inform Decis Mak 2024; 24:67. [PMID: 38448921 DOI: 10.1186/s12911-024-02464-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 02/21/2024] [Indexed: 03/08/2024] Open
Abstract
Deep learning has been increasingly utilized in the medical field and achieved many goals. Since the size of data dominates the performance of deep learning, several medical institutions are conducting joint research to obtain as much data as possible. However, sharing data is usually prohibited owing to the risk of privacy invasion. Federated learning is a reasonable idea to train distributed multicenter data without direct access; however, a central server to merge and distribute models is needed, which is expensive and hardly approved due to various legal regulations. This paper proposes a continual learning framework for a multicenter study, which does not require a central server and can prevent catastrophic forgetting of previously trained knowledge. The proposed framework contains the continual learning method selection process, assuming that a single method is not omnipotent for all involved datasets in a real-world setting and that there could be a proper method to be selected for specific data. We utilized the fake data based on a generative adversarial network to evaluate methods prospectively, not ex post facto. We used four independent electrocardiogram datasets for a multicenter study and trained the arrhythmia detection model. Our proposed framework was evaluated against supervised and federated learning methods, as well as finetuning approaches that do not include any regulation to preserve previous knowledge. Even without a central server and access to the past data, our framework achieved stable performance (AUROC 0.897) across all involved datasets, achieving comparable performance to federated learning (AUROC 0.901).
Collapse
Affiliation(s)
- Junmo Kim
- Interdisciplinary Program in Bioengineering, Seoul National University, Seoul, Republic of Korea
| | - Min Hyuk Lim
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Republic of Korea
- Graduate School of Health Science and Technology, Ulsan National Institute of Science and Technology, Ulsan, Republic of Korea
| | - Kwangsoo Kim
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Medicine, College of Medicine, Seoul National University, Seoul, Republic of Korea
| | - Hyung-Jin Yoon
- Interdisciplinary Program in Bioengineering, Seoul National University, Seoul, Republic of Korea.
- Medical Bigdata Research Center, Seoul National University College of Medicine, 101, Daehak-ro, Jongno-gu, Seoul, Republic of Korea.
| |
Collapse
|
3
|
Ran A, Liu H. Joint spatio-temporal features constrained self-supervised electrocardiogram representation learning. Biomed Eng Lett 2024; 14:209-220. [PMID: 38374910 PMCID: PMC10874354 DOI: 10.1007/s13534-023-00329-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 09/08/2023] [Accepted: 09/26/2023] [Indexed: 02/21/2024] Open
Abstract
The electrocardiogram (ECG) measurements with clinical diagnostic labels are intrinsically limited. We propose a generative learning based self-supervised method for general ECG representations applicable to various downstream tasks, thus achieving the goal of reducing the dependence on labeled data. However, existing self-supervised methods either fail to provide satisfactory ECG representations or require too much effort to curate a large amount of expert-annotated datasets. We propose a spatio-temporal joint detection based self-supervised method with little or no human supervision to label massive datasets. Considering the spatio-temporal characteristics of ECG signals, we dynamically randomly mask the original signal (temporal detection) and disrupt the order of leads (spatial detection) to complete the learning through reconstructing the original signal and predicting the lead numbers. To validate the effectiveness of the proposed method, we use several publicly available ECG databases as well as a private ECG data of ventricular tachycardia to pre-train our model. We use diagnostic classification of 27 arrhythmia types and localization of ventricular tachycardia origin sites as two downstream tasks, respectively. The results show that learning ECG representations with this method is effective. This effort demonstrates the feasibility of learning representations from ECG data by self-supervised learning. Our self-supervised method uses only 60% of the labeled data used by the supervised method to achieve the same performance. Using the same amount of data, our self-supervised approach shows 1.3% and 8.6% improvement in classification and localization accuracy compared to the model with random initialization on two types of downstream tasks, respectively.
Collapse
Affiliation(s)
- Ao Ran
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Zheda Road 38#, Hangzhou, 310027 China
| | - Huafeng Liu
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Zheda Road 38#, Hangzhou, 310027 China
| |
Collapse
|
4
|
Safdar MF, Nowak RM, Pałka P. Pre-Processing techniques and artificial intelligence algorithms for electrocardiogram (ECG) signals analysis: A comprehensive review. Comput Biol Med 2024; 170:107908. [PMID: 38217973 DOI: 10.1016/j.compbiomed.2023.107908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 12/19/2023] [Accepted: 12/24/2023] [Indexed: 01/15/2024]
Abstract
Electrocardiogram (ECG) are the physiological signals and a standard test to measure the heart's electrical activity that depicts the movement of cardiac muscles. A review study has been conducted on ECG signals analysis with the help of artificial intelligence (AI) methods over the last ten years i.e., 2012-22. Primarily, the method of ECG analysis by software systems was divided into classical signal processing (e.g. spectrograms or filters), machine learning (ML) and deep learning (DL), including recursive models, transformers and hybrid. Secondly, the data sources and benchmark datasets were depicted. Authors grouped resources by ECG acquisition methods into hospital-based portable machines and wearable devices. Authors also included new trends like advanced pre-processing, data augmentation, simulations and agent-based modeling. The study found improvement in ECG examination perfection made each year through ML, DL, hybrid models, and transformers. Convolutional neural networks and hybrid models were more targeted and proved efficient. The transformer model extended the accuracy from 90% to 98%. The Physio-Net library helps acquire ECG signals, including the popular benchmark databases such as MIT-BIH, PTB, and challenging datasets. Similarly, wearable devices have been established as a appropriate option for monitoring patient health without the time and place limitations and are also helpful for AI model calibration with so far accuracy of 82%-83% on Samsung smartwatch. In the pre-processing signals, spectrogram generation through Fourier and wavelet transformations are erected leading approaches promoting on average accuracy of 90%-95%. Likewise, data enhancement using geometrical techniques is well-considered; however, extraction and concatenation-based methods need attention. As the what-if analysis in healthcare or cardiac issues can be performed using a complex simulation, the study reviews agent-based modeling and simulation approaches for cardiovascular risk event assessment.
Collapse
Affiliation(s)
- Muhammad Farhan Safdar
- Institute of Computer Science, Faculty of Electronics and Information Technology, Warsaw University of Technology, 00-665 Warsaw, Poland.
| | - Robert Marek Nowak
- Institute of Computer Science, Faculty of Electronics and Information Technology, Warsaw University of Technology, 00-665 Warsaw, Poland
| | - Piotr Pałka
- Institute of Control and Computation Engineering, Faculty of Electronics and Information Technology, Warsaw University of Technology, 00-665 Warsaw, Poland
| |
Collapse
|
5
|
Al-Jibreen A, Al-Ahmadi S, Islam S, Artoli AM. Person identification with arrhythmic ECG signals using deep convolution neural network. Sci Rep 2024; 14:4431. [PMID: 38396036 PMCID: PMC11316829 DOI: 10.1038/s41598-024-55066-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Accepted: 02/20/2024] [Indexed: 02/25/2024] Open
Abstract
Over the past decade, the use of biometrics in security systems and other applications has grown in popularity. ECG signals in particular are attracting increased attention due to their characteristics, which are required for a trustworthy identification system. The majority of ECG-based person identification systems are evaluated without considering the health-state of the individuals. Few person identification systems consider person-by-person health-state annotation. This paper proposes a person identification system considering the health-state annotated ECG signals where each person's beats overlap among variant arrhythmia classes. This overlapping between the normal class and other arrhythmia classes grants the ability to isolate normal beats in the train set from the Arrhythmic beats in the test set. Therefore, this paper investigates the effect of arrhythmic heartbeats on biometric recognition. An effective lightweight CNN based on depth-wise separable convolution (DWSC) is proposed to enhance the performance of person identification for several common arrhythmia types using the MITBIH dataset. The proposed methodology has been tested on nine arrhythmia types and presents how different types of arrhythmia affect ECG-based biometric systems differently. The experimental results show excellent recognition performance (99.28%) on normal heartbeats and (93.81%) on arrhythmic heartbeats, outperforming other models in terms of mean accuracy.
Collapse
Affiliation(s)
- Awabed Al-Jibreen
- Computer Science Department, College of Computer and Information Sciences, King Saud University, 11543, Riyadh, Saudi Arabia.
| | - Saad Al-Ahmadi
- Computer Science Department, College of Computer and Information Sciences, King Saud University, 11543, Riyadh, Saudi Arabia
| | - Saiful Islam
- Department of Computer Engineering, Faculty of Engineering, TED University, 06420, Ankara, Türkiye
| | - Abdel Momin Artoli
- Computer Science Department, College of Computer and Information Sciences, King Saud University, 11543, Riyadh, Saudi Arabia
| |
Collapse
|
6
|
Liu J, He X, Xiong H. A cascaded convolutional neural networks for stroke detection imaging. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2023; 94:113701. [PMID: 37916915 DOI: 10.1063/5.0167592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 10/16/2023] [Indexed: 11/03/2023]
Abstract
In recent years, electrical impedance tomography has widely been used in stroke detection. To improve the prediction accuracy and anti-noise ability of the system, the inverse problem of electrical impedance tomography needs to be solved, for which cascade convolutional neural networks are used. The proposed network is divided into two parts so that the advantages can be compounded when parts of a network are cascaded together. To get high-resolution imaging, an optimized network based on encoding and decoding is designed in the first part. The second part is composed of a residual module, which is used to extract the characteristics of voltage information and ensure that no information is lost. The anti-noise performance of the network is better than other networks. In physical experiments, it is also proved that the algorithm can roughly restore the location of the object in the field.
Collapse
Affiliation(s)
- Jinzhen Liu
- The School of Control Science and Engineering, TianGong University, TianJin, China
- Tianjin Key Laboratory of Intelligent Control of Electrical Equipment, TianGong University, TianJin, China
| | - Xiaochuan He
- The School of Control Science and Engineering, TianGong University, TianJin, China
- Tianjin Key Laboratory of Intelligent Control of Electrical Equipment, TianGong University, TianJin, China
| | - Hui Xiong
- The School of Control Science and Engineering, TianGong University, TianJin, China
- Tianjin Key Laboratory of Intelligent Control of Electrical Equipment, TianGong University, TianJin, China
| |
Collapse
|
7
|
Camara C, Peris-Lopez P, Safkhani M, Bagheri N. ECG Identification Based on the Gramian Angular Field and Tested with Individuals in Resting and Activity States. SENSORS (BASEL, SWITZERLAND) 2023; 23:937. [PMID: 36679733 PMCID: PMC9862128 DOI: 10.3390/s23020937] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 01/07/2023] [Accepted: 01/10/2023] [Indexed: 06/17/2023]
Abstract
In the last decade, biosignals have attracted the attention of many researchers when designing novel biometrics systems. Many of these works use cardiac signals and their representation as electrocardiograms (ECGs). Nowadays, these solutions are even more realistic since we can acquire reliable ECG records by using wearable devices. This paper moves in that direction and proposes a novel approach for an ECG identification system. For that, we transform the ECG recordings into Gramian Angular Field (GAF) images, a time series encoding technique well-known in other domains but not very common with biosignals. Specifically, the time series is transformed using polar coordinates, and then, the cosine sum of the angles is computed for each pair of points. We present a proof-of-concept identification system built on a tuned VGG19 convolutional neural network using this approach. We confirm our proposal's feasibility through experimentation using two well-known public datasets: MIT-BIH Normal Sinus Rhythm Database (subjects at a resting state) and ECG-GUDB (individuals under four specific activities). In both scenarios, the identification system reaches an accuracy of 91%, and the False Acceptance Rate (FAR) is eight times higher than the False Rejection Rate (FRR).
Collapse
Affiliation(s)
- Carmen Camara
- Computer Science Department, Carlos III University of Madrid, 28911 Leganés, Spain
| | - Pedro Peris-Lopez
- Computer Science Department, Carlos III University of Madrid, 28911 Leganés, Spain
| | - Masoumeh Safkhani
- Computer Engineering Department, Shahid Rajaee Teacher Training University, Tehran 16788-15811, Iran
| | - Nasour Bagheri
- Electrical Engineering Department, Shahid Rajaee Teacher Training University, Tehran 16788-15811, Iran
- School of Computer Science (SCS), Institute for Research in Fundamental Sciences (IPM), Tehran 16788-15811, Iran
| |
Collapse
|
8
|
Ko H, Rim K, Hong JY. Bio-metric authentication with electrocardiogram (ECG) by considering variable signals. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:1716-1729. [PMID: 36899505 DOI: 10.3934/mbe.2023078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
The use of conventional bio-signals such as an electrocardiogram (ECG) for biometric authentication is vulnerable to a lack of verification of continuity of signals; this is because the system does not consider the change in signals caused by a change in the situation of a person, that is, conventional biological signals. Prediction technology based on tracking and analyzing new signals can overcome this shortcoming. However, since the biological signal data sets are massive, their utilization is crucial for higher accuracy. In this study, we defined a 10 × 10 matrix for 100 points based on the R-peak point and an array for the dimension of the signals. Furthermore, we defined the future predicted signals by analyzing the continuous points in each array of the matrices at the same point. As a result, the accuracy of user authentication was 91%.
Collapse
Affiliation(s)
- Hoon Ko
- Research & Development Center, MetaiONE Inc., Business Incubation Center (#504), Chosun University, Gwangju 61452, Korea
- Instituto Superior de Engenharia do Porto (ISEP/IPP), Porto 4249-015, Portugal
| | - Kwangcheol Rim
- The Department of Mathematics, Chosun University, 309 pilmundae-ro, Gwangju 61452, Korea
| | - Jong Youl Hong
- College of Culture & Sports, Korea University, Korea University Sejong Campus, Sejong City 30019, Korea
| |
Collapse
|
9
|
Wen H, Kang J. A novel deep learning package for electrocardiography research. Physiol Meas 2022; 43. [PMID: 36137539 DOI: 10.1088/1361-6579/ac9451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2022] [Accepted: 09/22/2022] [Indexed: 02/07/2023]
Abstract
Objective. In recent years, deep learning has blossomed in the field of electrocardiography (ECG) processing, outperforming traditional signal processing methods in a number of typical tasks; for example, classification, QRS detection and wave delineation. Although many neural architectures have been proposed in the literature, there is a lack of systematic studies and open-source libraries for ECG deep learning.Approach. In this paper, we propose a deep learning package, namedtorch_ecg, which assembles a large number of neural networks, from existing and novel literature, for various ECG processing tasks. The models are designed to be able to be automatically built from configuration files that contain a large set of configurable hyperparameters, making it convenient to scale the networks and perform neural architecture searching.torch_ecghas well-organized data processing modules, which contain utilities for data downloading, visualization, preprocessing and augmentation. To make the whole system more user-friendly, a series of helper modules are implemented, including model trainers, metric computation and loggers.Main results.torch_ecgestablishes a convenient and modular way for automatic building and flexible scaling of networks, as well as a neat and uniform way of organizing the preprocessing procedures and augmentation techniques for preparing the input data for the models. In addition,torch_ecgprovides benchmark studies using the latest databases, illustrating the principles and pipelines for solving ECG processing tasks and reproducing results from the literature.Significance.torch_ecgoffers the ECG research community a powerful tool for meeting the growing demand for the application of deep learning techniques. The code is available athttps://github.com/DeepPSP/torch_ecg.
Collapse
Affiliation(s)
- Hao Wen
- LMIB and School of Mathematical Sciences, Beihang University, Beijing, People's Republic of China
| | - Jingsu Kang
- Tianjin Medical University, Tianjin, People's Republic of China
| |
Collapse
|
10
|
Jaya Prakash A, Patro KK, Hammad M, Tadeusiewicz R, Pławiak P. BAED: A secured biometric authentication system using ECG signal based on deep learning techniques. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.08.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
11
|
ELEKTRA: ELEKTRokardiomatrix application to biometric identification with convolutional neural networks. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.07.059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
12
|
Ieracitano C, Morabito FC, Squartini S, Huang K, Li X, Mahmud M. Guest Editorial: Advances in Deep Learning for Clinical and Healthcare Applications. Cognit Comput 2022:1-3. [PMID: 35991007 PMCID: PMC9382598 DOI: 10.1007/s12559-022-10049-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/08/2022] [Indexed: 11/03/2022]
Affiliation(s)
- Cosimo Ieracitano
- DICEAM, University Mediterranea of Reggio Calabria, Reggio Calabria, Italy
| | | | | | | | - Xuelong Li
- Northwestern Polytechnical University, Xi’an, China
| | | |
Collapse
|
13
|
Musa N, Gital AY, Aljojo N, Chiroma H, Adewole KS, Mojeed HA, Faruk N, Abdulkarim A, Emmanuel I, Folawiyo YY, Ogunmodede JA, Oloyede AA, Olawoyin LA, Sikiru IA, Katb I. A systematic review and Meta-data analysis on the applications of Deep Learning in Electrocardiogram. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2022; 14:9677-9750. [PMID: 35821879 PMCID: PMC9261902 DOI: 10.1007/s12652-022-03868-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 04/26/2022] [Indexed: 06/08/2023]
Abstract
The success of deep learning over the traditional machine learning techniques in handling artificial intelligence application tasks such as image processing, computer vision, object detection, speech recognition, medical imaging and so on, has made deep learning the buzz word that dominates Artificial Intelligence applications. From the last decade, the applications of deep learning in physiological signals such as electrocardiogram (ECG) have attracted a good number of research. However, previous surveys have not been able to provide a systematic comprehensive review including biometric ECG based systems of the applications of deep learning in ECG with respect to domain of applications. To address this gap, we conducted a systematic literature review on the applications of deep learning in ECG including biometric ECG based systems. The study analyzed systematically, 150 primary studies with evidence of the application of deep learning in ECG. The study shows that the applications of deep learning in ECG have been applied in different domains. We presented a new taxonomy of the domains of application of the deep learning in ECG. The paper also presented discussions on biometric ECG based systems and meta-data analysis of the studies based on the domain, area, task, deep learning models, dataset sources and preprocessing methods. Challenges and potential research opportunities were highlighted to enable novel research. We believe that this study will be useful to both new researchers and expert researchers who are seeking to add knowledge to the already existing body of knowledge in ECG signal processing using deep learning algorithm. Supplementary information The online version contains supplementary material available at 10.1007/s12652-022-03868-z.
Collapse
Affiliation(s)
- Nehemiah Musa
- Department of Mathematical Sciences, Abubakar Tafawa Balewa University, Bauchi, Nigeria
| | - Abdulsalam Ya’u Gital
- Department of Mathematical Sciences, Abubakar Tafawa Balewa University, Bauchi, Nigeria
| | | | - Haruna Chiroma
- Computer Science and Engineering, University of Hafr Al-Batin, Hafr, Saudi Arabia
- Computer Science and Engineering , University of Hafr Al-Batin, Hafr Al-Batin, Saudi Arabia
| | - Kayode S. Adewole
- Department of Computer Science, University of Ilorin, Ilorin, Nigeria
| | - Hammed A. Mojeed
- Department of Computer Science, University of Ilorin, Ilorin, Nigeria
| | - Nasir Faruk
- Department of Physics, Sule Lamido University, Kafin Hausa, Nigeria
| | - Abubakar Abdulkarim
- Department of Electrical Engineering, Ahmadu Bello University Zaria, Zaria, Nigeria
| | - Ifada Emmanuel
- Department of Physics, Sule Lamido University, Kafin Hausa, Nigeria
| | | | | | | | | | | | - Ibrahim Katb
- Computer Science and Engineering, University of Hafr Al-Batin, Hafr, Saudi Arabia
| |
Collapse
|
14
|
El Boujnouni I, Zili H, Tali A, Tali T, Laaziz Y. A wavelet-based capsule neural network for ECG biometric identification. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
15
|
Cai W, Liu F, Xu B, Wang X, Hu S, Wang M. Classification of multi-lead ECG with deep residual convolutional neural networks. Physiol Meas 2022; 43. [PMID: 35705071 DOI: 10.1088/1361-6579/ac7939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 06/15/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Automatic ECG interpretation based on deep learning methods is attracting increasing attention. In this study, we propose a novel method to accurately classify multi-lead ECGs using deep residual neural networks. APPROACH ECG recordings from seven different open databases were provided by PhysioNet/Computing in Cardiology Challenge 2021. All the ECGs were pre-processed to obtain the same sampling rate. The label inconsistency among the databases was corrected by adding or removing specific labels. A label mask was created to filter out potentially incorrectly labelled data. Five models based on deep residual convolutional neural networks were optimized using an asymmetric loss function to classify multi-lead ECGs. MAIN RESULTS The proposed method achieved an official challenge score of 0.54, 0.52, 0.50, 0.51, and 0.50 on twelve-lead, six-lead, four-lead, three-lead, and two-lead ECG test sets, respectively. These scores were ranked 5th, 3rd, 7th, 5th and 7th, respectively, in the challenge. SIGNIFICANCE The proposed method can correct the differential labeling tendency of databases from different sources and exhibits good generalization for classifying multi-lead ECGs in the hidden test set. The proposed models have the potential for clinical applications.
Collapse
Affiliation(s)
- Wenjie Cai
- University of Shanghai for Science and Technology, 516 Jungong Road, Yangpu District, Shanghai, 200093, CHINA
| | - Fanli Liu
- University of Shanghai for Science and Technology, 516 Jungong Road, Yangpu District, Shanghai, 200093, CHINA
| | - Bolin Xu
- University of Shanghai for Science and Technology, 516 Jungong Road, Yangpu District, Shanghai, 200093, CHINA
| | - Xuan Wang
- University of Shanghai for Science and Technology, 516 Jungong Road, Yangpu District, Shanghai, 200093, CHINA
| | - Shuaicong Hu
- University of Shanghai for Science and Technology, 516 Jungong Road, Yangpu District, Shanghai, 200093, CHINA
| | - Mingjie Wang
- Fudan University School of Basic Medical Sciences, 138 Yixueyuan Road, Xuhui District, Shanghai, 200032, CHINA
| |
Collapse
|
16
|
Chee KJ, Ramli DA. Electrocardiogram Biometrics Using Transformer's Self-Attention Mechanism for Sequence Pair Feature Extractor and Flexible Enrollment Scope Identification. SENSORS 2022; 22:s22093446. [PMID: 35591136 PMCID: PMC9100332 DOI: 10.3390/s22093446] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 04/21/2022] [Accepted: 04/26/2022] [Indexed: 11/16/2022]
Abstract
The existing electrocardiogram (ECG) biometrics do not perform well when ECG changes after the enrollment phase because the feature extraction is not able to relate ECG collected during enrollment and ECG collected during classification. In this research, we propose the sequence pair feature extractor, inspired by Bidirectional Encoder Representations from Transformers (BERT)'s sentence pair task, to obtain a dynamic representation of a pair of ECGs. We also propose using the self-attention mechanism of the transformer to draw an inter-identity relationship when performing ECG identification tasks. The model was trained once with datasets built from 10 ECG databases, and then, it was applied to six other ECG databases without retraining. We emphasize the significance of the time separation between enrollment and classification when presenting the results. The model scored 96.20%, 100.0%, 99.91%, 96.09%, 96.35%, and 98.10% identification accuracy on MIT-BIH Atrial Fibrillation Database (AFDB), Combined measurement of ECG, Breathing and Seismocardiograms (CEBSDB), MIT-BIH Normal Sinus Rhythm Database (NSRDB), MIT-BIH ST Change Database (STDB), ECG-ID Database (ECGIDDB), and PTB Diagnostic ECG Database (PTBDB), respectively, over a short time separation. The model scored 92.70% and 64.16% identification accuracy on ECGIDDB and PTBDB, respectively, over a long time separation, which is a significant improvement compared to state-of-the-art methods.
Collapse
|
17
|
ResNet-50 for 12-Lead Electrocardiogram Automated Diagnosis. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7617551. [PMID: 35528345 PMCID: PMC9071921 DOI: 10.1155/2022/7617551] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 01/13/2022] [Accepted: 03/22/2022] [Indexed: 12/30/2022]
Abstract
Nowadays, the implementation of Artificial Intelligence (AI) in medical diagnosis has attracted major attention within both the academic literature and industrial sector. AI would include deep learning (DL) models, where these models have been achieving a spectacular performance in healthcare applications. According to the World Health Organization (WHO), in 2020 there were around 25.6 million people who died from cardiovascular diseases (CVD). Thus, this paper aims to shad the light on cardiology since it is widely considered as one of the most important in medicine field. The paper develops an efficient DL model for automatic diagnosis of 12-lead electrocardiogram (ECG) signals with 27 classes, including 26 types of CVD and a normal sinus rhythm. The proposed model consists of Residual Neural Network (ResNet-50). An experimental work has been conducted using combined public databases from the USA, China, and Germany as a proof-of-concept. Simulation results of the proposed model have achieved an accuracy of 97.63% and a precision of 89.67%. The achieved results are validated against the actual values in the recent literature.
Collapse
|
18
|
Chen SW, Wang SL, Qi XZ, Samuri SM, Yang C. Review of ECG detection and classification based on deep learning: Coherent taxonomy, motivation, open challenges and recommendations. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103493] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
|
19
|
Sakr AS, Pławiak P, Tadeusiewicz R, Hammad M. Cancelable ECG biometric based on combination of deep transfer learning with DNA and amino acid approaches for human authentication. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.11.066] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
20
|
Camara C, Peris-Lopez P, Safkhani M, Bagheri N. ECGsound for human identification. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103335] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
21
|
Sun L, Zhong Z, Qu Z, Xiong N. PerAE: An Effective Personalized AutoEncoder for ECG-based Biometric in Augmented Reality System. IEEE J Biomed Health Inform 2022; 26:2435-2446. [PMID: 35077376 DOI: 10.1109/jbhi.2022.3145999] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
With the development of the Augmented and Virtual Reality (AR/VR) technologies, massive biometric data are collected by different organizations. These data have great significance but also worsen the privacy risks. Electro-CardioGram (ECG)-based Identity Recognition (EIR) is a popular Biometric technology. An ECG record is an internal Biology feature of a person and has time continuity. Thus, compared with traditional Biometric methods like face recognition, EIR may be less vulnerable to attack. We propose an Autoencoder-based EIR system, called Personalized AutoEncoder (PerAE). PerAE maintains a small autoencoder model (called Attention-MemAE) for each registered user of a system. The Attention-MemAE enhances the autoencoder by using a memory module and two attention mechanisms. A users Attention-MemAE classifies the hearbeats of other users as anomalies. An Attention-MemAE can be updated when the distribution of the users ECG data is changed. By using personalized autoencoder, PerAE can improve the time efficiency and reduce the memory overhead. It improves the adaptability, scalability, and maintainability of EIR systems. Experiment results show that to train an Attention-MemAE with 90% identification accuracy for a user, we can just take five minutes to collect the users ECG data (around 500 heartbeat samples).
Collapse
|
22
|
Ge Z, Jiang X, Tong Z, Feng P, Zhou B, Xu M, Wang Z, Pang Y. Multi-label correlation guided feature fusion network for abnormal ECG diagnosis. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107508] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
23
|
Ghazarian A, Zheng J, El-Askary H, Chu H, Fu G, Rakovski C. Increased Risks of Re-identification For Patients Posed by Deep Learning-Based ECG Identification Algorithms. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:1969-1975. [PMID: 34891673 DOI: 10.1109/embc46164.2021.9630880] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
ECGs analysis is an important tool in cardiac diagnosis. ECG data also have the potential to be used as a biometric source that allows precise person identification similar to the widely used fingerprint and iris recognition techniques. However, this phenomenon also raises serious privacy concerns. In this study, we provide a complete, multi-step ECG identification algorithm using a private database of ECG recordings. We train and validate our AI model on approximately 40k patients which makes this study by far the largest research project in this field. Moreover, our best model attained an exceptionally high accuracy of 94.56%. In addition to discussing the general implications of the deployment of such systems related to privacy, for the first time, we also assess the accuracy of ECG-based identification for distinct heart condition groups (and combinations of such conditions) and the corresponding privacy implications. For instance, we discovered that in contrast to initial expectation that identification accuracy for healthy normal sinus rhythm should be the highest, the identification accuracy is higher for patients with sinus tachycardia or patients who are diagnosed with both ST changes and supraventricular tachycardia. This puts these patients at a higher risk of privacy issues due to re-identification. On the other hand, we observed that patients with premature ventricular contractions have an identification accuracy as low as 78.54%. The identification rate for patients with a pacemaker is 80.2%.Clinical relevance-While ECG as a biometric can be a potentially useful technology, it also raises serious concerns regarding the privacy of cardiac patients. Especially, the ECG Identification algorithms empowered by deep learning can increase the risk of re-identification.
Collapse
|
24
|
Chiu JK, Chang CS, Wu SC. ECG-based Biometric Recognition without QRS Segmentation: A Deep Learning-Based Approach. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:88-91. [PMID: 34891246 DOI: 10.1109/embc46164.2021.9630899] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Electrocardiogram (ECG)-based identification systems have been widely studied in the literature. Usually, an ECG trace needs to be segmented according to the detected R peaks to enable feature extraction from the ECGs of duration equal to nearly one cardiac cycle. Beat averaging should also be applied to reduce the influence of inter-beat variation on the extracted features and identification accuracy. Either detecting R peaks or collecting extra heartbeats for averaging will inevitably lead to a delay in the identification process. This paper proposes a deep learning-based ECG biometric identification scheme that allows identity recognition using a random ECG segment without needing R-peak detection and beat averaging. Moreover, the problem of being vulnerable to unregistered subjects in an identification system is also addressed. Experimental results demonstrated that an identification rate of 99.1% for an identification system having 235 enrollees with an equal error rate of 8.08% was achieved.
Collapse
|
25
|
Tuncer T, Aydemir E, Dogan S, Kobat MA, Kaya MC, Metin S. New human identification method using Tietze graph-based feature generation. Soft comput 2021. [DOI: 10.1007/s00500-021-06094-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
26
|
ECG Authentication Based on Non-Linear Normalization under Various Physiological Conditions. SENSORS 2021; 21:s21216966. [PMID: 34770273 PMCID: PMC8587891 DOI: 10.3390/s21216966] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 10/15/2021] [Accepted: 10/16/2021] [Indexed: 11/24/2022]
Abstract
The development and use of wearable devices require high levels of security and have sparked interest in biometric authentication research. Among the available approaches, electrocardiogram (ECG) technology is attracting attention because of its strengths in spoofing. However, morphological changes of ECG, which are affected by physical and psychological factors, can make authentication difficult. In this paper, we propose authentication using non-linear normalization of ECG beats that is robust to changes in ECG waveforms according to heart rate fluctuations in various daily activities. We performed a non-linear normalization method through the analysis of ECG alongside heart rate, evaluating similarities and authenticating the performance of our new method compared to existing methods. Compared with beats before normalization, the average similarity of the proposed method increased 23.7% in the resting state and 43% in the non-resting state. After learning in the resting state, authentication performance reached 99.05% accuracy for the resting state and 88.14% for the non-resting state. The proposed method can be applicable to an ECG-based authentication system under various physiological conditions.
Collapse
|
27
|
Salvi R, Fuentealba P, Henze J, Bisgin P, Sühn T, Spiller M, Burmann A, Boese A, Illanes A, Friebe M. Vascular Auscultation of Carotid Artery: Towards Biometric Identification and Verification of Individuals. SENSORS (BASEL, SWITZERLAND) 2021; 21:6656. [PMID: 34640975 PMCID: PMC8512563 DOI: 10.3390/s21196656] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 09/28/2021] [Accepted: 09/29/2021] [Indexed: 11/27/2022]
Abstract
BACKGROUND Biometric sensing is a security method for protecting information and property. State-of-the-art biometric traits are behavioral and physiological in nature. However, they are vulnerable to tampering and forgery. METHODS The proposed approach uses blood flow sounds in the carotid artery as a source of biometric information. A handheld sensing device and an associated desktop application were built. Between 80 and 160 carotid recordings of 11 s in length were acquired from seven individuals each. Wavelet-based signal analysis was performed to assess the potential for biometric applications. RESULTS The acquired signals per individual proved to be consistent within one carotid sound recording and between multiple recordings spaced by several weeks. The averaged continuous wavelet transform spectra for all cardiac cycles of one recording showed specific spectral characteristics in the time-frequency domain, allowing for the discrimination of individuals, which could potentially serve as an individual fingerprint of the carotid sound. This is also supported by the quantitative analysis consisting of a small convolutional neural network, which was able to differentiate between different users with over 95% accuracy. CONCLUSION The proposed approach and processing pipeline appeared promising for the discrimination of individuals. The biometrical recognition could clinically be used to obtain and highlight differences from a previously established personalized audio profile and subsequently could provide information on the source of the deviation as well as on its effects on the individual's health. The limited number of individuals and recordings require a study in a larger population along with an investigation of the long-term spectral stability of carotid sounds to assess its potential as a biometric marker. Nevertheless, the approach opens the perspective for automatic feature extraction and classification.
Collapse
Affiliation(s)
- Rutuja Salvi
- IDTM GmbH-Ingenieurgesellschaft für Diagnostischen und Therapeutische Medizintechnik mit Beschränkter Haftung, 45657 Recklinghausen, Germany; (R.S.); (M.F.)
| | - Patricio Fuentealba
- IDTM GmbH-Ingenieurgesellschaft für Diagnostischen und Therapeutische Medizintechnik mit Beschränkter Haftung, 45657 Recklinghausen, Germany; (R.S.); (M.F.)
- Instituto de Electricidad y Electrónica, Facultad de Ciencias de la Ingeniería, Universidad Austral de Chile, Valdivia 5111187, Chile
| | - Jasmin Henze
- Fraunhofer Institute for Software and Systems Engineering, 44227 Dortmund, Germany; (J.H.); (P.B.); (A.B.)
| | - Pinar Bisgin
- Fraunhofer Institute for Software and Systems Engineering, 44227 Dortmund, Germany; (J.H.); (P.B.); (A.B.)
| | - Thomas Sühn
- INKA-Innovation Laboratory for Image Guided Therapy, Otto-von-Guericke University, 39120 Magdeburg, Germany; (T.S.); (M.S.); (A.I.)
- SURAG Medical GmbH-Surgical Audio Guidance, 39120 Magdeburg, Germany
| | - Moritz Spiller
- INKA-Innovation Laboratory for Image Guided Therapy, Otto-von-Guericke University, 39120 Magdeburg, Germany; (T.S.); (M.S.); (A.I.)
- SURAG Medical GmbH-Surgical Audio Guidance, 39120 Magdeburg, Germany
| | - Anja Burmann
- Fraunhofer Institute for Software and Systems Engineering, 44227 Dortmund, Germany; (J.H.); (P.B.); (A.B.)
| | - Axel Boese
- MEDICS GmbH-Medical Innovation to Certification Services, 39114 Magdeburg, Germany;
| | - Alfredo Illanes
- INKA-Innovation Laboratory for Image Guided Therapy, Otto-von-Guericke University, 39120 Magdeburg, Germany; (T.S.); (M.S.); (A.I.)
- SURAG Medical GmbH-Surgical Audio Guidance, 39120 Magdeburg, Germany
| | - Michael Friebe
- IDTM GmbH-Ingenieurgesellschaft für Diagnostischen und Therapeutische Medizintechnik mit Beschränkter Haftung, 45657 Recklinghausen, Germany; (R.S.); (M.F.)
- INKA-Innovation Laboratory for Image Guided Therapy, Otto-von-Guericke University, 39120 Magdeburg, Germany; (T.S.); (M.S.); (A.I.)
| |
Collapse
|
28
|
AlDuwaile DA, Islam MS. Using Convolutional Neural Network and a Single Heartbeat for ECG Biometric Recognition. ENTROPY 2021; 23:e23060733. [PMID: 34207846 PMCID: PMC8229700 DOI: 10.3390/e23060733] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 05/23/2021] [Accepted: 06/06/2021] [Indexed: 11/16/2022]
Abstract
The electrocardiogram (ECG) signal has become a popular biometric modality due to characteristics that make it suitable for developing reliable authentication systems. However, the long segment of signal required for recognition is still one of the limitations of existing ECG biometric recognition methods and affects its acceptability as a biometric modality. This paper investigates how a short segment of an ECG signal can be effectively used for biometric recognition, using deep-learning techniques. A small convolutional neural network (CNN) is designed to achieve better generalization capability by entropy enhancement of a short segment of a heartbeat signal. Additionally, it investigates how various blind and feature-dependent segments with different lengths affect the performance of the recognition system. Experiments were carried out on two databases for performance evaluation that included single and multisession records. In addition, a comparison was made between the performance of the proposed classifier and four well-known CNN models: GoogLeNet, ResNet, MobileNet and EfficientNet. Using a time-frequency domain representation of a short segment of an ECG signal around the R-peak, the proposed model achieved an accuracy of 99.90% for PTB, 98.20% for the ECG-ID mixed-session, and 94.18% for ECG-ID multisession datasets. Using the preprinted ResNet, we obtained 97.28% accuracy for 0.5-second segments around the R-peaks for ECG-ID multisession datasets, outperforming existing methods. It was found that the time-frequency domain representation of a short segment of an ECG signal can be feasible for biometric recognition by achieving better accuracy and acceptability of this modality.
Collapse
|
29
|
Yeh LR, Chen WC, Chan HY, Lu NH, Wang CY, Twan WH, Du WC, Huang YH, Hsu SY, Chen TB. Integrating ECG Monitoring and Classification via IoT and Deep Neural Networks. BIOSENSORS-BASEL 2021; 11:bios11060188. [PMID: 34201215 PMCID: PMC8226863 DOI: 10.3390/bios11060188] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 05/26/2021] [Accepted: 06/07/2021] [Indexed: 12/24/2022]
Abstract
Anesthesia assessment is most important during surgery. Anesthesiologists use electrocardiogram (ECG) signals to assess the patient’s condition and give appropriate medications. However, it is not easy to interpret the ECG signals. Even physicians with more than 10 years of clinical experience may still misjudge. Therefore, this study uses convolutional neural networks to classify ECG image types to assist in anesthesia assessment. The research uses Internet of Things (IoT) technology to develop ECG signal measurement prototypes. At the same time, it classifies signal types through deep neural networks, divided into QRS widening, sinus rhythm, ST depression, and ST elevation. Three models, ResNet, AlexNet, and SqueezeNet, are developed with 50% of the training set and test set. Finally, the accuracy and kappa statistics of ResNet, AlexNet, and SqueezeNet in ECG waveform classification were (0.97, 0.96), (0.96, 0.95), and (0.75, 0.67), respectively. This research shows that it is feasible to measure ECG in real time through IoT and then distinguish four types through deep neural network models. In the future, more types of ECG images will be added, which can improve the real-time classification practicality of the deep model.
Collapse
Affiliation(s)
- Li-Ren Yeh
- Department of Anesthesiology, E-DA Cancer Hospital, I-Shou University, No. 65, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan;
- Department of Health and Beauty, Shu-Zen Junior College of Medicine and Management, No. 452, Huanqiu Road, Luzhu District, Kaohsiung City 82144, Taiwan
| | - Wei-Chin Chen
- Department of Anesthesiology, E-DA Hospital, I-Shou University, No. 1, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan;
| | - Hua-Yan Chan
- Department of Medical Radiology, E-DA Cancer Hospital, I-Shou University, No. 1, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan;
| | - Nan-Han Lu
- Department of Pharmacy, Tajen University, No. 20, Weixin Road, Yanpu Township, Pingtung County 90741, Taiwan;
- Department of Radiology, E-DA Hospital, I-Shou University, No. 1, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan
- Department of Medical Imaging and Radiological Science, I-Shou University, No. 8, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan; (C.-Y.W.); (Y.-H.H.)
| | - Chi-Yuan Wang
- Department of Medical Imaging and Radiological Science, I-Shou University, No. 8, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan; (C.-Y.W.); (Y.-H.H.)
- Department of Radiology, Zuoying Branch of Kaohsiung Armed Forces General Hospital, No. 553, Junxiao Rd., Zuoying District, Kaohsiung City 81342, Taiwan
| | - Wen-Hung Twan
- Department of Life Sciences, National Taitung University, No. 369, Sec. 2, University Road, Taitung 95092, Taiwan;
| | - Wei-Chang Du
- Department of Information Engineering, I-Shou University, No. 1, Sec. 1, Syuecheng Road, Dashu District, Kaohsiung City 84001, Taiwan;
| | - Yung-Hui Huang
- Department of Medical Imaging and Radiological Science, I-Shou University, No. 8, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan; (C.-Y.W.); (Y.-H.H.)
| | - Shih-Yen Hsu
- Department of Medical Imaging and Radiological Science, I-Shou University, No. 8, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan; (C.-Y.W.); (Y.-H.H.)
- Department of Information Engineering, I-Shou University, No. 1, Sec. 1, Syuecheng Road, Dashu District, Kaohsiung City 84001, Taiwan;
- Correspondence: (S.-Y.H.); (T.-B.C.)
| | - Tai-Been Chen
- Department of Medical Imaging and Radiological Science, I-Shou University, No. 8, Yida Road, Jiao-su Village, Yan-chao District, Kaohsiung City 82445, Taiwan; (C.-Y.W.); (Y.-H.H.)
- Institute of Statistics, National Yang Ming Chiao Tung University, No. 1001, University Road, Hsinchu 30010, Taiwan
- Correspondence: (S.-Y.H.); (T.-B.C.)
| |
Collapse
|
30
|
|
31
|
Zhou R, Wang C, Zhang P, Chen X, Du L, Wang P, Zhao Z, Du M, Fang Z. ECG-based biometric under different psychological stress states. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 202:106005. [PMID: 33662803 DOI: 10.1016/j.cmpb.2021.106005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 02/11/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE In recent years, people have been exploring methods for biometric identification through electrocardiogram (ECG) signals. Under the same psychological pressure state, biometric identification through ECG signals is a traditional verification method. However, ECG signals are affected by changes in psychological stress, and ECG-Based biometric under different psychological stress states are still challenging. In this paper, we propose a method combining manual and automatic features for ECG-based biometric under different psychological stress states. And propose a new indicator Stress Classification Coefficient (SCC) that assesses the effect of different psychological stress on heart rate variability (HRV) features. METHODS In our method, we obtain manual features to be a three-step process: first, HRV features obtained from the ECG signals. Second, based on HRV features, the mental state of the experimental subjects is assessed by using the Gaussian mixture model (GMM). Finally, use cluster centers to process the original HRV features to reduce the Stress Classification Coefficient (SCC). Also, the one-dimensional convolutional neural network is constructed to automatically extract the implied features of ECG signals. Finally, the manual feature and the automatic feature are combined, and the final recognition result is obtained through the support vector machine (SVM) model. The major attribute of the proposed method is that it can perform ECG biometric under different psychological stress states. The combination of manual and automatic features expands the application scenarios of ECG-based biometric. RESULTS Based on this method, we used the Montreal stress model with calculation experiment in the laboratory to induce stress on 23 healthy students (10 women and 13 men, aged 20-37), and obtain their ECG signals under different stress conditions. Through this method to recognize the above data, an average recognition rate of more than 95% can be achieved, the average F1 score is 0.97. CONCLUSIONS The proposed method in this article is a promising approach to deal with the effects of different psychological stresses on ECG-Based biometric. It provides the possibility of ECG-Based biometric under different psychological stress.
Collapse
Affiliation(s)
- Ruishi Zhou
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; University of Chinese Academy of Sciences, Beijing, China.
| | - Chenshuo Wang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; University of Chinese Academy of Sciences, Beijing, China.
| | - Pengfei Zhang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Xianxiang Chen
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Lidong Du
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Peng Wang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Zhan Zhao
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China.
| | - Mingyan Du
- Beijing Luhe Hospital, Capital Medical University, Beijing, China.
| | - Zhen Fang
- Aerospace Information Research Institute, Chinese Academy of Sciences (AIRCAS), Beijing, China; Personalized Management of Chronic Respiratory Disease, Chinese Academy of Medical Sciences, China; University of Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
32
|
A Novel Fingerprint Biometric Cryptosystem Based on Convolutional Neural Networks. MATHEMATICS 2021. [DOI: 10.3390/math9070730] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Modern access controls employ biometrics as a means of authentication to a great extent. For example, biometrics is used as an authentication mechanism implemented on commercial devices such as smartphones and laptops. This paper presents a fingerprint biometric cryptosystem based on the fuzzy commitment scheme and convolutional neural networks. One of its main contributions is a novel approach to automatic discretization of fingerprint texture descriptors, entirely based on a convolutional neural network, and designed to generate fixed-length templates. By converting templates into the binary domain, we developed the biometric cryptosystem that can be used in key-release systems or as a template protection mechanism in fingerprint matching biometric systems. The problem of biometric data variability is marginalized by applying the secure block-level Bose–Chaudhuri–Hocquenghem error correction codes, resistant to statistical-based attacks. The evaluation shows significant performance gains when compared to other texture-based fingerprint matching and biometric cryptosystems.
Collapse
|
33
|
Fu Z, Hong S, Zhang R, Du S. Artificial-Intelligence-Enhanced Mobile System for Cardiovascular Health Management. SENSORS 2021; 21:s21030773. [PMID: 33498892 PMCID: PMC7865877 DOI: 10.3390/s21030773] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 01/19/2021] [Accepted: 01/20/2021] [Indexed: 12/25/2022]
Abstract
The number of patients with cardiovascular diseases is rapidly increasing in the world. The workload of existing clinicians is consequently increasing. However, the number of cardiovascular clinicians is declining. In this paper, we aim to design a mobile and automatic system to improve the abilities of patients’ cardiovascular health management while also reducing clinicians’ workload. Our system includes both hardware and cloud software devices based on recent advances in Internet of Things (IoT) and Artificial Intelligence (AI) technologies. A small hardware device was designed to collect high-quality Electrocardiogram (ECG) data from the human body. A novel deep-learning-based cloud service was developed and deployed to achieve automatic and accurate cardiovascular disease detection. Twenty types of diagnostic items including sinus rhythm, tachyarrhythmia, and bradyarrhythmia are supported. Experimental results show the effectiveness of our system. Our hardware device can guarantee high-quality ECG data by removing high-/low-frequency distortion and reverse lead detection with 0.9011 Area Under the Receiver Operating Characteristic Curve (ROC–AUC) score. Our deep-learning-based cloud service supports 20 types of diagnostic items, 17 of them have more than 0.98 ROC–AUC score. For a real world application, the system has been used by around 20,000 users in twenty provinces throughout China. As a consequence, using this service, we could achieve both active and passive health management through a lightweight mobile application on the WeChat Mini Program platform. We believe that it can have a broader impact on cardiovascular health management in the world.
Collapse
Affiliation(s)
- Zhaoji Fu
- School of Management, University of Science and Technology of China, Hefei 230026, China; (Z.F.); (S.D.)
- HeartVoice Medical Technology, Hefei 230027, China
| | - Shenda Hong
- National Institute of Health Data Science at Peking University, Peking University, Beijing 100191, China
- Institute of Medical Technology, Health Science Center of Peking University, Beijing 100191, China
- Correspondence:
| | - Rui Zhang
- Division of Life Science and Medicine, University of Science and Technology of China, Hefei 230026, China;
| | - Shaofu Du
- School of Management, University of Science and Technology of China, Hefei 230026, China; (Z.F.); (S.D.)
| |
Collapse
|
34
|
Hong S, Zhou Y, Shang J, Xiao C, Sun J. Opportunities and challenges of deep learning methods for electrocardiogram data: A systematic review. Comput Biol Med 2020; 122:103801. [PMID: 32658725 DOI: 10.1016/j.compbiomed.2020.103801] [Citation(s) in RCA: 108] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2019] [Revised: 04/30/2020] [Accepted: 04/30/2020] [Indexed: 12/15/2022]
Abstract
BACKGROUND The electrocardiogram (ECG) is one of the most commonly used diagnostic tools in medicine and healthcare. Deep learning methods have achieved promising results on predictive healthcare tasks using ECG signals. OBJECTIVE This paper presents a systematic review of deep learning methods for ECG data from both modeling and application perspectives. METHODS We extracted papers that applied deep learning (deep neural network) models to ECG data that were published between January 1st of 2010 and February 29th of 2020 from Google Scholar, PubMed, and the Digital Bibliography & Library Project. We then analyzed each article according to three factors: tasks, models, and data. Finally, we discuss open challenges and unsolved problems in this area. RESULTS The total number of papers extracted was 191. Among these papers, 108 were published after 2019. Different deep learning architectures have been used in various ECG analytics tasks, such as disease detection/classification, annotation/localization, sleep staging, biometric human identification, and denoising. CONCLUSION The number of works on deep learning for ECG data has grown explosively in recent years. Such works have achieved accuracy comparable to that of traditional feature-based approaches and ensembles of multiple approaches can achieve even better results. Specifically, we found that a hybrid architecture of a convolutional neural network and recurrent neural network ensemble using expert features yields the best results. However, there are some new challenges and problems related to interpretability, scalability, and efficiency that must be addressed. Furthermore, it is also worth investigating new applications from the perspectives of datasets and methods. SIGNIFICANCE This paper summarizes existing deep learning research using ECG data from multiple perspectives and highlights existing challenges and problems to identify potential future research directions.
Collapse
Affiliation(s)
- Shenda Hong
- Department of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, USA.
| | - Yuxi Zhou
- School of Electronics Engineering and Computer Science, Peking University, Beijing, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, China.
| | - Junyuan Shang
- School of Electronics Engineering and Computer Science, Peking University, Beijing, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing, China.
| | - Cao Xiao
- Analytics Center of Excellence, IQVIA, Cambridge, USA.
| | - Jimeng Sun
- Department of Computer Science, University of Illinois at Urbana-Champaign, Urbana, USA.
| |
Collapse
|