1
|
Zhang X, Liu Q, He D, Suo H, Zhao C. Electrocardiogram-Based Biometric Identification Using Mixed Feature Extraction and Sparse Representation. SENSORS (BASEL, SWITZERLAND) 2023; 23:9179. [PMID: 38005564 PMCID: PMC10675745 DOI: 10.3390/s23229179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 11/06/2023] [Accepted: 11/13/2023] [Indexed: 11/26/2023]
Abstract
(1) Background: The ability to recognize identities is an essential component of security. Electrocardiogram (ECG) signals have gained popularity for identity recognition because of their universal, unique, stable, and measurable characteristics. To ensure accurate identification of ECG signals, this paper proposes an approach which involves mixed feature sampling, sparse representation, and recognition. (2) Methods: This paper introduces a new method of identifying individuals through their ECG signals. This technique combines the extraction of fixed ECG features and specific frequency features to improve accuracy in ECG identity recognition. This approach uses the wavelet transform to extract frequency bands which contain personal information features from the ECG signals. These bands are reconstructed, and the single R-peak localization determines the ECG window. The signals are segmented and standardized based on the located windows. A sparse dictionary is created using the standardized ECG signals, and the KSVD (K-Orthogonal Matching Pursuit) algorithm is employed to project ECG target signals into a sparse vector-matrix representation. To extract the final representation of the target signals for identification, the sparse coefficient vectors in the signals are maximally pooled. For recognition, the co-dimensional bundle search method is used in this paper. (3) Results: This paper utilizes the publicly available European ST-T database for our study. Specifically, this paper selects ECG signals from 20, 50 and 70 subjects, each with 30 testing segments. The method proposed in this paper achieved recognition rates of 99.14%, 99.09%, and 99.05%, respectively. (4) Conclusion: The experiments indicate that the method proposed in this paper can accurately capture, represent and identify ECG signals.
Collapse
Affiliation(s)
- Xu Zhang
- State Key Laboratory of Integrated Optoelectronics, College of Electronic Science and Engineering, Jilin University, Changchun 130015, China; (X.Z.); (H.S.); (C.Z.)
| | - Qifeng Liu
- School of Preparatory Education, Jilin University, Changchun 130015, China
| | - Dong He
- State Key Laboratory of Integrated Optoelectronics, College of Electronic Science and Engineering, Jilin University, Changchun 130015, China; (X.Z.); (H.S.); (C.Z.)
| | - Hui Suo
- State Key Laboratory of Integrated Optoelectronics, College of Electronic Science and Engineering, Jilin University, Changchun 130015, China; (X.Z.); (H.S.); (C.Z.)
| | - Chun Zhao
- State Key Laboratory of Integrated Optoelectronics, College of Electronic Science and Engineering, Jilin University, Changchun 130015, China; (X.Z.); (H.S.); (C.Z.)
| |
Collapse
|
2
|
Wang X, Zhao S, Pei Y, Luo Z, Xie L, Yan Y, Yin E. The increasing instance of negative emotion reduce the performance of emotion recognition. Front Hum Neurosci 2023; 17:1180533. [PMID: 37900730 PMCID: PMC10611512 DOI: 10.3389/fnhum.2023.1180533] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 09/29/2023] [Indexed: 10/31/2023] Open
Abstract
Introduction Emotion recognition plays a crucial role in affective computing. Recent studies have demonstrated that the fuzzy boundaries among negative emotions make recognition difficult. However, to the best of our knowledge, no formal study has been conducted thus far to explore the effects of increased negative emotion categories on emotion recognition. Methods A dataset of three sessions containing consistent non-negative emotions and increased types of negative emotions was designed and built which consisted the electroencephalogram (EEG) and the electrocardiogram (ECG) recording of 45 participants. Results The results revealed that as negative emotion categories increased, the recognition rates decreased by more than 9%. Further analysis depicted that the discriminative features gradually reduced with an increase in the negative emotion types, particularly in the θ, α, and β frequency bands. Discussion This study provided new insight into the balance of emotion-inducing stimuli materials.
Collapse
Affiliation(s)
- Xiaomin Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Shaokai Zhao
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, China
| | - Yu Pei
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, China
| | - Zhiguo Luo
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, China
| | - Liang Xie
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, China
| | - Ye Yan
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, China
| | - Erwei Yin
- Defense Innovation Institute, Academy of Military Sciences (AMS), Beijing, China
| |
Collapse
|
3
|
Asif MS, Faisal MS, Dar MN, Hamdi M, Elmannai H, Rizwan A, Abbas M. Hybrid Deep Learning and Discrete Wavelet Transform-Based ECG Biometric Recognition for Arrhythmic Patients and Healthy Controls. SENSORS (BASEL, SWITZERLAND) 2023; 23:4635. [PMID: 37430549 PMCID: PMC10220968 DOI: 10.3390/s23104635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 05/05/2023] [Accepted: 05/08/2023] [Indexed: 07/12/2023]
Abstract
The intrinsic and liveness detection behavior of electrocardiogram (ECG) signals has made it an emerging biometric modality for the researcher with several applications including forensic, surveillance and security. The main challenge is the low recognition performance with datasets of large populations, including healthy and heart-disease patients, with a short interval of an ECG signal. This research proposes a novel method with the feature-level fusion of the discrete wavelet transform and a one-dimensional convolutional recurrent neural network (1D-CRNN). ECG signals were preprocessed by removing high-frequency powerline interference, followed by a low-pass filter with a cutoff frequency of 1.5 Hz for physiological noises and by baseline drift removal. The preprocessed signal is segmented with PQRST peaks, while the segmented signals are passed through Coiflets' 5 Discrete Wavelet Transform for conventional feature extraction. The 1D-CRNN with two long short-term memory (LSTM) layers followed by three 1D convolutional layers was applied for deep learning-based feature extraction. These combinations of features result in biometric recognition accuracies of 80.64%, 98.81% and 99.62% for the ECG-ID, MIT-BIH and NSR-DB datasets, respectively. At the same time, 98.24% is achieved when combining all of these datasets. This research also compares conventional feature extraction, deep learning-based feature extraction and a combination of these for performance enhancement, compared to transfer learning approaches such as VGG-19, ResNet-152 and Inception-v3 with a small segment of ECG data.
Collapse
Affiliation(s)
- Muhammad Sheharyar Asif
- Department of Computer Science, COMSATS University Islamabad, Attock City 43600, Pakistan; (M.S.A.); (M.S.F.)
| | - Muhammad Shahzad Faisal
- Department of Computer Science, COMSATS University Islamabad, Attock City 43600, Pakistan; (M.S.A.); (M.S.F.)
| | - Muhammad Najam Dar
- Department of Electrical and Computer Engineering, Air University, Islamabad 44000, Pakistan
| | - Monia Hamdi
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia; (M.H.); (H.E.)
| | - Hela Elmannai
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia; (M.H.); (H.E.)
| | - Atif Rizwan
- Department of Computer Engineering, Jeju National University, Jejusi 63243, Republic of Korea
| | - Muhammad Abbas
- Department of Computer and Software Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan;
| |
Collapse
|
4
|
Prakash AJ, Patro KK, Samantray S, Pławiak P, Hammad M. A Deep Learning Technique for Biometric Authentication Using ECG Beat Template Matching. INFORMATION 2023; 14:65. [DOI: 10.3390/info14020065] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/23/2024] Open
Abstract
An electrocardiogram (ECG) is a unique representation of a person’s identity, similar to fingerprints, and its rhythm and shape are completely different from person to person. Cloning and tampering with ECG-based biometric systems are very difficult. So, ECG signals have been used successfully in a number of biometric recognition applications where security is a top priority. The major challenges in the existing literature are (i) the noise components in the signals, (ii) the inability to automatically extract the feature set, and (iii) the performance of the system. This paper suggests a beat-based template matching deep learning (DL) technique to solve problems with traditional techniques. ECG beat denoising, R-peak detection, and segmentation are done in the pre-processing stage of this proposed methodology. These noise-free ECG beats are converted into gray-scale images and applied to the proposed deep-learning technique. A customized activation function is also developed in this work for faster convergence of the deep learning network. The proposed network can extract features automatically from the input data. The network performance is tested with a publicly available ECGID biometric database, and the proposed method is compared with the existing literature. The comparison shows that the proposed modified Siamese network authenticated biometrics have an accuracy of 99.85%, a sensitivity of 99.30%, a specificity of 99.85%, and a positive predictivity of 99.76%. The experimental results show that the proposed method works better than the state-of-the-art techniques.
Collapse
Affiliation(s)
- Allam Jaya Prakash
- Department of ECE, National Institute of Technology Rourkela, Rourkela 769008, Odisha, India
| | - Kiran Kumar Patro
- Department of ECE, Aditya Institute of Technology and Management, Tekkali 532201, Andhra Pradesh, India
| | - Saunak Samantray
- Department of ETC, IIIT Bhubaneswar, Gothapatna 751003, Odisha, India
| | - Paweł Pławiak
- Department of Computer Science, Faculty of Computer Science and Telecommunications, Cracow University of Technology, Warszawska 24, 31-155 Krakow, Poland
- Institute of Theoretical and Applied Informatics, Polish Academy of Sciences, Bałtycka 5, 44-100 Gliwice, Poland
| | - Mohamed Hammad
- Information Technology Department, Faculty of Computers and Information, Menoufia University, Menoufia P.O. Box 32511, Egypt
| |
Collapse
|
5
|
Jaya Prakash A, Patro KK, Hammad M, Tadeusiewicz R, Pławiak P. BAED: A secured biometric authentication system using ECG signal based on deep learning techniques. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.08.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
6
|
El Boujnouni I, Zili H, Tali A, Tali T, Laaziz Y. A wavelet-based capsule neural network for ECG biometric identification. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
7
|
Shaw R, Mohanty C, Patra BK, Pradhan A. 1D Multi-Point Local Ternary Pattern: A Novel Feature Extraction Method for Analyzing Cognitive Engagement of students in Flipped Learning Pedagogy. Cognit Comput 2022; 15:1-14. [PMID: 35637880 PMCID: PMC9132764 DOI: 10.1007/s12559-022-10023-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Accepted: 04/24/2022] [Indexed: 12/04/2022]
Abstract
Flipped learning is a blended learning method based on academic engagement of students online (outside class) and offline (inside class). In this learning pedagogy, students receive lesson any time from lecture videos pre-loaded on digital platform at their convenience places and it is followed by in-classroom activities such as doubt clearing, problem solving, etc. However, students are constantly exposed to high levels of distraction in this age of the Internet. Therefore, it is hard for an instructor to know whether a student has paid attention while watching pre-loaded lecture video. In order to analyze attention level of individual students, captured brain signal or electroencephalogram (EEG) of students can be utilized. In this study, we utilize a popular feature extraction technique called Local Binary Pattern (LBP) and improvise it to develop an enhanced feature selection method. The adapted feature selection method termed as 1D Multi-Point Local Ternary Pattern (1D MP-LTP) is used to extract unique features from collected electroencephalogram (EEG) signals. Standard classification techniques are exploited to classify the attention level of students. Experiments are conducted with the data captured at Intelligent Data Analysis Lab, NIT Rourkela, to show effectiveness of the proposed feature extraction technique. The proposed 1D Multi-Point Local Ternary Pattern (1D MP-LTP)-based classification techniques outperform traditional and state-of-the-art classification techniques using LBP. This research can be helpful for instructors to identify students who need special care for improving their learning ability. Researchers in educational technology can extend this work by adopting this methodology in other online teaching pedagogy such as Massive Open Online Courses (MOOC).
Collapse
Affiliation(s)
- Rabi Shaw
- Department of Computer Science and Engineering, National Institute of Technology Rourkela, Rourkela, Odisha, 769008 India
| | - Chinmay Mohanty
- Department of Computer Science and Engineering, National Institute of Technology Rourkela, Rourkela, Odisha, 769008 India
| | - Bidyut Kr. Patra
- Department of Computer Science and Engineering, National Institute of Technology Rourkela, Rourkela, Odisha, 769008 India
| | - Animesh Pradhan
- Department of Computer Science and Engineering, National Institute of Technology Rourkela, Rourkela, Odisha, 769008 India
| |
Collapse
|
8
|
Tuncer T, Dogan S, Baygin M, Rajendra Acharya U. Tetromino pattern based accurate EEG emotion classification model. Artif Intell Med 2022; 123:102210. [PMID: 34998511 DOI: 10.1016/j.artmed.2021.102210] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 10/31/2021] [Accepted: 11/01/2021] [Indexed: 11/17/2022]
Abstract
Nowadays, emotion recognition using electroencephalogram (EEG) signals is becoming a hot research topic. The aim of this paper is to classify emotions of EEG signals using a novel game-based feature generation function with high accuracy. Hence, a multileveled handcrafted feature generation automated emotion classification model using EEG signals is presented. A novel textural features generation method inspired by the Tetris game called Tetromino is proposed in this work. The Tetris game is one of the famous games worldwide, which uses various characters in the game. First, the EEG signals are subjected to discrete wavelet transform (DWT) to create various decomposition levels. Then, novel features are generated from the decomposed DWT sub-bands using the Tetromino method. Next, the maximum relevance minimum redundancy (mRMR) features selection method is utilized to select the most discriminative features, and the selected features are classified using support vector machine classifier. Finally, each channel's results (validation predictions) are obtained, and the mode function-based voting method is used to obtain the general results. We have validated our developed model using three databases (DREAMER, GAMEEMO, and DEAP). We have attained 100% accuracies using DREAMER and GAMEEMO datasets. Furthermore, over 99% of classification accuracy is achieved for DEAP dataset. Thus, our developed emotion detection model has yielded the best classification accuracy rate compared to the state-of-the-art techniques and is ready to be tested for clinical application after validating with more diverse datasets. Our results show the success of the presented Tetromino pattern-based EEG signal classification model validated using three public emotional EEG datasets.
Collapse
Affiliation(s)
- Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey.
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig, Turkey
| | - Mehmet Baygin
- Department of Computer Engineering, Faculty of Engineering, Ardahan University, Ardahan, Turkey
| | - U Rajendra Acharya
- Ngee Ann Polytechnic, Department of Electronics and Computer Engineering, 599489, Singapore; Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore; Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|