Cancelable HD-sEMG-Based Biometrics for Cross-Application Discrepant Personal Identification

Cybersecurity in neural interfaces: Survey and future trends

With the joint advancement in areas such as pervasive neural data sensing, neural computing, neuromodulation and artificial intelligence, neural interface has become a promising technology facilitating both the closed-loop neurorehabilitation for neurologically impaired patients and the intelligent man-machine interactions for general application purposes. However, although neural interface has been widely studied, few previous studies focused on the cybersecurity issues in related applications. In this survey, we systematically investigated possible cybersecurity risks in neural interfaces, together with potential solutions to these problems. Importantly, our survey considers interfacing techniques on both central nervous systems (i.e., brain-computer interfaces) and peripheral nervous systems (i.e., general neural interfaces), covering diverse neural modalities such as electroencephalography, electromyography and more. Moreover, our survey is organized on three different levels: (1) the data level, which mainly focuses on the privacy leakage issue via attacking and analyzing neural database of users; (2) the permission level, which mainly focuses on the prospects and risks to directly use real time neural signals as biometrics for continuous and unobtrusive user identity verification; and (3) the model level, which mainly focuses on adversarial attacks and defenses on both the forward neural decoding models (e.g. via machine learning) and the backward feedback implementation models (e.g. via neuromodulation and stimulation). This is the first study to systematically investigate cybersecurity risks and possible solutions in neural interfaces which covers both central and peripheral nervous systems, and considers multiple different levels to provide a complete picture of this issue.

Comparison of Wrist and Forearm EMG for Multi-day Biometric Authentication

Recently, electromyography (EMG) has been established as a promising new biometric trait that provides a unique dual mode security: biometrics and knowledge. For authentication that is used daily and long-term by general consumers, the wrist is a suitable location, which could be easily integrated into the existing form of smartwatches and fitness trackers. However, current EMG-based biometrics still follow the historical path of powered prosthetics research, where EMG signals were usually recorded from forearm positions. Moreover, the robustness of EMG processing algorithms across multiple days is still an open problem that needs to be addressed before for long-term reliable use. This study intends to investigate the difference in authentication performance between wrist and forearm EMG signals, in a within-day and two cross-day analyses. Our open dataset (GRABMyo dataset) was used to examine this difference, which contains forearm and wrist EMG data collected from 43 participants over three different days with long separation (Days 1, 8, and 29). The results showed wrist EMG signals led to at least comparable with forearm EMG signals in within-day Equal-error rate (EER). In cross-day analysis, the EER of the wrist EMG signals was higher than that of forearm signals. In general, the low median EER (<0.1) of wrist EMG in cumulative cross-day analysis demonstrates the promise of using wrist EMG signals for authentication in long-term applications.

MCR-ALS-based muscle synergy extraction method combined with LSTM neural network for motion intention detection

Introduction

The time-varying and individual variability of surface electromyographic signals (sEMG) can lead to poorer motor intention detection results from different subjects and longer temporal intervals between training and testing datasets. The consistency of using muscle synergy between the same tasks may be beneficial to improve the detection accuracy over long time ranges. However, the conventional muscle synergy extraction methods, such as non-negative matrix factorization (NMF) and principal component analysis (PCA) have some limitations in the field of motor intention detection, especially in the continuous estimation of upper limb joint angles.

Methods

In this study, we proposed a reliable multivariate curve-resolved-alternating least squares (MCR-ALS) muscle synergy extraction method combined with long-short term memory neural network (LSTM) to estimate continuous elbow joint motion by using the sEMG datasets from different subjects and different days. The pre-processed sEMG signals were then decomposed into muscle synergies by MCR-ALS, NMF and PCA methods, and the decomposed muscle activation matrices were used as sEMG features. The sEMG features and elbow joint angular signals were input to LSTM to establish a neural network model. Finally, the established neural network models were tested by using sEMG dataset from different subjects and different days, and the detection accuracy was measured by correlation coefficient.

Results

The detection accuracy of elbow joint angle was more than 85% by using the proposed method. This result was significantly higher than the detection accuracies obtained by using NMF and PCA methods. The results showed that the proposed method can improve the accuracy of motor intention detection results from different subjects and different acquisition timepoints.

Discussion

This study successfully improves the robustness of sEMG signals in neural network applications using an innovative muscle synergy extraction method. It contributes to the application of human physiological signals in human-machine interaction.

Random Channel Masks for Regularization of Least Squares-Based Finger EMG-Force Modeling to Improve Cross-Day Performance

Estimating the finger forces from surface electromyography (sEMG) is essential for diverse applications (e.g., human-machine interfacing). The performance of pre-trained sEMG-force models degenerates significantly when applied on a second day, due to the large cross-day variation of sEMG characteristics. Previous studies mainly employed transfer learning algorithms to tackle this problem. However, transfer learning algorithms normally require data collected on the second day for model calibration, increasing the inconvenience in practical use. In this work, we investigated the effect of model regularization on this issue. Specifically, 256-channel high-density sEMG (HDsEMG) signals with varying finger forces were collected on different days (3-25 days apart). We applied randomly generated channel perturbations ("masks") to feature maps of randomly selected channels in training dataset. The channel masks of the training set were generated randomly and independently in each narrow time window (~20 ms). We assumed that by learning from randomly masked feature maps (randomness is the central aspect), the model would not be biased by a small number of features but would be based on learning from a global perspective, therefore avoiding overfitting to the within-day EMG patterns. Moore-Penrose inverse model regularization was also employed as a baseline method, with results showing that cross-day EMG-force models require a higher tolerance parameter compared with within-day applications. In combination with the Moore-Penrose inverse model regularization, further applying random channel masks to the training set significantly improved model performance in cross-day validation.

Multi-Session Surface Electromyogram Signal Database for Personal Identification

Surface electromyogram (sEMG) refers to a biosignal acquired from the skin surface during the contraction of skeletal muscles, and a different signal waveform is generated, depending on the motion performed. Therefore, in contrast to generic personal identification, which uses only a piece of registered information, the sEMG changes the registered information in a personal identification method. The sEMG database (DB) for conventional personal identification has shortcomings, such as a few subjects and the inability to verify sEMG signal variability. In order to solve the problems of DBs, this paper describes a method for constructing a multi-session sEMG DB for many subjects. Data were obtained in two channels when each of the 200 subjects performed 12 motions. There were three sessions, and each motion was repeated 10 times in time intervals of a day or longer between each session. Furthermore, to verify the effectiveness of the constructed sEMG DB, we conducted a personal identification experiment. According to the experimental results, the accuracy for five subjects was 74.19%, demonstrating the applicability of the constructed multi-session sEMG DB.

Personal Identification Using an Ensemble Approach of 1D-LSTM and 2D-CNN with Electrocardiogram Signals

Conventional personal identification methods (ID, password, authorization certificate, etc.) entail various issues, including forgery or loss. Technological advances and the diffusion across industries have enhanced convenience; however, privacy risks due to security attacks are increasing. Hence, personal identification based on biometrics such as the face, iris, fingerprints, and veins has been used widely. However, biometric information including faces and fingerprints is difficult to apply in industries requiring high-level security, owing to tampering or forgery risks and recognition errors. This paper proposes a personal identification technique based on an ensemble of long short-term memory (LSTM) and convolutional neural network (CNN) that uses electrocardiograms (ECGs). An ECG uses internal biometric information, representing the heart rate in signals using microcurrents and thereby including noises during measurements. This noise is removed using filters in a preprocessing step, and the signals are divided into cycles with respect to R-peaks for extracting features. LSTM is used to perform personal identification using ECG signals; 1D ECG signals are transformed into the time–frequency domain using STFT, scalogram, FSST, and WSST; and a 2D-CNN is used to perform personal identification. This ensemble of two models is used to attain higher performances than LSTM or 2D-CNN. Results reveal a performance improvement of 1.06–3.75%.

PerAE: An Effective Personalized AutoEncoder for ECG-based Biometric in Augmented Reality System

With the development of the Augmented and Virtual Reality (AR/VR) technologies, massive biometric data are collected by different organizations. These data have great significance but also worsen the privacy risks. Electro-CardioGram (ECG)-based Identity Recognition (EIR) is a popular Biometric technology. An ECG record is an internal Biology feature of a person and has time continuity. Thus, compared with traditional Biometric methods like face recognition, EIR may be less vulnerable to attack. We propose an Autoencoder-based EIR system, called Personalized AutoEncoder (PerAE). PerAE maintains a small autoencoder model (called Attention-MemAE) for each registered user of a system. The Attention-MemAE enhances the autoencoder by using a memory module and two attention mechanisms. A users Attention-MemAE classifies the hearbeats of other users as anomalies. An Attention-MemAE can be updated when the distribution of the users ECG data is changed. By using personalized autoencoder, PerAE can improve the time efficiency and reduce the memory overhead. It improves the adaptability, scalability, and maintainability of EIR systems. Experiment results show that to train an Attention-MemAE with 90% identification accuracy for a user, we can just take five minutes to collect the users ECG data (around 500 heartbeat samples).

Cancelable HD-sEMG Biometric Identification Via Deep Feature Learning

Conventional biometric modalities, such as face, fingerprint, and iris, are vulnerable against imitation and circumvention. Accordingly, secure biometric modalities with cancellable properties are needed for personal identification, especially in smart healthcare applications. Here we developed a person identification model using high-density surface electromyography (HD-sEMG) as biometric traits. In this model, the HD-sEMG biometric templates are cancellable and could be customized by the users through performing finger isometric contractions. A deep feature learning approach, implemented by convolutional neural networks (CNNs) is used to capture user-specific patterns from HD-sEMG signals and make identification decisions. This model has been validated on twenty-two subjects, with training and testing data acquired from two different days. The rank-1 identification accuracy and equal error rate for 44 identities (22 subjects x 2 accounts) can reach 87.23% and 4.66%, respectively. The cross-day identification accuracy of the proposed model is higher than the results of previous methods reported in the literature. The usability and efficiency of the proposed model are also investigated, indicating its potentials for practical applications.

Score, Rank, and Decision-Level Fusion Strategies of Multicode Electromyogram-based Verification and Identification Biometrics

Recent advances in biometric research have established surface electromyogram (sEMG) as a potential spoof-free solution to address some key limitations in current biometric traits. The nature of sEMG signals provide a unique dual-mode security: sEMGs have individual-specific characteristics (biometrics), and users can customize and change gestures just like passcodes. Such security also facilitates the use of code sequences (multicode) to further enhance the security. In this study, three levels of fusion, score, rank, and decision were investigated for two biometric applications, verification and identification. This study involved 24 subjects performing 16 hand/finger gestures, and code sequences with varying codelengths were generated. The performance of the verification and identification system was analyzed for varying codelength (M: 16) and rank (K: 14) to determine the best fusion scheme and desirable parameter values for a multicode sEMG biometric system. The results showed that the decision-level fusion scheme using a weighted majority voting resulted in an average equal error rate of 0.6% for the verification system when M=4. For the identification system, the score-level fusion scheme with score normalization based on fitting a Weibull distribution resulted in a minimum false rejection rate of 0.01% and false acceptance rate of 4.7% using a combination of K=2 and M=4. The results also suggested that the parameters M and K could be adjusted based on the number of users in the database to facilitate optimal performance. In summary, a multicode sEMG biometric system was developed to provide improved dual-mode security based on the personalized codes and biometric traits of individuals, with the combination of enhanced security and flexibility.

Transcending Conventional Biometry Frontiers: Diffusive Dynamics PPG Biometry

This paper presents the first photoplethysmographic (PPG) signal dynamic-based biometric authentication system with a Siamese convolutional neural network (CNN). Our method extracts the PPG signal's biometric characteristics from its diffusive dynamics, characterized by geometric patterns in the (p,q)-planes specific to the 0-1 test. PPG signal diffusive dynamics are strongly dependent on the vascular bed's biostructure, unique to each individual. The dynamic characteristics of the PPG signal are more stable over time than its morphological features, particularly in the presence of psychosomatic conditions. Besides its robustness, our biometric method is anti-spoofing, given the complex nature of the blood network. Our proposal trains using a national research study database with 40 real-world PPG signals measured with commercial equipment. Biometric system results for input data, raw and preprocessed, are studied and compared with eight primary biometric methods related to PPG, achieving the best equal error rate (ERR) and processing times with a single attempt, among all of them.

Data Management for Transfer Learning Approaches to Elbow EMG-Torque Modeling

The performance of single-use subject-specific electromyogram (EMG)-torque models degrades significantly when used on a new subject, or even the same subject on a second day. Improving the generalization performance of models is essential but challenging. In this work, we investigate how data management strategies contribute to the performance of elbow joint EMG-torque models in cross-subject evaluation. Data management can be divided into two parts, namely data acquisition and data utilization. For data acquisition, analysis of data from 65 subjects shows that training set data diversity (number of subjects) is more important than data size (total data duration). For data utilization, we propose a correlation-based data weighting (COR-W) method for model calibration which is unsupervised in the modeling stage. We first evaluated the domain shift level between data in each training trial (source domain) and data acquired from a new subject (target domain) via the mismatch of feature correlation, using only EMG signals in the target domain without the synchronized torque values (hence unsupervised during model training). Data weights were assigned to each training trial according to different domain shift levels. The weighted least squares method using the obtained data weights was then employed to develop a calibrated EMG-torque model for the new subject. The COR-W method can achieve a low root mean square error (9.29% maximum voluntary contraction) in cross-subject evaluation, with significant performance improvement compared to models without calibration. Both the data acquisition and utilization strategies contribute to the performance of EMG-torque models in cross-subject evaluation.