Two-Step Biometrics Using Electromyogram Signal Based on Convolutional Neural Network-Long Short-Term Memory Networks

Feature evaluation for myoelectric pattern recognition of multiple nearby reaching targets

Intention detection of the reaching movement is considerable for myoelectric human and machine collaboration applications. A comprehensive set of handcrafted features was mined from windows of electromyogram (EMG) of the upper-limb muscles while reaching nine nearby targets like activities of daily living. The feature selection-based scoring method, neighborhood component analysis (NCA), selected the relevant feature subset. Finally, the target was recognized by the support vector machine (SVM) model. The classification performance was generalized by a nested cross-validation structure that selected the optimal feature subset in the inner loop. According to the low spatial resolution of the target location on display and following the slight discrimination of signals between targets, the best classification accuracy of 77.11 % was achieved for concatenating the features of two segments with a length of 2 and 0.25 s. Due to the lack of subtle variation in EMG, while reaching different targets, a wide range of features was applied to consider additional aspects of the knowledge contained in EMG signals. Furthermore, since NCA selected features that provided more discriminant power, it became achievable to employ various combinations of features and even concatenated features extracted from different movement parts to improve classification performance.

MSFF-Net: Multi-Stream Feature Fusion Network for surface electromyography gesture recognition

In the field of surface electromyography (sEMG) gesture recognition, how to improve recognition accuracy has been a research hotspot. The rapid development of deep learning provides a new solution to this problem. At present, the main applications of deep learning for sEMG gesture feature extraction are based on convolutional neural network (CNN) structures to capture spatial morphological information of the multichannel sEMG or based on long short-term memory network (LSTM) to extract time-dependent information of the single-channel sEMG. However, there are few methods to comprehensively consider the distribution area of the sEMG signal acquisition electrode sensor and the arrangement of the sEMG signal morphological features and electrode spatial features. In this paper, a novel multi-stream feature fusion network (MSFF-Net) model is proposed for sEMG gesture recognition. The model adopts a divide-and-conquer strategy to learn the relationship between different muscle regions and specific gestures. Firstly, a multi-stream convolutional neural network (Multi-stream CNN) and a convolutional block attention module integrated with a resblock (ResCBAM) are used to extract multi-dimensional spatial features from signal morphology, electrode space, and feature map space. Then the learned multi-view depth features are fused by a view aggregation network consisting of an early fusion network and a late fusion network. The results of all subjects and gesture movement validation experiments in the sEMG signal acquired from 12 sensors provided by NinaPro’s DB2 and DB4 sub-databases show that the proposed model in this paper has better performance in terms of gesture recognition accuracy compared with the existing models.

A Review of EMG-, FMG-, and EIT-Based Biosensors and Relevant Human–Machine Interactivities and Biomedical Applications

Wearables developed for human body signal detection receive increasing attention in the current decade. Compared to implantable sensors, wearables are more focused on body motion detection, which can support human–machine interaction (HMI) and biomedical applications. In wearables, electromyography (EMG)-, force myography (FMG)-, and electrical impedance tomography (EIT)-based body information monitoring technologies are broadly presented. In the literature, all of them have been adopted for many similar application scenarios, which easily confuses researchers when they start to explore the area. Hence, in this article, we review the three technologies in detail, from basics including working principles, device architectures, interpretation algorithms, application examples, merits and drawbacks, to state-of-the-art works, challenges remaining to be solved and the outlook of the field. We believe the content in this paper could help readers create a whole image of designing and applying the three technologies in relevant scenarios.

A hybrid approach to product prototype usability testing based on surface EMG images and convolutional neural network classification

OBJECTIVE

It is common for employees to complain of muscle fatigue when resting in a reclined position in an office chair. To investigate the physical factors that influence resting comfort in a supine position, a newly designed product was used as the basis for creating a prototype experiment and testing its efficacy in use. Subjective questionnaires were combined with surface EMG measurements and deep learning algorithms were used to identify body part comfort to create a hybrid approach to product usability testing.

METHODS

To facilitate the use of sEMG-based CNNs in human factors engineering, a subjective user assessment was first conducted using a combination of body mapping and an impact comfort scale to the screen which body parts have a significant impact effect on comfort when using the prototype. A control group (no used) and an experimental group (used) were then created and the body parts with the most significant effects were measured using sEMG methods. After pre-processing the sEMG signal, sMEG feature maps were obtained by mean power frequency (MPF) and linear regression was used to analyze the comforting effect. Finally, a CNN model is constructed and the sMEG feature maps are trained and tested.

RESULTS

The results of the experiment showed that the user's subjective assessment showed that 10 body parts had a significant effect on comfort, with the right and left sides of the neck having the highest effect on comfort (4.78). sEMG measurements were then performed on the sternocleidomastoid (SCM) of the left and right neck. Linear analysis of the measurements showed that the control group had higher SCM fatigue than the experimental group, which could also indicate that the experimental group had better comfort. The final CNN model was able to accurately classify the four datasets with an accuracy of 0.99.

CONCLUSION

The results of the study show that the method is effective for the study of physical comfort in the supine sitting position and that it can be used to validate the comfort of similar products and to design iterations of the prototype.

Multi-Session Surface Electromyogram Signal Database for Personal Identification

Surface electromyogram (sEMG) refers to a biosignal acquired from the skin surface during the contraction of skeletal muscles, and a different signal waveform is generated, depending on the motion performed. Therefore, in contrast to generic personal identification, which uses only a piece of registered information, the sEMG changes the registered information in a personal identification method. The sEMG database (DB) for conventional personal identification has shortcomings, such as a few subjects and the inability to verify sEMG signal variability. In order to solve the problems of DBs, this paper describes a method for constructing a multi-session sEMG DB for many subjects. Data were obtained in two channels when each of the 200 subjects performed 12 motions. There were three sessions, and each motion was repeated 10 times in time intervals of a day or longer between each session. Furthermore, to verify the effectiveness of the constructed sEMG DB, we conducted a personal identification experiment. According to the experimental results, the accuracy for five subjects was 74.19%, demonstrating the applicability of the constructed multi-session sEMG DB.