Hand Motion Recognition from Single Channel Surface EMG Using Wavelet & Artificial Neural Network

Simple recognition of hand gestures using single-channel EMG signals

Electromyography (EMG) signals are used for many different purposes, such as recording and measuring the electrical activity generated by varying the body's skeletal muscles. Biosignals are different types of biomedical signals, like EMG signals, which can be used for the neural linkage with computers and are obtained from a particular part of the body such as tissue, muscle, organ, or cell system like the nervous system. Surface electromyography (SEMG) is a non-invasive method that can be used as an effective system for controlling upper arm prostheses. This study focused on classifying the five types of distinct finger movements investigated in four unique channels.We have used a classification technique, the k-nearest neighbors (KNN), to categorize the collected samples. Two time-domain features, (a) maximum (Max) and (b) minimum (Min), were used with one of these three features separately: mean absolute value (MAV), root mean square (RMS), and simple square integral (SSI) to classify gestures. We chose classification accuracy as a criterion for evaluating the effectiveness of every classification. We figured out that the first grouping, that is, (MAV, Max, Min), was the best choice for classification. The accuracy percentage in the four channels for the first group was 91.0%, 89.9%, 89.8%, and 96.0%, respectively.

Recent trends and challenges of surface electromyography in prosthetic applications

Surface electromyography (sEMG) meets extensive applications in the field of prosthesis in the current period. The effectiveness of sEMG in prosthesis applications has been verified by numerous revolutionary developments and extensive research attempts. A large volume of research and literature works have explored and validated the vast use of these signals in prostheses as an assistive technology. The objective of this paper is to conduct a systematic review and offer a detailed overview of the work record in the prosthesis and myoelectric interfaces framework. This review utilized a systematic search strategy to identify published articles discussing the state-of-the-art applications of sEMG in prostheses (including upper limb prosthesis and lower limb prostheses). Relevant studies were identified using electronic databases such as PubMed, IEEE Explore, SCOPUS, ScienceDirect, Google Scholar and Web of Science. Out of 3791 studies retrieved from the databases, 188 articles were found to be potentially relevant (after screening of abstracts and application of inclusion-exclusion criteria) and included in this review. This review presents an investigative analysis of sEMG-based prosthetic applications to assist the readers in making further advancements in this field. It also discusses the fundamental advantages and disadvantages of using sEMG in prosthetic applications. It also includes some important guidelines to follow in order to improve the performance of sEMG-based prosthesis. The findings of this study support the widespread use of sEMG in prosthetics. It is concluded that sEMG-based prosthesis technology, still in its sprouting phase, requires significant explorations for further development. Supplementary investigations are necessary in the direction of making a seamless mechanism of biomechatronics for sEMG-based prosthesis by cohesive efforts of robotic researchers and biomedical engineers.

Design of an Effective Prosthetic Hand System for Adaptive Grasping with the Control of Myoelectric Pattern Recognition Approach

In this paper, we develop a prosthetic bionic hand system to realize adaptive gripping with two closed-loop control loops by using a linear discriminant analysis algorithm (LDA). The prosthetic hand contains five fingers and each finger is driven by a linear servo motor. When grasping objects, four fingers except the thumb would adjust automatically and bend with an appropriate gesture, while the thumb is stretched and bent by the linear servo motor. Since the change of the surface electromechanical signal (sEMG) occurs before human movement, the recognition of sEMG signal with LDA algorithm can help to obtain people’s action intention in advance, and then timely send control instructions to assist people to grasp. For activity intention recognition, we extract three features, Variance (VAR), Root Mean Square (RMS) and Minimum (MIN) for recognition. As the results show, it can achieve an average accuracy of 96.59%. This helps our system perform well for disabilities to grasp objects of different sizes and shapes adaptively. Finally, a test of the people with disabilities grasping 15 objects of different sizes and shapes was carried out and achieved good experimental results.

A Study on the Classification Effect of sEMG Signals in Different Vibration Environments Based on the LDA Algorithm

Myoelectric prosthesis has become an important aid to disabled people. Although it can help people to recover to a nearly normal life, whether they can adapt to severe working conditions is a subject that is yet to be studied. Generally speaking, the working environment is dominated by vibration. This paper takes the gripping action as its research object, and focuses on the identification of grasping intentions under different vibration frequencies in different working conditions. In this way, the possibility of the disabled people who wear myoelectric prosthesis to work in various vibration environment is studied. In this paper, an experimental test platform capable of simulating 0–50 Hz vibration was established, and the Surface Electromyography (sEMG) signals of the human arm in the open and grasping states were obtained through the MP160 physiological record analysis system. Considering the reliability of human intention recognition and the rapidity of algorithm processing, six different time-domain features and the Linear Discriminant Analysis (LDA) classifier were selected as the sEMG signal feature extraction and recognition algorithms in this paper. When two kinds of features, Zero Crossing (ZC) and Root Mean Square (RMS), were used as input, the accuracy of LDA algorithm can reach 96.9%. When three features, RMS, Minimum Value (MIN), and Variance (VAR), were used as inputs, the accuracy of the LDA algorithm can reach 98.0%. When the six features were used as inputs, the accuracy of the LDA algorithm reached 98.4%. In the analysis of different vibration frequencies, it was found that when the vibration frequency reached 20 Hz, the average accuracy of the LDA algorithm in recognizing actions was low, while at 0 Hz, 40 Hz and 50 Hz, the average accuracy was relatively high. This is of great significance in guiding disabled people to work in a vibration environment in the future.

Sustainable Human–Robot Collaboration Based on Human Intention Classification

Sustainable manufacturing plays a role in ensuring products’ economic characteristics and reducing energy and resource consumption by improving the well-being of human workers and communities and maintaining safety. Using robots is one way for manufacturers to increase their sustainable manufacturing practices. Nevertheless, there are limitations to directly replacing humans with robots due to work characteristics and practical conditions. Collaboration between robots and humans should accommodate human capabilities while reducing loads and ineffective human motions to prevent human fatigue and maximize overall performance. Moreover, there is a need to establish early and fast communication between humans and machines in human–robot collaboration to know the status of the human in the activity and make immediate adjustments for maximum performance. This study used a deep learning algorithm to classify muscular signals of human motions with accuracy of 88%. It indicates that the signal could be used as information for the robot to determine the human motion’s intention during the initial stage of the entire motion. This approach can increase not only the communication and efficiency of human–robot collaboration but also reduce human fatigue by the early detection of human motion patterns. To enhance human well-being, it is suggested that a human–robot collaboration assembly line adopt similar technologies for a sustainable human–robot collaboration workplace.

The effect of attentional focusing strategies on EMG-based classification

Earlier studies showed that external focusing enhances motor performance and reduces muscular activity compare to internal one. However, low activity is not always desired especially in case of Human-Machine Interface applications. This study is based on investigating the effects of attentional focusing preferences on EMG based control systems. For the EMG measurements via biceps brachii muscles, 35 subjects were asked to perform weight-lifting under control, external and internal focus conditions. The difference between external and internal focusing was found to be significant and internal focus enabled higher EMG activity. Besides, six statistical features, namely, RMS, maximum, minimum, mean, standard deviation, and variance were extracted from both time and frequency domains to be used as inputs for Artificial Neural Network classifiers. The results found to be 87.54% for ANN1 and 82.69% for ANN2, respectively. These findings showed that one's focus of attention would be predicted during the performance and unlike the literature, internal focusing could be also useful when it is used as an input for HMI studies. Therefore, attentional focusing might be an important strategy not only for performance improvement to human movement but also for advancing the study of EMG-based control mechanisms.

Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future

Amputation of the upper limb brings heavy burden to amputees, reduces their quality of life, and limits their performance in activities of daily life. The realization of natural control for prosthetic hands is crucial to improving the quality of life of amputees. Surface electromyography (sEMG) signal is one of the most widely used biological signals for the prediction of upper limb motor intention, which is an essential element of the control systems of prosthetic hands. The conversion of sEMG signals into effective control signals often requires a lot of computational power and complex process. Existing commercial prosthetic hands can only provide natural control for very few active degrees of freedom. Deep learning (DL) has performed surprisingly well in the development of intelligent systems in recent years. The significant improvement of hardware equipment and the continuous emergence of large data sets of sEMG have also boosted the DL research in sEMG signal processing. DL can effectively improve the accuracy of sEMG pattern recognition and reduce the influence of interference factors. This paper analyzes the applicability and efficiency of DL in sEMG-based gesture recognition and reviews the key techniques of DL-based sEMG pattern recognition for the prosthetic hand, including signal acquisition, signal preprocessing, feature extraction, classification of patterns, post-processing, and performance evaluation. Finally, the current challenges and future prospects in clinical application of these techniques are outlined and discussed.

Research on athlete’s action recognition based on acceleration sensor and deep learning

Due to the difficulty of athletes’ motion recognition, there are few studies on athletes’ specific motion recognition. Based on this, this study uses the acceleration sensor as the carrier, and uses human-computer interaction to transform the action of the athlete into a machine-identifiable action unit. At the same time, this paper combines the actual situation of human body motion to construct a human body motion model and builds a corresponding computer hardware and software platform. Moreover, this paper designs a classification recognition algorithm that can recognize the movement of athletes and builds SVM model based on machine learning for classification and recognition. In addition, in this study, the effectiveness of the algorithm was studied through experimental comparison. Finally, the simulation analysis was carried out to obtain the corresponding research results, and the results were analyzed by combing statistics. The research shows that the proposed algorithm can classify and recognize the collected motion data, and it has certain effects on the theoretical analysis of athletes’ motion recognition. Moreover, the algorithm can perform motion quality analysis and provide theoretical reference for subsequent related research.

Exploration of Human Activity Recognition Using a Single Sensor for Stroke Survivors and Able-Bodied People

Commonly used sensors like accelerometers, gyroscopes, surface electromyography sensors, etc., which provide a convenient and practical solution for human activity recognition (HAR), have gained extensive attention. However, which kind of sensor can provide adequate information in achieving a satisfactory performance, or whether the position of a single sensor would play a significant effect on the performance in HAR are sparsely studied. In this paper, a comparative study to fully investigate the performance of the aforementioned sensors for classifying four activities (walking, tooth brushing, face washing, drinking) is explored. Sensors are spatially distributed over the human body, and subjects are categorized into three groups (able-bodied people, stroke survivors, and the union of both). Performances of using accelerometer, gyroscope, sEMG, and their combination in each group are evaluated by adopting the Support Vector Machine classifier with the Leave-One-Subject-Out Cross-Validation technique, and the optimal sensor position for each kind of sensor is presented based on the accuracy. Experimental results show that using the accelerometer could obtain the best performance in each group. The highest accuracy of HAR involving stroke survivors was 95.84 ± 1.75% (mean ± standard error), achieved by the accelerometer attached to the extensor carpi ulnaris. Furthermore, taking the practical application of HAR into consideration, a novel approach to distinguish various activities of stroke survivors based on a pre-trained HAR model built on healthy subjects is proposed, the highest accuracy of which is 77.89 ± 4.81% (mean ± standard error) with the accelerometer attached to the extensor carpi ulnaris.

Development of Sign Language Motion Recognition System for Hearing-Impaired People Using Electromyography Signal

Sign languages are developed around the world for hearing-impaired people to communicate with others who understand them. Different grammar and alphabets limit the usage of sign languages between different sign language users. Furthermore, training is required for hearing-intact people to communicate with them. Therefore, in this paper, a real-time motion recognition system based on an electromyography signal is proposed for recognizing actual American Sign Language (ASL) hand motions for helping hearing-impaired people communicate with others and training normal people to understand the sign languages. A bilinear model is applied to deal with the on electromyography (EMG) data for decreasing the individual difference among different people. A long short-term memory neural network is used in this paper as the classifier. Twenty sign language motions in the ASL library are selected for recognition in order to increase the practicability of the system. The results indicate that this system can recognize these twenty motions with high accuracy among twenty participants. Therefore, this system has the potential to be widely applied to help hearing-impaired people for daily communication and normal people to understand the sign languages.

Locomo-Net: A Low -Complex Deep Learning Framework for sEMG-Based Hand Movement Recognition for Prosthetic Control

Background: The enhancement in the performance of the myoelectric pattern recognition techniques based on deep learning algorithm possess computationally expensive and exhibit extensive memory behavior. Therefore, in this paper we report a deep learning framework named 'Low-Complex Movement recognition-Net' (LoCoMo-Net) built with convolution neural network (CNN) for recognition of wrist and finger flexion movements; grasping and functional movements; and force pattern from single channel surface electromyography (sEMG) recording. The network consists of a two-stage pipeline: 1) input data compression; 2) data-driven weight sharing. Methods: The proposed framework was validated on two different datasets- our own dataset (DS1) and publicly available NinaPro dataset (DS2) for 16 movements and 50 movements respectively. Further, we have prototyped the proposed LoCoMo-Net on Virtex-7 Xilinx field-programmable gate array (FPGA) platform and validated for 15 movements from DS1 to demonstrate its feasibility for real-time execution. Results: The effectiveness of the proposed LoCoMo-Net was verified by a comparative analysis against the benchmarked models using the same datasets wherein our proposed model outperformed Twin- Support Vector Machine (SVM) and existing CNN based model by an average classification accuracy of 8.5 % and 16.0 % respectively. In addition, hardware complexity analysis is done to reveal the advantages of the two-stage pipeline where approximately 27 %, 49 %, 50 %, 23 %, and 43 % savings achieved in lookup tables (LUT's), registers, memory, power consumption and computational time respectively. Conclusion: The clinical significance of such sEMG based accurate and low-complex movement recognition system can be favorable for the potential improvement in quality of life of an amputated persons.

Parkinson's Disease EMG Data Augmentation and Simulation with DCGANs and Style Transfer

This paper proposes two new data augmentation approaches based on Deep Convolutional Generative Adversarial Networks (DCGANs) and Style Transfer for augmenting Parkinson’s Disease (PD) electromyography (EMG) signals. The experimental results indicate that the proposed models can adapt to different frequencies and amplitudes of tremor, simulating each patient’s tremor patterns and extending them to different sets of movement protocols. Therefore, one could use these models for extending the existing patient dataset and generating tremor simulations for validating treatment approaches on different movement scenarios.

Real-Time Hand Gesture Recognition Using Surface Electromyography and Machine Learning: A Systematic Literature Review

Today, daily life is composed of many computing systems, therefore interacting with them in a natural way makes the communication process more comfortable. Human-Computer Interaction (HCI) has been developed to overcome the communication barriers between humans and computers. One form of HCI is Hand Gesture Recognition (HGR), which predicts the class and the instant of execution of a given movement of the hand. One possible input for these models is surface electromyography (EMG), which records the electrical activity of skeletal muscles. EMG signals contain information about the intention of movement generated by the human brain. This systematic literature review analyses the state-of-the-art of real-time hand gesture recognition models using EMG data and machine learning. We selected and assessed 65 primary studies following the Kitchenham methodology. Based on a common structure of machine learning-based systems, we analyzed the structure of the proposed models and standardized concepts in regard to the types of models, data acquisition, segmentation, preprocessing, feature extraction, classification, postprocessing, real-time processing, types of gestures, and evaluation metrics. Finally, we also identified trends and gaps that could open new directions of work for future research in the area of gesture recognition using EMG.

Pattern Recognition of Single-Channel sEMG Signal Using PCA and ANN Method to Classify Nine Hand Movements

A number of researchers prefer using multi-channel surface electromyography (sEMG) pattern recognition in hand gesture recognition to increase classification accuracy. Using this method can lead to computational complexity. Hand gesture classification by employing single channel sEMG signal acquisition is quite challenging, especially for low-rate sampling frequency. In this paper, a study on the pattern recognition method for sEMG signals of nine finger movements is presented. Common surface single channel electromyography (sEMG) was used to measure five different subjects with no neurological or muscular disorder by having nine hand movements. This research had several sequential processes (i.e., feature extraction, feature reduction, and feature classification). Sixteen time-domain features were employed for feature extraction. The features were then reduced using principal component analysis (PCA) into two and three-dimensional feature space. The artificial neural network (ANN) classifier was tested on two different feature sets: (1) using all principal components obtained from PCA (PC1–PC3) and (2) using selected principal components (PC2 and PC3). The third best principal components were then used for classification using ANN. The average accuracy using all subject signals was 86.7% to discriminate the nine finger movements.

sEMG Based Human Motion Intention Recognition

Human motion intention recognition is a key to achieve perfect human-machine coordination and wearing comfort of wearable robots. Surface electromyography (sEMG), as a bioelectrical signal, generates prior to the corresponding motion and reflects the human motion intention directly. Thus, a better human-machine interaction can be achieved by using sEMG based motion intention recognition. In this paper, we review and discuss the state of the art of the sEMG based motion intention recognition that is mainly used in detail. According to the method adopted, motion intention recognition is divided into two groups: sEMG-driven musculoskeletal (MS) model based motion intention recognition and machine learning (ML) model based motion intention recognition. The specific models and recognition effects of each study are analyzed and systematically compared. Finally, a discussion of the existing problems in the current studies, major advances, and future challenges is presented.

Development of a Parent Wireless Assistive Interface for Myoelectric Prosthetic Hands for Children

In this study, a one-degree-of-freedom myoelectric prosthesis system was proposed using a Parent Wireless Assistive Interface (PWAI) that allowed an external assistant (e. g., the parent of the user) to immediately adjust the parameters of the prosthetic hand controller. In the PWAI, the myoelectric potential of use of the upper limb was plotted on an external terminal in real time. Simultaneously, the assistant adjusted the parameters of the prosthetic hand control device and manually manipulated the prosthetic hand. With these functions, children that have difficulty verbally communicating could obtain properly adjusted prosthetic hands. In addition, non-experts could easily adjust and manually manipulate the prosthesis; therefore, training for the prosthetic hands could be performed at home. Two types of hand motion discrimination methods were constructed in this study of the myoelectric control system: (1) a threshold control based on the myoelectric potential amplitude information and (2) a pattern recognition of the frequency domain features. In an evaluation test of the prosthesis threshold control system, child subjects achieved discrimination rates as high as 89%, compared with 96% achieved by adult subjects. Furthermore, the high discrimination rate was maintained by sequentially updating the threshold value. In addition, a discrimination rate of 82% on average was obtained by recognizing three motions using the pattern recognition method.

sEMG Signal Acquisition Strategy towards Hand FES Control

Due to damage of the nervous system, patients experience impediments in their daily life: severe fatigue, tremor or impaired hand dexterity, hemiparesis, or hemiplegia. Surface electromyography (sEMG) signal analysis is used to identify motion; however, standardization of electrode placement and classification of sEMG patterns are major challenges. This paper describes a technique used to acquire sEMG signals for five hand motion patterns from six able-bodied subjects using an array of recording and stimulation electrodes placed on the forearm and its effects over functional electrical stimulation (FES) and volitional sEMG combinations, in order to eventually control a sEMG-driven FES neuroprosthesis for upper limb rehabilitation. A two-part protocol was performed. First, personalized templates to place eight sEMG bipolar channels were designed; with these data, a universal template, called forearm electrode set (FELT), was built. Second, volitional and evoked movements were recorded during FES application. 95% classification accuracy was achieved using two sessions per movement. With the FELT, it was possible to perform FES and sEMG recordings simultaneously. Also, it was possible to extract the volitional and evoked sEMG from the raw signal, which is highly important for closed-loop FES control.

A NOVEL APPROACH FOR THE PATTERN RECOGNITION OF HAND MOVEMENTS BASED ON EMG AND VPMCD

Essentially, the classification of human hand movements is a process of pattern recognition. However, existing computationally intense and complex pattern recognition methods have failed thus far to be optimally successful in constructing associations between extracted signal features. Due to such limitations, a new pattern recognition method using variable predictive model-based class discrimination (VPMCD) is proposed. This approach considers that the feature values can exhibit inter-relations in nature and such associations will show different forms in different classes. In practice, this is always true for different hand movements. The signals produced by electromyography (EMG) and received from human arm muscles, are characteristically non-linear and non-stationary. A novel hand gesture recognition technique, based on wavelet feature extraction and VPMCD is proposed. First, the maximum values of the wavelet coefficient are extracted as the feature vectors from the surface EMG signals after de-noising. Then, the feature values are regarded as the inputs of the VPMCD classifier. Finally, four movement patterns (hand clenching, hand extension, wrist flexion, and wrist extension) are identified by the outputs of the VPMCD classifier. Our analysis results show that the proposed pattern recognition approach can distinguish different gestures successfully and effectively. Simultaneously, compared with the artificial neural network and the support vector machine classifier, more accurate recognition can be achieved using our proposed technique.

Upper Limb Motion Recognition Based on LLE-ELM Method of sEMG

The purpose of this paper is to develop an effective method to identify upper limb motions based on EMG signal for community rehabilitation. The method will be applicable to the control system in the rehabilitation equipment and provide objective data for quantitative assessment. The recognition goal sets of upper limb motion are constructed by decomposing assessment activities of activity of daily living scale (ADL). The recognition feature vector space is established by Variance (VAR), Mean Absolute Value (MAV), the fourth-order Autoregressive (the 4thAR), Zero Crossings (ZC’s), integral EMG (IEMG), and Root Mean Square (RMS), and various feature sets are extracted to get the best classification. Locally linear embedding (LLE) algorithm is used to reduce the computational complexity, and upper limb motions about shoulder, elbow and wrist are quickly classified through extreme leaving machine (ELM), which obtained the average accuracy of 98.14%, 98.61% and 94.77%, respectively. Furthermore, when ELM is compared with Back-propagation (BP) and Support vector machine (SVM), it has performed relatively better than BP and SVM. The results show that the validity of the mixed model for recognition is verified. In addition, the method can also provide a basis for recognition and assessment of the angle of upper limb joint in the next study.