Deep learning and machine learning techniques to improve hand movement classification in myoelectric control system

EMG Dataset for Gesture Recognition with Arm Translation

Myoelectric control has emerged as a promising approach for a wide range of applications, including controlling limb prosthetics, teleoperating robots and enabling immersive interactions in the Metaverse. However, the accuracy and robustness of myoelectric control systems are often affected by various factors, including muscle fatigue, perspiration, drifts in electrode positions and changes in arm position. The latter has received less attention despite its significant impact on signal quality and decoding accuracy. To address this gap, we present a novel dataset of surface electromyographic (EMG) signals captured from multiple arm positions. This dataset, comprising EMG and hand kinematics data from 8 participants performing 6 different hand gestures, provides a comprehensive resource for investigating position-invariant myoelectric control decoding algorithms. We envision this dataset to serve as a valuable resource for both training and benchmark arm position-invariant myoelectric control algorithms. Additionally, to expand the publicly available data capturing the variability of EMG signals across diverse arm positions, we propose a novel data acquisition protocol that can be utilized for future data collection.

Continuous reach-to-grasp motion recognition based on an extreme learning machine algorithm using sEMG signals

Recognizing user intention in reach-to-grasp motions is a critical challenge in rehabilitation engineering. To address this, a Machine Learning (ML) algorithm based on the Extreme Learning Machine (ELM) was developed for identifying motor actions using surface Electromyography (sEMG) during continuous reach-to-grasp movements, involving multiple Degrees of Freedom (DoFs). This study explores feature extraction methods based on time domain and autoregressive models to evaluate ELM performance under different conditions. The experimental setup encompassed variations in neuron size, time windows, validation with each muscle, increase in the number of features, comparison with five conventional ML-based classifiers, inter-subjects variability, and temporal dynamic response. To evaluate the efficacy of the proposed ELM-based method, an openly available sEMG dataset containing data from 12 participants was used. Results highlight the method's performance, achieving Accuracy above 85%, F-score above 90%, Recall above 85%, Area Under the Curve of approximately 84% and compilation times (computational cost) of less than 1 ms. These metrics significantly outperform standard methods (p < 0.05). Additionally, specific trends were found in increasing and decreasing performance in identifying specific tasks, as well as variations in the continuous transitions in the temporal dynamics response. Thus, the ELM-based method effectively identifies continuous reach-to-grasp motions through myoelectric data. These findings hold promise for practical applications. The method's success prompts future research into implementing it for more reliable and effective Human-Machine Interface (HMI) control. This can revolutionize real-time upper limb rehabilitation, enabling natural and complex Activities of Daily Living (ADLs) like object manipulation. The robust results encourages further research and innovative solutions to improve people's quality of life through more effective interventions.

A novel procedure to automate the removal of PLI and motion artifacts using mode decomposition to enhance pattern recognition of sEMG signals for myoelectric control of prosthesis

Hand Movement Recognition (HMR) with sEMG is crucial for artificial hand prostheses. HMR performance mostly depends on the feature information that is fed to the classifiers. However, sEMG often captures noise like power line interference (PLI) and motion artifacts. This may extract redundant and insignificant feature information, which can degrade HMR performance and increase computational complexity. This study aims to address these issues by proposing a novel procedure for automatically removing PLI and motion artifacts from experimental sEMG signals. This will make it possible to extract better features from the signal and improve the categorization of various hand movements. Empirical mode decomposition and energy entropy thresholding are utilized to select relevant mode components for artifact removal. Time domain features are then used to train classifiers (kNN, LDA, SVM) for hand movement categorization, achieving average accuracies of 92.36%, 93.63%, and 98.12%, respectively, across subjects. Additionally, muscle contraction efforts are classified into low, medium, and high categories using this technique. Validation is performed on data from ten subjects performing eight hand movement classes and three muscle contraction efforts with three surface electrode channels. Results indicate that the proposed preprocessing improves average accuracy by 9.55% with the SVM classifier, significantly reducing computational time.

A Comparison of Myoelectric Control Modes for an Assistive Robotic Virtual Platform

In this paper, we propose a daily living situation where objects in a kitchen can be grasped and stored in specific containers using a virtual robot arm operated by different myoelectric control modes. The main goal of this study is to prove the feasibility of providing virtual environments controlled through surface electromyography that can be used for the future training of people using prosthetics or with upper limb motor impairments. We propose that simple control algorithms can be a more natural and robust way to interact with prostheses and assistive robotics in general than complex multipurpose machine learning approaches. Additionally, we discuss the advantages and disadvantages of adding intelligence to the setup to automatically assist grasping activities. The results show very good performance across all participants who share similar opinions regarding the execution of each of the proposed control modes.

A Smartphone-Based sEMG Signal Analysis System for Human Action Recognition

In lower-limb rehabilitation, human action recognition (HAR) technology can be introduced to analyze the surface electromyography (sEMG) signal generated by movements, which can provide an objective and accurate evaluation of the patient's action. To balance the long cycle required for rehabilitation and the inconvenient factors brought by wearing sEMG devices, a portable sEMG signal acquisition device was developed that can be used under daily scenarios. Additionally, a mobile application was developed to meet the demand for real-time monitoring and analysis of sEMG signals. This application can monitor data in real time and has functions such as plotting, filtering, storage, and action capture and recognition. To build the dataset required for the recognition model, six lower-limb motions were developed for rehabilitation (kick, toe off, heel off, toe off and heel up, step back and kick, and full gait). The sEMG segment and action label were combined for training a convolutional neural network (CNN) to achieve high-precision recognition performance for human lower-limb actions (with a maximum accuracy of 97.96% and recognition accuracy for all actions reaching over 97%). The results show that the smartphone-based sEMG analysis system proposed in this paper can provide reliable information for the clinical evaluation of lower-limb rehabilitation.

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Robust classification of natural hand grasp type based on electromyography (EMG) still has some shortcomings in the practical prosthetic hand control, owing to the influence of dynamic arm position changing during hand actions. This study provided a framework for robust hand grasp type classification during dynamic arm position changes, improving both the “hardware” and “algorithm” components. In the hardware aspect, co-located synchronous EMG and force myography (FMG) signals are adopted as the multi-modal strategy. In the algorithm aspect, a sequential decision algorithm is proposed by combining the RNN-based deep learning model with a knowledge-based post-processing model. Experimental results showed that the classification accuracy of multi-modal EMG-FMG signals was increased by more than 10% compared with the EMG-only signal. Moreover, the classification accuracy of the proposed sequential decision algorithm improved the accuracy by more than 4% compared with other baseline models when using both EMG and FMG signals.

A Mass-Producible Washable Smart Garment with Embedded Textile EMG Electrodes for Control of Myoelectric Prostheses: A Pilot Study

Electromyography (EMG) is the resulting electrical signal from muscle activity, commonly used as a proxy for users' intent in voluntary control of prosthetic devices. EMG signals are recorded with gold standard Ag/AgCl gel electrodes, though there are limitations in continuous use applications, with potential skin irritations and discomfort. Alternative dry solid metallic electrodes also face long-term usability and comfort challenges due to their inflexible and non-breathable structures. This is critical when the anatomy of the targeted body region is variable (e.g., residual limbs of individuals with amputation), and conformal contact is essential. In this study, textile electrodes were developed, and their performance in recording EMG signals was compared to gel electrodes. Additionally, to assess the reusability and robustness of the textile electrodes, the effect of 30 consumer washes was investigated. Comparisons were made between the signal-to-noise ratio (SNR), with no statistically significant difference, and with the power spectral density (PSD), showing a high correlation. Subsequently, a fully textile sleeve was fabricated covering the forearm, with 14 textile electrodes. For three individuals, an artificial neural network model was trained, capturing the EMG of 7 distinct finger movements. The personalized models were then used to successfully control a myoelectric prosthetic hand.