User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control

Liquid Metal Composites-Enabled Real-Time Hand Gesture Recognizer with Superior Recognition Speed and Accuracy

Prosthetic hands play a vital role in restoring forearm functionality for patients who have suffered hand loss or deformity. The hand gesture intention recognition system serves as a critical component within the prosthetic hand system. However, accurately and swiftly identifying hand gesture intentions remains a challenge in existing approaches. Here, a real-time motion intention recognition system utilizing liquid metal composite sensor bracelets is proposed. The sensor bracelet detects pressure signals generated by forearm muscle movements to recognize hand gesture intent. Leveraging the remarkable pressure sensitivity of liquid metal composites and the efficient classifier based on the optimized recognition algorithm, this system achieves an average offline and real-time recognition accuracy of 98.2% and 92.04%, respectively, with an average recognition speed of 0.364 s. Thus, this wearable system shows advantages in superior recognition speed and accuracy. Furthermore, this system finds applications in master-slave control of prosthetic hands in unmanned scenarios, such as electrically powered operations, space exploration, and telemedicine. The proposed system promises significant advances in next-generation intent-controlled prosthetic hands and robots.

TraHGR: Transformer for Hand Gesture Recognition via Electromyography

Deep learning-based Hand Gesture Recognition (HGR) via surface Electromyogram (sEMG) signals have recently shown considerable potential for development of advanced myoelectric-controlled prosthesis. Although deep learning techniques can improve HGR accuracy compared to their classical counterparts, classifying hand movements based on sparse multichannel sEMG signals is still a challenging task. Furthermore, existing deep learning approaches, typically, include only one model as such can hardly extract representative features. In this paper, we aim to address this challenge by capitalizing on the recent advances in hybrid models and transformers. In other words, we propose a hybrid framework based on the transformer architecture, which is a relatively new and revolutionizing deep learning model. The proposed hybrid architecture, referred to as the Transformer for Hand Gesture Recognition (TraHGR), consists of two parallel paths followed by a linear layer that acts as a fusion center to integrate the advantage of each module. We evaluated the proposed architecture TraHGR based on the commonly used second Ninapro dataset, referred to as the DB2. The sEMG signals in the DB2 dataset are measured in real-life conditions from 40 healthy users, each performing 49 gestures. We have conducted an extensive set of experiments to test and validate the proposed TraHGR architecture, and compare its achievable accuracy with several recently proposed HGR classification algorithms over the same dataset. We have also compared the results of the proposed TraHGR architecture with each individual path and demonstrated the distinguishing power of the proposed hybrid architecture. The recognition accuracies of the proposed TraHGR architecture for the window of size 200ms and step size of 100ms are 86.00%, 88.72%, 81.27%, and 93.74%, which are 2.30%, 4.93%, 8.65%, and 4.20% higher than the state-of-the-art performance for DB2 (49 gestures), DB2-B (17 gestures), DB2-C (23 gestures), and DB2-D (9 gestures), respectively.

Soft Robotics Enables Neuroprosthetic Hand Design

Development and implementation of neuroprosthetic hands is a multidisciplinary field at the interface between humans and artificial robotic systems, which aims at replacing the sensorimotor function of the upper-limb amputees as their own. Although prosthetic hand devices with myoelectric control can be dated back to more than 70 years ago, their applications with anthropomorphic robotic mechanisms and sensory feedback functions are still at a relatively preliminary and laboratory stage. Nevertheless, a recent series of proof-of-concept studies suggest that soft robotics technology may be promising and useful in alleviating the design complexity of the dexterous mechanism and integration difficulty of multifunctional artificial skins, in particular, in the context of personalized applications. Here, we review the evolution of neuroprosthetic hands with the emerging and cutting-edge soft robotics, covering the soft and anthropomorphic prosthetic hand design and relating bidirectional neural interactions with myoelectric control and sensory feedback. We further discuss future opportunities on revolutionized mechanisms, high-performance soft sensors, and compliant neural-interaction interfaces for the next generation of neuroprosthetic hands.

Bio-robotics research for non-invasive myoelectric neural interfaces for upper-limb prosthetic control: a 10-year perspective review

A decade ago, a group of researchers from academia and industry identified a dichotomy between the industrial and academic state-of-the-art in upper-limb prosthesis control, a widely used bio-robotics application. They proposed that four key technical challenges, if addressed, could bridge this gap and translate academic research into clinically and commercially viable products. These challenges are unintuitive control schemes, lack of sensory feedback, poor robustness and single sensor modality. Here, we provide a perspective review on the research effort that occurred in the last decade, aiming at addressing these challenges. In addition, we discuss three research areas essential to the recent development in upper-limb prosthetic control research but were not envisioned in the review 10 years ago: deep learning methods, surface electromyogram decomposition and open-source databases. To conclude the review, we provide an outlook into the near future of the research and development in upper-limb prosthetic control and beyond.

The multi-grip and standard myoelectric hand prosthesis compared: does the multi-grip hand live up to its promise?

BACKGROUND

Multi-grip myoelectric hand prostheses (MHPs), with five movable and jointed fingers, have been developed to increase functionality. However, literature comparing MHPs with standard myoelectric hand prostheses (SHPs) is limited and inconclusive. To establish whether MHPs increase functionality, we compared MHPs with SHPs on all categories of the International Classification of Functioning, Disability, and Health-model (ICF-model).

METHODS

MHP users (N = 14, 64.3% male, mean age = 48.6 years) performed physical measurements (i.e., Refined Clothespin Relocation Test (RCRT), Tray-test, Box and Blocks Test, Southampton Hand Assessment Procedure) with their MHP and an SHP to compare the joint angle coordination and functionality related to the ICF-categories 'Body Function' and 'Activities' (within-group comparisons). SHP users (N = 19, 68.4% male, mean age = 58.1 years) and MHP users completed questionnaires/scales (i.e., Orthotics and Prosthetics Users' Survey-The Upper Extremity Functional Status Survey /OPUS-UEFS, Trinity Amputation and Prosthesis Experience Scales for upper extremity/TAPES-Upper, Research and Development-36/RAND-36, EQ-5D-5L, visual analogue scale/VAS, the Dutch version of the Quebec User Evaluation of Satisfaction with assistive technology/D-Quest, patient-reported outcome measure to assess the preferred usage features of upper limb prostheses/PUF-ULP) to compare user experiences and quality of life in the ICF-categories 'Activities', 'Participation', and 'Environmental Factors' (between-group comparisons).

RESULTS

'Body Function' and 'Activities': nearly all users of MHPs had similar joint angle coordination patterns with an MHP as when they used an SHP. The RCRT in the upward direction was performed slower in the MHP condition compared to the SHP condition. No other differences in functionality were found. 'Participation': MHP users had a lower EQ-5D-5L utility score; experienced more pain or limitations due to pain (i.e., measured with the RAND-36). 'Environmental Factors': MHPs scored better than SHPs on the VAS-item holding/shaking hands. The SHP scored better than the MHP on five VAS-items (i.e., noise, grip force, vulnerability, putting clothes on, physical effort to control) and the PUF-ULP.

CONCLUSION

MHPs did not show relevant differences in outcomes compared to SHPs on any of the ICF-categories. This underlines the importance of carefully considering whether the MHP is the most suitable option for an individual taking into account the additional costs of MHPs.

Recalibration of myoelectric control with active learning

Introduction

Improving the robustness of myoelectric control to work over many months without the need for recalibration could reduce prosthesis abandonment. Current approaches rely on post-hoc error detection to verify the certainty of a decoder's prediction using predefined threshold value. Since the decoder is fixed, the performance decline over time is inevitable. Other approaches such as supervised recalibration and unsupervised self-recalibration entail limitations in scaling up and computational resources. The objective of this paper is to study active learning as a scalable, human-in-the-loop framework, to improve the robustness of myoelectric control.

Method

Active learning and linear discriminate analysis methods were used to create an iterative learning process, to modify decision boundaries based on changes in the data. We simulated a real-time scenario. We exploited least confidence, smallest margin and entropy reduction sampling strategies in single and batch-mode sample selection. Optimal batch-mode sampling was considered using ranked batch-mode active learning.

Results

With only 3.2 min of data carefully selected by the active learner, the decoder outperforms random sampling by 4-5 and ~2% for able-bodied and people with limb difference, respectively. We observed active learning strategies to systematically and significantly enhance the decoders adaptation while optimizing the amount of training data on a class-specific basis. Smallest margin and least confidence uncertainty were shown to be the most supreme.

Discussion

We introduce for the first time active learning framework for long term adaptation in myoelectric control. This study simulates closed-loop environment in an offline manner and proposes a pipeline for future real-time deployment.

Surface EMG Statistical and Performance Analysis of Targeted-Muscle-Reinnervated (TMR) Transhumeral Prosthesis Users in Home and Laboratory Settings

A pattern-recognition (PR)-based myoelectric control system is the trend of future prostheses development. Compared with conventional prosthetic control systems, PR-based control systems provide high dexterity, with many studies achieving >95% accuracy in the last two decades. However, most research studies have been conducted in the laboratory. There is limited research investigating how EMG signals are acquired when users operate PR-based systems in their home and community environments. This study compares the statistical properties of surface electromyography (sEMG) signals used to calibrate prostheses and quantifies the quality of calibration sEMG data through separability indices, repeatability indices, and correlation coefficients in home and laboratory settings. The results demonstrate no significant differences in classification performance between home and laboratory environments in within-calibration classification error (home: 6.33 ± 2.13%, laboratory: 7.57 ± 3.44%). However, between-calibration classification errors (home: 40.61 ± 9.19%, laboratory: 44.98 ± 12.15%) were statistically different. Furthermore, the difference in all statistical properties of sEMG signals is significant (p < 0.05). Separability indices reveal that motion classes are more diverse in the home setting. In summary, differences in sEMG signals generated between home and laboratory only affect between-calibration performance.

Use of regenerative peripheral nerve interfaces and intramuscular electrodes to improve prosthetic grasp selection: a case study

Objective.Advanced myoelectric hands enable users to select from multiple functional grasps. Current methods for controlling these hands are unintuitive and require frequent recalibration. This case study assessed the performance of tasks involving grasp selection, object interaction, and dynamic postural changes using intramuscular electrodes with regenerative peripheral nerve interfaces (RPNIs) and residual muscles.Approach.One female with unilateral transradial amputation participated in a series of experiments to compare the performance of grasp selection controllers with RPNIs and intramuscular control signals with controllers using surface electrodes. These experiments included a virtual grasp-matching task with and without a concurrent cognitive task and physical tasks with a prosthesis including standardized functional assessments and a functional assessment where the individual made a cup of coffee ('Coffee Task') that required grasp transitions.Main results.In the virtual environment, the participant was able to select between four functional grasps with higher accuracy using the RPNI controller (92.5%) compared to surface controllers (81.9%). With the concurrent cognitive task, performance of the virtual task was more consistent with RPNI controllers (reduced accuracy by 1.1%) compared to with surface controllers (4.8%). When RPNI signals were excluded from the controller with intramuscular electromyography (i.e. residual muscles only), grasp selection accuracy decreased by up to 24%. The participant completed the Coffee Task with 11.7% longer completion time with the surface controller than with the RPNI controller. She also completed the Coffee Task with 11 fewer transition errors out of a maximum of 25 total errors when using the RPNI controller compared to surface controller.Significance.The use of RPNI signals in concert with residual muscles and intramuscular electrodes can improve grasp selection accuracy in both virtual and physical environments. This approach yielded consistent performance without recalibration needs while reducing cognitive load associated with pattern recognition for myoelectric control (clinical trial registration number NCT03260400).

Adaptive Lower Limb Pattern Recognition for Multi-Day Control

Pattern recognition in EMG-based control systems suffer from increase in error rate over time, which could lead to unwanted behavior. This so-called concept drift in myoelectric control systems could be caused by fatigue, sensor replacement and varying skin conditions. To circumvent concept drift, adaptation strategies could be used to retrain a pattern recognition system, which could lead to comparable error rates over multiple days. In this study, we investigated the error rate development over one week and compared three adaptation strategies to reduce the error rate increase. The three adaptation strategies were based on entropy, on backward prediction and a combination of backward prediction and entropy. Ten able-bodied subjects were measured on four measurement days while performing gait-related activities. During the measurement electromyography and kinematics were recorded. The three adaptation strategies were implemented and compared against the baseline error rate and against adaptation using the ground truth labels. It can be concluded that without adaptation the baseline error rate increases significantly from day 1 to 2, but plateaus on day 2, 3 and 7. Of the three tested adaptation strategies, entropy based adaptation showed the smallest increase in error rate over time. It can be concluded that entropy based adaptation is simple to implement and can be considered a feasible adaptation strategy for lower limb pattern recognition.

Extended Reality "X-Reality" for Prosthesis Training of Upper-Limb Amputees: A Review on Current and Future Clinical Potential

The rejection rates of upper-limb prosthetic devices in adults are high, currently averaging 26% and 23% for body-powered and electric devices, respectively. While many factors influence acceptance, prosthesis training methods relying on novel virtual reality systems have been cited as a critical factor capable of increasing the likelihood of long-term, full-time use. Despite that, these implementations have not yet garnered widespread traction in the clinical setting, and their use remains immaterial. This review aims to explore the reasons behind this situation by identifying trends in existing research that seek to advance Extended Reality "X-Reality" systems for the sake of upper-limb prosthesis rehabilitation and, secondly, analyzing barriers and presenting potential pathways to deployment for successful adoption in the future. The search yielded 42 research papers that were divided into two categories. The first category included articles that focused on the technical aspect of virtual prosthesis training. Articles in the second category utilize user evaluation procedures to ensure applicability in a clinical environment. The review showed that 75% of articles that conducted whole system testing experimented with non-immersive virtual systems. Furthermore, there is a shortage of experiments performed with amputee subjects. From the large-scale studies analyzed, 71% of those recruited solely able-bodied participants. This paper shows that X-Reality technologies for prosthesis rehabilitation of upper-limb amputees carry significant benefits. Nevertheless, much still must be done so that the technology reaches widespread clinical use.

SeNic: An Open Source Dataset for sEMG-Based Gesture Recognition in Non-ideal Conditions

In order to reduce the gap between the laboratory environment and actual use in daily life of human-machine interaction based on surface electromyogram (sEMG) intent recognition, this paper presents a benchmark dataset of sEMG in non-ideal conditions (SeNic). The dataset mainly consists of 8-channel sEMG signals, and electrode shifts from an 3D-printed annular ruler. A total of 36 subjects participate in our data acquisition experiments of 7 gestures in non-ideal conditions, where non-ideal factors of 1) electrode shifts, 2) individual difference, 3) muscle fatigue, 4) inter-day difference, and 5) arm postures are elaborately involved. Signals of sEMG are validated first in temporal and frequency domains. Results of recognizing gestures in ideal conditions indicate the high quality of the dataset. Adverse impacts in non-ideal conditions are further revealed in the amplitudes of these data and recognition accuracies. To be concluded, SeNic is a benchmark dataset that introduces several non-ideal factors which often degrade the robustness of sEMG-based systems. It could be used as a freely available dataset and a common platform for researchers in the sEMG-based recognition community. The benchmark dataset SeNic are available online via the website3.

Classification Performance and Feature Space Characteristics in Individuals With Upper Limb Loss Using Sonomyography

Objective: Sonomyography, or ultrasound-based sensing of muscle deformation, is an emerging modality for upper limb prosthesis control. Although prior studies have shown that individuals with upper limb loss can achieve successful motion classification with sonomyography, it is important to better understand the time-course over which proficiency develops. In this study, we characterized user performance during their initial and subsequent exposures to sonomyography. Method: Ultrasound images corresponding to a series of hand gestures were collected from individuals with transradial limb loss under three scenarios: during their initial exposure to sonomyography (Experiment 1), during a subsequent exposure to sonomyography where they were provided biofeedback as part of a training protocol (Experiment 2), and during testing sessions held on different days (Experiment 3). User performance was characterized by offline classification accuracy, as well as metrics describing the consistency and separability of the sonomyography signal patterns in feature space. Results: Classification accuracy was high during initial exposure to sonomyography (96.2 ± 5.9%) and did not systematically change with the provision of biofeedback or on different days. Despite this stable classification performance, some of the feature space metrics changed. Conclusions: User performance was strong upon their initial exposure to sonomyography and did not improve with subsequent exposure. Clinical Impact: Prosthetists may be able to quickly assess if a patient will be successful with sonomyography without submitting them to an extensive training protocol, leading to earlier socket fabrication and delivery.

The Influence of Training with Visual Biofeedback on the Predictability of Myoelectric Control Usability

Studies have shown that closed-loop myoelectric control schemes can lead to changes in user performance and behavior compared to open-loop systems. When users are placed within the control loop, such as during real-time use, they must correct for errors made by the controller and learn what behavior is necessary to produce desired outcomes. Augmented feedback, consequently, has been used to incorporate the user throughout the training process and to facilitate learning. This work explores the effect of visual feedback presented during user training on both the performance and predictability of a myoelectric classification-based control system. Our results suggest that properly designed feedback mechanisms and training tasks can influence the quality of the training data and the ability to predict usability using linear combinations of metrics derived from feature space. Furthermore, our results confirm that the most common in-lab training protocol, screen guided training, may yield training data that are less representative of online use than training protocols that incorporate the user in the loop. These results suggest that training protocols should be designed that better parallel the testing environment to more effectively prepare both the algorithms and users for real-time control.

Towards Robust, Adaptive and Reliable Upper-limb Motion Estimation Using Machine Learning and Deep Learning--A Survey in Myoelectric Control

To develop multi-functional human-machine interfaces that can help disabled people reconstruct lost functions of upper-limbs, machine learning (ML) and deep learning (DL) techniques have been widely implemented to decode human movement intentions from surface electromyography (sEMG) signals. However, due to the high complexity of upper-limb movements and the inherent non-stable characteristics of sEMG, the usability of ML/DL based control schemes is still greatly limited in practical scenarios. To this end, tremendous efforts have been made to improve model robustness, adaptation, and reliability. In this article, we provide a systematic review on recent achievements, mainly from three categories: multi-modal sensing fusion to gain additional information of the user, transfer learning (TL) methods to eliminate domain shift impacts on estimation models, and post-processing approaches to obtain more reliable outcomes. Special attention is given to fusion strategies, deep TL frameworks, and confidence estimation. \textcolor{red}{Research challenges and emerging opportunities, with respect to hardware development, public resources, and decoding strategies, are also analysed to provide perspectives for future developments.

Towards zero retraining for multiday motion recognition via a fully unsupervised adaptive approach and fabric myoelectric armband

Surface electromyogram pattern recognition (EMG-PR) requires time-consuming training and retraining procedures for long-term use, hindering the usability of myoelectric control. In this paper, we design a fabric myoelectric armband to reduce the electrode shifts. Furthermore, we propose a fully unsupervised adaptive approach called hybrid serial classifier (HSC) to eliminate the burden of retraining over multiply days. We investigated the performance of our approach with a dataset of ten types of forearm motion from ten male subjects over eight weeks (total ten days, including: from day 1 to day 7, day 14, day 28, day 56). The average inter-day classification accuracies of HSC without any new retraining data are 86.61% when trained exclusively with the first day's EMG data, and 94.77% when trained with other nine days' data. We compare our proposed HSC algorithm with linear discriminant analysis (LDA) without recalibration (BLDA) and supervised adaption LDA (ALDA) with just one trial of new retraining data. The inter-day classification accuracy of HSC is significantly higher than that of BLDA and ALDA. These results indicate that our novel armband sEMG device is feasible for long-term use in conjunction with the proposed HSC algorithm.

An Adaptive Multi-Modal Control Strategy to Attenuate the Limb Position Effect in Myoelectric Pattern Recognition

Over the last few decades, pattern recognition algorithms have shown promising results in the field of upper limb prostheses myoelectric control and are now gradually being incorporated in commercial devices. A widely used approach is based on a classifier which assigns a specific input value to a selected hand motion. While this method guarantees good performance and robustness within each class, it still shows limitations in adapting to different conditions encountered in real-world applications, such as changes in limb position or external loads. This paper proposes an adaptive method based on a pattern recognition classifier that takes advantage of an augmented dataset-i.e., representing variations in limb position or external loads-to selectively adapt to underrepresented variations. The proposed method was evaluated using a series of target achievement control tests with ten able-bodied volunteers. Results indicated a higher median completion rate >3.33% for the adapted algorithm compared to a classical pattern recognition classifier used as a baseline model. Subject-specific performance showed the potential for improved control after adaptation and a ≤13% completion rate; and in many instances, the adapted points were able to provide new information within classes. These preliminary results show the potential of the proposed method and encourage further development.

A Network-Enabled Myoelectric Platform for Prototyping Research Outside of the Lab

We present a network-enabled myoelectric platform for performing research outside of the laboratory environment. A low-cost, flexible, modular design based on common Internet of Things connectivity technology allows home-based research to be piloted. An outline of the platform is presented followed by technical results obtained from ten days of home-based tests with three participants. Results show the system enabled collection of close to 12,000 trials during around 28 cumulative hours of use. Home-based testing of multiple participants in parallel offers efficiency gains and provides a intuitive route toward long-term testing of upper-limb prosthetic devices in more naturalistic settings.Clinical relevance- In-home myoelectric training reduces clinician time. Network-enabled systems with back-end dashboards allow clinicians to monitor patients myoelectric ability over time and will provide a new way of accessing information about how upper-limb prosthetics are commonly used.

Score, Rank, and Decision-Level Fusion Strategies of Multicode Electromyogram-based Verification and Identification Biometrics

Recent advances in biometric research have established surface electromyogram (sEMG) as a potential spoof-free solution to address some key limitations in current biometric traits. The nature of sEMG signals provide a unique dual-mode security: sEMGs have individual-specific characteristics (biometrics), and users can customize and change gestures just like passcodes. Such security also facilitates the use of code sequences (multicode) to further enhance the security. In this study, three levels of fusion, score, rank, and decision were investigated for two biometric applications, verification and identification. This study involved 24 subjects performing 16 hand/finger gestures, and code sequences with varying codelengths were generated. The performance of the verification and identification system was analyzed for varying codelength (M: 16) and rank (K: 14) to determine the best fusion scheme and desirable parameter values for a multicode sEMG biometric system. The results showed that the decision-level fusion scheme using a weighted majority voting resulted in an average equal error rate of 0.6% for the verification system when M=4. For the identification system, the score-level fusion scheme with score normalization based on fitting a Weibull distribution resulted in a minimum false rejection rate of 0.01% and false acceptance rate of 4.7% using a combination of K=2 and M=4. The results also suggested that the parameters M and K could be adjusted based on the number of users in the database to facilitate optimal performance. In summary, a multicode sEMG biometric system was developed to provide improved dual-mode security based on the personalized codes and biometric traits of individuals, with the combination of enhanced security and flexibility.

Automated detection of muscle fatigue conditions from cyclostationary based geometric features of surface electromyography signals

In this study, an attempt has been made to develop an automated muscle fatigue detection system using cyclostationary based geometric features of surface electromyography (sEMG) signals. For this purpose, signals are acquired from fifty-eight healthy volunteers under dynamic muscle fatiguing contractions. The sEMG signals are preprocessed and the epochs of signals under nonfatigue and fatigue conditions are considered for the analysis. A computationally effective Fast Fourier transform based accumulation algorithm is adapted to compute the spectral correlation density coefficients. The boundary of spectral density coefficients in the complex plane is obtained using alpha shape method. The geometric features, namely, perimeter, area, circularity, bending energy, eccentricity and inertia are extracted from the shape and the machine learning models based on multilayer perceptron (MLP) and extreme learning machine (ELM) are developed using these biomarkers. The results show that the cyclostationarity increases in fatigue condition. All the extracted features are found to have significant difference in the two conditions. It is found that the ELM model based on prominent features classifies the sEMG signals with a maximum accuracy of 94.09% and F-score of 93.75%. Therefore, the proposed approach appears to be useful for analysing the fatiguing contractions in neuromuscular conditions.

The Need to Work Arm in Arm: Calling for Collaboration in Delivering Neuroprosthetic Limb Replacements

Over the last few decades there has been a push to enhance the use of advanced prosthetics within the fields of biomedical engineering, neuroscience, and surgery. Through the development of peripheral neural interfaces and invasive electrodes, an individual's own nervous system can be used to control a prosthesis. With novel improvements in neural recording and signal decoding, this intimate communication has paved the way for bidirectional and intuitive control of prostheses. While various collaborations between engineers and surgeons have led to considerable success with motor control and pain management, it has been significantly more challenging to restore sensation. Many of the existing peripheral neural interfaces have demonstrated success in one of these modalities; however, none are currently able to fully restore limb function. Though this is in part due to the complexity of the human somatosensory system and stability of bioelectronics, the fragmentary and as-yet uncoordinated nature of the neuroprosthetic industry further complicates this advancement. In this review, we provide a comprehensive overview of the current field of neuroprosthetics and explore potential strategies to address its unique challenges. These include exploration of electrodes, surgical techniques, control methods, and prosthetic technology. Additionally, we propose a new approach to optimizing prosthetic limb function and facilitating clinical application by capitalizing on available resources. It is incumbent upon academia and industry to encourage collaboration and utilization of different peripheral neural interfaces in combination with each other to create versatile limbs that not only improve function but quality of life. Despite the rapidly evolving technology, if the field continues to work in divided "silos," we will delay achieving the critical, valuable outcome: creating a prosthetic limb that is right for the patient and positively affects their life.

A Multi-Variate Approach to Predicting Myoelectric Control Usability

Pattern recognition techniques leveraging the use of electromyography signals have become a popular approach to provide intuitive control of myoelectric devices. Performance of these control interfaces is commonly quantified using offline classification accuracy, despite studies having shown that this metric is a poor indicator of usability. Researchers have identified alternative offline metrics that better correlate with online performance; however, the relationship has yet to be fully defined in the literature. This has necessitated the continued trial-and-error-style online testing of algorithms developed using offline approaches. To bridge this information divide, we conducted an exploratory study where thirty-two different metrics from the offline training data were extracted. A correlation analysis and an ordinary least squares regression were implemented to investigate the relationship between the offline metrics and six aspects online use. The results indicate that the current offline standard, classification accuracy, is a poor indicator of usability and that other metrics may hold predictive power. The metrics identified in this work also may constitute more representative evaluation criteria when designing and reporting new control schemes. Furthermore, linear combinations of offline training metrics generate substantially more accurate predictions than using individual metrics. We found that the offline metric feature efficiency generated the best predictions for the usability metric throughput. A combination of two offline metrics (mean semi-principal axes and mean absolute value) significantly outperformed feature efficiency alone, with a 166% increase in the predicted R² value (i.e., VEcv). These findings suggest that combinations of metrics could provide a more robust framework for predicting usability.

Toward Hand Pattern Recognition in Assistive and Rehabilitation Robotics Using EMG and Kinematics

Wearable hand robots are becoming an attractive means in the facilitating of assistance with daily living and hand rehabilitation exercises for patients after stroke. Pattern recognition is a crucial step toward the development of wearable hand robots. Electromyography (EMG) is a commonly used biological signal for hand pattern recognition. However, the EMG based pattern recognition performance in assistive and rehabilitation robotics post stroke remains unsatisfactory. Moreover, low cost kinematic sensors such as Leap Motion is recently used for pattern recognition in various applications. This study proposes feature fusion and decision fusion method that combines EMG features and kinematic features for hand pattern recognition toward application in upper limb assistive and rehabilitation robotics. Ten normal subjects and five post stroke patients participating in the experiments were tested with eight hand patterns of daily activities while EMG and kinematics were recorded simultaneously. Results showed that average hand pattern recognition accuracy for post stroke patients was 83% for EMG features only, 84.71% for kinematic features only, 96.43% for feature fusion of EMG and kinematics, 91.18% for decision fusion of EMG and kinematics. The feature fusion and decision fusion was robust as three different levels of noise was given to the classifiers resulting in small decrease of classification accuracy. Different channel combination comparisons showed the fusion classifiers would be robust despite failure of specific EMG channels which means that the system has promising potential in the field of assistive and rehabilitation robotics. Future work will be conducted with real-time pattern classification on stroke survivors.

Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future

Amputation of the upper limb brings heavy burden to amputees, reduces their quality of life, and limits their performance in activities of daily life. The realization of natural control for prosthetic hands is crucial to improving the quality of life of amputees. Surface electromyography (sEMG) signal is one of the most widely used biological signals for the prediction of upper limb motor intention, which is an essential element of the control systems of prosthetic hands. The conversion of sEMG signals into effective control signals often requires a lot of computational power and complex process. Existing commercial prosthetic hands can only provide natural control for very few active degrees of freedom. Deep learning (DL) has performed surprisingly well in the development of intelligent systems in recent years. The significant improvement of hardware equipment and the continuous emergence of large data sets of sEMG have also boosted the DL research in sEMG signal processing. DL can effectively improve the accuracy of sEMG pattern recognition and reduce the influence of interference factors. This paper analyzes the applicability and efficiency of DL in sEMG-based gesture recognition and reviews the key techniques of DL-based sEMG pattern recognition for the prosthetic hand, including signal acquisition, signal preprocessing, feature extraction, classification of patterns, post-processing, and performance evaluation. Finally, the current challenges and future prospects in clinical application of these techniques are outlined and discussed.

Evaluating User and Machine Learning in Short- and Long-Term Pattern Recognition-Based Myoelectric Control

Proper training is essential to achieve reliable pattern recognition (PR) based myoelectric control. The amount of training is commonly determined by experience. The purpose of this study is to provide an offline validation method that makes the offline performance transferable to online control and find the proper amount of training that achieves good online performance. In the offline experiment, eight able-bodied subjects and three amputees participated in a ten-day training. Repeatability index (RI) and classification error (CE) were used to evaluate user learning and machine learning, respectively. The performance of cross-validation (CV) and time serial related validation (TSV) was compared. Learning curves were established with different training trials by TSV. In the online experiment, sixteen able-bodied subjects were randomly divided into two groups with one- or five-trial training, respectively, followed by participating in the test with and without classifier-output feedback. The correlation between offline and online tests was analyzed. Results indicated that five-trial training was proper to train the user and the classifier. The long-term retention of skills could not shorten the learning process. The correlation between CEs of TSV and the online test was strong ( r=0.87 ) with five-trial training, while the correlation between CEs of CV and the online test was weak ( r=0.30 ). Outcomes demonstrate that offline performance evaluated by TSV is transferable to online performance and the learning process can guide the user to achieve good online myoelectric control with minimum training.

Simultaneous and proportional control of wrist and hand movements by decoding motor unit discharges in real time

Objective.Surface electromyography (EMG) decomposition techniques can be used to establish human-machine interfacing (HMI), but most investigations are implemented offline due to the computational load of the approach. Here, we generalize the offline decomposition algorithm to identify the motor unit (MU) activities in real time, and we propose a MU-based approach for online simultaneous and proportional control of multiple motor tasks.Approach.High-density surface EMG signals recorded from forearm muscles were decomposed into motor unit spike trains (MUST) with the proposed decomposition method. The MUSTs were first pooled into clusters in the calibration phase and the cumulative discharges of active MUs in each group were extracted as the control signal for each motor task. Then the subjects were instructed to control a virtual cursor with multiple motor tasks involving grasp and wrist movements. Fifteen able-bodied subjects and two patients with limb deficiency participated in the experiments to validate the proposed control scheme.Main results.On average, over 20 MUSTs were identified in real time with an estimated decomposition accuracy > 85%. The cumulative discharge in each pool was highly correlated with the activation of the specific motion (R=0.93±0.05). Moreover, the proposed MU-based method had superior performance in online tests than conventional myo-control methods based on global EMG features.Significance.These results indicate the feasibility of real-time neural decoding in a non-invasive way. Moreover, the superior performance in online tests proves the potential of the MU-based approach for the simultaneous and proportional control, promoting the application of EMG decomposition for HMI systems.

A Transferable Adaptive Domain Adversarial Neural Network for Virtual Reality Augmented EMG-Based Gesture Recognition

Within the field of electromyography-based (EMG) gesture recognition, disparities exist between the offline accuracy reported in the literature and the real-time usability of a classifier. This gap mainly stems from two factors: 1) The absence of a controller, making the data collected dissimilar to actual control. 2) The difficulty of including the four main dynamic factors (gesture intensity, limb position, electrode shift, and transient changes in the signal), as including their permutations drastically increases the amount of data to be recorded. Contrarily, online datasets are limited to the exact EMG-based controller used to record them, necessitating the recording of a new dataset for each control method or variant to be tested. Consequently, this paper proposes a new type of dataset to serve as an intermediate between offline and online datasets, by recording the data using a real-time experimental protocol. The protocol, performed in virtual reality, includes the four main dynamic factors and uses an EMG-independent controller to guide movements. This EMG-independent feedback ensures that the user is in-the-loop during recording, while enabling the resulting dynamic dataset to be used as an EMG-based benchmark. The dataset is comprised of 20 able-bodied participants completing three to four sessions over a period of 14 to 21 days. The ability of the dynamic dataset to serve as a benchmark is leveraged to evaluate the impact of different recalibration techniques for long-term (across-day) gesture recognition, including a novel algorithm, named TADANN. TADANN consistently and significantly ( [Formula: see text]) outperforms using fine-tuning as the recalibration technique.

Position Identification for Robust Myoelectric Control Against Electrode Shift

The vulnerability to the electrode shift was one of the key barriers to the wide application of pattern recognition-based (PR-based) myoelectric control systems outside the controlled laboratory conditions. To overcome this challenge, a novel framework named position identification (PI) was proposed. In the PI framework, an anchor gesture performed by the user was first analyzed to identify the current electrode position from a pool of potential electrode shift positions. Next, the classifier calibrated by the data of the identified position would be selected for following myoelectric control tasks. The results of the amputee and able-bodied participants both demonstrated that the differential filter combined with majority voting improved the PI accuracy. With only one second contraction of the chosen anchor gesture (hand close), the subsequent PR-based myoelectric control performance was fully restored from eight different electrode shift scenarios, with 1 cm in either or both perpendicular and parallel directions. The classification accuracies with PI framework were not significant before and after the shift ( 0.001). The advantage of restoring performance fully in just one second made it a practical solution to improve the robustness of PR-based myoelectric control systems in a wide range of real-world applications.

Improve Inter-day Hand Gesture Recognition Via Convolutional Neural Network-based Feature Fusion

The learning of inter-day representation of electromyographic (EMG) signals across multiple days remains a challenging topic and not fully accommodated yet. This study aims to improve the inter-day hand motion classification accuracy via convolutional neural network (CNN)-based data feature fusion. An EMG database (ISRMyo-I) was recorded from six subjects on 10 days via a low density electrode setting. This study investigated CNNs’ capability of feature learning, and found that the output of the first fully connected layer (CNNFeats) was a decent supplement feature set to the most prevalent Hudgins’ time domain features in combination with fourth-order autoregressive coefficients (TDAR). Through adding the automatically learned CNNFeats to the handcrafted TDAR feature set, both linear discriminant analysis (LDA) and support vector machine (SVM) classifiers received [Formula: see text]3% accuracy improvement. Similarly, taking TDAR as additional input to the CNN improved the accuracy by [Formula: see text]1% in the comparison with the basic CNN. Our results also demonstrated that the CNN approach outperformed conventional approaches when multiple subjects’ data were available for training, while traditional approaches were more adept at presenting motion patterns for single subject. A preliminary conclusion is drawn that substantial “common knowledge/features” can be learned by CNNs from the raw EMG signals across multiple days and multiple subjects, and thus it is believed that a pre-trained CNN model would contribute to higher accuracy as well as the reduction of learning burden.

Simultaneous control of multiple functions of bionic hand prostheses: Performance and robustness in end users

Myoelectric hand prostheses are usually controlled with two bipolar electrodes located on the flexor and extensor muscles of the residual limb. With clinically established techniques, only one function can be controlled at a time. This is cumbersome and limits the benefit of additional functions offered by modern prostheses. Extensive research has been conducted on more advanced control techniques, but the clinical impact has been limited, mainly due to the lack of reliability in real-world conditions. We implemented a regression-based control approach that allows for simultaneous and proportional control of two degrees of freedom and evaluated it on five prosthetic end users. In the evaluation of tasks mimicking daily life activities, we included factors that limit reliability, such as tests in different arm positions and on different days. The regression approach was robust over multiple days and only slightly affected by changing in the arm position. Additionally, the regression approach outperformed two clinical control approaches in most conditions.

Shared Prosthetic Control Based on Multiple Movement Intent Decoders

SIGNIFICANCE

A number of movement intent decoders exist in the literature that typically differ in the algorithms used and the nature of the outputs generated. Each approach comes with its own advantages and disadvantages. Combining the estimates of multiple algorithms may have better performance than any of the individual methods.

OBJECTIVE

This paper presents and evaluates a shared controller framework for prosthetic limbs based on multiple decoders of volitional movement intent.

METHODS

An algorithm to combine multiple estimates to control the prosthesis is developed in this paper. The capabilities of the approach are validated using a system that combines a Kalman filter-based decoder with a multilayer perceptron classifier-based decoder. The shared controller's performance is validated in online experiments where a virtual limb is controlled in real-time by amputee and intact-arm subjects. During the testing phase subjects controlled a virtual hand in real time to move digits to instructed positions using either a Kalman filter decoder, a multilayer perceptron decoder, or a linear combination of the two.

RESULTS

The shared controller results in statistically significant improvements over the component decoders. Specifically, certain degrees of shared control result in increases in the time-in-target metric and decreases in unintended movements.

CONCLUSION

The shared controller of this paper combines the good qualities of component decoders tested in this paper. Herein, combining a Kalman filter decoder with a classifier-based decoder inherits the flexibility of the Kalman filter decoder and the limited unwanted movements from the classifier-based decoder, resulting in a system that may be able to perform the tasks of everyday life more naturally and reliably.

A comparative study of motion detection with FMG and sEMG methods for assistive applications

Introduction

While surface-electromyography (sEMG) has been widely used in limb motion detection for the control of exoskeleton, there is an increasing interest to use forcemyography (FMG) method to detect motion. In this paper, we review the applications of two types of motion detection methods. Their performances were experimentally compared in day-to-day classification of forearm motions. The objective is to select a detection method suitable for motion assistance on a daily basis.

Methods

Comparisons of motion detection with FMG and sEMG were carried out considering classification accuracy (CA), repeatability and training scheme. For both methods, classification of motions was achieved through feed-forward neural network. Repeatability was evaluated on the basis of change in CA between days and also training schemes.

Results

The experiments shows that day-to-day CA with FMG can reach 84.9%, compared with a CA of 77.8% with sEMG, when the classifiers were trained only on the first day. Moreover, the CA with FMG can reach to 86.5%, comparable to CA of 84.1% with sEMG, if classifiers were trained daily.

Conclusions

Results suggest that data recorded from FMG is more repeatable in day-to-day testing and therefore FMG-based methods can be more useful than sEMG-based methods for motion detection in applications where exoskeletons are used as needed on a daily basis.

Exploring the Relationship Between EMG Feature Space Characteristics and Control Performance in Machine Learning Myoelectric Control

In myoelectric machine learning (ML) based control, it has been demonstrated that control performance usually increases with training, but it remains largely unknown which underlying factors govern these improvements. It has been suggested that the increase in performance originates from changes in characteristics of the Electromyography (EMG) patterns, such as separability or repeatability. However, the relation between these EMG metrics and control performance has hardly been studied. We assessed the relation between three common EMG feature space metrics (separability, variability and repeatability) in 20 able bodied participants who learned ML myoelectric control in a virtual task over 15 training blocks on 5 days. We assessed the change in offline and real-time performance, as well as the change of each EMG metric over the training. Subsequently, we assessed the relation between individual EMG metrics and offline and real-time performance via correlation analysis. Last, we tried to predict real-time performance from all EMG metrics via L2-regularized linear regression. Results showed that real-time performance improved with training, but there was no change in offline performance or in any of the EMG metrics. Furthermore, we only found a very low correlation between separability and real-time performance and no correlation between any other EMG metric and real-time performance. Finally, real-time performance could not be successfully predicted from all EMG metrics employing L2-regularized linear regression. We concluded that the three EMG metrics and real-time performance appear to be unrelated.

Robust Simultaneous and Proportional Myoelectric Control Scheme for Individuals with Transradial Amputations

Commercial myoelectric prostheses need to be accurate and clinically viable to be successful. This study proposed a simultaneous and proportional control scheme with frequency division technique (SPEC-FDT) to address limitations in current myoelectric prosthesis control, specifically to address non-stationaries such as contraction level variations and unintended activations. Twenty able-bodied participants (14 males and 6 females, age 23.4 ± 3.0) and four individuals with transradial amputations performed wrist movements (flexion/extension, rotations and combined movements) in two degrees-of freedom virtual tasks. The SPEC-FDT had a completion rate (CR)>90% for both control and clinical participants which was significantly higher than the conventional technique (CR=68%). Our results showed that SPEC-FDT is highly accurate for both able-bodied and clinical participants and provides a robust myoelectric control scheme allowing for increased prosthetic hand functions.

EMG-Based Hand Gesture Classification with Long Short-Term Memory Deep Recurrent Neural Networks

Electromyogram (EMG) pattern recognition has been utilized with the traditional machine and deep learning architectures as a control strategy for upper-limb prostheses. However, most of these learning architectures, including those in convolutional neural networks, focus the spatial correlations only; but muscle contractions have a strong temporal dependency. Our primary aim in this paper is to investigate the effectiveness of recurrent deep learning networks in EMG classification as they can learn long-term and non-linear dynamics of time series. We used a Long Short-Term Memory (LSTM-based) neural network to perform multiclass classification with six grip gestures at three different force levels (low, medium, and high) generated by nine amputees. Four different feature sets were extracted from the raw signals and fed to LSTM. Moreover, to investigate a generalization of the proposed method, three different training approaches were tested including 1) training the network with feature extracted from one specific force level and testing it with the same force level, 2) training the network with one specific force level and testing it with two remained force levels, and 3) training the network with all of the force levels and testing it with a single force level. Our results show that LSTM-based neural network can provide reliable performance with average classification errors of around 9% across all nine amputees and force levels. We demonstrate the applicability of deep learning for upperlimb prosthesis control.

Guiding the Training of Users With a Pattern Similarity Biofeedback to Improve the Performance of Myoelectric Pattern Recognition

Next generation prosthetics will rely massively on myoelectric "Pattern Recognition" (PR) based control approaches, to improve their users' dexterity. One major identified factor of successful functioning of these approaches lies in the training of amputees and in their understanding of how those prosthetics works. We thus propose here an intuitive pattern similarity biofeedback which can be easily used to train amputees and allow them to optimize their muscular contractions to improve their control performance. Experiments were conducted on twenty able-bodied participants and one transradial amputee. Their performance in controlling an interface through a myoelectric PR algorithm was evaluated; before and after a short automatic user training session consisting in using the proposed visual biofeedback for ten participants, and using a generic PR algorithm output feedback for the others ten. Participants who were trained with the proposed biofeedback increased their classification score for the retrained gesture (by 39.4%), without affecting the overall classification performance (which progressed by 10.2%) through over-training and increase of False Positive rate as observed in the control group. Additional analysis indicates a clear change in contraction strategy only in the group who used the proposed biofeedback. These preliminary results highlight the potential of this method which does not focus so much on over-optimizing the pattern recognition algorithm or on physically training the users, but on providing them simple and intuitive information to adapt or change their motor strategies to solve some misclassification issues.

Should Hands Be Restricted When Measuring Able-Bodied Participants to Evaluate Machine Learning Controlled Prosthetic Hands?

OBJECTIVE

When evaluating methods for machine-learning controlled prosthetic hands, able-bodied participants are often recruited, for practical reasons, instead of participants with upper limb absence (ULA). However, able-bodied participants have been shown to often perform myoelectric control tasks better than participants with ULA. It has been suggested that this performance difference can be reduced by restricting the wrist and hand movements of able-bodied participants. However, the effect of such restrictions on the consistency and separability of the electromyogram's (EMG) features remains unknown. The present work investigates whether the EMG separability and consistency between unaffected and affected arms differ and whether they change after restricting the unaffected limb in persons with ULA.

METHODS

Both arms of participants with unilateral ULA were compared in two conditions: with the unaffected hand and wrist restricted or not. Furthermore, it was tested if the effect of arm and restriction is influenced by arm posture (arm down, arm in front, or arm up).

RESULTS

Fourteen participants (two women, age = 53.4±4.05) with acquired transradial limb loss were recruited. We found that the unaffected limb generated more separated EMG than the affected limb. Furthermore, restricting the unaffected hand and wrist lowered the separability of the EMG when the arm was held down.

CONCLUSION

Limb restriction is a viable method to make the EMG of able-bodied participants more similar to that of participants with ULA.

SIGNIFICANCE

Future research that evaluates methods for machine learning controlled hands in able-bodied participants should restrict the participants' hand and wrist.

A Multiday Evaluation of Real-Time Intramuscular EMG Usability with ANN

Recent developments in implantable technology, such as high-density recordings, wireless transmission of signals to a prosthetic hand, may pave the way for intramuscular electromyography (iEMG)-based myoelectric control in the future. This study aimed to investigate the real-time control performance of iEMG over time. A novel protocol was developed to quantify the robustness of the real-time performance parameters. Intramuscular wires were used to record EMG signals, which were kept inside the muscles for five consecutive days. Tests were performed on multiple days using Fitts' law. Throughput, completion rate, path efficiency and overshoot were evaluated as performance metrics using three train/test strategies. Each train/test scheme was categorized on the basis of data quantity and the time difference between training and testing data. An artificial neural network (ANN) classifier was trained and tested on (i) data from the same day (WDT), (ii) data collected from the previous day and tested on present-day (BDT) and (iii) trained on all previous days including the present day and tested on present-day (CDT). It was found that the completion rate (91.6 ± 3.6%) of CDT was significantly better (p < 0.01) than BDT (74.02 ± 5.8%) and WDT (88.16 ± 3.6%). For BDT, on average, the first session of each day was significantly better (p < 0.01) than the second and third sessions for completion rate (77.9 ± 14.0%) and path efficiency (88.9 ± 16.9%). Subjects demonstrated the ability to achieve targets successfully with wire electrodes. Results also suggest that time variations in the iEMG signal can be catered by concatenating the data over several days. This scheme can be helpful in attaining stable and robust performance.

Robust Real-Time Embedded EMG Recognition Framework Using Temporal Convolutional Networks on a Multicore IoT Processor

Hand movement classification via surface electromyographic (sEMG) signal is a well-established approach for advanced Human-Computer Interaction. However, sEMG movement recognition has to deal with the long-term reliability of sEMG-based control, limited by the variability affecting the sEMG signal. Embedded solutions are affected by a recognition accuracy drop over time that makes them unsuitable for reliable gesture controller design. In this paper, we present a complete wearable-class embedded system for robust sEMG-based gesture recognition, based on Temporal Convolutional Networks (TCNs). Firstly, we developed a novel TCN topology (TEMPONet), and we tested our solution on a benchmark dataset (Ninapro), achieving 49.6% average accuracy, 7.8%, better than current State-Of-the-Art (SoA). Moreover, we designed an energy-efficient embedded platform based on GAP8, a novel 8-core IoT processor. Using our embedded platform, we collected a second 20-sessions dataset to validate the system on a setup which is representative of the final deployment. We obtain 93.7% average accuracy with the TCN, comparable with a SoA SVM approach (91.1%). Finally, we profiled the performance of the network implemented on GAP8 by using an 8-bit quantization strategy to fit the memory constraint of the processor. We reach a 4× lower memory footprint (460 kB) with a performance degradation of only 3% accuracy. We detailed the execution on the GAP8 platform, showing that the quantized network executes a single classification in 12.84 ms with a power envelope of 0.9 mJ, making it suitable for a long-lifetime wearable deployment.

Biometric From Surface Electromyogram (sEMG): Feasibility of User Verification and Identification Based on Gesture Recognition

Electrical biosignals are favored as biometric traits due to their hidden nature and allowing for liveness detection. This study explored the feasibility of surface electromyogram (sEMG), the electrical manifestation of muscle activities, as a biometric trait. The accurate gesture recognition from sEMG provided a unique advantage over two traditional electrical biosignal traits, electrocardiogram (ECG), and electroencephalogram (EEG), enabling users to customize their own gesture codes. The performance of 16 static wrist and hand gestures was systematically investigated in two identity management modes: verification and identification. The results showed that for a single fixed gesture, using only 0.8-second data, the averaged equal error rate (EER) for verification was 3.5%, and the averaged rank-1 for identification was 90.3%, both comparable to the reported performance of ECG and EEG. The function of customizing gesture code could further improve the verification performance to 1.1% EER. This work demonstrated the potential and effectiveness of sEMG as a biometric trait in user verification and identification, beneficial for the design of future biometric systems.

Myoelectric Control for Upper Limb Prostheses

State-of-the-art high-end prostheses are electro-mechanically able to provide a great variety of movements. Nevertheless, in order to functionally replace a human limb, it is essential that each movement is properly controlled. This is the goal of prosthesis control, which has become a growing research field in the last decades, with the ultimate goal of reproducing biological limb control. Therefore, exploration and development of prosthesis control are crucial to improve many aspects of an amputee’s life. Nowadays, a large divergence between academia and industry has become evident in commercial systems. Although several studies propose more natural control systems with promising results, basic one degree of freedom (DoF), a control switching system is the most widely used option in industry because of simplicity, robustness and inertia. A few classification controlled prostheses have emerged in the last years but they are still a low percentage of the used ones. One of the factors that generate this situation is the lack of robustness of more advanced control algorithms in daily life activities outside of laboratory conditions. Because of this, research has shifted towards more functional prosthesis control. This work reviews the most recent literature in upper limb prosthetic control. It covers commonly used variants of possible biological inputs, its processing and translation to actual control, mostly focusing on electromyograms as well as the problems it will have to overcome in near future.

Facilitate sEMG-Based Human–Machine Interaction Through Channel Optimization

Electromyography (EMG) has been widely accepted to interact with prosthetic hands, but still limited to using few channels for the control of few degrees of freedom. The use of more channels can improve the controllability, but it also increases system’s complexity and reduces its wearability. It is yet clear if optimizely placing the EMG channel could provide a feasible solution to this challenge. This study customized a genetic algorithm to optimize the number of channels and its position on the forearm in inter-day hand gesture recognition scenario. Our experimental results demonstrate that optimally selected 14 channels out of 16 can reach a peak inter-day hand gesture recognition accuracy at 72.3%, and optimally selecting 9 and 11 channels would reduce the performance by 3% and 10%. The cross-validation results also demonstrate that the optimally selected EMG channels from five subjects also work on the rest of the subjects, improving the accuracies by 3.09% and 4.5% in 9- and 11-channel combination, respectively. In sum, this study demonstrates the feasibility of channel reduction through genetic algorithm, and preliminary proves the significance of EMG channel optimization for human–machine interaction.