Current state of digital signal processing in myoelectric interfaces and related applications

Hand Gesture Recognition Based on High-Density Myoelectricity in Forearm Flexors in Humans

Electromyography-based gesture recognition has become a challenging problem in the decoding of fine hand movements. Recent research has focused on improving the accuracy of gesture recognition by increasing the complexity of network models. However, training a complex model necessitates a significant amount of data, thereby escalating both user burden and computational costs. Moreover, owing to the considerable variability of surface electromyography (sEMG) signals across different users, conventional machine learning approaches reliant on a single feature fail to meet the demand for precise gesture recognition tailored to individual users. Therefore, to solve the problems of large computational cost and poor cross-user pattern recognition performance, we propose a feature selection method that combines mutual information, principal component analysis and the Pearson correlation coefficient (MPP). This method can filter out the optimal subset of features that match a specific user while combining with an SVM classifier to accurately and efficiently recognize the user's gesture movements. To validate the effectiveness of the above method, we designed an experiment including five gesture actions. The experimental results show that compared to the classification accuracy obtained using a single feature, we achieved an improvement of about 5% with the optimally selected feature as the input to any of the classifiers. This study provides an effective guarantee for user-specific fine hand movement decoding based on sEMG signals.

Multimodal fusion of EMG and vision for human grasp intent inference in prosthetic hand control

Objective: For transradial amputees, robotic prosthetic hands promise to regain the capability to perform daily living activities. Current control methods based on physiological signals such as electromyography (EMG) are prone to yielding poor inference outcomes due to motion artifacts, muscle fatigue, and many more. Vision sensors are a major source of information about the environment state and can play a vital role in inferring feasible and intended gestures. However, visual evidence is also susceptible to its own artifacts, most often due to object occlusion, lighting changes, etc. Multimodal evidence fusion using physiological and vision sensor measurements is a natural approach due to the complementary strengths of these modalities. Methods: In this paper, we present a Bayesian evidence fusion framework for grasp intent inference using eye-view video, eye-gaze, and EMG from the forearm processed by neural network models. We analyze individual and fused performance as a function of time as the hand approaches the object to grasp it. For this purpose, we have also developed novel data processing and augmentation techniques to train neural network components. Results: Our results indicate that, on average, fusion improves the instantaneous upcoming grasp type classification accuracy while in the reaching phase by 13.66% and 14.8%, relative to EMG (81.64% non-fused) and visual evidence (80.5% non-fused) individually, resulting in an overall fusion accuracy of 95.3%. Conclusion: Our experimental data analyses demonstrate that EMG and visual evidence show complementary strengths, and as a consequence, fusion of multimodal evidence can outperform each individual evidence modality at any given time.

Recent trends and challenges of surface electromyography in prosthetic applications

Surface electromyography (sEMG) meets extensive applications in the field of prosthesis in the current period. The effectiveness of sEMG in prosthesis applications has been verified by numerous revolutionary developments and extensive research attempts. A large volume of research and literature works have explored and validated the vast use of these signals in prostheses as an assistive technology. The objective of this paper is to conduct a systematic review and offer a detailed overview of the work record in the prosthesis and myoelectric interfaces framework. This review utilized a systematic search strategy to identify published articles discussing the state-of-the-art applications of sEMG in prostheses (including upper limb prosthesis and lower limb prostheses). Relevant studies were identified using electronic databases such as PubMed, IEEE Explore, SCOPUS, ScienceDirect, Google Scholar and Web of Science. Out of 3791 studies retrieved from the databases, 188 articles were found to be potentially relevant (after screening of abstracts and application of inclusion-exclusion criteria) and included in this review. This review presents an investigative analysis of sEMG-based prosthetic applications to assist the readers in making further advancements in this field. It also discusses the fundamental advantages and disadvantages of using sEMG in prosthetic applications. It also includes some important guidelines to follow in order to improve the performance of sEMG-based prosthesis. The findings of this study support the widespread use of sEMG in prosthetics. It is concluded that sEMG-based prosthesis technology, still in its sprouting phase, requires significant explorations for further development. Supplementary investigations are necessary in the direction of making a seamless mechanism of biomechatronics for sEMG-based prosthesis by cohesive efforts of robotic researchers and biomedical engineers.

High-Performance Surface Electromyography Armband Design for Gesture Recognition

Wearable surface electromyography (sEMG) signal-acquisition devices have considerable potential for medical applications. Signals obtained from sEMG armbands can be used to identify a person's intentions using machine learning. However, the performance and recognition capabilities of commercially available sEMG armbands are generally limited. This paper presents the design of a wireless high-performance sEMG armband (hereinafter referred to as the α Armband), which has 16 channels and a 16-bit analog-to-digital converter and can reach 2000 samples per second per channel (adjustable) with a bandwidth of 0.1-20 kHz (adjustable). The α Armband can configure parameters and interact with sEMG data through low-power Bluetooth. We collected sEMG data from the forearms of 30 subjects using the α Armband and extracted three different image samples from the time-frequency domain for training and testing convolutional neural networks. The average recognition accuracy for 10 hand gestures was as high as 98.6%, indicating that the α Armband is highly practical and robust, with excellent development potential.

Human-Centric Digital Twins in Industry: A Comprehensive Review of Enabling Technologies and Implementation Strategies

The last decade saw the emergence of highly autonomous, flexible, re-configurable Cyber-Physical Systems. Research in this domain has been enhanced by the use of high-fidelity simulations, including Digital Twins, which are virtual representations connected to real assets. Digital Twins have been used for process supervision, prediction, or interaction with physical assets. Interaction with Digital Twins is enhanced by Virtual Reality and Augmented Reality, and Industry 5.0-focused research is evolving with the involvement of the human aspect in Digital Twins. This paper aims to review recent research on Human-Centric Digital Twins (HCDTs) and their enabling technologies. A systematic literature review is performed using the VOSviewer keyword mapping technique. Current technologies such as motion sensors, biological sensors, computational intelligence, simulation, and visualization tools are studied for the development of HCDTs in promising application areas. Domain-specific frameworks and guidelines are formed for different HCDT applications that highlight the workflow and desired outcomes, such as the training of AI models, the optimization of ergonomics, the security policy, task allocation, etc. A guideline and comparative analysis for the effective development of HCDTs are created based on the criteria of Machine Learning requirements, sensors, interfaces, and Human Digital Twin inputs.

Spatio-temporal deep forest for emotion recognition based on facial electromyography signals

Emotion recognition is a key component of human-computer interaction technology, for which facial electromyogram (fEMG) is an important physiological modality. Recently, deep-learning-based emotion recognition using fEMG signals has drawn increased attention. However, the ability of effective feature extraction and the demand of large-scale training data are two dominant factors that restrict the performance of emotion recognition. In this paper, a novel spatio-temporal deep forest (STDF) model is proposed to classify three categories of discrete emotions (neutral, sadness, and fear) using multi-channel fEMG signals. The feature extraction module fully extracts effective spatio-temporal features of fEMG signals using a combination of 2D frame sequences and multi-grained scanning. Meanwhile, a cascade forest-based classifier is designed to provide optimal structures for different scales of training data via automatically adjusting the number of cascade layers. The proposed model and five comparison methods were evaluated on our in-house fEMG dataset that included three discrete emotions and three channels of fEMG electrodes with a total of twenty-seven subjects. Experimental results demonstrate that the proposed STDF model achieves the best recognition performance with an average accuracy of 97.41%. Besides, our proposed STDF model can reduced the scale of training data to 50% while the average accuracy of emotion recognition is only reduced by about 5%. Our proposed model offers an effective solution for practical applications of fEMG-based emotion recognition.

Decentralized robust interaction control of modular robot manipulators via harmonic drive compliance model-based human motion intention identification

In this paper, a human motion intention estimation-based decentralized robust interaction control method of modular robot manipulators (MRMs) is proposed under the situation of physical human–robot interaction (pHRI). Different from traditional interaction control scheme that depends on the biological signal and centralized control method, the decentralized robust interaction control is implemented that using only position measurements of each joint module in this investigation. Based on the harmonic drive compliance model, a novel torque-sensorless human motion intention estimation method is developed, which utilizes only the information of local dynamic position measurements. On this basis, the decentralized robust interaction control scheme is presented to achieve high performance of position tracking and ensure the security of interaction to create the ’safety’ interaction environment. The uniformly ultimately bounded (UUB) of the tracking error is proved by the Lyapunov theory. Finally, pHRI experiments confirm the effectiveness and advancement of the proposed method.

Individuals with moderate to severe hand impairments may struggle to use EMG control for assistive devices

Neurological trauma, such as stroke, traumatic brain injury (TBI), spinal cord injury, and cerebral palsy can cause mild to severe upper limb impairments. Hand impairment makes it difficult for individuals to complete activities of daily living, especially bimanual tasks. A robotic hand orthosis or hand exoskeleton can be used to restore partial function of an intact but impaired hand. It is common for upper extremity prostheses and orthoses to use electromyography (EMG) sensing as a method for the user to control their device. However some individuals with an intact but impaired hand may struggle to use a myoelectrically controlled device due to potentially confounding muscle activity. This study was conducted to evaluate the application of conventional EMG control techniques as a robotic orthosis/exoskeleton user input method for individuals with mild to severe hand impairments. Nine impaired subjects and ten healthy subjects were asked to perform repeated contractions of muscles in their forearm and then onset analysis and feature classification were used to determine the accuracy of the employed EMG techniques. The average accuracy for contraction identification across employed EMG techniques was 95.4% ± 4.9 for the healthy subjects and 73.9% ± 13.1 for the impaired subjects with a range of 47.0% ± 19.1 - 91.6% ± 8.5. These preliminary results suggest that the conventional EMG control technologies employed in this paper may be difficult for some impaired individuals to use due to their unreliable muscle control.

A sEMG Proportional Control for the Gripper of Patient Side Manipulator in da Vinci Surgical System

There is a large community of people with hand disabilities, and these disabilities can be a barrier to those looking to retain or pursue surgical careers. With the development of surgical robotics technologies, it may be possible to develop user interfaces to accommodate these individuals. This paper proposes a hand-free control method for the gripper of a patient side manipulator (PSM) in the da Vinci surgical system. Using electromyography (EMG) signals, a proportional control method was tested on its ability to grasp a pressure sensor. These preliminary results demonstrate that the user can reliably control the grasping motion of the da Vinci PSM using this system. There is a strong correlation between grasping force and normalized EMG signal (r= 0.874). Moreover, the gripper can generate a step grasping force output when feeding in a generated step signal. The results in this paper demonstrate the system integration of a research EMG system with the da Vinci surgical system and are a step towards developing accessible teleoperation systems for surgeons with disabilities. Hand-free control for remaining degrees of freedom in the PSM is under development using additional input from the motion capture system.

Identifying Interaction Forces Via EMG Under Changing Motion Dynamics

Musculoskeletal injuries can severely inhibit performance of activities of daily living. In order to regain function, rehabilitation is often required. Assistive rehabilitation devices can be used to increase arm mobility by guiding therapeutic exercises or assisting with motion. Electromyography (EMG) may be able to provide an intuitive interface between the patient and the device if appropriate classification models allow smart systems to relate these signals to the desired device motion. Unfortunately, the accuracy of pattern recognition models classifying motion in constrained laboratory environments significantly drops when used for detecting dynamic unconstrained movements. The objectives of this study were to quantity how various motion factors affect arm muscle activations during dynamic motion, and to use these motion factors and EMG signals for detecting interaction forces between the person and the environment during motion. The results quantity how EMG features change significantly with variations in arm positions, interaction forces, and motion velocities. The results also show that pattern recognition models were able to detect intended characteristics of motion based solely on EMG signals. Prediction of force was improved from 73.77% correct to 79.17% accuracy during elbow flexion-extension by properly selecting the features, and providing measurable arm position and velocity information as additional inputs to a linear discriminant analysis model.

Real-Time Control of Intelligent Prosthetic Hand Based on the Improved TCN

Intelligent prosthetic hand is an important branch of intelligent robotics. It can remotely replace humans to complete various complex tasks and also help humans to complete rehabilitation training. In human-computer interaction technology, the prosthetic hand can be accurately controlled by surface electromyography (sEMG). This paper proposes a new multichannel fusion scheme (MSFS) to extend the virtual channels of sEMG and improve the accuracy of gesture recognition. In addition, the Temporal Convolutional Network (TCN) in deep learning has been improved to enhance the performance of the network. Finally, the sEMG is collected by the Myo armband and the prosthetic hand is controlled in real time to validate the new method. The experimental results show that the method proposed in this paper can improve the accuracy of the control intelligent prosthetic hand, and the accuracy rate is 93.69%.

Frequency-Domain sEMG Classification Using a Single Sensor

Working towards the development of robust motion recognition systems for assistive technology control, the widespread approach has been to use a plethora of, often times, multi-modal sensors. In this paper, we develop single-sensor motion recognition systems. Utilising the peripheral nature of surface electromyography (sEMG) data acquisition, we optimise the information extracted from sEMG sensors. This allows the reduction in sEMG sensors or provision of contingencies in a system with redundancies. In particular, we process the sEMG readings captured at the trapezius descendens and platysma muscles. We demonstrate that sEMG readings captured at one muscle contain distinct information on movements or contractions of other agonists. We used the trapezius and platysma muscle sEMG data captured in able-bodied participants and participants with tetraplegia to classify shoulder movements and platysma contractions using white-box supervised learning algorithms. Using the trapezius sensor, shoulder raise is classified with an accuracy of 99%. Implementing subject-specific multi-class classification, shoulder raise, shoulder forward and shoulder backward are classified with a 94% accuracy amongst object raise and shoulder raise-and-hold data in able bodied adults. A three-way classification of the platysma sensor data captured with participants with tetraplegia achieves a 95% accuracy on platysma contraction and shoulder raise detection.

Co-adaptive control of bionic limbs via unsupervised adaptation of muscle synergies

OBJECTIVE

In this work, we present a myoelectric interface that extracts natural motor synergies from multi-muscle signals and adapts in real-time with new user inputs. With this unsupervised adaptive myocontrol (UAM) system, optimal synergies for control are continuously co-adapted with changes in user motor control, or as a function of perturbed conditions via online non-negative matrix factorization guided by physiologically informed sparseness constraints in lieu of explicit data labelling.

METHODS

UAM was tested in a set of virtual target reaching tasks completed by able-bodied and amputee subjects. Tests were conducted under normative and electrode perturbed conditions to gauge control robustness with comparisons to non-adaptive and supervised adaptive myocontrol schemes. Furthermore, UAM was used to interface an amputee with a multi-functional powered hand prosthesis during standardized Clothespin Relocation Tests, also conducted in normative and perturbed conditions.

RESULTS

In virtual tests, UAM effectively mitigated performance degradation caused by electrode displacement, affording greater resilience over an existing supervised adaptive system for amputee subjects. Induced electrode shifts also had negligible effect on the real world control performance of UAM with consistent completion times (23.91±1.33 s) achieved across Clothespin Relocation Tests in the normative and electrode perturbed conditions.

CONCLUSION

UAM affords comparable robustness improvements to existing supervised adaptive myocontrol interfaces whilst providing additional practical advantages for clinical deployment.

SIGNIFICANCE

The proposed system uniquely incorporates neuromuscular control principles with unsupervised online learning methods and presents a working example of a freely co-adaptive bionic interface.

A Way of Bionic Control Based on EI, EMG, and FMG Signals

Creating highly functional prosthetic, orthotic, and rehabilitation devices is a socially relevant scientific and engineering task. Currently, certain constraints hamper the development of such devices. The primary constraint is the lack of an intuitive and reliable control interface working between the organism and the actuator. The critical point in developing these devices and systems is determining the type and parameters of movements based on control signals recorded on an extremity. In the study, we investigate the simultaneous acquisition of electric impedance (EI), electromyography (EMG), and force myography (FMG) signals during basic wrist movements: grasping, flexion/extension, and rotation. For investigation, a laboratory instrumentation and software test setup were made for registering signals and collecting data. The analysis of the acquired signals revealed that the EI signals in conjunction with the analysis of EMG and FMG signals could potentially be highly informative in anthropomorphic control systems. The study results confirm that the comprehensive real-time analysis of EI, EMG, and FMG signals potentially allows implementing the method of anthropomorphic and proportional control with an acceptable delay.

Learning Data Correction for Myoelectric Hand Based on "Survival of the Fittest"

In recent years, myoelectric hands have become multi-degree-of-freedom (DOF) devices, which are controlled via machine learning methods. However, currently, learning data for myoelectric hands are gathered manually and thus tend to be of low quality. Moreover, in the case of infants, gathering accurate learning data is nearly impossible because of the difficulty of communicating with them. Therefore, a method that automatically corrects errors in the learning data is necessary. Myoelectric hands are wearable robots and thus have volumetric and weight constraints that make it infeasible to store large amounts of data or apply complex processing methods. Compared with general machine learning methods such as image processing, those for myoelectric hands have limitations on the data storage, although the amount of data to be processed is quite large. If we can use this huge amount of processing data to correct the learning data without storing the processing data, the machine learning performance is expected to improve. We then propose a method for correcting the learning data through utilisation of the signals acquired during the use of the myoelectric hand. The proposed method is inspired by "survival of the fittest." The effectiveness of the method was verified through offline analysis. The method reduced the amount of learning data and learning time by approximately a factor of 10 while maintaining classification rates. The classification rates improved for one participant but slightly deteriorated on average among all participants. To solve this problem, verifying the method via interactive learning will be necessary in the future.

Improved Motion Classification With an Integrated Multimodal Exoskeleton Interface

Human motion intention detection is an essential part of the control of upper-body exoskeletons. While surface electromyography (sEMG)-based systems may be able to provide anticipatory control, they typically require exact placement of the electrodes on the muscle bodies which limits the practical use and donning of the technology. In this study, we propose a novel physical interface for exoskeletons with integrated sEMG- and pressure sensors. The sensors are 3D-printed with flexible, conductive materials and allow multi-modal information to be obtained during operation. A K-Nearest Neighbours classifier is implemented in an off-line manner to detect reaching movements and lifting tasks that represent daily activities of industrial workers. The performance of the classifier is validated through repeated experiments and compared to a unimodal EMG-based classifier. The results indicate that excellent prediction performance can be obtained, even with a minimal amount of sEMG electrodes and without specific placement of the electrode.

One-class autoencoder approach for optimal electrode set identification in wearable EEG event monitoring. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021;2021:7128-7131. [PMID: 34892744 DOI: 10.1109/embc46164.2021.9630901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

A limiting factor towards the wide use of wearable devices for continuous healthcare monitoring is their cumbersome and obtrusive nature. This is particularly true in electroencephalography (EEG), where numerous electrodes are placed in contact with the scalp to perform brain activity recordings. In this work, we propose to identify the optimal wearable EEG electrode set, in terms of minimal number of electrodes, comfortable location and performance, for EEG-based event detection and monitoring. By relying on the demonstrated power of autoencoder (AE) networks to learn latent representations from high-dimensional data, our proposed strategy trains an AE architecture in a one-class classification setup with different electrode combinations as input data. The model performance is assessed using the F-score. Alpha waves detection is the use case through which we demonstrate that the proposed method allows to detect a brain state from an optimal set of electrodes. The so-called wearable configuration, consisting of electrodes in the forehead and behind the ear, is the chosen optimal set, with an average F-score of 0.78. This study highlights the beneficial impact of a learning-based approach in the design of wearable devices for real-life event-related monitoring.

Performance enhancement of facial electromyogram-based facial-expression recognition for social virtual reality applications using linear discriminant analysis adaptation

Recent studies have indicated that facial electromyogram (fEMG)-based facial-expression recognition (FER) systems are promising alternatives to the conventional camera-based FER systems for virtual reality (VR) environments because they are economical, do not depend on the ambient lighting, and can be readily incorporated into existing VR headsets. In our previous study, we applied a Riemannian manifold-based feature extraction approach to fEMG signals recorded around the eyes and demonstrated that 11 facial expressions could be classified with a high accuracy of 85.01%, with only a single training session. However, the performance of the conventional fEMG-based FER system was not high enough to be applied in practical scenarios. In this study, we developed a new method for improving the FER performance by employing linear discriminant analysis (LDA) adaptation with labeled datasets of other users. Our results indicated that the mean classification accuracy could be increased to 89.40% by using the LDA adaptation method (p < .001, Wilcoxon signed-rank test). Additionally, we demonstrated the potential of a user-independent FER system that could classify 11 facial expressions with a classification accuracy of 82.02% without any training sessions. To the best of our knowledge, this was the first study in which the LDA adaptation approach was employed in a cross-subject manner. It is expected that the proposed LDA adaptation approach would be used as an important method to increase the usability of fEMG-based FER systems for social VR applications.

Affordable Embroidered EMG Electrodes for Myoelectric Control of Prostheses: A Pilot Study

Commercial myoelectric prostheses are costly to purchase and maintain, making their provision challenging for developing countries. Recent research indicates that embroidered EMG electrodes may provide a more affordable alternative to the sensors used in current prostheses. This pilot study investigates the usability of such electrodes for myoelectric control by comparing online and offline performance against conventional gel electrodes. Offline performance is evaluated through the classification of nine different hand and wrist gestures. Online performance is assessed with a crossover two-degree-of-freedom real-time experiment using Fitts’ Law. Two performance metrics (Throughput and Completion Rate) are used to quantify usability. The mean classification accuracy of the nine gestures is approximately 98% for subject-specific models trained on both gel and embroidered electrode offline data from individual subjects, and 97% and 96% for general models trained on gel and embroidered offline data, respectively, from all subjects. Throughput (0.3 bits/s) and completion rate (95–97%) are similar in the online test. Results indicate that embroidered electrodes can achieve similar performance to gel electrodes paving the way for low-cost myoelectric prostheses.

Literature review on assistive devices available for quadriplegic people: Indian context

PURPOSE

This literature review aims to find the current state of the art in self-help devices (SHD) available for people with quadriplegia.

MATERIALS AND METHODS

We searched original articles, technical and case studies, conference articles, and literature reviews published between 2014 to 2019 with the keywords ("Self-help devices" OR "Assistive Devices" OR "Assistive Product" OR "Assistive Technology") AND "Quadriplegia" in Science Direct, Pubmed, IEEE Xplore digital library and Web of Science.

RESULTS

Total 222 articles were found. After removing duplicates and screening these articles based on their title and abstracts 80 articles remained. After this, we reviewed the full text, and articles unrelated to SHD development or about the patients who require mechanical ventilation or where the upper limb is functional (C2 or above and T2 or below injuries) were discarded. After the exclusion of articles using the above-mentioned criterion 75 articles were used for further review.

CONCLUSION

The abandonment rate of SHD currently available in the literature is very high. The major requirement of the people was independence and improved quality of life. The situation in India is very bad as compared to the developed countries. The people with spinal cord injury in India are uneducated and very poor, with an average income of 3000 ₹ (41$). They require SHDs and training specially designed for them, keeping their needs in mind.Implications for rehabilitationPeople with quadriplegia are totally dependent on caregivers. Assistive devices not only help these people to do day-to-day tasks but also provides them self-confidence.Even though there are a lot of self-help devices currently available, still they are not able to fulfil the requirements of people with quadriplegia, hence there is a very high abandonment rate of such devices.This study provides an evidence that developing devices after understanding the functional and non-functional requirements of these subjects will decrease the abandonment rate and increase the effectiveness of the device.The results of this study can be used for planning and developing assistive devices which are more focussed on fulfilling the requirements of people with quadriplegia.

An Improved Performance of Deep Learning Based on Convolution Neural Network to Classify the Hand Motion by Evaluating Hyper Parameter

High accuracy in pattern recognition based on electromyography(EMG) contributes to the effectiveness of prosthetics hand development. This study aimed to improve performance and simplify the deep learning pre-processing based on the convolution neural network (CNN) algorithm for classifying ten hand motion from two raw EMG signals. The main contribution of this study is the simplicity of pre-processing stage in classifier machine. For instance, the feature extraction process is not required. Furthermore, the performance of the classifier was improved by evaluating the best hyperparameter in deep learning architecture. To validate the performance of deep learning, the public dataset from ten subjects was evaluated. The performance of the proposed method was compared to other conventional machine learning, specifically LDA, SVM, and KNN. The CNN can discriminate the ten hand-motion based on raw EMG signal without handcrafts feature extraction. The results of the evaluation showed that CNN outperformed other classifiers. The average accuracy for all motion ranges between 0.77 and 0.93. The statistical t-test between using two-channel(CH1 and CH2) and single-channel(CH2) shows that there is no significant difference in accuracy with p-value >0.05. The proposed method was useful in the study of prosthetic hand, which required the simple architecture of machine learning and high performance in the classification.

Multimodal Data Fusion of Electromyography and Acoustic Signals for Thai Syllable Recognition

Speech disorders such as dysarthria are common and frequent after suffering a stroke. Speech rehabilitation performed by a speech-language pathologist is needed to improve and recover. However, in Thailand, there is a shortage of speech-language pathologists. In this paper, we present a syllable recognition system, which can be deployable in a speech rehabilitation system to provide support to the limited speech-language pathologists available. The proposed system is based on a multimodal fusion of acoustic signal and surface electromyography (sEMG) collected from facial muscles. Multimodal data fusion is studied to improve signal collection under noisy situations while reducing the number of electrodes needed. The signals are simultaneously collected while articulating 12 Thai syllables designed for rehabilitation exercises. Several features are extracted from sEMG signals and five channels are studied. The best combination of features and channels is chosen to be fused with the mel-frequency cepstral coefficients extracted from the acoustic signal. The feature vector from each signal source is projected by spectral regression extreme learning machine and concatenated. Data from seven healthy subjects were collected for evaluation purposes. Results show that the multimodal fusion outperforms the use of a single signal source achieving up to [Formula: see text] of accuracy. In other words, an accuracy improvement up to [Formula: see text] can be achieved when using the proposed multimodal fusion. Moreover, its low standard deviations in classification accuracy compared to those from the unimodal fusion indicate the improvement in the robustness of the syllable recognition.

Prediction of motor Unified Parkinson's Disease Rating Scale scores in patients with Parkinson's disease using surface electromyography

OBJECTIVE

Parkinson's disease (PD) is a chronic neurodegenerative disorder with increasing prevalence in the elderly. Especially patients with advanced PD often require complex medication regimens due to fluctuations, that is abrupt transitions from ON to OFF or vice versa. Current gold standard to quantify PD-patients' motor symptoms is the assessment of the Unified Parkinson's Disease Rating Scale (UPDRS), which, however, is cumbersome and may depend upon investigators. This work aimed at developing a mobile, objective and unobtrusive measurement of motor symptoms in PD.

METHODS

Data from 45 PD-patients was recorded using surface electromyography (sEMG) electrodes attached to a wristband. The motor paradigm consisted of a tapping task performed with and without dopaminergic medication. Our aim was to predict UPDRS scores from the sEMG characteristics with distinct regression models and machine learning techniques.

RESULTS

A random forest regression model outnumbered other regression models resulting in a correlation of 0.739 between true and predicted UPDRS values.

CONCLUSIONS

PD-patients' motor affection can be extrapolated from sEMG data during a simple tapping task. In the future, such records could help determine the need for medication changes in telemedicine applications.

SIGNIFICANCE

Our findings support the utility of wearables to detect Parkinson's symptoms and could help in developing tailored therapies in the future.

EMG based classification for pick and place task

The hand amputee is deprived of number of activities of daily living. To help the hand amputee, it is important to learn the pattern of muscles activity. There are several elements of tasks, which involve forearm along with the wrist and hand. The one very important task is pick and place activity performed by the hand. A pick and place action is a compilation of different finger motions for the grasping of objects at different force levels. This action may be better understood by learning the electromyography signals of forearm muscles. Electromyography is the technique to acquire electrical muscle activity that is used for the pattern recognition technique of assistive devices. Regarding this, the different classification characterizations of EMG signals involved in the pick and place action, subjected to variable grip span and weights were considered in this study. A low-level force measuring gripper, capable to bear the changes in weights and object spans was designed and developed to simulate the task. The grip span varied from 6 cm to 9 cm and the maximum weight used in this study was 750 gms. The pattern recognition classification methodology was performed for the differentiation of phases of the pick and place activity, grip force, and the angular deviation of metacarpal phalangeal (MCP) joint. The classifiers used in this study were decision tree (DT), support vector machines (SVM) and k-nearest neighbor (k-NN) based on the feature sets of the EMG signals. After analyses, it was found that k-NN performed best to classify different phases of the activity and relative deviation of MCP joint with an average classification accuracy of 82% and 91% respectively. However; the SVM performed best in classification of force with a particular feature set. The findings of the study would be helpful in designing the assistive devices for hand amputee.

Surface EMG-Based Instantaneous Hand Gesture Recognition Using Convolutional Neural Network with the Transfer Learning Method

In recent years, surface electromyography (sEMG)-based human-computer interaction has been developed to improve the quality of life for people. Gesture recognition based on the instantaneous values of sEMG has the advantages of accurate prediction and low latency. However, the low generalization ability of the hand gesture recognition method limits its application to new subjects and new hand gestures, and brings a heavy training burden. For this reason, based on a convolutional neural network, a transfer learning (TL) strategy for instantaneous gesture recognition is proposed to improve the generalization performance of the target network. CapgMyo and NinaPro DB1 are used to evaluate the validity of our proposed strategy. Compared with the non-transfer learning (non-TL) strategy, our proposed strategy improves the average accuracy of new subject and new gesture recognition by 18.7% and 8.74%, respectively, when up to three repeated gestures are employed. The TL strategy reduces the training time by a factor of three. Experiments verify the transferability of spatial features and the validity of the proposed strategy in improving the recognition accuracy of new subjects and new gestures, and reducing the training burden. The proposed TL strategy provides an effective way of improving the generalization ability of the gesture recognition system.

Performance Evaluation of a Wearable Tattoo Electrode Suitable for High-Resolution Surface Electromyogram Recording

OBJECTIVE

High-density surface electromyography (HD-sEMG) has been utilized extensively in neuromuscular research. Despite its potential advantages, limitations in electrode design have largely prevented widespread acceptance of the technology. Commercial electrodes have limited spatial fidelity, because of a lack of sharpness of the signal, and variable signal stability. We demonstrate here a novel tattoo electrode that addresses these issues. Our dry HD electrode grid exhibits remarkable deformability which ensures superior conformity with the skin surface, while faithfully recording signals during different levels of muscle contraction.

METHOD

We fabricated a 4 cm×3 cm tattoo HD electrode grid on a stretchable electronics membrane for sEMG applications. The grid was placed on the skin overlying the biceps brachii of healthy subjects, and was used to record signals for several hours while tracking different isometric contractions.

RESULTS

The sEMG signals were recorded successfully from all 64 electrodes across the grid. These electrodes were able to faithfully record sEMG signals during repeated contractions while maintaining a stable baseline at rest. During voluntary contractions, broad EMG frequency content was preserved, with accurate reproduction of the EMG spectrum across the full signal bandwidth.

CONCLUSION

The tattoo grid electrode can potentially be used for recording high-density sEMG from skin overlying major limb muscles. Layout programmability, good signal quality, excellent baseline stability, and easy wearability make this electrode a potentially valuable component of future HD electrode grid applications.

SIGNIFICANCE

The tattoo electrode can facilitate high fidelity recording in clinical applications such as tracking the evolution and time-course of challenging neuromuscular degenerative disorders.

Design, Implementation, and Configuration of Laser Systems for Vehicle Detection and Classification in Real Time

The use of real-time vehicle detection and classification systems is essential for the accurate management of traffic and road infrastructure. Over time, diverse systems have been proposed for it, such as the widely known magnetic loops or microwave radars. However, these types of sensors do not offer all the information currently required for exhaustive and comprehensive traffic control. Thus, this paper presents the design, implementation, and configuration of laser systems to obtain 3D profiles of vehicles, which collect more precise information about the state of the roads. Nevertheless, to obtain reliable information on vehicle traffic by means of these systems, it is fundamental to correctly carry out a series of preliminary steps: choose the most suitable type of laser, select its configuration properly, determine the optimal location, and process the information provided accurately. Therefore, this paper details a series of criteria to help make these crucial and difficult decisions. Furthermore, following these guidelines, a complete laser system implemented for vehicle detection and classification is presented as result, which is characterized by its versatility and the ability to control up to four lanes in real time.

A database of high-density surface electromyogram signals comprising 65 isometric hand gestures

Control of contemporary, multi-joint prosthetic hands is commonly realized by using electromyographic signals from the muscles remaining after amputation at the forearm level. Although this principle is trying to imitate the natural control structure where muscles control the joints of the hand, in practice, myoelectric control provides only basic hand functions to an amputee using a dexterous prosthesis. This study aims to provide an annotated database of high-density surface electromyographic signals to aid the efforts of designing robust and versatile electromyographic control interfaces for prosthetic hands. The electromyographic signals were recorded using 128 channels within two electrode grids positioned on the forearms of 20 able-bodied volunteers. The participants performed 65 different hand gestures in an isometric manner. The hand movements were strictly timed using an automated recording protocol which also synchronously recorded the electromyographic signals and hand joint forces. To assess the quality of the recorded signals several quantitative assessments were performed, such as frequency content analysis, channel crosstalk, and the detection of poor skin-electrode contacts.

A Transferable Adaptive Domain Adversarial Neural Network for Virtual Reality Augmented EMG-Based Gesture Recognition

Within the field of electromyography-based (EMG) gesture recognition, disparities exist between the offline accuracy reported in the literature and the real-time usability of a classifier. This gap mainly stems from two factors: 1) The absence of a controller, making the data collected dissimilar to actual control. 2) The difficulty of including the four main dynamic factors (gesture intensity, limb position, electrode shift, and transient changes in the signal), as including their permutations drastically increases the amount of data to be recorded. Contrarily, online datasets are limited to the exact EMG-based controller used to record them, necessitating the recording of a new dataset for each control method or variant to be tested. Consequently, this paper proposes a new type of dataset to serve as an intermediate between offline and online datasets, by recording the data using a real-time experimental protocol. The protocol, performed in virtual reality, includes the four main dynamic factors and uses an EMG-independent controller to guide movements. This EMG-independent feedback ensures that the user is in-the-loop during recording, while enabling the resulting dynamic dataset to be used as an EMG-based benchmark. The dataset is comprised of 20 able-bodied participants completing three to four sessions over a period of 14 to 21 days. The ability of the dynamic dataset to serve as a benchmark is leveraged to evaluate the impact of different recalibration techniques for long-term (across-day) gesture recognition, including a novel algorithm, named TADANN. TADANN consistently and significantly ( [Formula: see text]) outperforms using fine-tuning as the recalibration technique.

Learning regularized representations of categorically labelled surface EMG enables simultaneous and proportional myoelectric control

Background

Processing the surface electromyogram (sEMG) to decode movement intent is a promising approach for natural control of upper extremity prostheses. To this end, this paper introduces and evaluates a new framework which allows for simultaneous and proportional myoelectric control over multiple degrees of freedom (DoFs) in real-time. The framework uses multitask neural networks and domain-informed regularization in order to automatically find nonlinear mappings from the forearm sEMG envelope to multivariate and continuous encodings of concurrent hand- and wrist kinematics, despite only requiring categorical movement instruction stimuli signals for calibration.

Methods

Forearm sEMG with 8 channels was collected from healthy human subjects (N = 20) and used to calibrate two myoelectric control interfaces, each with two output DoFs. The interfaces were built from (I) the proposed framework, termed Myoelectric Representation Learning (MRL), and, to allow for comparisons, from (II) a standard pattern recognition framework based on Linear Discriminant Analysis (LDA). The online performances of both interfaces were assessed with a Fitts’s law type test generating 5 quantitative performance metrics. The temporal stabilities of the interfaces were evaluated by conducting identical tests without recalibration 7 days after the initial experiment session.

Results

Metric-wise two-way repeated measures ANOVA with factors method (MRL vs LDA) and session (day 1 vs day 7) revealed a significant (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$p<0.05$$\end{document}p<0.05) advantage for MRL over LDA in 5 out of 5 performance metrics, with metric-wise effect sizes (Cohen’s \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$d$$\end{document}d) separating MRL from LDA ranging from \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\left|d\right|=0.62$$\end{document}d=0.62 to \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\left|d\right|=1.13$$\end{document}d=1.13. No significant effect on any metric was detected for neither session nor interaction between method and session, indicating that none of the methods deteriorated significantly in control efficacy during one week of intermission.

Conclusions

The results suggest that MRL is able to successfully generate stable mappings from EMG to kinematics, thereby enabling myoelectric control with real-time performance superior to that of the current commercial standard for pattern recognition (as represented by LDA). It is thus postulated that the presented MRL approach can be of practical utility for muscle-computer interfaces.

EMG-Based 3D Hand Motor Intention Prediction for Information Transfer from Human to Robot

(1) Background: Three-dimensional (3-D) hand position is one of the kinematic parameters that can be inferred from Electromyography (EMG) signals. The inferred parameter is used as a communication channel in human–robot collaboration applications. Although its application from the perspective of rehabilitation and assistive technologies are widely studied, there are few papers on its application involving healthy subjects such as intelligent manufacturing and skill transfer. In this regard, for tasks associated with complex hand trajectories without the consideration of the degree of freedom (DOF), the prediction of 3-D hand position from EMG signal alone has not been addressed. (2) Objective: The primary aim of this study is to propose a model to predict human motor intention that can be used as information from human to robot. Therefore, the prediction of a 3-D hand position directly from the EMG signal for complex trajectories of hand movement, without the direct consideration of joint movements, is studied. In addition, the effects of slow and fast motions on the accuracy of the prediction model are analyzed. (3) Methods: This study used the EMG signal that is collected from the upper limb of healthy subjects, and the position signal of the hand while the subjects manipulate complex trajectories. We considered and analyzed two types of tasks with complex trajectories, each with quick and slow motions. A recurrent fuzzy neural network (RFNN) model was constructed to predict the 3-D position of the hand from the features of EMG signals alone. We used the Pearson correlation coefficient (CC) and normalized root mean square error (NRMSE) as performance metrics. (4) Results: We found that 3-D hand positions of the complex movement can be predicted with the mean performance of CC = 0.85 and NRMSE = 0.105. The 3-D hand position can be predicted well within a future time of 250 ms, from the EMG signal alone. Even though tasks performed under quick motion had a better prediction performance; the statistical difference in the accuracy of prediction between quick and slow motion was insignificant. Concerning the prediction model, we found that RFNN has a good performance in decoding for the time-varying system. (5) Conclusions: In this paper, irrespective of the speed of the motion, the 3-D hand position is predicted from the EMG signal alone. The proposed approach can be used in human–robot collaboration applications to enhance the natural interaction between a human and a robot.

A novel energy-motion model for continuous sEMG decoding: from muscle energy to motor pattern

At present, sEMG-based gesture recognition requires vast amounts of training data; otherwise it is limited to a few gestures. Objective. This paper presents a novel dynamic energy model that decodes continuous hand actions by training small amounts of sEMG data. Approach. The activation of forearm muscles can set the corresponding fingers in motion or state with movement trends. The moving fingers store kinetic energy, and the fingers with movement trends store potential energy. The kinetic energy and potential energy in each finger are dynamically allocated due to the adaptive-coupling mechanism of five-fingers in actual motion. Meanwhile, the sum of the two energies remains constant at a certain muscle activation. We regarded hand movements with the same direction of acceleration for five-finger as the same in energy mode and divided hand movements into ten energy modes. Independent component analysis and machine learning methods were used to model associations between sEMG signals and energy modes and expressed gestures by energy form adaptively. This theory imitates the self-adapting mechanism in actual tasks. Thus, ten healthy subjects were recruited, and three experiments mimicking activities of daily living were designed to evaluate the interface: (1) the expression of untrained gestures, (2) the decoding of the amount of single-finger energy, and (3) real-time control. Main results. (1) Participants completed the untrained hand movements (100/100, p < 0.0001). (2) The interface performed better than chance in the experiment where participants pricked balloons with a needle tip (779/1000, p < 0.0001). (3) In the experiment where participants punched a hole in the plasticine on the balloon, the success rate was over 95% (97.67 ± 5.04%, p < 0.01). Significance. The model can achieve continuous hand actions with speed or force information by training small amounts of sEMG data, which reduces learning task complexity.

Automatic Fracture Characterization Using Tactile and Proximity Optical Sensing

This paper demonstrates how tactile and proximity sensing can be used to perform automatic mechanical fractures detection (surface cracks). For this purpose, a custom-designed integrated tactile and proximity sensor has been implemented. With the help of fiber optics, the sensor measures the deformation of its body, when interacting with the physical environment, and the distance to the environment's objects. This sensor slides across different surfaces and records data which are then analyzed to detect and classify fractures and other mechanical features. The proposed method implements machine learning techniques (handcrafted features, and state of the art classification algorithms). An average crack detection accuracy of ~94% and width classification accuracy of ~80% is achieved. Kruskal-Wallis results (p < 0.001) indicate statistically significant differences among results obtained when analysing only integrated deformation measurements, only proximity measurements and both deformation and proximity data. A real-time classification method has been implemented for online classification of explored surfaces. In contrast to previous techniques, which mainly rely on visual modality, the proposed approach based on optical fibers might be more suitable for operation in extreme environments (such as nuclear facilities) where radiation may damage electronic components of commonly employed sensing devices, such as standard force sensors based on strain gauges and video cameras.

Position Identification for Robust Myoelectric Control Against Electrode Shift

The vulnerability to the electrode shift was one of the key barriers to the wide application of pattern recognition-based (PR-based) myoelectric control systems outside the controlled laboratory conditions. To overcome this challenge, a novel framework named position identification (PI) was proposed. In the PI framework, an anchor gesture performed by the user was first analyzed to identify the current electrode position from a pool of potential electrode shift positions. Next, the classifier calibrated by the data of the identified position would be selected for following myoelectric control tasks. The results of the amputee and able-bodied participants both demonstrated that the differential filter combined with majority voting improved the PI accuracy. With only one second contraction of the chosen anchor gesture (hand close), the subsequent PR-based myoelectric control performance was fully restored from eight different electrode shift scenarios, with 1 cm in either or both perpendicular and parallel directions. The classification accuracies with PI framework were not significant before and after the shift ( 0.001). The advantage of restoring performance fully in just one second made it a practical solution to improve the robustness of PR-based myoelectric control systems in a wide range of real-world applications.

Introduction of a sEMG Sensor System for Autonomous Use by Inexperienced Users

Wearable devices play an increasing role in the rehabilitation of patients with movement disorders. Although information about muscular activation is highly interesting, no approach exists that allows reliable collection of this information when the sensor is applied autonomously by the patient. This paper aims to demonstrate the proof-of-principle of an innovative sEMG sensor system, which can be used intuitively by patients while detecting their muscular activation with sufficient accuracy. The sEMG sensor system utilizes a multichannel approach based on 16 sEMG leads arranged circularly around the limb. Its design enables a stable contact between the skin surface and the system's dry electrodes, fulfills the SENIAM recommendations regarding the electrode size and inter-electrode distance and facilitates a high temporal resolution. The proof-of-principle was demonstrated by elbow flexion/extension movements of 10 subjects, proving that it has root mean square values and a signal-to-noise ratio comparable to commercial systems based on pre-gelled electrodes. Furthermore, it can be easily placed and removed by patients with reduced arm function and without detailed knowledge about the exact positioning of the sEMG electrodes. With its features, the demonstration of the sEMG sensor system's proof-of-principle positions it as a wearable device that has the potential to monitor muscular activation in home and community settings.

EMG Characterization and Processing in Production Engineering

Electromyography (EMG) signals are biomedical signals that measure electrical currents generated during muscle contraction. These signals are strongly influenced by physiological and anatomical characteristics of the muscles and represent the neuromuscular activities of the human body. The evolution of EMG analysis and acquisition techniques makes this technology more reliable for production engineering applications, overcoming some of its inherent issues. Taking as an example, the fatigue monitoring of workers as well as enriched human–machine interaction (HMI) systems used in collaborative tasks are now possible with this technology. The main objective of this research is to evaluate the current implementation of EMG technology within production engineering, its weaknesses, opportunities, and synergies with other technologies, with the aim of developing more natural and efficient HMI systems that could improve the safety and productivity within production environments.

Dry Epidermal Electrodes Can Provide Long-Term High Fidelity Electromyography for Limited Dynamic Lower Limb Movements

Due to the limitations of standard wet Silver/Silver Chloride (Ag/AgCl) hydrogel electrodes and the growing demand for long-term high fidelity surface electromyography (EMG) recording, dry epidermal electrodes are of great interest. Evaluating the usability and signal fidelity of dry epidermal electrodes could help determine the extent of potential applications using EMG electrodes. We collected EMG signals over eight days from the right rectus femoris of seven subjects using single-use dry epidermal electrodes and traditional Ag/AgCl electrodes while covered and uncovered during dynamic movements (leg extension, sit-to-stand, and treadmill walking at 0.75 m/s and 1.30 m/s). We quantified signal fidelity using signal-to-noise ratio (SNR); signal-to-motion ratio (SMR); and a metric we previously developed, the Signal Quality Index, which considers that better EMG signal quality requires both good signal-to-noise ratio and good signal-to-motion ratio. Wear patterns over the eight days degraded EMG signal quality. Uncovered epidermal electrodes that remained intact and maintained good adhesion to the skin had signal-to-noise ratios, signal-to-motion ratios, and Signal Quality Index values that were above the acceptable thresholds for limited dynamic lower limb movements (leg extension and sit-to-stand). This indicated that dry epidermal electrodes could provide good signal quality across all subjects for five days for these movements. For walking, the signal-to-noise ratios of the uncovered epidermal electrodes were still above the acceptable threshold, but signal-to-motion ratios and the Signal Quality Index values were far below the acceptable thresholds. The signal quality of the epidermal electrodes that showed no visible wear was stable over five days. As expected, covering the epidermal electrodes improved signal quality, but only for limited dynamic lower limb movements. Overall, single-use dry epidermal electrodes were able to maintain high signal quality for long-term EMG recording during limited dynamic lower limb movements, but further improvement is needed to reduce motion artifacts for whole body dynamic movements such as walking.

Analysis of Influence of Segmentation, Features, and Classification in sEMG Processing: A Case Study of Recognition of Brazilian Sign Language Alphabet

Sign Language recognition systems aid communication among deaf people, hearing impaired people, and speakers. One of the types of signals that has seen increased studies and that can be used as input for these systems is surface electromyography (sEMG). This work presents the recognition of a set of alphabet gestures from Brazilian Sign Language (Libras) using sEMG acquired from an armband. Only sEMG signals were used as input. Signals from 12 subjects were acquired using a MyoTM armband for the 26 signs of the Libras alphabet. Additionally, as the sEMG has several signal processing parameters, the influence of segmentation, feature extraction, and classification was considered at each step of the pattern recognition. In segmentation, window length and the presence of four levels of overlap rates were analyzed, as well as the contribution of each feature, the literature feature sets, and new feature sets proposed for different classifiers. We found that the overlap rate had a high influence on this task. Accuracies in the order of 99% were achieved for the following factors: segments of 1.75 s with a 12.5% overlap rate; the proposed set of four features; and random forest (RF) classifiers.

Silent Speech Decoding Using Spectrogram Features Based on Neuromuscular Activities

Silent speech decoding is a novel application of the Brain-Computer Interface (BCI) based on articulatory neuromuscular activities, reducing difficulties in data acquirement and processing. In this paper, spatial features and decoders that can be used to recognize the neuromuscular signals are investigated. Surface electromyography (sEMG) data are recorded from human subjects in mimed speech situations. Specifically, we propose to utilize transfer learning and deep learning methods by transforming the sEMG data into spectrograms that contain abundant information in time and frequency domains and are regarded as channel-interactive. For transfer learning, a pre-trained model of Xception on the large image dataset is used for feature generation. Three deep learning methods, Multi-Layer Perception, Convolutional Neural Network and bidirectional Long Short-Term Memory, are then trained using the extracted features and evaluated for recognizing the articulatory muscles' movements in our word set. The proposed decoders successfully recognized the silent speech and bidirectional Long Short-Term Memory achieved the best accuracy of 90%, outperforming the other two algorithms. Experimental results demonstrate the validity of spectrogram features and deep learning algorithms.

Hybrid Encoder-Decoder Deep Networks for Decoding Neural Drive Information towards Precise Muscle Force Estimation

How to utilize and interpret microscopic motor unit (MU) activities after surface electromyogram (sEMG) decomposition towards accurate decoding of the neural control remains a great challenge. In this study, a novel framework of hybrid encoder-decoder deep networks is proposed to process the microscopic neural drive information and it is applied to precise muscle force estimation. After a high-density sEMG (HD-sEMG) decomposition was performed using the progressive FastICA peel-off algorithm, a muscle twitch force model was then applied to basically convert each channel's electric waveform (i.e., action potential) of each MU into a twitch force. Next, hybrid encoder-decoder deep networks were performed on every 50 ms of segment of the summation of twitch force trains from all decomposed MUs. The encoder network was designed to characterize spatial information of MU's force contribution over all channels, and the decoder network finally decoded the muscle force. This framework was validated on HD-sEMG recordings from the abductor pollicis brevis muscles of five subjects by a thumb abduction task using an 8 × 8 grid. The proposed framework yielded a mean root mean square error of 6.62% ± 1.26% and a mean coefficient of determination value of 0.95 ± 0.03 from a linear regression analysis between the estimated force and actual force over all data trials, and it outperformed three common methods with statistical significance (p < 0.001). This study offers a valuable solution for interpreting microscopic neural drive information and demonstrates its success in predicting muscle force.

Exploiting the Intertemporal Structure of the Upper-Limb sEMG: Comparisons between an LSTM Network and Cross-Sectional Myoelectric Pattern Recognition Methods

The use of natural myoelectric interfaces promises great value for a variety of potential applications, clinical and otherwise, provided a computational mapping between measured neuromuscular activity and executed motion can be approximated to a satisfactory degree. However, prevalent methods intended for such decoding of movement intent from the surface electromyogram (sEMG) based on pattern recognition typically do not capitalize on the inherently time series-like nature of the acquired signals. In this paper, we present the results from a comparative study in which the performances of traditional cross-sectional pattern recognition methods were compared with that of a classifier built on the natural assumption of temporal ordering by utilizing a long short-term memory (LSTM) neural network. The resulting evaluation indicate that the LSTM approach outperforms traditional gesture recognition techniques which are based on cross-sectional inference. These findings held both when the LSTM classifier operated on conventional features and on raw sEMG and for both healthy subjects and transradial amputees.