sEMG Signal Acquisition Strategy towards Hand FES Control

Transformer-based hand gesture recognition from instantaneous to fused neural decomposition of high-density EMG signals

Designing efficient and labor-saving prosthetic hands requires powerful hand gesture recognition algorithms that can achieve high accuracy with limited complexity and latency. In this context, the paper proposes a Compact Transformer-based Hand Gesture Recognition framework referred to as [Formula: see text], which employs a vision transformer network to conduct hand gesture recognition using high-density surface EMG (HD-sEMG) signals. Taking advantage of the attention mechanism, which is incorporated into the transformer architectures, our proposed [Formula: see text] framework overcomes major constraints associated with most of the existing deep learning models such as model complexity; requiring feature engineering; inability to consider both temporal and spatial information of HD-sEMG signals, and requiring a large number of training samples. The attention mechanism in the proposed model identifies similarities among different data segments with a greater capacity for parallel computations and addresses the memory limitation problems while dealing with inputs of large sequence lengths. [Formula: see text] can be trained from scratch without any need for transfer learning and can simultaneously extract both temporal and spatial features of HD-sEMG data. Additionally, the [Formula: see text] framework can perform instantaneous recognition using sEMG image spatially composed from HD-sEMG signals. A variant of the [Formula: see text] is also designed to incorporate microscopic neural drive information in the form of Motor Unit Spike Trains (MUSTs) extracted from HD-sEMG signals using Blind Source Separation (BSS). This variant is combined with its baseline version via a hybrid architecture to evaluate potentials of fusing macroscopic and microscopic neural drive information. The utilized HD-sEMG dataset involves 128 electrodes that collect the signals related to 65 isometric hand gestures of 20 subjects. The proposed [Formula: see text] framework is applied to 31.25, 62.5, 125, 250 ms window sizes of the above-mentioned dataset utilizing 32, 64, 128 electrode channels. Our results are obtained via 5-fold cross-validation by first applying the proposed framework on the dataset of each subject separately and then, averaging the accuracies among all the subjects. The average accuracy over all the participants using 32 electrodes and a window size of 31.25 ms is 86.23%, which gradually increases till reaching 91.98% for 128 electrodes and a window size of 250 ms. The [Formula: see text] achieves accuracy of 89.13% for instantaneous recognition based on a single frame of HD-sEMG image. The proposed model is statistically compared with a 3D Convolutional Neural Network (CNN) and two different variants of Support Vector Machine (SVM) and Linear Discriminant Analysis (LDA) models. The accuracy results for each of the above-mentioned models are paired with their precision, recall, F1 score, required memory, and train/test times. The results corroborate effectiveness of the proposed [Formula: see text] framework compared to its counterparts.

Inter-rater and intra-rater reliability of isotonic exercise monitoring device for measuring active knee extension

Background

The goal of this study was to assess the reliability of electromyography and range of motion measurements obtained using a knee exercise monitoring system. This device was developed to collect data on knee exercise activities.

Methods

Twenty healthy individuals performed isotonic quadriceps exercises in this study. The vastus medialis surface electromyography (sEMG) and range of motion (ROM) of the knee were recorded during the exercise using the isotonic knee exercise monitoring device, the Mobi6-6b, and a video camera system. Each subject underwent a second measuring session at least 24 h after the first session. To determine reliability, the intraclass correlation coefficients (ICCs) and standard error of measurement (SEM) at the 95% confidence interval were calculated, and a Bland-Altman analysis was performed.

Results

For inter-rater reliability, the ICCs of the mean absolute value (MAV) and root mean square (RMS) of sEMG were 0.73 (0.49, 0.86) and 0.79 (0.61, 0.89), respectively. ROM had an ICC of 0.93 (0.02, 0.98). The intra-rater reliability of the MAV of the sEMG was 0.89 (0.71, 0.96) and the intra-rater reliability of RMS of the sEMG was 0.88 (0.70, 0.95). The ROM between days had an intra-rater reliability of 0.82 (0.54, 0.93). The Bland-Altman analysis demonstrated no systematic bias in the MAV and RMS of sEMG, but revealed a small, systematic bias in ROM (-0.8311 degrees).

Conclusion

For sEMG and range of motion measures, the isotonic knee exercise monitoring equipment revealed moderate to excellent inter- and intra-rater agreement. However, the confidence interval of ROM inter-rater reliability was quite large, indicating a small agreement bias; hence, the isotonic knee exercise monitor may not be suitable for measuring ROM. This isotonic knee exercise monitor could detect and collect information on a patient's exercise activity for the benefit of healthcare providers.

Cross-Platform Implementation of an SSVEP-Based BCI for the Control of a 6-DOF Robotic Arm

Robotics has been successfully applied in the design of collaborative robots for assistance to people with motor disabilities. However, man-machine interaction is difficult for those who suffer severe motor disabilities. The aim of this study was to test the feasibility of a low-cost robotic arm control system with an EEG-based brain-computer interface (BCI). The BCI system relays on the Steady State Visually Evoked Potentials (SSVEP) paradigm. A cross-platform application was obtained in C++. This C++ platform, together with the open-source software Openvibe was used to control a Stäubli robot arm model TX60. Communication between Openvibe and the robot was carried out through the Virtual Reality Peripheral Network (VRPN) protocol. EEG signals were acquired with the 8-channel Enobio amplifier from Neuroelectrics. For the processing of the EEG signals, Common Spatial Pattern (CSP) filters and a Linear Discriminant Analysis classifier (LDA) were used. Five healthy subjects tried the BCI. This work allowed the communication and integration of a well-known BCI development platform such as Openvibe with the specific control software of a robot arm such as Stäubli TX60 using the VRPN protocol. It can be concluded from this study that it is possible to control the robotic arm with an SSVEP-based BCI with a reduced number of dry electrodes to facilitate the use of the system.

Embedded Bio-Mimetic System for Functional Electrical Stimulation Controlled by Event-Driven sEMG

The analysis of the surface ElectroMyoGraphic (sEMG) signal for controlling the Functional Electrical Stimulation (FES) therapy is being widely accepted as an active rehabilitation technique for the restoration of neuro-muscular disorders. Portability and real-time functionalities are major concerns, and, among others, two correlated challenges are the development of an embedded system and the implementation of lightweight signal processing approaches. In this respect, the event-driven nature of the Average Threshold Crossing (ATC) technique, considering its high correlation with the muscle force and the sparsity of its representation, could be an optimal solution. In this paper we present an embedded ATC-FES control system equipped with a multi-platform software featuring an easy-to-use Graphical User Interface (GUI). The system has been first characterized and validated by analyzing CPU and memory usage in different operating conditions, as well as measuring the system latency (fulfilling the real-time requirements with a 140 ms FES definition process). We also confirmed system effectiveness, testing it on 11 healthy subjects: The similarity between the voluntary movement and the stimulate one has been evaluated, computing the cross-correlation coefficient between the angular signals acquired during the limbs motion. We obtained high correlation values of 0.87 ± 0.07 and 0.93 ± 0.02 for the elbow flexion and knee extension exercises, respectively, proving good stimulation application in real therapy-scenarios.

Comparison of muscle synergies extracted from both legs during cycling at different mechanical conditions

Muscle synergies are the building blocks for generating movement by the central nervous system (CNS). According to this hypothesis, CNS decreases the complexity of motor control by combination of a small number of muscle synergies. The aim of this work is to investigate similarity of muscle synergies during cycling across various mechanical conditions. Twenty healthy subjects performed three 6- min cycling tasks at over a range of rotational speed (40, 50, and 60 rpm) and resistant torque (3, 5, and 7 N/m). Surface electromyography (sEMG) signals were recorded during pedaling from eight muscles of the right and left legs. We extracted four synchronous muscle synergies by using the non-negative matrix factorization (NMF) method. Mean and standard deviation of the goodness of the signal reconstruction (R²) for all subjects was obtained 0.9898 ± 0.0535. We investigated the functional roles of both leg muscles during cycling by synchronous muscle synergy extraction. We compared the muscle synergies extracted from all subjects in all mechanical conditions. The total mean and standard deviation of the similarity of synergy vectors for all subjects in all mechanical conditions was obtained 0.8788 ± 0.0709. We found the high degrees of similarity among the sets of synchronous muscle synergies across mechanical conditions and also across different subjects. Our results demonstrated that different subjects at different mechanical conditions use the same motor control strategies for cycling, despite inter-individual variability of muscle patterns.