HD-sEMG-based research on activation heterogeneity of skeletal muscles and the joint force estimation during elbow flexion

A robust HD-sEMG sensor suitable for convenient acquisition of muscle activity in clinical post-stroke dysphagia

Objective.A flexible high-density surface electromyography (HD-sEMG) sensor combined with an adaptive algorithm was used to collect and analyze the swallowing activities of patients with Post-stroke dysphagia.Approach.The electrode frame, modified electrode, and bonded substrate of the sensor were fabricated using a flexible printed circuit process, controlled drop coating, and molding, respectively. The adaptation algorithm was achieved by using Laplace and Teager-Kaiser energy operators to extract active segments, a cross-correlation coefficient matrix (CCCM) to evaluate synergy, and multi-frame real-time dynamic root mean square (RMS) to visualize spatiotemporal information to screen lesions and level of dysphagia. Finally, support vector machines (SVM) were adopted to explore the classification accuracy of sex, age, and lesion location with small sample sizes.Main results.The sensor not only has a basic low contact impedance (0.262 kΩ) and high signal-to-noise ratio (37.284 ± 1.088 dB) but also achieves other characteristics suitable for clinical applications, such as flexibility (747.67 kPa) and durability (1000 times) balance, simple operation (including initial, repeated, and replacement use), and low cost ($ 15.2). The three conclusions are as follows. CCCM can be used as a criterion for judging the unbalanced muscle region of the patient's neck and can accurately locate unbalanced muscles. The RMS cloud map provides the time consumption, swallowing times, and unbalanced areas. When the lesion location involves the left and right hemispheres simultaneously, it can be used as an evidence of relatively severely unbalanced areas. The classification accuracy of SVM in terms of sex, age, and lesion location was as high as 100%.Significance.The HD-sEMG sensor in this study and the adaptation algorithm will contribute to the establishment of a larger-scale database in the future to establish more detailed and accurate quantitative standards, which will be the basis for developing more optimized screening mechanisms and rehabilitation assessment methods.

Natural grasping movement recognition and force estimation using electromyography

Electromyography (EMG) generated by human hand movements is usually used to decode different action types with high accuracy. However, the classifications of the gestures rarely consider the impact of force, and the estimation of the grasp force when performing natural grasping movements is so far overlooked. Decoding natural grasping movements and estimating the force generated by the associated movements can help patients to improve the accuracy of prosthesis control. This study mainly focused on two aspects: the classification of four natural grasping movements and the force estimation of these actions. For this purpose, we designed an experimental platform where subjects could perform four common natural grasping movements in daily life, including pinch, palmar, twist, and plug grasp, to complete target profiles. On the one hand, the results showed that, for natural grasping movements with different levels of force (three levels at 20, 50, and 80%), the average accuracy could reach from 91.43 to 97.33% under five classification schemes. On the other hand, the feasibility of force estimation for natural grasping movements was demonstrated. Furthermore, in the process of force estimation, we confirmed that the regression performance about plug grasp was the best, and the average R2 could reach 0.9082. Besides, we found that the regression results were affected by the speed of force application. These findings contribute to the natural control of myoelectric prosthesis and the EMG-based rehabilitation training system, improving the user’s experience and acceptance.

Continuous Estimation of Finger and Wrist Joint Angles Using a Muscle Synergy Based Musculoskeletal Model

Recently, many muscle synergy-based human motion prediction models and algorithms have been proposed. In this study, the muscle synergies extracted from electromyography (EMG) data were used to construct a musculoskeletal model (MSM) to predict the joint angles of the wrist, thumb, index finger, and middle finger. EMG signals were analyzed using independent component analysis to reduce signal noise and task-irrelevant artifacts. The weights of each independent component (IC) were converted into a heat map related to the motion pattern and compared with human anatomy to find a different number of ICs matching the motion pattern. Based on the properties of the MSM, non-negative matrix factorization was used to extract muscle synergies from selected ICs that represent the extensor and flexor muscle groups. The effects of these choices on the prediction accuracy was also evaluated. The performance of the model was evaluated using the correlation coefficient (CC) and normalized root-mean-square error (NRMSE). The proposed method has a higher prediction accuracy than those of traditional methods, with an average CC of 92.0% and an average NRMSE of 10.7%.

Optimal strategy of sEMG feature and measurement position for grasp force estimation

Grasp force estimation based on surface electromyography (sEMG) is essential for the dexterous control of a prosthetic hand. Nowadays, although increasing the number of sEMG measurement positions and extracting more features are common methods to increase the accuracy of grasp force estimation, it will increase the computational burden. In this paper, an approach based on analysis of variance (ANOVA) and generalized regression neural network (GRNN) for optimal measurement positions and features is proposed, with the purpose of using fewer measurement positions or features to achieve higher estimation accuracy. Firstly, we captured six channels of sEMG from subjects’ forearm and grasp force synchronously. Then, four kinds of features in time domain are extracted from each channel of sEMG. By combining different measurement position sets (MPSs) and feature set (FSs), we construct 945 data sets. These data sets are fed to GRNN to realize grasp force estimation. Normalized root mean square error (NRMS), normalized mean of absolute error (NMAE), and correlation coefficient (CC) between estimated grasp force and actual force are introduced to evaluate the performance of grasp force estimation. Finally, ANOVA and Tukey HSD testing are introduced to analyze grasp force estimation results so as to obtain the optimal measurement positions and features. We obtain the optimal MPSs for grasp force estimation when different FSs are employed, and the optimal FSs when different MPSs are utilized.

Adaptive Electrode Calibration Method Based on Muscle Core Activation Regions and Its Application in Myoelectric Pattern Recognition

To reduce the bad effect of electrode shifts on myoelectric pattern recognition, this paper presents an adaptive electrode calibration method based on core activation regions of muscles. In the proposed method, the high-density surface electromyography (HD-sEMG) matrix collected during hand gesture execution is decomposed into source signal matrix and mixed coefficient matrix by fast independent component analysis algorithm firstly. The mixed coefficient vector whose source signal has the largest two-norm energy is selected as the major pattern, and core activation region of muscles is extracted by traversing the major pattern periodically using a sliding window. The electrode calibration is realized by aligning the core activation regions in unsupervised way. Gestural HD-sEMG data collection experiments with known and unknown electrode shifts are carried out on 9 gestures and 11 participants. A CNN+LSTM-based network is constructed and two network training strategies are adopted for the recognition task. The experimental results demonstrate the effectiveness of the proposed method in mitigating the bad effect of electrode shifts on gesture recognition accuracy and the potentials in reducing user training burden of myoelectric control systems. With the proposed electrode calibration method, the overall gesture recognition accuracies increase about (5.72~7.69)%. In specific, the average recognition accuracy increases (13.32~17.30)% when using only one batch of data in data diversity strategy, and increases (12.01~13.75)% when using only one repetition of each gesture in model update strategy. The proposed electrode calibration algorithm can be extended and applied to improve the robustness of myoelectric control system.

Muscle Force Estimation Based on Neural Drive Information From Individual Motor Units

Estimation of muscle contraction force based on the macroscopic feature of surface electromyography (SEMG) has been widely reported, but the use of microscopic neural drive information has not been thoroughly investigated. In this study, a novel method is proposed to process individual motor unit (MU) activities (firing sequences and action potential waveforms) derived from the decomposition of high density SEMG (HD-SEMG), and it is applied to muscle force estimation. In the proposed method, a supervised machine learning approach was conducted to determine the twitch force of each MU according to its action potential waveforms, which enables separate calculation of every MU's contribution to force. Thus, the muscle force was predicted through a physiologically meaningful muscle force model. In the experiment, HD-SEMG data were recorded from the abductor pollicis brevis muscles of eight healthy subjects during their performance of thumb abduction with the force increasing gradually from zero to four force levels (10%, 20%, 30%, 40% of the maximal voluntary contraction), while the true muscle force was measured simultaneously. When the proposed method was used, the root mean square difference (RMSD) of the error of the estimated force with respect to the measured force was reported to be 8.3% ± 2.8%. The proposed method also significantly outperformed the other four common methods for force estimation (RMSD: from 11.7% to 20%, ), demonstrating its effectiveness. This study offers a useful tool for exploiting the neural drive information towards muscle force estimation with improved precision. The proposed method has wide applications in precise motor control, sport and rehabilitation medicine.

Spatial filtering for enhanced high-density surface electromyographic examination of neuromuscular changes and its application to spinal cord injury

Background

Spatial filtering of multi-channel signals is considered to be an effective pre-processing approach for improving signal-to-noise ratio. The use of spatial filtering for preprocessing high-density (HD) surface electromyogram (sEMG) helps to extract critical spatial information, but its application to non-invasive examination of neuromuscular changes have not been well investigated.

Methods

Aimed at evaluating how spatial filtering can facilitate examination of muscle paralysis, three different spatial filtering methods are presented using principle component analysis (PCA) algorithm, non-negative matrix factorization (NMF) algorithm, and both combination, respectively. Their performance was evaluated in terms of diagnostic power, through HD-sEMG clustering index (CI) analysis of neuromuscular changes in paralyzed muscles following spinal cord injury (SCI).

Results

The experimental results showed that: (1) The CI analysis of conventional single-channel sEMG can reveal complex neuromuscular changes in paralyzed muscles following SCI, and its diagnostic power has been confirmed to be characterized by the variance of Z scores; (2) the diagnostic power was highly dependent on the location of sEMG recording channel. Directly averaging the CI diagnostic indicators over channels just reached a medium level of the diagnostic power; (3) the use of either PCA-based or NMF-based filtering method yielded a greater diagnostic power, and their combination could even enhance the diagnostic power significantly.

Conclusions

This study not only presents an essential preprocessing approach for improving diagnostic power of HD-sEMG, but also helps to develop a standard sEMG preprocessing pipeline, thus promoting its widespread application.

High-density surface electromyography signals during isometric contractions of elbow muscles of healthy humans

This paper presents a dataset of high-density surface EMG signals (HD-sEMG) designed to study patterns of sEMG spatial distribution over upper limb muscles during voluntary isometric contractions. Twelve healthy subjects performed four different isometric tasks at different effort levels associated with movements of the forearm. Three 2-D electrode arrays were used for recording the myoelectric activity from five upper limb muscles: biceps brachii, triceps brachii, anconeus, brachioradialis, and pronator teres. Technical validation comprised a signals quality assessment from outlier detection algorithms based on supervised and non-supervised classification methods. About 6% of the total number of signals were identified as "bad" channels demonstrating the high quality of the recordings. In addition, spatial and intensity features of HD-sEMG maps for identification of effort type and level, have been formulated in the framework of this database, demonstrating better performance than the traditional time-domain features. The presented database can be used for pattern recognition and MUAP identification among other uses.

Online Grasp Force Estimation From the Transient EMG

Myoelectric upper limb prostheses are controlled using information from the electrical activity of residual muscles (i.e. the electromyogram, EMG). EMG patterns at the onset of a contraction (transient phase) have shown predictive information about upcoming grasps. However, decoding this information for the estimation of the grasp force was so far overlooked. In a previous offline study, we proved that the transient phase of the EMG indeed contains information about the grasp force and determined the best algorithm to extract this information. Here we translated those findings into an online platform to be tested with both non-amputees and amputees. The platform was tested during a pick and lift task (tri-digital grasp) with light objects (200 g - 1 kg), for which fine control of the grasp force is more important. Results show that, during this task, it is possible to estimate the target grasp force with an absolute error of 2.06 (1.32) % and 2.04 (0.49) % the maximum voluntary force for non-amputee and amputees, respectively, using information from the transient phase of the EMG. This approach would allow for a biomimetic regulation of the grasp force of a prosthetic hand. Indeed, the users could contract their muscles only once before the grasp begins with no need to modulate the grasp force for the whole duration of the grasp, as required with continuous classifiers. These results pave the way to fast, intuitive and robust myoelectric controllers of limb prostheses.

Upper Limb End-Effector Force Estimation During Multi-Muscle Isometric Contraction Tasks Using HD-sEMG and Deep Belief Network

In this study, research was carried out on the end-effector force estimation of two representative multi-muscle contraction tasks: elbow flexion and palm-pressing. The aim was to ascertain whether an individual muscle or a combination of muscles is more suitable for the end-effector force estimation. High-density surface electromyography (HD-sEMG) signals were collected from four primary muscle areas of the upper arm and forearm: the biceps brachii (BB), brachialis (BR), triceps brachii (TB), brachioradialis (BRD), and extensor digitorum communis (EDC). The wrist pulling and palm-pressing forces were measured in elbow flexion and palm-pressing tasks, respectively. The deep belief network (DBN) was adopted to establish the relation between HD-sEMG and the measured force. The representative signals of the four primary areas, which were considered as the input signal of the force estimation model, were extracted by HD-sEMG using the principle component analysis (PCA) algorithm, and fed separately or together into the DBN. An index termed mean impact value (MIV) was proposed to describe the priority of different muscle groups for estimating the end-effector force. The experimental results demonstrated that, in multi-muscle isometric contraction tasks, the dominant muscles with the highest activation degree could track variations in the end-effector force more effectively, and are more suitable than a combination of muscles. The main contributions of this research are as follows: (1) To fuse the activation information from different muscles effectively, DBN was adopted to establish the relationship between HD-sEMG and the generated force, and achieved highly accurate force estimation. (2) Based on the well-trained DBN force estimation model, an index termed MIV was presented to evaluate the priority of muscles for estimating the generated force.

Investigation on the Contributions of Different Muscles to the Generated Force based on HD-sEMG and DBN

In this study, we proposed a multi-muscle contraction force estimation framework and implemented it on the elbow flexion task to explore the contributions of different muscles to integrated force at different force levels. High density surface electromyography (HD-sEMG) signals were collected from four muscle groups and the wrist pulling force was measured synchronously. The deep belief network (DBN) was adopted to establish the relationship between HD-sEMG and force. The representative signals of four primary areas, which were considered as the input signal of the force estimation model, were extracted from HD-sEMG by principle component analysis (PCA) algorithm, then fed separately or in common to the DBN to estimate the generated force. And the contributions of different muscle groups to the generated force was analyzed with an index called mean impact value (MIV). The experimental result demonstrates that in multi-muscle contraction task, not all muscles are suitable for force estimation, the force estimation accuracy obtained using only one muscle approximates even exceeds that obtained using multiple muscles, and the relative contributions of different muscle groups to the force can be obtained according to the ranking of MIVs. This scheme provides an effective method for muscle force estimation in multi-muscle contraction tasks, and can be further applied to biomechanics, sports and rehabilitation medicine.

A Novel HD-sEMG Preprocessing Method Integrating Muscle Activation Heterogeneity Analysis and Kurtosis-Guided Filtering for High-Accuracy Joint Force Estimation

This study proposes a novel preprocessing method integrating muscle activation heterogeneity analysis and kurtosis-guided filtering to realize high-accuracy surface electromyogr-aphy (sEMG)-based force estimation. A total of 10 subjects were recruited. Each subject performed isometric elbow flexion tasks at 20%, 40%, and 60% maximum voluntary contraction (MVC) target force levels, and the joint force and high-density sEMG (HD-sEMG) signals from biceps brachii and brachialis were collected synchronously. The force estimation model was built using three-order polynomial fitting technique. The input signal extraction of the force model, also named as the preprocessing of HD-sEMG signal, was carried out in the following procedures: first, HD-sEMG signals were decomposed by principal component analysis into principal components and weight vectors; second, the first several weight maps were segmented to obtain heterogeneity information by the Otsu and Moore-Neighbor tracing methods, and the principal component covering the most activated areas was selected; and last, a kurtosis-guided filter was designed to process the selected principal component to obtain the input signal. For the sake of comparison, the joint force estimation experiments based ON five preprocessing methods were conducted. The experimental results demonstrated that the proposed method obtained 52%, 53%, and 59% reduction in the mean root mean square difference at 20% MVC, 40% MVC, and 60% MVC force-level tasks, respectively, compared to the preprocessing method with the first principal component plus fixed parameter filtering. This proposed HD-sEMG pre-processing method has reliable neuromuscular electro-physiological foundation, and has good application value for realizing high-accuracy muscle/joint force estimation in the fields of rehabilitation engineering, sports biomechanics, and muscle disease diagnosis etc.

Heterogeneity Counts More than Power for HD-sEMG-Based Joint Force Estimation

The aim of the proposed work is to utilize the heterogeneity information, in input signal extraction, to improve the joint force estimation from high-density surface electromyography (HD-sEMG). For this purpose, joint force and HD-sEMG signals from biceps brachii and brachialis were collected synchronously during isometric elbow flexion. The input signal of the force model was obtained after the following procedures: first, HD-sEMG signals were decomposed by principal component analysis into principal components and weight vectors; second, the first several weight maps were segmented to obtain heterogeneity information by the Otsu and Moore-Neighbor tracing methods, and the principal component covering the most activated areas (maximum heterogeneity) was selected; and last, the selected principal component was low-pass filtered to obtain the input signal. The force model was built using a polynomial fitting technique. The conventional power-based input signal was compared with our obtained input signal. According to the obtained results, the proposed heterogeneity-based input signal can reduce the force estimation error significantly than the power-based input signal. The proposed heterogeneity-based input signal extraction methods had more neuromuscular control information and will be tested in more muscles and force tasks in future works.

Proportional myoelectric and compensating control of a cable-conduit mechanism-driven upper limb exoskeleton

Recent studies have indicated that human motion recognition based on surface electromyography (sEMG) is a reliable and natural method for achieving motion intention. However, achieving accurate estimates of intended motion using a low computational cost is the main challenge in this scenario. In this study, a proportional myoelectric and compensating control method for estimating and assisting human motion intention with a cable-conduit mechanism-driven upper limb exoskeleton was proposed. The integral signal of sEMG and its time-delayed signals were applied as a new feature vector to represent the role of sEMG, which ensured the accuracy and real-time performance of motion estimation. An integrated circuit was used to reduce time of feature extraction. A feed-forward compensator was designed to compensate for the effect of the hysteresis problem in the exoskeleton, which is inevitable when the cable-conduit mechanism was applied to reduce the exoskeleton weight. The model-free control method based on PID method and least squares support vector machine were applied to avoid calculating the complex biomechanical model of human upper limb and the dynamic model of exoskeleton. Experimental results validated the proposed method. The average values of the root-mean-square difference (RMSD) for motion estimation were 0.0579 ± 0.0085 [motion with constant pace (CP)] and 0.0845 ± 0.0137 [motion with variable pace (VP)]. The Bland-Altman analysis results showed that the estimated angle of the proposed method was consistent with the actual angle. The performance of the control method was good, and the accuracies were 98.5608% ± 0.4485% (motion with CP) and 96.6119% ± 0.6628% (motion with VP).

Spatial Reorganization of Myoelectric Activities in Extensor Digitorum for Sustained Finger Force Production

The study aims to explore the spatial distribution of multi-tendinous muscle modulated by central nervous system (CNS) during sustained contraction. Nine subjects were recruited to trace constant target forces with right index finger extension. Surface electromyography (sEMG) of extensor digitorum (ED) were recorded with a 32-channel electrode array. Nine successive topographic maps (TM) were obtained. Pixel wise analysis was utilized to extract subtracted topographic maps (STM), which exhibited inhomogeneous distribution. STMs were characterized into hot, warm, and cool regions corresponding to higher, moderate, and lower change ranges, respectively. The relative normalized area (normalized to the first phase) of these regions demonstrated different changing trends as rising, plateauing, and falling over time, respectively. Moreover, the duration of these trends were found to be affected by force level. The rising/falling periods were longer at lower force levels, while the plateau can be achieved from the initial phase for higher force output (45% maximal voluntary contraction). The results suggested muscle activity reorganization in ED plays a role to maintain sustained contraction. Furthermore, the decreased dynamical regulation ability to spatial reorganization may be prone to induce fatigue. This finding implied that spatial reorganization of muscle activity as a regulation mechanism contribute to maintain constant force production.