1
|
Li D, Kang P, Yu Y, Shull PB. Graph-Driven Simultaneous and Proportional Estimation of Wrist Angle and Grasp Force via High-Density EMG. IEEE J Biomed Health Inform 2024; 28:2723-2732. [PMID: 38442056 DOI: 10.1109/jbhi.2024.3373432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/07/2024]
Abstract
Myoelectric prostheses are generally unable to accurately control the position and force simultaneously, prohibiting natural and intuitive human-machine interaction. This issue is attributed to the limitations of myoelectric interfaces in effectively decoding multi-degree-of-freedom (multi-DoF) kinematic and kinetic information. We thus propose a novel multi-task, spatial-temporal model driven by graphical high-density electromyography (HD-EMG) for simultaneous and proportional control of wrist angle and grasp force. Twelve subjects were recruited to perform three multi-DoF movements, including wrist pronation/supination, wrist flexion/extension, and wrist abduction/adduction while varying grasp force. Experimental results demonstrated that the proposed model outperformed five baseline models, with the normalized root mean square error of 13.2% and 9.7% and the correlation coefficient of 89.6% and 91.9% for wrist angle and grasp force estimation, respectively. In addition, the proposed model still maintained comparable accuracy even with a significant reduction in the number of HD-EMG electrodes. To the best of our knowledge, this is the first study to achieve simultaneous and proportional wrist angle and grasp force control via HD-EMG and has the potential to empower prostheses users to perform a broader range of tasks with greater precision and control, ultimately enhancing their independence and quality of life.
Collapse
|
2
|
Wei Z, Zhang ZQ, Xie SQ. Continuous Motion Intention Prediction Using sEMG for Upper-Limb Rehabilitation: A Systematic Review of Model-Based and Model-Free Approaches. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1487-1504. [PMID: 38557618 DOI: 10.1109/tnsre.2024.3383857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Upper limb functional impairments persisting after stroke significantly affect patients' quality of life. Precise adjustment of robotic assistance levels based on patients' motion intentions using sEMG signals is crucial for active rehabilitation. This paper systematically reviews studies on continuous prediction of upper limb single joints and multi-joint combinations motion intention using Model-Based (MB) and Model-Free (MF) approaches over the past decade, based on 186 relevant studies screened from six major electronic databases. The findings indicate ongoing challenges in terms of subject composition, algorithm robustness and generalization, and algorithm feasibility for practical applications. Moreover, it suggests integrating the strengths of both MB and MF approaches to improve existing algorithms. Therefore, future research should further explore personalized MB-MF combination methods incorporating deep learning, attention mechanisms, muscle synergy features, motor unit features, and closed-loop feedback to achieve precise, real-time, and long-duration prediction of multi-joint complex movements, while further refining the transfer learning strategy for rapid algorithm deployment across days and subjects. Overall, this review summarizes the current research status, significant findings, and challenges, aiming to inspire future research on predicting upper limb motion intentions based on sEMG.
Collapse
|
3
|
Xu Y, Yu Y, Zhao Z, Sheng X. Decoding Multi-DoF Movements Using a CST-Based Force Generation Model With Single-DoF Training. IEEE Trans Neural Syst Rehabil Eng 2024; 32:974-982. [PMID: 38376978 DOI: 10.1109/tnsre.2024.3367742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Abstract
Recent developments in dexterous myoelectric prosthetics have established a hardware base for human-machine interfaces. Although pattern recognition techniques have seen successful deployment in gesture classification, their applications remain largely confined to certain specific discrete gestures. Addressing complex daily tasks demands an immediate need for precise simultaneous and proportional control (SPC) for multiple degrees of freedom (DoFs) movements. In this paper, we introduce an SPC approach for multi-DoF wrist movements using the cumulative spike trains (CSTs) of motor unit pools, merely leveraging single-DoF training. The efficacy of our proposed approach was validated offline against existing methods respectively based on non-negative matrix factorization and motor unit spike trains, using experimental data. The experimental process includes both single-DoF (for training) and multi-DoF (for testing) movements. We evaluated the performance using Pearson correlation coefficient (R) and the normalized root mean square error (nRMSE). The results reveal that our method outperforms comparative approaches in force estimation for both testing datasets (3 and 4). On average, for dataset 3, R and nRMSE of the flexion/extension DoF (the pronation/supination DoF) are 0.923±0.037 (0.901±0.040) and 12.3±3.1% (12.9±2.2%); similarly, those of dataset 4 are 0.865±0.057 (0.837±0.053) and 14.9±2.9% (15.4±2.0%), respectively. The outcomes demonstrate the effectiveness of our method in simultaneous and proportional force estimation for multi-DoF wrist movements, showing a promising potential as a neural-machine interface for SPC of dexterous myoelectric prostheses.
Collapse
|
4
|
Xu Y, Yu Y, Zhao Z, Chen C, Sheng X. Cumulative Spike Train Estimation for Muscle Excitation Assessment From Surface EMG Using Spatial Spike Detection. IEEE J Biomed Health Inform 2023; 27:5335-5344. [PMID: 37643108 DOI: 10.1109/jbhi.2023.3309662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Estimating cumulative spike train (CST) of motor units (MUs) from surface electromyography (sEMG) is essential for the effective control of neural interfaces. However, the limited accuracy of existing estimation methods greatly hinders the further development of neural interface. This paper proposes a simple but effective approach for identifying CST based on spatial spike detection from high-density sEMG. Specifically, we use a spatial sliding window to detect spikes according to the spatial propagation characteristics of the motor unit action potential, focusing on the spikes of activated MUs in a local area rather than those of a specific MU. We validated the effectiveness of our proposed method through an experiment involving wrist flexion/extension and pronation/supination, comparing it with a recognized CST estimation method and an MU decomposition based method. The results demonstrated that the proposed method obtained higher accuracy on multi-DoF wrist torque estimation leveraging the estimated CST compared to the other three methods. On average, the correlation coefficient (R) and the normalized root mean square error (nRMSE) between the estimation results and recorded force were 0.96 ± 0.03 and 10.1% ± 3.7%, respectively. Moreover, there was an extremely high interpretive extent between the CSTs of proposed method and the MU decomposition method. The outcomes reveal the superiority of the proposed method in identifying CSTs and can provide promising driven signals for neural interface.
Collapse
|
5
|
Xia M, Chen C, Xu Y, Li Y, Sheng X, Ding H. Extracting Individual Muscle Drive and Activity From High-Density Surface Electromyography Signals Based on the Center of Gravity of Motor Unit. IEEE Trans Biomed Eng 2023; 70:2852-2862. [PMID: 37043313 DOI: 10.1109/tbme.2023.3266575] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/13/2023]
Abstract
Neural interfacing has played an essential role in advancing our understanding of fundamental movement neurophysiology and the development of human-machine interface. However, direct neural interfaces from brain and nerve recording are currently limited in clinical areas for their invasiveness and high selectivity. Here, we applied the surface electromyogram (EMG) in studying the neural control of movement and proposed a new non-invasive way of extracting neural drive to individual muscles. Sixteen subjects performed isometric contractions to complete six hand tasks. High-density surface EMG signals (256 channels in total) recorded from the forearm muscles were decomposed into motor unit firing trains. The location of each decomposed motor unit was represented by its center of gravity and was put into clustering for distinct muscle regions. All the motor units in the same cluster served as a muscle-specific motor pool from which individual muscle drive could be extracted directly. Moreover, we cross-validated the self-clustered muscle regions by magnetic resonance imaging (MRI) recorded from the subjects' forearms. All motor units that fall within the MRI region are considered correctly clustered. We achieved a clustering accuracy of 95.72% ± 4.01% for all subjects. We provided a new framework for collecting experimental muscle-specific drives and generalized the way of surface electrode placement without prior knowledge of the targeting muscle architecture.
Collapse
|
6
|
Chen C, Ma S, Sheng X, Zhu X. A peel-off convolution kernel compensation method for surface electromyography decomposition. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
7
|
Chen Z, Min H, Wang D, Xia Z, Sun F, Fang B. A Review of Myoelectric Control for Prosthetic Hand Manipulation. Biomimetics (Basel) 2023; 8:328. [PMID: 37504216 PMCID: PMC10807628 DOI: 10.3390/biomimetics8030328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 07/14/2023] [Accepted: 07/19/2023] [Indexed: 07/29/2023] Open
Abstract
Myoelectric control for prosthetic hands is an important topic in the field of rehabilitation. Intuitive and intelligent myoelectric control can help amputees to regain upper limb function. However, current research efforts are primarily focused on developing rich myoelectric classifiers and biomimetic control methods, limiting prosthetic hand manipulation to simple grasping and releasing tasks, while rarely exploring complex daily tasks. In this article, we conduct a systematic review of recent achievements in two areas, namely, intention recognition research and control strategy research. Specifically, we focus on advanced methods for motion intention types, discrete motion classification, continuous motion estimation, unidirectional control, feedback control, and shared control. In addition, based on the above review, we analyze the challenges and opportunities for research directions of functionality-augmented prosthetic hands and user burden reduction, which can help overcome the limitations of current myoelectric control research and provide development prospects for future research.
Collapse
Affiliation(s)
- Ziming Chen
- Laboratory for Embedded System and Intelligent Robot, Wuhan University of Science and Technology, Wuhan 430081, China; (Z.C.); (H.M.)
| | - Huasong Min
- Laboratory for Embedded System and Intelligent Robot, Wuhan University of Science and Technology, Wuhan 430081, China; (Z.C.); (H.M.)
| | - Dong Wang
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Ziwei Xia
- School of Engineering and Technology, China University of Geosciences, Beijing 100083, China
| | - Fuchun Sun
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Bin Fang
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| |
Collapse
|
8
|
Keleş AD, Türksoy RT, Yucesoy CA. The use of nonnormalized surface EMG and feature inputs for LSTM-based powered ankle prosthesis control algorithm development. Front Neurosci 2023; 17:1158280. [PMID: 37465585 PMCID: PMC10351874 DOI: 10.3389/fnins.2023.1158280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 06/14/2023] [Indexed: 07/20/2023] Open
Abstract
Advancements in instrumentation support improved powered ankle prostheses hardware development. However, control algorithms have limitations regarding number and type of sensors utilized and achieving autonomous adaptation, which is key to a natural ambulation. Surface electromyogram (sEMG) sensors are promising. With a minimized number of sEMG inputs an economic control algorithm can be developed, whereas limiting the use of lower leg muscles will provide a practical algorithm for both ankle disarticulation and transtibial amputation. To determine appropriate sensor combinations, a systematic assessment of the predictive success of variations of multiple sEMG inputs in estimating ankle position and moment has to conducted. More importantly, tackling the use of nonnormalized sEMG data in such algorithm development to overcome processing complexities in real-time is essential, but lacking. We used healthy population level walking data to (1) develop sagittal ankle position and moment predicting algorithms using nonnormalized sEMG, and (2) rank all muscle combinations based on success to determine economic and practical algorithms. Eight lower extremity muscles were studied as sEMG inputs to a long-short-term memory (LSTM) neural network architecture: tibialis anterior (TA), soleus (SO), medial gastrocnemius (MG), peroneus longus (PL), rectus femoris (RF), vastus medialis (VM), biceps femoris (BF) and gluteus maximus (GMax). Five features extracted from nonnormalized sEMG amplitudes were used: integrated EMG (IEMG), mean absolute value (MAV), Willison amplitude (WAMP), root mean square (RMS) and waveform length (WL). Muscle and feature combination variations were ranked using Pearson's correlation coefficient (r > 0.90 indicates successful correlations), the root-mean-square error and one-dimensional statistical parametric mapping between the original data and LSTM response. The results showed that IEMG+WL yields the best feature combination performance. The best performing variation was MG + RF + VM (rposition = 0.9099 and rmoment = 0.9707) whereas, PL (rposition = 0.9001, rmoment = 0.9703) and GMax+VM (rposition = 0.9010, rmoment = 0.9718) were distinguished as the economic and practical variations, respectively. The study established for the first time the use of nonnormalized sEMG in control algorithm development for level walking.
Collapse
Affiliation(s)
- Ahmet Doğukan Keleş
- Institute of Biomedical Engineering, Boğaziçi University, Istanbul, Türkiye
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
| | - Ramazan Tarık Türksoy
- Institute of Biomedical Engineering, Boğaziçi University, Istanbul, Türkiye
- Huawei Turkey R&D Center, Istanbul, Türkiye
| | - Can A. Yucesoy
- Institute of Biomedical Engineering, Boğaziçi University, Istanbul, Türkiye
| |
Collapse
|
9
|
Jiang N, Chen C, He J, Meng J, Pan L, Su S, Zhu X. Bio-robotics research for non-invasive myoelectric neural interfaces for upper-limb prosthetic control: a 10-year perspective review. Natl Sci Rev 2023; 10:nwad048. [PMID: 37056442 PMCID: PMC10089583 DOI: 10.1093/nsr/nwad048] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 01/01/2023] [Accepted: 02/07/2023] [Indexed: 04/05/2023] Open
Abstract
ABSTRACT
A decade ago, a group of researchers from academia and industry identified a dichotomy between the industrial and academic state-of-the-art in upper-limb prosthesis control, a widely used bio-robotics application. They proposed that four key technical challenges, if addressed, could bridge this gap and translate academic research into clinically and commercially viable products. These challenges are unintuitive control schemes, lack of sensory feedback, poor robustness and single sensor modality. Here, we provide a perspective review on the research effort that occurred in the last decade, aiming at addressing these challenges. In addition, we discuss three research areas essential to the recent development in upper-limb prosthetic control research but were not envisioned in the review 10 years ago: deep learning methods, surface electromyogram decomposition and open-source databases. To conclude the review, we provide an outlook into the near future of the research and development in upper-limb prosthetic control and beyond.
Collapse
Affiliation(s)
| | - Chen Chen
- State Key Laboratory of Mechanical System and Vibration, and Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Jiayuan He
- National Clinical Research Center for Geriatrics, West China Hospital, and Med-X Center for Manufacturing, Sichuan University, Chengdu 610041, China
| | - Jianjun Meng
- State Key Laboratory of Mechanical System and Vibration, and Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Lizhi Pan
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, School of Mechanical Engineering, Tianjin University, Tianjin 300350, China
| | - Shiyong Su
- Institute of Neuroscience, Université Catholique Louvain, Brussel B-1348, Belgium
| | - Xiangyang Zhu
- State Key Laboratory of Mechanical System and Vibration, and Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
10
|
Chen C, Yu Y, Sheng X, Meng J, Zhu X. Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control. IEEE Trans Neural Syst Rehabil Eng 2023; 31:1807-1815. [PMID: 37030732 DOI: 10.1109/tnsre.2023.3260209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
Abstract
The surface electromyography (EMG) decomposition techniques provide access to motor neuron activities and have been applied to myoelectric control schemes. However, the current decomposition-based myoelectric control mainly focuses on discrete gestures or single-DoF continuous movements. In this study, we aimed to map the motor unit discharges, which were identified from high-density surface EMG, to the three degrees of freedom (DoFs) wrist movements. The 3-DoF wrist torques and high-density surface EMG signals were recorded concurrently from eight non-disabled subjects. The experimental protocol included single-DoF movements and their various combinations. We decoded the motor unit discharges from the EMG signals using a segment-wise decomposition algorithm. Then the neural features were extracted from motor unit discharges and projected to wrist torques with a multiple linear regression model. We compared the performance of two neural features (twitch model and spike counting) and two training schemes (single-DoF and multi-DoF training). On average, 145 ± 33 motor units were identified from each subject, with a pulse-to-noise ratio of 30.8 ± 4.2 dB. Both neural features exhibited high estimation accuracy of 3-DoF wrist torques, with an average [Formula: see text] of 0.76 ± 0.12 and normalized root mean square error of 11.4 ± 3.1%. These results demonstrated the efficiency of the proposed method in continuous estimation of 3-DoF wrist torques, which has the potential to advance dexterous myoelectric control based on neural information.
Collapse
|
11
|
Chen C, Ma S, Yu Y, Sheng X, Zhu X. Segment-Wise Decomposition of Surface Electromyography to Identify Discharges Across Motor Neuron Populations. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2012-2021. [PMID: 35853067 DOI: 10.1109/tnsre.2022.3192272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE The surface electromyography (EMG) decomposition techniques have shown promising results in neurophysiologic investigations, clinical diagnosis, and human-machine interfacing. However, current decomposition methods could only decode a limited number of motor units (MUs) because of the local convergence. The number of identified MUs remains similar even though more muscles or movements are involved, where multiple motor neuron populations are activated. The objective of this study was to develop a segment-wise decomposition strategy to increase the number of MU decoded from multiple motor neuron populations. METHODS The EMG signals were divided into several segments depending on the number of involved movements. The motor neurons, activated during each movement, were regarded as a population. The convolution kernel compensation (CKC) method was applied individually for each segment to decode the motor unit discharges from each motor neuron population. The MU filters were obtained in each segment and filtrated to estimate the MU spike trains (MUSTs) from the global EMG signals. The decomposition performance was validated on synthetic and experimental EMG signals. MAIN RESULTS From synthetic EMG signals generated by two motor neuron populations, the proposed segment-wise CKC (swCKC) decoded significantly more MUs during low and medium excitation levels, with an increased rate of 16.3% to 75.4% compared with the conventional CKC. From experimental signals recorded during ten motor tasks, 133±24 MUs with the pulse-to-noise ratio of 36.6±6.5 dB were identified for each subject by swCKC, whereas the conventional CKC identified only 43±12 MUs. CONCLUSION AND SIGNIFICANCE These results indicate the feasibility and superiority of the proposed swCKC to decode MU activities across motor neuron populations, extending the potential applications of EMG decomposition for neural decoding during multiple motor tasks.
Collapse
|