1
|
Avrillon S, Hug F, Baker SN, Gibbs C, Farina D. Tutorial on MUedit: An open-source software for identifying and analysing the discharge timing of motor units from electromyographic signals. J Electromyogr Kinesiol 2024; 77:102886. [PMID: 38761514 DOI: 10.1016/j.jelekin.2024.102886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/20/2024] Open
Abstract
We introduce the open-source software MUedit and we describe its use for identifying the discharge timing of motor units from all types of electromyographic (EMG) signals recorded with multi-channel systems. MUedit performs EMG decomposition using a blind-source separation approach. Following this, users can display the estimated motor unit pulse trains and inspect the accuracy of the automatic detection of discharge times. When necessary, users can correct the automatic detection of discharge times and recalculate the motor unit pulse train with an updated separation vector. Here, we provide an open-source software and a tutorial that guides the user through (i) the parameters and steps of the decomposition algorithm, and (ii) the manual editing of motor unit pulse trains. Further, we provide simulated and experimental EMG signals recorded with grids of surface electrodes and intramuscular electrode arrays to benchmark the performance of MUedit. Finally, we discuss advantages and limitations of the blind-source separation approach for the study of motor unit behaviour during tonic muscle contractions.
Collapse
Affiliation(s)
- Simon Avrillon
- Department of Bioengineering, Faculty of Engineering, Imperial College London, London W12 7TA, UK.
| | - François Hug
- Université Côte d'Azur, LAMHESS, Nice 06200, France; The University of Queensland, School of Biomedical Sciences, St Lucia 4072, QLD, Australia
| | - Stuart N Baker
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne NE2 4HH, UK
| | - Ciara Gibbs
- Department of Bioengineering, Faculty of Engineering, Imperial College London, London W12 7TA, UK
| | - Dario Farina
- Department of Bioengineering, Faculty of Engineering, Imperial College London, London W12 7TA, UK.
| |
Collapse
|
2
|
Ma S, Mendez Guerra I, Caillet AH, Zhao J, Clarke AK, Maksymenko K, Deslauriers-Gauthier S, Sheng X, Zhu X, Farina D. NeuroMotion: Open-source platform with neuromechanical and deep network modules to generate surface EMG signals during voluntary movement. PLoS Comput Biol 2024; 20:e1012257. [PMID: 38959262 DOI: 10.1371/journal.pcbi.1012257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 06/15/2024] [Indexed: 07/05/2024] Open
Abstract
Neuromechanical studies investigate how the nervous system interacts with the musculoskeletal (MSK) system to generate volitional movements. Such studies have been supported by simulation models that provide insights into variables that cannot be measured experimentally and allow a large number of conditions to be tested before the experimental analysis. However, current simulation models of electromyography (EMG), a core physiological signal in neuromechanical analyses, remain either limited in accuracy and conditions or are computationally heavy to apply. Here, we provide a computational platform to enable future work to overcome these limitations by presenting NeuroMotion, an open-source simulator that can modularly test a variety of approaches to the full-spectrum synthesis of EMG signals during voluntary movements. We demonstrate NeuroMotion using three sample modules. The first module is an upper-limb MSK model with OpenSim API to estimate the muscle fibre lengths and muscle activations during movements. The second module is BioMime, a deep neural network-based EMG generator that receives nonstationary physiological parameter inputs, like the afore-estimated muscle fibre lengths, and efficiently outputs motor unit action potentials (MUAPs). The third module is a motor unit pool model that transforms the muscle activations into discharge timings of motor units. The discharge timings are convolved with the output of BioMime to simulate EMG signals during the movement. We first show how MUAP waveforms change during different levels of physiological parameter variations and different movements. We then show that the synthetic EMG signals during two-degree-of-freedom hand and wrist movements can be used to augment experimental data for regressing joint angles. Ridge regressors trained on the synthetic dataset were directly used to predict joint angles from experimental data. In this way, NeuroMotion was able to generate full-spectrum EMG for the first use-case of human forearm electrophysiology during voluntary hand, wrist, and forearm movements. All intermediate variables are available, which allows the user to study cause-effect relationships in the complex neuromechanical system, fast iterate algorithms before collecting experimental data, and validate algorithms that estimate non-measurable parameters in experiments. We expect this modular platform will enable validation of generative EMG models, complement experimental approaches and empower neuromechanical research.
Collapse
Affiliation(s)
- Shihan Ma
- Department of Bioengineering, Imperial College London, London, United Kingdom
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Irene Mendez Guerra
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | | | - Jiamin Zhao
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | | | | | | | - Xinjun Sheng
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
- Meta Robotics Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Xiangyang Zhu
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
- Meta Robotics Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Dario Farina
- Department of Bioengineering, Imperial College London, London, United Kingdom
| |
Collapse
|
3
|
Zhao H, Sun Y, Wei C, Xia Y, Zhou P, Zhang X. Online prediction of sustained muscle force from individual motor unit activities using adaptive surface EMG decomposition. J Neuroeng Rehabil 2024; 21:47. [PMID: 38575926 PMCID: PMC10996136 DOI: 10.1186/s12984-024-01345-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 03/22/2024] [Indexed: 04/06/2024] Open
Abstract
Decoding movement intentions from motor unit (MU) activities to represent neural drive information plays a central role in establishing neural interfaces, but there remains a great challenge for obtaining precise MU activities during sustained muscle contractions. In this paper, we presented an online muscle force prediction method driven by individual MU activities that were decomposed from prolonged surface electromyogram (SEMG) signals in real time. In the training stage of the proposed method, a set of separation vectors was initialized for decomposing MU activities. After transferring each decomposed MU activity into a twitch force train according to its action potential waveform, a neural network was designed and trained for predicting muscle force. In the subsequent online stage, a practical double-thread-parallel algorithm was developed. One frontend thread predicted the muscle force in real time utilizing the trained network and the other backend thread simultaneously updated the separation vectors. To assess the performance of the proposed method, SEMG signals were recorded from the abductor pollicis brevis muscles of eight subjects and the contraction force was simultaneously collected. With the update procedure in the backend thread, the force prediction performance of the proposed method was significantly improved in terms of lower root mean square deviation (RMSD) of around 10% and higher fitness (R2) of around 0.90, outperforming two conventional methods. This study provides a promising technique for real-time myoelectric applications in movement control and health.
Collapse
Affiliation(s)
- Haowen Zhao
- School of Microelectronics, University of Science and Technology of China, Hefei, Anhui, 230027, China
| | - Yong Sun
- Institute of Criminal Sciences, Hefei Public Security Bureau, Hefei, Anhui, 230001, China
| | - Chengzhuang Wei
- Institute of Criminal Sciences, Hefei Public Security Bureau, Hefei, Anhui, 230001, China
| | - Yuanfei Xia
- Institute of Criminal Sciences, Hefei Public Security Bureau, Hefei, Anhui, 230001, China
| | - Ping Zhou
- Faculty of Biomedical and Rehabilitation Engineering, University of Health and Rehabilitation Sciences, Qingdao, Shandong, 266024, China
| | - Xu Zhang
- School of Microelectronics, University of Science and Technology of China, Hefei, Anhui, 230027, China.
| |
Collapse
|
4
|
Yeung D, Negro F, Vujaklija I. Adaptive HD-sEMG decomposition: towards robust real-time decoding of neural drive. J Neural Eng 2024; 21:026012. [PMID: 38479007 DOI: 10.1088/1741-2552/ad33b0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 03/13/2024] [Indexed: 03/22/2024]
Abstract
Objective. Neural interfacing via decomposition of high-density surface electromyography (HD-sEMG) should be robust to signal non-stationarities incurred by changes in joint pose and contraction intensity.Approach. We present an adaptive real-time motor unit decoding algorithm and test it on HD-sEMG collected from the extensor carpi radialis brevis during isometric contractions over a range of wrist angles and contraction intensities. The performance of the algorithm was verified using high-confidence benchmark decompositions derived from concurrently recorded intramuscular electromyography.Main results. In trials where contraction conditions between the initialization and testing data differed, the adaptive decoding algorithm maintained significantly higher decoding accuracies when compared to static decoding methods.Significance. Using "gold standard" verification techniques, we demonstrate the limitations of filter re-use decoding methods and show the necessity of parameter adaptation to achieve robust neural decoding.
Collapse
Affiliation(s)
- Dennis Yeung
- Department of Electrical Engineering and Automation, Aalto University, Espoo, Finland
| | - Francesco Negro
- Department of Clinical and Experimental Sciences, Università degli Studi di Brescia, Brescia, Italy
| | - Ivan Vujaklija
- Department of Electrical Engineering and Automation, Aalto University, Espoo, Finland
| |
Collapse
|
5
|
Wang H, Tao Q, Zhang X. Ensemble Learning Method for the Continuous Decoding of Hand Joint Angles. SENSORS (BASEL, SWITZERLAND) 2024; 24:660. [PMID: 38276352 PMCID: PMC11154387 DOI: 10.3390/s24020660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Revised: 01/16/2024] [Accepted: 01/18/2024] [Indexed: 01/27/2024]
Abstract
Human-machine interface technology is fundamentally constrained by the dexterity of motion decoding. Simultaneous and proportional control can greatly improve the flexibility and dexterity of smart prostheses. In this research, a new model using ensemble learning to solve the angle decoding problem is proposed. Ultimately, seven models for angle decoding from surface electromyography (sEMG) signals are designed. The kinematics of five angles of the metacarpophalangeal (MCP) joints are estimated using the sEMG recorded during functional tasks. The estimation performance was evaluated through the Pearson correlation coefficient (CC). In this research, the comprehensive model, which combines CatBoost and LightGBM, is the best model for this task, whose average CC value and RMSE are 0.897 and 7.09. The mean of the CC and the mean of the RMSE for all the test scenarios of the subjects' dataset outperform the results of the Gaussian process model, with significant differences. Moreover, the research proposed a whole pipeline that uses ensemble learning to build a high-performance angle decoding system for the hand motion recognition task. Researchers or engineers in this field can quickly find the most suitable ensemble learning model for angle decoding through this process, with fewer parameters and fewer training data requirements than traditional deep learning models. In conclusion, the proposed ensemble learning approach has the potential for simultaneous and proportional control (SPC) of future hand prostheses.
Collapse
Affiliation(s)
- Hai Wang
- School of Mechanical Engineering, Xinjiang University, Urumqi 830017, China; (H.W.); (X.Z.)
| | - Qing Tao
- School of Mechanical Engineering, Xinjiang University, Urumqi 830017, China; (H.W.); (X.Z.)
| | - Xiaodong Zhang
- School of Mechanical Engineering, Xinjiang University, Urumqi 830017, China; (H.W.); (X.Z.)
- Shaanxi Key Laboratory of Intelligent Robot, Xi’an Jiaotong University, Xi’an 710049, China
| |
Collapse
|
6
|
Yeung D, Negro F, Vujaklija I. Optimal Motor Unit Subset Selection for Accurate Motor Intention Decoding: Towards Dexterous Real-Time Interfacing. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4225-4234. [PMID: 37862282 DOI: 10.1109/tnsre.2023.3326065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2023]
Abstract
OBJECTIVE Motor unit (MU) discharge timings encode human motor intentions to the finest degree. Whilst tapping into such information can bring significant gains to a range of applications, current approaches to MU decoding from surface signals do not scale well with the demands of dexterous human-machine interfacing (HMI). To optimize the forward estimation accuracy and time-efficiency of such systems, we propose the inclusion of task-wise initialization and MU subset selection. METHODS Offline analyses were conducted on data recorded from 11 non-disabled subjects. Task-wise decomposition was applied to identify MUs from high-density surface electromyography (HD-sEMG) pertaining to 18 wrist/forearm motor tasks. The activities of a selected subset of MUs were extracted from test data and used for forward estimation of intended motor tasks and joint kinematics. To that end, various combinations of subset selection and estimation algorithms (both regression and classification-based) were tested for a range of subset sizes. RESULTS The mutual information-based minimum Redundancy Maximum Relevance (mRMR-MI) criterion retained MUs with the highest predicative power. When the portion of tracked MUs was reduced down to 25%, the regression performance decreased only by 3% (R2=0.79) while classification accuracy dropped by 2.7% (accuracy = 74%) when kernel-based estimators were considered. CONCLUSION AND SIGNIFICANCE Careful selection of tracked MUs can optimize the efficiency of MU-driven interfacing. In particular, prioritization of MUs exhibiting strong nonlinear relationships with target motions is best leveraged by kernel-based estimators. Hence, this frees resources for more robust and adaptive MU decoding techniques to be implemented in future.
Collapse
|
7
|
Levine J, Avrillon S, Farina D, Hug F, Pons JL. Two motor neuron synergies, invariant across ankle joint angles, activate the triceps surae during plantarflexion. J Physiol 2023; 601:4337-4354. [PMID: 37615253 PMCID: PMC10952824 DOI: 10.1113/jp284503] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2023] [Accepted: 08/10/2023] [Indexed: 08/25/2023] Open
Abstract
Recent studies have suggested that the nervous system generates movements by controlling groups of motor neurons (synergies) that do not always align with muscle anatomy. In this study, we determined whether these synergies are robust across tasks with different mechanical constraints. We identified motor neuron synergies using principal component analysis (PCA) and cross-correlations between smoothed discharge rates of motor neurons. In part 1, we used simulations to validate these methods. The results suggested that PCA can accurately identify the number of common inputs and their distribution across active motor neurons. Moreover, the results confirmed that cross-correlation can separate pairs of motor neurons that receive common inputs from those that do not receive common inputs. In part 2, 16 individuals performed plantarflexion at three ankle angles while we recorded EMG signals from the gastrocnemius lateralis (GL) and medialis (GM) and the soleus (SOL) with grids of surface electrodes. The PCA revealed two motor neuron synergies. These motor neuron synergies were relatively stable, with no significant differences in the distribution of motor neuron weights across ankle angles (P = 0.62). When the cross-correlation was calculated for pairs of motor units tracked across ankle angles, we observed that only 13.0% of pairs of motor units from GL and GM exhibited significant correlations of their smoothed discharge rates across angles, confirming the low level of common inputs between these muscles. Overall, these results highlight the modularity of movement control at the motor neuron level, suggesting a sensible reduction of computational resources for movement control. KEY POINTS: The CNS might generate movements by activating groups of motor neurons (synergies) with common inputs. We show here that two main sources of common inputs drive the motor neurons innervating the triceps surae muscles during isometric ankle plantarflexions. We report that the distribution of these common inputs is globally invariant despite changing the mechanical constraints of the tasks, i.e. the ankle angle. These results suggest the functional relevance of the modular organization of the CNS to control movements.
Collapse
Affiliation(s)
- Jackson Levine
- Legs + Walking LabShirley Ryan AbilityLabChicagoILUSA
- Department of Physical Medicine and RehabilitationFeinberg School of MedicineNorthwestern UniversityChicagoILUSA
- Department of Biomedical EngineeringMcCormick School of EngineeringNorthwestern UniversityChicagoILUSA
| | - Simon Avrillon
- Legs + Walking LabShirley Ryan AbilityLabChicagoILUSA
- Department of Physical Medicine and RehabilitationFeinberg School of MedicineNorthwestern UniversityChicagoILUSA
- Department of BioengineeringFaculty of Engineering, Imperial College LondonLondonUK
| | - Dario Farina
- Department of BioengineeringFaculty of Engineering, Imperial College LondonLondonUK
| | - François Hug
- Université Côte d'Azur, LAMHESSNiceFrance
- School of Biomedical SciencesThe University of QueenslandSt LuciaQueenslandAustralia
| | - José L. Pons
- Legs + Walking LabShirley Ryan AbilityLabChicagoILUSA
- Department of Physical Medicine and RehabilitationFeinberg School of MedicineNorthwestern UniversityChicagoILUSA
- Department of Biomedical EngineeringMcCormick School of EngineeringNorthwestern UniversityChicagoILUSA
| |
Collapse
|
8
|
Zheng Y, Ma Y, Liu Y, Houston M, Guo C, Lian Q, Li S, Zhou P, Zhang Y. High-Density Surface EMG Decomposition by Combining Iterative Convolution Kernel Compensation With an Energy-Specific Peel-off Strategy. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3641-3651. [PMID: 37656648 DOI: 10.1109/tnsre.2023.3309546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/03/2023]
Abstract
Objective- This study aims to develop a novel framework for high-density surface electromyography (HD-sEMG) signal decomposition with superior decomposition yield and accuracy, especially for low-energy MUs. Methods- An iterative convolution kernel compensation-peel off (ICKC-P) framework is proposed, which consists of three steps: decomposition of the motor units (MUs) with relatively large energy by using the iterative convolution kernel compensation (ICKC) method and extraction of low-energy MUs with a Post-Processor and novel 'peel-off' strategy. Results- The performance of the proposed framework was evaluated by both simulated and experimental HD-sEMG signals. Our simulation results demonstrated that, with 120 simulated MUs, the proposed framework extracts more MUs compared to K-means convolutional kernel compensation (KmCKC) approach across six noise levels. And the proposed 'peel-off' strategy estimates more accurate MUAP waveforms at six noise levels than the 'peel-off' strategy proposed in the progressive FastICA peel-off (PFP) framework. For the experimental sEMG signals recorded from biceps brachii, an average of 16.1 ±3.4 MUs were identified from each contraction, while only 10.0 ± 2.8 MUs were acquired by the KmCKC method. Conclusion- The high yield and accuracy of MUs decomposed from simulated and experimental HD-sEMG signals demonstrate the superiority of the proposed framework in decomposing low-energy MUs compared to existing methods for HD-sEMG signal decomposition. Significance- The proposed framework enables us to construct a more representative motor unit pool, consequently enhancing our understanding pertaining to various neuropathological conditions and providing invaluable information for the diagnosis and treatment of neuromuscular disorders and motor neuron diseases.
Collapse
|
9
|
Chen C, Ma S, Sheng X, Zhu X. A peel-off convolution kernel compensation method for surface electromyography decomposition. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/30/2023]
|
10
|
Yeung D, Negro F, Vujaklija I. Semi-Automated Identification of Motor Units Concurrently Recorded in High-Density Surface and Intramuscular Electromyography. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38083795 DOI: 10.1109/embc40787.2023.10340187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
An increasing focus on extending automated surface electromyography (EMG) decomposition algorithms to operate under non-stationary conditions requires rigorous and robust validation. However, relevant benchmarks derived manually from iEMG are laborsome to obtain and this is further exacerbated by the need to consider multiple contraction conditions. This work demonstrates a semi-automatic technique for extracting motor units (MUs) whose activities are present in concurrently recorded high-density surface EMG (HD-sEMG) and intramuscular EMG (iEMG) during isometric contractions. We leverage existing automatic surface decomposition algorithms for initial identification of active MUs. Resulting spike times are then used to identify (trigger) the sources that are concurrently detectable in iEMG. We demonstrate this technique on recordings targeting the extensor carpi radialis brevis in five human subjects. This dataset consists of 117 trials across different force levels and wrist angles, from which the presented method yielded a set of 367 high-confidence decompositions. Thus, our approach effectively alleviates the overhead of manual decomposition as it efficiently produces reliable benchmarks under different conditions.Clinical Relevance- We present an efficient method for obtaining high-quality in-vivo decomposition particularly useful in the verification of new surface decomposition approaches.
Collapse
|
11
|
Jiang N, Chen C, He J, Meng J, Pan L, Su S, Zhu X. Bio-robotics research for non-invasive myoelectric neural interfaces for upper-limb prosthetic control: a 10-year perspective review. Natl Sci Rev 2023; 10:nwad048. [PMID: 37056442 PMCID: PMC10089583 DOI: 10.1093/nsr/nwad048] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 01/01/2023] [Accepted: 02/07/2023] [Indexed: 04/05/2023] Open
Abstract
ABSTRACT
A decade ago, a group of researchers from academia and industry identified a dichotomy between the industrial and academic state-of-the-art in upper-limb prosthesis control, a widely used bio-robotics application. They proposed that four key technical challenges, if addressed, could bridge this gap and translate academic research into clinically and commercially viable products. These challenges are unintuitive control schemes, lack of sensory feedback, poor robustness and single sensor modality. Here, we provide a perspective review on the research effort that occurred in the last decade, aiming at addressing these challenges. In addition, we discuss three research areas essential to the recent development in upper-limb prosthetic control research but were not envisioned in the review 10 years ago: deep learning methods, surface electromyogram decomposition and open-source databases. To conclude the review, we provide an outlook into the near future of the research and development in upper-limb prosthetic control and beyond.
Collapse
Affiliation(s)
| | - Chen Chen
- State Key Laboratory of Mechanical System and Vibration, and Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Jiayuan He
- National Clinical Research Center for Geriatrics, West China Hospital, and Med-X Center for Manufacturing, Sichuan University, Chengdu 610041, China
| | - Jianjun Meng
- State Key Laboratory of Mechanical System and Vibration, and Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Lizhi Pan
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, School of Mechanical Engineering, Tianjin University, Tianjin 300350, China
| | - Shiyong Su
- Institute of Neuroscience, Université Catholique Louvain, Brussel B-1348, Belgium
| | - Xiangyang Zhu
- State Key Laboratory of Mechanical System and Vibration, and Institute of Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
12
|
Martinez-Valdes E, Enoka RM, Holobar A, McGill K, Farina D, Besomi M, Hug F, Falla D, Carson RG, Clancy EA, Disselhorst-Klug C, van Dieën JH, Tucker K, Gandevia S, Lowery M, Søgaard K, Besier T, Merletti R, Kiernan MC, Rothwell JC, Perreault E, Hodges PW. Consensus for experimental design in electromyography (CEDE) project: Single motor unit matrix. J Electromyogr Kinesiol 2023; 68:102726. [PMID: 36571885 DOI: 10.1016/j.jelekin.2022.102726] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 11/16/2022] [Accepted: 11/16/2022] [Indexed: 11/29/2022] Open
Abstract
The analysis of single motor unit (SMU) activity provides the foundation from which information about the neural strategies underlying the control of muscle force can be identified, due to the one-to-one association between the action potentials generated by an alpha motor neuron and those received by the innervated muscle fibers. Such a powerful assessment has been conventionally performed with invasive electrodes (i.e., intramuscular electromyography (EMG)), however, recent advances in signal processing techniques have enabled the identification of single motor unit (SMU) activity in high-density surface electromyography (HDsEMG) recordings. This matrix, developed by the Consensus for Experimental Design in Electromyography (CEDE) project, provides recommendations for the recording and analysis of SMU activity with both invasive (needle and fine-wire EMG) and non-invasive (HDsEMG) SMU identification methods, summarizing their advantages and disadvantages when used during different testing conditions. Recommendations for the analysis and reporting of discharge rate and peripheral (i.e., muscle fiber conduction velocity) SMU properties are also provided. The results of the Delphi process to reach consensus are contained in an appendix. This matrix is intended to help researchers to collect, report, and interpret SMU data in the context of both research and clinical applications.
Collapse
Affiliation(s)
- Eduardo Martinez-Valdes
- Centre of Precision Rehabilitation for Spinal Pain (CPR Spine), School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK
| | - Roger M Enoka
- Department of Integrative Physiology, University of Colorado Boulder, CO, USA
| | - Aleš Holobar
- Faculty of Electrical Engineering and Computer Science, University of Maribor, Koroška cesta 46, Maribor, Slovenia
| | | | - Dario Farina
- Department of Bioengineering, Imperial College London, London, UK
| | - Manuela Besomi
- School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia; School of Biomedical Sciences, The University of Queensland, Brisbane, Australia
| | - François Hug
- School of Biomedical Sciences, The University of Queensland, Brisbane, Australia; LAMHESS, Université Côte d'Azur, Nice, France; Institut Universitaire de France (IUF), Paris, France
| | - Deborah Falla
- Centre of Precision Rehabilitation for Spinal Pain (CPR Spine), School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK
| | - Richard G Carson
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin, Ireland; School of Psychology, Queen's University Belfast, Belfast, UK; School of Human Movement and Nutrition Sciences, The University of Queensland, Brisbane, Australia
| | | | - Catherine Disselhorst-Klug
- Department of Rehabilitation and Prevention Engineering, Institute of Applied Medical Engineering, RWTH Aachen University, Aachen, Germany
| | - Jaap H van Dieën
- Department of Human Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences, Amsterdam, the Netherlands
| | - Kylie Tucker
- School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia; School of Biomedical Sciences, The University of Queensland, Brisbane, Australia
| | - Simon Gandevia
- Neuroscience Research Australia, University of New South Wales, Sydney, Australia
| | - Madeleine Lowery
- School of Electrical and Electronic Engineering, University College Dublin, Belfield, Dublin, Ireland
| | - Karen Søgaard
- Department of Clinical Research and Department of Sports Sciences and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark
| | - Thor Besier
- Auckland Bioengineering Institute and Department of Engineering Science, University of Auckland, Auckland, New Zealand
| | - Roberto Merletti
- LISiN, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - Matthew C Kiernan
- Brain and Mind Centre, University of Sydney, Sydney, Australia Department of Neurology, Royal Prince Alfred Hospital, Sydney, Australia
| | - John C Rothwell
- Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, London, UK
| | - Eric Perreault
- Northwestern University, Evanston, IL, USA; Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Paul W Hodges
- School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia.
| |
Collapse
|
13
|
Wen Y, Kim SJ, Avrillon S, Levine JT, Hug F, Pons JL. Toward a generalizable deep CNN for neural drive estimation across muscles and participants. J Neural Eng 2023; 20. [PMID: 36548991 DOI: 10.1088/1741-2552/acae0b] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 12/22/2022] [Indexed: 12/24/2022]
Abstract
Objective.High-density electromyography (HD-EMG) decomposition algorithms are used to identify individual motor unit (MU) spike trains, which collectively constitute the neural code of movements, to predict motor intent. This approach has advanced from offline to online decomposition, from isometric to dynamic contractions, leading to a wide range of neural-machine interface applications. However, current online methods need offline retraining when applied to the same muscle on a different day or to a different person, which limits their applications in a real-time neural-machine interface. We proposed a deep convolutional neural network (CNN) framework for neural drive estimation, which takes in frames of HD-EMG signals as input, extracts general spatiotemporal properties of MU action potentials, and outputs the number of spikes in each frame. The deep CNN can generalize its application without retraining to HD-EMG data recorded in separate sessions, muscles, or participants.Approach.We recorded HD-EMG signals from the vastus medialis and vastus lateralis muscles from five participants while they performed isometric contractions during two sessions separated by ∼20 months. We identified MU spike trains from HD-EMG signals using a convolutive blind source separation (BSS) method, and then used the cumulative spike train (CST) of these MUs and the HD-EMG signals to train and validate the deep CNN.Main results.On average, the correlation coefficients between CST from the BSS and that from deep CNN were0.983±0.006for leave-one-out across-sessions-and-muscles validation and0.989±0.002for leave-one-out across-participants validation. When trained with more than four datasets, the performance of deep CNN saturated at0.984±0.001for cross validations across muscles, sessions, and participants.Significance.We can conclude that the deep CNN is generalizable across the aforementioned conditions without retraining. We could potentially generate a robust deep CNN to estimate neural drive to muscles for neural-machine interfaces.
Collapse
Affiliation(s)
- Yue Wen
- Legs and Walking Lab of Shirley Ryan AbilityLab and Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| | - Sangjoon J Kim
- Legs and Walking Lab of Shirley Ryan AbilityLab and Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| | - Simon Avrillon
- Legs and Walking Lab of Shirley Ryan AbilityLab and Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| | - Jackson T Levine
- Legs and Walking Lab of Shirley Ryan AbilityLab and Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| | - François Hug
- Université Côte d'Azur, LAMHESS, Nice, France.,School of Biomedical Sciences, University of Queensland, Brisbane, QLD, Australia
| | - José L Pons
- Legs and Walking Lab of Shirley Ryan AbilityLab, McCormick School of Engineering, and Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| |
Collapse
|
14
|
Chen C, Yu Y, Sheng X, Meng J, Zhu X. Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control. IEEE Trans Neural Syst Rehabil Eng 2023; 31:1807-1815. [PMID: 37030732 DOI: 10.1109/tnsre.2023.3260209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
Abstract
The surface electromyography (EMG) decomposition techniques provide access to motor neuron activities and have been applied to myoelectric control schemes. However, the current decomposition-based myoelectric control mainly focuses on discrete gestures or single-DoF continuous movements. In this study, we aimed to map the motor unit discharges, which were identified from high-density surface EMG, to the three degrees of freedom (DoFs) wrist movements. The 3-DoF wrist torques and high-density surface EMG signals were recorded concurrently from eight non-disabled subjects. The experimental protocol included single-DoF movements and their various combinations. We decoded the motor unit discharges from the EMG signals using a segment-wise decomposition algorithm. Then the neural features were extracted from motor unit discharges and projected to wrist torques with a multiple linear regression model. We compared the performance of two neural features (twitch model and spike counting) and two training schemes (single-DoF and multi-DoF training). On average, 145 ± 33 motor units were identified from each subject, with a pulse-to-noise ratio of 30.8 ± 4.2 dB. Both neural features exhibited high estimation accuracy of 3-DoF wrist torques, with an average [Formula: see text] of 0.76 ± 0.12 and normalized root mean square error of 11.4 ± 3.1%. These results demonstrated the efficiency of the proposed method in continuous estimation of 3-DoF wrist torques, which has the potential to advance dexterous myoelectric control based on neural information.
Collapse
|
15
|
Qiu F, Liu X, Xu Y, Shi L, Sheng X, Chen C. Neural inputs from spinal motor neurons to lateralis vastus muscle: Comparison between sprinters and nonathletes. Front Physiol 2022; 13:994857. [PMID: 36277210 PMCID: PMC9585313 DOI: 10.3389/fphys.2022.994857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 09/21/2022] [Indexed: 11/13/2022] Open
Abstract
The adaptation of neural contractile properties has been observed in previous work. However, the neural changes on the motor unit (MU) level remain largely unknown. Voluntary movements are controlled through the precise activation of MU populations. In this work, we estimate the neural inputs from the spinal motor neurons to the muscles during isometric contractions and characterize the neural adaptation during training by comparing the MU properties decomposed from sprinters and nonathletes. Twenty subjects were recruited and divided into two groups. The high-density surface electromyography (EMG) signals were recorded from the lateralis vastus muscle during the isometric contraction of knee extension and were then decomposed into MU spike trains. Each MU’s action potentials and discharge properties were extracted for comparison across subject groups and tasks. A total of 1097 MUs were identified from all subjects. Results showed that the discharge rates and amplitudes of MUAPs from athletes were significantly higher than those from nonathletes. These results demonstrate the neural adaptations in physical training at the MU population level and indicate the great potential of EMG decomposition in physiological investigations.
Collapse
Affiliation(s)
- Fang Qiu
- Department of Exercise Physiology, Beijing Sport University, Beijing, China
| | - Xiaodong Liu
- School of Kinesiology, Shanghai University of Sport, Shanghai, China
| | - Yilin Xu
- Sports Biomechanics Laboratory, Jiangsu Research Institute of Sports Science, Nanjing, China
| | - Lijun Shi
- Department of Exercise Physiology, Beijing Sport University, Beijing, China
| | - Xinjun Sheng
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Chen Chen
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
- *Correspondence: Chen Chen,
| |
Collapse
|
16
|
Vaskov AK, Vu PP, North N, Davis AJ, Kung TA, Gates DH, Cederna PS, Chestek CA. Surgically Implanted Electrodes Enable Real-Time Finger and Grasp Pattern Recognition for Prosthetic Hands. IEEE T ROBOT 2022; 38:2841-2857. [PMID: 37193351 PMCID: PMC10168021 DOI: 10.1109/tro.2022.3170720] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Currently available prosthetic hands are capable of actuating anywhere from five to 30 degrees of freedom (DOF). However, grasp control of these devices remains unintuitive and cumbersome. To address this issue, we propose directly extracting finger commands from the neuromuscular system. Two persons with transradial amputations had bipolar electrodes implanted into regenerative peripheral nerve interfaces (RPNIs) and residual innervated muscles. The implanted electrodes recorded local electromyography with large signal amplitudes. In a series of single-day experiments, participants used a high speed movement classifier to control a virtual prosthetic hand in real-time. Both participants transitioned between 10 pseudo-randomly cued individual finger and wrist postures with an average success rate of 94.7% and trial latency of 255 ms. When the set was reduced to five grasp postures, metrics improved to 100% success and 135 ms trial latency. Performance remained stable across untrained static arm positions while supporting the weight of the prosthesis. Participants also used the high speed classifier to switch between robotic prosthetic grips and complete a functional performance assessment. These results demonstrate that pattern recognition systems can use intramuscular electrodes and RPNIs for fast and accurate prosthetic grasp control.
Collapse
Affiliation(s)
- Alex K Vaskov
- Robotics Institute, University of Michigan, Ann Arbor, MI 48109 USA
| | - Philip P Vu
- Section of Plastic Surgery, University of Michigan, Ann Arbor, MI 48109 USA
| | - Naia North
- Mechanical Engineering department at University of Michigan, Ann Arbor, MI 48109 USA
| | - Alicia J Davis
- Department of Physical Medicine and Rehabilitation at the University of Michigan, Ann Arbor, MI 48109 USA
| | - Theodore A Kung
- Section of Plastic Surgery, University of Michigan, Ann Arbor, MI 48109 USA
| | - Deanna H Gates
- School of Kinesiology, University of Michigan, Ann Arbor, MI 48109 USA
| | - Paul S Cederna
- Section of Plastic Surgery, University of Michigan, Ann Arbor, MI 48109 USA
| | - Cynthia A Chestek
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109 USA
| |
Collapse
|
17
|
Chen C, Ma S, Yu Y, Sheng X, Zhu X. Segment-Wise Decomposition of Surface Electromyography to Identify Discharges Across Motor Neuron Populations. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2012-2021. [PMID: 35853067 DOI: 10.1109/tnsre.2022.3192272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE The surface electromyography (EMG) decomposition techniques have shown promising results in neurophysiologic investigations, clinical diagnosis, and human-machine interfacing. However, current decomposition methods could only decode a limited number of motor units (MUs) because of the local convergence. The number of identified MUs remains similar even though more muscles or movements are involved, where multiple motor neuron populations are activated. The objective of this study was to develop a segment-wise decomposition strategy to increase the number of MU decoded from multiple motor neuron populations. METHODS The EMG signals were divided into several segments depending on the number of involved movements. The motor neurons, activated during each movement, were regarded as a population. The convolution kernel compensation (CKC) method was applied individually for each segment to decode the motor unit discharges from each motor neuron population. The MU filters were obtained in each segment and filtrated to estimate the MU spike trains (MUSTs) from the global EMG signals. The decomposition performance was validated on synthetic and experimental EMG signals. MAIN RESULTS From synthetic EMG signals generated by two motor neuron populations, the proposed segment-wise CKC (swCKC) decoded significantly more MUs during low and medium excitation levels, with an increased rate of 16.3% to 75.4% compared with the conventional CKC. From experimental signals recorded during ten motor tasks, 133±24 MUs with the pulse-to-noise ratio of 36.6±6.5 dB were identified for each subject by swCKC, whereas the conventional CKC identified only 43±12 MUs. CONCLUSION AND SIGNIFICANCE These results indicate the feasibility and superiority of the proposed swCKC to decode MU activities across motor neuron populations, extending the potential applications of EMG decomposition for neural decoding during multiple motor tasks.
Collapse
|
18
|
Durandau G, Rampeltshammer WF, Kooij HVD, Sartori M. Neuromechanical Model-Based Adaptive Control of Bilateral Ankle Exoskeletons: Biological Joint Torque and Electromyogram Reduction Across Walking Conditions. IEEE T ROBOT 2022. [DOI: 10.1109/tro.2022.3170239] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Guillaume Durandau
- Department of Biomechanical Engineering, Technical Medical Centre, University of Twente, Enschede, NB, The Netherlands
| | - Wolfgang F. Rampeltshammer
- Department of Biomechanical Engineering, Technical Medical Centre, University of Twente, Enschede, NB, The Netherlands
| | - Herman van der Kooij
- Department of Biomechanical Engineering, Technical Medical Centre, University of Twente, Enschede, NB, The Netherlands
| | - Massimo Sartori
- Department of Biomechanical Engineering, Technical Medical Centre, University of Twente, Enschede, NB, The Netherlands
| |
Collapse
|
19
|
Yang Y, Ren J, Duan F. The Spiking Rates Inspired Encoder and Decoder for Spiking Neural Networks: An Illustration of Hand Gesture Recognition. Cognit Comput 2022. [DOI: 10.1007/s12559-022-10027-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
20
|
Zheng Y, Xu G, Li Y, Qiang W. Improved online decomposition of non-stationary electromyogram via signal enhancement using a neuron resonance model: a simulation study. J Neural Eng 2022; 19. [PMID: 35303735 DOI: 10.1088/1741-2552/ac5f1b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Accepted: 03/18/2022] [Indexed: 11/12/2022]
Abstract
Objective. Motor unit (MU) discharge information obtained via the online electromyogram (EMG) decomposition has shown promising prospects in multiple applications. However, the nonstationarity of EMG signals caused by the rotation (recruitment-derecruitment) of MUs and the variation of MU action potentials (MUAP) can significantly degrade the online decomposition performance. This study aimed to develop an independent component analysis-based online decomposition method that can accommodate the nonstationarity of EMG signals.Approach. The EMG nonstationarity can make the separation vectors obtained beforehand inaccurate, resulting in the reduced amplitudes of the peaks corresponding to firing events in the source signal (independent component) and then the decreased accuracy of firing events. Therefore, we utilized the FitzHugh-Nagumo (FHN) resonance model to enhance the firing peaks in the source signal in order to improve the decomposition accuracy. A two-session approach was used with the offline session to extract the separation vectors and train the FHN models. In the online session, the source signal was estimated and further processed using the FHN model before detecting the firing events in a real-time manner. The proposed method was tested on simulated EMG signals, in which MU rotation and MUAP variation were involved to mimic the nonstationarity of EMG recordings.Main results. Compared with the conventional method, the proposed method can improve the decomposition accuracy significantly (88.70% ± 4.17% vs. 92.43% ± 2.79%) by enhancing the firing peaks, and more importantly, the improvement was more prominent when the EMG signal had stronger background noises (87.00% ± 3.70% vs. 91.66% ± 2.63%).Conclusions. Our results demonstrated the effectiveness of the proposed method to utilize the FHN model to improve the online decomposition performance on the nonstationary EMG signals. Further development of our method has the potential to improve the performance of the neural decoding system that utilizes the MU discharge information and promote its application in the neural-machine interface.
Collapse
Affiliation(s)
- Yang Zheng
- Institute of Engineering & Medicine Interdisciplinary Studies, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China.,State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China
| | - Guanghua Xu
- Institute of Engineering & Medicine Interdisciplinary Studies, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China.,State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China
| | - Yixin Li
- Institute of Engineering & Medicine Interdisciplinary Studies, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China
| | - Wei Qiang
- Institute of Engineering & Medicine Interdisciplinary Studies, School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China
| |
Collapse
|
21
|
Chen C, Yu Y, Sheng X, Zhu X. Non-invasive analysis of motor unit activation during simultaneous and continuous wrist movements. IEEE J Biomed Health Inform 2021; 26:2106-2115. [PMID: 34910644 DOI: 10.1109/jbhi.2021.3135575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Surface electromyography (EMG) signals have shown promising applications in human-machine interfacing (HMI) systems such as orthotics, prosthetics, and exoskeletons. Nevertheless, existing myoelectric control methods, generally based on time-domain or frequency-domain features, could not directly interpret neural commands. EMG decomposition techniques have become a prevailing solution to decode the motor neuron discharges from the spinal cord, whereas only single degree-of-freedom (DoF) movements are primarily involved in the current neural-based interfaces, resulting in limited intuitiveness and functionality. Here, we propose a non-invasive framework to analyze motor unit activities and estimate wrist torques during simultaneous contractions of multiple DoFs. Motor unit discharges were decoded from surface EMG signals and pooled into groups during sequential wrist movements. Then three neural features were extracted and linearly projected to the torques of multi-DoF tasks. On average, there were 4413 motor units identified for each motion with a PNR value of 25.82.9 dB. The neural features outperformed the classic EMG feature on the estimation accuracy with higher correlation coefficients and smoothness. These results demonstrate the feasibility and superiority of the proposed framework in kinetics estimation of simultaneous movements, extending the potential applications of surface EMG decomposition in human-machine interfaces.
Collapse
|
22
|
Tang X, Zhang X, Chen M, Chen X, Chen X. Decoding Muscle Force From Motor Unit Firings Using Encoder-Decoder Networks. IEEE Trans Neural Syst Rehabil Eng 2021; 29:2484-2495. [PMID: 34748497 DOI: 10.1109/tnsre.2021.3126752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Appropriate interpretation of motor unit (MU) activities after surface EMG (sEMG) decomposition is a key factor to decode motor intentions in a noninvasive and physiologically meaningful way. However, there are great challenges due to the difficulty in cross-trial MU tracking and unavoidable loss of partial MU information resulting from incomplete decomposition. In light of these issues, this study presents a novel framework for interpreting MU activities and applies it to decode muscle force. The resulting MUs were clustered and classified into different categories by characterizing their spatially distributed firing waveforms. The process served as a general MU tracking method. On this basis, after transferring the MU firing trains to twitch force trains by a twitch force model, a deep network was designed to predict the normalized force. In addition, MU category distribution was examined to calibrate the actual force level, while functions of some unavailable MUs were compensated. To investigate the effectiveness of this framework, high-density sEMG signals were recorded using an 8×8 electrode array from the abductor pollicis brevis muscles of eight subjects, while thumb abduction force was measured. The proposed method outperformed three common methods ( ) yielding the lowest root mean square deviation of 6.68% ± 1.29% and the highest fitness ( R2 ) of 0.94 ± 0.04 between the predicted force and the actual force. This study offers a valuable, computational solution for interpreting individual MU activities, and its effectiveness was confirmed in muscle force estimation.
Collapse
|
23
|
Ma S, Chen C, Zhao J, Han D, Sheng X, Farina D, Zhu X. Analytical Modelling of Surface EMG Signals Generated by Curvilinear Fibers with Approximate Conductivity Tensor. IEEE Trans Biomed Eng 2021; 69:1052-1062. [PMID: 34529557 DOI: 10.1109/tbme.2021.3112766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Mathematical modelling of surface electromyographic (EMG) signals has been proven a valuable tool to interpret experimental data and to validate signal processing techniques. Most analytical EMG models only consider muscle fibers with specific and fixed arrangements. However, the fiber orientation and curvature may change along the fiber paths and may differ from fiber to fiber. Here we propose a subject-specific EMG model that simulates the fiber trajectories in muscles of the upper arm and analytically derives the action potentials assuming an approximate conductivity tensor. METHODS Magnetic Resonance (MR) images were acquired to identify and generate muscle fiber paths and to determine the muscle locations in a cylindrical volume conductor. While the propagation of the action potentials followed the identified curvilinear fiber paths, the conductivity tensor was not adapted to the fiber direction but approximated along the longitudinal axis of the cylindrical volume conductor. Single fiber action potentials (SFAPs) were computed by simulating the generation, propagation, and extinction of membrane current sources. To validate the assumption of the approximate conductivity tensor, two numerical models were implemented for comparison with the analytical solution. The first numerical model reproduced the analytical model and therefore included an approximation for the conductivity tensor. The second numerical model included the exact conductivity tensor derived from the fiber curvatures. RESULTS The motor unit action potentials generated by the proposed analytical model and the two numerical models were highly similar (cross-correlation >0.98, normalized root mean square error, nRMSE 0.04, relative error in the median frequency of the simulated waveforms of approximately 3%). The proposed analytical model was also evaluated by comparing simulated and experimentally recorded compound muscle action potentials (CMAPs). The CMAPs simulated with the proposed model better matched the experimental data (cross-correlation >0.90 and nRMSE <0.25 for the majority of the channels) than a model with straight fibers. Finally, the proposed model was representatively used to test the accuracy of an EMG decomposition algorithm, providing a realistic benchmark. CONCLUSIONS AND SIGNIFICANCE The proposed analytical model generates action potentials that reflect the spatial distributions of muscle fibers with curvilinear paths. The simulated signals are more realistic than signals generated by analytical models with straight fibers and can therefore be applied for testing EMG processing algorithms with a trade-off between simulation accuracy and computational speed.
Collapse
|
24
|
Del Vecchio A, Castellini C, Beckerle P. Peripheral Neuroergonomics - An Elegant Way to Improve Human-Robot Interaction? Front Neurorobot 2021; 15:691508. [PMID: 34489669 PMCID: PMC8417695 DOI: 10.3389/fnbot.2021.691508] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Accepted: 07/28/2021] [Indexed: 11/13/2022] Open
Affiliation(s)
- Alessandro Del Vecchio
- Department of Artificial Intelligence in Biomedical Engineering, Faculty of Engineering, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Claudio Castellini
- Institute of Robotics and Mechatronics, DLR German Aerospace Center, Weßling, Germany
| | - Philipp Beckerle
- Chair of Autonomous Systems and Mechatronics, Department of Electrical Engineering and Department of Artificial Intelligence in Biomedical Engineering, Faculty of Engineering, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany
- Institute for Mechatronic Systems, Mechanical Engineering, Technical University of Darmstadt, Darmstadt, Germany
| |
Collapse
|
25
|
Yu Y, Chen C, Sheng X, Zhu X. Wrist Torque Estimation via Electromyographic Motor Unit Decomposition and Image Reconstruction. IEEE J Biomed Health Inform 2021; 25:2557-2566. [PMID: 33264096 DOI: 10.1109/jbhi.2020.3041861] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Neural interface using decomposed motor units (MUs) from surface electromyography (sEMG) has allowed non-invasive access to the neural control signals, and provided a novel approach for intuitive human-machine interaction. However, most of the existing methods based on decomposed MUs merely adopted the discharge rate (DR) as the feature representations, which may lack local information around the discharge instant and ignore the subtle interactions of different MUs. In this study, we proposed an MU-specific image-based scheme for wrist torque estimation. Specifically, the high-density sEMG signals were decoded into motor unit spike trains (MUSTs), and then MU-specific images were reconstructed with MUSTs and corresponding motor unit action potential (MUAP). A convolutional neural network was used to learn representative features from MU-specific images automatically, and further to estimate wrist torques. The results demonstrated that the proposed method outperformed three conventional and a deep-learning regression approaches using DR features, with the estimation accuracy R2 of 0.82 ± 0.09, 0.89 ± 0.06, and nRMSE of 12.6 ± 2.5%, 11.0 ± 3.1% for pronation/supination and flexion/extension, respectively. Further, the analysis of the extracted features from MU-specific images showed a higher correlation than DR for recorded torques, indicating the effectiveness of the proposed method. The outcomes of this study provide a novel and promising perspective for the intuitive control of neural interfacing.
Collapse
|
26
|
Guo LX, Dong RC, Yuan S, Feng QZ, Fan W. Influence of seat lumbar support adjustment on muscle fatigue under whole body vibration: An in vivo experimental study. Technol Health Care 2021; 30:455-467. [PMID: 34275916 DOI: 10.3233/thc-212840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND In order to alleviate muscle fatigue and improve ride comfort, many published studies aimed to improve the seat environment or optimize seating posture. However, the effect of lumbar support on the lumbar muscle of seated subjects under whole body vibration is still unclear. OBJECTIVE This study aimed to investigate the effect of lumbar support magnitude of the seat on lumbar muscle fatigue relief under whole body vibration. METHODS Twenty healthy volunteers without low back pain participated in the experiment. By measuring surface electromyographic signals of erector spinae muscles under vibration or non-vibration for 30 minutes, the effect of different lumbar support conditions on muscle fatigue was analyzed. The magnitude of lumbar support d is assigned as d1= 0 mm, d2= 20 mm and d3= 40 mm for no support, small support and large support, respectively. RESULTS The results showed that lumbar muscle activation levels vary under different support conditions. For the small support case (d2= 20 mm), the muscle activation level under vibration and no-vibration was the minimum, 42.3% and 77.7% of that under no support (d1= 0 mm). For all support conditions, the muscle activation level under vibration is higher than that under no-vibration. CONCLUSIONS The results indicate that the small support yields the minimum muscle contraction (low muscle contraction intensity) under vibration, which is more helpful for relieving lumbar muscle fatigue than no support or large support cases. Therefore, an appropriate lumbar support of seats is necessary for alleviating lumbar muscle fatigue.
Collapse
Affiliation(s)
- Li-Xin Guo
- School of Mechanical Engineering and Automation, Northeastern University, Shenyang, Liaoning, China
| | - Rui-Chun Dong
- School of Mechanical Engineering and Automation, Northeastern University, Shenyang, Liaoning, China
| | | | - Qing-Zhi Feng
- Department of Audio and Video Material Examination Technology, Criminal Investigation Police University of China, Shenyang, Liaoning, China
| | - Wei Fan
- School of Mechanical Engineering and Automation, Northeastern University, Shenyang, Liaoning, China
| |
Collapse
|
27
|
Jiang S, Kang P, Song X, Lo B, Shull P. Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey. IEEE Rev Biomed Eng 2021; 15:85-102. [PMID: 33961564 DOI: 10.1109/rbme.2021.3078190] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Hands are vital in a wide range of fundamental daily activities, and neurological diseases that impede hand function can significantly affect quality of life. Wearable hand gesture interfaces hold promise to restore and assist hand function and to enhance human-human and human-computer communication. The purpose of this review is to synthesize current novel sensing interfaces and algorithms for hand gesture recognition, and the scope of applications covers rehabilitation, prosthesis control, sign language recognition, and human-computer interaction. Results showed that electrical, dynamic, acoustical/vibratory, and optical sensing were the primary input modalities in gesture recognition interfaces. Two categories of algorithms were identified: 1) classification algorithms for predefined, fixed hand poses and 2) regression algorithms for continuous finger and wrist joint angles. Conventional machine learning algorithms, including linear discriminant analysis, support vector machines, random forests, and non-negative matrix factorization, have been widely used for a variety of gesture recognition applications, and deep learning algorithms have more recently been applied to further facilitate the complex relationship between sensor signals and multi-articulated hand postures. Future research should focus on increasing recognition accuracy with larger hand gesture datasets, improving reliability and robustness for daily use outside of the laboratory, and developing softer, less obtrusive interfaces.
Collapse
|
28
|
Oliveira AS, Negro F. Neural control of matched motor units during muscle shortening and lengthening at increasing velocities. J Appl Physiol (1985) 2021; 130:1798-1813. [PMID: 33955258 DOI: 10.1152/japplphysiol.00043.2021] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
Modulation of movement velocity is necessary during daily life tasks, work, and sports activities. However, assessing motor unit behavior during muscle shortening and lengthening at different velocities is challenging. High-density surface electromyography (HD-sEMG) is an established method to identify and track motor unit behavior in isometric contractions. Therefore, we used this methodology to unravel the behavior of the same motor units in dynamic contractions at low contraction velocities. Velocity-related changes in tibialis anterior motor unit behavior during concentric and eccentric contractions at 10% and 25% maximum voluntary isometric contraction were assessed by decomposing HD-sEMG signals recorded from the tibialis anterior muscle of eleven healthy participants at 5°/s, 10°/s, and 20°/s. Motor units extracted from the dynamic contractions were tracked across different velocities at the same load levels. On average, 14 motor units/participant were matched across different velocities, showing specific changes in discharge rate modulation. Specifically, increased velocity led to an increased rate of change in discharge rate (e.g., discharge rate slope, P = 0.025), recruitment and derecruitment discharge rates (P = 0.003 and P = 0.001), and decreased recruitment angles (P = 0.0001). Surprisingly, the application of the motor unit extraction filters calculated from 20°/s onto the recordings at 5°/s and 10°/s revealed that >92% of motor units recruited at the highest velocity were active on both lower velocities, indicating no additional recruitment of motor units. Our results suggest that motor unit rate coding rather than recruitment is responsible for controlling muscle shortening and lengthening contractions at increasing velocities against a constant load.NEW & NOTEWORTHY The control of movement velocity is accomplished by the modulation of the neural drive to muscle and its variation over time. In this study, we tracked motor units decomposed from HD-sEMG across shortening and lengthening contractions at increasing velocities in two submaximal load levels. We demonstrate that concentric and eccentric contractions of the tibialis anterior muscle at slow velocities are achieved by specific motor unit rate coding strategies rather than distinct recruitment schemes.
Collapse
Affiliation(s)
| | - Francesco Negro
- Department of Clinical and Experimental Sciences, Università degli Studi di Brescia, Brescia, Italy
| |
Collapse
|
29
|
Chen C, Yu Y, Sheng X, Farina D, Zhu X. Simultaneous and proportional control of wrist and hand movements by decoding motor unit discharges in real time. J Neural Eng 2021; 18. [PMID: 33764315 DOI: 10.1088/1741-2552/abf186] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Accepted: 03/24/2021] [Indexed: 11/12/2022]
Abstract
Objective.Surface electromyography (EMG) decomposition techniques can be used to establish human-machine interfacing (HMI), but most investigations are implemented offline due to the computational load of the approach. Here, we generalize the offline decomposition algorithm to identify the motor unit (MU) activities in real time, and we propose a MU-based approach for online simultaneous and proportional control of multiple motor tasks.Approach.High-density surface EMG signals recorded from forearm muscles were decomposed into motor unit spike trains (MUST) with the proposed decomposition method. The MUSTs were first pooled into clusters in the calibration phase and the cumulative discharges of active MUs in each group were extracted as the control signal for each motor task. Then the subjects were instructed to control a virtual cursor with multiple motor tasks involving grasp and wrist movements. Fifteen able-bodied subjects and two patients with limb deficiency participated in the experiments to validate the proposed control scheme.Main results.On average, over 20 MUSTs were identified in real time with an estimated decomposition accuracy > 85%. The cumulative discharge in each pool was highly correlated with the activation of the specific motion (R=0.93±0.05). Moreover, the proposed MU-based method had superior performance in online tests than conventional myo-control methods based on global EMG features.Significance.These results indicate the feasibility of real-time neural decoding in a non-invasive way. Moreover, the superior performance in online tests proves the potential of the MU-based approach for the simultaneous and proportional control, promoting the application of EMG decomposition for HMI systems.
Collapse
Affiliation(s)
- Chen Chen
- Department of Mechanical Engineering, Shanghai Jiao Tong University State Key Laboratory of Mechanical System and Vibration, No. 800, Dongchuan Road, Shanghai, 200240, CHINA
| | - Yang Yu
- Shanghai Jiao Tong University State Key Laboratory of Mechanical System and Vibration, 800 Dongchuan RD. Minhang District, Shanghai, 200240, CHINA
| | - Xinjun Sheng
- Department of Mechanical Engineering, Shanghai Jiao Tong University State Key Laboratory of Mechanical System and Vibration, No. 800, Dongchuan Road, Shanghai, 200240, CHINA
| | - Dario Farina
- Department of Bioengineering, Imperial College London, Royal School of Mines South Kensington Campus, London, SW7 2AZ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Xiangyang Zhu
- Department of Mechanical Engineering, Shanghai Jiao Tong University State Key Laboratory of Mechanical System and Vibration, No. 800, Dongchuan Road, Shanghai, 200240, CHINA
| |
Collapse
|
30
|
Wen Y, Avrillon S, Hernandez-Pavon JC, Kim SJ, Hug F, Pons JL. A convolutional neural network to identify motor units from high-density surface electromyography signals in real time. J Neural Eng 2021; 18. [PMID: 33721852 DOI: 10.1088/1741-2552/abeead] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 03/15/2021] [Indexed: 11/11/2022]
Abstract
OBJECTIVES This paper aims to investigate the feasibility and the validity of applying deep convolutional neural networks (CNN) to identify motor unit (MU) spike trains and estimate the neural drive to muscles from high-density electromyography (HD-EMG) signals in real time. Two distinct deep CNNs are compared with the convolution kernel compensation (CKC) algorithm using simulated and experimentally recorded signals. The effects of window size and step size of the input HD-EMG signals are also investigated. APPROACH The MU spike trains were first identified with the CKC algorithm. The HD-EMG signals and spike trains were used to train the deep CNN. Then, the deep CNN decomposed the HD-EMG signals into MU discharge times in real time. Two CNN approaches are compared with the CKC: 1) multiple single-output deep CNN (SO-DCNN) with one MU decomposed per network, and 2) one multiple-output deep CNN (MO-DCNN) to decompose all MUs (up to 23) with one network. MAIN RESULTS The MO-DCNN outperformed the SO-DCNN in terms of training time (3.2 to 21.4 s/epoch vs. 6.5 to 47.8 s/epoch, respectively) and prediction time (0.04 vs. 0.27 s/sample, respectively). The optimal window size and step size for MO-DCNN were 120 and 20 data points, respectively. It results in sensitivity of 98% and 85% with simulated and experimentally recorded HD-EMG signals, respectively. There is a high cross-correlation coefficient between the neural drive estimated with CKC and that estimated with MO-DCNN (range of r-value across conditions: 0.88-0.95). SIGNIFICANCE We demonstrate the feasibility and the validity of using deep CNN to accurately identify MU activity from HD-EMG with a latency lower than 80 ms, which falls within the lower bound of the human electromechanical delay. This method opens many opportunities for using the neural drive to interface humans with assistive devices.
Collapse
Affiliation(s)
- Yue Wen
- Legs and Walking Lab, Shirley Ryan AbilityLab, 355 East Erie Street, Chicago, Illinois, 60611-2654, UNITED STATES
| | - Simon Avrillon
- Shirley Ryan AbilityLab, 355 E Erie St, Chicago, Illinois, 60601, UNITED STATES
| | - Julio Cesar Hernandez-Pavon
- Department of Physical Medicine and Rehabilitation, Northwestern University Feinberg School of Medicine, 251 E Huron St, Chicago, Illinois, 60611, UNITED STATES
| | - Sangjoon Jonathan Kim
- Shirley Ryan AbilityLab, 355 E Erie St, Chicago, Illinois, 60611-2654, UNITED STATES
| | - Francois Hug
- Laboratoire 'Motricite, Interactions, Performance', Universite de Nantes, JE 2438 UFRSTAPS,, 25 bis Guy Mollet BP 72206, Nantes, F-44000 France, Nantes, 72206, FRANCE
| | - Jose Luis Pons
- Bioengineering Group, Spanish Research Council, Serrano 117, Arganda del Rey (Madrid), 28006, SPAIN
| |
Collapse
|
31
|
Abstract
When nerves are damaged by trauma or disease, they are still capable of firing off electrical command signals that originate from the brain. Furthermore, those damaged nerves have an innate ability to partially regenerate, so they can heal from trauma and even reinnervate new muscle targets. For an amputee who has his/her damaged nerves surgically reconstructed, the electrical signals that are generated by the reinnervated muscle tissue can be sensed and interpreted with bioelectronics to control assistive devices or robotic prostheses. No two amputees will have identical physiologies because there are many surgical options for reconstructing residual limbs, which may in turn impact how well someone can interface with a robotic prosthesis later on. In this review, we aim to investigate what the literature has to say about different pathways for peripheral nerve regeneration and how each pathway can impact the neuromuscular tissue’s final electrophysiology. This information is important because it can guide us in planning the development of future bioelectronic devices, such as prosthetic limbs or neurostimulators. Future devices will primarily have to interface with tissue that has undergone some natural regeneration process, and so we have explored and reported here what is known about the bioelectrical features of neuromuscular tissue regeneration.
Collapse
|
32
|
Bräcklein M, Ibáñez J, Barsakcioglu DY, Farina D. Towards human motor augmentation by voluntary decoupling beta activity in the neural drive to muscle and force production. J Neural Eng 2021; 18. [PMID: 33237879 DOI: 10.1088/1741-2552/abcdbf] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Accepted: 11/25/2020] [Indexed: 11/12/2022]
Abstract
Objective.Effective human motor augmentation should rely on biological signals that can be volitionally modulated without compromising natural motor control.Approach.We provided human subjects with real-time information on the power of two separate spectral bands of the spiking activity of motor neurons innervating the tibialis anterior muscle: the low-frequency band (<7 Hz), which is directly translated into natural force control, and the beta band (13-30 Hz), which is outside the dynamics of the neuromuscular system.Main Results.Subjects could gain control over the powers in these two bands to navigate a cursor towards specific targets in a 2D space (experiment 1) and to up- and down-modulate beta activity while keeping steady force contractions (experiment 2).Significance.Results indicate that beta projections to the spinal motor neuron pool can be voluntarily controlled partially decoupled from natural muscle contractions and, therefore, they could be valid control signals for implementing effective human motor augmentation platforms.
Collapse
Affiliation(s)
- M Bräcklein
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London SW7 2AZ, United Kingdom
| | - J Ibáñez
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London SW7 2AZ, United Kingdom.,Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom
| | - D Y Barsakcioglu
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London SW7 2AZ, United Kingdom
| | - D Farina
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London SW7 2AZ, United Kingdom
| |
Collapse
|