1
|
Ma S, Mendez Guerra I, Caillet AH, Zhao J, Clarke AK, Maksymenko K, Deslauriers-Gauthier S, Sheng X, Zhu X, Farina D. NeuroMotion: Open-source platform with neuromechanical and deep network modules to generate surface EMG signals during voluntary movement. PLoS Comput Biol 2024; 20:e1012257. [PMID: 38959262 PMCID: PMC11251629 DOI: 10.1371/journal.pcbi.1012257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 07/16/2024] [Accepted: 06/15/2024] [Indexed: 07/05/2024] Open
Abstract
Neuromechanical studies investigate how the nervous system interacts with the musculoskeletal (MSK) system to generate volitional movements. Such studies have been supported by simulation models that provide insights into variables that cannot be measured experimentally and allow a large number of conditions to be tested before the experimental analysis. However, current simulation models of electromyography (EMG), a core physiological signal in neuromechanical analyses, remain either limited in accuracy and conditions or are computationally heavy to apply. Here, we provide a computational platform to enable future work to overcome these limitations by presenting NeuroMotion, an open-source simulator that can modularly test a variety of approaches to the full-spectrum synthesis of EMG signals during voluntary movements. We demonstrate NeuroMotion using three sample modules. The first module is an upper-limb MSK model with OpenSim API to estimate the muscle fibre lengths and muscle activations during movements. The second module is BioMime, a deep neural network-based EMG generator that receives nonstationary physiological parameter inputs, like the afore-estimated muscle fibre lengths, and efficiently outputs motor unit action potentials (MUAPs). The third module is a motor unit pool model that transforms the muscle activations into discharge timings of motor units. The discharge timings are convolved with the output of BioMime to simulate EMG signals during the movement. We first show how MUAP waveforms change during different levels of physiological parameter variations and different movements. We then show that the synthetic EMG signals during two-degree-of-freedom hand and wrist movements can be used to augment experimental data for regressing joint angles. Ridge regressors trained on the synthetic dataset were directly used to predict joint angles from experimental data. In this way, NeuroMotion was able to generate full-spectrum EMG for the first use-case of human forearm electrophysiology during voluntary hand, wrist, and forearm movements. All intermediate variables are available, which allows the user to study cause-effect relationships in the complex neuromechanical system, fast iterate algorithms before collecting experimental data, and validate algorithms that estimate non-measurable parameters in experiments. We expect this modular platform will enable validation of generative EMG models, complement experimental approaches and empower neuromechanical research.
Collapse
Affiliation(s)
- Shihan Ma
- Department of Bioengineering, Imperial College London, London, United Kingdom
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | - Irene Mendez Guerra
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | | | - Jiamin Zhao
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
| | | | | | | | - Xinjun Sheng
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
- Meta Robotics Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Xiangyang Zhu
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, China
- Meta Robotics Institute, Shanghai Jiao Tong University, Shanghai, China
| | - Dario Farina
- Department of Bioengineering, Imperial College London, London, United Kingdom
| |
Collapse
|
2
|
Abdelhady M, Damiano DL, Bulea TC. Knee Angle Estimation from Surface EMG during Walking Using Attention-Based Deep Recurrent Neural Networks: Feasibility and Initial Demonstration in Cerebral Palsy. SENSORS (BASEL, SWITZERLAND) 2024; 24:4217. [PMID: 39000996 PMCID: PMC11243788 DOI: 10.3390/s24134217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Revised: 06/15/2024] [Accepted: 06/25/2024] [Indexed: 07/16/2024]
Abstract
Accurately estimating knee joint angle during walking from surface electromyography (sEMG) signals can enable more natural control of wearable robotics like exoskeletons. However, challenges exist due to variability across individuals and sessions. This study evaluates an attention-based deep recurrent neural network combining gated recurrent units (GRUs) and an attention mechanism (AM) for knee angle estimation. Three experiments were conducted. First, the GRU-AM model was tested on four healthy adolescents, demonstrating improved estimation compared to GRU alone. A sensitivity analysis revealed that the key contributing muscles were the knee flexor and extensors, highlighting the ability of the AM to focus on the most salient inputs. Second, transfer learning was shown by pretraining the model on an open source dataset before additional training and testing on the four adolescents. Third, the model was progressively adapted over three sessions for one child with cerebral palsy (CP). The GRU-AM model demonstrated robust knee angle estimation across participants with healthy participants (mean RMSE 7 degrees) and participants with CP (RMSE 37 degrees). Further, estimation accuracy improved by 14 degrees on average across successive sessions of walking in the child with CP. These results demonstrate the feasibility of using attention-based deep networks for joint angle estimation in adolescents and clinical populations and support their further development for deployment in wearable robotics.
Collapse
Affiliation(s)
| | | | - Thomas C. Bulea
- Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD 20892, USA; (M.A.); (D.L.D.)
| |
Collapse
|
3
|
Chacon PFS, Hammer M, Wochner I, Walter JR, Schmitt S. A physiologically enhanced muscle spindle model: using a Hill-type model for extrafusal fibers as template for intrafusal fibers. Comput Methods Biomech Biomed Engin 2023:1-20. [PMID: 38126259 DOI: 10.1080/10255842.2023.2293652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 12/05/2023] [Indexed: 12/23/2023]
Abstract
The muscle spindle is an essential proprioceptor, significantly involved in sensing limb position and movement. Although biological spindle models exist for years, the gold-standard for motor control in biomechanics are still sensors built of homogenized spindle output models due to their simpler combination with neuro-musculoskeletal models. Aiming to improve biomechanical simulations, this work establishes a more physiological model of the muscle spindle, aligned to the advantage of easy integration into large-scale musculoskeletal models. We implemented four variations of a spindle model in Matlab/Simulink®: the Mileusnic et al. (2006) model, Mileusnic model without mass, our enhanced Hill-type model, and our enhanced Hill-type model with parallel damping element (PDE). Different stretches in the intrafusal fibers were simulated in all model variations following the spindle afferent recorded in previous experiments in feline soleus muscle. Additionally, the enhanced Hill-type models had their parameters extensively optimized to match the experimental conditions, and the resulting model was validated against data from rats' triceps surae muscle. As result, the Mileusnic models present a better overall performance generating the afferent firings compared to the common data evaluated. However, the enhanced Hill-type model with PDE exhibits a more stable performance than the original Mileusnic model, at the same time that presents a well-tuned Hill-type model as muscle spindle fibers, and also accounts for real sarcomere force-length and force-velocity aspects. Finally, our activation dynamics is similar to the one applied to Hill-type model for extrafusal fibers, making our proposed model more easily integrated in multi-body simulations.
Collapse
Affiliation(s)
- Pablo F S Chacon
- Institute for Modeling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
| | - Maria Hammer
- Institute for Modeling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
- Stuttgart Center for Simulation Science, University of Stuttgart, Stuttgart, Germany
| | - Isabell Wochner
- Institute for Modeling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
- Stuttgart Center for Simulation Science, University of Stuttgart, Stuttgart, Germany
- Institute of Computer Engineering, University of Heidelberg, Heidelberg, Germany
| | - Johannes R Walter
- Institute for Modeling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
- Max Planck Institute for Intelligent Systems, Stuttgart, Germany
| | - Syn Schmitt
- Institute for Modeling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
- Stuttgart Center for Simulation Science, University of Stuttgart, Stuttgart, Germany
| |
Collapse
|
4
|
Nölle LV, Alfaro EH, Martynenko OV, Schmitt S. An investigation of tendon strains in jersey finger injury load cases using a finite element neuromuscular human body model. Front Bioeng Biotechnol 2023; 11:1293705. [PMID: 38155925 PMCID: PMC10752991 DOI: 10.3389/fbioe.2023.1293705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 12/01/2023] [Indexed: 12/30/2023] Open
Abstract
Introduction: A common hand injury in American football, rugby and basketball is the so-called jersey finger injury (JFI), in which an eccentric overextension of the distal interphalangeal joint leads to an avulsion of the connected musculus flexor digitorum profundus (FDP) tendon. In the field of automotive safety assessment, finite element (FE) neuromuscular human body models (NHBMs) have been validated and are employed to evaluate different injury types related to car crash scenarios. The goal of this study is to show, how such a model can be modified to assess JFIs by adapting the hand of an FE-NHBM for the computational analysis of tendon strains during a generalized JFI load case. Methods: A jersey finger injury criterion (JFIC) covering the injury mechanisms of tendon straining and avulsion was defined based on biomechanical experiments found in the literature. The hand of the Total Human Model for Safety (THUMS) version 3.0 was combined with the musculature of THUMS version 5.03 to create a model with appropriate finger mobility. Muscle routing paths of FDP and musculus flexor digitorum superficialis (FDS) as well as tendon material parameters were optimized using literature data. A simplified JFI load case was simulated as the gripping of a cylindrical rod with finger flexor activation levels between 0% and 100%, which was then retracted with the velocity of a sprinting college football player to forcefully open the closed hand. Results: The optimization of the muscle routing node positions and tendon material parameters yielded good results with minimum normalized mean absolute error values of 0.79% and 7.16% respectively. Tendon avulsion injuries were detected in the middle and little finger for muscle activation levels of 80% and above, while no tendon or muscle strain injuries of any kind occurred. Discussion: The presented work outlines the steps necessary to adapt the hand model of a FE-NHBM for the assessment of JFIs using a newly defined injury criterion called the JFIC. The injury assessment results are in good agreement with documented JFI symptoms. At the same time, the need to rethink commonly asserted paradigms concerning the choice of muscle material parameters is highlighted.
Collapse
Affiliation(s)
- Lennart V. Nölle
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
| | - Eduardo Herrera Alfaro
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
| | - Oleksandr V. Martynenko
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
| | - Syn Schmitt
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Stuttgart, Germany
- Stuttgart Center for Simulation Science, University of Stuttgart, Stuttgart, Germany
| |
Collapse
|
5
|
Martynenko OV, Kempter F, Kleinbach C, Nölle LV, Lerge P, Schmitt S, Fehr J. Development and verification of a physiologically motivated internal controller for the open-source extended Hill-type muscle model in LS-DYNA. Biomech Model Mechanobiol 2023; 22:2003-2032. [PMID: 37542621 PMCID: PMC10613192 DOI: 10.1007/s10237-023-01748-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Accepted: 07/06/2023] [Indexed: 08/07/2023]
Abstract
Nowadays, active human body models are becoming essential tools for the development of integrated occupant safety systems. However, their broad application in industry and research is limited due to the complexity of incorporated muscle controllers, the long simulation runtime, and the non-regular use of physiological motor control approaches. The purpose of this study is to address the challenges in all indicated directions by implementing a muscle controller with several physiologically inspired control strategies into an open-source extended Hill-type muscle model formulated as LS-DYNA user-defined umat41 subroutine written in the Fortran programming language. This results in increased usability, runtime performance and physiological accuracy compared to the standard muscle material existing in LS-DYNA. The proposed controller code is verified with extensive experimental data that include findings for arm muscles, the cervical spine region, and the whole body. Selected verification experiments cover three different muscle activation situations: (1) passive state, (2) open-loop and closed-loop muscle activation, and (3) reflexive behaviour. Two whole body finite element models, the 50th percentile female VIVA OpenHBM and the 50th percentile male THUMS v5, are used for simulations, complemented by the simplified arm model extracted from the 50th percentile male THUMS v3. The obtained results are evaluated additionally with the CORrelation and Analysis methodology and the mean squared error method, showing good to excellent biofidelity and sufficient agreement with the experimental data. It was shown additionally how the integrated controller allows simplified mimicking of the movements for similar musculoskeletal models using the parameters transfer method. Furthermore, the Hill-type muscle model presented in this paper shows better kinematic behaviour even in the passive case compared to the existing one in LS-DYNA due to its improved damping and elastic properties. These findings provide a solid evidence base motivating the application of the enhanced muscle material with the internal controller in future studies with Active Human Body Models under different loading conditions.
Collapse
Affiliation(s)
- Oleksandr V Martynenko
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Nobelstr. 15, 70569, Stuttgart, Germany.
| | - Fabian Kempter
- Institute of Engineering and Computational Mechanics, University of Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany
| | - Christian Kleinbach
- Institute of Engineering and Computational Mechanics, University of Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany
| | - Lennart V Nölle
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Nobelstr. 15, 70569, Stuttgart, Germany
| | - Patrick Lerge
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Nobelstr. 15, 70569, Stuttgart, Germany
| | - Syn Schmitt
- Institute for Modelling and Simulation of Biomechanical Systems, University of Stuttgart, Nobelstr. 15, 70569, Stuttgart, Germany.
| | - Jörg Fehr
- Institute of Engineering and Computational Mechanics, University of Stuttgart, Pfaffenwaldring 9, 70569, Stuttgart, Germany
| |
Collapse
|
6
|
Jalali F, Nazari MA, Bahrami A, Perrier P, Payan Y. FIM: A fatigued-injured muscle model based on the sliding filament theory. Comput Biol Med 2023; 164:107367. [PMID: 37595519 DOI: 10.1016/j.compbiomed.2023.107367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Revised: 07/24/2023] [Accepted: 08/12/2023] [Indexed: 08/20/2023]
Abstract
Skeletal muscle modeling has a vital role in movement studies and the development of therapeutic approaches. In the current study, a Huxley-based model for skeletal muscle is proposed, which demonstrates the impact of impairments in muscle characteristics. This model focuses on three identified ions: H+, inorganic phosphate Pi, and Ca2+. Modifications are made to actin-myosin attachment and detachment rates to study the effects of H+ and Pi. Additionally, an activation coefficient is included to represent the role of calcium ions interacting with troponin, highlighting the importance of Ca2+. It is found that maximum isometric muscle force decreases by 9.5% due to a reduction in pH from 7.4 to 6.5 and by 47.5% in case of the combination of a reduction in pH and an increase of Pi concentration up to 30 mM, respectively. Then the force decline caused by a fall in the active calcium ions is studied. When only 15% of the total calcium in the myofibrillar space is able to interact with troponin, up to 80% force drop is anticipated by the model. The proposed fatigued-injured muscle model is useful to study the effect of various shortening velocities and initial muscle-tendon lengths on muscle force; in addition, the benefits of the model go beyond predicting the force in different conditions as it can also predict muscle stiffness and power. The power and stiffness decrease by 40% and 6.5%, respectively, due to the pH reduction, and the simultaneous accumulation of H+ and Pi leads to a 50% and 18% drop in power and stiffness.
Collapse
Affiliation(s)
- Fatemeh Jalali
- School of Mechanical Engineering, College of Engineering, University of Tehran, Tehran, Iran
| | - Mohammad Ali Nazari
- School of Mechanical Engineering, College of Engineering, University of Tehran, Tehran, Iran; Univ. Grenoble Alpes, CNRS, Grenoble INP, TIMC, 38000, Grenoble, France.
| | - Arash Bahrami
- School of Mechanical Engineering, College of Engineering, University of Tehran, Tehran, Iran
| | - Pascal Perrier
- Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, 38000, Grenoble, France
| | - Yohan Payan
- Univ. Grenoble Alpes, CNRS, Grenoble INP, TIMC, 38000, Grenoble, France
| |
Collapse
|
7
|
Abdelhady M, Damiano DL, Bulea TC. Attention-Based Deep Recurrent Neural Network to Estimate Knee Angle During Walking from Lower-Limb EMG. IEEE Int Conf Rehabil Robot 2023; 2023:1-6. [PMID: 37941224 DOI: 10.1109/icorr58425.2023.10304604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
Accurate prediction of joint angle during walking from surface electromyography (sEMG) offers the potential to infer movement intention and therefore represents a potentially useful approach for adaptive control of wearable robotics. Here, we present the use of a recurrent neural network (RNN) with gated recurrent units (GRUs) and an attention mechanism to estimate knee angle during overground walking from sEMG and its initial offline validation in healthy adolescents. Our results show that the attention mechanism improved estimation accuracy by focusing on the most relevant parts of the input dataset within each time window, particularly muscles active during knee excursion. Sensitivity analysis revealed knee extensor and flexor muscles to be most salient in accurately estimating joint angle. Additionally, we demonstrate the ability of the GRU-RNN approach to accurately estimate knee angle during overground walking in a child with cerebral palsy (CP) in the presence of exoskeleton knee extension assistance. Collectively, our findings establish the initial feasibility of using this approach to estimate user movement from sEMG, which is particularly important for developing robotic exoskeletons for children with neuromuscular disorders such as CP.
Collapse
|
8
|
Zhao Y, Zhang M, Wu H, He X, Todoh M. Neuromechanics-Based Neural Feedback Controller for Planar Arm Reaching Movements. Bioengineering (Basel) 2023; 10:bioengineering10040436. [PMID: 37106623 PMCID: PMC10136284 DOI: 10.3390/bioengineering10040436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 03/22/2023] [Accepted: 03/24/2023] [Indexed: 04/29/2023] Open
Abstract
Based on the principles of neuromechanics, human arm movements result from the dynamic interaction between the nervous, muscular, and skeletal systems. To develop an effective neural feedback controller for neuro-rehabilitation training, it is important to consider both the effects of muscles and skeletons. In this study, we designed a neuromechanics-based neural feedback controller for arm reaching movements. To achieve this, we first constructed a musculoskeletal arm model based on the actual biomechanical structure of the human arm. Subsequently, a hybrid neural feedback controller was developed that mimics the multifunctional areas of the human arm. The performance of this controller was then validated through numerical simulation experiments. The simulation results demonstrated a bell-shaped movement trajectory, consistent with the natural motion of human arm movements. Furthermore, the experiment testing the tracking ability of the controller revealed real-time errors within one millimeter, with the tensile force generated by the controller's muscles being stable and maintained at a low value, thereby avoiding the issue of muscle strain that can occur due to excessive excitation during the neurorehabilitation process.
Collapse
Affiliation(s)
- Yongkun Zhao
- Division of Human Mechanical Systems and Design, Graduate School of Engineering, Hokkaido University, Sapporo 060-8628, Japan
- Division of Bioengineering, Graduate School of Engineering Science, Osaka University, Osaka 560-8531, Japan
| | - Mingquan Zhang
- State Key Laboratory of Bioelectronics, Jiangsu Provincial Key Laboratory of Remote Measurement and Control, School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
| | - Haijun Wu
- Division of Mechanical and Aerospace Engineering, Faculty of Engineering, Hokkaido University, Sapporo 060-8628, Japan
| | - Xiangkun He
- Department of Bioengineering, Faculty of Engineering, Imperial College London, London SW7 2AZ, UK
| | - Masahiro Todoh
- Division of Mechanical and Aerospace Engineering, Faculty of Engineering, Hokkaido University, Sapporo 060-8628, Japan
| |
Collapse
|