1
|
Huang HH, Hargrove LJ, Ortiz-Catalan M, Sensinger JW. Integrating Upper-Limb Prostheses with the Human Body: Technology Advances, Readiness, and Roles in Human-Prosthesis Interaction. Annu Rev Biomed Eng 2024; 26:503-528. [PMID: 38594922 DOI: 10.1146/annurev-bioeng-110222-095816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/11/2024]
Abstract
Significant advances in bionic prosthetics have occurred in the past two decades. The field's rapid expansion has yielded many exciting technologies that can enhance the physical, functional, and cognitive integration of a prosthetic limb with a human. We review advances in the engineering of prosthetic devices and their interfaces with the human nervous system, as well as various surgical techniques for altering human neuromusculoskeletal systems for seamless human-prosthesis integration. We discuss significant advancements in research and clinical translation, focusing on upper limbprosthetics since they heavily rely on user intent for daily operation, although many discussed technologies have been extended to lower limb prostheses as well. In addition, our review emphasizes the roles of advanced prosthetics technologies in complex interactions with humans and the technology readiness levels (TRLs) of individual research advances. Finally, we discuss current gaps and controversies in the field and point out future research directions, guided by TRLs.
Collapse
Affiliation(s)
- He Helen Huang
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, North Carolina, USA;
| | - Levi J Hargrove
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, Illinois, USA
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, Illinois, USA
| | - Max Ortiz-Catalan
- Medical Bionics Department, University of Melbourne, Melbourne, Australia
- Bionics Institute, Melbourne, Australia
| | - Jonathon W Sensinger
- Institute of Biomedical Engineering, University of New Brunswick, Fredericton, New Brunswick, Canada;
| |
Collapse
|
2
|
Zhang L, Van Wouwe T, Yan S, Wang R. EMG-Constrained and Ultrasound-Informed Muscle-Tendon Parameter Estimation in Post-Stroke Hemiparesis. IEEE Trans Biomed Eng 2024; 71:1798-1809. [PMID: 38206783 DOI: 10.1109/tbme.2024.3352556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2024]
Abstract
Secondary morphological and mechanical property changes in the muscle-tendon unit at the ankle joint are often observed in post-stroke individuals. These changes may alter the force generation capacity and affect daily activities such as locomotion. This work aimed to estimate subject-specific muscle-tendon parameters in individuals after stroke by solving the muscle redundancy problem using direct collocation optimal control methods based on experimental electromyography (EMG) signals and measured muscle fiber length. Subject-specific muscle-tendon parameters of the gastrocnemius, soleus, and tibialis anterior were estimated in seven post-stroke individuals and seven healthy controls. We found that the maximum isometric force, tendon stiffness and optimal fiber length in the post-stroke group were considerably lower than in the control group. We also computed the root mean square error between estimated and experimental values of muscle excitation and fiber length. The musculoskeletal model with estimated subject-specific muscle tendon parameters (from the muscle redundancy solver), yielded better muscle excitation and fiber length estimations than did scaled generic parameters. Our findings also showed that the muscle redundancy solver can estimate muscle-tendon parameters that produce force behavior in better accordance with the experimentally-measured value. These muscle-tendon parameters in the post-stroke individuals were physiologically meaningful and may shed light on treatment and/or rehabilitation planning.
Collapse
|
3
|
Wei Z, Zhang ZQ, Xie SQ. Continuous Motion Intention Prediction Using sEMG for Upper-Limb Rehabilitation: A Systematic Review of Model-Based and Model-Free Approaches. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1487-1504. [PMID: 38557618 DOI: 10.1109/tnsre.2024.3383857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Upper limb functional impairments persisting after stroke significantly affect patients' quality of life. Precise adjustment of robotic assistance levels based on patients' motion intentions using sEMG signals is crucial for active rehabilitation. This paper systematically reviews studies on continuous prediction of upper limb single joints and multi-joint combinations motion intention using Model-Based (MB) and Model-Free (MF) approaches over the past decade, based on 186 relevant studies screened from six major electronic databases. The findings indicate ongoing challenges in terms of subject composition, algorithm robustness and generalization, and algorithm feasibility for practical applications. Moreover, it suggests integrating the strengths of both MB and MF approaches to improve existing algorithms. Therefore, future research should further explore personalized MB-MF combination methods incorporating deep learning, attention mechanisms, muscle synergy features, motor unit features, and closed-loop feedback to achieve precise, real-time, and long-duration prediction of multi-joint complex movements, while further refining the transfer learning strategy for rapid algorithm deployment across days and subjects. Overall, this review summarizes the current research status, significant findings, and challenges, aiming to inspire future research on predicting upper limb motion intentions based on sEMG.
Collapse
|
4
|
Cop CP, Jakubowski KL, Schouten AC, Koopman B, Perreault EJ, Sartori M. The Simultaneous Model-Based Estimation of Joint, Muscle, and Tendon Stiffness is Highly Sensitive to the Tendon Force-Strain Relationship. IEEE Trans Biomed Eng 2024; 71:987-997. [PMID: 37831575 PMCID: PMC10960253 DOI: 10.1109/tbme.2023.3324485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2023]
Abstract
OBJECTIVE Accurate estimation of stiffness across anatomical levels (i.e., joint, muscle, and tendon) in vivo has long been a challenge in biomechanics. Recent advances in electromyography (EMG)-driven musculoskeletal modeling have allowed the non-invasive estimation of stiffness during dynamic joint rotations. Nevertheless, validation has been limited to the joint level due to a lack of simultaneous in vivo experimental measurements of muscle and tendon stiffness. METHODS With a focus on the triceps surae, we employed a novel perturbation-based experimental technique informed by dynamometry and ultrasonography to derive reference stiffness at the joint, muscle, and tendon levels simultaneously. Here, we propose a new EMG-driven model-based approach that does not require external joint perturbation, nor ultrasonography, to estimate multi-level stiffness. We present a novel set of closed-form equations that enables the person-specific tuning of musculoskeletal parameters dictating biological stiffness, including passive force-length relationships in modeled muscles and tendons. RESULTS Calibrated EMG-driven musculoskeletal models estimated the reference data with average normalized root-mean-square error ≈ 20%. Moreover, only when calibrated tendons were approximately four times more compliant than typically modeled, our approach could estimate multi-level reference stiffness. CONCLUSION EMG-driven musculoskeletal models can be calibrated on a larger set of reference data to provide more realistic values for the biomechanical variables across multiple anatomical levels. Moreover, the tendon models that are typically used in musculoskeletal modeling are too stiff. SIGNIFICANCE Calibrated musculoskeletal models informed by experimental measurements give access to an augmented range of biomechanical variables that might not be easily measured with sensors alone.
Collapse
|
5
|
Shi E, Zhi W, Chen W, Han Y, Zhang B, Zhao X. Design and assessment of a reconfigurable behavioral assistive robot: a pilot study. Front Neurorobot 2024; 18:1332721. [PMID: 38419818 PMCID: PMC10899700 DOI: 10.3389/fnbot.2024.1332721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 01/23/2024] [Indexed: 03/02/2024] Open
Abstract
Introduction For patients with functional motor disorders of the lower limbs due to brain damage or accidental injury, restoring the ability to stand and walk plays an important role in clinical rehabilitation. Lower limb exoskeleton robots generally require patients to convert themselves to a standing position for use, while being a wearable device with limited movement distance. Methods This paper proposes a reconfigurable behavioral assistive robot that integrates the functions of an exoskeleton robot and an assistive standing wheelchair through a novel mechanism. The new mechanism is based on a four-bar linkage, and through simple and stable conformal transformations, the robot can switch between exoskeleton state, sit-to-stand support state, and wheelchair state. This enables the robot to achieve the functions of assisted walking, assisted standing up, supported standing and wheelchair mobility, respectively, thereby meeting the daily activity needs of sit-to-stand transitions and gait training. The configuration transformation module controls seamless switching between different configurations through an industrial computer. Experimental protocols have been developed for wearable testing of robotic prototypes not only for healthy subjects but also for simulated hemiplegic patients. Results The experimental results indicate that the gait tracking effect during robot-assisted walking is satisfactory, and there are no sudden speed changes during the assisted standing up process, providing smooth support to the wearer. Meanwhile, the activation of the main force-generating muscles of the legs and the plantar pressure decreases significantly in healthy subjects and simulated hemiplegic patients wearing the robot for assisted walking and assisted standing-up compared to the situation when the robot is not worn. Discussion These experimental findings demonstrate that the reconfigurable behavioral assistive robot prototype of this study is effective, reducing the muscular burden on the wearer during walking and standing up, and provide effective support for the subject's body. The experimental results objectively and comprehensively showcase the effectiveness and potential of the reconfigurable behavioral assistive robot in the realms of behavioral assistance and rehabilitation training.
Collapse
Affiliation(s)
- Enming Shi
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Wenzhuo Zhi
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Wanxin Chen
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Yuhang Han
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China
- School of Mechanical Engineering and Automation Northeastern University, Northeastern University, Shenyang, China
| | - Bi Zhang
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xingang Zhao
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang, China
- University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
6
|
Mohamed Refai MI, Moya-Esteban A, Sartori M. Electromyography-driven musculoskeletal models with time-varying fatigue dynamics improve lumbosacral joint moments during lifting. J Biomech 2024; 164:111987. [PMID: 38342053 DOI: 10.1016/j.jbiomech.2024.111987] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 01/29/2024] [Accepted: 02/04/2024] [Indexed: 02/13/2024]
Abstract
Muscle fatigue is prevalent across different aspects of daily life. Tracking muscle fatigue is useful to understand muscle overuse and possible risk of injury leading to musculoskeletal disorders. Current fatigue models are not suitable for real-world settings as they are either validated using simulations or non-functional tasks. Moreover, models that capture the changes to muscle activity due to fatigue either assume a linear relationship between muscle activity and muscle force or utilize a simple muscle model. Personalised electromygraphy (EMG)-driven musculoskeletal models (pEMS) offer person-specific approaches to model muscle and joint kinetics during a wide repertoire of daily life tasks. These models utilize EMG, thus capturing central fatigue-dependent changes in multi-muscle bio-electrical activity. However, the peripheral muscle force decay is missing in these models. Thus, we studied the influence of fatigue on a large scale pEMS of the trunk. Eleven healthy participants performed functional asymmetric lifting task. Average peak body-weight normalized lumbosacral moments (BW-LM) were estimated to be 2.55 ± 0.26 Nm/kg by reference inverse dynamics. After complete exhaustion of the lower back, the pEMS overestimated the peak BW-LM by 0.64 ± 0.37 Nm/kg. Then, we developed a time-varying muscle force decay model resulting in a time-varying pEMS (t-pEMS). This reduced the difference between BW-LM estimated by the t-pEMS and reference to 0.49 ± 0.14 Nm/kg. We also showed that five fatiguing contractions are sufficient to calibrate the t-pEMS. Thus, this study presents a person and muscle specific model to track fatigue during functional tasks.
Collapse
Affiliation(s)
| | - Alejandro Moya-Esteban
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| | - Massimo Sartori
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| |
Collapse
|
7
|
Babcock CD, Volk VL, Zeng W, Hamilton LD, Shelburne KB, Fitzpatrick CK. Neural-driven activation of 3D muscle within a finite element framework: exploring applications in healthy and neurodegenerative simulations. Comput Methods Biomech Biomed Engin 2023:1-11. [PMID: 37966863 PMCID: PMC11093887 DOI: 10.1080/10255842.2023.2280772] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 11/02/2023] [Indexed: 11/16/2023]
Abstract
This paper presents a novel computational framework for neural-driven finite element muscle models, with an application to amyotrophic lateral sclerosis (ALS). The multiscale neuromusculoskeletal (NMS) model incorporates physiologically accurate motor neurons, 3D muscle geometry, and muscle fiber recruitment. It successfully predicts healthy muscle force and tendon elongation and demonstrates a progressive decline in muscle force due to ALS, dropping from 203 N (healthy) to 155 N (120 days after ALS onset). This approach represents a preliminary step towards developing integrated neural and musculoskeletal simulations to enhance our understanding of neurodegenerative and neurodevelopmental conditions through predictive NMS models.
Collapse
Affiliation(s)
- Colton D. Babcock
- Mechanical and Biomedical Engineering, Boise State University, Boise, ID
| | - Victoria L. Volk
- Mechanical and Biomedical Engineering, Boise State University, Boise, ID
| | - Wei Zeng
- Department of Mechanical Engineering, New York Institute of Technology, New York, NY
| | | | | | | |
Collapse
|
8
|
Lloyd DG, Jonkers I, Delp SL, Modenese L. The History and Future of Neuromusculoskeletal Biomechanics. J Appl Biomech 2023; 39:273-283. [PMID: 37751904 DOI: 10.1123/jab.2023-0165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 07/04/2023] [Accepted: 07/05/2023] [Indexed: 09/28/2023]
Abstract
The Executive Council of the International Society of Biomechanics has initiated and overseen the commemorations of the Society's 50th Anniversary in 2023. This included multiple series of lectures at the ninth World Congress of Biomechanics in 2022 and XXIXth Congress of the International Society of Biomechanics in 2023, all linked to special issues of International Society of Biomechanics' affiliated journals. This special issue of the Journal of Applied Biomechanics is dedicated to the biomechanics of the neuromusculoskeletal system. The reader is encouraged to explore this special issue which comprises 6 papers exploring the current state-of the-art, and future directions and roles for neuromusculoskeletal biomechanics. This editorial presents a very brief history of the science of the neuromusculoskeletal system's 4 main components: the central nervous system, musculotendon units, the musculoskeletal system, and joints, and how they biomechanically integrate to enable an understanding of the generation and control of human movement. This also entails a quick exploration of contemporary neuromusculoskeletal biomechanics and its future with new fields of application.
Collapse
Affiliation(s)
- David G Lloyd
- Griffith Centre of Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland and Advanced Design and Prototyping Technologies Institute, School of Health Science and Social Work, Griffith University, Gold Coast, QLD, Australia
| | - Ilse Jonkers
- Institute of Physics-Based Modeling for in Silico Health, Human Movement Science Department, KU Leuven, Leuven, Belgium
| | - Scott L Delp
- Bioengineering, Mechanical Engineering and Orthopedic Surgery, and Wu Tsai Human Performance Alliance at Stanford, Stanford University, Stanford, CA, USA
| | - Luca Modenese
- Graduate School of Biomedical Engineering, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
9
|
Mahdian ZS, Wang H, Refai MIM, Durandau G, Sartori M, MacLean MK. Tapping Into Skeletal Muscle Biomechanics for Design and Control of Lower Limb Exoskeletons: A Narrative Review. J Appl Biomech 2023; 39:318-333. [PMID: 37751903 DOI: 10.1123/jab.2023-0046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 08/11/2023] [Accepted: 08/18/2023] [Indexed: 09/28/2023]
Abstract
Lower limb exoskeletons and exosuits ("exos") are traditionally designed with a strong focus on mechatronics and actuation, whereas the "human side" is often disregarded or minimally modeled. Muscle biomechanics principles and skeletal muscle response to robot-delivered loads should be incorporated in design/control of exos. In this narrative review, we summarize the advances in literature with respect to the fusion of muscle biomechanics and lower limb exoskeletons. We report methods to measure muscle biomechanics directly and indirectly and summarize the studies that have incorporated muscle measures for improved design and control of intuitive lower limb exos. Finally, we delve into articles that have studied how the human-exo interaction influences muscle biomechanics during locomotion. To support neurorehabilitation and facilitate everyday use of wearable assistive technologies, we believe that future studies should investigate and predict how exoskeleton assistance strategies would structurally remodel skeletal muscle over time. Real-time mapping of the neuromechanical origin and generation of muscle force resulting in joint torques should be combined with musculoskeletal models to address time-varying parameters such as adaptation to exos and fatigue. Development of smarter predictive controllers that steer rather than assist biological components could result in a synchronized human-machine system that optimizes the biological and electromechanical performance of the combined system.
Collapse
Affiliation(s)
- Zahra S Mahdian
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| | - Huawei Wang
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| | | | - Guillaume Durandau
- Department of Mechanical Engineering, McGill University, Montreal, QC, Canada
| | - Massimo Sartori
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| | - Mhairi K MacLean
- Department of Biomechanical Engineering, University of Twente, Enschede, the Netherlands
| |
Collapse
|
10
|
Zhang L, Soselia D, Wang R, Gutierrez-Farewik EM. Estimation of Joint Torque by EMG-Driven Neuromusculoskeletal Models and LSTM Networks. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3722-3731. [PMID: 37708013 DOI: 10.1109/tnsre.2023.3315373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/16/2023]
Abstract
Accurately predicting joint torque using wearable sensors is crucial for designing assist-as-needed exoskeleton controllers to assist muscle-generated torque and ensure successful task performance. In this paper, we estimated ankle dorsiflexion/plantarflexion, knee flexion/extension, hip flexion/extension, and hip abduction/adduction torques from electromyography (EMG) and kinematics during daily activities using neuromusculoskeletal (NMS) models and long short-term memory (LSTM) networks. The joint torque ground truth for model calibrating and training was obtained through inverse dynamics of captured motion data. A cluster approach that grouped movements based on characteristic similarity was implemented, and its ability to improve the estimation accuracy of both NMS and LSTM models was evaluated. We compared torque estimation accuracy of NMS and LSTM models in three cases: Pooled, Individual, and Clustered models. Pooled models used data from all 10 movements to calibrate or train one model, Individual models used data from each individual movement, and Clustered models used data from each cluster. Individual, Clustered and Pooled LSTM models all had relatively high joint torque estimation accuracy. Individual and Clustered NMS models had similarly good estimation performance whereas the Pooled model may be too generic to satisfy all movement patterns. While the cluster approach improved the estimation accuracy in NMS models in some movements, it made relatively little difference in the LSTM neural networks, which already had high estimation accuracy. Our study provides practical implications for designing assist-as-needed exoskeleton controllers by offering guidelines for selecting the appropriate model for different scenarios, and has potential to enhance the functionality of wearable exoskeletons and improve rehabilitation and assistance for individuals with motor disorders.
Collapse
|
11
|
Hambly MJ, De Sousa ACC, Lloyd DG, Pizzolato C. EMG-Informed Neuromusculoskeletal Modelling Estimates Muscle Forces and Joint Moments During Electrical Stimulation. IEEE Int Conf Rehabil Robot 2023; 2023:1-6. [PMID: 37941242 DOI: 10.1109/icorr58425.2023.10304785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
This study implemented an electromyogram (EMG)-informed neuromusculoskeletal (NMS) model evaluating the volitional contributions to muscle forces and joint moments during functional electrical stimulation (FES). The NMS model was calibrated using motion and EMG (biceps brachii and triceps brachii) data recorded from able-bodied participants (n=3) performing weighted elbow flexion and extension cycling movements while equipped with an EMG-controlled closed-loop FES system. Models were executed using three computational approaches (i) EMG-driven, (ii) EMG-hybrid and (iii) EMG-assisted to estimate muscle forces and joint moments. Both EMG-hybrid and EMG-assisted modes were able estimate the elbow moment (root mean squared error and coefficient of determination), but the EMG-hybrid method also enabled quantifying the volitional contributions to muscle forces and elbow moments during FES. The proposed modelling method allows for assessing volitional contributions of patients to muscle force during FES rehabilitation, and could be used as biomarkers of recovery, biofeedback, and for real-time control of combined FES and robotic systems.
Collapse
|
12
|
Zhang L, Zhang X, Zhu X, Wang R, Gutierrez-Farewik EM. Neuromusculoskeletal model-informed machine learning-based control of a knee exoskeleton with uncertainties quantification. Front Neurosci 2023; 17:1254088. [PMID: 37712095 PMCID: PMC10498472 DOI: 10.3389/fnins.2023.1254088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 08/11/2023] [Indexed: 09/16/2023] Open
Abstract
Introduction Research interest in exoskeleton assistance strategies that incorporate the user's torque capacity is growing rapidly. However, the predicted torque capacity from users often includes uncertainty from various sources, which can have a significant impact on the safety of the exoskeleton-user interface. Methods To address this challenge, this paper proposes an adaptive control framework for a knee exoskeleton that uses muscle electromyography (EMG) signals and joint kinematics. The framework predicted the user's knee flexion/extension torque with confidence bounds to quantify the uncertainty based on a neuromusculoskeletal (NMS) solver-informed Bayesian Neural Network (NMS-BNN). The predicted torque, with a specified confidence level, controlled the assistive torque provided by the exoskeleton through a TCP/IP stream. The performance of the NMS-BNN model was also compared to that of the Gaussian process (NMS-GP) model. Results Our findings showed that both the NMS-BNN and NMS-GP models accurately predicted knee joint torque with low error, surpassing traditional NMS models. High uncertainties were observed at the beginning of each movement, and at terminal stance and terminal swing in self-selected speed walking in both NMS-BNN and NMS-GP models. The knee exoskeleton provided the desired assistive torque with a low error, although lower torque was observed during terminal stance of fast walking compared to self-selected walking speed. Discussion The framework developed in this study was able to predict knee flexion/extension torque with quantifiable uncertainty and to provide adaptive assistive torque to the user. This holds significant potential for the development of exoskeletons that provide assistance as needed, with a focus on the safety of the exoskeleton-user interface.
Collapse
Affiliation(s)
- Longbin Zhang
- KTH MoveAbility Lab, Department of Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Xiaochen Zhang
- KTH MoveAbility Lab, Department of Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Xueyu Zhu
- Department of Mathematics, University of Iowa, Iowa City, IA, United States
| | - Ruoli Wang
- KTH MoveAbility Lab, Department of Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Elena M. Gutierrez-Farewik
- KTH MoveAbility Lab, Department of Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden
| |
Collapse
|
13
|
Chen Z, Min H, Wang D, Xia Z, Sun F, Fang B. A Review of Myoelectric Control for Prosthetic Hand Manipulation. Biomimetics (Basel) 2023; 8:328. [PMID: 37504216 PMCID: PMC10807628 DOI: 10.3390/biomimetics8030328] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 07/14/2023] [Accepted: 07/19/2023] [Indexed: 07/29/2023] Open
Abstract
Myoelectric control for prosthetic hands is an important topic in the field of rehabilitation. Intuitive and intelligent myoelectric control can help amputees to regain upper limb function. However, current research efforts are primarily focused on developing rich myoelectric classifiers and biomimetic control methods, limiting prosthetic hand manipulation to simple grasping and releasing tasks, while rarely exploring complex daily tasks. In this article, we conduct a systematic review of recent achievements in two areas, namely, intention recognition research and control strategy research. Specifically, we focus on advanced methods for motion intention types, discrete motion classification, continuous motion estimation, unidirectional control, feedback control, and shared control. In addition, based on the above review, we analyze the challenges and opportunities for research directions of functionality-augmented prosthetic hands and user burden reduction, which can help overcome the limitations of current myoelectric control research and provide development prospects for future research.
Collapse
Affiliation(s)
- Ziming Chen
- Laboratory for Embedded System and Intelligent Robot, Wuhan University of Science and Technology, Wuhan 430081, China; (Z.C.); (H.M.)
| | - Huasong Min
- Laboratory for Embedded System and Intelligent Robot, Wuhan University of Science and Technology, Wuhan 430081, China; (Z.C.); (H.M.)
| | - Dong Wang
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Ziwei Xia
- School of Engineering and Technology, China University of Geosciences, Beijing 100083, China
| | - Fuchun Sun
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Bin Fang
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| |
Collapse
|
14
|
Sharifi-Renani M, Mahoor MH, Clary CW. BioMAT: An Open-Source Biomechanics Multi-Activity Transformer for Joint Kinematic Predictions Using Wearable Sensors. SENSORS (BASEL, SWITZERLAND) 2023; 23:5778. [PMID: 37447628 DOI: 10.3390/s23135778] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 06/08/2023] [Accepted: 06/15/2023] [Indexed: 07/15/2023]
Abstract
Through wearable sensors and deep learning techniques, biomechanical analysis can reach beyond the lab for clinical and sporting applications. Transformers, a class of recent deep learning models, have become widely used in state-of-the-art artificial intelligence research due to their superior performance in various natural language processing and computer vision tasks. The performance of transformer models has not yet been investigated in biomechanics applications. In this study, we introduce a Biomechanical Multi-activity Transformer-based model, BioMAT, for the estimation of joint kinematics from streaming signals of multiple inertia measurement units (IMUs) using a publicly available dataset. This dataset includes IMU signals and the corresponding sagittal plane kinematics of the hip, knee, and ankle joints during multiple activities of daily living. We evaluated the model's performance and generalizability and compared it against a convolutional neural network long short-term model, a bidirectional long short-term model, and multi-linear regression across different ambulation tasks including level ground walking (LW), ramp ascent (RA), ramp descent (RD), stair ascent (SA), and stair descent (SD). To investigate the effect of different activity datasets on prediction accuracy, we compared the performance of a universal model trained on all activities against task-specific models trained on individual tasks. When the models were tested on three unseen subjects' data, BioMAT outperformed the benchmark models with an average root mean square error (RMSE) of 5.5 ± 0.5°, and normalized RMSE of 6.8 ± 0.3° across all three joints and all activities. A unified BioMAT model demonstrated superior performance compared to individual task-specific models across four of five activities. The RMSE values from the universal model for LW, RA, RD, SA, and SD activities were 5.0 ± 1.5°, 6.2 ± 1.1°, 5.8 ± 1.1°, 5.3 ± 1.6°, and 5.2 ± 0.7° while these values for task-specific models were, 5.3 ± 2.1°, 6.7 ± 2.0°, 6.9 ± 2.2°, 4.9 ± 1.4°, and 5.6 ± 1.3°, respectively. Overall, BioMAT accurately estimated joint kinematics relative to previous machine learning algorithms across different activities directly from the sequence of IMUs signals instead of time-normalized gait cycle data.
Collapse
Affiliation(s)
| | - Mohammad H Mahoor
- Computer Vision and Social Robotics Laboratory, University of Denver, Denver, CO 80208, USA
| | - Chadd W Clary
- Center for Orthopaedic Biomechanics, University of Denver, Denver, CO 80208, USA
| |
Collapse
|
15
|
Nizamis K, Ayvaz A, Rijken NHM, Koopman BFJM, Sartori M. Real-time myoelectric control of wrist/hand motion in Duchenne muscular dystrophy: A case study. Front Robot AI 2023; 10:1100411. [PMID: 37090893 PMCID: PMC10116050 DOI: 10.3389/frobt.2023.1100411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Accepted: 03/21/2023] [Indexed: 04/09/2023] Open
Abstract
Introduction: Duchenne muscular dystrophy (DMD) is a genetic disorder that induces progressive muscular degeneration. Currently, the increase in DMD individuals' life expectancy is not being matched by an increase in quality of life. The functioning of the hand and wrist is central for performing daily activities and for providing a higher degree of independence. Active exoskeletons can assist this functioning but require the accurate decoding of the users' motor intention. These methods have, however, never been systematically analyzed in the context of DMD. Methods: This case study evaluated direct control (DC) and pattern recognition (PR), combined with an admittance model. This enabled customization of myoelectric controllers to one DMD individual and to a control population of ten healthy participants during a target-reaching task in 1- and 2- degrees of freedom (DOF). We quantified real-time myocontrol performance using target reaching times and compared the differences between the healthy individuals and the DMD individual. Results and Discussion: Our findings suggest that despite the muscle tissue degeneration, the myocontrol performance of the DMD individual was comparable to that of the healthy individuals in both DOFs and with both control approaches. It was also evident that PR control performed better for the 2-DOF tasks for both DMD and healthy participants, while DC performed better for the 1-DOF tasks. The insights gained from this study can lead to further developments for the intuitive multi-DOF myoelectric control of active hand exoskeletons for individuals with DMD.
Collapse
Affiliation(s)
- Kostas Nizamis
- Systems Engineering and Multidisciplinary Design Group, Department of Design, Production, and Management, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| | - Anıl Ayvaz
- Neuromechanical Modelling and Engineering lab, Department of Biomechanical Engineering, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| | - Noortje H. M. Rijken
- Research Group Smart Health, Saxion University of Applied Sciences, Enschede, Netherlands
| | - Bart F. J. M. Koopman
- Neuromechanical Modelling and Engineering lab, Department of Biomechanical Engineering, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| | - Massimo Sartori
- Neuromechanical Modelling and Engineering lab, Department of Biomechanical Engineering, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| |
Collapse
|
16
|
Farina D, Vujaklija I, Brånemark R, Bull AMJ, Dietl H, Graimann B, Hargrove LJ, Hoffmann KP, Huang HH, Ingvarsson T, Janusson HB, Kristjánsson K, Kuiken T, Micera S, Stieglitz T, Sturma A, Tyler D, Weir RFF, Aszmann OC. Toward higher-performance bionic limbs for wider clinical use. Nat Biomed Eng 2023; 7:473-485. [PMID: 34059810 DOI: 10.1038/s41551-021-00732-x] [Citation(s) in RCA: 96] [Impact Index Per Article: 96.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2019] [Accepted: 04/01/2021] [Indexed: 12/19/2022]
Abstract
Most prosthetic limbs can autonomously move with dexterity, yet they are not perceived by the user as belonging to their own body. Robotic limbs can convey information about the environment with higher precision than biological limbs, but their actual performance is substantially limited by current technologies for the interfacing of the robotic devices with the body and for transferring motor and sensory information bidirectionally between the prosthesis and the user. In this Perspective, we argue that direct skeletal attachment of bionic devices via osseointegration, the amplification of neural signals by targeted muscle innervation, improved prosthesis control via implanted muscle sensors and advanced algorithms, and the provision of sensory feedback by means of electrodes implanted in peripheral nerves, should all be leveraged towards the creation of a new generation of high-performance bionic limbs. These technologies have been clinically tested in humans, and alongside mechanical redesigns and adequate rehabilitation training should facilitate the wider clinical use of bionic limbs.
Collapse
Affiliation(s)
- Dario Farina
- Department of Bioengineering, Imperial College London, London, UK.
| | - Ivan Vujaklija
- Department of Electrical Engineering and Automation, Aalto University, Espoo, Finland
| | - Rickard Brånemark
- Center for Extreme Bionics, Biomechatronics Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Anthony M J Bull
- Department of Bioengineering, Imperial College London, London, UK
| | - Hans Dietl
- Ottobock Products SE & Co. KGaA, Vienna, Austria
| | | | - Levi J Hargrove
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, USA
- Department of Physical Medicine & Rehabilitation, Northwestern University, Chicago, IL, USA
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, USA
| | - Klaus-Peter Hoffmann
- Department of Medical Engineering & Neuroprosthetics, Fraunhofer-Institut für Biomedizinische Technik, Sulzbach, Germany
| | - He Helen Huang
- NCSU/UNC Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC, USA
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Thorvaldur Ingvarsson
- Department of Research and Development, Össur Iceland, Reykjavík, Iceland
- Faculty of Medicine, University of Iceland, Reykjavík, Iceland
| | - Hilmar Bragi Janusson
- School of Engineering and Natural Sciences, University of Iceland, Reykjavík, Iceland
| | | | - Todd Kuiken
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, USA
- Department of Physical Medicine & Rehabilitation, Northwestern University, Chicago, IL, USA
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, USA
| | - Silvestro Micera
- The Biorobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pontedera, Italy
- Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pontedera, Italy
- Bertarelli Foundation Chair in Translational NeuroEngineering, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| | - Thomas Stieglitz
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering-IMTEK, BrainLinks-BrainTools Center and Bernstein Center Freiburg, University of Freiburg, Freiburg, Germany
| | - Agnes Sturma
- Department of Bioengineering, Imperial College London, London, UK
- Clinical Laboratory for Bionic Extremity Reconstruction, Department of Plastic and Reconstructive Surgery, Medical University of Vienna, Vienna, Austria
| | - Dustin Tyler
- Case School of Engineering, Case Western Reserve University, Cleveland, OH, USA
- Louis Stokes Veterans Affairs Medical Centre, Cleveland, OH, USA
| | - Richard F Ff Weir
- Biomechatronics Development Laboratory, Bioengineering Department, University of Colorado Denver and VA Eastern Colorado Healthcare System, Aurora, CO, USA
| | - Oskar C Aszmann
- Clinical Laboratory for Bionic Extremity Reconstruction, Department of Plastic and Reconstructive Surgery, Medical University of Vienna, Vienna, Austria
| |
Collapse
|
17
|
Cimolato A, Ciotti F, Kljajić J, Valle G, Raspopovic S. Symbiotic electroneural and musculoskeletal framework to encode proprioception via neurostimulation: ProprioStim. iScience 2023; 26:106248. [PMID: 36923003 PMCID: PMC10009292 DOI: 10.1016/j.isci.2023.106248] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 11/23/2022] [Accepted: 02/16/2023] [Indexed: 02/23/2023] Open
Abstract
Peripheral nerve stimulation in amputees achieved the restoration of touch, but not proprioception, which is critical in locomotion. A plausible reason is the lack of means to artificially replicate the complex activity of proprioceptors. To uncover this, we coupled neuromuscular models from ten subjects and nerve histologies from two implanted amputees to develop ProprioStim: a framework to encode proprioception by electrical evoking neural activity in close agreement with natural proprioceptive activity. We demonstrated its feasibility through non-invasive stimulation on seven healthy subjects comparing it with standard linear charge encoding. Results showed that ProprioStim multichannel stimulation was felt more natural, and hold promises for increasing accuracy in knee angle tracking, especially in future implantable solutions. Additionally, we quantified the importance of realistic 3D-nerve models against extruded models previously adopted for further design and validation of novel neurostimulation encoding strategies. ProprioStim provides clear guidelines for the development of neurostimulation policies restoring natural proprioception.
Collapse
Affiliation(s)
- Andrea Cimolato
- Neuroengineering Lab, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
- Rehab Technologies Lab, Fondazione Istituto Italiano di Tecnologia, 16163 Genova, Italy
- Neuroengineering and Medical Robotics Laboratory, Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Italy
| | - Federico Ciotti
- Neuroengineering Lab, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
| | - Jelena Kljajić
- Institute Mihajlo Pupin, Belgrade, 11060, Serbia
- School of Electrical Engineering, University of Belgrade, Belgrade, 11120, Serbia
| | - Giacomo Valle
- Neuroengineering Lab, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
| | - Stanisa Raspopovic
- Neuroengineering Lab, Department of Health Sciences and Technology, Institute for Robotics and Intelligent Systems, ETH Zürich, 8092 Zürich, Switzerland
| |
Collapse
|
18
|
Rodrigues-Carvalho C, Fernández-García M, Pinto-Fernández D, Sanz-Morere C, Barroso FO, Borromeo S, Rodríguez-Sánchez C, Moreno JC, del-Ama AJ. Benchmarking the Effects on Human-Exoskeleton Interaction of Trajectory, Admittance and EMG-Triggered Exoskeleton Movement Control. SENSORS (BASEL, SWITZERLAND) 2023; 23:791. [PMID: 36679587 PMCID: PMC9867281 DOI: 10.3390/s23020791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 12/12/2022] [Accepted: 01/04/2023] [Indexed: 06/17/2023]
Abstract
Nowadays, robotic technology for gait training is becoming a common tool in rehabilitation hospitals. However, its effectiveness is still controversial. Traditional control strategies do not adequately integrate human intention and interaction and little is known regarding the impact of exoskeleton control strategies on muscle coordination, physical effort, and user acceptance. In this article, we benchmarked three types of exoskeleton control strategies in a sample of seven healthy volunteers: trajectory assistance (TC), compliant assistance (AC), and compliant assistance with EMG-Onset stepping control (OC), which allows the user to decide when to take a step during the walking cycle. This exploratory study was conducted within the EUROBENCH project facility. Experimental procedures and data analysis were conducted following EUROBENCH's protocols. Specifically, exoskeleton kinematics, muscle activation, heart and breathing rates, skin conductance, as well as user-perceived effort were analyzed. Our results show that the OC controller showed robust performance in detecting stepping intention even using a corrupt EMG acquisition channel. The AC and OC controllers resulted in similar kinematic alterations compared to the TC controller. Muscle synergies remained similar to the synergies found in the literature, although some changes in muscle contribution were found, as well as an overall increase in agonist-antagonist co-contraction. The OC condition led to the decreased mean duration of activation of synergies. These differences were not reflected in the overall physiological impact of walking or subjective perception. We conclude that, although the AC and OC walking conditions allowed the users to modulate their walking pattern, the application of these two controllers did not translate into significant changes in the overall physiological cost of walking nor the perceived experience of use. Nonetheless, results suggest that both AC and OC controllers are potentially interesting approaches that can be explored as gait rehabilitation tools. Furthermore, the INTENTION project is, to our knowledge, the first study to benchmark the effects on human-exoskeleton interaction of three different exoskeleton controllers, including a new EMG-based controller designed by us and never tested in previous studies, which has made it possible to provide valuable third-party feedback on the use of the EUROBENCH facility and testbed, enriching the apprenticeship of the project consortium and contributing to the scientific community.
Collapse
Affiliation(s)
- Camila Rodrigues-Carvalho
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28002 Madrid, Spain
- Systems Engineering and Automation Department, Carlos III University of Madrid, 28903 Madrid, Spain
| | | | - David Pinto-Fernández
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28002 Madrid, Spain
- CAR-UPM Associated Unit, Universidad Politécnica de Madrid, 28040 Madrid, Spain
| | - Clara Sanz-Morere
- Center for Clinical Neuroscience, Hospital Los Madroños, 28690 Madrid, Spain
| | - Filipe Oliveira Barroso
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28002 Madrid, Spain
| | - Susana Borromeo
- Electronic Technology Department, Rey Juan Carlos University, 28933 Móstoles, Spain
| | | | - Juan C. Moreno
- Neural Rehabilitation Group, Cajal Institute, Spanish National Research Council (CSIC), 28002 Madrid, Spain
| | - Antonio J. del-Ama
- Electronic Technology Department, Rey Juan Carlos University, 28933 Móstoles, Spain
| |
Collapse
|
19
|
Zheng K, Liu S, Yang J, Al-Selwi M, Li J. sEMG-Based Continuous Hand Action Prediction by Using Key State Transition and Model Pruning. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22249949. [PMID: 36560318 PMCID: PMC9787629 DOI: 10.3390/s22249949] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 12/12/2022] [Accepted: 12/14/2022] [Indexed: 06/12/2023]
Abstract
Conventional classification of hand motions and continuous joint angle estimation based on sEMG have been widely studied in recent years. The classification task focuses on discrete motion recognition and shows poor real-time performance, while continuous joint angle estimation evaluates the real-time joint angles by the continuity of the limb. Few researchers have investigated continuous hand action prediction based on hand motion continuity. In our study, we propose the key state transition as a condition for continuous hand action prediction and simulate the prediction process using a sliding window with long-term memory. Firstly, the key state modeled by GMM-HMMs is set as the condition. Then, the sliding window is used to dynamically look for the key state transition. The prediction results are given while finding the key state transition. To extend continuous multigesture action prediction, we use model pruning to improve reusability. Eight subjects participated in the experiment, and the results show that the average accuracy of continuous two-hand actions is 97% with a 70 ms time delay, which is better than LSTM (94.15%, 308 ms) and GRU (93.83%, 300 ms). In supplementary experiments with continuous four-hand actions, over 85% prediction accuracy is achieved with an average time delay of 90 ms.
Collapse
Affiliation(s)
- Kaikui Zheng
- School of Advanced Manufacturing, Fuzhou University, Quanzhou 362200, China
| | - Shuai Liu
- School of Advanced Manufacturing, Fuzhou University, Quanzhou 362200, China
| | - Jinxing Yang
- Quanzhou Institute of Equipment Manufacturing, Chinese Academy of Sciences, Quanzhou 362216, China
| | - Metwalli Al-Selwi
- Quanzhou Institute of Equipment Manufacturing, Chinese Academy of Sciences, Quanzhou 362216, China
| | - Jun Li
- Quanzhou Institute of Equipment Manufacturing, Chinese Academy of Sciences, Quanzhou 362216, China
| |
Collapse
|
20
|
Romanato M, Spolaor F, Beretta C, Fichera F, Bertoldo A, Volpe D, Sawacha Z. Quantitative assessment of training effects using EksoGT® exoskeleton in Parkinson's disease patients: A randomized single blind clinical trial. Contemp Clin Trials Commun 2022; 28:100926. [PMID: 35664504 PMCID: PMC9156880 DOI: 10.1016/j.conctc.2022.100926] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Accepted: 05/21/2022] [Indexed: 11/19/2022] Open
Affiliation(s)
- M. Romanato
- Department of Information Engineering, University of Padua, Padua, Italy
| | - F. Spolaor
- Department of Information Engineering, University of Padua, Padua, Italy
| | - C. Beretta
- Fresco Parkinson Center, Villa Margherita, S. Stefano, Vicenza, Italy
| | - F. Fichera
- Fresco Parkinson Center, Villa Margherita, S. Stefano, Vicenza, Italy
| | - A. Bertoldo
- Department of Information Engineering, University of Padua, Padua, Italy
| | - D. Volpe
- Fresco Parkinson Center, Villa Margherita, S. Stefano, Vicenza, Italy
| | - Z. Sawacha
- Department of Information Engineering, University of Padua, Padua, Italy
- Department of Medicine, University of Padua, Padua, Italy
- Corresponding author. Department of Information Engineering, University of Padova, Via Gradenigo 6B, 35131, Padova, Italy.
| |
Collapse
|
21
|
Geng Y, Yu Z, Long Y, Qin L, Chen Z, Li Y, Guo X, Li G. A CNN-Attention Network for Continuous Estimation of Finger Kinematics from Surface Electromyography. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3169448] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Yanjuan Geng
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Zhebin Yu
- Hebei University of Technology, Tianjin, China
| | - Yucheng Long
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Liuni Qin
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Ziyin Chen
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Yongcheng Li
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Xin Guo
- Hebei University of Technology, Tianjin, China
| | - Guanglin Li
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| |
Collapse
|
22
|
Schulte RV, Zondag M, Buurke JH, Prinsen EC. Multi-Day EMG-Based Knee Joint Torque Estimation Using Hybrid Neuromusculoskeletal Modelling and Convolutional Neural Networks. Front Robot AI 2022; 9:869476. [PMID: 35546902 PMCID: PMC9081836 DOI: 10.3389/frobt.2022.869476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 04/01/2022] [Indexed: 11/13/2022] Open
Abstract
Proportional control using surface electromyography (EMG) enables more intuitive control of a transfemoral prosthesis. However, EMG is a noisy signal which can vary over time, giving rise to the question what approach for knee torque estimation is most suitable for multi-day control. In this study we compared three different modelling frameworks to estimate knee torque in non-weight-bearing situations. The first model contained a convolutional neural network (CNN) which mapped EMG to knee torque directly. The second used a neuromusculoskeletal model (NMS) which used EMG, muscle tendon unit lengths and moment arms to compute knee torque. The third model (Hybrid) used a CNN to map EMG to specific muscle activation, which was used together with NMS components to compute knee torque. Multi-day measurements were conducted on ten able-bodied participants who performed non-weight bearing activities. CNN had the best performance in general and on each day (Normalized Root Mean Squared Error (NRMSE) 9.2 ± 4.4%). The Hybrid model (NRMSE 12.4 ± 3.4%) was able to outperform NMS (NRMSE 14.3 ± 4.2%). The NMS model showed no significant difference between measurement days. The CNN model and Hybrid models had significant performance differences between the first day and all other days. CNNs are suited for multi-day torque estimation in terms of error rate, outperforming the other two model types. NMS was the only model type which was robust over all days. This study investigated the behavior of three model types over multiple days, giving insight in the most suited modelling approach for multi-day torque estimation to be used in prosthetic control.
Collapse
Affiliation(s)
- Robert V. Schulte
- Roessingh Research and Development, Enschede, Netherlands
- Department of Biomedical Signals and Systems, University of Twente, Enschede, Netherlands
- *Correspondence: Robert V. Schulte ,
| | - Marijke Zondag
- Roessingh Research and Development, Enschede, Netherlands
- Department of Biomedical Signals and Systems, University of Twente, Enschede, Netherlands
| | - Jaap H. Buurke
- Roessingh Research and Development, Enschede, Netherlands
- Department of Biomedical Signals and Systems, University of Twente, Enschede, Netherlands
| | - Erik C. Prinsen
- Roessingh Research and Development, Enschede, Netherlands
- Department of Biomechanical Engineering, University of Twente, Enschede, Netherlands
| |
Collapse
|
23
|
Zhang L, Soselia D, Wang R, Gutierrez-Farewik EM. Lower-limb Joint Torque Prediction using LSTM Neural Networks and Transfer Learning. IEEE Trans Neural Syst Rehabil Eng 2022; 30:600-609. [PMID: 35239487 DOI: 10.1109/tnsre.2022.3156786] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Estimation of joint torque during movement provides important information in several settings, such as effect of athletes' training or of a medical intervention, or analysis of the remaining muscle strength in a wearer of an assistive device. The ability to estimate joint torque during daily activities using wearable sensors is increasingly relevant in such settings. In this study, lower limb joint torques during ten daily activities were predicted by long short-term memory (LSTM) neural networks and transfer learning. LSTM models were trained with muscle electromyography signals and lower limb joint angles. Hip flexion/extension, hip abduction/adduction, knee flexion/extension and ankle dorsiflexion/plantarflexion torques were predicted. The LSTM models' performance in predicting torque was investigated in both intra-subject and inter-subject scenarios. Each scenario was further divided into intra-task and inter-task tests. We observed that LSTM models could predict lower limb joint torques during various activities accurately with relatively low error (root mean square error ≤ 0.14 Nm/kg, normalized root mean square error ≤8.7%) either through a uniform model or through ten separate models in intra-subject tests. Furthermore, a transfer learning technique was adopted in the inter-task and inter-subject tests to further improve the generalizability of LSTM models by pre-training a model on multiple subjects and/or tasks and transferring the learned knowledge to a target task/subject. Particularly in the inter-subject tests, we could predict joint torques accurately in several movements after training from only a few movements from new subjects.
Collapse
|
24
|
Lotti N, Xiloyannis M, Missiroli F, Bokranz C, Chiaradia D, Frisoli A, Riener R, Masia L. Myoelectric or Force Control? A Comparative Study on a Soft Arm Exosuit. IEEE T ROBOT 2022. [DOI: 10.1109/tro.2021.3137748] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
25
|
Koelewijn AD, Audu M, del-Ama AJ, Colucci A, Font-Llagunes JM, Gogeascoechea A, Hnat SK, Makowski N, Moreno JC, Nandor M, Quinn R, Reichenbach M, Reyes RD, Sartori M, Soekadar S, Triolo RJ, Vermehren M, Wenger C, Yavuz US, Fey D, Beckerle P. Adaptation Strategies for Personalized Gait Neuroprosthetics. Front Neurorobot 2021; 15:750519. [PMID: 34975445 PMCID: PMC8716811 DOI: 10.3389/fnbot.2021.750519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 11/18/2021] [Indexed: 11/13/2022] Open
Abstract
Personalization of gait neuroprosthetics is paramount to ensure their efficacy for users, who experience severe limitations in mobility without an assistive device. Our goal is to develop assistive devices that collaborate with and are tailored to their users, while allowing them to use as much of their existing capabilities as possible. Currently, personalization of devices is challenging, and technological advances are required to achieve this goal. Therefore, this paper presents an overview of challenges and research directions regarding an interface with the peripheral nervous system, an interface with the central nervous system, and the requirements of interface computing architectures. The interface should be modular and adaptable, such that it can provide assistance where it is needed. Novel data processing technology should be developed to allow for real-time processing while accounting for signal variations in the human. Personalized biomechanical models and simulation techniques should be developed to predict assisted walking motions and interactions between the user and the device. Furthermore, the advantages of interfacing with both the brain and the spinal cord or the periphery should be further explored. Technological advances of interface computing architecture should focus on learning on the chip to achieve further personalization. Furthermore, energy consumption should be low to allow for longer use of the neuroprosthesis. In-memory processing combined with resistive random access memory is a promising technology for both. This paper discusses the aforementioned aspects to highlight new directions for future research in gait neuroprosthetics.
Collapse
Affiliation(s)
- Anne D. Koelewijn
- Biomechanical Data Analysis and Creation (BIOMAC) Group, Machine Learning and Data Analytics Lab, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Musa Audu
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Antonio J. del-Ama
- Applied Mathematics, Materials Science and Technology and Electronic Technology Department, Rey Juan Carlos University, Mostoles, Spain
| | - Annalisa Colucci
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Neurosciences, Charité - Universita¨tsmedizin Berlin, Berlin, Germany
| | - Josep M. Font-Llagunes
- Biomechanical Engineering Lab, Department of Mechanical Engineering and Research Centre for Biomedical Engineering, Universitat Politècnica de Catalunya, Barcelona, Spain
- Institut de Recerca Sant Joan de Déu, Esplugues de Llobregat, Spain
| | - Antonio Gogeascoechea
- Department of Biomechanical Engineering, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| | - Sandra K. Hnat
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Nathan Makowski
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Physical Medicine and Rehabilitation, MetroHealth Medical Center, Cleveland, OH, United States
| | - Juan C. Moreno
- Neural Rehabilitation Group, Department of Translational Neuroscience, Cajal Institute, CSIC, Madrid, Spain
| | - Mark Nandor
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Mechanical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Roger Quinn
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Mechanical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Marc Reichenbach
- Chair of Computer Engineering, Brandenburg University of Technology Cottbus-Senftenberg, Cottbus, Germany
- Chair for Computer Architecture, Department of Computer Science, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Ryan-David Reyes
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Massimo Sartori
- Department of Biomechanical Engineering, Faculty of Engineering Technology, University of Twente, Enschede, Netherlands
| | - Surjo Soekadar
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Neurosciences, Charité - Universita¨tsmedizin Berlin, Berlin, Germany
| | - Ronald J. Triolo
- Department of Veterans Affairs, Louis Stokes Clevel and Veterans Affairs Medical Center, Advanced Platform Technology Center, Cleveland, OH, United States
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Mareike Vermehren
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Neurosciences, Charité - Universita¨tsmedizin Berlin, Berlin, Germany
| | - Christian Wenger
- IHP-Leibniz Institut Fuer Innovative Mikroelektronik, Frankfurt (Oder), Germany
| | - Utku S. Yavuz
- Biomedical Signals and Systems Group, University of Twente, Enschede, Netherlands
| | - Dietmar Fey
- Chair for Computer Architecture, Department of Computer Science, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Philipp Beckerle
- Chair of Autonomous Systems and Mechatronics, Department of Electrical Engineering, Artificial Intelligence in Biomedical Engineering, Faculty of Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
26
|
Volk VL, Hamilton LD, Hume DR, Shelburne KB, Fitzpatrick CK. Integration of neural architecture within a finite element framework for improved neuromusculoskeletal modeling. Sci Rep 2021; 11:22983. [PMID: 34836986 PMCID: PMC8626416 DOI: 10.1038/s41598-021-02298-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Accepted: 11/10/2021] [Indexed: 11/12/2022] Open
Abstract
Neuromusculoskeletal (NMS) models can aid in studying the impacts of the nervous and musculoskeletal systems on one another. These computational models facilitate studies investigating mechanisms and treatment of musculoskeletal and neurodegenerative conditions. In this study, we present a predictive NMS model that uses an embedded neural architecture within a finite element (FE) framework to simulate muscle activation. A previously developed neuromuscular model of a motor neuron was embedded into a simple FE musculoskeletal model. Input stimulation profiles from literature were simulated in the FE NMS model to verify effective integration of the software platforms. Motor unit recruitment and rate coding capabilities of the model were evaluated. The integrated model reproduced previously published output muscle forces with an average error of 0.0435 N. The integrated model effectively demonstrated motor unit recruitment and rate coding in the physiological range based upon motor unit discharge rates and muscle force output. The combined capability of a predictive NMS model within a FE framework can aid in improving our understanding of how the nervous and musculoskeletal systems work together. While this study focused on a simple FE application, the framework presented here easily accommodates increased complexity in the neuromuscular model, the FE simulation, or both.
Collapse
Affiliation(s)
- Victoria L Volk
- Micron School of Materials Science and Engineering, Boise State University, Boise, ID, USA.,Mechanical and Biomedical Engineering, Boise State University, 1910 University Drive, MS-2085, Boise, ID, 83725-2085, USA
| | - Landon D Hamilton
- Center for Orthopaedic Biomechanics, University of Denver, Denver, CO, USA
| | - Donald R Hume
- Center for Orthopaedic Biomechanics, University of Denver, Denver, CO, USA
| | - Kevin B Shelburne
- Center for Orthopaedic Biomechanics, University of Denver, Denver, CO, USA
| | - Clare K Fitzpatrick
- Mechanical and Biomedical Engineering, Boise State University, 1910 University Drive, MS-2085, Boise, ID, 83725-2085, USA.
| |
Collapse
|
27
|
Reynolds DJ, Shazar A, Zhang X. Design and Validation of a Sensor Fault-Tolerant Module for Real-Time High-Density EMG Pattern Recognition. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6738-6742. [PMID: 34892654 DOI: 10.1109/embc46164.2021.9629541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
With the advancements in electronics technology, high-density (HD) EMG sensing systems have become available and have been investigated for their feasibility and performance in neural-machine interface (NMI) applications. Comparing to the traditional single channel-based targeted muscle sensing method, HD EMG sensing performs a sampling of the electrical activity over a larger surface area and has the promise of 1) providing richer neural information from one temporal and two spatial dimensions and 2) ease of wear in real life without the need of anatomically targeted electrode placement. To use HD EMG in real-time NMI applications, challenges including high computational burden and unreliability of EMG recordings over time need to be addressed. This paper presented an HD EMG PR based NMI which seamlessly integrates HD EMG PR with a Sensor Fault-Tolerant Module (SFTM) which aimed to provide robust PR in real time. Experimental results showed that the SFTM was able to recover the PR accuracies by 6%-22% from disturbances including contact artifacts and loose contacts. A Python-based implementation of the proposed HD EMG SFTM was developed and was demonstrated to be computationally efficient for real-time performance. These results have demonstrated the feasibility of a robust real-time HD EMG PR-based NMI.
Collapse
|
28
|
Hernandez AG, Kobayashi RO, Yavuz US, Sartori M. Identification of Motor Unit Twitch Properties in the Intact Human In Vivo. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6310-6313. [PMID: 34892556 DOI: 10.1109/embc46164.2021.9630328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Restoring natural motor function in neurologically injured individuals is challenging, largely due to the lack of personalization in current neurorehabilitation technologies. Signal-driven neuro-musculoskeletal models may offer a novel paradigm for devising novel closed-loop rehabilitation strategies according to an individual's physiology. However, current modelling techniques are constrained to bipolar electromyography (EMG), thereby lacking the resolution necessary to extract the activity of individual motor units (MUs) in vivo. In this work, we decoded MU spike trains from high-density (HD)-EMG to obtain relevant neural properties across multiple isometric plantar-dorsiflexion tasks. Then, we sampled MU statistical distributions and used them to reproduce MU specific activation profiles. Results showed bimodal distributions which may correspond to slow and fast MU populations. The estimated activation profiles showed a high degree of similarity to the reference torque (R2>0.8) across the recorded muscles. This suggests that the estimation of MU twitch properties is a crucial step for the translation of neural information into muscle force.Clinical Relevance- This work has multiple implications for understanding the underlying mechanism of motor impairment and for developing closed-loop strategies for modulating alpha motor circuitries in neurologically injured individuals.
Collapse
|
29
|
Design and Assist-as-Needed Control of Flexible Elbow Exoskeleton Actuated by Nonlinear Series Elastic Cable Driven Mechanism. ACTUATORS 2021. [DOI: 10.3390/act10110290] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Exoskeletons can assist the daily life activities of the elderly with weakened muscle strength, but traditional rigid exoskeletons bring parasitic torque to the human joints and easily disturbs the natural movement of the wearer’s upper limbs. Flexible exoskeletons have more natural human-machine interaction, lower weight and cost, and have great application potential. Applying assist force according to the patient’s needs can give full play to the wearer’s remaining muscle strength, which is more conducive to muscle strength training and motor function recovery. In this paper, a design scheme of an elbow exoskeleton driven by flexible antagonistic cable actuators is proposed. The cable actuator is driven by a nonlinear series elastic mechanism, in which the elastic elements simulate the passive elastic properties of human skeletal muscle. Based on an improved elbow musculoskeletal model, the assist torque of exoskeleton is predicted. An assist-as-needed (AAN) control algorithm is proposed for the exoskeleton and experiments are carried out. The experimental results on the experimental platform show that the root mean square error between the predicted assist torque and the actual assist torque is 0.00226 Nm. The wearing experimental results also show that the AAN control method designed in this paper can reduce the activation of biceps brachii effectively when the exoskeleton assist level increases.
Collapse
|
30
|
Lam SK, Vujaklija I. Joint Torque Prediction via Hybrid Neuromusculoskeletal Modelling during Gait Using Statistical Ground Reaction Estimates: An Exploratory Study. SENSORS 2021; 21:s21196597. [PMID: 34640917 PMCID: PMC8512679 DOI: 10.3390/s21196597] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/27/2021] [Accepted: 09/28/2021] [Indexed: 01/03/2023]
Abstract
Joint torques of lower extremity are important clinical indicators of gait capability. This parameter can be quantified via hybrid neuromusculoskeletal modelling that combines electromyography-driven modelling and static optimisation. The simulations rely on kinematics and external force measurements, for example, ground reaction forces (GRF) and the corresponding centres of pressure (COP), which are conventionally acquired using force plates. This bulky equipment, however, hinders gait analysis in real-world environments. While this portability issue could potentially be solved by estimating the parameters through machine learning, the effect of the estimation errors on joint torque prediction with biomechanical models remains to be investigated. This study first estimated GRF and COP through feedforward artificial neural networks, and then leveraged them to predict lower-limb sagittal joint torques via (i) inverse dynamics and (ii) hybrid modelling. The approach was evaluated on five healthy subjects, individually. The predicted torques were validated with the measured torques, showing that hip was the most sensitive whereas ankle was the most resistive to the GRF/COP estimates for both models, with average metrics values being 0.70 < R2 < 0.97 and 0.069 < RMSE < 0.15 (Nm/kg). This study demonstrated the feasibility of torque prediction based on personalised (neuro)musculoskeletal modelling using statistical ground reaction estimates, thus providing insights into potential real-world mobile joint torque quantification.
Collapse
|
31
|
Liu YX, Wang R, Gutierrez-Farewik EM. A Muscle Synergy-Inspired Method of Detecting Human Movement Intentions Based on Wearable Sensor Fusion. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1089-1098. [PMID: 34097615 DOI: 10.1109/tnsre.2021.3087135] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Detecting human movement intentions is fundamental to neural control of robotic exoskeletons, as it is essential for achieving seamless transitions between different locomotion modes. In this study, we enhanced a muscle synergy-inspired method of locomotion mode identification by fusing the electromyography data with two types of data from wearable sensors (inertial measurement units), namely linear acceleration and angular velocity. From the finite state machine perspective, the enhanced method was used to systematically identify 2 static modes, 7 dynamic modes, and 27 transitions among them. In addition to the five broadly studied modes (level ground walking, ramps ascent/descent, stairs ascent/descent), we identified the transition between different walking speeds and modes of ramp walking at different inclination angles. Seven combinations of sensor fusion were conducted, on experimental data from 8 able-bodied adult subjects, and their classification accuracy and prediction time were compared. Prediction based on a fusion of electromyography and gyroscope (angular velocity) data predicted transitions earlier and with higher accuracy. All transitions and modes were identified with a total average classification accuracy of 94.5% with fused sensor data. For nearly all transitions, we were able to predict the next locomotion mode 300-500ms prior to the step into that mode.
Collapse
|
32
|
Romanato M, Volpe D, Guiotto A, Spolaor F, Sartori M, Sawacha Z. Electromyography-informed modeling for estimating muscle activation and force alterations in Parkinson's disease. Comput Methods Biomech Biomed Engin 2021; 25:14-26. [PMID: 33998843 DOI: 10.1080/10255842.2021.1925887] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Electromyography (EMG)-driven neuromusculoskeletal modeling (NMSM) enables simulating the mechanical function of multiple muscle-tendon units as controlled by nervous system in the generation of complex movements. In the context of clinical assessment this may enable understanding biomechanical factor contributing to gait disorders such as one induced by Parkinson's disease (PD). In spite of the challenges in the development of patient-specific models, this preliminary study aimed at establishing a feasible and noninvasive experimental and modeling pipeline to be adopted in clinics to detect PD-induced gait alterations. Four different NMSM have been implemented for three healthy controls using CEINMS, an OpenSim-compatible toolbox. Models differed in the EMG-normalization methods used for calibration purposes (i.e. walking trial normalization and maximum voluntary contraction normalization) and in the set of experimental EMGs used for the musculotendon-unit mapping (i.e. 4 channels vs. 15 channels). Model accuracy assessment showed no statistically significant differences between the more complete model (non-clinically viable) and the proposed reduced one (clinically viable). The clinically viable reduced model was systematically applied on a dataset including ten PD's and thirteen healthy controls. Results showed significant differences in the neuromuscular control strategy of the PD group in term of muscle forces and joint torques. Indeed, PD patients displayed a significantly lower magnitude on force production and revealed a higher amount of force variability with the respect of the healthy controls. The estimated variables could become a measurable biomechanical outcome to assess and track both disease progression and its impact on gait in PD subjects.
Collapse
Affiliation(s)
- Marco Romanato
- Department of Information Engineering, University of Padua, Padova, Italy
| | - Daniele Volpe
- Fresco Parkinson Center, Villa Margherita, Vicenza, Italy
| | - Annamaria Guiotto
- Department of Information Engineering, University of Padua, Padova, Italy
| | - Fabiola Spolaor
- Department of Information Engineering, University of Padua, Padova, Italy
| | - Massimo Sartori
- Department of Biomechanical Engineering, University of Twente, AE Enschede, Netherlands
| | - Zimi Sawacha
- Department of Information Engineering, University of Padua, Padova, Italy.,Department of Medicine, University of Padua, Padova, Italy
| |
Collapse
|
33
|
Li W, Shi P, Yu H. Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future. Front Neurosci 2021; 15:621885. [PMID: 33981195 PMCID: PMC8107289 DOI: 10.3389/fnins.2021.621885] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Accepted: 02/23/2021] [Indexed: 01/09/2023] Open
Abstract
Amputation of the upper limb brings heavy burden to amputees, reduces their quality of life, and limits their performance in activities of daily life. The realization of natural control for prosthetic hands is crucial to improving the quality of life of amputees. Surface electromyography (sEMG) signal is one of the most widely used biological signals for the prediction of upper limb motor intention, which is an essential element of the control systems of prosthetic hands. The conversion of sEMG signals into effective control signals often requires a lot of computational power and complex process. Existing commercial prosthetic hands can only provide natural control for very few active degrees of freedom. Deep learning (DL) has performed surprisingly well in the development of intelligent systems in recent years. The significant improvement of hardware equipment and the continuous emergence of large data sets of sEMG have also boosted the DL research in sEMG signal processing. DL can effectively improve the accuracy of sEMG pattern recognition and reduce the influence of interference factors. This paper analyzes the applicability and efficiency of DL in sEMG-based gesture recognition and reviews the key techniques of DL-based sEMG pattern recognition for the prosthetic hand, including signal acquisition, signal preprocessing, feature extraction, classification of patterns, post-processing, and performance evaluation. Finally, the current challenges and future prospects in clinical application of these techniques are outlined and discussed.
Collapse
Affiliation(s)
- Wei Li
- Institute of Rehabilitation Engineering and Technology, University of Shanghai for Science and Technology, Shanghai, China
| | - Ping Shi
- Institute of Rehabilitation Engineering and Technology, University of Shanghai for Science and Technology, Shanghai, China
| | - Hongliu Yu
- Institute of Rehabilitation Engineering and Technology, University of Shanghai for Science and Technology, Shanghai, China
| |
Collapse
|
34
|
Zheng E, Wan J, Yang L, Wang Q, Qiao H. Wrist Angle Estimation With a Musculoskeletal Model Driven by Electrical Impedance Tomography Signals. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3060400] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
35
|
Wu W, Saul KR, Huang HH. Using Reinforcement Learning to Estimate Human Joint Moments From Electromyography or Joint Kinematics: An Alternative Solution to Musculoskeletal-Based Biomechanics. J Biomech Eng 2021; 143:044502. [PMID: 33332536 DOI: 10.1115/1.4049333] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2020] [Indexed: 11/08/2022]
Abstract
Reinforcement learning (RL) has potential to provide innovative solutions to existing challenges in estimating joint moments in motion analysis, such as kinematic or electromyography (EMG) noise and unknown model parameters. Here, we explore feasibility of RL to assist joint moment estimation for biomechanical applications. Forearm and hand kinematics and forearm EMGs from four muscles during free finger and wrist movement were collected from six healthy subjects. Using the proximal policy optimization approach, we trained two types of RL agents that estimated joint moment based on measured kinematics or measured EMGs, respectively. To quantify the performance of trained RL agents, the estimated joint moment was used to drive a forward dynamic model for estimating kinematics, which was then compared with measured kinematics using Pearson correlation coefficient. The results demonstrated that both trained RL agents are feasible to estimate joint moment for wrist and metacarpophalangeal (MCP) joint motion prediction. The correlation coefficients between predicted and measured kinematics, derived from the kinematics-driven agent and subject-specific EMG-driven agents, were 98% ± 1% and 94% ± 3% for the wrist, respectively, and were 95% ± 2% and 84% ± 6% for the metacarpophalangeal joint, respectively. In addition, a biomechanically reasonable joint moment-angle-EMG relationship (i.e., dependence of joint moment on joint angle and EMG) was predicted using only 15 s of collected data. In conclusion, this study illustrates that an RL approach can be an alternative technique to conventional inverse dynamic analysis in human biomechanics study and EMG-driven human-machine interfacing applications.
Collapse
Affiliation(s)
- Wen Wu
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill/North Carolina State University, Raleigh, NC 27695
| | - Katherine R Saul
- Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC 27695
| | - He Helen Huang
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill/North Carolina State University, Raleigh, NC 27695
| |
Collapse
|
36
|
Wen Y, Avrillon S, Hernandez-Pavon JC, Kim SJ, Hug F, Pons JL. A convolutional neural network to identify motor units from high-density surface electromyography signals in real time. J Neural Eng 2021; 18. [PMID: 33721852 DOI: 10.1088/1741-2552/abeead] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 03/15/2021] [Indexed: 11/11/2022]
Abstract
OBJECTIVES This paper aims to investigate the feasibility and the validity of applying deep convolutional neural networks (CNN) to identify motor unit (MU) spike trains and estimate the neural drive to muscles from high-density electromyography (HD-EMG) signals in real time. Two distinct deep CNNs are compared with the convolution kernel compensation (CKC) algorithm using simulated and experimentally recorded signals. The effects of window size and step size of the input HD-EMG signals are also investigated. APPROACH The MU spike trains were first identified with the CKC algorithm. The HD-EMG signals and spike trains were used to train the deep CNN. Then, the deep CNN decomposed the HD-EMG signals into MU discharge times in real time. Two CNN approaches are compared with the CKC: 1) multiple single-output deep CNN (SO-DCNN) with one MU decomposed per network, and 2) one multiple-output deep CNN (MO-DCNN) to decompose all MUs (up to 23) with one network. MAIN RESULTS The MO-DCNN outperformed the SO-DCNN in terms of training time (3.2 to 21.4 s/epoch vs. 6.5 to 47.8 s/epoch, respectively) and prediction time (0.04 vs. 0.27 s/sample, respectively). The optimal window size and step size for MO-DCNN were 120 and 20 data points, respectively. It results in sensitivity of 98% and 85% with simulated and experimentally recorded HD-EMG signals, respectively. There is a high cross-correlation coefficient between the neural drive estimated with CKC and that estimated with MO-DCNN (range of r-value across conditions: 0.88-0.95). SIGNIFICANCE We demonstrate the feasibility and the validity of using deep CNN to accurately identify MU activity from HD-EMG with a latency lower than 80 ms, which falls within the lower bound of the human electromechanical delay. This method opens many opportunities for using the neural drive to interface humans with assistive devices.
Collapse
Affiliation(s)
- Yue Wen
- Legs and Walking Lab, Shirley Ryan AbilityLab, 355 East Erie Street, Chicago, Illinois, 60611-2654, UNITED STATES
| | - Simon Avrillon
- Shirley Ryan AbilityLab, 355 E Erie St, Chicago, Illinois, 60601, UNITED STATES
| | - Julio Cesar Hernandez-Pavon
- Department of Physical Medicine and Rehabilitation, Northwestern University Feinberg School of Medicine, 251 E Huron St, Chicago, Illinois, 60611, UNITED STATES
| | - Sangjoon Jonathan Kim
- Shirley Ryan AbilityLab, 355 E Erie St, Chicago, Illinois, 60611-2654, UNITED STATES
| | - Francois Hug
- Laboratoire 'Motricite, Interactions, Performance', Universite de Nantes, JE 2438 UFRSTAPS,, 25 bis Guy Mollet BP 72206, Nantes, F-44000 France, Nantes, 72206, FRANCE
| | - Jose Luis Pons
- Bioengineering Group, Spanish Research Council, Serrano 117, Arganda del Rey (Madrid), 28006, SPAIN
| |
Collapse
|
37
|
Ueno R, Navacchia A, Schilaty ND, Myer GD, Hewett TE, Bates NA. Anterior Cruciate Ligament Loading Increases With Pivot-Shift Mechanism During Asymmetrical Drop Vertical Jump in Female Athletes. Orthop J Sports Med 2021; 9:2325967121989095. [PMID: 34235227 PMCID: PMC8226378 DOI: 10.1177/2325967121989095] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 10/28/2020] [Indexed: 12/17/2022] Open
Abstract
Background: Frontal plane trunk lean with a side-to-side difference in lower extremity
kinematics during landing increases unilateral knee abduction moment and
consequently anterior cruciate ligament (ACL) injury risk. However, the
biomechanical features of landing with higher ACL loading are still unknown.
Validated musculoskeletal modeling offers the potential to quantify ACL
strain and force during a landing task. Purpose: To investigate ACL loading during a landing and assess the association
between ACL loading and biomechanical factors of individual landing
strategies. Study Design: Descriptive laboratory study. Methods: Thirteen young female athletes performed drop vertical jump trials, and their
movements were recorded with 3-dimensional motion capture.
Electromyography-informed optimization was performed to estimate lower limb
muscle forces with an OpenSim musculoskeletal model. A whole-body
musculoskeletal finite element model was developed. The joint motion and
muscle forces obtained from the OpenSim simulations were applied to the
musculoskeletal finite element model to estimate ACL loading during
participants’ simulated landings with physiologic knee mechanics. Kinematic,
muscle force, and ground-reaction force waveforms associated with high ACL
strain trials were reconstructed via principal component analysis and
logistic regression analysis, which were used to predict trials with high
ACL strain. Results: The median (interquartile range) values of peak ACL strain and force during
the drop vertical jump were 3.3% (–1.9% to 5.1%) and 195.1 N (53.9 to 336.9
N), respectively. Four principal components significantly predicted high ACL
strain trials, with 100% sensitivity, 78% specificity, and an area of 0.91
under the receiver operating characteristic curve (P <
.001). High ACL strain trials were associated with (1) knee motions that
included larger knee abduction, internal tibial rotation, and anterior
tibial translation and (2) motion that included greater vertical and lateral
ground-reaction forces, lower gluteus medius force, larger lateral pelvic
tilt, and increased hip adduction. Conclusion: ACL loads were higher with a pivot-shift mechanism during a simulated landing
with asymmetry in the frontal plane. Specifically, knee abduction can create
compression on the posterior slope of the lateral tibial plateau, which
induces anterior tibial translation and internal tibial rotation. Clinical Relevance: Athletes are encouraged to perform interventional and preventive training to
improve symmetry during landing.
Collapse
Affiliation(s)
- Ryo Ueno
- Department of Orthopedic Surgery, Mayo Clinic, Rochester, Minnesota, USA.,Department of Sport Science, University of Innsbruck, Innsbruck, Austria
| | - Alessandro Navacchia
- Department of Sport Science, University of Innsbruck, Innsbruck, Austria.,Smith & Nephew, San Clemente, California, USA
| | - Nathan D Schilaty
- Department of Orthopedic Surgery, Mayo Clinic, Rochester, Minnesota, USA.,Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, Minnesota, USA.,Department of Physical Medicine and Rehabilitation, Mayo Clinic, Rochester, Minnesota, USA
| | - Gregory D Myer
- The SPORT Center, Division of Sports Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA.,Departments of Pediatrics and Orthopedic Surgery, College of Medicine, University of Cincinnati, Cincinnati, Ohio, USA.,The Micheli Center for Sports Injury Prevention, Waltham, Massachusetts, USA
| | - Timothy E Hewett
- Hewett Global Consulting, Rochester Minnesota, USA.,The Rocky Mountain Consortium for Sports Research, Edwards, Colorado, USA
| | - Nathaniel A Bates
- Department of Orthopedic Surgery, Mayo Clinic, Rochester, Minnesota, USA.,Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, Minnesota, USA
| |
Collapse
|
38
|
A Conceptual Blueprint for Making Neuromusculoskeletal Models Clinically Useful. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11052037] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
The ultimate goal of most neuromusculoskeletal modeling research is to improve the treatment of movement impairments. However, even though neuromusculoskeletal models have become more realistic anatomically, physiologically, and neurologically over the past 25 years, they have yet to make a positive impact on the design of clinical treatments for movement impairments. Such impairments are caused by common conditions such as stroke, osteoarthritis, Parkinson’s disease, spinal cord injury, cerebral palsy, limb amputation, and even cancer. The lack of clinical impact is somewhat surprising given that comparable computational technology has transformed the design of airplanes, automobiles, and other commercial products over the same time period. This paper provides the author’s personal perspective for how neuromusculoskeletal models can become clinically useful. First, the paper motivates the potential value of neuromusculoskeletal models for clinical treatment design. Next, it highlights five challenges to achieving clinical utility and provides suggestions for how to overcome them. After that, it describes clinical, technical, collaboration, and practical needs that must be addressed for neuromusculoskeletal models to fulfill their clinical potential, along with recommendations for meeting them. Finally, it discusses how more complex modeling and experimental methods could enhance neuromusculoskeletal model fidelity, personalization, and utilization. The author hopes that these ideas will provide a conceptual blueprint that will help the neuromusculoskeletal modeling research community work toward clinical utility.
Collapse
|
39
|
Ranavolo A, Ajoudani A, Cherubini A, Bianchi M, Fritzsche L, Iavicoli S, Sartori M, Silvetti A, Vanderborght B, Varrecchia T, Draicchio F. The Sensor-Based Biomechanical Risk Assessment at the Base of the Need for Revising of Standards for Human Ergonomics. SENSORS (BASEL, SWITZERLAND) 2020; 20:E5750. [PMID: 33050438 PMCID: PMC7599507 DOI: 10.3390/s20205750] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Revised: 09/24/2020] [Accepted: 10/03/2020] [Indexed: 02/06/2023]
Abstract
Due to the epochal changes introduced by "Industry 4.0", it is getting harder to apply the varying approaches for biomechanical risk assessment of manual handling tasks used to prevent work-related musculoskeletal disorders (WMDs) considered within the International Standards for ergonomics. In fact, the innovative human-robot collaboration (HRC) systems are widening the number of work motor tasks that cannot be assessed. On the other hand, new sensor-based tools for biomechanical risk assessment could be used for both quantitative "direct instrumental evaluations" and "rating of standard methods", allowing certain improvements over traditional methods. In this light, this Letter aims at detecting the need for revising the standards for human ergonomics and biomechanical risk assessment by analyzing the WMDs prevalence and incidence; additionally, the strengths and weaknesses of traditional methods listed within the International Standards for manual handling activities and the next challenges needed for their revision are considered. As a representative example, the discussion is referred to the lifting of heavy loads where the revision should include the use of sensor-based tools for biomechanical risk assessment during lifting performed with the use of exoskeletons, by more than one person (team lifting) and when the traditional methods cannot be applied. The wearability of sensing and feedback sensors in addition to human augmentation technologies allows for increasing workers' awareness about possible risks and enhance the effectiveness and safety during the execution of in many manual handling activities.
Collapse
Affiliation(s)
- Alberto Ranavolo
- Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, INAIL, Monte Porzio Catone, 00040 Rome, Italy; (S.I.); (A.S.); (T.V.); (F.D.)
| | - Arash Ajoudani
- HRI2 Laboratory, Istituto Italiano di Tecnologia, 16163 Genova, Italy;
| | | | - Matteo Bianchi
- Centro di Ricerca “Enrico Piaggio” and Department of Information Engineering, Università di Pisa, 56126 Pisa, Italy;
| | - Lars Fritzsche
- Ergonomics Division, IMK Automotive GmbH, 09128 Chemnitz, Germany;
| | - Sergio Iavicoli
- Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, INAIL, Monte Porzio Catone, 00040 Rome, Italy; (S.I.); (A.S.); (T.V.); (F.D.)
| | - Massimo Sartori
- Department of Biomechanical Engineering, University of Twente, 7522 NB Enschede, The Netherlands;
| | - Alessio Silvetti
- Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, INAIL, Monte Porzio Catone, 00040 Rome, Italy; (S.I.); (A.S.); (T.V.); (F.D.)
| | - Bram Vanderborght
- Brubotics, Vrije Universiteit Brussel, 1050 Brussels, Belgium;
- Flanders Make, Oude Diestersebaan 133, 3920 Lommel, Belgium
| | - Tiwana Varrecchia
- Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, INAIL, Monte Porzio Catone, 00040 Rome, Italy; (S.I.); (A.S.); (T.V.); (F.D.)
| | - Francesco Draicchio
- Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, INAIL, Monte Porzio Catone, 00040 Rome, Italy; (S.I.); (A.S.); (T.V.); (F.D.)
| |
Collapse
|
40
|
|
41
|
Li K, Zhang J, Wang L, Zhang M, Li J, Bao S. A review of the key technologies for sEMG-based human-robot interaction systems. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.102074] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
42
|
Machine learning methods to support personalized neuromusculoskeletal modelling. Biomech Model Mechanobiol 2020; 19:1169-1185. [DOI: 10.1007/s10237-020-01367-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Accepted: 07/08/2020] [Indexed: 12/19/2022]
|
43
|
Comparison of Particle Filter to Established Filtering Methods in Electromyography Biofeedback. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101949] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
44
|
Kapelner T, Sartori M, Negro F, Farina D. Neuro-Musculoskeletal Mapping for Man-Machine Interfacing. Sci Rep 2020; 10:5834. [PMID: 32242142 PMCID: PMC7118097 DOI: 10.1038/s41598-020-62773-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2019] [Accepted: 03/09/2020] [Indexed: 12/31/2022] Open
Abstract
We propose a myoelectric control method based on neural data regression and musculoskeletal modeling. This paradigm uses the timings of motor neuron discharges decoded by high-density surface electromyogram (HD-EMG) decomposition to estimate muscle excitations. The muscle excitations are then mapped into the kinematics of the wrist joint using forward dynamics. The offline tracking performance of the proposed method was superior to that of state-of-the-art myoelectric regression methods based on artificial neural networks in two amputees and in four out of six intact-bodied subjects. In addition to joint kinematics, the proposed data-driven model-based approach also estimated several biomechanical variables in a full feed-forward manner that could potentially be useful in supporting the rehabilitation and training process. These results indicate that using a full forward dynamics musculoskeletal model directly driven by motor neuron activity is a promising approach in rehabilitation and prosthetics to model the series of transformations from muscle excitation to resulting joint function.
Collapse
Affiliation(s)
- Tamas Kapelner
- Orthopaedic Surgery and Plastic Surgery - Research Department of Neurorehabilitation Systems, Clinic for Trauma Surgery, University Medical Center Göttingen, Göttingen, 37075, Germany
| | - Massimo Sartori
- Department of Biomechanical Engineering, TechMed Centre, University of Twente, Enschede, Netherlands
| | - Francesco Negro
- Department of Clinical and Experimental Sciences, Research Centre for Neuromuscular Function and Adapted Physical Activity "Teresa Camplani", Università degli Studi di Brescia, Brescia, Italy
| | - Dario Farina
- Department of Bioengineering, Imperial College London, SW7 2AZ, London, UK.
| |
Collapse
|
45
|
Cop CP, Durandau G, Esteban AM, van 't Veld RC, Schouten AC, Sartori M. Model-Based Estimation of Ankle Joint Stiffness During Dynamic Tasks: a Validation-Based Approach. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:4104-4107. [PMID: 31946773 DOI: 10.1109/embc.2019.8857391] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Joint stiffness estimation under dynamic conditions still remains a challenge. Current stiffness estimation methods often rely on the external perturbation of the joint. In this study, a novel 'perturbation-free' stiffness estimation method via electromyography (EMG)-driven musculoskeletal modeling was validated for the first time against system identification techniques. EMG signals, motion capture, and dynamic data of the ankle joint were collected in an experimental setup to study the ankle joint stiffness in a controlled way, i.e. at a movement frequency of 0.6 Hz as well as in the presence and absence of external perturbations. The model-based joint stiffness estimates were comparable to system identification techniques. The ability to estimate joint stiffness at any instant of time, with no need to apply joint perturbations, might help to fill the gap of knowledge between the neural and the muscular systems and enable the subsequent development of tailored neurorehabilitation therapies and biomimetic prostheses and orthoses.
Collapse
|
46
|
Zhang Q, Kim K, Sharma N. Prediction of Ankle Dorsiflexion Moment by Combined Ultrasound Sonography and Electromyography. IEEE Trans Neural Syst Rehabil Eng 2020; 28:318-327. [DOI: 10.1109/tnsre.2019.2953588] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
47
|
Pizzolato C, Saxby DJ, Palipana D, Diamond LE, Barrett RS, Teng YD, Lloyd DG. Neuromusculoskeletal Modeling-Based Prostheses for Recovery After Spinal Cord Injury. Front Neurorobot 2019; 13:97. [PMID: 31849634 PMCID: PMC6900959 DOI: 10.3389/fnbot.2019.00097] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2019] [Accepted: 11/05/2019] [Indexed: 01/12/2023] Open
Abstract
Concurrent stimulation and reinforcement of motor and sensory pathways has been proposed as an effective approach to restoring function after developmental or acquired neurotrauma. This can be achieved by applying multimodal rehabilitation regimens, such as thought-controlled exoskeletons or epidural electrical stimulation to recover motor pattern generation in individuals with spinal cord injury (SCI). However, the human neuromusculoskeletal (NMS) system has often been oversimplified in designing rehabilitative and assistive devices. As a result, the neuromechanics of the muscles is seldom considered when modeling the relationship between electrical stimulation, mechanical assistance from exoskeletons, and final joint movement. A powerful way to enhance current neurorehabilitation is to develop the next generation prostheses incorporating personalized NMS models of patients. This strategy will enable an individual voluntary interfacing with multiple electromechanical rehabilitation devices targeting key afferent and efferent systems for functional improvement. This narrative review discusses how real-time NMS models can be integrated with finite element (FE) of musculoskeletal tissues and interface multiple assistive and robotic devices with individuals with SCI to promote neural restoration. In particular, the utility of NMS models for optimizing muscle stimulation patterns, tracking functional improvement, monitoring safety, and providing augmented feedback during exercise-based rehabilitation are discussed.
Collapse
Affiliation(s)
- Claudio Pizzolato
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre for Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| | - David J Saxby
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre for Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| | - Dinesh Palipana
- Griffith Centre for Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia.,The Hopkins Centre, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia.,Gold Coast Hospital and Health Service, Gold Coast, QLD, Australia.,School of Medicine, Griffith University, Gold Coast, QLD, Australia
| | - Laura E Diamond
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre for Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| | - Rod S Barrett
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre for Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| | - Yang D Teng
- Department of Physical Medicine and Rehabilitation, Spaulding Rehabilitation Hospital, Harvard Medical School, Charlestown, MA, United States.,Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States
| | - David G Lloyd
- School of Allied Health Sciences, Griffith University, Gold Coast, QLD, Australia.,Griffith Centre for Biomedical and Rehabilitation Engineering, Menzies Health Institute Queensland, Griffith University, Gold Coast, QLD, Australia
| |
Collapse
|
48
|
Abstract
Vertical loading rate could be associated with residuum and whole body injuries affecting individuals fitted with transtibial prostheses. The objective of this study was to outline one out of five automated methods of extraction of vertical loading rate that stacked up the best against manual detection, which is considered the gold standard during pseudo-prosthetic gait. The load applied on the long axis of the leg of three males was recorded using a transducer fitted between a prosthetic foot and physiotherapy boot while walking on a treadmill for circa 30 min. The automated method of extraction of vertical loading rate, combining the lowest absolute average and range of 95% CI difference compared to the manual method, was deemed the most accurate and precise. The average slope of the loading rate detected manually over 150 strides was 5.56 ± 1.33 kN/s, while the other slopes ranged from 4.43 ± 0.98 kN/s to 6.52 ± 1.64 kN/s depending on the automated detection method. An original method proposed here, relying on progressive loading gradient-based automated extraction, produced the closest results (6%) to manual selection. This work contributes to continuous efforts made by providers of prosthetic and rehabilitation care to generate evidence informing reflective clinical decision-making.
Collapse
|
49
|
Grabke EP, Masani K, Andrysek J. Lower Limb Assistive Device Design Optimization Using Musculoskeletal Modeling: A Review. J Med Device 2019. [DOI: 10.1115/1.4044739] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
AbstractMany individuals with lower limb amputations or neuromuscular impairments face mobility challenges attributable to suboptimal assistive device design. Forward dynamic modeling and simulation of human walking using conventional biomechanical gait models offer an alternative to intuition-based assistive device design, providing insight into the biomechanics underlying pathological gait. Musculoskeletal models enable better understanding of prosthesis and/or exoskeleton contributions to the human musculoskeletal system, and device and user contributions to both body support and propulsion during gait. This paper reviews current literature that have used forward dynamic simulation of clinical population musculoskeletal models to perform assistive device design optimization using optimal control, optimal tracking, computed muscle control (CMC) and reflex-based control. Musculoskeletal model complexity and assumptions inhibit forward dynamic musculoskeletal modeling in its current state, hindering computational assistive device design optimization. Future recommendations include validating musculoskeletal models and resultant assistive device designs, developing less computationally expensive forward dynamic musculoskeletal modeling methods, and developing more efficient patient-specific musculoskeletal model generation methods to enable personalized assistive device optimization.
Collapse
Affiliation(s)
- Emerson Paul Grabke
- Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, ON M5S 3G9, Canada
| | - Kei Masani
- KITE—Toronto Rehabilitation Institute, University Health Network, Toronto, ON M4G 3V9, Canada
| | - Jan Andrysek
- Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON M4G1R8, Canada
| |
Collapse
|
50
|
Pan L, Crouch DL, Huang H. Comparing EMG-Based Human-Machine Interfaces for Estimating Continuous, Coordinated Movements. IEEE Trans Neural Syst Rehabil Eng 2019; 27:2145-2154. [PMID: 31478862 DOI: 10.1109/tnsre.2019.2937929] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Electromyography (EMG)-based interfaces are trending toward continuous, simultaneous control with multiple degrees of freedom. Emerging methods range from data-driven approaches to biomechanical model-based methods. However, there has been no direct comparison between these two types of continuous EMG-based interfaces. The aim of this study was to compare a musculoskeletal model (MM) with two data-driven approaches, linear regression (LR) and artificial neural network (ANN), for predicting continuous wrist and hand motions for EMG-based interfaces. Six able-bodied subjects and one transradial amputee subject performed (missing) metacarpophalangeal (MCP) and wrist flexion/extension, simultaneously or independently, while four EMG signals were recorded from forearm muscles. To add variation to the EMG signals, the subjects repeated the MCP and wrist motions at various upper extremity postures. For each subject, the EMG signals collected from the neutral posture were used to build the EMG interfaces; the EMG signals collected from all postures were used to evaluate the interfaces. The performance of the interface was quantified by Pearson's correlation coefficient (r) and the normalized root mean square error (NRMSE) between measured and estimated joint angles. The results demonstrated that the MM predicted movements more accurately, with higher r values and lower NRMSE, than either LR or ANN. Similar results were observed in the transradial amputee. Additionally, the variation in r across postures, an indicator of reliability against posture changes, was significantly lower (better) for the MM than for either LR or ANN. Our findings suggest that incorporating musculoskeletal knowledge into EMG-based human-machine interfaces could improve the estimation of continuous, coordinated motion.
Collapse
|