1
|
Bell S, Nasr A, McPhee J. General Muscle Torque Generator Model for a Two Degree-of-Freedom Shoulder Joint. J Biomech Eng 2024; 146:081008. [PMID: 38470378 DOI: 10.1115/1.4065044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 03/04/2024] [Indexed: 03/13/2024]
Abstract
Muscle torque generators (MTGs) have been developed as an alternative to muscle-force models, reducing the muscle-force model complexity to a single torque at the joint. Current MTGs can only be applied to single Degree-of-freedom (DoF) joints, leading to complications in modeling joints with multiple-DoFs such as the shoulder. This study aimed to develop an MTG model that accounts for the coupling between 2-DoF at the shoulder joint: shoulder plane of elevation (horizontal abduction/adduction) and shoulder elevation (flexion/extension). Three different 2-DoF MTG equations were developed to model the coupling between these two movements. Net joint torques at the shoulder were determined for 20 participants (10 females and 10 males) in isometric, isokinetic, and passive tests. Curve and surface polynomial fitting were used to find the best general fit for the experimental data in terms of the different degrees of coupling. The models were validated against experimental isokinetic torque data. It was determined that implicit coupling that used interpolation between single-DoF MTGs resulted in the lowest root-mean-square percent error of 8.5%. The work demonstrated that general MTG models can predict torque results that are dependent on multiple-DoFs of the shoulder.
Collapse
Affiliation(s)
- Sydney Bell
- Systems Design Engineering Department, University of Waterloo, Waterloo, ON N2L 3G1, Canada
- University of Waterloo
| | - Ali Nasr
- Systems Design Engineering Department, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - John McPhee
- Systems Design Engineering Department, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| |
Collapse
|
2
|
Zheng Y, Zheng G, Zhang H, Zhao B, Sun P. Mapping Method of Human Arm Motion Based on Surface Electromyography Signals. SENSORS (BASEL, SWITZERLAND) 2024; 24:2827. [PMID: 38732933 PMCID: PMC11086324 DOI: 10.3390/s24092827] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 04/19/2024] [Accepted: 04/24/2024] [Indexed: 05/13/2024]
Abstract
This paper investigates a method for precise mapping of human arm movements using sEMG signals. A multi-channel approach captures the sEMG signals, which, combined with the accurately calculated joint angles from an Inertial Measurement Unit, allows for action recognition and mapping through deep learning algorithms. Firstly, signal acquisition and processing were carried out, which involved acquiring data from various movements (hand gestures, single-degree-of-freedom joint movements, and continuous joint actions) and sensor placement. Then, interference signals were filtered out through filters, and the signals were preprocessed using normalization and moving averages to obtain sEMG signals with obvious features. Additionally, this paper constructs a hybrid network model, combining Convolutional Neural Networks and Artificial Neural Networks, and employs a multi-feature fusion algorithm to enhance the accuracy of gesture recognition. Furthermore, a nonlinear fitting between sEMG signals and joint angles was established based on a backpropagation neural network, incorporating momentum term and adaptive learning rate adjustments. Finally, based on the gesture recognition and joint angle prediction model, prosthetic arm control experiments were conducted, achieving highly accurate arm movement prediction and execution. This paper not only validates the potential application of sEMG signals in the precise control of robotic arms but also lays a solid foundation for the development of more intuitive and responsive prostheses and assistive devices.
Collapse
Affiliation(s)
- Yuanyuan Zheng
- School of Mechanical and Energy Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China
- Key Laboratory of Special Purpose Equipment and Advanced Processing Technology, Ministry of Education and Zhejiang Province, Zhejiang University of Technology, Hangzhou 310023, China
| | - Gang Zheng
- School of Mechanical and Energy Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China
| | - Hanqi Zhang
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
| | - Bochen Zhao
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
| | - Peng Sun
- Key Laboratory of Special Purpose Equipment and Advanced Processing Technology, Ministry of Education and Zhejiang Province, Zhejiang University of Technology, Hangzhou 310023, China
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
| |
Collapse
|
3
|
Nasr A, Hashemi A, McPhee J. Scalable musculoskeletal model for dynamic simulations of upper body movement. Comput Methods Biomech Biomed Engin 2024; 27:306-337. [PMID: 36877170 DOI: 10.1080/10255842.2023.2184747] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/19/2022] [Accepted: 02/07/2023] [Indexed: 03/07/2023]
Abstract
A musculoskeletal (MSK) model is a valuable tool for assessing complex biomechanical problems, estimating joint torques during motion, optimizing motion in sports, and designing exoskeletons and prostheses. This study proposes an open-source upper body MSK model that supports biomechanical analysis of human motion. The MSK model of the upper body consists of 8 body segments (torso, head, left/right upper arm, left/right forearm, and left/right hand). The model has 20 degrees of freedom (DoFs) and 40 muscle torque generators (MTGs), which are constructed using experimental data. The model is adjustable for different anthropometric measurements and subject body characteristics: sex, age, body mass, height, dominant side, and physical activity. Joint limits are modeled using experimental dynamometer data within the proposed multi-DoF MTG model. The model equations are verified by simulating the joint range of motion (ROM) and torque; all simulation results have a good agreement with previously published research.
Collapse
Affiliation(s)
- Ali Nasr
- Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| | - Arash Hashemi
- Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| | - John McPhee
- Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| |
Collapse
|
4
|
Nasr A, McPhee J. Scalable musculoskeletal model for dynamic simulations of lower body movement. Comput Methods Biomech Biomed Engin 2024:1-27. [PMID: 38396368 DOI: 10.1080/10255842.2024.2316240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 01/27/2024] [Indexed: 02/25/2024]
Abstract
A musculoskeletal (MSK) model is an important tool for analysing human motions, calculating joint torques during movement, enhancing sports activity, and developing exoskeletons and prostheses. To enable biomechanical investigation of human motion, this work presents an open-source lower body MSK model. The MSK model of the lower body consists of 7 body segments (pelvis, left/right thigh, left/right leg, and left/right foot). The model has 20 degrees of freedom (DoFs) and 28 muscle torque generators (MTGs), which are developed from experimental data. The model can be modified for different anthropometric measurements and subject body characteristics, including sex, age, body mass, height, physical activity, and skin temperature. The model is validated by simulating the torque within the range of motion (ROM) of isolated movements; all simulation findings exhibit a good level of agreement with the literature.
Collapse
Affiliation(s)
- Ali Nasr
- Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| | - John McPhee
- Department of Systems Design Engineering, University of Waterloo, Waterloo, Canada
| |
Collapse
|
5
|
Liu Y, Peng X, Tan Y, Oyemakinde TT, Wang M, Li G, Li X. A novel unsupervised dynamic feature domain adaptation strategy for cross-individual myoelectric gesture recognition. J Neural Eng 2024; 20:066044. [PMID: 38134446 DOI: 10.1088/1741-2552/ad184f] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 12/22/2023] [Indexed: 12/24/2023]
Abstract
Objective.Surface electromyography pattern recognition (sEMG-PR) is considered as a promising control method for human-machine interaction systems. However, the performance of a trained classifier would greatly degrade for novel users since sEMG signals are user-dependent and largely affected by a number of individual factors such as the quantity of subcutaneous fat and the skin impedance.Approach.To solve this issue, we proposed a novel unsupervised cross-individual motion recognition method that aligned sEMG features from different individuals by self-adaptive dimensional dynamic distribution adaptation (SD-DDA) in this study. In the method, both the distances of marginal and conditional distributions between source and target features were minimized through automatically selecting the optimal feature domain dimension by using a small amount of unlabeled target data.Main results.The effectiveness of the proposed method was tested on four different feature sets, and results showed that the average classification accuracy was improved by above 10% on our collected dataset with the best accuracy reached 90.4%. Compared to six kinds of classic transfer learning methods, the proposed method showed an outstanding performance with improvements of 3.2%-13.8%. Additionally, the proposed method achieved an approximate 9% improvement on a publicly available dataset.Significance.These results suggested that the proposed SD-DDA method is feasible for cross-individual motion intention recognition, which would provide help for the application of sEMG-PR based system.
Collapse
Affiliation(s)
- Yan Liu
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Xinhao Peng
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Yingxiao Tan
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Tolulope Tofunmi Oyemakinde
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Mengtao Wang
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Guanglin Li
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Xiangxin Li
- CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society, Research Center for Neural Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| |
Collapse
|
6
|
Nasr A, Dickerson CR, McPhee J. Experimental Study of Fully Passive, Fully Active, and Active-Passive Upper-Limb Exoskeleton Efficiency: An Assessment of Lifting Tasks. SENSORS (BASEL, SWITZERLAND) 2023; 24:63. [PMID: 38202925 PMCID: PMC10780908 DOI: 10.3390/s24010063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 12/12/2023] [Accepted: 12/15/2023] [Indexed: 01/12/2024]
Abstract
Recently, robotic exoskeletons are gaining attention for assisting industrial workers. The exoskeleton power source ranges from fully passive (FP) to fully active (FA), or a mixture of both. The objective of this experimental study was to assess the efficiency of a new active-passive (AP) shoulder exoskeleton using statistical analyses of 11 quantitative measures from surface electromyography (sEMG) and kinematic data and a user survey for weight lifting tasks. Two groups of females and males lifted heavy kettlebells, while a shoulder exoskeleton helped them in modes of fully passive (FP), fully active (FA), and active-passive (AP). The AP exoskeleton outperformed the FP and FA exoskeletons because the participants could hold the weighted object for nearly twice as long before fatigue occurred. Future developments should concentrate on developing sex-specific controllers as well as on better-fitting wearable devices for women.
Collapse
Affiliation(s)
- Ali Nasr
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada;
| | - Clark R. Dickerson
- Department of Kinesiology and Health Sciences, University of Waterloo, Waterloo, ON N2L 3G1, Canada;
| | - John McPhee
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada;
| |
Collapse
|
7
|
Chen Z, Min H, Wang D, Xia Z, Sun F, Fang B. A Review of Myoelectric Control for Prosthetic Hand Manipulation. Biomimetics (Basel) 2023; 8:328. [PMID: 37504216 PMCID: PMC10807628 DOI: 10.3390/biomimetics8030328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 07/14/2023] [Accepted: 07/19/2023] [Indexed: 07/29/2023] Open
Abstract
Myoelectric control for prosthetic hands is an important topic in the field of rehabilitation. Intuitive and intelligent myoelectric control can help amputees to regain upper limb function. However, current research efforts are primarily focused on developing rich myoelectric classifiers and biomimetic control methods, limiting prosthetic hand manipulation to simple grasping and releasing tasks, while rarely exploring complex daily tasks. In this article, we conduct a systematic review of recent achievements in two areas, namely, intention recognition research and control strategy research. Specifically, we focus on advanced methods for motion intention types, discrete motion classification, continuous motion estimation, unidirectional control, feedback control, and shared control. In addition, based on the above review, we analyze the challenges and opportunities for research directions of functionality-augmented prosthetic hands and user burden reduction, which can help overcome the limitations of current myoelectric control research and provide development prospects for future research.
Collapse
Affiliation(s)
- Ziming Chen
- Laboratory for Embedded System and Intelligent Robot, Wuhan University of Science and Technology, Wuhan 430081, China; (Z.C.); (H.M.)
| | - Huasong Min
- Laboratory for Embedded System and Intelligent Robot, Wuhan University of Science and Technology, Wuhan 430081, China; (Z.C.); (H.M.)
| | - Dong Wang
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Ziwei Xia
- School of Engineering and Technology, China University of Geosciences, Beijing 100083, China
| | - Fuchun Sun
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| | - Bin Fang
- Institute for Artificial Intelligence, State Key Lab of Intelligent Technology and Systems, Department of Computer Science and Technology, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
| |
Collapse
|
8
|
Nasr A, Hunter J, Dickerson CR, McPhee J. Evaluation of a machine-learning-driven active-passive upper-limb exoskeleton robot: Experimental human-in-the-loop study. WEARABLE TECHNOLOGIES 2023; 4:e13. [PMID: 38487766 PMCID: PMC10936398 DOI: 10.1017/wtc.2023.9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 02/07/2023] [Accepted: 03/26/2023] [Indexed: 03/17/2024]
Abstract
Evaluating exoskeleton actuation methods and designing an effective controller for these exoskeletons are both challenging and time-consuming tasks. This is largely due to the complicated human-robot interactions, the selection of sensors and actuators, electrical/command connection issues, and communication delays. In this research, a test framework for evaluating a new active-passive shoulder exoskeleton was developed, and a surface electromyography (sEMG)-based human-robot cooperative control method was created to execute the wearer's movement intentions. The hierarchical control used sEMG-based intention estimation, mid-level strength regulation, and low-level actuator control. It was then applied to shoulder joint elevation experiments to verify the exoskeleton controller's effectiveness. The active-passive assistance was compared with fully passive and fully active exoskeleton control using the following criteria: (1) post-test survey, (2) load tolerance duration, and (3) computed human torque, power, and metabolic energy expenditure using sEMG signals and inverse dynamic simulation. The experimental outcomes showed that active-passive exoskeletons required less muscular activation torque (50%) from the user and reduced fatigue duration indicators by a factor of 3, compared to fully passive ones.
Collapse
Affiliation(s)
- Ali Nasr
- Systems Design Engineering, University of Waterloo, Waterloo, ONN2L 3G1, Canada
| | - Jason Hunter
- Systems Design Engineering, University of Waterloo, Waterloo, ONN2L 3G1, Canada
| | - Clark R. Dickerson
- Kinesiology and Health Sciences, University of Waterloo, Waterloo, ONN2L 3G1, Canada
| | - John McPhee
- Systems Design Engineering, University of Waterloo, Waterloo, ONN2L 3G1, Canada
| |
Collapse
|
9
|
RBF Sliding Mode Control Method for an Upper Limb Rehabilitation Exoskeleton Based on Intent Recognition. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12104993] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Aiming at the lack of active willingness of patients to participate in the current upper limb exoskeleton rehabilitation training control methods, this study proposed a radial basis function (RBF) sliding mode impedance control method based on surface electromyography (sEMG) to identify the movement intention of upper limb rehabilitation. The proposed control method realizes the process of active and passive rehabilitation training according to the wearer’s movement intention. This study first established a joint angle prediction model based on sEMG for the problem of poor human–machine coupling and used the least-squares support vector machine method (LSSVM) to complete the upper limb joint angle prediction. In addition, in view of the problem of poor compliance in the rehabilitation training process, an adaptive sliding mode controller based on the RBF network approximation system model was proposed. In the process of active training, an impedance model was added based on the position loop control, which could dynamically adjust the motion trajectory according to the interaction force. The experiment results showed that the impedance control method based on the RBF could effectively reduce the interaction force between the human and machine to improve the compliance of the exoskeleton manipulator and achieve the purpose of stabilizing the impedance characteristics of the system.
Collapse
|
10
|
Knodel N, Lawson B, Bywater E, Lamia J, Patel S, Nauman EA. An EMG-Based Constitutive Law for Force Generation in Skeletal Muscle - Part II: Model Validation On the Ankle Joint Complex. J Biomech Eng 2022; 144:1140055. [PMID: 35388404 DOI: 10.1115/1.4054275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Indexed: 11/08/2022]
Abstract
This study evaluates the predictive ability of the skeletal muscle force model derived previously within the ankle joint complex. The model is founded in dimensional analysis, using electromyography and the muscle force-length, force-velocity, and force-frequency curves as inputs. Seventeen subjects (8 males, 9 females) performed five different exercises that activated the primary muscles crossing the ankle joint. Motion capture, force plate, and electromyography data were collected during these exercises. A constant, Km, was calculated for each muscle of each subject using four of the five exercises. The fifth exercise was used to validate the results by treating the moments due to muscle forces as known and all other components in Euler's second law as unknown. While muscle forces cannot be directly validated in vivo, methods can be developed to test these values with reasonable confidence. This study compared moments about the ankle joint due to the calculated muscle forces to the sum of the moments due to all other sources and the kinematic terms in the second Newton-Euler equation of rigid body motion. Average percent errors for each subject ranged from 4.2% to 15.5% with an average percent error across all subjects of 8.2% while maximum percent errors for each subject ranged from 33.3% to 78.0% with an overall average maximum of 52.4%. Future work will examine sensitivity analyses to identify potential simplifications to the model and solution process and will validate the model on a more complex joint.
Collapse
Affiliation(s)
- Nathan Knodel
- Purdue University, Department of Mechanical Engineering, 585 Purdue Mall, West Lafayette, IN 47906
| | - Brie Lawson
- Purdue University, Department of Mechanical Engineering, 585 Purdue Mall, West Lafayette, IN 47906
| | - Emily Bywater
- Purdue University, Department of Mechanical Engineering, 585 Purdue Mall, West Lafayette, IN 47906
| | - Joseph Lamia
- Purdue University, Department of Biomedical Engineering, 585 Purdue Mall, West Lafayette, IN 47906
| | - Shiv Patel
- Purdue University, Department of Biomedical Engineering, 585 Purdue Mall, West Lafayette, IN 47906
| | - Eric A Nauman
- Purdue University, Department of Mechanical Engineering, 585 Purdue Mall, West Lafayette, IN 47906; Purdue University, Department of Biomedical Engineering, 585 Purdue Mall, West Lafayette, IN 47906; Purdue University, Department of Basic Medical Sciences, 585 Purdue Mall, West Lafayette, IN 47906
| |
Collapse
|
11
|
Wimalasena LN, Braun J, Keshtkaran MR, Hofmann D, Gallego JÁ, Alessandro C, Tresch M, Miller LE, Pandarinath C. Estimating muscle activation from EMG using deep learning-based dynamical systems models. J Neural Eng 2022; 19. [PMID: 35366649 DOI: 10.1088/1741-2552/ac6369] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Accepted: 04/01/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE To study the neural control of movement, it is often necessary to estimate how muscles are activated across a variety of behavioral conditions. One approach is to try extracting the underlying neural command signal to muscles by applying latent variable modeling methods to electromyographic (EMG) recordings. However, estimating the latent command signal that underlies muscle activation is challenging due to its complex relation with recorded EMG signals. Common approaches estimate each muscle activation independently or require manual tuning of model hyperparameters to preserve behaviorally-relevant features. APPROACH Here, we adapted AutoLFADS, a large-scale, unsupervised deep learning approach originally designed to de-noise cortical spiking data, to estimate muscle activation from multi-muscle EMG signals. AutoLFADS uses recurrent neural networks (RNNs) to model the spatial and temporal regularities that underlie multi-muscle activation. MAIN RESULTS We first tested AutoLFADS on muscle activity from the rat hindlimb during locomotion and found that it dynamically adjusts its frequency response characteristics across different phases of behavior. The model produced single-trial estimates of muscle activation that improved prediction of joint kinematics as compared to low-pass or Bayesian filtering. We also applied AutoLFADS to monkey forearm muscle activity recorded during an isometric wrist force task. AutoLFADS uncovered previously uncharacterized high-frequency oscillations in the EMG that enhanced the correlation with measured force. The AutoLFADS-inferred estimates of muscle activation were also more closely correlated with simultaneously-recorded motor cortical activity than were other tested approaches. SIGNIFICANCE This method leverages dynamical systems modeling and artificial neural networks to provide estimates of muscle activation for multiple muscles. Ultimately, the approach can be used for further studies of multi-muscle coordination and its control by upstream brain areas.
Collapse
Affiliation(s)
- Lahiru Neth Wimalasena
- Biomedical Engineering, Emory University, 101 Woodruff Circle NE, Atlanta, Georgia, 30322-1007, UNITED STATES
| | - Jonas Braun
- Electrical and Computer Engineering, Technical University of Munich, Arcisstraße 21, Munchen, Bayern, 80333, GERMANY
| | - Mohammad Reza Keshtkaran
- Biomedical Engineering, Emory University, 101 Woodruff Circle NE, Atlanta, Georgia, 30322-1007, UNITED STATES
| | - David Hofmann
- Physics, Emory University, Math & Science Center, 400 Dowman Drive, Atlanta, Georgia, 30322-1007, UNITED STATES
| | - Juan Álvaro Gallego
- Physiology, Northwestern University Feinberg School of Medicine, 303 East Chicago Ave, Chicago, Illinois, 60611-3008, UNITED STATES
| | - Cristiano Alessandro
- Physiology, Northwestern University Feinberg School of Medicine, 303 East Chicago Ave, Chicago, Illinois, 60611-3008, UNITED STATES
| | - Matthew Tresch
- Physiology, Northwestern University Feinberg School of Medicine, 303 East Chicago Ave, Chicago, Illinois, 60611-3008, UNITED STATES
| | - Lee E Miller
- Physiology, Northwestern University Feinberg School of Medicine, 303 East Chicago Ave, Chicago, Illinois, 60611-3008, UNITED STATES
| | - Chethan Pandarinath
- Biomedical Engineering, Emory University, 101 Woodruff Circle NE, Atlanta, Georgia, 30322-1007, UNITED STATES
| |
Collapse
|
12
|
Nasr A, Inkol KA, Bell S, McPhee J. InverseMuscleNET: Alternative Machine Learning Solution to Static Optimization and Inverse Muscle Modeling. Front Comput Neurosci 2022; 15:759489. [PMID: 35002663 PMCID: PMC8735851 DOI: 10.3389/fncom.2021.759489] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Accepted: 11/29/2021] [Indexed: 11/13/2022] Open
Abstract
InverseMuscleNET, a machine learning model, is proposed as an alternative to static optimization for resolving the redundancy issue in inverse muscle models. A recurrent neural network (RNN) was optimally configured, trained, and tested to estimate the pattern of muscle activation signals. Five biomechanical variables (joint angle, joint velocity, joint acceleration, joint torque, and activation torque) were used as inputs to the RNN. A set of surface electromyography (EMG) signals, experimentally measured around the shoulder joint for flexion/extension, were used to train and validate the RNN model. The obtained machine learning model yields a normalized regression in the range of 88-91% between experimental data and estimated muscle activation. A sequential backward selection algorithm was used as a sensitivity analysis to discover the less dominant inputs. The order of most essential signals to least dominant ones was as follows: joint angle, activation torque, joint torque, joint velocity, and joint acceleration. The RNN model required 0.06 s of the previous biomechanical input signals and 0.01 s of the predicted feedback EMG signals, demonstrating the dynamic temporal relationships of the muscle activation profiles. The proposed approach permits a fast and direct estimation ability instead of iterative solutions for the inverse muscle model. It raises the possibility of integrating such a model in a real-time device for functional rehabilitation and sports evaluation devices with real-time estimation and tracking. This method provides clinicians with a means of estimating EMG activity without an invasive electrode setup.
Collapse
Affiliation(s)
- Ali Nasr
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Keaton A Inkol
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Sydney Bell
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| | - John McPhee
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada
| |
Collapse
|
13
|
Hashemi A, McPhee J. Assistive Sliding Mode Control of a Rehabilitation Robot with Automatic Weight Adjustment. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:4891-4896. [PMID: 34892305 DOI: 10.1109/embc46164.2021.9631110] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
There are approximately 13 million new stroke cases worldwide each year. Research has shown that robotics can provide practical and efficient solutions for expediting post-stroke patient recovery. This simulation study aimed to design a sliding mode controller (SMC) for an end-effector-based rehabilitation robot. A genetic algorithm (GA) was designed for automatic controller weight adjustment. The optimal weights were obtained by minimizing a cost function comprising the end-effector position error, robot input, robot input-rate, and patient input. To promote safe tuner optimization, a model of the human arm was incorporated to generate the human joint torque. A computed-torque proportional derivative controller (CTPD) was designed for the human arm to approximate the central nervous system (CNS) motor control. This controller was adjusted to simulate rehabilitation effects and patient adaptation. The tuner was optimized for a trajectory tracking task with an assistive high-level control scheme. The simulation results showed lower cost compared to seven manual weight settings. The optimal weights provided good tracking performance and suitable robot inputs. This research provides a framework to conduct various simulations before testing our controller on human subjects. The preliminary results of this study will be used as the starting point for online adaptive controller tuning, which will be examined in our future research.
Collapse
|