1
|
Song H, Hsieh TH, Yeon SH, Shu T, Nawrot M, Landis CF, Friedman GN, Israel EA, Gutierrez-Arango S, Carty MJ, Freed LE, Herr HM. Continuous neural control of a bionic limb restores biomimetic gait after amputation. Nat Med 2024; 30:2010-2019. [PMID: 38951635 PMCID: PMC11271427 DOI: 10.1038/s41591-024-02994-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 04/11/2024] [Indexed: 07/03/2024]
Abstract
For centuries scientists and technologists have sought artificial leg replacements that fully capture the versatility of their intact biological counterparts. However, biological gait requires coordinated volitional and reflexive motor control by complex afferent and efferent neural interplay, making its neuroprosthetic emulation challenging after limb amputation. Here we hypothesize that continuous neural control of a bionic limb can restore biomimetic gait after below-knee amputation when residual muscle afferents are augmented. To test this hypothesis, we present a neuroprosthetic interface consisting of surgically connected, agonist-antagonist muscles including muscle-sensing electrodes. In a cohort of seven leg amputees, the interface is shown to augment residual muscle afferents by 18% of biologically intact values. Compared with a matched amputee cohort without the afferent augmentation, the maximum neuroprosthetic walking speed is increased by 41%, enabling equivalent peak speeds to persons without leg amputation. Further, this level of afferent augmentation enables biomimetic adaptation to various walking speeds and real-world environments, including slopes, stairs and obstructed pathways. Our results suggest that even a small augmentation of residual muscle afferents restores biomimetic gait under continuous neuromodulation in individuals with leg amputation.
Collapse
Affiliation(s)
- Hyungeun Song
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Tsung-Han Hsieh
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Seong Ho Yeon
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Tony Shu
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Michael Nawrot
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Mechanical Engineering Department, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Christian F Landis
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Gabriel N Friedman
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Neurosurgery, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Erica A Israel
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Samantha Gutierrez-Arango
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Matthew J Carty
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Division of Plastic and Reconstructive Surgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Lisa E Freed
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Hugh M Herr
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute, Massachusetts Institute of Technology, Cambridge, MA, USA.
| |
Collapse
|
2
|
Rubin N, Hinson R, Saul K, Hu X, Huang H. Ankle Torque Estimation With Motor Unit Discharges in Residual Muscles Following Lower-Limb Amputation. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4821-4830. [PMID: 38015668 PMCID: PMC10752569 DOI: 10.1109/tnsre.2023.3336543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
There has been increased interest in using residual muscle activity for neural control of powered lower-limb prostheses. However, only surface electromyography (EMG)-based decoders have been investigated. This study aims to investigate the potential of using motor unit (MU)-based decoding methods as an alternative to EMG-based intent recognition for ankle torque estimation. Eight people without amputation (NON) and seven people with amputation (AMP) participated in the experiments. Subjects conducted isometric dorsi- and plantarflexion with their intact limb by tracing desired muscle activity of the tibialis anterior (TA) and gastrocnemius (GA) while ankle torque was recorded. To match phantom limb and intact limb activity, AMP mirrored muscle activation with their residual TA and GA. We compared neuromuscular decoders (linear regression) for ankle joint torque estimation based on 1) EMG amplitude (aEMG), 2) MU firing frequencies representing neural drive (ND), and 3) MU firings convolved with modeled twitch forces (MUDrive). In addition, sensitivity analysis and dimensionality reduction of optimization were performed on the MUDrive method to further improve its practical value. Our results suggest MUDrive significantly outperforms (lower root-mean-square error) EMG and ND methods in muscles of NON, as well as both intact and residual muscles of AMP. Reducing the number of optimized MUDrive parameters degraded performance. Even so, optimization computational time was reduced and MUDrive still outperformed aEMG. Our outcomes indicate integrating MU discharges with modeled biomechanical outputs may provide a more accurate torque control signal than direct EMG control of assistive, lower-limb devices, such as exoskeletons and powered prostheses.
Collapse
|
3
|
Teng Z, Xu G, Zhang X, Chen X, Zhang S, Huang HY. Concurrent and continuous estimation of multi-finger forces by synergy mapping and reconstruction: a pilot study. J Neural Eng 2023; 20:066024. [PMID: 38029436 DOI: 10.1088/1741-2552/ad10d1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 11/29/2023] [Indexed: 12/01/2023]
Abstract
Objective.The absence of intuitive control in present myoelectric interfaces makes it a challenge for users to communicate with assistive devices efficiently in real-world conditions. This study aims to tackle this difficulty by incorporating neurophysiological entities, namely muscle and force synergies, onto multi-finger force estimation to allow intuitive myoelectric control.Approach. Eleven healthy subjects performed six isometric grasping tasks at three muscle contraction levels. The exerted fingertip forces were collected concurrently with the surface electromyographic (sEMG) signals from six extrinsic and intrinsic muscles of hand. Muscle synergies were then extracted from recorded sEMG signals, while force synergies were identified from measured force data. Afterwards, a linear regressor was trained to associate the two types of synergies. This would allow us to predict multi-finger forces simply by multiplying the activation signals derived from muscle synergies with the weighting matrix of initially identified force synergies. To mitigate the false activation of unintended fingers, the force predictions were finally corrected by a finger state recognition procedure.Main results. We found that five muscle synergies and four force synergies are able to make a tradeoff between the computation load and the prediction accuracy for the proposed model; When trained and tested on all six grasping tasks, our method (SYN-II) achieved better performance (R2= 0.80 ± 0.04, NRMSE = 0.19 ± 0.01) than conventional sEMG amplitude-based method; Interestingly, SYN-II performed better than all other methods when tested on two unknown tasks outside the four training tasks (R2= 0.74 ± 0.03, NRMSE = 0.22 ± 0.02), which indicated better generalization ability.Significance. This study shows the first attempt to link between muscle and force synergies to allow concurrent and continuous estimation of multi-finger forces from sEMG. The proposed approach may lay the foundation for high-performance myoelectric interfaces that allow users to control robotic hands in a more natural and intuitive manner.
Collapse
Affiliation(s)
- Zhicheng Teng
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Guanghua Xu
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Xun Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Xiaobi Chen
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Sicong Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, People's Republic of China
| | - Hsien-Yung Huang
- Department of Bioengineering, Imperial College London, London, United Kingdom
| |
Collapse
|
4
|
Park J, Jeoung J, Kim D, Pak C, Hong J, Min S, Kim B, Lee S. Flexible & Stretchable EMG Sensor for Lower Extremity Amputee. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083375 DOI: 10.1109/embc40787.2023.10341075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
EMG signals can be widely used for indicators of muscle activity, and it can be used for robot control. However, the practical use of the EMG sensor for the amputee has been limited due to harsh conditions in the socket where strong pressure and friction exist. In this paper, thus we suggested a flexible and stretchable EMG Sensor. It is designed to withstand the pressure of the socket and to be used repeatedly with soft adhesive material. The performance of mechanical and electrical properties is investigated, and the muscle signals are recorded in static and dynamic (jump and gait) conditions. The selectivity of the recorded muscle signals during dorsiflexion and plantar flexion shows better than that of commercial electrodes indicating that it could be used for control of robotic legs in the future.Clinical Relevance- The flexible material and stretchable electrode pattern could be helpful in clinical research for an amputee.
Collapse
|
5
|
Gehlhar R, Tucker M, Young AJ, Ames AD. A Review of Current State-of-the-Art Control Methods for Lower-Limb Powered Prostheses. ANNUAL REVIEWS IN CONTROL 2023; 55:142-164. [PMID: 37635763 PMCID: PMC10449377 DOI: 10.1016/j.arcontrol.2023.03.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/29/2023]
Abstract
Lower-limb prostheses aim to restore ambulatory function for individuals with lower-limb amputations. While the design of lower-limb prostheses is important, this paper focuses on the complementary challenge - the control of lower-limb prostheses. Specifically, we focus on powered prostheses, a subset of lower-limb prostheses, which utilize actuators to inject mechanical power into the walking gait of a human user. In this paper, we present a review of existing control strategies for lower-limb powered prostheses, including the control objectives, sensing capabilities, and control methodologies. We separate the various control methods into three main tiers of prosthesis control: high-level control for task and gait phase estimation, mid-level control for desired torque computation (both with and without the use of reference trajectories), and low-level control for enforcing the computed torque commands on the prosthesis. In particular, we focus on the high- and mid-level control approaches in this review. Additionally, we outline existing methods for customizing the prosthetic behavior for individual human users. Finally, we conclude with a discussion on future research directions for powered lower-limb prostheses based on the potential of current control methods and open problems in the field.
Collapse
Affiliation(s)
- Rachel Gehlhar
- Department of Mechanical and Civil Engineering, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
| | - Maegan Tucker
- Department of Mechanical and Civil Engineering, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
| | - Aaron J Young
- Woodruff School of Mechanical Engineering, Georgia Institute of Technology, North Avenue, Atlanta, 30332, GA, USA
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, North Avenue, Atlanta, 30332, GA, USA
| | - Aaron D Ames
- Department of Mechanical and Civil Engineering, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
- Department of Computing and Mathematical Sciences, California Institute of Technology, 1200 E. California Blvd., Pasadena, 91125, CA, USA
| |
Collapse
|
6
|
Shu T, Shallal C, Chun E, Shah A, Bu A, Levine D, Yeon SH, Carney M, Song H, Hsieh TH, Herr HM. Modulation of Prosthetic Ankle Plantarflexion Through Direct Myoelectric Control of a Subject-Optimized Neuromuscular Model. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3183762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Tony Shu
- Media Lab, MIT Cambridge, Cambridge, MA, USA
| | - Christopher Shallal
- Harvard-MIT Program in Health Sciences and Technology, MIT Cambridge, Cambridge, MA, USA
| | - Ethan Chun
- Department of Electrical Engineering and Computer Science, MIT Cambridge, Cambridge, MA, USA
| | - Aashini Shah
- Department of Mechanical Engineering, MIT Cambridge, Cambridge, MA, USA
| | - Angel Bu
- Department of Mechanical Engineering, MIT Cambridge, Cambridge, MA, USA
| | | | | | | | - Hyungeun Song
- Harvard-MIT Program in Health Sciences and Technology, MIT Cambridge, Cambridge, MA, USA
| | | | | |
Collapse
|
7
|
Yeon SH, Herr HM. Rejecting Impulse Artifacts from Surface EMG Signals using Real-time Cumulative Histogram Filtering. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6235-6241. [PMID: 34892539 DOI: 10.1109/embc46164.2021.9631052] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
This paper presents a cumulative histogram filtering (CHF) algorithm to filter impulsive artifacts within surface electromyograhy (sEMG) signal for time-domain signal feature extraction. The proposed CHF algorithm filters sEMG signals by extracting a continuous subset of amplitude-sorted values within a real-time window of measured samples using information about the probabilistic distribution of sEMG amplitude. For real-time deployment of the proposed CHF algorithm on an embedded computing platform, we also present an efficient, iterative implementation of the proposed algorithm. The proposed CHF algorithm was evaluated on synthetic impulse artifacts superimposed upon undisturbed sEMG recorded from a subject with transtibial amputation. Results suggest that the CHF algorithm effectively suppresses the simulated impulse artifacts while preserving a minimum signal-to-noise ratio of 95% and an average Pearson correlation of 0.99 compared to the undisturbed sEMG recordings.
Collapse
|
8
|
Yeon SH, Song H, Herr HM. Spatiotemporally Synchronized Surface EMG and Ultrasonography Measurement Using a Flexible and Low-Profile EMG Electrode. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6242-6246. [PMID: 34892540 DOI: 10.1109/embc46164.2021.9629789] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The temporally synchronized recording of muscle activity and fascicle dynamics is essential in understanding the neurophysiology of human motor control which could promote developments of effective rehabilitation strategies and assistive technologies. Surface electromyography (sEMG) and ultrasonography provide easy-to-use, low-cost, and noninvasive modalities to assess muscle activity and fascicle dynamics, and have been widely used in both clinical and lab settings. However, due to size of these sensors and limited skin surface area, it is extremely challenging to collect data from a muscle of interest in a spatially as well as temporally synchronized manner. Here, we introduce a low-cost, noninvasive flexible electrode that provides high quality sEMG recording, while also enabling spatiotemporally synchronized ultrasonography recordings. The proposed method was verified by comparing ultrasonography of a phantom and a tibialis anterior (TA) muscle during dorsiflexion and plantarflexion with and without the electrode acutely placed under an ultrasound probe. Our results show no significant artifact in ultrasonography from both the phantom and TA fascicle strains due to the presence of the electrode, demonstrating the capability of spatiotemporally synchronized sEMG and ultrasonography recording.
Collapse
|