1
|
Herrera-Arcos G, Song H, Yeon SH, Ghenand O, Gutierrez-Arango S, Sinha S, Herr H. Closed-loop optogenetic neuromodulation enables high-fidelity fatigue-resistant muscle control. Sci Robot 2024; 9:eadi8995. [PMID: 38776378 DOI: 10.1126/scirobotics.adi8995] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Accepted: 04/25/2024] [Indexed: 05/25/2024]
Abstract
Closed-loop neuroprostheses show promise in restoring motion in individuals with neurological conditions. However, conventional activation strategies based on functional electrical stimulation (FES) fail to accurately modulate muscle force and exhibit rapid fatigue because of their unphysiological recruitment mechanism. Here, we present a closed-loop control framework that leverages physiological force modulation under functional optogenetic stimulation (FOS) to enable high-fidelity muscle control for extended periods of time (>60 minutes) in vivo. We first uncovered the force modulation characteristic of FOS, showing more physiological recruitment and significantly higher modulation ranges (>320%) compared with FES. Second, we developed a neuromuscular model that accurately describes the highly nonlinear dynamics of optogenetically stimulated muscle. Third, on the basis of the optogenetic model, we demonstrated real-time control of muscle force with improved performance and fatigue resistance compared with FES. This work lays the foundation for fatigue-resistant neuroprostheses and optogenetically controlled biohybrid robots with high-fidelity force modulation.
Collapse
Affiliation(s)
- Guillermo Herrera-Arcos
- K. Lisa Yang Center for Bionics, MIT, Cambridge, MA, USA
- Program in Media Arts and Sciences, MIT Media Lab, Cambridge, MA, USA
- McGovern Institute for Brain Research, MIT, Cambridge, MA, USA
| | - Hyungeun Song
- K. Lisa Yang Center for Bionics, MIT, Cambridge, MA, USA
- Harvard-MIT Division of Health Sciences and Technology (HST), MIT, Cambridge, MA, USA
| | - Seong Ho Yeon
- K. Lisa Yang Center for Bionics, MIT, Cambridge, MA, USA
- Program in Media Arts and Sciences, MIT Media Lab, Cambridge, MA, USA
| | - Omkar Ghenand
- K. Lisa Yang Center for Bionics, MIT, Cambridge, MA, USA
- Department of Biological Engineering, MIT, Cambridge, MA, USA
| | - Samantha Gutierrez-Arango
- K. Lisa Yang Center for Bionics, MIT, Cambridge, MA, USA
- Program in Media Arts and Sciences, MIT Media Lab, Cambridge, MA, USA
| | - Sapna Sinha
- K. Lisa Yang Center for Bionics, MIT, Cambridge, MA, USA
- McGovern Institute for Brain Research, MIT, Cambridge, MA, USA
| | - Hugh Herr
- K. Lisa Yang Center for Bionics, MIT, Cambridge, MA, USA
- McGovern Institute for Brain Research, MIT, Cambridge, MA, USA
| |
Collapse
|
2
|
Ross SA, Waters-Banker C, Sawatsky A, Leonard TR, Herzog W. A methodological approach for collecting simultaneous measures of muscle, aponeurosis, and tendon behaviour during dynamic contractions. Biol Open 2024; 13:bio060383. [PMID: 38780905 PMCID: PMC11139038 DOI: 10.1242/bio.060383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 04/23/2024] [Indexed: 05/25/2024] Open
Abstract
Skeletal muscles and the tendons that attach them to bone are structurally complex and deform non-uniformly during contraction. While these tissue deformations dictate force production during movement, our understanding of this behaviour is limited due to challenges in obtaining complete measures of the constituent structures. To address these challenges, we present an approach for simultaneously measuring muscle, fascicle, aponeurosis, and tendon behaviour using sonomicrometry. To evaluate this methodology, we conducted isometric and dynamic contractions in in situ rabbit medial gastrocnemius. We found comparable patterns of strain in the muscle belly, fascicle, aponeurosis, and tendon during the isometric trials to those published in the literature. For the dynamic contractions, we found that our measures using this method were consistent across all animals and aligned well with our theoretical understanding of muscle-tendon unit behaviour. Thus, this method provides a means to fully capture the complex behaviour of muscle-tendon units across contraction types.
Collapse
Affiliation(s)
- Stephanie A. Ross
- Human Performance Laboratory, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Christine Waters-Banker
- Human Performance Laboratory, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Andrew Sawatsky
- Human Performance Laboratory, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Timothy R. Leonard
- Human Performance Laboratory, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Walter Herzog
- Human Performance Laboratory, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada
| |
Collapse
|
3
|
Wan J, Nie Z, Xu J, Zhang Z, Yao S, Xiang Z, Lin X, Lu Y, Xu C, Zhao P, Wang Y, Zhang J, Wang Y, Zhang S, Wang J, Man W, Zhang M, Han M. Millimeter-scale magnetic implants paired with a fully integrated wearable device for wireless biophysical and biochemical sensing. SCIENCE ADVANCES 2024; 10:eadm9314. [PMID: 38507494 PMCID: PMC10954204 DOI: 10.1126/sciadv.adm9314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 02/13/2024] [Indexed: 03/22/2024]
Abstract
Implantable sensors can directly interface with various organs for precise evaluation of health status. However, extracting signals from such sensors mainly requires transcutaneous wires, integrated circuit chips, or cumbersome readout equipment, which increases the risks of infection, reduces biocompatibility, or limits portability. Here, we develop a set of millimeter-scale, chip-less, and battery-less magnetic implants paired with a fully integrated wearable device for measuring biophysical and biochemical signals. The wearable device can induce a large amplitude damped vibration of the magnetic implants and capture their subsequent motions wirelessly. These motions reflect the biophysical conditions surrounding the implants and the concentration of a specific biochemical depending on the surface modification. Experiments in rat models demonstrate the capabilities of measuring cerebrospinal fluid (CSF) viscosity, intracranial pressure, and CSF glucose levels. This miniaturized system opens the possibility for continuous, wireless monitoring of a wide range of biophysical and biochemical conditions within the living organism.
Collapse
Affiliation(s)
- Ji Wan
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
- School of Integrated Circuits, Peking University, Beijing, China
| | - Zhongyi Nie
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
| | - Jie Xu
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
| | - Zixuan Zhang
- School of Electronic and Computer Engineering, Peking University, Shenzhen, China
| | - Shenglian Yao
- School of Materials Science and Engineering, University of Science and Technology Beijing, Beijing, China
| | - Zehua Xiang
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
- School of Integrated Circuits, Peking University, Beijing, China
| | - Xiang Lin
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
| | - Yuxing Lu
- Department of Bigdata and Biomedical AI, College of Future Technology, Peking University, Beijing, China
| | - Chen Xu
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
- Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
| | - Pengcheng Zhao
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
- School of Integrated Circuits, Peking University, Beijing, China
| | - Yiran Wang
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
| | - Jingyan Zhang
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
| | - Yaozheng Wang
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
- School of Integrated Circuits, Peking University, Beijing, China
| | | | - Jinzhuo Wang
- Department of Bigdata and Biomedical AI, College of Future Technology, Peking University, Beijing, China
| | - Weitao Man
- Department of Neurosurgery, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University, Beijing, China
| | - Min Zhang
- School of Electronic and Computer Engineering, Peking University, Shenzhen, China
| | - Mengdi Han
- National Key Laboratory of Science and Technology on Micro/Nano Fabrication, Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
| |
Collapse
|
4
|
Daliri M, Akbarzadeh A, Aminzadeh B, Kachooei AR, Hajiaghajani G, Ebrahimzadeh MH, Moradi A. The second clinical study investigating the surgical method for the kineticomyographic control implementation of the bionic hand. Sci Rep 2023; 13:18387. [PMID: 37884628 PMCID: PMC10603097 DOI: 10.1038/s41598-023-45578-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 10/21/2023] [Indexed: 10/28/2023] Open
Abstract
In 2018, during our first clinical study on the kineticomyographic (KMG)-controlled bionic hand, we implanted three magnetic tags inside the musculotendinous junction of three paired extensor-flexor transferred tendons. However, the post-operative tissue adhesions affected the independent movements of the implanted tags and consequently the distinct patterns of the obtained signals. To overcome this issue, we modified our surgical procedure from a one-stage tendon transfer to a two-stage. During the first surgery, we created three tunnels using silicon rods for the smooth tendon gliding. In the second stage, we transferred the same three pairs of the forearm agonist-antagonist tendons through the tunnels and implanted the magnetic tags inside the musculotendinous junction. Compared to our prior clinical investigation, fluoroscopy and ultrasound evaluations revealed that the surgical modification in the current study yielded more pronounced independent movements in two specific magnetic tags associated with fingers (maximum 5.7 mm in the first trial vs. 28 mm in the recent trial with grasp and release) and thumb (maximum 3.2 mm in the first trial vs. 9 mm in the current trial with thumb flexion-extension). Furthermore, we observed that utilizing the flexor digitorum superficialis (FDS) tendons for the flexor component in finger and thumb tendon transfer resulted in more independent movements of the implanted tags, compared with the flexor digitorum profundus (FDP) in the prior research. This study can help us plan for our future five-channel bionic limb design by identifying the gestures with the most significant independent tag displacement.
Collapse
Affiliation(s)
- Mahla Daliri
- Orthopedics Research Center, Ghaem Hospital, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Alireza Akbarzadeh
- Mechanical Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Behzad Aminzadeh
- Department of Radiology, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Amir R Kachooei
- Orthopedics Research Center, Ghaem Hospital, Mashhad University of Medical Sciences, Mashhad, Iran
- Rothman Orthopaedic Institute, Orlando, FL, USA
| | - Ghazaleh Hajiaghajani
- Orthopedics Research Center, Ghaem Hospital, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Mohammad H Ebrahimzadeh
- Orthopedics Research Center, Ghaem Hospital, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Ali Moradi
- Orthopedics Research Center, Ghaem Hospital, Mashhad University of Medical Sciences, Mashhad, Iran.
| |
Collapse
|
5
|
Wang H, Nonaka T, Abdulali A, Iida F. Coordinating upper limbs for octave playing on the piano via neuro-musculoskeletal modeling. BIOINSPIRATION & BIOMIMETICS 2023; 18:066009. [PMID: 37714178 DOI: 10.1088/1748-3190/acfa51] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 09/15/2023] [Indexed: 09/17/2023]
Abstract
Understanding the coordination of multiple biomechanical degrees of freedom in biological organisms is crucial for unraveling the neurophysiological control of sophisticated motor tasks. This study focuses on the cooperative behavior of upper-limb motor movements in the context of octave playing on the piano. While the vertebrate locomotor system has been extensively investigated, the coherence and precision timing of rhythmic movements in the upper-limb system remain incompletely understood. Inspired by the spinal cord neuronal circuits (central pattern generator, CPG), a computational neuro-musculoskeletal model is proposed to explore the coordination of upper-limb motor movements during octave playing across varying tempos and volumes. The proposed model incorporates a CPG-based nervous system, a physiologically-informed mechanical body, and a piano environment to mimic human joint coordination and expressiveness. The model integrates neural rhythm generation, spinal reflex circuits, and biomechanical muscle dynamics while considering piano playing quality and energy expenditure. Based on real-world human subject experiments, the model has been refined to study tempo transitions and volume control during piano playing. This computational approach offers insights into the neurophysiological basis of upper-limb motor coordination in piano playing and its relation to expressive features.
Collapse
Affiliation(s)
- Huijiang Wang
- Bio-Inspired Robotics Lab, Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, United Kingdom
| | - Tetsushi Nonaka
- Graduate School of Human Development and Environment, Kobe University, Kobe 6578501, Japan
| | - Arsen Abdulali
- Bio-Inspired Robotics Lab, Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, United Kingdom
| | - Fumiya Iida
- Bio-Inspired Robotics Lab, Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, United Kingdom
| |
Collapse
|
6
|
Paggetti F, Gherardini M, Lucantonio A, Cipriani C. To What Extent Implanting Single vs Pairs of Magnets Per Muscle Affect the Localization Accuracy of the Myokinetic Control Interface? Evidence From a Simulated Environment. IEEE Trans Biomed Eng 2023; 70:2972-2979. [PMID: 37141061 DOI: 10.1109/tbme.2023.3272977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
OBJECTIVE We recently proposed a new concept of human-machine interface to control hand prostheses which we dubbed the myokinetic control interface. Such interface detects muscle displacement during contraction by localizing permanent magnets implanted in the residual muscles. So far, we evaluated the feasibility of implanting one magnet per muscle and monitoring its displacement relative to its initial position. However, multiple magnets could actually be implanted in each muscle, as using their relative distance as a measure of muscle contraction could improve the system robustness against environmental disturbances. METHODS Here, we simulated the implant of pairs of magnets in each muscle and we compared the localization accuracy of such system with the one magnet per muscle approach, considering first a planar and then an anatomically appropriate configuration. Such comparison was also performed when simulating different grades of mechanical disturbances applied to the system (i.e., shift of the sensor grid). RESULTS We found that implanting one magnet per muscle always led to lower localization errors under ideal conditions (i.e., no external disturbances). Differently, when mechanical disturbances were applied, magnet pairs outperformed the single magnet approach, confirming that differential measurements are able to reject common mode disturbances. CONCLUSION We identified important factors affecting the choice of the number of magnets to implant in a muscle. SIGNIFICANCE Our results provide important guidelines for the design of disturbance rejection strategies and for the development of the myokinetic control interface, as well as for a whole range of biomedical applications involving magnetic tracking.
Collapse
|
7
|
Masiero F, Sinibaldi E. Exact and Computationally Robust Solutions for Cylindrical Magnets Systems with Programmable Magnetization. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2023; 10:e2301033. [PMID: 37460392 PMCID: PMC10477869 DOI: 10.1002/advs.202301033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Indexed: 09/06/2023]
Abstract
Magnetic systems based on permanent magnets are receiving growing attention, in particular for micro/millirobotics and biomedical applications. Their design landscape is expanded by the possibility to program magnetization, yet enabling analytical results, crucial for containing computational costs, are lacking. The dipole approximation is systematically used (and often strained), because exact and computationally robust solutions are to be unveiled even for common geometries such as cylindrical magnets, which are ubiquitously used in fundamental research and applications. In this study, exact solutions are disclosed for magnetic field and gradient of a cylindrical magnet with generic uniform magnetization, which can be robustly computed everywhere within and outside the magnet, and directly extend to magnets systems of arbitrary complexity. Based on them, exact and computationally robust solutions are unveiled for force and torque between coaxial magnets. The obtained analytical solutions overstep the dipole approximation, thus filling a long-standing gap, and offer strong computational gains versus numerical simulations (up to 106 , for the considered test-cases). Moreover, they bridge to a variety of applications, as illustrated through a compact magnets array that could be used to advance state-of-the-art biomedical tools, by creating, based on programmable magnetization patterns, circumferential and helical force traps for magnetoresponsive diagnostic/therapeutic agents.
Collapse
Affiliation(s)
- Federico Masiero
- Biorobotics InstituteScuola Superiore Sant'Annaviale Rinaldo Piaggio 34Pontedera56025Italy
- Department of Excellence in Robotics and AIScuola Superiore Sant'Annapiazza Martiri della Libertà 33Pisa56127Italy
| | | |
Collapse
|
8
|
Sun H, He C, Vujaklija I. Design trends in actuated lower-limb prosthetic systems: a narrative review. Expert Rev Med Devices 2023; 20:1157-1172. [PMID: 37925668 DOI: 10.1080/17434440.2023.2279999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 11/02/2023] [Indexed: 11/07/2023]
Abstract
INTRODUCTION Actuated lower limb prostheses, including powered (active) and semi-active (quasi-passive) joints, are endowed with controllable power and/or impedance, which can be advantageous to limb impairment individuals by improving locomotion mechanics and reducing the overall metabolic cost of ambulation. However, an increasing number of commercial and research-focused options have made navigating this field a daunting task for users, researchers, clinicians, and professionals. AREAS COVERED The present paper provides an overview of the latest trends and developments in the field of actuated lower-limb prostheses and corresponding technologies. Following a gentle summary of essential gait features, we introduce and compare various actuated prosthetic solutions in academia and the market designed to provide assistance at different levels of impairments. Correspondingly, we offer insights into the latest developments of sockets and suspension systems, before finally discussing the established and emerging trends in surgical approaches aimed at improving prosthetic experience through enhanced physical and neural interfaces. EXPERT OPINION The ongoing challenges and future research opportunities in the field are summarized for exploring potential avenues for development of next generation of actuated lower limb prostheses. In our opinions, a closer multidisciplinary integration can be found in the field of actuated lower-limb prostheses in the future.
Collapse
Affiliation(s)
- Haoran Sun
- School of Mechanical Engineering, Southwest Jiaotong University, Chengdu, P.R. China
- Department of Electrical Engineering and Automation, Aalto University, Espoo, Finland
| | - Chaoming He
- School of Mechanical Engineering, Southwest Jiaotong University, Chengdu, P.R. China
| | - Ivan Vujaklija
- Department of Electrical Engineering and Automation, Aalto University, Espoo, Finland
| |
Collapse
|
9
|
Provini P, Camp AL, Crandell KE. Emerging biological insights enabled by high-resolution 3D motion data: promises, perspectives and pitfalls. J Exp Biol 2023; 226:286825. [PMID: 36752301 PMCID: PMC10038148 DOI: 10.1242/jeb.245138] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
Deconstructing motion to better understand it is a key prerequisite in the field of comparative biomechanics. Since Marey and Muybridge's work, technical constraints have been the largest limitation to motion capture and analysis, which, in turn, limited what kinds of questions biologists could ask or answer. Throughout the history of our field, conceptual leaps and significant technical advances have generally worked hand in hand. Recently, high-resolution, three-dimensional (3D) motion data have become easier to acquire, providing new opportunities for comparative biomechanics. We describe how adding a third dimension of information has fuelled major paradigm shifts, not only leading to a reinterpretation of long-standing scientific questions but also allowing new questions to be asked. In this paper, we highlight recent work published in Journal of Experimental Biology and influenced by these studies, demonstrating the biological breakthroughs made with 3D data. Although amazing opportunities emerge from these technical and conceptual advances, high-resolution data often come with a price. Here, we discuss challenges of 3D data, including low-throughput methodology, costly equipment, low sample sizes, and complex analyses and presentation. Therefore, we propose guidelines for how and when to pursue 3D high-resolution data. We also suggest research areas that are poised for major new biological advances through emerging 3D data collection.
Collapse
Affiliation(s)
- Pauline Provini
- Université Paris Cité, Inserm, System Engineering and Evolution Dynamics, F-75004 Paris, France
- Learning Planet Institute, F-75004 Paris, France
- Département Adaptations du Vivant, UMR 7179 CNRS/Muséum National d'Histoire Naturelle, F-75005 Paris, France
| | - Ariel L Camp
- Department of Musculoskeletal and Ageing Science, Institute of Life Course and Medical Sciences, University of Liverpool, Liverpool L78TX, UK
| | | |
Collapse
|
10
|
Nazari V, Zheng YP. Controlling Upper Limb Prostheses Using Sonomyography (SMG): A Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:1885. [PMID: 36850483 PMCID: PMC9959820 DOI: 10.3390/s23041885] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 02/01/2023] [Accepted: 02/06/2023] [Indexed: 06/18/2023]
Abstract
This paper presents a critical review and comparison of the results of recently published studies in the fields of human-machine interface and the use of sonomyography (SMG) for the control of upper limb prothesis. For this review paper, a combination of the keywords "Human Machine Interface", "Sonomyography", "Ultrasound", "Upper Limb Prosthesis", "Artificial Intelligence", and "Non-Invasive Sensors" was used to search for articles on Google Scholar and PubMed. Sixty-one articles were found, of which fifty-nine were used in this review. For a comparison of the different ultrasound modes, feature extraction methods, and machine learning algorithms, 16 articles were used. Various modes of ultrasound devices for prosthetic control, various machine learning algorithms for classifying different hand gestures, and various feature extraction methods for increasing the accuracy of artificial intelligence used in their controlling systems are reviewed in this article. The results of the review article show that ultrasound sensing has the potential to be used as a viable human-machine interface in order to control bionic hands with multiple degrees of freedom. Moreover, different hand gestures can be classified by different machine learning algorithms trained with extracted features from collected data with an accuracy of around 95%.
Collapse
Affiliation(s)
- Vaheh Nazari
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Yong-Ping Zheng
- Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong SAR, China
| |
Collapse
|
11
|
Taylor CR, Yeon SH, Clark WH, Clarrissimeaux EG, O’Donnell MK, Roberts TJ, Herr HM. Untethered muscle tracking using magnetomicrometry. Front Bioeng Biotechnol 2022; 10:1010275. [PMID: 36394028 PMCID: PMC9640962 DOI: 10.3389/fbioe.2022.1010275] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 10/05/2022] [Indexed: 09/08/2023] Open
Abstract
Muscle tissue drives nearly all movement in the animal kingdom, providing power, mobility, and dexterity. Technologies for measuring muscle tissue motion, such as sonomicrometry, fluoromicrometry, and ultrasound, have significantly advanced our understanding of biomechanics. Yet, the field lacks the ability to monitor muscle tissue motion for animal behavior outside the lab. Towards addressing this issue, we previously introduced magnetomicrometry, a method that uses magnetic beads to wirelessly monitor muscle tissue length changes, and we validated magnetomicrometry via tightly-controlled in situ testing. In this study we validate the accuracy of magnetomicrometry against fluoromicrometry during untethered running in an in vivo turkey model. We demonstrate real-time muscle tissue length tracking of the freely-moving turkeys executing various motor activities, including ramp ascent and descent, vertical ascent and descent, and free roaming movement. Given the demonstrated capacity of magnetomicrometry to track muscle movement in untethered animals, we feel that this technique will enable new scientific explorations and an improved understanding of muscle function.
Collapse
Affiliation(s)
- Cameron R. Taylor
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Seong Ho Yeon
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - William H. Clark
- Department of Ecology, Evolution, and Organismal Biology, Brown University, Providence, RI, United States
| | - Ellen G. Clarrissimeaux
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Mary Kate O’Donnell
- Department of Ecology, Evolution, and Organismal Biology, Brown University, Providence, RI, United States
- Department of Biology, Lycoming College, Williamsport, PA, United States
| | - Thomas J. Roberts
- Department of Ecology, Evolution, and Organismal Biology, Brown University, Providence, RI, United States
| | - Hugh M. Herr
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
| |
Collapse
|
12
|
Taylor CR, Clark WH, Clarrissimeaux EG, Yeon SH, Carty MJ, Lipsitz SR, Bronson RT, Roberts TJ, Herr HM. Clinical viability of magnetic bead implants in muscle. Front Bioeng Biotechnol 2022; 10:1010276. [PMID: 36394042 PMCID: PMC9640959 DOI: 10.3389/fbioe.2022.1010276] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 10/05/2022] [Indexed: 11/25/2022] Open
Abstract
Human movement is accomplished through muscle contraction, yet there does not exist a portable system capable of monitoring muscle length changes in real time. To address this limitation, we previously introduced magnetomicrometry, a minimally-invasive tracking technique comprising two implanted magnetic beads in muscle and a magnetic field sensor array positioned on the body's surface adjacent the implanted beads. The implant system comprises a pair of spherical magnetic beads, each with a first coating of nickel-copper-nickel and an outer coating of Parylene C. In parallel work, we demonstrate submillimeter accuracy of magnetic bead tracking for muscle contractions in an untethered freely-roaming avian model. Here, we address the clinical viability of magnetomicrometry. Using a specialized device to insert magnetic beads into muscle in avian and lagomorph models, we collect data to assess gait metrics, bead migration, and bead biocompatibility. For these animal models, we find no gait differences post-versus pre-implantation, and bead migration towards one another within muscle does not occur for initial bead separation distances greater than 3 cm. Further, using extensive biocompatibility testing, the implants are shown to be non-irritant, non-cytotoxic, non-allergenic, and non-irritating. Our cumulative results lend support for the viability of these magnetic bead implants for implantation in human muscle. We thus anticipate their imminent use in human-machine interfaces, such as in control of prostheses and exoskeletons and in closed-loop neuroprosthetics to aid recovery from neurological disorders.
Collapse
Affiliation(s)
- Cameron R. Taylor
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - William H. Clark
- Department of Ecology, Evolution, and Organismal Biology, Brown University, Providence, RI, United States
| | - Ellen G. Clarrissimeaux
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Seong Ho Yeon
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Matthew J. Carty
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
- Harvard Medical School, Boston, MA, United States
| | | | | | - Thomas J. Roberts
- Department of Ecology, Evolution, and Organismal Biology, Brown University, Providence, RI, United States
| | - Hugh M. Herr
- K. Lisa Yang Center for Bionics, Massachusetts Institute of Technology, Cambridge, MA, United States
- Harvard Medical School, Boston, MA, United States
| |
Collapse
|
13
|
Agonist-antagonist muscle strain in the residual limb preserves motor control and perception after amputation. COMMUNICATIONS MEDICINE 2022; 2:97. [PMID: 35942078 PMCID: PMC9356003 DOI: 10.1038/s43856-022-00162-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Accepted: 07/22/2022] [Indexed: 12/04/2022] Open
Abstract
Background Elucidating underlying mechanisms in subject-specific motor control and perception after amputation could guide development of advanced surgical and neuroprosthetic technologies. In this study, relationships between preserved agonist-antagonist muscle strain within the residual limb and preserved motor control and perception capacity are investigated. Methods Fourteen persons with unilateral transtibial amputations spanning a range of ages, etiologies, and surgical procedures underwent evaluations involving free-space mirrored motions of their lower limbs. Research has shown that varied motor control in biologically intact limbs is executed by the activation of muscle synergies. Here, we assess the naturalness of phantom joint motor control postamputation based on extracted muscle synergies and their activation profiles. Muscle synergy extraction, degree of agonist-antagonist muscle strain, and perception capacity are estimated from electromyography, ultrasonography, and goniometry, respectively. Results Here, we show significant positive correlations (P < 0.005–0.05) between sensorimotor responses and residual limb agonist-antagonist muscle strain. Identified trends indicate that preserving even 20–26% of agonist-antagonist muscle strain within the residuum compared to a biologically intact limb is effective in preserving natural motor control postamputation, though preserving limb perception capacity requires more (61%) agonist-antagonist muscle strain preservation. Conclusions The results suggest that agonist-antagonist muscle strain is a characteristic, readily ascertainable residual limb structural feature that can help explain variability in amputation outcome, and agonist-antagonist muscle strain preserving surgical amputation strategies are one way to enable more effective and biomimetic sensorimotor control postamputation. People who undergo limb amputation can have issues with controlling movement and perception of residual limbs. This, in turn, can impact the success of neuroprosthetic strategies, which use signals from the body to control a prosthetic limb. Here, we wanted to understand how sensory signals within the muscle help to preserve movement and limb perception following amputation. We used ultrasound imaging and other methods to measure muscle activity and limb perception in fourteen people who have undergone lower limb amputations. We show that the level at which the relationship between pairs of related muscles is preserved is associated with more natural control of limb movement after amputation. Developing surgical techniques that preserve this relationship may help people living with amputations to naturally perceive and control their residual limbs, and ultimately may improve controllability of assistive prosthetic devices. Song et al. study the relationship between agonist-antagonist muscle strain (AMS) and motor control and perception in lower limb amputees, with some receiving a myoneural interface intervention. The authors report that the degree of AMS within the residual limb is associated with preserved motor control and perception.
Collapse
|
14
|
Reimagining Prosthetic Control: A Novel Body-Powered Prosthetic System for Simultaneous Control and Actuation. PROSTHESIS 2022. [DOI: 10.3390/prosthesis4030032] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Globally, the most popular upper-limb prostheses are powered by the human body. For body-powered (BP) upper-limb prostheses, control is provided by changing the tension of (Bowden) cables to open or close the terminal device. This technology has been around for centuries, and very few BP alternatives have been presented since. This paper introduces a new BP paradigm that can overcome certain limitations of the current cabled systems, such as a restricted operation space and user discomfort caused by the harness to which the cables are attached. A new breathing-powered system is introduced to give the user full control of the hand motion anywhere in space. Users can regulate their breathing, and this controllable airflow is then used to power a small Tesla turbine that can accurately control the prosthetic finger movements. The breathing-powered device provides a novel prosthetic option that can be used without limiting any of the user’s body movements. Here we prove that it is feasible to produce a functional breathing-powered prosthetic hand and show the models behind it along with a preliminary demonstration. This work creates a step-change in the potential BP options available to patients in the future.
Collapse
|