1
|
Sagastegui Alva PG, Boesendorfer A, Aszmann OC, Ibáñez J, Farina D. Excitation of natural spinal reflex loops in the sensory-motor control of hand prostheses. Sci Robot 2024; 9:eadl0085. [PMID: 38809994 DOI: 10.1126/scirobotics.adl0085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2023] [Accepted: 04/30/2024] [Indexed: 05/31/2024]
Abstract
Sensory feedback for prosthesis control is typically based on encoding sensory information in specific types of sensory stimuli that the users interpret to adjust the control of the prosthesis. However, in physiological conditions, the afferent feedback received from peripheral nerves is not only processed consciously but also modulates spinal reflex loops that contribute to the neural information driving muscles. Spinal pathways are relevant for sensory-motor integration, but they are commonly not leveraged for prosthesis control. We propose an approach to improve sensory-motor integration for prosthesis control based on modulating the excitability of spinal circuits through the vibration of tendons in a closed loop with muscle activity. We measured muscle signals in healthy participants and amputees during different motor tasks, and we closed the loop by applying vibration on tendons connected to the muscles, which modulated the excitability of motor neurons. The control signals to the prosthesis were thus the combination of voluntary control and additional spinal reflex inputs induced by tendon vibration. Results showed that closed-loop tendon vibration was able to modulate the neural drive to the muscles. When closed-loop tendon vibration was used, participants could achieve similar or better control performance in interfaces using muscle activation than without stimulation. Stimulation could even improve prosthetic grasping in amputees. Overall, our results indicate that closed-loop tendon vibration can integrate spinal reflex pathways in the myocontrol system and open the possibility of incorporating natural feedback loops in prosthesis control.
Collapse
Affiliation(s)
| | - Anna Boesendorfer
- Clinical Laboratory for Bionic Extremity Reconstruction, Department of Plastic, Reconstructive and Aesthetic Surgery, Medical University of Vienna, Vienna, Austria
| | - Oskar C Aszmann
- Clinical Laboratory for Bionic Extremity Reconstruction, Department of Plastic, Reconstructive and Aesthetic Surgery, Medical University of Vienna, Vienna, Austria
- Department of Plastic, Reconstructive and Aesthetic Surgery, Medical University of Vienna, Vienna, Austria
| | - Jaime Ibáñez
- Department of Bioengineering, Imperial College London, London, UK
- BSICoS group, I3A Institute, University of Zaragoza, IIS Aragón, Zaragoza, Spain
| | - Dario Farina
- Department of Bioengineering, Imperial College London, London, UK
| |
Collapse
|
2
|
Thomas RL, Howes R, McMenemy L, Hindle P, Wordsworth M, Staruch R. Delivery of UK military upper limb prosthetics: current concepts and future directions. BMJ Mil Health 2023:e002485. [PMID: 37879645 DOI: 10.1136/military-2023-002485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2023] [Accepted: 09/24/2023] [Indexed: 10/27/2023]
Abstract
Upper limb prosthetics have a challenging task. A natural upper limb combines strength, coordination and dexterity to accomplish daily activities such as eating, writing, working and social interaction. Artificially replicating these functions requires a prosthetic with composite, synchronous motor function while maintaining sensory feedback and skeletal stability. Achieving these functions requires interfaces between biology and machine across nerve, muscle, bone and skin. This leads to issues related to infection, foreign material encapsulation and implant stability, and electrical signal transduction and interpretation. Over the last 20 years the advent of technologies such as osseointegration, targeted muscle reinnervation, implantable myoelectric sensors, peripheral nerve interfaces and pattern recognition technology has sought to address these problems.Due to many advances in prehospital care, truncated timelines to damage control surgery and improved combat personal protective equipment, the numbers of amputees have increased with more patients surviving injury. From October 2001 to March 2019 there were 333 amputees from Afghanistan and Iraq compared with 457 fatalities over a similar period. Over a third of these were significant multiple amputees. With a functional, robust upper limb prosthetic which mirrors or exceeds normal function, injured service personnel could be returned to an active combat role. This has benefits for their physical and mental health, improves employability prospects and allows Defence to retain some of its most highly motivated and skilled people who represent significant financial investment.
Collapse
Affiliation(s)
| | - R Howes
- Burns, Plastic and Reconstructive Surgery, Salisbury NHS Foundation Trust, Salisbury, UK
| | - L McMenemy
- Academic Department of Military Surgery and Trauma (ADMST), Royal Centre for Defence Medicine, Birmingham, UK
- Centre for Blast Injury Studies, Imperial College London, London, UK
| | - P Hindle
- Trauma and Orthopaedic Surgery, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - M Wordsworth
- Academic Department of Military Surgery and Trauma, Royal Centre for Defence Medicine, Birmingham, UK
| | - R Staruch
- Department of Plastic Surgery, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| |
Collapse
|
3
|
Papaleo ED, D'Alonzo M, Fiori F, Piombino V, Falato E, Pilato F, De Liso A, Di Lazzaro V, Di Pino G. Integration of proprioception in upper limb prostheses through non-invasive strategies: a review. J Neuroeng Rehabil 2023; 20:118. [PMID: 37689701 PMCID: PMC10493033 DOI: 10.1186/s12984-023-01242-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Accepted: 08/24/2023] [Indexed: 09/11/2023] Open
Abstract
Proprioception plays a key role in moving our body dexterously and effortlessly. Nevertheless, the majority of investigations evaluating the benefits of providing supplemental feedback to prosthetics users focus on delivering touch restitution. These studies evaluate the influence of touch sensation in an attempt to improve the controllability of current robotic devices. Contrarily, investigations evaluating the capabilities of proprioceptive supplemental feedback have yet to be comprehensively analyzed to the same extent, marking a major gap in knowledge within the current research climate. The non-invasive strategies employed so far to restitute proprioception are reviewed in this work. In the absence of a clearly superior strategy, approaches employing vibrotactile, electrotactile and skin-stretch stimulation achieved better and more consistent results, considering both kinesthetic and grip force information, compared with other strategies or any incidental feedback. Although emulating the richness of the physiological sensory return through artificial feedback is the primary hurdle, measuring its effects to eventually support the integration of cumbersome and energy intensive hardware into commercial prosthetic devices could represent an even greater challenge. Thus, we analyze the strengths and limitations of previous studies and discuss the possible benefits of coupling objective measures, like neurophysiological parameters, as well as measures of prosthesis embodiment and cognitive load with behavioral measures of performance. Such insights aim to provide additional and collateral outcomes to be considered in the experimental design of future investigations of proprioception restitution that could, in the end, allow researchers to gain a more detailed understanding of possibly similar behavioral results and, thus, support one strategy over another.
Collapse
Affiliation(s)
- Ermanno Donato Papaleo
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Marco D'Alonzo
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Francesca Fiori
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Valeria Piombino
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Emma Falato
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Fabio Pilato
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Alfredo De Liso
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Vincenzo Di Lazzaro
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Giovanni Di Pino
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy.
| |
Collapse
|
4
|
Wersényi G. Perception Accuracy of a Multi-Channel Tactile Feedback System for Assistive Technology. SENSORS (BASEL, SWITZERLAND) 2022; 22:8962. [PMID: 36433558 PMCID: PMC9695395 DOI: 10.3390/s22228962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 11/11/2022] [Accepted: 11/15/2022] [Indexed: 06/16/2023]
Abstract
Assistive technology uses multi-modal feedback devices, focusing on the visual, auditory, and haptic modalities. Tactile devices provide additional information via touch sense. Perception accuracy of vibrations depends on the spectral and temporal attributes of the signal, as well as on the body parts they are attached to. The widespread use of AR/VR devices, wearables, and gaming interfaces requires information about the usability of feedback devices. This paper presents results of an experiment using an 8-channel tactile feedback system with vibrators placed on the wrists, arms, ankles, and forehead. Different vibration patterns were designed and presented using sinusoidal frequency bursts on 2, 4, and 8 channels. In total, 27 subjects reported their sensation formally and informally on questionnaires. Results indicate that 2 and 4 channels could be used simultaneously with high accuracy, and the transducers' optimal placement (best sensitivity) is on the wrists, followed by the ankles. Arm and head positions were inferior and generally inadequate for signal presentation. For optimal performance, signal length should exceed 500 ms. Furthermore, the amplitude level and temporal pattern of the presented signals have to be used for carrying information rather than the frequency of the vibration.
Collapse
Affiliation(s)
- György Wersényi
- Department of Telecommunications, Széchenyi István University, H-9026 Gyor, Hungary
| |
Collapse
|
5
|
Eden J, Bräcklein M, Ibáñez J, Barsakcioglu DY, Di Pino G, Farina D, Burdet E, Mehring C. Principles of human movement augmentation and the challenges in making it a reality. Nat Commun 2022; 13:1345. [PMID: 35292665 PMCID: PMC8924218 DOI: 10.1038/s41467-022-28725-7] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 02/04/2022] [Indexed: 12/23/2022] Open
Abstract
Augmenting the body with artificial limbs controlled concurrently to one's natural limbs has long appeared in science fiction, but recent technological and neuroscientific advances have begun to make this possible. By allowing individuals to achieve otherwise impossible actions, movement augmentation could revolutionize medical and industrial applications and profoundly change the way humans interact with the environment. Here, we construct a movement augmentation taxonomy through what is augmented and how it is achieved. With this framework, we analyze augmentation that extends the number of degrees-of-freedom, discuss critical features of effective augmentation such as physiological control signals, sensory feedback and learning as well as application scenarios, and propose a vision for the field.
Collapse
Affiliation(s)
- Jonathan Eden
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Mario Bräcklein
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Jaime Ibáñez
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
- BSICoS, IIS Aragón, Universidad de Zaragoza, Zaragoza, Spain
- Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, London, UK
| | | | - Giovanni Di Pino
- NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Dario Farina
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Etienne Burdet
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK.
| | - Carsten Mehring
- Bernstein Center Freiburg, University of Freiburg, Freiburg im Breisgau, 79104, Germany
- Faculty of Biology, University of Freiburg, Freiburg im Breisgau, 79104, Germany
| |
Collapse
|
6
|
Vargas L, Huang H, Zhu Y, Hu X. Object Recognition via Evoked Sensory Feedback during Control of a Prosthetic Hand. IEEE Robot Autom Lett 2022; 7:207-214. [PMID: 35784093 PMCID: PMC9248871 DOI: 10.1109/lra.2021.3122897] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Haptic and proprioceptive feedback is critical for sensorimotor integration when we use our hand to perform daily tasks. Here, we evaluated how externally evoked haptic and proprioceptive feedback and myoelectric control strategies affected the recognition of object properties when participants controlled a prosthetic hand. Fingertip haptic sensation was elicited using a transcutaneous nerve stimulation grid to encode the prosthetic's fingertip forces. An array of tactors elicited patterned vibratory stimuli to encode tactile-proprioceptive kinematic information of the prosthetic finger joint. Myoelectric signals of the finger flexor and extensor were used to control the position or velocity of joint angles of the prosthesis. Participants were asked to perform object property (stiffness and size) recognition, by controlling the prosthetic hand with concurrent haptic and tactile-proprioceptive feedback. With the evoked feedback, intact and amputee participants recognized the object stiffness and size at success rates ranging from 50% to 100% in both position and velocity control with no significant difference across control schemes. Our findings show that evoked somatosensory feedback in a non-invasive manner can facilitate closed-loop control of the prosthetic hand and allowed for simultaneous recognition of different object properties. The outcomes can facilitate our understanding on the role of sensory feedback during bidirectional human-machine interactions, which can potentially promote user experience in object interactions using prosthetic hands.
Collapse
Affiliation(s)
- Luis Vargas
- Joint Department of Biomedical Engineering at University of North Carolina-Chapel Hill and NC State University
| | - He Huang
- Joint Department of Biomedical Engineering at University of North Carolina-Chapel Hill and NC State University
| | - Yong Zhu
- Mechanical and Aerospace Engineering Department at NC State University
| | - Xiaogang Hu
- Joint Department of Biomedical Engineering at University of North Carolina-Chapel Hill and NC State University
| |
Collapse
|
7
|
Blondin CM, Ivanova E, Eden J, Burdet E. Perception and Performance of Electrical Stimulation for Proprioception. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:4550-4554. [PMID: 34892229 DOI: 10.1109/embc46164.2021.9630186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Proprioception, yielding awareness of the body's position and motion in space, is typically lacking in prostheses and supernumerary limbs. Electrical stimulation is one technique that may provide these devices with proprioception. This paper first investigates how the modalities of electrotactile cues, such as frequency and intensity, are perceived. Using the results, we designed and compared several comfortable and perceptible feedback mappings for spatial cues. Two experiments were conducted using a 16-electrode bracelet worn above the elbow to provide electrical stimuli. We found that subjects could localize the stimulating electrode with a precision of ±1 electrode (110 mm) in all feedback conditions. Moreover, within the range of pulse intensities perceived as comfortable, the participants' performance was more sensitive to changes in frequency than in intensity. The highest performance was obtained for the condition which increased both intensity and frequency with radial distance. These results suggest that electrical stimulation can be used for artificial proprioceptive feedback, which can ensure a comfortable and intuitive interaction and provides high spatial accuracy.
Collapse
|
8
|
Shokur S, Mazzoni A, Schiavone G, Weber DJ, Micera S. A modular strategy for next-generation upper-limb sensory-motor neuroprostheses. MED 2021; 2:912-937. [DOI: 10.1016/j.medj.2021.05.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Revised: 04/28/2021] [Accepted: 05/10/2021] [Indexed: 02/06/2023]
|
9
|
Vargas L, Huang H(H, Zhu Y, Hu X. Static and dynamic proprioceptive recognition through vibrotactile stimulation. J Neural Eng 2021; 18:10.1088/1741-2552/ac0d43. [PMID: 34153955 PMCID: PMC8715509 DOI: 10.1088/1741-2552/ac0d43] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2020] [Accepted: 06/21/2021] [Indexed: 11/12/2022]
Abstract
Objective.Proprioceptive information provides individuals with a sense of our limb's static position and dynamic movement. Impaired or a lack of such feedback can diminish our ability to perform dexterous motions with our biological limbs or assistive devices. Here we seek to determine whether both static and dynamic components of proprioception can be recognized using variation of the spatial and temporal components of vibrotactile feedback.Approach.An array of five vibrotactors was placed on the forearm of each subject. Each tactor was encoded to represent one of the five forearm postures. Vibratory stimulus was elicited to convey the static position and movement of the forearm. Four experimental blocks were performed to test each subject's recognition of a forearm's simulated static position, rotational amplitude, rotational amplitude and direction, and rotational speed.Main results.Our results showed that the subjects were able to perform proprioceptive recognition based on the delivered vibrotactile information. Specifically, rotational amplitude recognition resulted in the highest level of accuracy (99.0%), while the recognition accuracy of the static position and the rotational amplitude-direction was the lowest (91.7% and 90.8%, respectively). Nevertheless, all proprioceptive properties were perceived with >90% accuracy, indicating that the implemented vibrotactile encoding scheme could effectively provide proprioceptive information to the users.Significance.The outcomes suggest that information pertaining to static and dynamic aspects of proprioception can be accurately delivered using an array of vibrotactors. This feedback approach could be used to potentially evaluate the sensorimotor integration processes during human-machine interactions, and to improve sensory feedback in clinical populations with somatosensory impairments.
Collapse
Affiliation(s)
- Luis Vargas
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, NC and North Carolina State University, 10206B Mary Ellen Jones Bldg, Raleigh, NC 27599, United States of America
| | - He (Helen) Huang
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, NC and North Carolina State University, 10206B Mary Ellen Jones Bldg, Raleigh, NC 27599, United States of America
| | - Yong Zhu
- Department of Mechanical and Aerospace Engineering, North Carolina State University, Raleigh, NC, United States of America
| | - Xiaogang Hu
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, NC and North Carolina State University, 10206B Mary Ellen Jones Bldg, Raleigh, NC 27599, United States of America
| |
Collapse
|
10
|
Atashzar SF, Carriere J, Tavakoli M. Review: How Can Intelligent Robots and Smart Mechatronic Modules Facilitate Remote Assessment, Assistance, and Rehabilitation for Isolated Adults With Neuro-Musculoskeletal Conditions? Front Robot AI 2021; 8:610529. [PMID: 33912593 PMCID: PMC8072151 DOI: 10.3389/frobt.2021.610529] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2020] [Accepted: 02/08/2021] [Indexed: 12/12/2022] Open
Abstract
Worldwide, at the time this article was written, there are over 127 million cases of patients with a confirmed link to COVID-19 and about 2.78 million deaths reported. With limited access to vaccine or strong antiviral treatment for the novel coronavirus, actions in terms of prevention and containment of the virus transmission rely mostly on social distancing among susceptible and high-risk populations. Aside from the direct challenges posed by the novel coronavirus pandemic, there are serious and growing secondary consequences caused by the physical distancing and isolation guidelines, among vulnerable populations. Moreover, the healthcare system's resources and capacity have been focused on addressing the COVID-19 pandemic, causing less urgent care, such as physical neurorehabilitation and assessment, to be paused, canceled, or delayed. Overall, this has left elderly adults, in particular those with neuromusculoskeletal (NMSK) conditions, without the required service support. However, in many cases, such as stroke, the available time window of recovery through rehabilitation is limited since neural plasticity decays quickly with time. Given that future waves of the outbreak are expected in the coming months worldwide, it is important to discuss the possibility of using available technologies to address this issue, as societies have a duty to protect the most vulnerable populations. In this perspective review article, we argue that intelligent robotics and wearable technologies can help with remote delivery of assessment, assistance, and rehabilitation services while physical distancing and isolation measures are in place to curtail the spread of the virus. By supporting patients and medical professionals during this pandemic, robots, and smart digital mechatronic systems can reduce the non-COVID-19 burden on healthcare systems. Digital health and cloud telehealth solutions that can complement remote delivery of assessment and physical rehabilitation services will be the subject of discussion in this article due to their potential in enabling more effective and safer NMSDK rehabilitation, assistance, and assessment service delivery. This article will hopefully lead to an interdisciplinary dialogue between the medical and engineering sectors, stake holders, and policy makers for a better delivery of care for those with NMSK conditions during a global health crisis including future pandemics.
Collapse
Affiliation(s)
- S. Farokh Atashzar
- Department of Electrical and Computer Engineering, Department of Mechanical and Aerospace Engineering, New York University, New York, NY, United States
| | - Jay Carriere
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| | - Mahdi Tavakoli
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|