1
|
Dong Y, Zhang Y, Li Q, Huang J, Li X, Jiang N, Li G, Liang W, Fang P. Assessment of TENS-Evoked Tactile Sensations for Transradial Amputees via EEG Investigation. IEEE Trans Neural Syst Rehabil Eng 2024; 32:3261-3269. [PMID: 39213273 DOI: 10.1109/tnsre.2024.3452153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Abstract
Most of current prostheses can offer motor function restoration for limb amputees but usually lack natural and intuitive sensory feedback. Many studies have demonstrated that Transcutaneous Electrical Nerve Stimulation (TENS) is promising in non-invasive sensation evoking for amputees. However, the objective evaluation and mechanism analysis on sensation feedback are still limited. This work utilized multi-channel TENS with diverse stimulus patterns to evoke sensations on four non-disabled subjects and two transradial amputees. Meanwhile, electroencephalogram (EEG) was collected to objectively assess the evoked sensations, where event-related potentials (ERPs), brain electrical activity maps (BEAMs), and functional connectivity (FC) were computed. The results show that various sensations could be successfully evoked for both amputees and non-disabled subjects by customizing stimulus parameters. The ERP confirmed the sensation and revealed the sensory-processing-related components like N100 and P200; the BEAMs confirmed the corresponding regions of somatosensory cortex were activated by stimulation; the FC indicated an increase of interactions between the regions of sensorimotor cortex. This study may shed light on how the brain responds to external stimulation as sensory feedback and serve as a pilot for further bidirectional closed-loop prosthetic control.
Collapse
|
2
|
Zhang Z, Xie A, Chou CH, Liang W, Zhang J, Bi S, Lan N. Closed-Loop Force Control by Biorealistic Hand Prosthesis With Visual and Tactile Sensory Feedback. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2939-2949. [PMID: 39110556 DOI: 10.1109/tnsre.2024.3439722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
The ability of a novel biorealistic hand prosthesis for grasp force control reveals improved neural compatibility between the human-prosthetic interaction. The primary purpose here was to validate a virtual training platform for amputee subjects and evaluate the respective roles of visual and tactile information in fundamental force control tasks. We developed a digital twin of tendon-driven prosthetic hand in the MuJoCo environment. Biorealistic controllers emulated a pair of antagonistic muscles controlling the index finger of the virtual hand by surface electromyographic (sEMG) signals from amputees' residual forearm muscles. Grasp force information was transmitted to amputees through evoked tactile sensation (ETS) feedback. Six forearm amputees participated in force tracking and holding tasks under different feedback conditions or using their intact hands. Test results showed that visual feedback played a predominant role than ETS feedback in force tracking and holding tasks. However, in the absence of visual feedback during the force holding task, ETS feedback significantly enhanced motor performance compared to feedforward control alone. Thus, ETS feedback still supplied reliable sensory information to facilitate amputee's ability of stable grasp force control. The effects of tactile and visual feedback on force control were subject-specific when both types of feedback were provided simultaneously. Amputees were able to integrate visual and tactile information to the biorealistic controllers and achieve a good sensorimotor performance in grasp force regulation. The virtual platform may provide a training paradigm for amputees to adapt the biorealistic hand controller and ETS feedback optimally.
Collapse
|
3
|
Xie A, Li C, Chou CH, Li T, Dai C, Lan N. A hybrid sensory feedback system for thermal nociceptive warning and protection in prosthetic hand. Front Neurosci 2024; 18:1351348. [PMID: 38650624 PMCID: PMC11033464 DOI: 10.3389/fnins.2024.1351348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 03/25/2024] [Indexed: 04/25/2024] Open
Abstract
Background Advanced prosthetic hands may embed nanosensors and microelectronics in their cosmetic skin. Heat influx may cause damage to these delicate structures. Protecting the integrity of the prosthetic hand becomes critical and necessary to ensure sustainable function. This study aims to mimic the sensorimotor control strategy of the human hand in perceiving nociceptive stimuli and triggering self-protective mechanisms and to investigate how similar neuromorphic mechanisms implemented in prosthetic hand can allow amputees to both volitionally release a hot object upon a nociceptive warning and achieve reinforced release via a bionic withdrawal reflex. Methods A steady-state temperature prediction algorithm was proposed to shorten the long response time of a thermosensitive temperature sensor. A hybrid sensory strategy for transmitting force and a nociceptive temperature warning using transcutaneous electrical nerve stimulation based on evoked tactile sensations was designed to reconstruct the nociceptive sensory loop for amputees. A bionic withdrawal reflex using neuromorphic muscle control technology was used so that the prosthetic hand reflexively opened when a harmful temperature was detected. Four able-bodied subjects and two forearm amputees randomly grasped a tube at the different temperatures based on these strategies. Results The average prediction error of temperature prediction algorithm was 8.30 ± 6.00%. The average success rate of six subjects in perceiving force and nociceptive temperature warnings was 86.90 and 94.30%, respectively. Under the reinforcement control mode in Test 2, the median reaction time of all subjects was 1.39 s, which was significantly faster than the median reaction time of 1.93 s in Test 1, in which two able-bodied subjects and two amputees participated. Results demonstrated the effectiveness of the integration of nociceptive sensory strategy and withdrawal reflex control strategy in a closed loop and also showed that amputees restored the warning of nociceptive sensation while also being able to withdraw from thermal danger through both voluntary and reflexive protection. Conclusion This study demonstrated that it is feasible to restore the sensorimotor ability of amputees to warn and react against thermal nociceptive stimuli. Results further showed that the voluntary release and withdrawal reflex can work together to reinforce heat protection. Nevertheless, fusing voluntary and reflex functions for prosthetic performance in activities of daily living awaits a more cogent strategy in sensorimotor control.
Collapse
Affiliation(s)
- Anran Xie
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chen Li
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chih-hong Chou
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, School of Biomedical Engineering Shanghai Jiao Tong University, Shanghai, China
| | - Tie Li
- i-Lab, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), Suzhou, China
| | - Chenyun Dai
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Ning Lan
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, School of Biomedical Engineering Shanghai Jiao Tong University, Shanghai, China
- Richard and Loan Hill Department of Biomedical Engineering, University of Illinois Chicago, Chicago, IL, United States
| |
Collapse
|
4
|
Muheim J, Iberite F, Akouissi O, Monney R, Morosato F, Gruppioni E, Micera S, Shokur S. A sensory-motor hand prosthesis with integrated thermal feedback. MED 2024; 5:118-125.e5. [PMID: 38340707 DOI: 10.1016/j.medj.2023.12.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 09/29/2023] [Accepted: 12/07/2023] [Indexed: 02/12/2024]
Abstract
BACKGROUND Recently, we reported the presence of phantom thermal sensations in amputees: thermal stimulation of specific spots on the residual arm elicited thermal sensations in their missing hands. Here, we exploit phantom thermal sensations via a standalone system integrated into a robotic prosthetic hand to provide real-time and natural temperature feedback. METHODS The subject (a male adult with unilateral transradial amputation) used the sensorized prosthesis to manipulate objects and distinguish their thermal properties. We tested his ability to discriminate between (1) hot, cold, and ambient temperature objects, (2) different materials (copper, glass, and plastic), and (3) artificial versus human hands. We also introduced the thermal box and block test (thermal BBT), a test to evaluate real-time temperature discrimination during standardized pick-and-place tasks. FINDINGS The subject performed all three discrimination tasks above chance level with similar accuracies as with his intact hand. Additionally, in all 15 sessions of the thermal BBT, he correctly placed more than half of the samples. Finally, the phantom thermal sensation was stable during the 13 recording sessions spread over 400 days. CONCLUSION Our study paves the way for more natural hand prostheses that restore the full palette of sensations. FUNDING This work was funded by the Bertarelli Foundation (including the Catalyst program); the Swiss National Science Foundation through the National Centre of Competence in Research (NCCR) Robotics; the European Union's Horizon 2020 research and innovation program; the Horizon Europe Research & Innovation Program; the Ministry of University and Research (MUR), National Recovery and Resilience Plan (NRRP); and the Tuscany Health Ecosystem.
Collapse
Affiliation(s)
- Jonathan Muheim
- Bertarelli Foundation Chair in Translational Neural Engineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland
| | - Francesco Iberite
- The BioRobotics Institute, Health Interdisciplinary Center and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, 56127 Pisa, Italy
| | - Outman Akouissi
- Bertarelli Foundation Chair in Translational Neural Engineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland; Bertarelli Foundation Chair in Neuroprosthetic Technology, Neuro-X Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland
| | - Rachel Monney
- Bertarelli Foundation Chair in Translational Neural Engineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland
| | | | | | - Silvestro Micera
- Bertarelli Foundation Chair in Translational Neural Engineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland; The BioRobotics Institute, Health Interdisciplinary Center and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, 56127 Pisa, Italy.
| | - Solaiman Shokur
- Bertarelli Foundation Chair in Translational Neural Engineering, Neuro-X Institute, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland; The BioRobotics Institute, Health Interdisciplinary Center and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, 56127 Pisa, Italy.
| |
Collapse
|
5
|
Várkuti B, Halász L, Hagh Gooie S, Miklós G, Smits Serena R, van Elswijk G, McIntyre CC, Lempka SF, Lozano AM, Erōss L. Conversion of a medical implant into a versatile computer-brain interface. Brain Stimul 2024; 17:39-48. [PMID: 38145752 DOI: 10.1016/j.brs.2023.12.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 12/19/2023] [Accepted: 12/20/2023] [Indexed: 12/27/2023] Open
Abstract
BACKGROUND Information transmission into the human nervous system is the basis for a variety of prosthetic applications. Spinal cord stimulation (SCS) systems are widely available, have a well documented safety record, can be implanted minimally invasively, and are known to stimulate afferent pathways. Nonetheless, SCS devices are not yet used for computer-brain-interfacing applications. OBJECTIVE Here we aimed to establish computer-to-brain communication via medical SCS implants in a group of 20 individuals who had been operated for the treatment of chronic neuropathic pain. METHODS In the initial phase, we conducted interface calibration with the aim of determining personalized stimulation settings that yielded distinct and reproducible sensations. These settings were subsequently utilized to generate inputs for a range of behavioral tasks. We evaluated the required calibration time, task training duration, and the subsequent performance in each task. RESULTS We could establish a stable spinal computer-brain interface in 18 of the 20 participants. Each of the 18 then performed one or more of the following tasks: A rhythm-discrimination task (n = 13), a Morse-decoding task (n = 3), and/or two different balance/body-posture tasks (n = 18; n = 5). The median calibration time was 79 min. The median training time for learning to use the interface in a subsequent task was 1:40 min. In each task, every participant demonstrated successful performance, surpassing chance levels. CONCLUSION The results constitute the first proof-of-concept of a general purpose computer-brain interface paradigm that could be deployed on present-day medical SCS platforms.
Collapse
Affiliation(s)
| | - László Halász
- Albert-Szentgyörgyi Medical School, Doctoral School of Clinical Medicine, Clinical and Experimental Research for Reconstructive and Organ-Sparing Surgery, University of Szeged, Szeged, Hungary
| | | | - Gabriella Miklós
- CereGate GmbH, München, Germany; National Institute of Mental Health, Neurology, and Neurosurgery, Budapest, Hungary; János Szentágothai Doctoral School of Neurosciences, Semmelweis University, Budapest, Hungary
| | - Ricardo Smits Serena
- CereGate GmbH, München, Germany; Department of Orthopaedics and Sports Orthopaedics, Klinikum Rechts der Isar, Technical University of Munich, München, Germany
| | | | - Cameron C McIntyre
- Department of Biomedical Engineering and Department of Neurosurgery, Duke University, Durham, NC, USA
| | - Scott F Lempka
- Department of Biomedical Engineering, Department of Anesthesiology and the Biointerfaces Institute, University of Michigan, Ann Arbor, MI, USA
| | - Andres M Lozano
- Division of Neurosurgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Loránd Erōss
- National Institute of Mental Health, Neurology, and Neurosurgery, Budapest, Hungary
| |
Collapse
|
6
|
Zhang J, Chou CH, Hao M, Li Y, Yu Y, Lan N. Fusion of dual modalities of non-invasive sensory feedback for object profiling with prosthetic hands. Front Neurorobot 2023; 17:1298176. [PMID: 38162892 PMCID: PMC10757719 DOI: 10.3389/fnbot.2023.1298176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Accepted: 11/24/2023] [Indexed: 01/03/2024] Open
Abstract
Introduction Either non-invasive somatotopic or substitute sensory feedback is capable of conveying a single modality of sensory information from prosthetic hands to amputees. However, the neurocognitive ability of amputees to integrate multi-modality sensory information for functional discrimination is unclear. The purpose of this study was to assess the fusion of non-invasive somatotopic tactile and substitute aperture feedbacks for profile perception of multiple physical features during grasping objects. Methods Two left transradial amputees with somatotopic evoked tactile sensation (ETS) of five fingers participated in the study. The tactile information of prosthetic hand was provided to amputees by the ETS feedback elicited on the stump projected finger map. Hand aperture information was conveyed to amputees with substitute electrotactile stimulation on the forearm or upper arm. Two types of sensory feedback were integrated to a commercial prosthetic hand. The efficacy of somatotopic ETS feedback on object length identification task was assessed with or without substitute aperture stimulation. The object size identification task was utilized to assess how ETS stimulation at the stump may affect aperture perception with stimulation on the ipsilateral upper arm or forearm. Finally, the task of identifying combined length and size was conducted to evaluate the ability of amputees to integrate the dual modalities of sensory feedback for perceiving profile features. Results The study revealed that amputee subjects can effectively integrate the ETS feedback with electrotactile substitutive feedback for object profile discrimination. Specifically, ETS was robust to provide object length information with electrotactile stimulation at either the forearm or upper arm. However, electrotactile stimulation at the upper arm for aperture perception was less susceptible to the interference of ETS stimulation than at the forearm. Discussion Amputee subjects are able to combine somatotopic ETS and aperture feedbacks for identifying multi-dimensional features in object profiling. The two sensory streams of information can be fused effectively without mutual interference for functional discrimination.
Collapse
Affiliation(s)
- Jie Zhang
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chih-Hong Chou
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Manzhao Hao
- Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yan Li
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yashuo Yu
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Ning Lan
- Laboratory of NeuroRehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
7
|
Bensmaia SJ, Tyler DJ, Micera S. Restoration of sensory information via bionic hands. Nat Biomed Eng 2023; 7:443-455. [PMID: 33230305 PMCID: PMC10233657 DOI: 10.1038/s41551-020-00630-8] [Citation(s) in RCA: 85] [Impact Index Per Article: 85.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2019] [Accepted: 09/13/2020] [Indexed: 12/19/2022]
Abstract
Individuals who have lost the use of their hands because of amputation or spinal cord injury can use prosthetic hands to restore their independence. A dexterous prosthesis requires the acquisition of control signals that drive the movements of the robotic hand, and the transmission of sensory signals to convey information to the user about the consequences of these movements. In this Review, we describe non-invasive and invasive technologies for conveying artificial sensory feedback through bionic hands, and evaluate the technologies' long-term prospects.
Collapse
Affiliation(s)
- Sliman J Bensmaia
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA.
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA.
- Grossman Institute for Neuroscience, Quantitative Biology, and Human Behavior, University of Chicago, Chicago, IL, USA.
| | - Dustin J Tyler
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
- Louis Stokes Cleveland Veterans Affairs Medical Center, Cleveland, OH, USA
| | - Silvestro Micera
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy.
- Translational Neural Engineering Laboratory, Center for Neuroprosthetics and Institute of Bioengineering, School of Engineering, École Polytechnique Federale de Lausanne, Lausanne, Switzerland.
| |
Collapse
|
8
|
Wang Y, Liu H, Zeng P, Ji L, Zhou Y, Zhou L, Tao Y. Electrical nerve stimulation for sensory-neural pathway reconstruction in upper-limb amputees. Front Neurosci 2023; 17:1114962. [PMID: 36845418 PMCID: PMC9947467 DOI: 10.3389/fnins.2023.1114962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2022] [Accepted: 01/16/2023] [Indexed: 02/11/2023] Open
Abstract
Introduction The loss of the neural sensory function pathways between the stump limbs and the brain greatly impacts the rehabilitation of limb function and the daily lives of amputees. Non-invasive physical stressors, such as mechanical pressure and transcutaneous electrical nerve stimulation (TENS), could be potential solutions for recovering somatic sensations in amputees. Previous studies have shown that stimulating the residual or regenerated nerves in the stumps of some amputees can produce phantom hand sensations. However, the results are inconclusive due to unstable physiological responses caused by inaccurate stimulus parameters and positions. Methods In this study, we developed an optimal TENS strategy by mapping the distribution of the nerves in the stump skin that elicitsphantom sensations known as a "phantom hand map." We evaluated the effectiveness and stability of the confirmed stimulus configuration in a long-term experiment using single- and multi-stimulus paradigms. Additionally, we evaluated the evoked sensations by recording electroencephalograms (EEG) and analyzing brain activities. Results The results demonstrated that various types of intuitive sensations for amputees could be stably induced by adjusting TENS frequencies, particularly at 5 and 50 Hz. At these frequencies, 100% stability of sensory types was achieved when the stimuli were applied to two specific locations on the stump skin. Furthermore, at these locations, the stability of sensory positions was 100% across different days. Moreover, the evoked sensations were objectively supported by specific patterns of event-related potentials in brain responses. Discussion This study provides an effective method for developing and evaluating physical stressor stimulus strategies, which could play an important role in the somatosensory rehabilitation of amputees and other patients suffering from somatomotor sensory dysfunction. The paradigm developed in this study can provide effective guidelines for stimulus parameters in physical and electrical nerve stimulation treatments for a variety of symptoms related to neurological disorders.
Collapse
Affiliation(s)
- Yingying Wang
- Department of Otolaryngology, Peking University Shenzhen Hospital, Shenzhen, China,CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Hongyu Liu
- Department of Otolaryngology, Peking University Shenzhen Hospital, Shenzhen, China
| | - Peiying Zeng
- Department of Rheumatology and Immunology, Peking University Shenzhen Hospital, Shenzhen, China,*Correspondence: Peiying Zeng ✉
| | - Lingchao Ji
- Department of Otolaryngology, Peking University Shenzhen Hospital, Shenzhen, China
| | - Yaqi Zhou
- Department of Otolaryngology, Peking University Shenzhen Hospital, Shenzhen, China
| | - Liufang Zhou
- Department of Otolaryngology, Peking University Shenzhen Hospital, Shenzhen, China
| | - Yuan Tao
- Department of Otolaryngology, Peking University Shenzhen Hospital, Shenzhen, China,Yuan Tao ✉
| |
Collapse
|
9
|
Zhang Z, Zhang J, Luo Q, Chou CH, Xie A, Niu CM, Hao M, Lan N. A Biorealistic Computational Model Unfolds Human-Like Compliant Properties for Control of Hand Prosthesis. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2022; 3:150-161. [PMID: 36712316 PMCID: PMC9870270 DOI: 10.1109/ojemb.2022.3215726] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 06/17/2022] [Accepted: 10/10/2022] [Indexed: 11/06/2022] Open
Abstract
Objective: Human neuromuscular reflex control provides a biological model for a compliant hand prosthesis. Here we present a computational approach to understanding the emerging human-like compliance, force and position control, and stiffness adaptation in a prosthetic hand with a replica of human neuromuscular reflex. Methods: A virtual twin of prosthetic hand was constructed in the MuJoCo environment with a tendon-driven anthropomorphic hand structure. Biorealistic mathematic models of muscle, spindle, spiking-neurons and monosynaptic reflex were implemented in neuromorphic chips to drive the virtual hand for real-time control. Results: Simulation showed that the virtual hand acquired human-like ability to control fingertip position, force and stiffness for grasp, as well as the capacity to interact with soft objects by adaptively adjusting hand stiffness. Conclusion: The biorealistic neuromorphic reflex model restores human-like neuromuscular properties for hand prosthesis to interact with soft objects.
Collapse
Affiliation(s)
- Zhuozhi Zhang
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
| | - Jie Zhang
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
| | - Qi Luo
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
| | - Chih-Hong Chou
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
- Institute of Medical RoboticsShanghai Jiao Tong University Shanghai 200240 China
| | - Anran Xie
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
| | - Chuanxin M Niu
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
- Institute of Medical RoboticsShanghai Jiao Tong University Shanghai 200240 China
| | - Manzhao Hao
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
- Institute of Medical RoboticsShanghai Jiao Tong University Shanghai 200240 China
| | - Ning Lan
- Laboratory of Neurorehabilitation Engineering, School of Biomedical EngineeringShanghai Jiao Tong University Shanghai 200240 China
- Institute of Medical RoboticsShanghai Jiao Tong University Shanghai 200240 China
| |
Collapse
|
10
|
Zhang J, Chou CH, Wu X, Pei W, Lan N. Non-Invasive Stable Sensory Feedback for Closed-Loop Control of Hand Prosthesis. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:2344-2347. [PMID: 36086109 DOI: 10.1109/embc48229.2022.9871682] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The absence of somatotopic sensory feedback limits the function of conventional prosthetic hands. In this study, we integrated a non-invasive sensory feedback system into a commercial Bebionic hand with new customized surface stimulation electrodes. Multiple modalities of tactile and hand aperture sensory information were conveyed to the amputee via the technique of evoked tactile sensation (ETS) elicited at projected finger map (PFM) of residual limb and an additional electrotactile stimulation in the ipsilateral upper arm. A previously developed anti-stimulus artifact module was used to remove the stimulus artifact from surface electromyographic (sEMG) signals, and the filtered sEMG envelops controlled the speed of open/close of the Bebionic hand. The Ag/AgCl surface stimulation electrode in 10-mm diameter was specially designed to fit the restricted PFM areas for stable perception. We evaluated the alternating-current (AC) impedance magnitude of this electrode stimulated over 12 hours. The perceptual and upper thresholds in pulse-width over 200 days at PFM areas were recorded to assess the stability of the non-invasive sensory neural interface. The efficacy of multi-modality feedback for identification of physical properties of objects was also assessed. Results showed that the AC impedance of customized surface stimulation electrode was stable over 12 hours of stimulation. The perceptual and upper thresholds were stable over 200 days. This non-invasive sensory feedback enabled a forearm amputee to identify the compliance and length of grasped objects with an accuracy of 100 %. Results illustrated that the multi-modality sensory feedback system provided stable and sufficient sensory information for perceptual discrimination of physical features of grasped objects. Clinical Relevance- This study demonstrated a promising and novel way to restore stable sensory feedback non-invasively for commercial hand prostheses.
Collapse
|
11
|
Xie A, Chou CH, Luo Q, Zhang Z, Lan N. Antagonistic Control of a Cable-Driven Prosthetic Hand with Neuromorphic Model of Muscle Reflex. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:732-735. [PMID: 36086467 DOI: 10.1109/embc48229.2022.9871530] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
In this paper, a novel prototype of a cable-driven prosthetic hand with biorealisitic muscle property was developed. A pair of antagonistic muscles controlled the flexion and extension of the prosthetic index finger. Biorealistic properties of muscle were emulated using a neuromorphic model of muscle reflex in real time. The model output was coupled to a servo motor that tracked the computed muscle force. The servo motor was able to track model output within a frequency range from 0 to 8.29 (Hz) with a phase shift from 2 to 205 (deg). Surface electromyography signals collected from the amputee's forearm were used as α commands to drive the muscle model. With this prototype system, we evaluated its characteristics for force and stiffness control. Results of the force variability test showed that the standard deviation of fingertip force was linear to the mean fingertip force, indicating that force variability was proportional to the background force. At different levels of antagonistic co-contraction, the index finger and muscles displayed different levels of stiffness corresponding to the degree of co-activation. This prototype system showed the similar compliant behaviors of human limbs actuated with biological muscles. In further studies, this prototype system would be thoroughly evaluated for its biorealistic properties, and integrated with sensors to investigate feedback strategies of various sensory information for individuals with amputation. Clinical Relevance- This article established an antagonistic control of a cable-driven prosthetic hand with biorealistic properties of muscle reflex for application to individuals with amputation.
Collapse
|
12
|
Vargas L, Huang H, Zhu Y, Hu X. Evoked Tactile Feedback and Control Scheme on Functional Utility of Prosthetic Hand. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2021.3139147] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
13
|
Zhang J, Hao M, Yang F, Liang W, Sun A, Chou CH, Lan N. Evaluation of multiple perceptual qualities of transcutaneous electrical nerve stimulation for evoked tactile sensation in forearm amputees. J Neural Eng 2022; 19. [PMID: 35320789 DOI: 10.1088/1741-2552/ac6062] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 03/23/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Evoked tactile sensation (ETS) elicited by transcutaneous electrical nerve stimulation (TENS) is promising to convey digit-specific sensory information to amputees naturally and non-invasively. Fitting ETS-based sensory feedback to amputees entails customizing coding of multiple sensory information for each stimulation site. This study was to elucidate the consistency of percepts and qualities by TENS at multiple stimulation sites in amputees retaining ETS. APPROACH Five transradial amputees with ETS and fourteen able-bodied subjects participated in this study. Surface electrodes with small size (10 mm in diameter) were adopted to fit the restricted projected finger map on the forearm stump of amputees. Effects of stimulus frequency on sensory types were assessed, and the map of perceptual threshold for each sensation was characterized. Sensitivity for vibration and buzz sensations was measured using distinguishable difference in stimulus pulse width. Rapid assessments for modulation ranges of pulse width at fixed amplitude and frequency were developed for coding sensory information. Buzz sensation was demonstrated for location discrimination relating to prosthetic fingers. MAIN RESULTS Vibration and buzz sensations were consistently evoked at 20 Hz and 50 Hz as dominant sensation types in all amputees and able-bodied subjects. Perceptual thresholds of different sensations followed a similar strength-duration curve relating stimulus amplitude to pulse width. The averaged distinguishable difference in pulse width was 12.84 ± 7.23 μs for vibration and 15.21 ± 6.47 μs for buzz in able-bodied subjects, and 14.91 ± 10.54 μs for vibration and 11.30 ± 3.42 μs for buzz in amputees. Buzz coding strategy enabled five amputees to discriminate contact of individual fingers with an overall accuracy of 77.85%. SIGNIFICANCE The consistency in perceptual qualities of dominant sensations can be exploited for coding multi-modality sensory feedback. A fast protocol of sensory coding is possible for fitting ETS-based, non-invasive sensory feedback to amputees.
Collapse
Affiliation(s)
- Jie Zhang
- Laboratory of Neurorehabilitaiton Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Room 404 South Building Med-X, No.1954 Rd. Huashan, Shanghai, Shanghai, 200030, CHINA
| | - Manzhao Hao
- Laboratory of Neurorehabilitaiton Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Room 401 South Building Med-X, No.1954 Rd. Huashan, Shanghai, Shanghai, 200030, CHINA
| | - Fei Yang
- Shanghai Jiao Tong University, Room 404 South Building Med-X, No. 1954 Rd. Huashan, Xuhui, Shanghai, Shanghai, 200030, CHINA
| | - Wenyuan Liang
- National Research Center for Rehabilitation Technical Aids, No.1 Rong Hua Zhong Road, Beijing Economic and Technological Development Area, Beijing, Beijing, 100176, CHINA
| | - Aiping Sun
- National Research Center for Rehabilitation Technical Aids, No.1 Rong Hua Zhong Road, Beijing Economic and Technological Development Area, Beijing, Beijing, 100176, CHINA
| | - Chi-Hong Chou
- Laboratory of Neurorehabilitaiton Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Room 401 South Building Med-X, No.1954 Rd. Huashan, Shanghai, Shanghai, 200030, CHINA
| | - Ning Lan
- Laboratory of Neurorehabilitaiton Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Room 405 South Building Med-X, No.1954 Rd. Huashan, Shanghai, Shanghai, 200030, CHINA
| |
Collapse
|
14
|
Jabban L, Dupan S, Zhang D, Ainsworth B, Nazarpour K, Metcalfe BW. Sensory Feedback for Upper-Limb Prostheses: Opportunities and Barriers. IEEE Trans Neural Syst Rehabil Eng 2022; 30:738-747. [PMID: 35290188 DOI: 10.1109/tnsre.2022.3159186] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The addition of sensory feedback to upper-limb prostheses has been shown to improve control, increase embodiment, and reduce phantom limb pain. However, most commercial prostheses do not incorporate sensory feedback due to several factors. This paper focuses on the major challenges of a lack of deep understanding of user needs, the unavailability of tailored, realistic outcome measures and the segregation between research on control and sensory feedback. The use of methods such as the Person-Based Approach and co-creation can improve the design and testing process. Stronger collaboration between researchers can integrate different prostheses research areas to accelerate the translation process.
Collapse
|
15
|
Liu Y, Xi P, Li B, Zhang M, Liu H, Tang R, Xin S, Huang Q, He J, Liu Z, Yuan Z, Lang Y. Effect of neuromorphic transcutaneous electrical nerve stimulation (nTENS) of cortical functional networks on tactile perceptions: An event-related electroencephalogram study. J Neural Eng 2022; 19. [PMID: 35263714 DOI: 10.1088/1741-2552/ac5bf6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 03/09/2022] [Indexed: 11/12/2022]
Abstract
BACKGROUND Transcutaneous electrical nerve stimulation (TENS) is generally applied for tactile feedback in the field of prosthetics. The distinct mechanisms of evoked tactile perception between stimulus patterns in conventional TENS (cTENS) and neuromorphic TENS (nTENS) are relatively unknown. This is the first study to investigate the neurobiological effect of nTENS for cortical functional mechanism in evoked tactile perception. METHODS Twenty-one healthy participants were recruited in this study. Electroencephalogram (EEG) was recorded while the participants underwent a tactile discrimination task. One cTENS pattern (square pattern) and two nTENS patterns (electromyography and single motor unit patterns) were applied to evoke tactile perception in four fingers, including the right and left index and little fingers. EEG was preprocessed and somatosensory-evoked potentials (SEPs) were determined. Then, source-level functional networks based on graph theory were evaluated, including clustering coefficient, path length, global efficiency, and local efficiency in six frequency bands. RESULTS Behavioral results suggested that the single motor units (SMU) pattern of nTENS was the most natural tactile perception. SEPs results revealed that SMU pattern exhibited significant shorter latency in P1 and N1 components than the other patterns, while nTENS patterns have significantly longer latency in P3 component than cTENS pattern. Cortical functional networks showed that the SMU pattern had the lowest short path and highest efficiency in beta and gamma bands. CONCLUSION This study highlighted that distinct TENS patterns could affect brain activities. The new characteristics in tactile manifestation of nTENS would provide insights for the application of tactile perception restoration.
Collapse
Affiliation(s)
- Yafei Liu
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, 100081, CHINA
| | - Pengcheng Xi
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Bo Li
- School of Mechatronical Engineering, Beijing Institute of Technology, No. 5, South Street, Zhongguancun, Haidian District, Beijing, Bei Jing, Bei Jing, 100081, CHINA
| | - Minjian Zhang
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Honghao Liu
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Rongyu Tang
- School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, No.1 Zhanlanguan Road, Xicheng District, Beijing, Beijing, 100044, CHINA
| | - Shan Xin
- School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, NO.1, Zhanlanguan Road, Xicheng District, Beijing, Beijing, 100044, CHINA
| | - Qiang Huang
- Beijing Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Jiping He
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Zhiqiang Liu
- Beijing institute of basic medical sciences, 27 Taiping Road, HaidianDistrict, Beijing, Beijing, 100850, CHINA
| | - Zengqiang Yuan
- Beijing institute of basic medical sciences, 27 Taiping Road, HaidianDistrict, Beijing, 100850, CHINA
| | - Yiran Lang
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Haidian Dist. Zhongguancun South Street No. 5, Beijing, 100081, CHINA
| |
Collapse
|
16
|
Wang Y, Fang P, Tang X, Jiang N, Tian L, Li X, Zheng Y, Huang J, Samuel OW, Wang H, Wu K, Li G. Effective Evaluation of Finger Sensation Evoking by Non-invasive Stimulation for Sensory Function Recovery in Transradial Amputees. IEEE Trans Neural Syst Rehabil Eng 2022; 30:519-528. [PMID: 35235514 DOI: 10.1109/tnsre.2022.3155756] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Synergetic recovery of both somatosensory and motor functions is highly desired by limb amputees to fully regain their lost limb abilities. The commercially available prostheses can restore the lost motor function in amputees but lack intuitive sensory feedback. The previous studies showed that electrical stimulation on the arm stump would be a promising approach to induce sensory information into the nervous system, enabling the possibility of realizing sensory feedback in limb prostheses. However, there are currently limited studies on the effective evaluation of the sensations evoked by transcutaneous electrical nerve stimulation (TENS). In this paper, a multichannel TENS platform was developed and the different stimulus patterns were designed to evoke stable finger sensations for a transradial amputee. Electroencephalogram (EEG) was recorded simultaneously during TENS on the arm stump, which was utilized to evaluate the evoked sensations. The experimental results revealed that different types of sensations on three phantom fingers could be stably evoked for the amputee by properly selecting TENS patterns. The analysis of the event-related potential (ERP) of EEG recordings further confirmed the evoked sensations, and ERP latencies and curve characteristics for different phantom fingers showed significant differences. This work may provide insight for an in-depth understanding of how somatosensation could be restored in limb amputees and offer technical support for the applications of non-invasive sensory feedback systems.
Collapse
|
17
|
Luo Q, Niu CM, Chou CH, Liang W, Deng X, Hao M, Lan N. Biorealistic Control of Hand Prosthesis Augments Functional Performance of Individuals With Amputation. Front Neurosci 2021; 15:783505. [PMID: 34970115 PMCID: PMC8712573 DOI: 10.3389/fnins.2021.783505] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Accepted: 11/15/2021] [Indexed: 11/27/2022] Open
Abstract
The human hand has compliant properties arising from muscle biomechanics and neural reflexes, which are absent in conventional prosthetic hands. We recently proved the feasibility to restore neuromuscular reflex control (NRC) to prosthetic hands using real-time computing neuromorphic chips. Here we show that restored NRC augments the ability of individuals with forearm amputation to complete grasping tasks, including standard Box and Blocks Test (BBT), Golf Balls Test (GBT), and Potato Chips Test (PCT). The latter two were more challenging, but novel to prosthesis tests. Performance of a biorealistic controller (BC) with restored NRC was compared to that of a proportional linear feedback (PLF) controller. Eleven individuals with forearm amputation were divided into two groups: one with experience of myocontrol of a prosthetic hand and another without any. Controller performances were evaluated by success rate, failure (drop/break) rate in each grasping task. In controller property tests, biorealistic control achieved a better compliant property with a 23.2% wider range of stiffness adjustment than that of PLF control. In functional grasping tests, participants could control prosthetic hands more rapidly and steadily with neuromuscular reflex. For participants with myocontrol experience, biorealistic control yielded 20.4, 39.4, and 195.2% improvements in BBT, GBT, and PCT, respectively, compared to PLF control. Interestingly, greater improvements were achieved by participants without any myocontrol experience for BBT, GBT, and PCT at 27.4, 48.9, and 344.3%, respectively. The functional gain of biorealistic control over conventional control was more dramatic in more difficult grasp tasks of GBT and PCT, demonstrating the advantage of NRC. Results support the hypothesis that restoring neuromuscular reflex in hand prosthesis can improve neural motor compatibility to human sensorimotor system, hence enabling individuals with amputation to perform delicate grasps that are not tested with conventional prosthetic hands.
Collapse
Affiliation(s)
- Qi Luo
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chuanxin M. Niu
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
- Department of Rehabilitation Medicine, Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Chih-Hong Chou
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Wenyuan Liang
- National Research Center for Rehabilitation Technical Aids, Beijing, China
| | - Xiaoqian Deng
- Guangdong Work Injury Rehabilitation Hospital, Guangzhou, China
| | - Manzhao Hao
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Ning Lan
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
18
|
Demofonti A, Scarpelli A, Cordella F, Zollo L. Modulation of sensation intensity in the lower limb via Transcutaneous Electrical Nerve Stimulation. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:6470-6474. [PMID: 34892592 DOI: 10.1109/embc46164.2021.9630871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Commercially available lower limb prostheses do not restore sensory feedback in amputees. Literature suggests that Transcutaneous Electrical Nerve Stimulation (TENS) is a valid non-invasive, somatotopic technique to elicit tactile sensations, but no studies have been performed to investigate the capability of discriminating stimulus intensity via TENS in the foot. The aim of the study is to investigate how TENS can be used in order to restore sensations in the lower limb with different levels of intensity. Two experimental protocols were developed and tested on 8 healthy subjects: Mapping protocol is addressed to a fully characterization of the evoked tactile sensations; the Stimulus Intensity Discrimination one aims at investigating the best stimulation parameter to modulate for allowing the recognition of different levels of intensity. The results showed how elicited sensations were mostly described as an almost natural and superficial. A variation of the referred sensation (from nothing to vibration) and its intensity (ρ=0.6431) occurred when a higher quantity of charge was injected. Among the three modulated stimulation parameters, Pulse Amplitude (PA) has the best performance in terms of success rate (90%) and has a statistically significant difference with Pulse Frequency (PF) (PPA-PF = 0.0073<0.016). In the future, PA modulation will be tested on a larger number of healthy subjects and on amputees.
Collapse
|
19
|
Luo Q, Niu CM, Liu J, Chou CH, Hao M, Lan N. Evaluation of Model-Based Biomimetic Control of Prosthetic Finger Force for Grasp. IEEE Trans Neural Syst Rehabil Eng 2021; 29:1723-1733. [PMID: 34415835 DOI: 10.1109/tnsre.2021.3106304] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Restoring neuromuscular reflex properties in the control of a prosthetic hand may potentially approach human-level grasp functions in the prosthetic hand. Previous studies have confirmed the feasibility of real-time emulation of a monosynaptic spinal reflex loop for prosthetic control. This study continues to explore how well the biomimetic controller could enable the amputee to perform force-control tasks that required both strength and error-tolerance. The biomimetic controller was programmed on a neuromorphic chip for real-time emulation of reflex. The model-calculated force of finger flexor was used to drive a torque motor, which pulled a tendon that flexed prosthetic fingers. Force control ability was evaluated in a "press-without-break" task, which required participants to press a force transducer toward a target level, but never exceeding a breakage threshold. The same task was tested either with the index finger or the full hand; the performance of the biomimetic controller was compared to a proportional linear feedback (PLF) controller, and the contralateral normal hand. Data from finger pressing task in 5 amputees showed that the biomimetic controller and the PLF controller achieved 95.8% and 66.9% the performance of contralateral finger in success rate; 50.0% and 25.1% in stability of force control; 59.9% and 42.8% in information throughput; and 51.5% and 38.4% in completion time. The biomimetic controller outperformed the PLF controller in all performance indices. Similar trends were observed with full-hand grasp task. The biomimetic controller exhibited capacity and behavior closer to contralateral normal hand. Results suggest that incorporating neuromuscular reflex properties in the biomimetic controller may provide human-like capacity of force regulation, which may enhance motor performance of amputees operating a tendon-driven prosthetic hand.
Collapse
|
20
|
Xu X, Zhang H, Yan Y, Wang J, Guo L. Effects of electrical stimulation on skin surface. ACTA MECHANICA SINICA = LI XUE XUE BAO 2021; 37:1843-1871. [PMID: 33584001 PMCID: PMC7866966 DOI: 10.1007/s10409-020-01026-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/15/2020] [Revised: 09/16/2020] [Accepted: 10/02/2020] [Indexed: 05/10/2023]
Abstract
ABSTRACT Skin is the largest organ in the body, and directly contact with the external environment. Articles on the role of micro-current and skin have emerged in recent years. The function of micro-current is various, including introducing various drugs into the skin locally or throughout the body, stimulating skin wounds healing through various currents, suppressing pain caused by various diseases, and promoting blood circulation for postoperative muscle rehabilitation, etc. This article reviews these efforts. Compared with various physical and chemical medical therapies, micro-current stimulation provides a relatively safe, non-invasive therapy with few side effects, giving modern medicine a more suitable treatment option. At the same time, the cost of the electrical stimulation generating device is relatively low, which makes it have wider space to and more clinical application value. The current micro-current stimulation technology has become more and more mature, but there are still many problems in its research. The design of the experiment and the selection of the current parameters not standardized and rigorous. Now, clear regulations are needed to regulate this field. Micro-current skin therapy has become a robust, reliable, and well-structured system.
Collapse
Affiliation(s)
- Xinkai Xu
- State Key Laboratory of Nonlinear Mechanics, Institute of Mechanics, Chinese Academy of Sciences, Beijing, 100190 China
- School of Engineering Science, University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Han Zhang
- School of Engineering Science, University of Chinese Academy of Sciences, Beijing, 100049 China
- Key Laboratory of Noise and Vibration, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190 China
- State Key Laboratory of Acoustics, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190 China
| | - Yan Yan
- Cosmetic Technology Center, Chinese Academy of Inspection and Quarantine, Beijing, 100176 China
| | - Jianru Wang
- Xi’an Aerospace Propulsion Institute, Xi’an, 710100 China
| | - Liang Guo
- State Key Laboratory of Nonlinear Mechanics, Institute of Mechanics, Chinese Academy of Sciences, Beijing, 100190 China
| |
Collapse
|
21
|
Lan N, Hao M, Niu CM, Cui H, Wang Y, Zhang T, Fang P, Chou CH. Next-Generation Prosthetic Hand: from Biomimetic to Biorealistic. RESEARCH (WASHINGTON, D.C.) 2021; 2021:4675326. [PMID: 34104890 PMCID: PMC8152677 DOI: 10.34133/2021/4675326] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2020] [Accepted: 02/21/2021] [Indexed: 01/18/2023]
Abstract
Integrating a prosthetic hand to amputees with seamless neural compatibility presents a grand challenge to neuroscientists and neural engineers for more than half century. Mimicking anatomical structure or appearance of human hand does not lead to improved neural connectivity to the sensorimotor system of amputees. The functions of modern prosthetic hands do not match the dexterity of human hand due primarily to lack of sensory awareness and compliant actuation. Lately, progress in restoring sensory feedback has marked a significant step forward in improving neural continuity of sensory information from prosthetic hands to amputees. However, little effort has been made to replicate the compliant property of biological muscle when actuating prosthetic hands. Furthermore, a full-fledged biorealistic approach to designing prosthetic hands has not been contemplated in neuroprosthetic research. In this perspective article, we advance a novel view that a prosthetic hand can be integrated harmoniously with amputees only if neural compatibility to the sensorimotor system is achieved. Our ongoing research supports that the next-generation prosthetic hand must incorporate biologically realistic actuation, sensing, and reflex functions in order to fully attain neural compatibility.
Collapse
Affiliation(s)
- Ning Lan
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Manzhao Hao
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chuanxin M. Niu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
- Department of Rehabilitation Medicine, Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - He Cui
- Center for Excellence in Brain Science and Intelligent Technology, Chinese Academy of Sciences, Shanghai, China
| | - Yu Wang
- School of Biological Science and Medical Engineering, Beihang University, Beijing, China
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, China
| | - Ting Zhang
- i-lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics, Chinese Academy of Sciences, Suzhou, China
| | - Peng Fang
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Chih-hong Chou
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
22
|
Li Y, Cao Z, Li T, Sun F, Bai Y, Lu Q, Wang S, Yang X, Hao M, Lan N, Zhang T. Highly Selective Biomimetic Flexible Tactile Sensor for Neuroprosthetics. RESEARCH (WASHINGTON, D.C.) 2020; 2020:8910692. [PMID: 33029592 PMCID: PMC7521026 DOI: 10.34133/2020/8910692] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2020] [Accepted: 08/02/2020] [Indexed: 06/02/2023]
Abstract
Biomimetic flexible tactile sensors endow prosthetics with the ability to manipulate objects, similar to human hands. However, it is still a great challenge to selectively respond to static and sliding friction forces, which is crucial tactile information relevant to the perception of weight and slippage during grasps. Here, inspired by the structure of fingerprints and the selective response of Ruffini endings to friction forces, we developed a biomimetic flexible capacitive sensor to selectively detect static and sliding friction forces. The sensor is designed as a novel plane-parallel capacitor, in which silver nanowire-3D polydimethylsiloxane (PDMS) electrodes are placed in a spiral configuration and set perpendicular to the substrate. Silver nanowires are uniformly distributed on the surfaces of 3D polydimethylsiloxane microcolumns, and silicon rubber (Ecoflex®) acts as the dielectric material. The capacitance of the sensor remains nearly constant under different applied normal forces but increases with the static friction force and decreases when sliding occurs. Furthermore, aiming at the slippage perception of neuroprosthetics, a custom-designed signal encoding circuit was designed to transform the capacitance signal into a bionic pulsed signal modulated by the applied sliding friction force. Test results demonstrate the great potential of the novel biomimetic flexible sensors with directional and dynamic sensitivity of haptic force for smart neuroprosthetics.
Collapse
Affiliation(s)
- Yue Li
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
- School of Nano-Tech and Nano-Bionics, University of Science and Technology of China, 96 Jinzhai Road, Hefei, Anhui 230026, China
| | - Zhiguang Cao
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
| | - Tie Li
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
- School of Nano-Tech and Nano-Bionics, University of Science and Technology of China, 96 Jinzhai Road, Hefei, Anhui 230026, China
| | - Fuqin Sun
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
| | - Yuanyuan Bai
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
| | - Qifeng Lu
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
| | - Shuqi Wang
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
| | - Xianqing Yang
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
| | - Manzhao Hao
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering and Institute of Medical Robotics, Shanghai Jiao Tong University, 1954 Huashan Road, Shanghai 20030, China
| | - Ning Lan
- Laboratory of Neurorehabilitation Engineering, School of Biomedical Engineering and Institute of Medical Robotics, Shanghai Jiao Tong University, 1954 Huashan Road, Shanghai 20030, China
| | - Ting Zhang
- i-Lab, Key Laboratory of Multifunctional Nanomaterials and Smart Systems, Suzhou Institute of Nano-Tech and Nano-Bionics (SINANO), Chinese Academy of Sciences (CAS), 398 Ruoshui Road, Suzhou 215123, China
- School of Nano-Tech and Nano-Bionics, University of Science and Technology of China, 96 Jinzhai Road, Hefei, Anhui 230026, China
- Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| |
Collapse
|