1
|
Ma C, Nazarpour K. DistaNet: grasp-specific distance biofeedback promotes the retention of myoelectric skills. J Neural Eng 2024; 21:036037. [PMID: 38742365 DOI: 10.1088/1741-2552/ad4af7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2023] [Accepted: 04/24/2024] [Indexed: 05/16/2024]
Abstract
Objective.An active myoelectric interface responds to the user's muscle signals to enable movements. Machine learning can decode user intentions from myoelectric signals. However, machine learning-based interface control lacks continuous, intuitive feedback about task performance, needed to facilitate the acquisition and retention of myoelectric control skills.Approach.We propose DistaNet as a neural network-based framework that extracts smooth, continuous, and low-dimensional signatures of the hand grasps from multi-channel myoelectric signals and provides grasp-specific biofeedback to the users.Main results.Experimental results show its effectiveness in decoding user gestures and providing biofeedback, helping users retain the acquired motor skills.Significance.We demonstrates myoelectric skill retention in a pattern recognition setting for the first time.
Collapse
Affiliation(s)
- Chenfei Ma
- School of Informatics, The University of Edinburgh, Edinburgh EH8 9AB, United Kingdom
| | - Kianoush Nazarpour
- School of Informatics, The University of Edinburgh, Edinburgh EH8 9AB, United Kingdom
| |
Collapse
|
2
|
Papaleo ED, D'Alonzo M, Fiori F, Piombino V, Falato E, Pilato F, De Liso A, Di Lazzaro V, Di Pino G. Integration of proprioception in upper limb prostheses through non-invasive strategies: a review. J Neuroeng Rehabil 2023; 20:118. [PMID: 37689701 PMCID: PMC10493033 DOI: 10.1186/s12984-023-01242-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Accepted: 08/24/2023] [Indexed: 09/11/2023] Open
Abstract
Proprioception plays a key role in moving our body dexterously and effortlessly. Nevertheless, the majority of investigations evaluating the benefits of providing supplemental feedback to prosthetics users focus on delivering touch restitution. These studies evaluate the influence of touch sensation in an attempt to improve the controllability of current robotic devices. Contrarily, investigations evaluating the capabilities of proprioceptive supplemental feedback have yet to be comprehensively analyzed to the same extent, marking a major gap in knowledge within the current research climate. The non-invasive strategies employed so far to restitute proprioception are reviewed in this work. In the absence of a clearly superior strategy, approaches employing vibrotactile, electrotactile and skin-stretch stimulation achieved better and more consistent results, considering both kinesthetic and grip force information, compared with other strategies or any incidental feedback. Although emulating the richness of the physiological sensory return through artificial feedback is the primary hurdle, measuring its effects to eventually support the integration of cumbersome and energy intensive hardware into commercial prosthetic devices could represent an even greater challenge. Thus, we analyze the strengths and limitations of previous studies and discuss the possible benefits of coupling objective measures, like neurophysiological parameters, as well as measures of prosthesis embodiment and cognitive load with behavioral measures of performance. Such insights aim to provide additional and collateral outcomes to be considered in the experimental design of future investigations of proprioception restitution that could, in the end, allow researchers to gain a more detailed understanding of possibly similar behavioral results and, thus, support one strategy over another.
Collapse
Affiliation(s)
- Ermanno Donato Papaleo
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Marco D'Alonzo
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Francesca Fiori
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Valeria Piombino
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy
| | - Emma Falato
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Fabio Pilato
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Alfredo De Liso
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Vincenzo Di Lazzaro
- Research Unit of Neurology, Department of Medicine and Surgery, Università Campus Bio-Medico Di Roma, Via Alvaro del Portillo, 21, 00128, Rome, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Via Alvaro del Portillo 200, 00128, Rome, Italy
| | - Giovanni Di Pino
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico Di Roma, Via Álvaro Del Portillo 21, 00128, Rome, Italy.
| |
Collapse
|
3
|
Earley EJ, Johnson RE, Sensinger JW, Hargrove LJ. Wrist speed feedback improves elbow compensation and reaching accuracy for myoelectric transradial prosthesis users in hybrid virtual reaching task. J Neuroeng Rehabil 2023; 20:9. [PMID: 36658605 PMCID: PMC9850536 DOI: 10.1186/s12984-023-01138-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Accepted: 01/11/2023] [Indexed: 01/20/2023] Open
Abstract
BACKGROUND Myoelectric prostheses are a popular choice for restoring motor capability following the loss of a limb, but they do not provide direct feedback to the user about the movements of the device-in other words, kinesthesia. The outcomes of studies providing artificial sensory feedback are often influenced by the availability of incidental feedback. When subjects are blindfolded and disconnected from the prosthesis, artificial sensory feedback consistently improves control; however, when subjects wear a prosthesis and can see the task, benefits often deteriorate or become inconsistent. We theorize that providing artificial sensory feedback about prosthesis speed, which cannot be precisely estimated via vision, will improve the learning and control of a myoelectric prosthesis. METHODS In this study, we test a joint-speed feedback system with six transradial amputee subjects to evaluate how it affects myoelectric control and adaptation behavior during a virtual reaching task. RESULTS Our results showed that joint-speed feedback lowered reaching errors and compensatory movements during steady-state reaches. However, the same feedback provided no improvement when control was perturbed. CONCLUSIONS These outcomes suggest that the benefit of joint speed feedback may be dependent on the complexity of the myoelectric control and the context of the task.
Collapse
Affiliation(s)
- Eric J Earley
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, USA.
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, USA.
- Center for Bionics and Pain Research, Mölndal, Sweden.
- Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden.
| | - Reva E Johnson
- Department of Mechanical Engineering and Bioengineering, Valparaiso University, Valparaiso, IN, USA
| | - Jonathon W Sensinger
- Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB, Canada
- Department of Electrical and Computer Engineering, University of New Brunswick, Fredericton, NB, Canada
| | - Levi J Hargrove
- Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, USA
- Department of Biomedical Engineering, Northwestern University, Chicago, IL, USA
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago, IL, USA
| |
Collapse
|
4
|
Tchimino J, Dideriksen JL, Dosen S. EMG feedback outperforms force feedback in the presence of prosthesis control disturbance. Front Neurosci 2022; 16:952288. [PMID: 36203816 PMCID: PMC9530657 DOI: 10.3389/fnins.2022.952288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2022] [Accepted: 08/22/2022] [Indexed: 11/30/2022] Open
Abstract
Closing the prosthesis control loop by providing artificial somatosensory feedback can improve utility and user experience. Additionally, closed-loop control should be more robust with respect to disturbance, but this might depend on the type of feedback provided. Thus, the present study investigates and compares the performance of EMG and force feedback in the presence of control disturbances. Twenty able-bodied subjects and one transradial amputee performed delicate and power grasps with a prosthesis in a functional task, while the control signal gain was temporarily increased (high-gain disturbance) or decreased (low-gain disturbance) without their knowledge. Three outcome measures were considered: the percentage of trials successful in the first attempt (reaction to disturbance), the average number of attempts in trials where the wrong force was initially applied (adaptation to disturbance), and the average completion time of the last attempt in every trial. EMG feedback was shown to offer significantly better performance compared to force feedback during power grasping in terms of reaction to disturbance and completion time. During power grasping with high-gain disturbance, the median first-attempt success rate was significantly higher with EMG feedback (73.3%) compared to that achieved with force feedback (60%). Moreover, the median completion time for power grasps with low-gain disturbance was significantly longer with force feedback than with EMG feedback (3.64 against 2.48 s, an increase of 32%). Contrary to our expectations, there was no significant difference between feedback types with regards to adaptation to disturbances and the two feedback types performed similarly in delicate grasps. The results indicated that EMG feedback displayed better performance than force feedback in the presence of control disturbances, further demonstrating the potential of this approach to provide a reliable prosthesis-user interaction.
Collapse
|
5
|
Guémann M, Halgand C, Bastier A, Lansade C, Borrini L, Lapeyre É, Cattaert D, de Rugy A. Sensory substitution of elbow proprioception to improve myoelectric control of upper limb prosthesis: experiment on healthy subjects and amputees. J Neuroeng Rehabil 2022; 19:59. [PMID: 35690860 PMCID: PMC9188052 DOI: 10.1186/s12984-022-01038-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 05/31/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Current myoelectric prostheses lack proprioceptive information and rely on vision for their control. Sensory substitution is increasingly developed with non-invasive vibrotactile or electrotactile feedback, but most systems are designed for grasping or object discriminations, and few were tested for online control in amputees. The objective of this work was evaluate the effect of a novel vibrotactile feedback on the accuracy of myoelectric control of a virtual elbow by healthy subjects and participants with an upper-limb amputation at humeral level. METHODS Sixteen, healthy participants and 7 transhumeral amputees performed myoelectric control of a virtual arm under different feedback conditions: vision alone (VIS), vibration alone (VIB), vision plus vibration (VIS + VIB), or no feedback at all (NO). Reach accuracy was evaluated by angular errors during discrete as well as back and forth movements. Healthy participants' workloads were assessed with the NASA-TLX questionnaire, and feedback conditions were ranked according to preference at the end of the experiment. RESULTS Reach errors were higher in NO than in VIB, indicating that our vibrotactile feedback improved performance as compared to no feedback. Conditions VIS and VIS+VIB display similar levels of performance and produced lower errors than in VIB. Vision remains therefore critical to maintain good performance, which is not ameliorated nor deteriorated by the addition of vibrotactile feedback. The workload associated with VIB was higher than for VIS and VIS+VIB, which did not differ from each other. 62.5% of healthy subjects preferred the VIS+VIB condition, and ranked VIS and VIB second and third, respectively. CONCLUSION Our novel vibrotactile feedback improved myoelectric control of a virtual elbow as compared to no feedback. Although vision remained critical, the addition of vibrotactile feedback did not improve nor deteriorate the control and was preferred by participants. Longer training should improve performances with VIB alone and reduce the need of vision for close-loop prosthesis control.
Collapse
Affiliation(s)
- Matthieu Guémann
- HYBRID Team, INCIA, CNRS, UMR 5287, Bordeaux, France. .,Unité de Physiologie de l'Exercice et des Activités en Conditions Extrêmes,Département Environnements Opérationnels, Institut de Recherche Biomédicale des Armées, Brétigny, France.
| | | | | | | | - Léo Borrini
- Physical and Rehabilitation Medicine Department, Percy Military Hospital, Clamart, France
| | - Éric Lapeyre
- Physical and Rehabilitation Medicine Department, Percy Military Hospital, Clamart, France
| | | | - Aymar de Rugy
- HYBRID Team, INCIA, CNRS, UMR 5287, Bordeaux, France
| |
Collapse
|
6
|
Earley EJ, Zbinden J, Munoz-Novoa M, Mastinu E, Smiles A, Ortiz-Catalan M. Competitive motivation increased home use and improved prosthesis self-perception after Cybathlon 2020 for neuromusculoskeletal prosthesis user. J Neuroeng Rehabil 2022; 19:47. [PMID: 35578249 PMCID: PMC9112467 DOI: 10.1186/s12984-022-01024-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 05/03/2022] [Indexed: 11/30/2022] Open
Abstract
Background Assistive technologies, such as arm prostheses, are intended to improve the quality of life of individuals with physical disabilities. However, certain training and learning is usually required from the user to make these technologies more effective. Moreover, some people can be encouraged to train more through competitive motivation. Methods In this study, we investigated if the training for and participation in a competitive event (Cybathlon 2020) could promote behavioral changes in an individual with upper limb amputation (the pilot). We defined behavioral changes as the active time while his prosthesis was actuated, ratio of opposing and simultaneous movements, and the pilot’s ability to finely modulate his movement speeds. The investigation was based on extensive home-use data from the period before, during and after the Cybathlon 2020 competition. Results Relevant behavioral changes were found from both quantitative and qualitative analyses. The pilot’s home use of his prosthesis nearly doubled in the period before the Cybathlon, and remained 66% higher than baseline after the competition. Moreover, he improved his speed modulation when controlling his prosthesis, and he learned and routinely operated new movements in the prosthesis (wrist rotation) at home. Additionally, as confirmed by semi-structured interviews, his self-perception of the prosthetic arm and its functionality also improved. Conclusions An event like the Cybathlon may indeed promote behavioral changes in how competitive individuals with amputation use their prostheses. Provided that the prosthesis is suitable in terms of form and function for both competition and at-home daily use, daily activities can become opportunities for training, which in turn can improve prosthesis function and create further opportunities for daily use. Moreover, these changes appeared to remain even well after the event, albeit relevant only for individuals who continue using the technology employed in the competition. Supplementary Information The online version contains supplementary material available at 10.1186/s12984-022-01024-4.
Collapse
Affiliation(s)
- Eric J Earley
- Center for Bionics and Pain Research, Mölndal, Sweden.,Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Jan Zbinden
- Center for Bionics and Pain Research, Mölndal, Sweden.,Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Maria Munoz-Novoa
- Center for Bionics and Pain Research, Mölndal, Sweden.,Department of Clinical Neuroscience, Institute of Neuroscience and Physiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Enzo Mastinu
- Center for Bionics and Pain Research, Mölndal, Sweden.,Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Andrew Smiles
- Center for Bionics and Pain Research, Mölndal, Sweden.,Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden.,Waterloo Engineering Bionics Lab, University of Waterloo, Waterloo, Canada
| | - Max Ortiz-Catalan
- Center for Bionics and Pain Research, Mölndal, Sweden. .,Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden. .,Operational Area 3, Sahlgrenska University Hospital, Gothenburg, Sweden. .,Department of Orthopedics, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.
| |
Collapse
|