1
|
Rubin N, Hinson R, Saul K, Filer W, Hu X, Huang H(H. Modified motor unit properties in residual muscle following transtibial amputation. J Neural Eng 2024; 21:10.1088/1741-2552/ad1ac2. [PMID: 38176027 PMCID: PMC11214693 DOI: 10.1088/1741-2552/ad1ac2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 01/04/2024] [Indexed: 01/06/2024]
Abstract
Objective.Neural signals in residual muscles of amputated limbs are frequently decoded to control powered prostheses. Yet myoelectric controllers assume muscle activities of residual muscles are similar to that of intact muscles. This study sought to understand potential changes to motor unit (MU) properties after limb amputation.Approach.Six people with unilateral transtibial amputation were recruited. Surface electromyogram (EMG) of residual and intacttibialis anterior(TA) andgastrocnemius(GA) muscles were recorded while subjects traced profiles targeting up to 20% and 35% of maximum activation for each muscle (isometric for intact limbs). EMG was decomposed into groups of MU spike trains. MU recruitment thresholds, action potential amplitudes (MU size), and firing rates were correlated to model Henneman's size principle, the onion-skin phenomenon, and rate-size associations. Organization (correlation) and modulation (rates of change) of relations were compared between intact and residual muscles.Main results.The residual TA exhibited significantly lower correlation and flatter slopes in the size principle and onion-skin, and each outcome covaried between the MU relations. The residual GA was unaffected for most subjects. Subjects trained prior with myoelectric prostheses had minimally affected slopes in the TA. Rate-size association correlations were preserved, but both residual muscles exhibited flatter decay rates.Significance.We showed peripheral neuromuscular damage also leads to spinal-level functional reorganizations. Our findings suggest models of MU recruitment and discharge patterns for residual muscle EMG generation need reparameterization to account for disturbances observed. In the future, tracking MU pool adaptations may also provide a biomarker of neuromuscular control to aid training with myoelectric prostheses.
Collapse
Affiliation(s)
- Noah Rubin
- UNC/NC State Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
| | - Robert Hinson
- UNC/NC State Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC 27695, United States of America
- UNC/NC State Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
- School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
| | - Katherine Saul
- Department of Mechanical & Aerospace Engineering, North Carolina State University, Raleigh, NC 27695, United States of America
| | - William Filer
- School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
| | - Xiaogang Hu
- Department of Mechanical Engineering, Pennsylvania State University, University Park, PA 16802, United States of America
| | - He (Helen) Huang
- UNC/NC State Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, United States of America
| |
Collapse
|
2
|
Bochniewicz EM, Emmer G, Dromerick AW, Barth J, Lum PS. Measurement of Functional Use in Upper Extremity Prosthetic Devices Using Wearable Sensors and Machine Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:3111. [PMID: 36991822 PMCID: PMC10058354 DOI: 10.3390/s23063111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 03/11/2023] [Accepted: 03/12/2023] [Indexed: 06/19/2023]
Abstract
Trials for therapies after an upper limb amputation (ULA) require a focus on the real-world use of the upper limb prosthesis. In this paper, we extend a novel method for identifying upper extremity functional and nonfunctional use to a new patient population: upper limb amputees. We videotaped five amputees and 10 controls performing a series of minimally structured activities while wearing sensors on both wrists that measured linear acceleration and angular velocity. The video data was annotated to provide ground truth for annotating the sensor data. Two different analysis methods were used: one that used fixed-size data chunks to create features to train a Random Forest classifier and one that used variable-size data chunks. For the amputees, the fixed-size data chunk method yielded good results, with 82.7% median accuracy (range of 79.3-85.8) on the 10-fold cross-validation intra-subject test and 69.8% in the leave-one-out inter-subject test (range of 61.4-72.8). The variable-size data method did not improve classifier accuracy compared to the fixed-size method. Our method shows promise for inexpensive and objective quantification of functional upper extremity (UE) use in amputees and furthers the case for use of this method in assessing the impact of UE rehabilitative treatments.
Collapse
Affiliation(s)
- Elaine M. Bochniewicz
- The MITRE Corporation, McLean, VA 22102, USA
- Department of Biomedical Engineering, Catholic University of America, Washington, DC 20064, USA
| | - Geoff Emmer
- The MITRE Corporation, McLean, VA 22102, USA
| | - Alexander W. Dromerick
- Medstar National Rehabilitation Network, Washington, DC 20010, USA
- Veterans Affairs Medical Center, Providence, RI 02908, USA
- Department of Rehabilitation Medicine, Georgetown University, Washington, DC 20057, USA
| | - Jessica Barth
- Medstar National Rehabilitation Network, Washington, DC 20010, USA
- Veterans Affairs Medical Center, Providence, RI 02908, USA
| | - Peter S. Lum
- Department of Biomedical Engineering, Catholic University of America, Washington, DC 20064, USA
- Medstar National Rehabilitation Network, Washington, DC 20010, USA
- Veterans Affairs Medical Center, Providence, RI 02908, USA
| |
Collapse
|
3
|
Pasluosta C, Kiele P, Čvančara P, Micera S, Aszmann OC, Stieglitz T. Bidirectional bionic limbs: a perspective bridging technology and physiology. J Neural Eng 2022; 19. [PMID: 35132954 DOI: 10.1088/1741-2552/ac4bff] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Accepted: 01/17/2022] [Indexed: 11/11/2022]
Abstract
Precise control of bionic limbs relies on robust decoding of motor commands from nerves or muscles signals and sensory feedback from artificial limbs to the nervous system by interfacing the afferent nerve pathways. Implantable devices for bidirectional communication with bionic limbs have been developed in parallel with research on physiological alterations caused by an amputation. In this perspective article, we question whether increasing our effort on bridging these technologies with a deeper understanding of amputation pathophysiology and human motor control may help to overcome pressing stalls in the next generation of bionic limbs.
Collapse
Affiliation(s)
- C Pasluosta
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering, University of Freiburg, Freiburg, Germany
| | - P Kiele
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering, University of Freiburg, Freiburg, Germany
| | - P Čvančara
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering, University of Freiburg, Freiburg, Germany.,BrainLinks-BrainTools, University of Freiburg, Freiburg, Germany
| | - S Micera
- School of Engineering, École Polytechnique Fédérale de Lausanne, Bertarelli Foundation Chair in Translational Neuroengineering, Centre for Neuroprosthetics and Institute of Bioengineering, Lausanne, Switzerland.,The BioRobotics Institute and Department of Excellence in Robotics and Artificial Intelligence, Scuola Superiore Sant'Anna, Pisa, Italy
| | - O C Aszmann
- Clinical Laboratory for Bionic Extremity Reconstruction, Medical University of Vienna; Division of Plastic and Reconstructive Surgery, Department of Surgery, Medical University of Vienna, Vienna, Austria
| | - T Stieglitz
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering, University of Freiburg, Freiburg, Germany.,Bernstein Center Freiburg, University of Freiburg, Freiburg, Germany.,BrainLinks-BrainTools, University of Freiburg, Freiburg, Germany
| |
Collapse
|
4
|
Mamidanna P, Dideriksen JL, Dosen S. The impact of objective functions on control policies in closed-loop control of grasping force with a myoelectric prosthesis. J Neural Eng 2021; 18. [PMID: 34479219 DOI: 10.1088/1741-2552/ac23c1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Accepted: 09/03/2021] [Indexed: 01/14/2023]
Abstract
Objective.Supplemental sensory feedback for myoelectric prostheses can provide both psychosocial and functional benefits during prosthesis control. However, the impact of feedback depends on multiple factors and there is insufficient understanding about the fundamental role of such feedback in prosthesis use. The framework of human motor control enables us to systematically investigate the user-prosthesis control loop. In this study, we explore how different task objectives such as speed and accuracy shape the control policy developed by participants in a prosthesis force-matching task.Approach.Participants were randomly assigned to two groups that both used identical electromyography control interface and prosthesis force feedback, through vibrotactile stimulation, to perform a prosthesis force-matching task. However, the groups received different task objectives specifying speed and accuracy demands. We then investigated the control policies developed by the participants. To this end, we not only evaluated how successful or fast participants were but also analyzed the behavioral strategies adopted by the participants to obtain such performance gains.Main results.First, we observed that participants successfully integrated supplemental prosthesis force feedback to develop both feedforward and feedback control policies, as demanded by the task objectives. We then observed that participants who first developed a (slow) feedback policy were quickly able to adapt their policy to more stringent speed demands, by switching to a combined feedforward-feedback control strategy. However, the participants who first developed a (fast) feedforward policy were not able to change their control policy and adjust to greater accuracy demands.Significance.Overall, the results signify how the framework of human motor control can be applied to study the role of feedback in user-prosthesis interaction. The results also reveal the utility of training prosthesis users to integrate supplemental feedback into their state estimation by designing training protocols that encourage the development of combined feedforward and feedback policy.
Collapse
Affiliation(s)
- Pranav Mamidanna
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | | | - Strahinja Dosen
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| |
Collapse
|
5
|
Williams HE, Chapman CS, Pilarski PM, Vette AH, Hebert JS. Myoelectric prosthesis users and non-disabled individuals wearing a simulated prosthesis exhibit similar compensatory movement strategies. J Neuroeng Rehabil 2021; 18:72. [PMID: 33933105 PMCID: PMC8088043 DOI: 10.1186/s12984-021-00855-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2020] [Accepted: 03/17/2021] [Indexed: 11/24/2022] Open
Abstract
Background Research studies on upper limb prosthesis function often rely on the use of simulated myoelectric prostheses (attached to and operated by individuals with intact limbs), primarily to increase participant sample size. However, it is not known if these devices elicit the same movement strategies as myoelectric prostheses (operated by individuals with amputation). The objective of this study was to address the question of whether non-disabled individuals using simulated prostheses employ the same compensatory movements (measured by hand and upper body kinematics) as individuals who use actual myoelectric prostheses. Methods The upper limb movements of two participant groups were investigated: (1) twelve non-disabled individuals wearing a simulated prosthesis, and (2) three individuals with transradial amputation using their custom-fitted myoelectric devices. Motion capture was used for data collection while participants performed a standardized functional task. Performance metrics, hand movements, and upper body angular kinematics were calculated. For each participant group, these measures were compared to those from a normative baseline dataset. Each deviation from normative movement behaviour, by either participant group, indicated that compensatory movements were used during task performance. Results Results show that participants using either a simulated or actual myoelectric prosthesis exhibited similar deviations from normative behaviour in phase durations, hand velocities, hand trajectories, number of movement units, grip aperture plateaus, and trunk and shoulder ranges of motion. Conclusions This study suggests that the use of a simulated prosthetic device in upper limb research offers a reasonable approximation of compensatory movements employed by a low- to moderately-skilled transradial myoelectric prosthesis user.
Collapse
Affiliation(s)
- Heather E Williams
- Department of Biomedical Engineering, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada.
| | - Craig S Chapman
- Faculty of Kinesiology, Sport, and Recreation, University of Alberta, Edmonton, AB, Canada
| | - Patrick M Pilarski
- Department of Medicine, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Albert H Vette
- Department of Biomedical Engineering, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada.,Department of Mechanical Engineering, Faculty of Engineering, University of Alberta, Edmonton, AB, Canada.,Glenrose Rehabilitation Hospital, Alberta Health Services, Edmonton, AB, Canada
| | - Jacqueline S Hebert
- Department of Biomedical Engineering, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada.,Department of Medicine, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada.,Glenrose Rehabilitation Hospital, Alberta Health Services, Edmonton, AB, Canada
| |
Collapse
|
6
|
Burns MK, Stika J, Patel V, Pei D, Nataraj R, Vinjamuri R. Lateralization and Model Transference in a Bilateral Cursor Task .. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:3240-3243. [PMID: 33018695 DOI: 10.1109/embc44109.2020.9176496] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Post-stroke rehabilitation, occupational and physical therapy, and training for use of assistive prosthetics leverages our current understanding of bilateral motor control to better train individuals. In this study, we examine upper limb lateralization and model transference using a bimanual joystick cursor task with orthogonal controls. Two groups of healthy subjects are recruited into a 2-session study spaced seven days apart. One group uses their left and right hands to control cursor position and rotation respectively, while the other uses their right and left hands. The groups switch control methods in the second session, and a rotational perturbation is applied to the positional controls in the latter half of each session. We find agreement with current lateralization theories when comparing robustness to feedforward perturbations in feedback and feedforward measures. We find no evidence of a transferable model after seven days, and evidence that the brain does not synchronize task completion between the hands.
Collapse
|
7
|
Mastinu E, Engels LF, Clemente F, Dione M, Sassu P, Aszmann O, Brånemark R, Håkansson B, Controzzi M, Wessberg J, Cipriani C, Ortiz-Catalan M. Neural feedback strategies to improve grasping coordination in neuromusculoskeletal prostheses. Sci Rep 2020; 10:11793. [PMID: 32678121 PMCID: PMC7367346 DOI: 10.1038/s41598-020-67985-5] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2020] [Accepted: 06/11/2020] [Indexed: 11/09/2022] Open
Abstract
Conventional prosthetic arms suffer from poor controllability and lack of sensory feedback. Owing to the absence of tactile sensory information, prosthetic users must rely on incidental visual and auditory cues. In this study, we investigated the effect of providing tactile perception on motor coordination during routine grasping and grasping under uncertainty. Three transhumeral amputees were implanted with an osseointegrated percutaneous implant system for direct skeletal attachment and bidirectional communication with implanted neuromuscular electrodes. This neuromusculoskeletal prosthesis is a novel concept of artificial limb replacement that allows to extract control signals from electrodes implanted on viable muscle tissue, and to stimulate severed afferent nerve fibers to provide somatosensory feedback. Subjects received tactile feedback using three biologically inspired stimulation paradigms while performing a pick and lift test. The grasped object was instrumented to record grasping and lifting forces and its weight was either constant or unexpectedly changed in between trials. The results were also compared to the no-feedback control condition. Our findings confirm, in line with the neuroscientific literature, that somatosensory feedback is necessary for motor coordination during grasping. Our results also indicate that feedback is more relevant under uncertainty, and its effectiveness can be influenced by the selected neuromodulation paradigm and arguably also the prior experience of the prosthesis user.
Collapse
Affiliation(s)
- Enzo Mastinu
- Center for Bionics and Pain Research, Mölndal, Sweden
- Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Leonard F Engels
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Francesco Clemente
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant'Anna, Pisa, Italy
- Prensilia SRL, Pontedera, Italy
| | - Mariama Dione
- Department of Physiology, Institute of Neuroscience and Physiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Paolo Sassu
- Department of Hand Surgery, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Oskar Aszmann
- Clinical Laboratory for Bionic Extremity Reconstruction, Division of Plastic and Reconstructive Surgery, Medical University of Vienna, Vienna, Austria
| | - Rickard Brånemark
- Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Center for Extreme Bionics, Biomechatronics Group, MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Bo Håkansson
- Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Marco Controzzi
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Johan Wessberg
- Department of Physiology, Institute of Neuroscience and Physiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
| | - Christian Cipriani
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Max Ortiz-Catalan
- Center for Bionics and Pain Research, Mölndal, Sweden.
- Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden.
- Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.
- Operational Area 3, Sahlgrenska University Hospital, Mölndal, Sweden.
| |
Collapse
|
8
|
Sensinger JW, Dosen S. A Review of Sensory Feedback in Upper-Limb Prostheses From the Perspective of Human Motor Control. Front Neurosci 2020; 14:345. [PMID: 32655344 PMCID: PMC7324654 DOI: 10.3389/fnins.2020.00345] [Citation(s) in RCA: 60] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Accepted: 03/23/2020] [Indexed: 12/22/2022] Open
Abstract
This manuscript reviews historical and recent studies that focus on supplementary sensory feedback for use in upper limb prostheses. It shows that the inability of many studies to speak to the issue of meaningful performance improvements in real-life scenarios is caused by the complexity of the interactions of supplementary sensory feedback with other types of feedback along with other portions of the motor control process. To do this, the present manuscript frames the question of supplementary feedback from the perspective of computational motor control, providing a brief review of the main advances in that field over the last 20 years. It then separates the studies on the closed-loop prosthesis control into distinct categories, which are defined by relating the impact of feedback to the relevant components of the motor control framework, and reviews the work that has been done over the last 50+ years in each of those categories. It ends with a discussion of the studies, along with suggestions for experimental construction and connections with other areas of research, such as machine learning.
Collapse
Affiliation(s)
- Jonathon W. Sensinger
- Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB, Canada
| | - Strahinja Dosen
- Department of Health Science and Technology, The Faculty of Medicine, Integrative Neuroscience, Aalborg University, Aalborg, Denmark
| |
Collapse
|
9
|
Comparison of vibrotactile and joint-torque feedback in a myoelectric upper-limb prosthesis. J Neuroeng Rehabil 2019; 16:70. [PMID: 31186005 PMCID: PMC6558922 DOI: 10.1186/s12984-019-0545-5] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2019] [Accepted: 05/28/2019] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Despite the technological advancements in myoelectric prostheses, body-powered prostheses remain a popular choice for amputees, in part due to the natural sensory advantage they provide. Research on haptic feedback in myoelectric prostheses has delivered mixed results. Furthermore, there is limited research comparing various haptic feedback modalities in myoelectric prostheses. In this paper, we present a comparison of the feedback intrinsically present in body-powered prostheses (joint-torque feedback) to a commonly proposed feedback modality for myoelectric prostheses (vibrotactile feedback). In so doing, we seek to understand whether the advantages of kinesthetic feedback present in body-powered prostheses translate to myoelectric prostheses, and whether there are differences between kinesthetic and cutaneous feedback in prosthetic applications. METHODS We developed an experimental testbed that features a cable-driven, voluntary-closing 1-DoF prosthesis, a capstan-driven elbow exoskeleton, and a vibrotactile actuation unit. The system can present grip force to users as either a flexion moment about the elbow or vibration on the wrist. To provide an equal comparison of joint-torque and vibrotactile feedback, a stimulus intensity matching scheme was utilized. Non-amputee participants (n=12) were asked to discriminate objects of varying stiffness with the prosthesis in three conditions: no haptic feedback, vibrotactile feedback, and joint-torque feedback. RESULTS Results indicate that haptic feedback increased discrimination accuracy over no haptic feedback, but the difference between joint-torque feedback and vibrotactile feedback was not significant. In addition, our results highlight nuanced differences in performance depending on the objects' stiffness, and suggest that participants likely pay less attention to incidental cues with the addition of haptic feedback. CONCLUSION Even when haptic feedback is not modality matched to the task, such as in the case of vibrotactile feedback, performance with a myoelectric prosthesis can improve significantly. This implies it is possible to achieve the same benefits with vibrotactile feedback, which is cheaper and easier to implement than other forms of feedback.
Collapse
|
10
|
Engels LF, Shehata AW, Scheme EJ, Sensinger JW, Cipriani C. When Less Is More - Discrete Tactile Feedback Dominates Continuous Audio Biofeedback in the Integrated Percept While Controlling a Myoelectric Prosthetic Hand. Front Neurosci 2019; 13:578. [PMID: 31244596 PMCID: PMC6563774 DOI: 10.3389/fnins.2019.00578] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2019] [Accepted: 05/21/2019] [Indexed: 11/13/2022] Open
Abstract
State of the art myoelectric hand prostheses can restore some feedforward motor function to their users, but they cannot yet restore sensory feedback. It has been shown, using psychophysical tests, that multi-modal sensory feedback is readily used in the formation of the users' representation of the control task in their central nervous system - their internal model. Hence, to fully describe the effect of providing feedback to prosthesis users, not only should functional outcomes be assessed, but so should the internal model. In this study, we compare the complex interactions between two different feedback types, as well as a combination of the two, on the internal model, and the functional performance of naïve participants without limb difference. We show that adding complementary audio biofeedback to visual feedback enables the development of a significantly stronger internal model for controlling a myoelectric hand compared to visual feedback alone, but adding discrete vibrotactile feedback to vision does not. Both types of feedback, however, improved the functional grasping abilities to a similar degree. Contrary to our expectations, when both types of feedback are combined, the discrete vibrotactile feedback seems to dominate the continuous audio feedback. This finding indicates that simply adding sensory information may not necessarily enhance the formation of the internal model in the short term. In fact, it could even degrade it. These results support our argument that assessment of the internal model is crucial to understanding the effects of any type of feedback, although we cannot be sure that the metrics used here describe the internal model exhaustively. Furthermore, all the feedback types tested herein have been proven to provide significant functional benefits to the participants using a myoelectrically controlled robotic hand. This article, therefore, proposes a crucial conceptual and methodological addition to the evaluation of sensory feedback for upper limb prostheses - the internal model - as well as new types of feedback that promise to significantly and considerably improve functional prosthesis control.
Collapse
Affiliation(s)
- Leonard F Engels
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Ahmed W Shehata
- Division of Physical Medicine and Rehabilitation, Department of Medicine, University of Alberta, Edmonton, AB, Canada
| | - Erik J Scheme
- Department of Electrical and Computer Engineering, Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB, Canada
| | - Jonathon W Sensinger
- Department of Electrical and Computer Engineering, Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB, Canada
| | | |
Collapse
|
11
|
Shehata AW, Scheme EJ, Sensinger JW. Evaluating Internal Model Strength and Performance of Myoelectric Prosthesis Control Strategies. IEEE Trans Neural Syst Rehabil Eng 2019; 26:1046-1055. [PMID: 29752240 DOI: 10.1109/tnsre.2018.2826981] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
On-going developments in myoelectric prosthesis control have provided prosthesis users with an assortment of control strategies that vary in reliability and performance. Many studies have focused on improving performance by providing feedback to the user but have overlooked the effect of this feedback on internal model development, which is key to improve long-term performance. In this paper, the strength of internal models developed for two commonly used myoelectric control strategies: raw control with raw feedback (using a regression-based approach) and filtered control with filtered feedback (using a classifier-based approach), were evaluated using two psychometric measures: trial-by-trial adaptation and just-noticeable difference. The performance of both strategies was also evaluated using Schmidt's style target acquisition task. Results obtained from 24 able-bodied subjects showed that although filtered control with filtered feedback had better short-term performance in path efficiency ( ), raw control with raw feedback resulted in stronger internal model development ( ), which may lead to better long-term performance. Despite inherent noise in the control signals of the regression controller, these findings suggest that rich feedback associated with regression control may be used to improve human understanding of the myoelectric control system.
Collapse
|
12
|
Fu Q, Shao F, Santello M. Inter-Limb Transfer of Grasp Force Perception With Closed-Loop Hand Prosthesis. IEEE Trans Neural Syst Rehabil Eng 2019; 27:927-936. [PMID: 31021799 DOI: 10.1109/tnsre.2019.2911893] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Sensory feedback of grasp forces provides important information about physical interactions between the hand and objects, enabling both reactive and anticipatory neural control mechanisms. The numerous studies have shown artificial sensory feedback of various forms improves force control during grasping tasks by prosthetic hand users through a closed-feedback loop. However, little is known about how perceptual information is transferred between an intact limb and a closed-loop prosthetic limb, and the extent to which training inter-limb transfer may improve myoelectric prosthetic control. We addressed these gaps by using a contralateral force-matching task in which able-bodied participants were asked to generate grasp forces with their native hand, and then match it using the contralateral hand or a soft-synergy prosthetic hand worn on the contralateral arm that was coupled with a mechanotactile feedback device. We found that absolute matching error and matching time were greater when using the prosthetic system than the native hand. However, with contralateral specific training, subjects were able to produce similar relative matching error with the prosthetic system and the native hand, especially at the untrained force level. These findings suggest that an association can be established between the perception produced by the prosthetic limb and the contralateral intact limb, and provide novel insights about potential applications to training and design of the closed-loop prosthesis.
Collapse
|
13
|
Mastinu E, Clemente F, Sassu P, Aszmann O, Brånemark R, Håkansson B, Controzzi M, Cipriani C, Ortiz-Catalan M. Grip control and motor coordination with implanted and surface electrodes while grasping with an osseointegrated prosthetic hand. J Neuroeng Rehabil 2019; 16:49. [PMID: 30975158 PMCID: PMC6460734 DOI: 10.1186/s12984-019-0511-2] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2018] [Accepted: 03/05/2019] [Indexed: 11/13/2022] Open
Abstract
Background Replacement of a lost limb by an artificial substitute is not yet ideal. Resolution and coordination of motor control approximating that of a biological limb could dramatically improve the functionality of prosthetic devices, and thus reduce the gap towards a suitable limb replacement. Methods In this study, we investigated the control resolution and coordination exhibited by subjects with transhumeral amputation who were implanted with epimysial electrodes and an osseointegrated interface that provides bidirectional communication in addition to skeletal attachment (e-OPRA Implant System). We assessed control resolution and coordination in the context of routine and delicate grasping using the Pick and Lift and the Virtual Eggs Tests. Performance when utilizing implanted electrodes was compared with the standard-of-care technology for myoelectric prostheses, namely surface electrodes. Results Results showed that implanted electrodes provide superior controllability over the prosthetic terminal device compared to conventional surface electrodes. Significant improvements were found in the control of the grip force and its reliability during object transfer. However, these improvements failed to increase motor coordination, and surprisingly decreased the temporal correlation between grip and load forces observed with surface electrodes. We found that despite being more functional and reliable, prosthetic control via implanted electrodes still depended highly on visual feedback. Conclusions Our findings indicate that incidental sensory feedback (visual, auditory, and osseoperceptive in this case) is insufficient for restoring natural grasp behavior in amputees, and support the idea that supplemental tactile sensory feedback is needed to learn and maintain the motor tasks internal model, which could ultimately restore natural grasp behavior in subjects using prosthetic hands.
Collapse
Affiliation(s)
- Enzo Mastinu
- Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden.
| | - Francesco Clemente
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy.,Prensilia SRL, Pisa, Italy
| | - Paolo Sassu
- Department of Hand Surgery, Sahlgrenska University Hospital, Gothenburg, Sweden
| | - Oskar Aszmann
- Christian Doppler Laboratory for Restoration of Extremity Function, Department of Surgery, Medical University of Vienna, Vienna, Austria
| | - Rickard Brånemark
- Department of Orthopaedics, Gothenburg University, Gothenburg, Sweden
| | - Bo Håkansson
- Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Marco Controzzi
- The Biorobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | | | - Max Ortiz-Catalan
- Department of Electrical Engineering, Chalmers University of Technology, Gothenburg, Sweden
| |
Collapse
|
14
|
Myocontrol is closed-loop control: incidental feedback is sufficient for scaling the prosthesis force in routine grasping. J Neuroeng Rehabil 2018; 15:81. [PMID: 30176929 PMCID: PMC6122439 DOI: 10.1186/s12984-018-0422-7] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2018] [Accepted: 08/22/2018] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Sensory feedback is critical for grasping in able-bodied subjects. Consequently, closing the loop in upper-limb prosthetics by providing artificial sensory feedback to the amputee is expected to improve the prosthesis utility. Nevertheless, even though amputees rate the prospect of sensory feedback high, its benefits in daily life are still very much debated. We argue that in order to measure the potential functional benefit of artificial sensory feedback, the baseline open-loop performance needs to be established. METHODS The myoelectric control of naïve able-bodied subjects was evaluated during modulation of electromyographic signals (EMG task), and grasping with a prosthesis (Prosthesis task). The subjects needed to activate the wrist flexor muscles and close the prosthesis to reach a randomly selected target level (routine grasping). To assess the baseline performance, the tasks were performed with a different extent of implicit feedback (proprioception, prosthesis motion and sound). Finally, the prosthesis task was repeated with explicit visual force feedback. The subjects' ability to scale the prosthesis command/force was assessed by testing for a statistically significant increase in the median of the generated commands/forces between neighboring levels. The quality of control was evaluated by computing the median absolute error (MAE) with respect to the target. RESULTS The subjects could successfully scale their motor commands and generated prosthesis forces across target levels in all tasks, even with the least amount of implicit feedback (only muscle proprioception, EMG task). In addition, the deviation of the generated commands/forces from the target levels decreased with additional feedback. However, the increase in implicit feedback, from proprioception to prosthesis motion and sound, seemed to have a more substantial effect than the final introduction of explicit feedback. Explicit feedback improved the performance mainly at the higher target-force levels. CONCLUSIONS The study establishes the baseline performance of myoelectric control and prosthesis grasping force. The results demonstrate that even without additional feedback, naïve subjects can effectively modulate force with good accuracy with respect to that achieved when increasing the amount of feedback information.
Collapse
|
15
|
Shehata AW, Engels LF, Controzzi M, Cipriani C, Scheme EJ, Sensinger JW. Improving internal model strength and performance of prosthetic hands using augmented feedback. J Neuroeng Rehabil 2018; 15:70. [PMID: 30064477 PMCID: PMC6069837 DOI: 10.1186/s12984-018-0417-4] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2018] [Accepted: 07/17/2018] [Indexed: 11/24/2022] Open
Abstract
Background The loss of an arm presents a substantial challenge for upper limb amputees when performing activities of daily living. Myoelectric prosthetic devices partially replace lost hand functions; however, lack of sensory feedback and strong understanding of the myoelectric control system prevent prosthesis users from interacting with their environment effectively. Although most research in augmented sensory feedback has focused on real-time regulation, sensory feedback is also essential for enabling the development and correction of internal models, which in turn are used for planning movements and reacting to control variability faster than otherwise possible in the presence of sensory delays. Methods Our recent work has demonstrated that audio-augmented feedback can improve both performance and internal model strength for an abstract target acquisition task. Here we use this concept in controlling a robotic hand, which has inherent dynamics and variability, and apply it to a more functional grasp-and-lift task. We assessed internal model strength using psychophysical tests and used an instrumented Virtual Egg to assess performance. Results Results obtained from 14 able-bodied subjects show that a classifier-based controller augmented with audio feedback enabled stronger internal model (p = 0.018) and better performance (p = 0.028) than a controller without this feedback. Conclusions We extended our previous work and accomplished the first steps on a path towards bridging the gap between research and clinical usability of a hand prosthesis. The main goal was to assess whether the ability to decouple internal model strength and motion variability using the continuous audio-augmented feedback extended to real-world use, where the inherent mechanical variability and dynamics in the mechanisms may contribute to a more complicated interplay between internal model formation and motion variability. We concluded that benefits of using audio-augmented feedback for improving internal model strength of myoelectric controllers extend beyond a virtual target acquisition task to include control of a prosthetic hand.
Collapse
Affiliation(s)
- Ahmed W Shehata
- Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB, E3B 5A3, Canada. .,Department of Electrical and Computer Engineering, University of New Brunswick, Fredericton, NB, E3B 5A3, Canada. .,Division of Physical Medicine and Rehabilitation, Department of Medicine, University of Alberta, Edmonton, AB, T6G 2E1, Canada.
| | - Leonard F Engels
- Scuola Superiore Sant'Anna, The BioRobotics Institute, V.le R. Piaggio 34, 56025, Pontedera, PI, Italy
| | - Marco Controzzi
- Scuola Superiore Sant'Anna, The BioRobotics Institute, V.le R. Piaggio 34, 56025, Pontedera, PI, Italy
| | - Christian Cipriani
- Scuola Superiore Sant'Anna, The BioRobotics Institute, V.le R. Piaggio 34, 56025, Pontedera, PI, Italy
| | - Erik J Scheme
- Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB, E3B 5A3, Canada.,Department of Electrical and Computer Engineering, University of New Brunswick, Fredericton, NB, E3B 5A3, Canada
| | - Jonathon W Sensinger
- Institute of Biomedical Engineering, University of New Brunswick, Fredericton, NB, E3B 5A3, Canada.,Department of Electrical and Computer Engineering, University of New Brunswick, Fredericton, NB, E3B 5A3, Canada
| |
Collapse
|
16
|
Shehata AW, Scheme EJ, Sensinger JW. Audible Feedback Improves Internal Model Strength and Performance of Myoelectric Prosthesis Control. Sci Rep 2018; 8:8541. [PMID: 29867147 PMCID: PMC5986794 DOI: 10.1038/s41598-018-26810-w] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2017] [Accepted: 05/21/2018] [Indexed: 12/01/2022] Open
Abstract
Myoelectric prosthetic devices are commonly used to help upper limb amputees perform activities of daily living, however amputees still lack the sensory feedback required to facilitate reliable and precise control. Augmented feedback may play an important role in affecting both short-term performance, through real-time regulation, and long-term performance, through the development of stronger internal models. In this work, we investigate the potential tradeoff between controllers that enable better short-term performance and those that provide sufficient feedback to develop a strong internal model. We hypothesize that augmented feedback may be used to mitigate this tradeoff, ultimately improving both short and long-term control. We used psychometric measures to assess the internal model developed while using a filtered myoelectric controller with augmented audio feedback, imitating classification-based control but with augmented regression-based feedback. In addition, we evaluated the short-term performance using a multi degree-of-freedom constrained-time target acquisition task. Results obtained from 24 able-bodied subjects show that an augmented feedback control strategy using audio cues enables the development of a stronger internal model than the filtered control with filtered feedback, and significantly better path efficiency than both raw and filtered control strategies. These results suggest that the use of augmented feedback control strategies may improve both short-term and long-term performance.
Collapse
Affiliation(s)
- Ahmed W Shehata
- University of New Brunswick, Electrical and Computer Engineering, Fredericton, E3B5A3, Canada.
- Institute of Biomedical Engineering, Fredericton, E3B5A3, Canada.
| | - Erik J Scheme
- University of New Brunswick, Electrical and Computer Engineering, Fredericton, E3B5A3, Canada
- Institute of Biomedical Engineering, Fredericton, E3B5A3, Canada
| | - Jonathon W Sensinger
- University of New Brunswick, Electrical and Computer Engineering, Fredericton, E3B5A3, Canada
- Institute of Biomedical Engineering, Fredericton, E3B5A3, Canada
| |
Collapse
|
17
|
Markovic M, Schweisfurth MA, Engels LF, Bentz T, Wüstefeld D, Farina D, Dosen S. The clinical relevance of advanced artificial feedback in the control of a multi-functional myoelectric prosthesis. J Neuroeng Rehabil 2018; 15:28. [PMID: 29580245 PMCID: PMC5870217 DOI: 10.1186/s12984-018-0371-1] [Citation(s) in RCA: 70] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2017] [Accepted: 02/22/2018] [Indexed: 11/26/2022] Open
Abstract
Background To effectively replace the human hand, a prosthesis should seamlessly respond to user intentions but also convey sensory information back to the user. Restoration of sensory feedback is rated highly by the prosthesis users, and feedback is critical for grasping in able-bodied subjects. Nonetheless, the benefits of feedback in prosthetics are still debated. The lack of consensus is likely due to the complex nature of sensory feedback during prosthesis control, so that its effectiveness depends on multiple factors (e.g., task complexity, user learning). Methods We evaluated the impact of these factors with a longitudinal assessment in six amputee subjects, using a clinical setup (socket, embedded control) and a range of tasks (box and blocks, block turn, clothespin and cups relocation). To provide feedback, we have proposed a novel vibrotactile stimulation scheme capable of transmitting multiple variables from a multifunction prosthesis. The subjects wore a bracelet with four by two uniformly placed vibro-tactors providing information on contact, prosthesis state (active function), and grasping force. The subjects also completed a questionnaire for the subjective evaluation of the feedback. Results The tests demonstrated that feedback was beneficial only in the complex tasks (block turn, clothespin and cups relocation), and that the training had an important, task-dependent impact. In the clothespin relocation and block turn tasks, training allowed the subjects to establish successful feedforward control, and therefore, the feedback became redundant. In the cups relocation task, however, the subjects needed some training to learn how to properly exploit the feedback. The subjective evaluation of the feedback was consistently positive, regardless of the objective benefits. These results underline the multifaceted nature of closed-loop prosthesis control as, depending on the context, the same feedback interface can have different impact on performance. Finally, even if the closed-loop control does not improve the performance, it could be beneficial as it seems to improve the subjective experience. Conclusions Therefore, in this study we demonstrate, for the first time, the relevance of an advanced, multi-variable feedback interface for dexterous, multi-functional prosthesis control in a clinically relevant setting. Electronic supplementary material The online version of this article (10.1186/s12984-018-0371-1) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Marko Markovic
- Department for Trauma Surgery, Orthopedics and Plastic Surgery, University Medical Center Göttingen, Von-Siebold-Str. 3, 37075, Göttingen, Germany.
| | - Meike A Schweisfurth
- Department for Trauma Surgery, Orthopedics and Plastic Surgery, University Medical Center Göttingen, Von-Siebold-Str. 3, 37075, Göttingen, Germany.,Faculty of Life Sciences, University of Applied Sciences (HAW), Ulmenliet 20, 21033, Hamburg, Germany
| | - Leonard F Engels
- Department for Trauma Surgery, Orthopedics and Plastic Surgery, University Medical Center Göttingen, Von-Siebold-Str. 3, 37075, Göttingen, Germany.,Biorobotics Institute, Scuola Superiore Sant'Anna, Viale R. Piaggio, 34, 56025, Pontedera (PI), Italy
| | | | - Daniela Wüstefeld
- Otto Bock Competence Center, Otto Bock HealthCare GmbH, 37115, Duderstadt, Germany
| | - Dario Farina
- Department for Trauma Surgery, Orthopedics and Plastic Surgery, University Medical Center Göttingen, Von-Siebold-Str. 3, 37075, Göttingen, Germany.,Department of Bioengineering, Imperial College London, SW7 2AZ, London, UK
| | - Strahinja Dosen
- Department for Trauma Surgery, Orthopedics and Plastic Surgery, University Medical Center Göttingen, Von-Siebold-Str. 3, 37075, Göttingen, Germany.,The Faculty of Medicine, Department of Health Science and Technology Center for Sensory-Motor Interaction, Aalborg University, Aalborg, Denmark
| |
Collapse
|
18
|
Hichert M, Plettenburg DH. Ipsilateral Scapular Cutaneous Anchor System: An alternative for the harness in body-powered upper-limb prostheses. Prosthet Orthot Int 2018; 42:101-106. [PMID: 28318402 PMCID: PMC5808826 DOI: 10.1177/0309364617691624] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/30/2016] [Accepted: 01/04/2017] [Indexed: 02/03/2023]
Abstract
BACKGROUND Body-powered prosthesis users frequently complain about the poor cosmesis and comfort of the traditional shoulder harness. The Ipsilateral Scapular Cutaneous Anchor System offers an alternative, but it remains unclear to what extent it affects the perception and control of cable operation forces compared to the traditional shoulder harness. OBJECTIVE To compare cable force perception and control with the figure-of-nine harness versus the Ipsilateral Scapular Cutaneous Anchor System and to investigate force perception and control at different force levels. STUDY DESIGN Experimental trial. METHODS Ten male able-bodied subjects completed a cable force reproduction task at four force levels in the range of 10-40 N using the figure-of-nine harness and the Anchor System. Perception and control of cable operating forces were quantified by the force reproduction error and the force variability. RESULTS In terms of force reproduction error and force variability, the subjects did not behave differently when using the two systems. The smallest force reproduction error and force variability were found at the smallest target force level of 10 N. CONCLUSION The Anchor System performs no differently than the traditional figure-of-nine harness in terms of force perception and control, making it a viable alternative. Furthermore, users perceive and control low operation forces better than high forces. Clinical relevance The Ipsilateral Scapular Cutaneous Anchor System offers an alternative for the traditional harness in terms of cable operation force perception and control and should therefore be considered for clinical use. Low cable operation forces increase the perception and control abilities of users.
Collapse
Affiliation(s)
- Mona Hichert
- Faculty Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, The Netherlands
| | - Dick H. Plettenburg
- Faculty Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, The Netherlands
| |
Collapse
|
19
|
Fu Q, Santello M. Improving Fine Control of Grasping Force during Hand-Object Interactions for a Soft Synergy-Inspired Myoelectric Prosthetic Hand. Front Neurorobot 2018; 11:71. [PMID: 29375360 PMCID: PMC5767584 DOI: 10.3389/fnbot.2017.00071] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Accepted: 12/18/2017] [Indexed: 11/29/2022] Open
Abstract
The concept of postural synergies of the human hand has been shown to potentially reduce complexity in the neuromuscular control of grasping. By merging this concept with soft robotics approaches, a multi degrees of freedom soft-synergy prosthetic hand [SoftHand-Pro (SHP)] was created. The mechanical innovation of the SHP enables adaptive and robust functional grasps with simple and intuitive myoelectric control from only two surface electromyogram (sEMG) channels. However, the current myoelectric controller has very limited capability for fine control of grasp forces. We addressed this challenge by designing a hybrid-gain myoelectric controller that switches control gains based on the sensorimotor state of the SHP. This controller was tested against a conventional single-gain (SG) controller, as well as against native hand in able-bodied subjects. We used the following tasks to evaluate the performance of grasp force control: (1) pick and place objects with different size, weight, and fragility levels using power or precision grasp and (2) squeezing objects with different stiffness. Sensory feedback of the grasp forces was provided to the user through a non-invasive, mechanotactile haptic feedback device mounted on the upper arm. We demonstrated that the novel hybrid controller enabled superior task completion speed and fine force control over SG controller in object pick-and-place tasks. We also found that the performance of the hybrid controller qualitatively agrees with the performance of native human hands.
Collapse
Affiliation(s)
- Qiushi Fu
- Neural Control of Movement Laboratory, School of Biological and Health Systems Engineering, Arizona State University, Tempe, AZ, United States.,Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL, United States
| | - Marco Santello
- Neural Control of Movement Laboratory, School of Biological and Health Systems Engineering, Arizona State University, Tempe, AZ, United States
| |
Collapse
|
20
|
Schweitzer W, Thali MJ, Egger D. Case-study of a user-driven prosthetic arm design: bionic hand versus customized body-powered technology in a highly demanding work environment. J Neuroeng Rehabil 2018; 15:1. [PMID: 29298708 PMCID: PMC5751817 DOI: 10.1186/s12984-017-0340-0] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2017] [Accepted: 12/11/2017] [Indexed: 12/17/2022] Open
Abstract
BACKGROUND Prosthetic arm research predominantly focuses on "bionic" but not body-powered arms. However, any research orientation along user needs requires sufficiently precise workplace specifications and sufficiently hard testing. Forensic medicine is a demanding environment, also physically, also for non-disabled people, on several dimensions (e.g., distances, weights, size, temperature, time). METHODS As unilateral below elbow amputee user, the first author is in a unique position to provide direct comparison of a "bionic" myoelectric iLimb Revolution (Touch Bionics) and a customized body-powered arm which contains a number of new developments initiated or developed by the user: (1) quick lock steel wrist unit; (2) cable mount modification; (3) cast shape modeled shoulder anchor; (4) suspension with a soft double layer liner (Ohio Willowwood) and tube gauze (Molnlycke) combination. The iLimb is mounted on an epoxy socket; a lanyard fixed liner (Ohio Willowwood) contains magnetic electrodes (Liberating Technologies). An on the job usage of five years was supplemented with dedicated and focused intensive two-week use tests at work for both systems. RESULTS The side-by-side comparison showed that the customized body-powered arm provides reliable, comfortable, effective, powerful as well as subtle service with minimal maintenance; most notably, grip reliability, grip force regulation, grip performance, center of balance, component wear down, sweat/temperature independence and skin state are good whereas the iLimb system exhibited a number of relevant serious constraints. CONCLUSIONS Research and development of functional prostheses may want to focus on body-powered technology as it already performs on manually demanding and heavy jobs whereas eliminating myoelectric technology's constraints seems out of reach. Relevant testing could be developed to help expediting this. This is relevant as Swiss disability insurance specifically supports prostheses that enable actual work integration. Myoelectric and cosmetic arm improvement may benefit from a less forgiving focus on perfecting anthropomorphic appearance.
Collapse
Affiliation(s)
- Wolf Schweitzer
- Zurich Institute of Forensic Medicine, University of Zurich, Winterthurerstrasse 190, Zürich, Switzerland.
| | - Michael J Thali
- Zurich Institute of Forensic Medicine, University of Zurich, Winterthurerstrasse 190, Zürich, Switzerland
| | - David Egger
- Balgrist Tec, Forchstrasse 340, Zürich, Switzerland
| |
Collapse
|
21
|
Strbac M, Isakovic M, Belic M, Popovic I, Simanic I, Farina D, Keller T, Dosen S. Short- and Long-Term Learning of Feedforward Control of a Myoelectric Prosthesis with Sensory Feedback by Amputees. IEEE Trans Neural Syst Rehabil Eng 2017; 25:2133-2145. [PMID: 28600254 DOI: 10.1109/tnsre.2017.2712287] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Human motor control relies on a combination of feedback and feedforward strategies. The aim of this study was to longitudinally investigate artificial somatosensory feedback and feedforward control in the context of grasping with myoelectric prosthesis. Nine amputee subjects performed routine grasping trials, with the aim to produce four levels of force during four blocks of 60 trials across five days. The electrotactile force feedback was provided in the second and third block using multipad electrode and spatial coding. The first baseline and last validation block (open-loop control) evaluated the effects of long- (across sessions) and short-term (within session) learning, respectively. The outcome measures were the absolute error between the generated and target force, and the number of force saturations. The results demonstrated that the electrotactile feedback improved the performance both within and across sessions. In the validation block, the performance did not significantly decrease and the quality of open-loop control (baseline) improved across days, converging to the performance characterizing closed-loop control. This paper provides important insights into the feedback and feedforward processes in prosthesis control, contributing to the better understanding of the role and design of feedback in prosthetic systems.
Collapse
|
22
|
Tactile feedback is an effective instrument for the training of grasping with a prosthesis at low- and medium-force levels. Exp Brain Res 2017; 235:2547-2559. [PMID: 28550423 PMCID: PMC5502062 DOI: 10.1007/s00221-017-4991-7] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2016] [Accepted: 05/17/2017] [Indexed: 10/26/2022]
Abstract
Grasping is a complex task routinely performed in an anticipatory (feedforward) manner, where sensory feedback is responsible for learning and updating the internal model of grasp dynamics. This study aims at evaluating whether providing a proportional tactile force feedback during the myoelectric control of a prosthesis facilitates learning a stable internal model of the prosthesis force control. Ten able-bodied subjects controlled a sensorized myoelectric prosthesis performing four blocks of consecutive grasps at three levels of target force (30, 50, and 70%), repeatedly closing the fully opened hand. In the first and third block, the subjects received tactile and visual feedback, respectively, while during the second and fourth block, the feedback was removed. The subjects also performed an additional block with no feedback 1 day after the training (Retest). The median and interquartile range of the generated forces was computed to assess the accuracy and precision of force control. The results demonstrated that the feedback was indeed an effective instrument for the training of prosthesis control. After the training, the subjects were still able to accurately generate the desired force for the low and medium target (30 and 50% of maximum force available in a prosthesis), despite the feedback being removed within the session and during the retest (low target force). However, the training was substantially less successful for high forces (70% of prosthesis maximum force), where subjects exhibited a substantial loss of accuracy as soon as the feedback was removed. The precision of control decreased with higher forces and it was consistent across conditions, determined by an intrinsic variability of repeated myoelectric grasping. This study demonstrated that the subject could rely on the tactile feedback to adjust the motor command to the prosthesis across trials. The subjects adjusted the mean level of muscle activation (accuracy), whereas the precision could not be modulated as it depends on the intrinsic myoelectric variability. They were also able to maintain the feedforward command even after the feedback was removed, demonstrating thereby a stable learning, but the retention depended on the level of the target force. This is an important insight into the role of feedback as an instrument for learning of anticipatory prosthesis force control.
Collapse
|
23
|
Hichert M, Abbink DA, Kyberd PJ, Plettenburg DH. High Cable Forces Deteriorate Pinch Force Control in Voluntary-Closing Body-Powered Prostheses. PLoS One 2017; 12:e0169996. [PMID: 28099454 PMCID: PMC5242472 DOI: 10.1371/journal.pone.0169996] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2016] [Accepted: 12/27/2016] [Indexed: 11/28/2022] Open
Abstract
Background It is generally asserted that reliable and intuitive control of upper-limb prostheses requires adequate feedback of prosthetic finger positions and pinch forces applied to objects. Body-powered prostheses (BPPs) provide the user with direct proprioceptive feedback. Currently available BPPs often require high cable operation forces, which complicates control of the forces at the terminal device. The aim of this study is to quantify the influence of high cable forces on object manipulation with voluntary-closing prostheses. Method Able-bodied male subjects were fitted with a bypass-prosthesis with low and high cable force settings for the prehensor. Subjects were requested to grasp and transfer a collapsible object as fast as they could without dropping or breaking it. The object had a low and a high breaking force setting. Results Subjects conducted significantly more successful manipulations with the low cable force setting, both for the low (33% more) and high (50%) object’s breaking force. The time to complete the task was not different between settings during successful manipulation trials. Conclusion High cable forces lead to reduced pinch force control during object manipulation. This implies that low cable operation forces should be a key design requirement for voluntary-closing BPPs.
Collapse
Affiliation(s)
- Mona Hichert
- Delft Institute of Prosthetics and Orthotics, Department of Biomechanical Engineering, Delft University of Technology, Delft, The Netherlands
- * E-mail:
| | - David A. Abbink
- Delft Haptics Lab, Department of Biomechanical Engineering, Delft University of Technology, Delft, The Netherlands
| | - Peter J. Kyberd
- Institute of Biomedical Engineering University of New Brunswick, Fredericton, Canada
- Department of Engineering Science, University of Greenwich, Chatham Maritime, United Kingdom
| | - Dick H. Plettenburg
- Delft Institute of Prosthetics and Orthotics, Department of Biomechanical Engineering, Delft University of Technology, Delft, The Netherlands
| |
Collapse
|
24
|
Huinink LHB, Bouwsema H, Plettenburg DH, van der Sluis CK, Bongers RM. Learning to use a body-powered prosthesis: changes in functionality and kinematics. J Neuroeng Rehabil 2016; 13:90. [PMID: 27716254 PMCID: PMC5054596 DOI: 10.1186/s12984-016-0197-7] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2015] [Accepted: 09/27/2016] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND Little is known about action-perception learning processes underlying prosthetic skills in body-powered prosthesis users. Body-powered prostheses are controlled through a harness connected by a cable that might provide for limited proprioceptive feedback. This study aims to test transfer of training basic tasks to functional tasks and to describe the changes over time in kinematics of basic tasks of novice body-powered prosthesis users. METHODS Thirty able-bodied participants and 17 controls participated in the study, using a body-powered prosthetic simulator. Participants in the training group were divided over four groups and practiced during a 2-week-period either direct grasping, indirect grasping, fixation, or a combination of these tasks. Deformable objects with different compliances had to be manipulated while kinematic variables and grip force control were assessed. Functional performance was measured with the Southampton Hand Assessment Procedure (SHAP) prior to and after the training sessions, and after 2 weeks and 3 months retention. The control group only performed the SHAP tests. RESULTS All four training groups and the control group improved on the SHAP, also after a period of non-use. Type of training had a small but significant influence on the improvements of the SHAP score. On a kinematic level movement times decreased and hook closing velocities increased over time. The indirect grasping group showed significantly shorter plateau times than the other training groups. Grip force control only improved a little over training. CONCLUSIONS Training action-perception couplings of body-powered prosthesis in basic tasks transferred to functional tasks and this lasted after a period of non-use. During training movement times decreased and the indirect grasping group showed advantages. It is advisable to start body-powered training with indirect grasping tasks but also to practice hook-object orientations.
Collapse
Affiliation(s)
- Laura H. B. Huinink
- Center for Human Movement Sciences, University of Groningen, University Medical Center Groningen, UMCG sector F, FA 23, PO Box 196, Groningen, NL-9700 AD The Netherlands
| | - Hanneke Bouwsema
- Adelante Rehabilitation Centre, Centre of Expertise in Rehabilitation and Audiology, Hoensbroek, The Netherlands
- Department of Rehabilitation Medicine, Research School CAPHRI, Maastricht University, Maastricht, The Netherlands
| | - Dick H. Plettenburg
- Department of BioMechanical Engineering, Faculty of Mechanical, Maritime, and Materials Engineering, Delft University of Technology, Delft, The Netherlands
| | - Corry K. van der Sluis
- Center for Rehabilitation, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Raoul M. Bongers
- Center for Human Movement Sciences, University of Groningen, University Medical Center Groningen, UMCG sector F, FA 23, PO Box 196, Groningen, NL-9700 AD The Netherlands
| |
Collapse
|
25
|
de Boer E, Romkema S, Cutti AG, Brouwers MA, Bongers RM, van der Sluis CK. Intermanual Transfer Effects in Below-Elbow Myoelectric Prosthesis Users. Arch Phys Med Rehabil 2016; 97:1924-1930. [PMID: 27240431 DOI: 10.1016/j.apmr.2016.04.021] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2015] [Revised: 04/28/2016] [Accepted: 04/30/2016] [Indexed: 11/15/2022]
Abstract
OBJECTIVES To determine intermanual transfer effects in patients with a below-elbow amputation using a myoelectric prosthesis and to establish whether laterality affects these effects. DESIGN Case-control. SETTING A standardized setting in a rehabilitation clinic. PARTICIPANTS A convenience sample (N=44) of experienced myoelectric prosthesis users (n=22) and matched controls (n=22). Controls were matched on sex, age (±5y), and hand dominance. INTERVENTIONS Both the experienced group and the control group performed several tasks using a prosthesis simulator attached to their nonaffected arm. MAIN OUTCOME MEASURES Movement time, force control, Box and Block test (BBT) scores, and duration of hand opening. RESULTS Movement times of myoelectric prosthesis users were shorter, and these users had significantly higher BBT scores and shorter hand opening durations than those of controls. No intermanual transfer effects on force control and no laterality effects were found. CONCLUSIONS Intermanual transfer effects were present in experienced myoelectric prosthesis users with a below-elbow amputation, independent of laterality. These findings support the clinical relevance of intermanual transfer training, which may facilitate persons with an upper limb amputation to start training directly after the amputation.
Collapse
Affiliation(s)
- Errit de Boer
- Department of Rehabilitation Medicine, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Sietske Romkema
- Department of Rehabilitation Medicine, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Andrea G Cutti
- Italian Workers' Compensation Authority, Vigorso di Budrio, Bologna, Italy
| | | | - Raoul M Bongers
- Center of Human Movement Sciences, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Corry K van der Sluis
- Department of Rehabilitation Medicine, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.
| |
Collapse
|
26
|
Dosen S, Markovic M, Wille N, Henkel M, Koppe M, Ninu A, Frömmel C, Farina D. Building an internal model of a myoelectric prosthesis via closed-loop control for consistent and routine grasping. Exp Brain Res 2015; 233:1855-65. [PMID: 25804864 DOI: 10.1007/s00221-015-4257-1] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2014] [Accepted: 03/11/2015] [Indexed: 10/23/2022]
Abstract
Prosthesis users usually agree that myoelectric prostheses should be equipped with somatosensory feedback. However, the exact role of feedback and potential benefits are still elusive. The current study investigates the nature of human control processes within a specific context of routine grasping. Although the latter includes a fast feedforward control of the grasping force, the assumption was that the feedback would still be useful; it would communicate the outcome of the grasping trial, which the subjects could use to learn an internal model of feedforward control. Nine able-bodied subjects produced repeatedly a desired level of grasping force using different control configurations: feedback versus no-feedback, virtual versus real prosthetic hand, and joystick versus myocontrol. The outcome measures were the median and dispersion of the relative force errors. The results demonstrated that the feedback was successful in limiting the variability of the routine grasping due to uncertainties in the system and/or the command interface. The internal models of feedforward control could be employed by the subjects to control the prosthesis without the loss of performance even after the force feedback was removed. The models were, however, unstable over time, especially with myocontrol. Overall, the study demonstrates that the prosthesis system can be learned by the subjects using feedback. The feedback is also essential to maintain the model, and it could be delivered intermittently. This approach has practical advantages, but the level to which this mechanism can be truly exploited in practice depends directly on the consistency of the prosthesis control interface.
Collapse
Affiliation(s)
- Strahinja Dosen
- Department of Neurorehabilitation Engineering, University Medical Center Goettingen, Georg-August University, Von-Siebold-Str. 6, 37075, Göttingen, Germany
| | | | | | | | | | | | | | | |
Collapse
|