Task-Oriented Gaming for Transfer to Prosthesis Use

Assessing the effectiveness of serious game training designed to assist in upper limb prothesis rehabilitation

Introduction

Controlling a myoelectric upper limb prosthesis is difficult, therefore training is required. Since training with serious games showed promising results, the current paper focuses on game design and its effectivity for transfer between in-game skill to actual prosthesis use for proportional control of hand opening and control of switching between grips. We also examined training duration and individual differences.

Method

Thirty-six participants were randomly assigned to one of three groups: a task-specific serious game training group, a non-task-specific serious game training group and a control group. Each group performed a pre-test, mid-test and a post-test with five training sessions between each test moment. Test sessions assessed proportional control using the Cylinder test, a test designed to measure scaling of hand aperture during grabbing actions, and the combined use of proportional and switch control using the Clothespin Relocation Test, part of the Southampton Hand Assessment Procedure and Tray Test. Switch control was assessed during training by measuring amplitude difference and phasing of co-contraction triggers.

Results

Differences between groups over test sessions were observed for proportional control tasks, however there was lack of structure in these findings. Maximum aperture changed with test moment and some participants adjusted maximum aperture for smaller objects. For proportional and switch control tasks no differences between groups were observed. The effect of test moment suggests a testing effect. For learning switch control, an overall improvement across groups was found in phasing of the co-contraction peaks. Importantly, individual differences were found in all analyses.

Conclusion

As improvements over test sessions were found, but no relevant differences between groups were revealed, we conclude that transfer effects from game training to actual prosthesis use did not take place. Task specificity nor training duration had effects on outcomes. Our results imply testing effects instead of transfer effects, in which individual differences played a significant role. How transfer from serious game training in upper limb prosthesis use can be enhanced, needs further attention.

Current status and clinical perspectives of extended reality for myoelectric prostheses: review

Training with "Extended Reality" or X-Reality (XR) systems can undoubtedly enhance the control of the myoelectric prostheses. However, there is no consensus on which factors improve the efficiency of skill transfer from virtual training to actual prosthesis abilities. This review examines the current status and clinical applications of XR in the field of myoelectric prosthesis training and analyses possible influences on skill migration. We have conducted a thorough search on databases in the field of prostheses using keywords such as extended reality, virtual reality and serious gaming. Our scoping review encompassed relevant applications, control methods, performance evaluation and assessment metrics. Our findings indicate that the implementation of XR technology for myoelectric rehabilitative training on prostheses provides considerable benefits. Additionally, there are numerous standardised methods available for evaluating training effectiveness. Recently, there has been a surge in the number of XR-based training tools for myoelectric prostheses, with an emphasis on user engagement and virtual training evaluation. Insufficient attention has been paid to significant limitations in the behaviour, functionality, and usage patterns of XR and myoelectric prostheses, potentially obstructing the transfer of skills and prospects for clinical application. Improvements are recommended in four critical areas: activities of daily living, training strategies, feedback, and the alignment of the virtual environment with the physical devices.

Cortical Reorganization after Limb Loss: Bridging the Gap between Basic Science and Clinical Recovery

Despite the increasing incidence and prevalence of amputation across the globe, individuals with acquired limb loss continue to struggle with functional recovery and chronic pain. A more complete understanding of the motor and sensory remodeling of the peripheral and central nervous system that occurs postamputation may help advance clinical interventions to improve the quality of life for individuals with acquired limb loss. The purpose of this article is to first provide background clinical context on individuals with acquired limb loss and then to provide a comprehensive review of the known motor and sensory neural adaptations from both animal models and human clinical trials. Finally, the article bridges the gap between basic science researchers and clinicians that treat individuals with limb loss by explaining how current clinical treatments may restore function and modulate phantom limb pain using the underlying neural adaptations described above. This review should encourage the further development of novel treatments with known neurological targets to improve the recovery of individuals postamputation.Significance Statement In the United States, 1.6 million people live with limb loss; this number is expected to more than double by 2050. Improved surgical procedures enhance recovery, and new prosthetics and neural interfaces can replace missing limbs with those that communicate bidirectionally with the brain. These advances have been fairly successful, but still most patients experience persistent problems like phantom limb pain, and others discontinue prostheses instead of learning to use them daily. These problematic patient outcomes may be due in part to the lack of consensus among basic and clinical researchers regarding the plasticity mechanisms that occur in the brain after amputation injuries. Here we review results from clinical and animal model studies to bridge this clinical-basic science gap.

Training prosthesis users to switch between modes of a multi-articulating prosthetic hand

PURPOSE

Producing triggers to switch between modes of myoelectric prosthetic hands has proven to be difficult. We evaluated whether digital training methods were feasible in individuals with an upper limb defect (ULD), whether myosignals in these individuals differ from those of non-impaired individuals and whether acquired skills transfer to prosthesis use.

MATERIALS AND METHODS

Two groups participated in a 9-day pre-test-post-test design study with seven 45-minute training sessions. One group trained using a serious game, the other with their myosignals digitally displayed. Both groups also trained using a prosthesis. The pre- and post-tests consisted of an adapted Clothespin Relocation Test and the spherical subset of the Southampton Hand Assessment Procedure. After the post-test, the System Usability Scale (SUS) was administered. Clinically relevant performance measures and myosignal features were analysed.

RESULTS

Four individuals with a ULD participated. SUS-scores deemed both training methods feasible. Three participants produced only a few correct triggers. Myosignals features indicated larger variability for individuals with a ULD compared to non-impaired individuals (previously published data [1]). Three participants indicated transfer of skill.

CONCLUSIONS

Even though both training methods were deemed feasible and most participants showed transfer, seven training sessions were insufficient to learn reliable switching behaviour.Trial registration: The study was approved by the medical ethics committee of the University Medical Center Groningen (METc 2018.268).Implications for rehabilitationSwitching between pre-programmed modes of a myoelectric prosthetic hand can be learned, however it does require training.Serious games can be considered useful training tools for trigger production in early phases of myoelectric prosthesis control training.In order to evoke transfer of skill from training to daily life both task-specificity and focus of attention during training should be taken into account.

A Review on the Usability, Flexibility, Affinity, and Affordability of Virtual Technology for Rehabilitation Training of Upper Limb Amputees

(1) Background: Prosthetic rehabilitation is essential for upper limb amputees to regain their ability to work. However, the abandonment rate of prosthetics is higher than 50% due to the high cost of rehabilitation. Virtual technology shows potential for improving the availability and cost-effectiveness of prosthetic rehabilitation. This article systematically reviews the application of virtual technology for the prosthetic rehabilitation of upper limb amputees. (2) Methods: We followed PRISMA review guidance, STROBE, and CASP to evaluate the included articles. Finally, 17 articles were screened from 22,609 articles. (3) Results: This study reviews the possible benefits of using virtual technology from four aspects: usability, flexibility, psychological affinity, and long-term affordability. Three significant challenges are also discussed: realism, closed-loop control, and multi-modality integration. (4) Conclusions: Virtual technology allows for flexible and configurable control rehabilitation, both during hospital admissions and after discharge, at a relatively low cost. The technology shows promise in addressing the critical barrier of current prosthetic training issues, potentially improving the practical availability of prosthesis techniques for upper limb amputees.

Controlling Upper Limb Prostheses Using Sonomyography (SMG): A Review

This paper presents a critical review and comparison of the results of recently published studies in the fields of human-machine interface and the use of sonomyography (SMG) for the control of upper limb prothesis. For this review paper, a combination of the keywords "Human Machine Interface", "Sonomyography", "Ultrasound", "Upper Limb Prosthesis", "Artificial Intelligence", and "Non-Invasive Sensors" was used to search for articles on Google Scholar and PubMed. Sixty-one articles were found, of which fifty-nine were used in this review. For a comparison of the different ultrasound modes, feature extraction methods, and machine learning algorithms, 16 articles were used. Various modes of ultrasound devices for prosthetic control, various machine learning algorithms for classifying different hand gestures, and various feature extraction methods for increasing the accuracy of artificial intelligence used in their controlling systems are reviewed in this article. The results of the review article show that ultrasound sensing has the potential to be used as a viable human-machine interface in order to control bionic hands with multiple degrees of freedom. Moreover, different hand gestures can be classified by different machine learning algorithms trained with extracted features from collected data with an accuracy of around 95%.

Kinematic analysis of impairments and compensatory motor behavior during prosthetic grasping in below-elbow amputees

After a major upper limb amputation, the use of myoelectric prosthesis as assistive devices is possible. However, these prostheses remain quite difficult to control for grasping and manipulation of daily life objects. The aim of the present observational case study is to document the kinematics of grasping in a group of 10 below-elbow amputated patients fitted with a myoelectric prosthesis in order to describe and better understand their compensatory strategies. They performed a grasping to lift task toward 3 objects (a mug, a cylinder and a cone) placed at two distances within the reaching area in front of the patients. The kinematics of the trunk and upper-limb on the non-amputated and prosthetic sides were recorded with 3 electromagnetic Polhemus sensors placed on the hand, the forearm (or the corresponding site on the prosthesis) and the ipsilateral acromion. The 3D position of the elbow joint and the shoulder and elbow angles were calculated thanks to a preliminary calibration of the sensor position. We examined first the effect of side, distance and objects with non-parametric statistics. Prosthetic grasping was characterized by severe temporo-spatial impairments consistent with previous clinical or kinematic observations. The grasping phase was prolonged and the reaching and grasping components uncoupled. The 3D hand displacement was symmetrical in average, but with some differences according to the objects. Compensatory strategies involved the trunk and the proximal part of the upper-limb, as shown by a greater 3D displacement of the elbow for close target and a greater forward displacement of the acromion, particularly for far targets. The hand orientation at the time of grasping showed marked side differences with a more frontal azimuth, and a more "thumb-up" roll. The variation of hand orientation with the object on the prosthetic side, suggested that the lack of finger and wrist mobility imposed some adaptation of hand pose relative to the object. The detailed kinematic analysis allows more insight into the mechanisms of the compensatory strategies that could be due to both increased distal or proximal kinematic constraints. A better knowledge of those compensatory strategies is important for the prevention of musculoskeletal disorders and the development of innovative prosthetics.

Extended Reality "X-Reality" for Prosthesis Training of Upper-Limb Amputees: A Review on Current and Future Clinical Potential

The rejection rates of upper-limb prosthetic devices in adults are high, currently averaging 26% and 23% for body-powered and electric devices, respectively. While many factors influence acceptance, prosthesis training methods relying on novel virtual reality systems have been cited as a critical factor capable of increasing the likelihood of long-term, full-time use. Despite that, these implementations have not yet garnered widespread traction in the clinical setting, and their use remains immaterial. This review aims to explore the reasons behind this situation by identifying trends in existing research that seek to advance Extended Reality "X-Reality" systems for the sake of upper-limb prosthesis rehabilitation and, secondly, analyzing barriers and presenting potential pathways to deployment for successful adoption in the future. The search yielded 42 research papers that were divided into two categories. The first category included articles that focused on the technical aspect of virtual prosthesis training. Articles in the second category utilize user evaluation procedures to ensure applicability in a clinical environment. The review showed that 75% of articles that conducted whole system testing experimented with non-immersive virtual systems. Furthermore, there is a shortage of experiments performed with amputee subjects. From the large-scale studies analyzed, 71% of those recruited solely able-bodied participants. This paper shows that X-Reality technologies for prosthesis rehabilitation of upper-limb amputees carry significant benefits. Nevertheless, much still must be done so that the technology reaches widespread clinical use.

State of the art of prosthesis simulators for the upper limb: A narrative review

BACKGROUND

Research into prosthesis training and design puts a burden on the small population of people with upper-limb absence who can participate in these studies. One solution is to use a prosthetic hand simulator, which allows for attaching a hand prosthesis to an intact limb. However, whether the results of prosthesis simulator studies can be translated to people with upper-limb absence using a hand prosthesis is unclear.

OBJECTIVE

To review the literature on prosthetic hand simulators, provide an overview of current designs, and highlight the differences and similarities between prosthesis simulators and traditional prostheses.

METHODS

A Boolean combination of keywords was used to search 3 electronic databases: PubMed, Scopus and Web of Science. Relevant articles in English were selected.

RESULTS

In total, 52 papers were included in the review, and an overview of the state of the art was presented. We identified the key differences between prosthesis simulators and traditional prostheses as the position of the terminal device and the available degrees of freedom of the arm and (prosthetic) wrist.

CONCLUSIONS

This paper provides an overview of prosthesis simulator designs over the past 27 years and an overview of the similarities and differences between prosthesis simulators and prostheses. The literature does not provide enough evidence to establish whether the results obtained from simulator studies could be translated to prostheses. A recommendation for future simulator design is to constrain pro- and supination of the forearm of anatomically intact participants and add a prosthetic wrist that can pro- and supinate. Additional research is required to find the ideal terminal device position for a prosthesis simulator with respect to the person's hand.

The efficacy of robot-assisted training for patients with upper limb amputations who use myoelectric prostheses: a randomized controlled pilot study

The aim of this pilot study was to investigate whether a movement therapy robot can improve skills in using a myoelectric prosthesis by patients with upper limb amputations. This prospective randomized, controlled study included a total of eleven patients with upper limb amputations who use myoelectric prostheses. The patients were randomized into a robot-assisted exercise group (n = 6) and a control group (n = 5). The robot group received robot-assisted training. No training program was provided to the control group. The outcome measure was kinematic data (A-goal hand-path ratio, A-goal deviation, A-goal instability and A-move) evaluated by the Armeo®Spring movement therapy robot. Significant improvements were noted in the A-goal hand-path ratio; A-goal deviation and A-goal instability in the robot group after treatment while compared with control group. No significant changes in A-move scores. We concluded that robot-assisted training may improve myoelectric prosthesis use skills in patients with upper limb amputation.

Serious Games Are Not Serious Enough for Myoelectric Prosthetics

Serious games show a lot of potential for use in movement rehabilitation (eg, after a stroke, injury to the spinal cord, or limb loss). However, the nature of this research leads to diversity both in the background of the researchers and in the approaches of their investigation. Our close examination and categorization of virtual training software for upper limb prosthetic rehabilitation found that researchers typically followed one of two broad approaches: (1) focusing on the game design aspects to increase engagement and muscle training and (2) concentrating on an accurate representation of prosthetic training tasks, to induce task-specific skill transfer. Previous studies indicate muscle training alone does not lead to improved prosthetic control without a transfer-enabling task structure. However, the literature shows a recent surge in the number of game-based prosthetic training tools, which focus on engagement without heeding the importance of skill transfer. This influx appears to have been strongly influenced by the availability of both software and hardware, specifically the launch of a commercially available acquisition device and freely available high-profile game development engines. In this Viewpoint, we share our perspective on the current trends and progress of serious games for prosthetic training.

Transfer of mode switching performance: from training to upper-limb prosthesis use

BACKGROUND

Current myoelectric prostheses are multi-articulated and offer multiple modes. Switching between modes is often done through pre-defined myosignals, so-called triggers, of which the training hardly is studied. We evaluated if switching skills trained without using a prosthesis transfer to actual prosthesis use and whether the available feedback during training influences this transfer. Furthermore we examined which clinically relevant performance measures and which myosignal features were adapted during training.

METHODS

Two experimental groups and one control group participated in a five day pre-test-post-test design study. Both experimental groups used their myosignals to perform a task. One group performed a serious game without seeing their myosignals, the second group was presented their myosignal on a screen. The control group played the serious game using the touchpad of the laptop. Each training session lasted 15 min. The pre- and post-test were identical for all groups and consisted of performing a task with an actual prosthesis, where switches had to be produced to change grip mode to relocate clothespins. Both clinically relevant performance measures and myosignal features were analysed.

RESULTS

10 participants trained using the serious game, 10 participants trained with the visual myosignal and 8 the control task. All participants were unimpaired. Both experimental groups showed significant transfer of skill from training to prosthesis use, the control group did not. The degree of transfer did not differ between the two training groups. Clinically relevant measure 'accuracy' and feature of the myosignals 'variation in phasing' changed during training.

CONCLUSIONS

Training switching skills appeared to be successful. The skills trained in the game transferred to performance in a functional task. Learning switching skills is independent of the type of feedback used during training. Outcome measures hardly changed during training and further research is needed to explain this. It should be noted that five training sessions did not result in a level of performance needed for actual prosthesis use. Trial registration The study was approved by the local ethics committee (ECB 2014.02.28_1) and was included in the Dutch trial registry (NTR5876).

User training for machine learning controlled upper limb prostheses: a serious game approach

BACKGROUND

Upper limb prosthetics with multiple degrees of freedom (DoFs) are still mostly operated through the clinical standard Direct Control scheme. Machine learning control, on the other hand, allows controlling multiple DoFs although it requires separable and consistent electromyogram (EMG) patterns. Whereas user training can improve EMG pattern quality, conventional training methods might limit user potential. Training with serious games might lead to higher quality EMG patterns and better functional outcomes. In this explorative study we compare outcomes of serious game training with conventional training, and machine learning control with the users' own one DoF prosthesis.

METHODS

Participants with upper limb absence participated in 7 training sessions where they learned to control a 3 DoF prosthesis with two grips which was fitted. Participants received either game training or conventional training. Conventional training was based on coaching, as described in the literature. Game-based training was conducted using two games that trained EMG pattern separability and functional use. Both groups also trained functional use with the prosthesis donned. The prosthesis system was controlled using a neural network regressor. Outcome measures were EMG metrics, number of DoFs used, the spherical subset of the Southampton Hand Assessment Procedure and the Clothespin Relocation Test.

RESULTS

Eight participants were recruited and four completed the study. Training did not lead to consistent improvements in EMG pattern quality or functional use, but some participants improved in some metrics. No differences were observed between the groups. Participants achieved consistently better results using their own prosthesis than the machine-learning controlled prosthesis used in this study.

CONCLUSION

Our explorative study showed in a small group of participants that serious game training seems to achieve similar results as conventional training. No consistent improvements were found in either group in terms of EMG metrics or functional use, which might be due to insufficient training. This study highlights the need for more research in user training for machine learning controlled prosthetics. In addition, this study contributes with more data comparing machine learning controlled prosthetics with Direct Controlled prosthetics.

Addressing unpredictability may be the key to improving performance with current clinically prescribed myoelectric prostheses

The efferent control chain for an upper-limb myoelectric prosthesis can be separated into 3 key areas: signal generation, signal acquisition, and device response. Data were collected from twenty trans-radial myoelectric prosthesis users using their own clinically prescribed devices, to establish the relative impact of these potential control factors on user performance (user functionality and everyday prosthesis usage). By identifying the key factor(s), we can guide future developments to ensure clinical impact. Skill in generating muscle signals was assessed via reaction times and signal tracking. To assess the predictability of signal acquisition, we inspected reaction time spread and undesired hand activations. As a measure of device response, we recorded the electromechanical delay between electrode stimulation and the onset of hand movement. Results suggest abstract measures of skill in controlling muscle signals are poorly correlated with performance. Undesired activations of the hand or incorrect responses were correlated with almost all kinematics and gaze measures suggesting unpredictability is a key factor. Significant correlations were also found between several measures of performance and the electromechanical delay; however, unexpectedly, longer electromechanical delays correlated with better performance. Future research should focus on exploring causes of unpredictability, their relative impacts on performance and interventions to address this.

Perception of Game-Based Rehabilitation in Upper Limb Prosthetic Training: Survey of Users and Researchers

Background

Serious games have been investigated for their use in multiple forms of rehabilitation for decades. The rising trend to use games for physical fitness in more recent years has also provided more options and garnered more interest for their use in physical rehabilitation and motor learning. In this study, we report the results of an opinion survey of serious games in upper limb prosthetic training.

Objective

This study investigates and contrasts the expectations and preferences for game-based prosthetic rehabilitation of people with limb difference and researchers.

Methods

Both participant groups answered open and closed questions as well as a questionnaire to assess their user types. The distribution of the user types was compared with a Pearson chi-square test against a sample population. The data were analyzed using the thematic framework method; answers fell within the themes of usability, training, and game design. Researchers shared their views on current challenges and what could be done to tackle these.

Results

A total of 14 people with limb difference and 12 researchers participated in this survey. The open questions resulted in an overview of the different views on prosthetic training games between the groups. The user types of people with limb difference and researchers were both significantly different from the sample population, with χ²₅=12.3 and χ²₅=26.5, respectively.

Conclusions

We found that the respondents not only showed a general willingness and tentative optimism toward the topic but also acknowledged hurdles limiting the adoption of these games by both clinics and users. The results indicate a noteworthy difference between researchers and people with limb difference in their game preferences, which could lead to design choices that do not represent the target audience. Furthermore, focus on long-term in-home experiments is expected to shed more light on the validity of games in upper limb prosthetic rehabilitation.

Effect of Mechanically Passive, Wearable Shoulder Exoskeletons on Muscle Output During Dynamic Upper Extremity Movements: A Computational Simulation Study

Wearable passive (ie, spring powered) shoulder exoskeletons could reduce muscle output during motor tasks to help prevent or treat shoulder musculoskeletal disorders. However, most wearable passive shoulder exoskeletons have been designed and evaluated for static tasks, so it is unclear how they affect muscle output during dynamic tasks. The authors used a musculoskeletal model and Computed Muscle Control optimization to estimate muscle output with and without a wearable passive shoulder exoskeleton during 2 simulated dynamic tasks: abduction and upward reach. To an existing upper extremity musculoskeletal model, the authors added an exoskeleton model with 3-dimensional representations of the exoskeleton components, including a spring, cam wheel, force-transmitting shoulder cable, and wrapping surfaces that permitted the shoulder cable to wrap over the shoulder. The exoskeleton reduced net muscle-generated moments in positive shoulder elevation by 28% and 62% during the abduction and upward reach, respectively. However, muscle outputs (joint moments and muscle effort) were higher with the exoskeleton than without at some points of the movement. Muscle output was higher with the exoskeleton because the exoskeleton moment opposed the muscle-generated moment in some postures. The results of this study highlight the importance of evaluating muscle output for passive exoskeletons designed to support dynamic movements to ensure that the exoskeletons assist, rather than impede, movement.

Performance among different types of myocontrolled tasks is not related

Studies on myocontrolled assistive technology (AT), such as myoelectric prostheses, as well as rehabilitation practice using myoelectric controlled interfaces, commonly assume the existence of a general myocontrol skill. This is the skill to control myosignals in such a way that they are employable in multiple tasks. If this skill exists, training any myocontrolled task using a certain set of muscles would improve the use of myocontrolled AT when the AT is controlled using these muscles. We examined whether a general myocontrol skill exists in myocontrolled tasks with and without a prosthesis. Unimpaired, right-handed adults used the sEMG of wrist flexors and extensors to perform several tasks in two experiments. In Experiment 1, twelve participants trained a myoelectric prosthesis-simulator task and a myocontrolled serious game for five consecutive days. Performance was compared between tasks and over the course of the training period. In Experiment 2, thirty-one participants performed five myocontrolled tasks consisting of two serious games, two prosthesis-simulator tasks and one digital signal matching task. All tasks were based on tasks currently used in clinical practice or research settings. Kendall rank correlation coefficients were computed to analyze correlations between the performance on different tasks. In Experiment 1 performance on the tasks showed no correlation for multiple outcome measures. Rankings within tasks did not change over the training period. In Experiment 2 performance did not correlate between any of the tasks. Since performance between different tasks did not correlate, results suggest that a general myocontrol skill does not exist and that each myocontrolled task requires a specific skill. Generalization of those findings to amputees using AT should be done with caution since in both experiments unimpaired participants were included. Moreover, training duration in Experiment 2 was short. Our findings indicate that training and assessment methods for myocontrolled AT use should focus on tasks frequently performed in daily life by the individual using the AT instead of merely focusing on training myosignals.

Comparing EMG-Based Human-Machine Interfaces for Estimating Continuous, Coordinated Movements

Electromyography (EMG)-based interfaces are trending toward continuous, simultaneous control with multiple degrees of freedom. Emerging methods range from data-driven approaches to biomechanical model-based methods. However, there has been no direct comparison between these two types of continuous EMG-based interfaces. The aim of this study was to compare a musculoskeletal model (MM) with two data-driven approaches, linear regression (LR) and artificial neural network (ANN), for predicting continuous wrist and hand motions for EMG-based interfaces. Six able-bodied subjects and one transradial amputee subject performed (missing) metacarpophalangeal (MCP) and wrist flexion/extension, simultaneously or independently, while four EMG signals were recorded from forearm muscles. To add variation to the EMG signals, the subjects repeated the MCP and wrist motions at various upper extremity postures. For each subject, the EMG signals collected from the neutral posture were used to build the EMG interfaces; the EMG signals collected from all postures were used to evaluate the interfaces. The performance of the interface was quantified by Pearson's correlation coefficient (r) and the normalized root mean square error (NRMSE) between measured and estimated joint angles. The results demonstrated that the MM predicted movements more accurately, with higher r values and lower NRMSE, than either LR or ANN. Similar results were observed in the transradial amputee. Additionally, the variation in r across postures, an indicator of reliability against posture changes, was significantly lower (better) for the MM than for either LR or ANN. Our findings suggest that incorporating musculoskeletal knowledge into EMG-based human-machine interfaces could improve the estimation of continuous, coordinated motion.

Proprioceptive Sonomyographic Control: A novel method for intuitive and proportional control of multiple degrees-of-freedom for individuals with upper extremity limb loss

Technological advances in multi-articulated prosthetic hands have outpaced the development of methods to intuitively control these devices. In fact, prosthetic users often cite "difficulty of use" as a key contributing factor for abandoning their prostheses. To overcome the limitations of the currently pervasive myoelectric control strategies, namely unintuitive proportional control of multiple degrees-of-freedom, we propose a novel approach: proprioceptive sonomyographiccontrol. Unlike myoelectric control strategies which measure electrical activation of muscles and use the extracted signals to determine the velocity of an end-effector; our sonomyography-based strategy measures mechanical muscle deformation directly with ultrasound and uses the extracted signals to proportionally control the position of an end-effector. Therefore, our sonomyography-based control is congruent with a prosthetic user’s innate proprioception of muscle deformation in the residual limb. In this work, we evaluated proprioceptive sonomyographic control with 5 prosthetic users and 5 able-bodied participants in a virtual target achievement and holding task for 5 different hand motions. We observed that with limited training, the performance of prosthetic users was comparable to that of able-bodied participants and thus conclude that proprioceptive sonomyographic control is a robust and intuitive prosthetic control strategy.

Virtual Integration Environment as an Advanced Prosthetic Limb Training Platform

Background: Despite advances in prosthetic development and neurorehabilitation, individuals with upper extremity (UE) loss continue to face functional and psychosocial challenges following amputation. Recent advanced myoelectric prostheses offer intuitive control over multiple, simultaneous degrees of motion and promise sensory feedback integration, but require complex training to effectively manipulate. We explored whether a virtual reality simulator could be used to teach dexterous prosthetic control paradigms to individuals with UE loss. Methods: Thirteen active-duty military personnel with UE loss (14 limbs) completed twenty, 30-min passive motor training sessions over 1-2 months. Participants were asked to follow the motions of a virtual avatar using residual and phantom limbs, and electrical activity from the residual limb was recorded using surface electromyography. Eight participants (nine limbs), also completed twenty, 30-min active motor training sessions. Participants controlled a virtual avatar through three motion sets of increasing complexity (Basic, Advanced, and Digit) and were scored on how accurately they performed requested motions. Score trajectory was assessed as a function of time using longitudinal mixed effects linear regression. Results: Mean classification accuracy for passive motor training was 43.8 ± 10.7% (14 limbs, 277 passive sessions). In active motor sessions, >95% classification accuracy (which we used as the threshold for prosthetic acceptance) was achieved by all participants for Basic sets and by 50% of participants in Advanced and Digit sets. Significant improvement in active motor scores over time was observed in Basic and Advanced sets (per additional session: β-coefficient 0.125, p = 0.022; β-coefficient 0.45, p = 0.001, respectively), and trended toward significance for Digit sets (β-coefficient 0.594, p = 0.077). Conclusions: These results offer robust evidence that a virtual reality training platform can be used to quickly and efficiently train individuals with UE loss to operate advanced prosthetic control paradigms. Participants can be trained to generate muscle contraction patterns in residual limbs that are interpreted with high accuracy by computer software as distinct active motion commands. These results support the potential viability of advanced myoelectric prostheses relying on pattern recognition feedback or similar controls systems.

Control within a virtual environment is correlated to functional outcomes when using a physical prosthesis

Background

Advances such as targeted muscle reinnervation and pattern recognition control may provide improved control of upper limb myoelectric prostheses, but evaluating user function remains challenging. Virtual environments are cost-effective and immersive tools that are increasingly used to provide practice and evaluate prosthesis control, but the relationship between virtual and physical outcomes—i.e., whether practice in a virtual environment translates to improved physical performance—is not understood.

Methods

Nine people with transhumeral amputations who previously had targeted muscle reinnervation surgery were fitted with a myoelectric prosthesis comprising a commercially available elbow, wrist, terminal device, and pattern recognition control system. Virtual and physical outcome measures were obtained before and after a 6-week home trial of the prosthesis.

Results

After the home trial, subjects showed statistically significant improvements (p < 0.05) in offline classification error, the virtual Target Achievement Control test, and the physical Southampton Hand Assessment Procedure and Box and Blocks Test. A trend toward improvement was also observed in the physical Clothespin Relocation task and Jebsen-Taylor test; however, these changes were not statistically significant. The median completion time in the virtual test correlated strongly and significantly with the Southampton Hand Assessment Procedure (p = 0.05, R = − 0.86), Box and Blocks Test (p = 0.007, R = − 0.82), Jebsen-Taylor Test (p = 0.003, R = 0.87), and the Assessment of Capacity for Myoelectric Control (p = 0.005,R = − 0.85). The classification error performance only had a significant correlation with the Clothespin Relocation Test (p = 0.018, R = .76).

Conclusions

In-home practice with a pattern recognition-controlled prosthesis improves functional control, as measured by both virtual and physical outcome measures. However, virtual measures need to be validated and standardized to ensure reliability in a clinical or research setting.

Trial registration

This is a registered clinical trial: NCT03097978.

Evaluation of Myoelectric Control Learning Using Multi-Session Game-Based Training

While training is critical for ensuring initial success as well as continued adoption of a myoelectric powered prosthesis, relatively little is known about the amount of training that is necessary. In previous studies, participants have completed only a small number of sessions, leaving doubt about whether the findings necessarily generalize to a longer-term clinical training program. Furthermore, a heavy emphasis has been placed on a functional prosthesis use when assessing the effectiveness of myoelectric training. Although well-motivated, this all-inclusive approach may obscure more subtle improvements made in underlying muscle control that could lead to tangible benefits. In this paper, a deeper exploration of the effects of myoelectric training was performed by following the progress of 30 participants as they completed a series of ten 30-min training sessions over multiple days. The progress was assessed using a newly developed set of metrics that was specifically designed to quantify the aspects of muscle control that are foundational to the strong myoelectric prosthesis use. It was determined that, while myoelectric training can lead to improvements in muscle control, these improvements may take longer than previously considered, even occurring after improvements in the training game itself. These results suggest the need to reconsider how and when transfer from training activities is assessed.

The Anatomy of Action Systems: Task Differentiation When Learning an EMG Controlled Game

This study aims to determine to what extent the task for an action system in its initial development relies on functional and anatomical components. Fifty-two able-bodied participants were randomly assigned to one of three experimental groups or to a control group. As a pre- and post-test all groups performed a computer game with the same goal and using the same musculature. One experimental group also trained to perform this test, while the other two experimental groups learned to perform a game that differed either in its goal or in the musculature used. The observed change in accuracy indicated that retaining the goal of the task or the musculature used equally increased transfer performance relative to controls. Conversely, changing either the goal or the musculature equally decreased transfer relative to training the test. These results suggest that in the initial development of an action system, the task to which the system pertains is not specified solely by either the goal of the task or the anatomical structures involved. It is suggested that functional specificity and anatomical dependence might equally be outcomes of continuously differentiating activity.

Learning an EMG Controlled Game: Task-Specific Adaptations and Transfer

Video games that aim to improve myoelectric control (myogames) are gaining popularity and are often part of the rehabilitation process following an upper limb amputation. However, direct evidence for their effect on prosthetic skill is limited. This study aimed to determine whether and how myogaming improves EMG control and whether performance improvements transfer to a prosthesis-simulator task. Able-bodied right-handed participants (N = 28) were randomly assigned to 1 of 2 groups. The intervention group was trained to control a video game (Breakout-EMG) using the myosignals of wrist flexors and extensors. Controls played a regular Mario computer game. Both groups trained 20 minutes a day for 4 consecutive days. Before and after training, two tests were conducted: one level of the Breakout-EMG game, and grasping objects with a prosthesis-simulator. Results showed a larger increase of in-game accuracy for the Breakout-EMG group than for controls. The Breakout-EMG group moreover showed increased adaptation of the EMG signal to the game. No differences were found in using a prosthesis-simulator. This study demonstrated that myogames lead to task-specific myocontrol skills. Transfer to a prosthesis task is therefore far from easy. We discuss several implications for future myogame designs.