Home Use of a Neural-connected Sensory Prosthesis Provides the Functional and Psychosocial Experience of Having a Hand Again

The impact of objective functions on control policies in closed-loop control of grasping force with a myoelectric prosthesis

Objective.Supplemental sensory feedback for myoelectric prostheses can provide both psychosocial and functional benefits during prosthesis control. However, the impact of feedback depends on multiple factors and there is insufficient understanding about the fundamental role of such feedback in prosthesis use. The framework of human motor control enables us to systematically investigate the user-prosthesis control loop. In this study, we explore how different task objectives such as speed and accuracy shape the control policy developed by participants in a prosthesis force-matching task.Approach.Participants were randomly assigned to two groups that both used identical electromyography control interface and prosthesis force feedback, through vibrotactile stimulation, to perform a prosthesis force-matching task. However, the groups received different task objectives specifying speed and accuracy demands. We then investigated the control policies developed by the participants. To this end, we not only evaluated how successful or fast participants were but also analyzed the behavioral strategies adopted by the participants to obtain such performance gains.Main results.First, we observed that participants successfully integrated supplemental prosthesis force feedback to develop both feedforward and feedback control policies, as demanded by the task objectives. We then observed that participants who first developed a (slow) feedback policy were quickly able to adapt their policy to more stringent speed demands, by switching to a combined feedforward-feedback control strategy. However, the participants who first developed a (fast) feedforward policy were not able to change their control policy and adjust to greater accuracy demands.Significance.Overall, the results signify how the framework of human motor control can be applied to study the role of feedback in user-prosthesis interaction. The results also reveal the utility of training prosthesis users to integrate supplemental feedback into their state estimation by designing training protocols that encourage the development of combined feedforward and feedback policy.

Neurorobotic fusion of prosthetic touch, kinesthesia, and movement in bionic upper limbs promotes intrinsic brain behaviors

[Figure: see text].

Testing silicone digit extensions as a way to suppress natural sensation to evaluate supplementary tactile feedback

Dexterous use of the hands depends critically on sensory feedback, so it is generally agreed that functional supplementary feedback would greatly improve the use of hand prostheses. Much research still focuses on improving non-invasive feedback that could potentially become available to all prosthesis users. However, few studies on supplementary tactile feedback for hand prostheses demonstrated a functional benefit. We suggest that confounding factors impede accurate assessment of feedback, e.g., testing non-amputee participants that inevitably focus intently on learning EMG control, the EMG’s susceptibility to noise and delays, and the limited dexterity of hand prostheses. In an attempt to assess the effect of feedback free from these constraints, we used silicone digit extensions to suppress natural tactile feedback from the fingertips and thus used the tactile feedback-deprived human hand as an approximation of an ideal feed-forward tool. Our non-amputee participants wore the extensions and performed a simple pick-and-lift task with known weight, followed by a more difficult pick-and-lift task with changing weight. They then repeated these tasks with one of three kinds of audio feedback. The tests were repeated over three days. We also conducted a similar experiment on a person with severe sensory neuropathy to test the feedback without the extensions. Furthermore, we used a questionnaire based on the NASA Task Load Index to gauge the subjective experience. Unexpectedly, we did not find any meaningful differences between the feedback groups, neither in the objective nor the subjective measurements. It is possible that the digit extensions did not fully suppress sensation, but since the participant with impaired sensation also did not improve with the supplementary feedback, we conclude that the feedback failed to provide relevant grasping information in our experiments. The study highlights the complex interaction between task, feedback variable, feedback delivery, and control, which seemingly rendered even rich, high-bandwidth acoustic feedback redundant, despite substantial sensory impairment.

The Need to Work Arm in Arm: Calling for Collaboration in Delivering Neuroprosthetic Limb Replacements

Over the last few decades there has been a push to enhance the use of advanced prosthetics within the fields of biomedical engineering, neuroscience, and surgery. Through the development of peripheral neural interfaces and invasive electrodes, an individual's own nervous system can be used to control a prosthesis. With novel improvements in neural recording and signal decoding, this intimate communication has paved the way for bidirectional and intuitive control of prostheses. While various collaborations between engineers and surgeons have led to considerable success with motor control and pain management, it has been significantly more challenging to restore sensation. Many of the existing peripheral neural interfaces have demonstrated success in one of these modalities; however, none are currently able to fully restore limb function. Though this is in part due to the complexity of the human somatosensory system and stability of bioelectronics, the fragmentary and as-yet uncoordinated nature of the neuroprosthetic industry further complicates this advancement. In this review, we provide a comprehensive overview of the current field of neuroprosthetics and explore potential strategies to address its unique challenges. These include exploration of electrodes, surgical techniques, control methods, and prosthetic technology. Additionally, we propose a new approach to optimizing prosthetic limb function and facilitating clinical application by capitalizing on available resources. It is incumbent upon academia and industry to encourage collaboration and utilization of different peripheral neural interfaces in combination with each other to create versatile limbs that not only improve function but quality of life. Despite the rapidly evolving technology, if the field continues to work in divided "silos," we will delay achieving the critical, valuable outcome: creating a prosthetic limb that is right for the patient and positively affects their life.

Neurophysiology of slip sensation and grip reaction: insights for hand prosthesis control of slippage

Sensory feedback is pivotal for a proficient dexterity of the hand. By modulating the grip force in function of the quick and not completely predictable change of the load force, grabbed objects are prevented to slip from the hand. Slippage control is an enabling achievement to all manipulation abilities. However, in hand prosthetics, the performance of even the most innovative research solutions proposed so far to control slippage remain distant from the human physiology. Indeed, slippage control involves parallel and compensatory activation of multiple mechanoceptors, spinal and supraspinal reflexes, and higher-order voluntary behavioral adjustments. In this work, we reviewed the literature on physiological correlates of slippage to propose a three-phases model for the slip sensation and reaction. Furthermore, we discuss the main strategies employed so far in the research studies that tried to restore slippage control in amputees. In the light of the proposed three-phase slippage model and from the weaknesses of already implemented solutions, we proposed several physiology-inspired solutions for slippage control to be implemented in the future hand prostheses. Understanding the physiological basis of slip detection and perception and implementing them in novel hand feedback system would make prosthesis manipulation more efficient and would boost its perceived naturalness, fostering the sense of agency for the hand movements.

Sensory feedback for limb prostheses in amputees

Commercial prosthetic devices currently do not provide natural sensory information on the interaction with objects or movements. The subsequent disadvantages include unphysiological walking with a prosthetic leg and difficulty in controlling the force exerted with a prosthetic hand, thus creating health issues. Restoring natural sensory feedback from the prosthesis to amputees is an unmet clinical need. An optimal device should be able to elicit natural sensations of touch or proprioception, by delivering the complex signals to the nervous system that would be produced by skin, muscles and joints receptors. This Review covers the various neurotechnological approaches that have been proposed for the development of the optimal sensory feedback restoration device for arm and leg amputees.

A compact system for simultaneous stimulation and recording for closed-loop myoelectric control

Background

Despite important advancements in control and mechatronics of myoelectric prostheses, the communication between the user and his/her bionic limb is still unidirectional, as these systems do not provide somatosensory feedback. Electrotactile stimulation is an attractive technology to close the control loop since it allows flexible modulation of multiple parameters and compact interface design via multi-pad electrodes. However, the stimulation interferes with the recording of myoelectric signals and this can be detrimental to control.

Methods

We present a novel compact solution for simultaneous recording and stimulation through dynamic blanking of stimulation artefacts. To test the system, a feedback coding scheme communicating wrist rotation and hand aperture was developed specifically to stress the myoelectric control while still providing meaningful information to the subjects. Ten subjects participated in an experiment, where the quality of closed-loop myoelectric control was assessed by controlling a cursor in a two degrees of freedom target-reaching task. The benchmark performance with visual feedback was compared to that achieved by combining visual feedback and electrotactile stimulation as well as by using electrotactile feedback only.

Results

There was no significant difference in performance between visual and combined feedback condition with regards to successfully reached targets, time to reach a target, path efficiency and the number of overshoots. Therefore, the quality of myoelectric control was preserved in spite of the stimulation. As expected, the tactile condition was significantly poorer in completion rate (100/4% and 78/25% for combined and tactile condition, respectively) and time to reach a target (9/2 s and 13/4 s for combined and tactile condition, respectively). However, the performance in the tactile condition was still good, with no significant difference in path efficiency (38/8%) and the number of overshoots (0.5/0.4 overshoots), indicating that the stimulation was meaningful for the subjects and useful for closed-loop control.

Conclusions

Overall, the results demonstrated that the developed system can provide robust closed-loop control using electrotactile stimulation. The system supports different encoding schemes and allows placing the recording and stimulation electrodes next to each other. This is an important step towards an integrated solution where the developed unit will be embedded into a prosthetic socket.

A brain-computer interface that evokes tactile sensations improves robotic arm control

Prosthetic arms controlled by a brain-computer interface can enable people with tetraplegia to perform functional movements. However, vision provides limited feedback because information about grasping objects is best relayed through tactile feedback. We supplemented vision with tactile percepts evoked using a bidirectional brain-computer interface that records neural activity from the motor cortex and generates tactile sensations through intracortical microstimulation of the somatosensory cortex. This enabled a person with tetraplegia to substantially improve performance with a robotic limb; trial times on a clinical upper-limb assessment were reduced by half, from a median time of 20.9 to 10.2 seconds. Faster times were primarily due to less time spent attempting to grasp objects, revealing that mimicking known biological control principles results in task performance that is closer to able-bodied human abilities.

Embodied Cooperation to Promote Forgiving Interactions With Autonomous Machines

During every waking moment, we must engage with our environments, the people around us, the tools we use, and even our own bodies to perform actions and achieve our intentions. There is a spectrum of control that we have over our surroundings that spans the extremes from full to negligible. When the outcomes of our actions do not align with our goals, we have a tremendous capacity to displace blame and frustration on external factors while forgiving ourselves. This is especially true when we cooperate with machines; they are rarely afforded the level of forgiveness we provide our bodies and often bear much of our blame. Yet, our brain readily engages with autonomous processes in controlling our bodies to coordinate complex patterns of muscle contractions, make postural adjustments, adapt to external perturbations, among many others. This acceptance of biological autonomy may provide avenues to promote more forgiving human-machine partnerships. In this perspectives paper, we argue that striving for machine embodiment is a pathway to achieving effective and forgiving human-machine relationships. We discuss the mechanisms that help us identify ourselves and our bodies as separate from our environments and we describe their roles in achieving embodied cooperation. Using a representative selection of examples in neurally interfaced prosthetic limbs and intelligent mechatronics, we describe techniques to engage these same mechanisms when designing autonomous systems and their potential bidirectional interfaces.

Compliant peripheral nerve interfaces

Peripheral nerve interfaces (PNIs) record and/or modulate neural activity of nerves, which are responsible for conducting sensory-motor information to and from the central nervous system, and for regulating the activity of inner organs. PNIs are used both in neuroscience research and in therapeutical applications such as precise closed-loop control of neuroprosthetic limbs, treatment of neuropathic pain and restoration of vital functions (e.g. breathing and bladder management). Implantable interfaces represent an attractive solution to directly access peripheral nerves and provide enhanced selectivity both in recording and in stimulation, compared to their non-invasive counterparts. Nevertheless, the long-term functionality of implantable PNIs is limited by tissue damage, which occurs at the implant-tissue interface, and is thus highly dependent on material properties, biocompatibility and implant design. Current research focuses on the development of mechanically compliant PNIs, which adapt to the anatomy and dynamic movements of nerves in the body thereby limiting foreign body response. In this paper, we review recent progress in the development of flexible and implantable PNIs, highlighting promising solutions related to materials selection and their associated fabrication methods, and integrated functions. We report on the variety of available interface designs (intraneural, extraneural and regenerative) and different modulation techniques (electrical, optical, chemical) emphasizing the main challenges associated with integrating such systems on compliant substrates.

Extended home use of an advanced osseointegrated prosthetic arm improves function, performance, and control efficiency

Objective.Full restoration of arm function using a prosthesis remains a grand challenge; however, advances in robotic hardware, surgical interventions, and machine learning are bringing seamless human-machine interfacing closer to reality.Approach.Through extensive data logging over 1 year, we monitored at-home use of the dexterous Modular Prosthetic Limb controlled through pattern recognition of electromyography (EMG) by an individual with a transhumeral amputation, targeted muscle reinnervation, and osseointegration (OI).Main results.Throughout the study, continuous prosthesis usage increased (1% per week,p< 0.001) and functional metrics improved up to 26% on control assessments and 76% on perceived workload evaluations. We observed increases in torque loading on the OI implant (up to 12.5% every month,p< 0.001) and prosthesis control performance (0.5% every month,p< 0.005), indicating enhanced user integration, acceptance, and proficiency. More importantly, the EMG signal magnitude necessary for prosthesis control decreased, up to 34.7% (p< 0.001), over time without degrading performance, demonstrating improved control efficiency with a machine learning-based myoelectric pattern recognition algorithm. The participant controlled the prosthesis up to one month without updating the pattern recognition algorithm. The participant customized prosthesis movements to perform specific tasks, such as individual finger control for piano playing and hand gestures for communication, which likely contributed to continued usage.Significance.This work demonstrates, in a single participant, the functional benefit of unconstrained use of a highly anthropomorphic prosthetic limb over an extended period. While hurdles remain for widespread use, including device reliability, results replication, and technical maturity beyond a prototype, this study offers insight as an example of the impact of advanced prosthesis technology for rehabilitation outside the laboratory.

Joint speed feedback improves myoelectric prosthesis adaptation after perturbed reaches in non amputees

Accurate control of human limbs involves both feedforward and feedback signals. For prosthetic arms, feedforward control is commonly accomplished by recording myoelectric signals from the residual limb to predict the user's intent, but augmented feedback signals are not explicitly provided in commercial devices. Previous studies have demonstrated inconsistent results when artificial feedback was provided in the presence of vision; some studies showed benefits, while others did not. We hypothesized that negligible benefits in past studies may have been due to artificial feedback with low precision compared to vision, which results in heavy reliance on vision during reaching tasks. Furthermore, we anticipated more reliable benefits from artificial feedback when providing information that vision estimates with high uncertainty (e.g. joint speed). In this study, we test an artificial sensory feedback system providing joint speed information and how it impacts performance and adaptation during a hybrid positional-and-myoelectric ballistic reaching task. We found that overall reaching errors were reduced after perturbed control, but did not significantly improve steady-state reaches. Furthermore, we found that feedback about the joint speed of the myoelectric prosthesis control improved the adaptation rate of biological limb movements, which may have resulted from high prosthesis control noise and strategic overreaching with the positional control and underreaching with the myoelectric control. These results provide insights into the relevant factors influencing the improvements conferred by artificial sensory feedback.

The rubber hand illusion is a fallible method to study ownership of prosthetic limbs

Enabling sensory feedback in limb prostheses can reverse a damaged body image caused by amputation. The rubber hand illusion (RHI) is a popular paradigm to study ownership of artificial limbs and potentially useful to assess sensory feedback strategies. We investigated the RHI as means to induce ownership of a prosthetic hand by providing congruent visual and tactile stimuli. We elicited tactile sensations via electric stimulation of severed afferent nerve fibres in four participants with transhumeral amputation. Contrary to our expectations, they failed to experience the RHI. The sensations we elicited via nerve stimulation resemble tapping as opposed to stroking, as in the original RHI. We therefore investigated the effect of tapping versus stroking in 30 able-bodied subjects. We found that either tactile modality equally induced ownership in two-thirds of the subjects. Failure to induce the RHI in the intact hand of our participants with amputation later confirmed that they form part of the RHI-immune population. Conversely, these participants use neuromusculoskeletal prostheses with neural sensory feedback in their daily lives and reported said prostheses as part of their body. Our findings suggest that people immune to the RHI can nevertheless experience ownership over prosthetic limbs when used in daily life and accentuates a significant limitation of the RHI paradigm.

Online Closed-Loop Control Using Tactile Feedback Delivered Through Surface and Subdermal Electrotactile Stimulation

Aim

Limb loss is a dramatic event with a devastating impact on a person’s quality of life. Prostheses have been used to restore lost motor abilities and cosmetic appearance. Closing the loop between the prosthesis and the amputee by providing somatosensory feedback to the user might improve the performance, confidence of the amputee, and embodiment of the prosthesis. Recently, a minimally invasive method, in which the electrodes are placed subdermally, was presented and psychometrically evaluated. The present study aimed to assess the quality of online control with subdermal stimulation and compare it to that achieved using surface stimulation (common benchmark) as well as to investigate the impact of training on the two modalities.

Methods

Ten able-bodied subjects performed a PC-based compensatory tracking task. The subjects employed a joystick to track a predefined pseudorandom trajectory using feedback on the momentary tracking error, which was conveyed via surface and subdermal electrotactile stimulation. The tracking performance was evaluated using the correlation coefficient (CORR), root mean square error (RMSE), and time delay between reference and generated trajectories.

Results

Both stimulation modalities resulted in good closed-loop control, and surface stimulation outperformed the subdermal approach. There was significant difference in CORR (86 vs 77%) and RMSE (0.23 vs 0.31) between surface and subdermal stimulation (all p < 0.05). The RMSE of the subdermal stimulation decreased significantly in the first few trials.

Conclusion

Subdermal stimulation is a viable method to provide tactile feedback. The quality of online control is, however, somewhat worse compared to that achieved using surface stimulation. Nevertheless, due to minimal invasiveness, compactness, and power efficiency, the subdermal interface could be an attractive solution for the functional application in sensate prostheses.

Virtual Reality for Neurorehabilitation and Cognitive Enhancement

Our access to computer-generated worlds changes the way we feel, how we think, and how we solve problems. In this review, we explore the utility of different types of virtual reality, immersive or non-immersive, for providing controllable, safe environments that enable individual training, neurorehabilitation, or even replacement of lost functions. The neurobiological effects of virtual reality on neuronal plasticity have been shown to result in increased cortical gray matter volumes, higher concentration of electroencephalographic beta-waves, and enhanced cognitive performance. Clinical application of virtual reality is aided by innovative brain–computer interfaces, which allow direct tapping into the electric activity generated by different brain cortical areas for precise voluntary control of connected robotic devices. Virtual reality is also valuable to healthy individuals as a narrative medium for redesigning their individual stories in an integrative process of self-improvement and personal development. Future upgrades of virtual reality-based technologies promise to help humans transcend the limitations of their biological bodies and augment their capacity to mold physical reality to better meet the needs of a globalized world.

A cutaneous mechanoneural interface for neuroprosthetic feedback

Amputation destroys sensory end organs and does not provide an anatomical interface for cutaneous neuroprosthetic feedback. Here, we report the design and a biomechanical and electrophysiological evaluation of the cutaneous mechanoneural interface consisting of an afferent neural system that comprises a muscle actuator coupled to a natively pedicled skin flap in a cuff-like architecture. Muscle is actuated through electrical stimulation to induce strains or oscillatory vibrations on the skin flap that are proportional to a desired contact duration or contact pressure. In rat hindlimbs, the mechanoneural interface elicited native dermal mechanotransducers to generate at least four levels of graded contact and eight distinct vibratory afferents that were not significantly different from analogous mechanical stimulation of intact skin. The application of different patterns of electrical stimulation independently engaged slowly adapting and rapidly adapting mechanotransducers, and recreated an array of cutaneous sensations. The cutaneous mechanoneural interface can be integrated with current prosthetic technologies for tactile feedback.

Arduino-Based Myoelectric Control: Towards Longitudinal Study of Prosthesis Use

Understanding how upper-limb prostheses are used in daily life helps to improve the design and robustness of prosthesis control algorithms and prosthetic components. However, only a very small fraction of published research includes prosthesis use in community settings. The cost, limited battery life, and poor generalisation may be the main reasons limiting the implementation of home-based applications. In this work, we introduce the design of a cost-effective Arduino-based myoelectric control system with wearable electromyogram (EMG) sensors. The design considerations focused on home studies, so the robustness, user-friendly control adjustments, and user supports were the main concerns. Three control algorithms, namely, direct control, abstract control, and linear discriminant analysis (LDA) classification, were implemented in the system. In this paper, we will share our design principles and report the robustness of the system in continuous operation in the laboratory. In addition, we will show a first real-time implementation of the abstract decoder for prosthesis control with an able-bodied participant.

Discriminability of multiple cutaneous and proprioceptive hand percepts evoked by intraneural stimulation with Utah slanted electrode arrays in human amputees

BACKGROUND

Electrical stimulation of residual afferent nerve fibers can evoke sensations from a missing limb after amputation, and bionic arms endowed with artificial sensory feedback have been shown to confer functional and psychological benefits. Here we explore the extent to which artificial sensations can be discriminated based on location, quality, and intensity.

METHODS

We implanted Utah Slanted Electrode Arrays (USEAs) in the arm nerves of three transradial amputees and delivered electrical stimulation via different electrodes and frequencies to produce sensations on the missing hand with various locations, qualities, and intensities. Participants performed blind discrimination trials to discriminate among these artificial sensations.

RESULTS

Participants successfully discriminated cutaneous and proprioceptive sensations ranging in location, quality and intensity. Performance was significantly greater than chance for all discrimination tasks, including discrimination among up to ten different cutaneous location-intensity combinations (15/30 successes, p < 0.0001) and seven different proprioceptive location-intensity combinations (21/40 successes, p < 0.0001). Variations in the site of stimulation within the nerve, via electrode selection, enabled discrimination among up to five locations and qualities (35/35 successes, p < 0.0001). Variations in the stimulation frequency enabled discrimination among four different intensities at the same location (13/20 successes, p < 0.0005). One participant also discriminated among individual stimulation of two different USEA electrodes, simultaneous stimulation on both electrodes, and interleaved stimulation on both electrodes (20/24 successes, p < 0.0001).

CONCLUSION

Electrode location, stimulation frequency, and stimulation pattern can be modulated to evoke functionally discriminable sensations with a range of locations, qualities, and intensities. This rich source of artificial sensory feedback may enhance functional performance and embodiment of bionic arms endowed with a sense of touch.

Lack of Support in Medical Device Regulation within Academia

New medical technologies can transform healthcare, and automation of processes is becoming increasingly ubiquitous within the patient care sector. Many innovative ideas arise from academia, but regulations need to be taken into account if they want to reach the market and create a real impact. This is particularly relevant for applied fields, such as prosthetics, which continuously generates cutting-edge solutions. However, it remains unclear how well the regulatory pathway is supported within universities. This study applied a data-driven assessment of available online information regarding support of medical device regulations within universities. A total of 109,200 URLs were screened for regulatory information associated with universities in the UK and the USA. The results show that based on available online data, 55% of the selected universities in the UK and 35% in the USA did not provide any support for medical device regulations. There is a big discrepancy between universities in terms of the available support, as well as the kind of information that is made accessible by the academic institutes. It is suggested that increasing support for regulatory strategies during the early phases of research and development will likely yield a better translation of technologies into clinical care. Universities can play a more active role in this.

Talking with Your (Artificial) Hands: Communicative Hand Gestures as an Implicit Measure of Embodiment

When people talk, they move their hands to enhance meaning. Using accelerometry, we measured whether people spontaneously use their artificial limbs (prostheses) to gesture, and whether this behavior relates to everyday prosthesis use and perceived embodiment. Perhaps surprisingly, one- and two-handed participants did not differ in the number of gestures they produced in gesture-facilitating tasks. However, they did differ in their gesture profile. One-handers performed more, and bigger, gesture movements with their intact hand relative to their prosthesis. Importantly, one-handers who gestured more similarly to their two-handed counterparts also used their prosthesis more in everyday life. Although collectively one-handers only marginally agreed that their prosthesis feels like a body part, one-handers who reported they embody their prosthesis also showed greater prosthesis use for communication and daily function. Our findings provide the first empirical link between everyday prosthesis use habits and perceived embodiment and a novel means for implicitly indexing embodiment.

Biomimetic Approaches for Separated Regeneration of Sensory and Motor Fibers in Amputee People: Necessary Conditions for Functional Integration of Sensory-Motor Prostheses With the Peripheral Nerves

The regenerative capacity of the peripheral nervous system after an injury is limited, and a complete function is not recovered, mainly due to the loss of nerve tissue after the injury that causes a separation between the nerve ends and to the disorganized and intermingled growth of sensory and motor nerve fibers that cause erroneous reinnervations. Even though the development of biomaterials is a very promising field, today no significant results have been achieved. In this work, we study not only the characteristics that should have the support that will allow the growth of nerve fibers, but also the molecular profile necessary for a specific guidance. To do this, we carried out an exhaustive study of the molecular profile present during the regeneration of the sensory and motor fibers separately, as well as of the effect obtained by the administration and inhibition of different factors involved in the regeneration. In addition, we offer a complete design of the ideal characteristics of a biomaterial, which allows the growth of the sensory and motor neurons in a differentiated way, indicating (1) size and characteristics of the material; (2) necessity to act at the microlevel, on small groups of neurons; (3) combination of molecules and specific substrates; and (4) temporal profile of those molecules expression throughout the regeneration process. The importance of the design we offer is that it respects the complexity and characteristics of the regeneration process; it indicates the appropriate temporal conditions of molecular expression, in order to obtain a synergistic effect; it takes into account the importance of considering the process at the group of neuron level; and it gives an answer to the main limitations in the current studies.

Long-term performance of Utah slanted electrode arrays and intramuscular electromyographic leads implanted chronically in human arm nerves and muscles

OBJECTIVE

We explore the long-term performance and stability of seven percutaneous Utah Slanted Electrode Arrays (USEAs) and intramuscular recording leads (iEMGs) implanted chronically in the residual arm nerves and muscles of three human participants as a means to permanently restore sensorimotor function after transradial amputations.

APPROACH

We quantify the number of functional recording and functional stimulating electrodes over time. We also calculate the signal-to-noise ratio (SNR) of USEA and iEMG recordings and quantify the stimulation current necessary to evoke detectable sensory percepts. Furthermore, we quantify the consistency of the sensory modality, receptive field location, and receptive field size of USEA-evoked percepts.

MAIN RESULTS

In the most recent subject, involving USEAs with technical improvements, neural recordings persisted for 502 d (entire implant duration) and the number of functional recording electrodes for one USEA increased over time. However, for six out of seven USEAs across the three participants, the number of functional recording electrodes decreased within the first 2 months after implantation. The SNR of neural recordings and electromyographic recordings stayed relatively consistent over time. Sensory percepts were consistently evoked over the span of 14 months, were not significantly different in size, and highlighted the nerves' fascicular organization. The percentage of percepts with consistent modality or consistent receptive field location between sessions (∼1 month apart) varied between 0%-86.2% and 9.1%-100%, respectively. Stimulation thresholds and electrode impedances increased initially but then remained relatively stable over time.

SIGNIFICANCE

This work demonstrates improved performance of USEAs, and provides a basis for comparing the longevity and stability of USEAs to that of other neural interfaces. USEAs provide a rich repertoire of neural recordings and sensory percepts. Although their performance still generally declines over time, functionality can persist long-term. Future work should leverage the results presented here to further improve USEA design or to develop adaptive algorithms that can maintain a high level of performance.

A bioelectric neural interface towards intuitive prosthetic control for amputees

OBJECTIVE

While prosthetic hands with independently actuated digits have become commercially available, state-of-the-art human-machine interfaces (HMI) only permit control over a limited set of grasp patterns, which does not enable amputees to experience sufficient improvement in their daily activities to make an active prosthesis useful.

APPROACH

Here we present a technology platform combining fully-integrated bioelectronics, implantable intrafascicular microelectrodes and deep learning-based artificial intelligence (AI) to facilitate this missing bridge by tapping into the intricate motor control signals of peripheral nerves. The bioelectric neural interface includes an ultra-low-noise neural recording system to sense electroneurography (ENG) signals from microelectrode arrays implanted in the residual nerves, and AI models employing the recurrent neural network (RNN) architecture to decode the subject's motor intention.

MAIN RESULTS

A pilot human study has been carried out on a transradial amputee. We demonstrate that the information channel established by the proposed neural interface is sufficient to provide high accuracy control of a prosthetic hand up to 15 degrees of freedom (DOF). The interface is intuitive as it directly maps complex prosthesis movements to the patient's true intention.

SIGNIFICANCE

Our study layouts the foundation towards not only a robust and dexterous control strategy for modern neuroprostheses at a near-natural level approaching that of the able hand, but also an intuitive conduit for connecting human minds and machines through the peripheral neural pathways. (Clinical trial identifier: NCT02994160).

Sensory stimulation enhances phantom limb perception and movement decoding

OBJECTIVE

A major challenge for controlling a prosthetic arm is communication between the device and the user's phantom limb. We show the ability to enhance phantom limb perception and improve movement decoding through targeted transcutaneous electrical nerve stimulation in individuals with an arm amputation.

APPROACH

Transcutaneous nerve stimulation experiments were performed with four participants with arm amputation to map phantom limb perception. We measured myoelectric signals during phantom hand movements before and after participants received sensory stimulation. Using electroencephalogram (EEG) monitoring, we measured the neural activity in sensorimotor regions during phantom movements and stimulation. In one participant, we also tracked sensory mapping over 2 years and movement decoding performance over 1 year.

MAIN RESULTS

Results show improvements in the participants' ability to perceive and move the phantom hand as a result of sensory stimulation, which leads to improved movement decoding. In the extended study with one participant, we found that sensory mapping remains stable over 2 years. Sensory stimulation improves within-day movement decoding while performance remains stable over 1 year. From the EEG, we observed cortical correlates of sensorimotor integration and increased motor-related neural activity as a result of enhanced phantom limb perception.

SIGNIFICANCE

This work demonstrates that phantom limb perception influences prosthesis control and can benefit from targeted nerve stimulation. These findings have implications for improving prosthesis usability and function due to a heightened sense of the phantom hand.

Portable Take-Home System Enables Proportional Control and High-Resolution Data Logging With a Multi-Degree-of-Freedom Bionic Arm

This paper describes a portable, prosthetic control system and the first at-home use of a multi-degree-of-freedom, proportionally controlled bionic arm. The system uses a modified Kalman filter to provide 6 degree-of-freedom, real-time, proportional control. We describe (a) how the system trains motor control algorithms for use with an advanced bionic arm, and (b) the system's ability to record an unprecedented and comprehensive dataset of EMG, hand positions and force sensor values. Intact participants and a transradial amputee used the system to perform activities-of-daily-living, including bi-manual tasks, in the lab and at home. This technology enables at-home dexterous bionic arm use, and provides a high-temporal resolution description of daily use—essential information to determine clinical relevance and improve future research for advanced bionic arms.

Sensitivity to temporal parameters of intraneural tactile sensory feedback

BACKGROUND

Recent studies have shown that neural stimulation can be used to provide artificial sensory feedback to amputees eliciting sensations referred on the amputated hand. The temporal properties of the neural stimulation modulate aspects of evoked sensations that can be exploited in a bidirectional hand prosthesis.

METHODS

We previously collected evidence that the derivative of the amplitude of the stimulation (intra-digit temporal dynamics) allows subjects to recognize object compliance and that the time delay among stimuli injected through electrodes implanted in different nerves (inter-digit temporal distance) allows to recognize object shapes. Nevertheless, a detailed characterization of the subjects' sensitivity to variations of intra-digit temporal dynamic and inter-digit temporal distance of the intraneural tactile feedback has not been executed. An exhaustive understanding of the overall potentials and limits of intraneural stimulation to deliver sensory feedback is of paramount importance to bring this approach closer and closer to the natural situation. To this aim, here we asked two trans-radial amputees to identify stimuli with different temporal characteristics delivered to the same active site (intra-digit temporal Dynamic Recognition (DR)) or between two active sites (inter-digit Temporal distance Recognition (TR)). Finally, we compared the results achieved for (simulated) TR with conceptually similar experiments with real objects with one subject.

RESULTS

We found that the subjects were able to identify stimuli with temporal differences (perceptual thresholds) larger than 0.25 s for DR and larger than 0.125 s for TR, respectively. Moreover, we also found no statistically significant differences when the subjects were asked to identify three objects during simulated 'open-loop' TR experiments or real 'closed-loop' tests while controlling robotic hand.

CONCLUSIONS

This study is a new step towards a more detailed analysis of the overall potentials and limits of intraneural sensory feedback. A full characterization is necessary to develop more advanced prostheses capable of restoring all lost functions and of being perceived more as a natural limb by users.

Sensory Feedback in Hand Prostheses: A Prospective Study of Everyday Use

Introduction

Sensory feedback in hand prostheses is lacking but wished for. Many amputees experience a phantom hand map on their residual forearm. When the phantom hand map is touched, it is experienced as touch on the amputated hand. A non-invasive sensory feedback system, applicable to existing hand prostheses, can transfer somatotopical sensory information via phantom hand map. The aim was to evaluate how forearm amputees experienced a non-invasive sensory feedback system used in daily life over a 4-week period.

Methods

This longitudinal cohort study included seven forearm amputees. A non-invasive sensory feedback system was used over 4 weeks. For analysis, a mixed method was used, including quantitative tests (ACMC, proprioceptive pointing task, questionnaire) and interviews. A directed content analysis with predefined categories sensory feedback from the prosthesis, agency, body ownership, performance in activity, and suggestions for improvements was applied.

Results

The results from interviews showed that sensory feedback was experienced as a feeling of touch which contributed to an experience of completeness. However, the results from the questionnaire showed that the sense of agency and performance remained unchanged or deteriorated. The ability to feel and manipulate small objects was difficult and a stronger feedback was wished for. Phantom pain was alleviated in four out of five patients.

Conclusion

This is the first time a non-invasive sensory feedback system for hand prostheses was implemented in the home environment. The qualitative and quantitative results diverged. The sensory feedback was experienced as a feeling of touch which contributed to a feeling of completeness, linked to body ownership. The qualitative result was not verified in the quantitative measurements.

Clinical Trial Registration

Name: Evaluation of a Non-invasive Sensory Feedback System in Hand Prostheses. Date of registration: March 15, 2019. Date the first participant was enrolled: April 1, 2015. ClinicalTrials.gov Identifier: NCT03876405 ORCID ID: https://orcid.org/0000-0002-4140-7478.

Sensory restoration by epidural stimulation of the lateral spinal cord in upper-limb amputees

Restoring somatosensory feedback to people with limb amputations is crucial to improve prosthetic control. Multiple studies have demonstrated that peripheral nerve stimulation and targeted reinnervation can provide somatotopically relevant sensory feedback. While effective, the surgical procedures required for these techniques remain a major barrier to translatability. Here, we demonstrate in four people with upper-limb amputation that epidural spinal cord stimulation (SCS), a common clinical technique to treat pain, evoked somatosensory percepts that were perceived as emanating from the missing arm and hand. Over up to 29 days, stimulation evoked sensory percepts in consistent locations in the missing hand regardless of time since amputation or level of amputation. Evoked sensations were occasionally described as naturalistic (e.g. touch or pressure), but were often paresthesias. Increasing stimulus amplitude increased the perceived intensity linearly, without increasing area of the sensations. These results demonstrate the potential of SCS as a tool to restore somatosensation after amputations.

Even some of the most advanced prosthetic arms lack an important feature: the ability to relay information about touch or pressure to the wearer. In fact, many people prefer to use simpler prostheses whose cables and harnesses pass on information about tension. However, recent studies suggest that electrical stimulation might give prosthesis users more sensation and better control.

After an amputation, the nerves that used to deliver sensory information from the hand still exist above the injury. Stimulating these nerves can help to recreate sensations in the missing limb and improve the control of the prosthesis. Still, this stimulation requires complicated surgical interventions to implant electrodes in or around the nerves. Spinal cord stimulation – a technique where a small electrical device is inserted near the spinal cord to stimulate nerves – may be an easier alternative. This approach only requires a simple outpatient procedure, and it is routinely used to treat chronic pain conditions.

Now, Chandrasekaran, Nanivadekar et al. show that spinal cord stimulation can produce the feeling of sensations in a person’s missing hand or arm. In the experiments, four people who had an arm amputation underwent spinal cord stimulation over 29 days. During the stimulation, the participants reported feeling electrical buzzing, vibration, or pressure in their missing limb. Changing the strength of the electric signals delivered to the spinal cord altered the intensity of these sensations.

The experiments are a step toward developing better prosthetics that restore some sensation. Further studies are now needed to determine whether spinal cord stimulation would allow people to perform sensory tasks with a prosthetic, for example handling an object that they cannot see.

Technology for monitoring everyday prosthesis use: a systematic review

BACKGROUND

Understanding how prostheses are used in everyday life is central to the design, provision and evaluation of prosthetic devices and associated services. This paper reviews the scientific literature on methodologies and technologies that have been used to assess the daily use of both upper- and lower-limb prostheses. It discusses the types of studies that have been undertaken, the technologies used to monitor physical activity, the benefits of monitoring daily living and the barriers to long-term monitoring, with particular focus on low-resource settings.

METHODS

A systematic literature search was conducted in PubMed, Web of Science, Scopus, CINAHL and EMBASE of studies that monitored the activity of prosthesis users during daily-living.

RESULTS

Sixty lower-limb studies and 9 upper-limb studies were identified for inclusion in the review. The first studies in the lower-limb field date from the 1990s and the number has increased steadily since the early 2000s. In contrast, the studies in the upper-limb field have only begun to emerge over the past few years. The early lower-limb studies focused on the development or validation of actimeters, algorithms and/or scores for activity classification. However, most of the recent lower-limb studies used activity monitoring to compare prosthetic components. The lower-limb studies mainly used step-counts as their only measure of activity, focusing on the amount of activity, not the type and quality of movements. In comparison, the small number of upper-limb studies were fairly evenly spread between development of algorithms, comparison of everyday activity to clinical scores, and comparison of different prosthesis user populations. Most upper-limb papers reported the degree of symmetry in activity levels between the arm with the prosthesis and the intact arm.

CONCLUSIONS

Activity monitoring technology used in conjunction with clinical scores and user feedback, offers significant insights into how prostheses are used and whether they meet the user's requirements. However, the cost, limited battery-life and lack of availability in many countries mean that using sensors to understand the daily use of prostheses and the types of activity being performed has not yet become a feasible standard clinical practice. This review provides recommendations for the research and clinical communities to advance this area for the benefit of prosthesis users.

A Review of Sensory Feedback in Upper-Limb Prostheses From the Perspective of Human Motor Control

This manuscript reviews historical and recent studies that focus on supplementary sensory feedback for use in upper limb prostheses. It shows that the inability of many studies to speak to the issue of meaningful performance improvements in real-life scenarios is caused by the complexity of the interactions of supplementary sensory feedback with other types of feedback along with other portions of the motor control process. To do this, the present manuscript frames the question of supplementary feedback from the perspective of computational motor control, providing a brief review of the main advances in that field over the last 20 years. It then separates the studies on the closed-loop prosthesis control into distinct categories, which are defined by relating the impact of feedback to the relevant components of the motor control framework, and reviews the work that has been done over the last 50+ years in each of those categories. It ends with a discussion of the studies, along with suggestions for experimental construction and connections with other areas of research, such as machine learning.

Is an artificial limb embodied as a hand? Brain decoding in prosthetic limb users

The potential ability of the human brain to represent an artificial limb as a body part (embodiment) has been inspiring engineers, clinicians, and scientists as a means to optimise human-machine interfaces. Using functional MRI (fMRI), we studied whether neural embodiment actually occurs in prosthesis users' occipitotemporal cortex (OTC). Compared with controls, different prostheses types were visually represented more similarly to each other, relative to hands and tools, indicating the emergence of a dissociated prosthesis categorisation. Greater daily life prosthesis usage correlated positively with greater prosthesis categorisation. Moreover, when comparing prosthesis users' representation of their own prosthesis to controls' representation of a similar looking prosthesis, prosthesis users represented their own prosthesis more dissimilarly to hands, challenging current views of visual prosthesis embodiment. Our results reveal a use-dependent neural correlate for wearable technology adoption, demonstrating adaptive use-related plasticity within the OTC. Because these neural correlates were independent of the prostheses' appearance and control, our findings offer new opportunities for prosthesis design by lifting restrictions imposed by the embodiment theory for artificial limbs.

Using Bionics to Restore Sensation to Reconstructed Breasts

Mastectomy often leads to a complete desensitization of the chest, which in turn can give rise to diminished sexual function and to disembodiment of the breasts. One approach to mitigate the sensory consequences of mastectomy is to leverage technology that has been developed for the restoration of sensation in bionic hands. Specifically, sensors embedded under the skin of the nipple-areolar complex can be used to detect touches. The output of the sensors then drives electrical stimulation of the residual intercostal nerves, delivered through chronically implanted electrode arrays, thereby eliciting tactile sensations experienced on the nipple-areolar complex. The hope is that the bionic breast will restore a woman's sense that her breast belongs to her body so she can experience the pleasure of an embrace and derive the benefit of the sensual touch of her partner.

Sensory- and Action-Oriented Embodiment of Neurally-Interfaced Robotic Hand Prostheses

Embodiment is the percept that something not originally belonging to the self becomes part of the body. Feeling embodiment for a prosthesis may counteract amputees' altered image of the body and increase prosthesis acceptability. Prosthesis embodiment has been studied longitudinally in an amputee receiving feedback through intraneural and perineural multichannel electrodes implanted in her stump. Three factors-invasive (vs non-invasive) stimulation, training, and anthropomorphism-have been tested through two multisensory integration tasks: visuo-tactile integration (VTI) and crossing-hand effect in temporal order judgment (TOJ), the former more sensible to an extension of a safe margin around the body and the latter to action-oriented remapping. Results from the amputee participant were compared with the ones from healthy controls. Testing the participant with intraneural stimulation produced an extension of peripersonal space, a sign of prosthesis embodiment. One-month training extended the peripersonal space selectively on the side wearing the prostheses. More and less-anthropomorphic prostheses benefited of intraneural feedback and extended the peripersonal space. However, the worsening of TOJ performance following arm crossing was present only wearing the more trained, despite less anthropomorphic, prosthesis, suggesting that training was critical for our participant to achieve operative tool-like embodiment.

Self-Contained Neuromusculoskeletal Arm Prostheses

We report the use of a bone-anchored, self-contained robotic arm with both sensory and motor components over 3 to 7 years in four patients after transhumeral amputation. The implant allowed for bidirectional communication between a prosthetic hand and electrodes implanted in the nerves and muscles of the upper arm and was anchored to the humerus through osseointegration, the process in which bone cells attach to an artificial surface without formation of fibrous tissue. Use of the device did not require formal training and depended on the intuitive intent of the user to activate movement and sensory feedback from the prosthesis. Daily use resulted in increasing sensory acuity and effectiveness in work and other activities of daily life. (Funded by the Promobilia Foundation and others.).

Dual-Parameter Modulation Improves Stimulus Localization in Multichannel Electrotactile Stimulation

Among most challenging open issues in prosthetic research is the development of a robust bidirectional interface between a prosthesis and its user. Commercially available prosthetic systems are mechanically advanced, but they do not provide somatosensory feedback. Here, we present a novel non-invasive interface for multichannel electrotactile feedback, comprising a matrix of 24 pads, and we investigate the ability of able-bodied human subjects to localize the electrotactile stimulus delivered through the matrix. For this purpose, we tested conventional stimulation (same frequency for all pads) and a novel dual-parameter modulation scheme (interleaved frequency and intensity) designed to facilitate the spatial localization over the electrode. Electrotactile stimulation was also compared to mechanical stimulation of the same locations on the skin. Experimental results on eight able-bodied subjects demonstrated that the proposed interleaved coding substantially improved the spatial localization compared to same-frequency stimulation. The results also showed that same-frequency stimulation was equivalent to mechanical stimulation, whereas the performance with dual-parameter modulation was significantly better. These are encouraging outcomes for the application of a multichannel interface for the restoration of feedback in prosthetics. The high-resolution augmented interfaces might be used to explore novel scenarios for effective communication with the prosthesis user enabled by maximizing information transmission.

Mechanotactile Sensory Feedback Improves Embodiment of a Prosthetic Hand During Active Use

There have been several advancements in the field of myoelectric prostheses to improve dexterity and restore hand grasp patterns for persons with upper limb loss, including robust control strategies, novel sensory feedback, and multifunction prosthetic terminal devices. Although these advancements have shown to improve prosthesis performance, a key element that may further improve acceptance is often overlooked. Embodiment, which encompasses the feeling of owning, controlling and locating the device without the need to constantly look at it, has been shown to be affected by sensory feedback. However, the specific aspects of embodiment that are influenced are not clearly understood, particularly when a prosthesis is actively controlled. In this work, we used a sensorized simulated prosthesis in able-bodied participants to investigate the contribution of sensory feedback, active motor control, and the combination of both to the components of embodiment; using a common methodology in the literature, namely the rubber hand illusion (RHI). Our results indicate that (1) the sensorized simulated prosthesis may be embodied by able-bodied users in a similar fashion as prosthetic devices embodied by persons with upper limb amputation, and (2) mechanotactile sensory feedback might not only be useful for improving certain aspects of embodiment, i.e., ownership and location, but also may have a modulating effect on other aspects, namely sense of agency, when provided asynchronously during active motor control tasks. This work may allow us to further investigate and manipulate factors contributing to the complex phenomenon of embodiment in relation to active motor control of a device, enabling future study of more precise quantitative measures of embodiment that do not rely as much on subjective perception.

A computational model to design neural interfaces for lower-limb sensory neuroprostheses

BACKGROUND

Leg amputees suffer the lack of sensory feedback from a prosthesis, which is connected to their low confidence during walking, falls and low mobility. Electrical peripheral nerve stimulation (ePNS) of upper-limb amputee's residual nerves has shown the ability to restore the sensations from the missing limb via intraneural (TIME) and epineural (FINE) neural interfaces. Physiologically plausible stimulation protocols targeting lower limb sciatic nerve hold promise to induce sensory feedback restoration that should facilitate close-to-natural sensorimotor integration and therefore walking corrections. The sciatic nerve, innervating the foot and lower leg, has very different dimensions in respect to upper-limb nerves. Therefore, there is a need to develop a computational model of its behavior in response to the ePNS.

METHODS

We employed a hybrid FEM-NEURON model framework for the development of anatomically correct sciatic nerve model. Based on histological images of two distinct sciatic nerve cross-sections, we reconstructed accurate FEM models for testing neural interfaces. Two different electrode types (based on TIME and FINE) with multiple active sites configurations were tested and evaluated for efficiency (selective recruitment of fascicles). We also investigated different policies of stimulation (monopolar and bipolar), as well as the optimal number of implants. Additionally, we optimized the existing simulation framework significantly reducing the computational load.

RESULTS

The main findings achieved through our modelling study include electrode manufacturing and surgical placement indications, together with beneficial stimulation policy of use. It results that TIME electrodes with 20 active sites are optimal for lower limb and the same number has been obtained for FINE electrodes. To interface the huge sciatic nerve, model indicates that 3 TIMEs is the optimal number of surgically implanted electrodes. Through the bipolar policy of stimulation, all studied configurations were gaining in the efficiency. Also, an indication for the optimized computation is given, which decreased the computation time by 80%.

CONCLUSIONS

This computational model suggests the optimal interfaces to use in human subjects with lower limb amputation, their surgical placement and beneficial bipolar policy of stimulation. It will potentially enable the clinical translation of the sensory neuroprosthetics towards the lower limb applications.

Advanced technologies for intuitive control and sensation of prosthetics

The Department of Defense, Department of Veterans Affairs and National Institutes of Health have invested significantly in advancing prosthetic technologies over the past 25 years, with the overall intent to improve the function, participation and quality of life of Service Members, Veterans, and all United States Citizens living with limb loss. These investments have contributed to substantial advancements in the control and sensory perception of prosthetic devices over the past decade. While control of motorized prosthetic devices through the use of electromyography has been widely available since the 1980s, this technology is not intuitive. Additionally, these systems do not provide stimulation for sensory perception. Recent research has made significant advancement not only in the intuitive use of electromyography for control but also in the ability to provide relevant meaningful perceptions through various stimulation approaches. While much of this previous work has traditionally focused on those with upper extremity amputation, new developments include advanced bidirectional neuroprostheses that are applicable to both the upper and lower limb amputation. The goal of this review is to examine the state-of-the-science in the areas of intuitive control and sensation of prosthetic devices and to discuss areas of exploration for the future. Current research and development efforts in external systems, implanted systems, surgical approaches, and regenerative approaches will be explored.

Morphological Neural Computation Restores Discrimination of Naturalistic Textures in Trans-radial Amputees

Humans rely on their sense of touch to interact with the environment. Thus, restoring lost tactile sensory capabilities in amputees would advance their quality of life. In particular, texture discrimination is an important component for the interaction with the environment, but its restoration in amputees has been so far limited to simplified gratings. Here we show that naturalistic textures can be discriminated by trans-radial amputees using intraneural peripheral stimulation and tactile sensors located close to the outer layer of the artificial skin. These sensors exploit the morphological neural computation (MNC) approach, i.e., the embodiment of neural computational functions into the physical structure of the device, encoding normal and shear stress to guarantee a faithful neural temporal representation of stimulus spatial structure. Two trans-radial amputees successfully discriminated naturalistic textures via the MNC-based tactile feedback. The results also allowed to shed light on the relevance of spike temporal encoding in the mechanisms used to discriminate naturalistic textures. Our findings pave the way to the development of more natural bionic limbs.

Restoring Finger-Specific Sensory Feedback for Transradial Amputees via Non-Invasive Evoked Tactile Sensation

Objective: This study assessed the feasibility to restore finger-specific sensory feedback in transradial amputees with electrical stimulation of evoked tactile sensation (ETS). Methods: Here we investigated primary somatosensory cortical (SI) responses of ETS using Magnetoencephalography. Results: SI activations revealed a causal correlation with peripheral stimulation of projected finger regions on the stump skin. Peak latency was accountable to neural transmission from periphery to SI. Peak intensity of SI response was proportional to the strength of peripheral stimulation, manifesting a direct neural pathway from skin receptors to SI neurons. Active regions in SI at the amputated side were consistent to the finger/hand map of homunculus, forming a mirror imaging to that of the contralateral hand. With sensory feedback, amputees can recognize a pressure at prosthetic fingers as that at the homonymous lost fingers. Conclusions: Results confirmed that the direct neural pathway from periphery to SI allows effective communication of finger-specific sensory information to these amputees.

Workshops of the Seventh International Brain-Computer Interface Meeting: Not Getting Lost in Translation

The Seventh International Brain-Computer Interface (BCI) Meeting was held May 21-25th, 2018 at the Asilomar Conference Grounds, Pacific Grove, California, United States. The interactive nature of this conference was embodied by 25 workshops covering topics in BCI (also called brain-machine interface) research. Workshops covered foundational topics such as hardware development and signal analysis algorithms, new and imaginative topics such as BCI for virtual reality and multi-brain BCIs, and translational topics such as clinical applications and ethical assumptions of BCI development. BCI research is expanding in the diversity of applications and populations for whom those applications are being developed. BCI applications are moving toward clinical readiness as researchers struggle with the practical considerations to make sure that BCI translational efforts will be successful. This paper summarizes each workshop, providing an overview of the topic of discussion, references for additional information, and identifying future issues for research and development that resulted from the interactions and discussion at the workshop.

DARPA investment in peripheral nerve interfaces for prosthetics, prescriptions, and plasticity

BACKGROUND

Peripheral nerve interfaces have emerged as alternative solutions for a variety of therapeutic and performance improvement applications. The Defense Advanced Research Projects Agency (DARPA) has widely invested in these interfaces to provide motor control and sensory feedback to prosthetic limbs, identify non-pharmacological interventions to treat disease, and facilitate neuromodulation to accelerate learning or improve performance on cognitive, sensory, or motor tasks. In this commentary, we highlight some of the design considerations for optimizing peripheral nerve interfaces depending on the application space. We also discuss the ethical considerations that accompany these advances.

Neural engineering: the process, applications, and its role in the future of medicine

OBJECTIVE

Recent advances in neural engineering have restored mobility to people with paralysis, relieved symptoms of movement disorders, reduced chronic pain, restored the sense of hearing, and provided sensory perception to individuals with sensory deficits.

APPROACH

This progress was enabled by the team-based, interdisciplinary approaches used by neural engineers. Neural engineers have advanced clinical frontiers by leveraging tools and discoveries in quantitative and biological sciences and through collaborations between engineering, science, and medicine. The movement toward bioelectronic medicines, where neuromodulation aims to supplement or replace pharmaceuticals to treat chronic medical conditions such as high blood pressure, diabetes and psychiatric disorders is a prime example of a new frontier made possible by neural engineering. Although one of the major goals in neural engineering is to develop technology for clinical applications, this technology may also offer unique opportunities to gain insight into how biological systems operate.

MAIN RESULTS

Despite significant technological progress, a number of ethical and strategic questions remain unexplored. Addressing these questions will accelerate technology development to address unmet needs. The future of these devices extends far beyond treatment of neurological impairments, including potential human augmentation applications. Our task, as neural engineers, is to push technology forward at the intersection of disciplines, while responsibly considering the readiness to transition this technology outside of the laboratory to consumer products.

SIGNIFICANCE

This article aims to highlight the current state of the neural engineering field, its links with other engineering and science disciplines, and the challenges and opportunities ahead. The goal of this article is to foster new ideas for innovative applications in neurotechnology.

A translational framework for peripheral nerve stimulating electrodes: Reviewing the journey from concept to clinic

The purpose of this review article is to describe the underlying methodology for successfully translating novel interfaces for electrical modulation of the peripheral nervous system (PNS) from basic design concepts to clinical applications and chronic human use. Despite advances in technologies to communicate directly with the nervous system, the pathway to clinical translation for most neural interfaces is not clear. FDA guidelines provide information on necessary evidence which should be generated and submitted to allow the agency evaluate safety and efficacy of a new medical device. However, a knowledge gap exists on translating neural interfaces from pre-clinical studies into the clinical domain. Our article is intended to inform the field on some of the key considerations for such a transition process specific to neural interfaces that may not be already covered by FDA guidances. This framework focuses on non-penetrating peripheral nerve stimulating electrodes that have been proven effective for motor and sensory neural prostheses and successfully transitioned from pre-clinical through first-in-human and chronic clinical deployment. We discuss the challenges of moving these neural interfaces along the translational continuum and ultimately through FDA approval for human feasibility studies. Specifically, we describe a translational process involving: quantitative human anatomy, neural modeling and simulation, acute intraoperative testing and verification, clinical demonstration with temporary percutaneous access, and finally chronic clinical deployment and functional performance. To clarify and demonstrate the importance of each step of this translational framework, we present case studies from electrodes developed at Case Western Reserve University (CWRU), specifically the spiral cuff, the Flat Interface Nerve Electrode (FINE), and the Composite FINE (C-FINE). In addition, we demonstrate that success along this translational pathway can be further expedited by: appropriate selection of well-characterized materials, validation of fabrication and sterilization protocols, well-implemented quality control measures, and quantification of impact on neural structure, health, and function. The issues and approaches identified in this review for the peripheral nervous system may also serve to accelerate the dissemination of any new neural interface into clinical practice, and consequently advance the performance, utility, and clinical value of new neural prostheses or neuromodulation systems.

Learning of Artificial Sensation Through Long-Term Home Use of a Sensory-Enabled Prosthesis

Upper limb prostheses are specialized tools, and skilled operation is learned by amputees over time. Recently, neural prostheses using implanted peripheral nerve interfaces have enabled advances in artificial somatosensory feedback that can improve prosthesis outcomes. However, the effect of sensory learning on artificial somatosensation has not been studied, despite its known influence on intact somatosensation and analogous neuroprostheses. Sensory learning involves changes in the perception and interpretation of sensory feedback and may further influence functional and psychosocial outcomes. In this mixed methods case study, we examined how passive learning over 115 days of home use of a neural-connected, sensory-enabled prosthetic hand influenced perception of artificial sensory feedback in a participant with transradial amputation. We examined perceptual changes both within individual days of use and across the duration of the study. At both time scales, the reported percept locations became significantly more aligned with prosthesis sensor locations, and the phantom limb became significantly more extended toward the prosthesis position. Similarly, the participant’s ratings of intensity, naturalness, and contact touch significantly increased, while his ratings of vibration and movement significantly decreased across-days for tactile channels. These sensory changes likely resulted from engagement of cortical plasticity mechanisms as the participant learned to use the artificial sensory feedback. We also assessed psychosocial and functional outcomes through surveys and interviews, and found that self-efficacy, perceived function, prosthesis embodiment, social touch, body image, and prosthesis efficiency improved significantly. These outcomes typically improved within the first month of home use, demonstrating rapid benefits of artificial sensation. Participant interviews indicated that the naturalness of the experience and engagement with the prosthesis increased throughout the study, suggesting that artificial somatosensation may decrease prosthesis abandonment. Our data showed that prosthesis embodiment was intricately related to naturalness and phantom limb perception, and that learning the artificial sensation may have modified the body schema. As another indicator of successfully learning to use artificial sensation, the participant reported the emergence of stereognosis later in the study. This study provides the first evidence that artificial somatosensation can undergo similar learning processes as intact sensation and highlights the importance of sensory restoration in prostheses.

Visual inputs and postural manipulations affect the location of somatosensory percepts elicited by electrical stimulation

The perception of somatosensation requires the integration of multimodal information, yet the effects of vision and posture on somatosensory percepts elicited by neural stimulation are not well established. In this study, we applied electrical stimulation directly to the residual nerves of trans-tibial amputees to elicit sensations referred to their missing feet. We evaluated the influence of congruent and incongruent visual inputs and postural manipulations on the perceived size and location of stimulation-evoked somatosensory percepts. We found that although standing upright may cause percept size to change, congruent visual inputs and/or body posture resulted in better localization. We also observed visual capture: the location of a somatosensory percept shifted toward a visual input when vision was incongruent with stimulation-induced sensation. Visual capture did not occur when an adopted posture was incongruent with somatosensation. Our results suggest that internal model predictions based on postural manipulations reinforce perceived sensations, but do not alter them. These characterizations of multisensory integration are important for the development of somatosensory-enabled prostheses because current neural stimulation paradigms cannot replicate the afferent signals of natural tactile stimuli. Nevertheless, multisensory inputs can improve perceptual precision and highlight regions of the foot important for balance and locomotion.