Direct neural sensory feedback and control of a prosthetic arm

A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback

Current myoelectric prostheses allow transradial amputees to regain voluntary motor control of their artificial limb by exploiting residual muscle function in the forearm. However, the overreliance on visual cues resulting from a lack of sensory feedback is a common complaint. Recently, several groups have provided tactile feedback in upper limb amputees using implanted electrodes, surface nerve stimulation, or sensory substitution. These approaches have led to improved function and prosthesis embodiment. Nevertheless, the provided information remains limited to a subset of the rich sensory cues available to healthy individuals. More specifically, proprioception, the sense of limb position and movement, is predominantly absent from current systems. Here, we show that sensory substitution based on intraneural stimulation can deliver position feedback in real time and in conjunction with somatotopic tactile feedback. This approach allowed two transradial amputees to regain high and close-to-natural remapped proprioceptive acuity, with a median joint angle reproduction precision of 9.1° and a median threshold to detection of passive movements of 9.5°, which was comparable with results obtained in healthy participants. The simultaneous delivery of position information and somatotopic tactile feedback allowed both amputees to discriminate the size and compliance of four objects with high levels of performance (75.5%). These results demonstrate that tactile information delivered via somatotopic neural stimulation and position information delivered via sensory substitution can be exploited simultaneously and efficiently by transradial amputees. This study paves a way to more sophisticated bidirectional bionic limbs conveying richer, multimodal sensations.

A skin-inspired tactile sensor for smart prosthetics

Recent achievements in the field of electronic skin have provided promising technology for prosthetic systems. However, the development of a bionic tactile-perception system that exhibits integrated stimuli sensing and neuron-like information-processing functionalities in a low-pressure regime remains a challenge. Here, we demonstrate a tactile sensor for smart prosthetics based on giant magneto-impedance (GMI) material embedded with an air gap. The sensor exhibits a high sensitivity of 120 newton^-1 (or 4.4 kilopascal^-1) and a very low detection limit of 10 micronewtons (or 0.3 pascals). The integration of the tactile sensor with an inductance-capacitance (LC) oscillation circuit enabled direct transduction of force stimuli into digital-frequency signals. The frequency increased with the force stimuli, consistent with the relationship between stimuli and human responses. The minimum loading of 50 micronewtons (or 1.25 pascals), which is less than the sensing threshold value of human skin, was also encoded into the frequency, similar to the pulse waveform of humans. The proposed tactile sensor not only showed desirable sensitivity and low detection limit but also exhibited transduction of digital-frequency signals like human stimuli responses. These features of the GMI-based tactile sensor show potential for its applications in smart prosthetics, especially prosthetic limbs that can functionally replace natural limbs.

Chronic Use of a Sensitized Bionic Hand Does Not Remap the Sense of Touch

Electrical stimulation of tactile nerve fibers that innervated an amputated hand results in vivid sensations experienced at a specific location on the phantom hand, a phenomenon that can be leveraged to convey tactile feedback through bionic hands. Ideally, electrically evoked sensations would be experienced on the appropriate part of the hand: touch with the bionic index fingertip, for example, would elicit a sensation experienced on the index fingertip. However, the perceived locations of sensations are determined by the idiosyncratic position of the stimulating electrode in the nerve and thus are difficult to predict or control. This problem could be circumvented if perceived sensations shifted over time to become consistent with the position of the sensor that triggers them. We show that, after long-term use of a neuromusculoskeletal prosthesis that featured a mismatch between the sensor location and the resulting tactile experience, the perceived location of the touch did not change.

Information about contact force and surface texture is mixed in the firing rates of cutaneous afferent neurons

Cutaneous mechanoreceptors in our hands gather information about the objects we handle. Tactile fibers encode mixed information about contact events and object properties. Neural coding in tactile afferents is typically studied by varying a single aspect of tactile stimuli, avoiding the confounds of real-world haptic interactions. We instead record responses of small populations of dorsal root ganglia (DRG) neurons to variable tactile stimuli and find that neurons primarily respond to force, though some texture information can be detected. Tactile nerve fibers convey information about many features of haptic interactions, including the force and speed of contact, as well as the texture and shape of the objects being handled. How we perceive these object features is relatively unaffected by the forces and movements we use when interacting with the object. Because signals related to contact events and object properties are mixed in the responses of tactile fibers, our ability to disentangle these different components of our tactile experience implies that they are demultiplexed as they propagate along the neuraxis. To understand how texture and contact mechanics are encoded together by tactile fibers, we studied the activity of multiple neurons recorded simultaneously in the cervical DRG of two anesthetized rhesus monkeys while textured surfaces were applied to the glabrous skin of the fingers and palm using a handheld probe. A transducer at the tip of the textured probe measured contact forces as tactile stimuli were applied at different locations on the finger-pads and palm. We examined how a sample population of DRG neurons encode force and texture and found that firing rates of individual neurons are modulated by both force and texture. In particular, slowly adapting (SA) neurons were more responsive to force than texture, and rapidly adapting (RA) neurons were more responsive to texture than force. Although force could be decoded accurately throughout the entire contact interval, texture signals were most salient during onset and offset phases of the contact interval.NEW & NOTEWORTHY Cutaneous mechanoreceptors in our hands gather information about the objects we handle. Tactile fibers encode mixed information about contact events and object properties. Neural coding in tactile afferents is typically studied by varying a single aspect of tactile stimuli, avoiding the confounds of real-world haptic interactions. We instead record responses of small populations of DRG neurons to variable tactile stimuli and find that neurons primarily respond to force, though some texture information can be detected.

Toward Closed-Loop Electrical Stimulation of Neuronal Systems: A Review

Biological neuronal cells communicate using neurochemistry and electrical signals. The same phenomena also allow us to probe and manipulate neuronal systems and communicate with them. Neuronal system malfunctions cause a multitude of symptoms and functional deficiencies that can be assessed and sometimes alleviated by electrical stimulation. Our working hypothesis is that real-time closed-loop full-duplex measurement and stimulation paradigms can provide more in-depth insight into neuronal networks and enhance our capability to control diseases of the nervous system. In this study, we review extracellular electrical stimulation methods used in in vivo, in vitro, and in silico neuroscience research and in the clinic (excluding methods mainly aimed at neuronal growth and other similar effects) and highlight the potential of closed-loop measurement and stimulation systems. A multitude of electrical stimulation and measurement-based methods are widely used in research and the clinic. Closed-loop methods have been proposed, and some are used in the clinic. However, closed-loop systems utilizing more complex measurement analysis and adaptive stimulation systems, such as artificial intelligence systems connected to biological neuronal systems, do not yet exist. Our review promotes the research and development of intelligent paradigms aimed at meaningful communications between neuronal and information and communications technology systems, "dialogical paradigms," which have the potential to take neuroscience and clinical methods to a new level.

A bioelectric neural interface towards intuitive prosthetic control for amputees

OBJECTIVE

While prosthetic hands with independently actuated digits have become commercially available, state-of-the-art human-machine interfaces (HMI) only permit control over a limited set of grasp patterns, which does not enable amputees to experience sufficient improvement in their daily activities to make an active prosthesis useful.

APPROACH

Here we present a technology platform combining fully-integrated bioelectronics, implantable intrafascicular microelectrodes and deep learning-based artificial intelligence (AI) to facilitate this missing bridge by tapping into the intricate motor control signals of peripheral nerves. The bioelectric neural interface includes an ultra-low-noise neural recording system to sense electroneurography (ENG) signals from microelectrode arrays implanted in the residual nerves, and AI models employing the recurrent neural network (RNN) architecture to decode the subject's motor intention.

MAIN RESULTS

A pilot human study has been carried out on a transradial amputee. We demonstrate that the information channel established by the proposed neural interface is sufficient to provide high accuracy control of a prosthetic hand up to 15 degrees of freedom (DOF). The interface is intuitive as it directly maps complex prosthesis movements to the patient's true intention.

SIGNIFICANCE

Our study layouts the foundation towards not only a robust and dexterous control strategy for modern neuroprostheses at a near-natural level approaching that of the able hand, but also an intuitive conduit for connecting human minds and machines through the peripheral neural pathways. (Clinical trial identifier: NCT02994160).

Wearable multichannel haptic device for encoding proprioception in the upper limb

OBJECTIVE

We present the design, implementation, and evaluation of a wearable multichannel haptic system. The device is a wireless closed-loop armband driven by surface electromyography (EMG) and provides sensory feedback encoding proprioception. The study is motivated by restoring proprioception information in upper limb prostheses.

APPROACH

The armband comprises eight vibrotactile actuators that generate distributed patterns of mechanical waves around the limb to stimulate perception and to transfer proportional information on the arm motion. An experimental study was conducted to assess: the sensory threshold in eight locations around the forearm, the user adaptation to the sensation provided by the device, the user performance in discriminating multiple stimulation levels, and the device performance in coding proprioception using four spatial patterns of stimulation. Eight able-bodied individuals performed reaching tasks by controlling a cursor with an EMG interface in a virtual environment. Vibrotactile patterns were tested with and without visual information on the cursor position with the addition of a random rotation of the reference control system to disturb the natural control and proprioception.

MAIN RESULTS

The sensation threshold depended on the actuator position and increased over time. The maximum resolution for stimuli discrimination was four. Using this resolution, four patterns of vibrotactile activation with different spatial and magnitude properties were generated to evaluate their performance in enhancing proprioception. The optimal vibration pattern varied among the participants. When the feedback was used in closed-loop control with the EMG interface, the task success rate, completion time, execution efficiency, and average target-cursor distance improved for the optimal stimulation pattern compared to the condition without visual or haptic information on the cursor position.

SIGNIFICANCE

The results indicate that the vibrotactile device enhanced the participants' perceptual ability, suggesting that the proposed closed-loop system has the potential to code proprioception and enhance user performance in the presence of perceptual perturbation.

W:Ti Flexible Transversal Electrode Array for Peripheral Nerve Stimulation: A Feasibility Study

The development of hardware for neural interfacing remains a technical challenge. We introduce a flexible, transversal intraneural tungsten:titanium electrode array for acute studies. We characterize the electrochemical properties of this new combination of tungsten and titanium using cyclic voltammetry and electrochemical impedance spectroscopy. With an in-vivo rodent study, we show that the stimulation of peripheral nerves with this electrode array is possible and that more than half of the electrode contacts can yield a stimulation selectivity index of 0.75 or higher at low stimulation currents. This feasibility study paves the way for the development of future cost-effective and easy-to-fabricate neural interfacing electrodes for acute settings, which ultimately can inform the development of technologies that enable bi-directional communication with the human nervous system.

Optimal Multichannel Artifact Prediction and Removal for Neural Stimulation and Brain Machine Interfaces

Neural implants that deliver multi-site electrical stimulation to the nervous systems are no longer the last resort but routine treatment options for various neurological disorders. Multi-site electrical stimulation is also widely used to study nervous system function and neural circuit transformations. These technologies increasingly demand dynamic electrical stimulation and closed-loop feedback control for real-time assessment of neural function, which is technically challenging since stimulus-evoked artifacts overwhelm the small neural signals of interest. We report a novel and versatile artifact removal method that can be applied in a variety of settings, from single- to multi-site stimulation and recording and for current waveforms of arbitrary shape and size. The method capitalizes on linear electrical coupling between stimulating currents and recording artifacts, which allows us to estimate a multi-channel linear Wiener filter to predict and subsequently remove artifacts via subtraction. We confirm and verify the linearity assumption and demonstrate feasibility in a variety of recording modalities, including in vitro sciatic nerve stimulation, bilateral cochlear implant stimulation, and multi-channel stimulation and recording between the auditory midbrain and cortex. We demonstrate a vast enhancement in the recording quality with a typical artifact reduction of 25-40 dB. The method is efficient and can be scaled to arbitrary number of stimulus and recording sites, making it ideal for applications in large-scale arrays, closed-loop implants, and high-resolution multi-channel brain-machine interfaces.

Neural feedback strategies to improve grasping coordination in neuromusculoskeletal prostheses

Conventional prosthetic arms suffer from poor controllability and lack of sensory feedback. Owing to the absence of tactile sensory information, prosthetic users must rely on incidental visual and auditory cues. In this study, we investigated the effect of providing tactile perception on motor coordination during routine grasping and grasping under uncertainty. Three transhumeral amputees were implanted with an osseointegrated percutaneous implant system for direct skeletal attachment and bidirectional communication with implanted neuromuscular electrodes. This neuromusculoskeletal prosthesis is a novel concept of artificial limb replacement that allows to extract control signals from electrodes implanted on viable muscle tissue, and to stimulate severed afferent nerve fibers to provide somatosensory feedback. Subjects received tactile feedback using three biologically inspired stimulation paradigms while performing a pick and lift test. The grasped object was instrumented to record grasping and lifting forces and its weight was either constant or unexpectedly changed in between trials. The results were also compared to the no-feedback control condition. Our findings confirm, in line with the neuroscientific literature, that somatosensory feedback is necessary for motor coordination during grasping. Our results also indicate that feedback is more relevant under uncertainty, and its effectiveness can be influenced by the selected neuromodulation paradigm and arguably also the prior experience of the prosthesis user.

Host tissue response to floating microelectrode arrays chronically implanted in the feline spinal nerve

OBJECTIVE

Neural interfacing technologies could significantly improve quality of life for people living with the loss of a limb. Both motor commands and sensory feedback must be considered; these complementary systems are segregated from one another in the spinal nerve.

APPROACH

The dorsal root ganglion-ventral root (DRG-VR) complex was targeted chronically with floating microelectrode arrays designed to record from motor neuron axons in the VR or stimulate sensory neurons in the DRG. Hematoxylin and eosin and Nissl/Luxol fast blue staining were performed. Characterization of the tissue response in regions of interest and pixel-based image analyses were used to quantify MAC387 (monocytes/macrophages), NF200 (axons), S100 (Schwann cells), vimentin (fibroblasts, endothelial cells, astrocytes), and GLUT1 (glucose transport proteins) reactivity. Implanted roots were compared to non-implanted roots and differences between the VR and DRG examined.

MAIN RESULTS

The tissue response associated with chronic array implantation in this peripheral location is similar to that observed in central nervous system locations. Markers of inflammation were increased in implanted roots relative to control roots with MAC387 positive cells distributed throughout the region corresponding to the device footprint. Significant decreases in neuronal density and myelination were observed in both the VR, which contains only neuronal axons, and the DRG, which contains both neuronal axons and cell bodies. Notably, decreases in NF200 in the VR were observed only at implant times less than ten weeks. Observations related to the blood-nerve barrier and tissue integrity suggest that tissue remodeling occurs, particularly in the VR.

SIGNIFICANCE

This study was designed to assess the viability of the DRG-VR complex as a site for neural interfacing applications and suggests that continued efforts to mitigate the tissue response will be critical to achieve the overall goal of a long-term, reliable neural interface.

A Review of Sensory Feedback in Upper-Limb Prostheses From the Perspective of Human Motor Control

This manuscript reviews historical and recent studies that focus on supplementary sensory feedback for use in upper limb prostheses. It shows that the inability of many studies to speak to the issue of meaningful performance improvements in real-life scenarios is caused by the complexity of the interactions of supplementary sensory feedback with other types of feedback along with other portions of the motor control process. To do this, the present manuscript frames the question of supplementary feedback from the perspective of computational motor control, providing a brief review of the main advances in that field over the last 20 years. It then separates the studies on the closed-loop prosthesis control into distinct categories, which are defined by relating the impact of feedback to the relevant components of the motor control framework, and reviews the work that has been done over the last 50+ years in each of those categories. It ends with a discussion of the studies, along with suggestions for experimental construction and connections with other areas of research, such as machine learning.

The future of upper extremity rehabilitation robotics: research and practice

The loss of upper limb motor function can have a devastating effect on people's lives. To restore upper limb control and functionality, researchers and clinicians have developed interfaces to interact directly with the human body's motor system. In this invited review, we aim to provide details on the peripheral nerve interfaces and brain-machine interfaces that have been developed in the past 30 years for upper extremity control, and we highlight the challenges that still remain to transition the technology into the clinical market. The findings show that peripheral nerve interfaces and brain-machine interfaces have many similar characteristics that enable them to be concurrently developed. Decoding neural information from both interfaces may lead to novel physiological models that may one day fully restore upper limb motor function for a growing patient population.

Psychophysical principles of discrete event-driven vibrotactile feedback for prostheses

Purpose/aim of the study: We aimed to establish psychophysical principles for non-invasive vibrotactile feedback signalling discrete transition events (e.g., extension to flexion) during use of prostheses, especially for the upper limbs.Materials and methods: Two vibrotactile actuators were used on both upper arms of 10 able-bodied human participants. Absolute thresholds, psychometric functions, and magnitude estimates were measured to equalize the sensation magnitudes for the tested vibrotactile frequencies and skin sites. Then, same-different and pattern recognition tasks were run to evaluate, respectfully, the discrimination and closed-set identification of stimuli with varying parameters (2 frequencies, 2 magnitudes, 2 sites). Finally, parameters of the left/right stimuli were mapped to hypothetical prosthesis events representing object/force and movement type. The stimuli were applied sequentially in accordance with the discrete event-driven feedback paradigm.Results: Reliable psychophysical models could be established for individual participants as verified by repetitive threshold measurements and relative adjustment of stimulus levels based on sensation magnitudes. Discrimination accuracy was higher for magnitude versus frequency comparisons; and magnitude discrimination accuracy was correlated with magnitude estimate differences. Pattern recognition recall/precision rates decreased from ∼0.7 to ∼0.5 for sequential delivery of two stimulus patterns to one arm versus to two arms. Using the patterns as two and three consecutive prosthesis events yielded statistically similar performance rates not correlated with magnitude estimate differences.Conclusions: By careful calibration of stimuli based on psychophysical principles, discrete event-driven vibrotactile feedback can be used to signal manipulated object and movement information with moderate identification rates as shown by confusion matrices.

Sensory- and Action-Oriented Embodiment of Neurally-Interfaced Robotic Hand Prostheses

Embodiment is the percept that something not originally belonging to the self becomes part of the body. Feeling embodiment for a prosthesis may counteract amputees' altered image of the body and increase prosthesis acceptability. Prosthesis embodiment has been studied longitudinally in an amputee receiving feedback through intraneural and perineural multichannel electrodes implanted in her stump. Three factors-invasive (vs non-invasive) stimulation, training, and anthropomorphism-have been tested through two multisensory integration tasks: visuo-tactile integration (VTI) and crossing-hand effect in temporal order judgment (TOJ), the former more sensible to an extension of a safe margin around the body and the latter to action-oriented remapping. Results from the amputee participant were compared with the ones from healthy controls. Testing the participant with intraneural stimulation produced an extension of peripersonal space, a sign of prosthesis embodiment. One-month training extended the peripersonal space selectively on the side wearing the prostheses. More and less-anthropomorphic prostheses benefited of intraneural feedback and extended the peripersonal space. However, the worsening of TOJ performance following arm crossing was present only wearing the more trained, despite less anthropomorphic, prosthesis, suggesting that training was critical for our participant to achieve operative tool-like embodiment.

Real-Time Hand Gesture Recognition Using Surface Electromyography and Machine Learning: A Systematic Literature Review

Today, daily life is composed of many computing systems, therefore interacting with them in a natural way makes the communication process more comfortable. Human-Computer Interaction (HCI) has been developed to overcome the communication barriers between humans and computers. One form of HCI is Hand Gesture Recognition (HGR), which predicts the class and the instant of execution of a given movement of the hand. One possible input for these models is surface electromyography (EMG), which records the electrical activity of skeletal muscles. EMG signals contain information about the intention of movement generated by the human brain. This systematic literature review analyses the state-of-the-art of real-time hand gesture recognition models using EMG data and machine learning. We selected and assessed 65 primary studies following the Kitchenham methodology. Based on a common structure of machine learning-based systems, we analyzed the structure of the proposed models and standardized concepts in regard to the types of models, data acquisition, segmentation, preprocessing, feature extraction, classification, postprocessing, real-time processing, types of gestures, and evaluation metrics. Finally, we also identified trends and gaps that could open new directions of work for future research in the area of gesture recognition using EMG.

Decoding of grasping tasks from intraneural recordings in trans-radial amputee

OBJECTIVE

A major challenge in neuroprosthetics is the restoration of sensory-motor hand functions in upper-limb amputees. Neuroprostheses based on the direct re-connection of the peripheral nerves may be an interesting approach for re-establishing the natural and effective bidirectional control of hand prostheses. Recent results have shown that transverse intrafascicular multi-channel electrodes (TIMEs) can restore natural and sophisticated sensory feedback. However, the potential of using TIME-recorded motor intraneural signals to decode grasping tasks has not as yet been explored.

APPROACH

In this study, we show that several hand-movement intentions can be decoded from intraneural signals recorded using four TIMEs implanted in the median and ulnar nerves of an upper limb amputee. Experimental sessions were performed over a week, from day 16 to day 23 after the surgical operation. Intraneural activity was recorded during several hand motor tasks imagined by the subject and processed offline.

MAIN RESULTS

We obtained a very high decoding accuracy considering 11 class states (up to 83%). These results confirm that neural signals recorded by multi-channel intraneural electrodes can be used to decode several movement intentions with high accuracy. Moreover, we were able to use same TIME channels for decoding over one week within the first month, even if the stability has to be confirmed during long-term experiments.

SIGNIFICANCE

Therefore, TIMEs could be used in the future to achieve a complete bidirectional approach exploiting neural pathways, to make a more natural and intuitive new generation of hand prostheses that have a closer resemblance to a healthy hand.

Restoring Somatosensation: Advantages and Current Limitations of Targeting the Brainstem Dorsal Column Nuclei Complex

Current neural prostheses can restore limb movement to tetraplegic patients by translating brain signals coding movements to control a variety of actuators. Fast and accurate somatosensory feedback is essential for normal movement, particularly dexterous tasks, but is currently lacking in motor neural prostheses. Attempts to restore somatosensory feedback have largely focused on cortical stimulation which, thus far, have succeeded in eliciting minimal naturalistic sensations. Yet, a question that deserves more attention is whether the cortex is the best place to activate the central nervous system to restore somatosensation. Here, we propose that the brainstem dorsal column nuclei are an ideal alternative target to restore somatosensation. We review some of the recent literature investigating the dorsal column nuclei functional organization and neurophysiology and highlight some of the advantages and limitations of the dorsal column nuclei as a future neural prosthetic target. Recent evidence supports the dorsal column nuclei as a potential neural prosthetic target, but also identifies several gaps in our knowledge as well as potential limitations which need to be addressed before such a goal can become reality.

Fabrication of the Composite Regenerative Peripheral Nerve Interface (C-RPNI) in the Adult Rat

Recent advances in neuroprosthetics have enabled those living with extremity loss to reproduce many functions native to the absent extremity, and this is often accomplished through integration with the peripheral nervous system. Unfortunately, methods currently employed are often associated with significant tissue damage which prevents prolonged use. Additionally, these devices often lack any meaningful degree of sensory feedback as their complex construction dampens any vibrations or other sensations a user may have previously depended on when using more simple prosthetics. The composite regenerative peripheral nerve interface (C-RPNI) was developed as a stable, biologic construct with the ability to amplify efferent motor nerve signals while providing simultaneous afferent sensory feedback. The C-RPNI consists of a segment of free dermal and muscle graft secured around a target mixed sensorimotor nerve, with preferential motor nerve reinnervation of the muscle graft and sensory nerve reinnervation of the dermal graft. In rats, this construct has demonstrated the generation of compound muscle action potentials (CMAPs), amplifying the target nerve's signal from the micro- to milli-volt level, with signal to noise ratios averaging approximately 30-50. Stimulation of the dermal component of the construct generates compound sensory nerve action potentials (CSNAPs) at the proximal nerve. As such, this construct has promising future utility towards the realization of the ideal, intuitive prosthetic.

Morphological Neural Computation Restores Discrimination of Naturalistic Textures in Trans-radial Amputees

Humans rely on their sense of touch to interact with the environment. Thus, restoring lost tactile sensory capabilities in amputees would advance their quality of life. In particular, texture discrimination is an important component for the interaction with the environment, but its restoration in amputees has been so far limited to simplified gratings. Here we show that naturalistic textures can be discriminated by trans-radial amputees using intraneural peripheral stimulation and tactile sensors located close to the outer layer of the artificial skin. These sensors exploit the morphological neural computation (MNC) approach, i.e., the embodiment of neural computational functions into the physical structure of the device, encoding normal and shear stress to guarantee a faithful neural temporal representation of stimulus spatial structure. Two trans-radial amputees successfully discriminated naturalistic textures via the MNC-based tactile feedback. The results also allowed to shed light on the relevance of spike temporal encoding in the mechanisms used to discriminate naturalistic textures. Our findings pave the way to the development of more natural bionic limbs.

Restoring Finger-Specific Sensory Feedback for Transradial Amputees via Non-Invasive Evoked Tactile Sensation

Objective: This study assessed the feasibility to restore finger-specific sensory feedback in transradial amputees with electrical stimulation of evoked tactile sensation (ETS). Methods: Here we investigated primary somatosensory cortical (SI) responses of ETS using Magnetoencephalography. Results: SI activations revealed a causal correlation with peripheral stimulation of projected finger regions on the stump skin. Peak latency was accountable to neural transmission from periphery to SI. Peak intensity of SI response was proportional to the strength of peripheral stimulation, manifesting a direct neural pathway from skin receptors to SI neurons. Active regions in SI at the amputated side were consistent to the finger/hand map of homunculus, forming a mirror imaging to that of the contralateral hand. With sensory feedback, amputees can recognize a pressure at prosthetic fingers as that at the homonymous lost fingers. Conclusions: Results confirmed that the direct neural pathway from periphery to SI allows effective communication of finger-specific sensory information to these amputees.

DRG microstimulation evokes postural responses in awake, standing felines

Objective.

We have demonstrated previously that microstimulation in the dorsal root ganglia (DRG) can selectively evoke activity in primary afferent neurons in anesthetized cats. This study describes the results of experiments focused on characterizing the postural effects of DRG microstimulation in awake cats during quiet standing.

Approach.

To understand the parameters of stimulation that can affect these postural shifts, we measured changes in ground reaction forces (GRF) while varying stimulation location and amplitude. Four animals were chronically implanted at the L6 and L7 DRG with penetrating multichannel microelectrode arrays. During each week of testing, we identified electrode channels that recruited primary afferent neurons with fast (80–120 m s⁻¹) and medium (30–75 m s⁻¹) conduction velocities, and selected one channel to deliver current-controlled biphasic stimulation trains during quiet standing.

Main results.

Postural responses were identified by changes in GRFs and were characterized based on their magnitude and latency. During DRG microstimulation, animals did not exhibit obvious signs of distress or discomfort, which could be indicative of pain or aversion to a noxious sensation. Across 56 total weeks, 13 electrode channels evoked behavioral responses, as detected by a significant change in GRF. Stimulation amplitude modulated the magnitude of the GRF responses for these 13 channels (p < 0.001). It was not possible to predict whether or not an electrode would drive a behavioral response based on information including conduction velocity, recruitment threshold, or the DRG in which it resided.

Significance.

The distinct and repeatable effects on the postural response to low amplitude (<40 μA) DRG microstimulation support that this technique may be an effective way to restore somatosensory feedback after neurological injuries such as amputation.

Characterization of multi-channel intraneural stimulation in transradial amputees

Although peripheral nerve stimulation using intraneural electrodes has been shown to be an effective and reliable solution to restore sensory feedback after hand loss, there have been no reports on the characterization of multi-channel stimulation. A deeper understanding of how the simultaneous stimulation of multiple electrode channels affects the evoked sensations should help in improving the definition of encoding strategies for bidirectional prostheses. We characterized the sensations evoked by simultaneous stimulation of median and ulnar nerves (multi-channel configuration) in four transradial amputees who had been implanted with four TIMEs (Transverse Intrafascicular Multichannel Electrodes). The results were compared with the characterization of single-channel stimulation. The sensations were characterized in terms of location, extent, type, and intensity. Combining two or more single-channel configurations caused a linear combination of the sensation locations and types perceived with such single-channel stimulations. Interestingly, this was also true when two active sites from the same nerve were stimulated. When stimulating in multi-channel configuration, the charge needed from each electrode channel to evoke a sensation was significantly lower than the one needed in single-channel configuration (sensory facilitation). This result was also supported by electroencephalography (EEG) recordings during nerve stimulation. Somatosensory potentials evoked by multi-channel stimulation confirmed that sensations in the amputated hand were perceived by the subjects and that a perceptual sensory facilitation occurred. Our results should help the future development of more efficient bidirectional prostheses by providing guidelines for the development of more complex stimulation approaches to effectively restore multiple sensations at the same time.

Selectivity of afferent microstimulation at the DRG using epineural and penetrating electrode arrays

OBJECTIVE

We have shown previously that microstimulation of the lumbar dorsal root ganglia (L5-L7 DRG) using penetrating microelectrodes, selectively recruits distal branches of the sciatic and femoral nerves in an acute preparation. However, a variety of challenges limit the clinical translatability of DRG microstimulation via penetrating electrodes. For clinical translation of a DRG somatosensory neural interface, electrodes placed on the epineural surface of the DRG may be a viable path forward. The goal of this study was to evaluate the recruitment properties of epineural electrodes and compare their performance with that of penetrating electrodes. Here, we compare the number of selectively recruited distal nerve branches and the threshold stimulus intensities between penetrating and epineural electrode arrays.

APPROACH

Antidromically propagating action potentials were recorded from multiple distal branches of the femoral and sciatic nerves in response to epineural stimulation on 11 ganglia in four cats to quantify the selectivity of DRG stimulation. Compound action potentials (CAPs) were recorded using nerve cuff electrodes implanted around up to nine distal branches of the femoral and sciatic nerve trunks. We also tested stimulation selectivity with penetrating microelectrode arrays implanted into ten ganglia in four cats. A binary search was carried out to identify the minimum stimulus intensity that evoked a response at any of the distal cuffs, as well as whether the threshold response selectively occurred in only a single distal nerve branch.

MAIN RESULTS

Stimulation evoked activity in just a single peripheral nerve through 67% of epineural electrodes (35/52) and through 79% of the penetrating microelectrodes (240/308). The recruitment threshold (median  =  9.67 nC/phase) and dynamic range of epineural stimulation (median  =  1.01 nC/phase) were significantly higher than penetrating stimulation (0.90 nC/phase and 0.36 nC/phase, respectively). However, the pattern of peripheral nerves recruited for each DRG were similar for stimulation through epineural and penetrating electrodes.

SIGNIFICANCE

Despite higher recruitment thresholds, epineural stimulation provides comparable selectivity and superior dynamic range to penetrating electrodes. These results suggest that it may be possible to achieve a highly selective neural interface with the DRG without penetrating the epineurium.

Implantable Neural Interfaces and Wearable Tactile Systems for Bidirectional Neuroprosthetics Systems

Neuroprosthetics and neuromodulation represent a promising field for several related applications in the central and peripheral nervous system, such as the treatment of neurological disorders, the control of external robotic devices, and the restoration of lost tactile functions. These actions are allowed by the neural interface, a miniaturized implantable device that most commonly exploits electrical energy to fulfill these operations. A neural interface must be biocompatible, stable over time, low invasive, and highly selective; the challenge is to develop a safe, compact, and reliable tool for clinical applications. In case of anatomical impairments, neuroprosthetics is bound to the need of exploring the surrounding environment by fast-responsive and highly sensitive artificial tactile sensors that mimic the natural sense of touch. Tactile sensors and neural interfaces are closely interconnected since the readouts from the first are required to convey information to the neural implantable apparatus. The role of these devices is pivotal hence technical improvements are essential to ensure a secure system to be eventually adopted in daily life. This review highlights the fundamental criteria for the design and microfabrication of neural interfaces and artificial tactile sensors, their use in clinical applications, and future enhancements for the release of a second generation of devices.

Spatiotemporal characteristics of neural activity in tibial nerves with carbon nanotube yarn electrodes

BACKGROUND

Reliable interfacing with peripheral nervous system is essential to extract neural signals. Current implantable peripheral nerve electrodes cannot provide long-term reliable interfaces due to their mechanical mismatch with host nerves. Carbon nanotube (CNT) yarns possess excellent mechanical flexibility and electrical conductivity. It is of great necessity to investigate the selectivity of implantable CNT yarn electrodes.

NEW METHOD

Neural interfaces were fabricated with CNT yarn electrodes insulated with Parylene-C. Acute recordings were carried out on tibial nerves of rats, and compound nerve action potentials (CNAPs) were electrically evoked by biphasic current stimulation of four toes. Spatiotemporal characteristics of neural activity and spatial selectivity of the electrodes, denoted by selectivity index (SI), were analyzed in detail.

RESULTS

Conduction velocities of sensory afferent fibers recorded by CNT yarn electrodes varied between 4.25 m/s and 37.56 m/s. The SI maxima for specific toes were between 0.55 and 0.99 across seven electrodes. SIs for different CNT yarn electrodes are significantly different among varied toes.

COMPARISON WITH EXISTING METHODS

Most single CNT yarn electrode with a ∼ 500 μm exposed length can be sensitive to one or two specific toes in rodent animals. While, it is only possible to discriminate two non-adjacent toes by multisite TIME electrodes.

CONCLUSION

Single CNT yarn electrode exposed ∼ 500 μm showed SI values for different toes comparable to a multisite TIME electrode, and had high spatial selectivity for one or two specific toes. The electrodes with cross section exposed could intend to be more sensitive to one specific toe.

Peripheral Neural Interface

Peripheral nervous system, widely spread in the whole body, is the important bridge for the transmission of neural signals. Signals from the central nervous system (brain and spinal cord) are transmitted to different parts of the body by the peripheral nerves, while along the way they also feedback all kinds of sensory information. Certain level of information integration and processing also occurs in the system. It has been shown that neural signals could be extracted from the distal end of the stump, indicating that the bridge is still effective after limb damage or amputation, which is the neurophysiological basis for the research and development of peripheral nerve interface for the prosthetic system.

Effect of vibration characteristics and vibror arrangement on the tactile perception of the upper arm in healthy subjects and upper limb amputees

Background

Vibrotactile stimulation is a promising venue in the field of prosthetics to retrain sensory feedback deficits following amputation. Discrimination is well established at the forearm level but not at the upper arm level. Moreover, the effects of combining vibration characteristics such as duration and intensity has never been investigated.

Method

We conducted experiments on spatial discrimination (experiment 1) and tactile intensity perception (experiment 2), using 9 combinations of 3 intensities and 3 durations of vibror stimulations device. Those combinations were tested under 4 arrangements with an array of 6 vibrors. In both experiments, linear orientation aligned with the upper arm longitudinal axis were compared to circular orientation on the upper arm circumference. For both orientations, vibrors were placed either with 3cm space between the center of 2 vibrors or proportionally to the length or the circumference of the subject upper arm. Eleven heathy subjects underwent the 2 experiments and 7 amputees (humeral level) participated in the spatial discrimination task with the best arrangement found.

Results

Experiment 1 revealed that circular arrangements elicited better scores than the linear ones. Arrangements with vibrors spaced proportionally elicited better scores (up to 75% correct) than those with 3 cm spacing. Experiment 2, showed that the perceived intensity of the vibration increases with the intensity of the vibrors’ activation, but also with their duration of activation. The 7 patients obtained high scores (up to 91.67% correct) with the circular proportional (CP) arrangement.

Discussion

These results highlight that discrete and short vibrations can be well discriminated by healthy subjects and people with an upper limb amputation. These new characteristics of vibrations have great potential for future sensory substitution application in closed-loop prosthetic control.

Neural engineering: the process, applications, and its role in the future of medicine

OBJECTIVE

Recent advances in neural engineering have restored mobility to people with paralysis, relieved symptoms of movement disorders, reduced chronic pain, restored the sense of hearing, and provided sensory perception to individuals with sensory deficits.

APPROACH

This progress was enabled by the team-based, interdisciplinary approaches used by neural engineers. Neural engineers have advanced clinical frontiers by leveraging tools and discoveries in quantitative and biological sciences and through collaborations between engineering, science, and medicine. The movement toward bioelectronic medicines, where neuromodulation aims to supplement or replace pharmaceuticals to treat chronic medical conditions such as high blood pressure, diabetes and psychiatric disorders is a prime example of a new frontier made possible by neural engineering. Although one of the major goals in neural engineering is to develop technology for clinical applications, this technology may also offer unique opportunities to gain insight into how biological systems operate.

MAIN RESULTS

Despite significant technological progress, a number of ethical and strategic questions remain unexplored. Addressing these questions will accelerate technology development to address unmet needs. The future of these devices extends far beyond treatment of neurological impairments, including potential human augmentation applications. Our task, as neural engineers, is to push technology forward at the intersection of disciplines, while responsibly considering the readiness to transition this technology outside of the laboratory to consumer products.

SIGNIFICANCE

This article aims to highlight the current state of the neural engineering field, its links with other engineering and science disciplines, and the challenges and opportunities ahead. The goal of this article is to foster new ideas for innovative applications in neurotechnology.

Fascicle specific targeting for selective peripheral nerve stimulation

OBJECTIVE

Electrical stimulation is a blunt tool for evoking neural activity. Neurons are naturally activated asynchronously and non-uniformly, whereas stimulation drives simultaneous activity within a population of cells. These differences in activation pattern can result in unintended side effects, including muddled sensory percepts and undesirable muscle contractions. These effects can be mitigated by the placement of electrodes in close approximation to nerve fibers and careful selection of the neural interface's location. This work describes the benefits of placing electrodes within specific fascicles of peripheral nerve to form selective neural interfaces for bidirectional neuroprosthetic devices.

APPROACH

Chronic electrodes were targeted to individual fascicles of the ulnar and median nerves in the forearm of four human subjects. During the surgical implant procedure, fascicles were dissected from each nerve, and functional testing was used to identify the relative composition of sensory and motor fibers within each. FAST-LIFE arrays, composed of longitudinal intrafascicular arrays and fascicular cuff electrodes, were implanted in each fascicle. The location, quality, and stimulation parameters associated with sensations evoked by electrical stimulation on these electrodes were characterized throughout the 90-180 d implant period.

MAIN RESULTS

FAST-LIFE arrays enable selective and chronic electrical stimulation of individual peripheral nerve fascicles. The quality of sensations evoked by stimulation in each fascicle is predictable and distinct; subjects reported tactile and cutaneous sensations during stimulation of sensory fascicles and deeper proprioceptive sensations during stimulation of motor fascicles. Stimulation thresholds and strength-duration time constants were typically higher within sensory fascicles.

SIGNIFICANCE

Highly selective, stable neural interfaces can be created by placing electrodes within and around single fascicles of peripheral nerves. This method enables targeting electrodes to nerve fibers that innervate a specific body region or have specific functions. Fascicle-specific interfacing techniques have broad potential to maximize the therapeutic effects of electrical stimulation in many neuromodulation applications. (Clinical Trial ID NCT02994160.).

Motorized Biomechatronic Upper and Lower Limb Prostheses-Clinically Relevant Outcomes

People with major limb amputations are severely impaired when it comes to activity, body structure and function, as well as participation. Demographic statistics predict a dramatic increase of this population and additional challenges with their increasing age and higher levels of amputation. Prosthetic use has been shown to have a positive impact on mobility and depression, thereby affecting the quality of life. Biomechatronic prostheses are at the forefront of prosthetic development. Actively powered designs are now regularly used for upper limb prosthetic fittings, whereas for lower limbs the clinical use of actively powered prostheses has been limited to a very low number of applications. Actively powered prostheses enhance restoration of the lost physical functions of an amputee but are yet to allow intuitive user control. This paper provides a review of the status of biomechatronic developments in upper and lower limb prostheses in the context of the various challenges of amputation and the clinically relevant outcomes. Whereas most of the evidence regarding lower limb prostheses addresses biomechanical issues, the evidence for upper limb prostheses relates to activities of daily living (ADL) and instrumental ADL through diverse outcome measures and tools.

Enhancing functional abilities and cognitive integration of the lower limb prosthesis

Lower limb amputation (LLA) destroys the sensory communication between the brain and the external world during standing and walking. Current prostheses do not restore sensory feedback to amputees, who, relying on very limited haptic information from the stump-socket interaction, are forced to deal with serious issues: the risk of falls, decreased mobility, prosthesis being perceived as an external object (low embodiment), and increased cognitive burden. Poor mobility is one of the causes of eventual device abandonment. Restoring sensory feedback from the missing leg of above-knee (transfemoral) amputees and integrating the sensory feedback into the sensorimotor loop would markedly improve the life of patients. In this study, we developed a leg neuroprosthesis, which provided real-time tactile and emulated proprioceptive feedback to three transfemoral amputees through nerve stimulation. The feedback was exploited in active tasks, which proved that our approach promoted improved mobility, fall prevention, and agility. We also showed increased embodiment of the lower limb prosthesis (LLP), through phantom leg displacement perception and questionnaires, and ease of the cognitive effort during a dual-task paradigm, through electroencephalographic recordings. Our results demonstrate that induced sensory feedback can be integrated at supraspinal levels to restore functional abilities of the missing leg. This work paves the way for further investigations about how the brain interprets different artificial feedback strategies and for the development of fully implantable sensory-enhanced leg neuroprostheses, which could drastically ameliorate life quality in people with disability.

Illusory movement perception improves motor control for prosthetic hands

To effortlessly complete an intentional movement, the brain needs feedback from the body regarding the movement's progress. This largely nonconscious kinesthetic sense helps the brain to learn relationships between motor commands and outcomes to correct movement errors. Prosthetic systems for restoring function have predominantly focused on controlling motorized joint movement. Without the kinesthetic sense, however, these devices do not become intuitively controllable. We report a method for endowing human amputees with a kinesthetic perception of dexterous robotic hands. Vibrating the muscles used for prosthetic control via a neural-machine interface produced the illusory perception of complex grip movements. Within minutes, three amputees integrated this kinesthetic feedback and improved movement control. Combining intent, kinesthesia, and vision instilled participants with a sense of agency over the robotic movements. This feedback approach for closed-loop control opens a pathway to seamless integration of minds and machines.

A rat model for assessing the long-term safety and performance of peripheral nerve electrode arrays

BACKGROUND

High-resolution peripheral nerve interfaces (PNIs) can provide amputees with intuitive motor control and sensory feedback. Current PNIs are limited by early device failure and suboptimal long-term stability. The present study aims to incorporate functional assessment into an in vivo test platform to assess the long-term safety and performance of PNIs for recording and stimulation.

NEW METHODS

Utah electrode arrays (EA) were implanted in the rat sciatic nerve along with electromyography wires in the gastrocnemius and tibialis anterior. Cranial EEG screws were implanted in the somatosensory cortex for 12 weeks. Spontaneous neural activity was recorded using the implanted EA and stimulation-induced activity was monitored throughout the experiment. The impedance of each electrode was measured, and nerve function tests were conducted throughout the EA lifetime. Post-hoc safety assessments included scanning electron microscopy (SEM) of the EA and nerve histomorphometric analysis.

RESULTS

EA recordings were stable, and stimulation with EA elicited somatosensory evoked potentials and muscle contractions. Motor and sensory function tests indicated minimal deficits. Histomorphometric analysis indicated changes in nerve microstructure. SEM indicated EA-tip fracture, while lead wire breakage primarily caused device failure.

COMPARISON WITH EXISTING METHODS

We improved our prior platform with the addition of functional assessments of sensory pathways, a robust EMG array design to increase device longevity, and quantitative analysis of nerve microstructure.

CONCLUSION

We present a test platform for long-term assessment of peripheral nerve interfaces for stimulation and recording. Using this platform, we demonstrate recording and stimulation with minimal impact on nerve function, while EA lead wire breakage and tip fracture could limit long-term device use.

Visual inputs and postural manipulations affect the location of somatosensory percepts elicited by electrical stimulation

The perception of somatosensation requires the integration of multimodal information, yet the effects of vision and posture on somatosensory percepts elicited by neural stimulation are not well established. In this study, we applied electrical stimulation directly to the residual nerves of trans-tibial amputees to elicit sensations referred to their missing feet. We evaluated the influence of congruent and incongruent visual inputs and postural manipulations on the perceived size and location of stimulation-evoked somatosensory percepts. We found that although standing upright may cause percept size to change, congruent visual inputs and/or body posture resulted in better localization. We also observed visual capture: the location of a somatosensory percept shifted toward a visual input when vision was incongruent with stimulation-induced sensation. Visual capture did not occur when an adopted posture was incongruent with somatosensation. Our results suggest that internal model predictions based on postural manipulations reinforce perceived sensations, but do not alter them. These characterizations of multisensory integration are important for the development of somatosensory-enabled prostheses because current neural stimulation paradigms cannot replicate the afferent signals of natural tactile stimuli. Nevertheless, multisensory inputs can improve perceptual precision and highlight regions of the foot important for balance and locomotion.

High-charge-capacity sputtered iridium oxide neural stimulation electrodes deposited using water vapor as a reactive plasma constituent

The deposition and properties of sputtered iridium oxide films (SIROFs) using water vapor as a reactive gas constituent are investigated for their potential as high-charge-capacity neural stimulation electrodes. Systematic investigation through a series of optical and electrochemical measurements reveals that the incorporation of water vapor as a reactive gas constituent, along with oxygen, alters the reduction-oxidation (redox) state of the plasma as well as its morphology and the electrochemical characteristics, including the cathodal charge-storage capacity (CSC_c ) and charge-injection capacity (CIC), of the SIROF. An apparent optimal O₂ :H₂ O gas ratio of 1:3 produced SIROF with a CSC_c of 182.0 mC cm^-2 μm^-1 (median, Q1 = 172.5, Q3 = 193.4, n = 15) and a CIC of 3.57 mC cm^-2 (median, Q1 = 2.97, Q3 = 4.58, n = 12) for 300-nm-thick films. These values are higher than those obtained with SIROFs deposited using no water vapor by a factor of 2.3 and 1.7 for the CSC_c and CIC, respectively. Additionally, the SIROF showed minimal changes in electrochemical characteristics over 10⁹ pulses of constant current stimulation and showed no indication of cytotoxicity toward primary cortical neurons in a cell viability assay. These results warrant investigation of the chronic recording and stimulation capabilities of the SIROF for implantable microelectrode arrays.

Biomimetic sensory feedback through peripheral nerve stimulation improves dexterous use of a bionic hand

We describe use of a bidirectional neuromyoelectric prosthetic hand that conveys biomimetic sensory feedback. Electromyographic recordings from residual arm muscles were decoded to provide independent and proportional control of a six-DOF prosthetic hand and wrist-the DEKA LUKE arm. Activation of contact sensors on the prosthesis resulted in intraneural microstimulation of residual sensory nerve fibers through chronically implanted Utah Slanted Electrode Arrays, thereby evoking tactile percepts on the phantom hand. With sensory feedback enabled, the participant exhibited greater precision in grip force and was better able to handle fragile objects. With active exploration, the participant was also able to distinguish between small and large objects and between soft and hard ones. When the sensory feedback was biomimetic-designed to mimic natural sensory signals-the participant was able to identify the objects significantly faster than with the use of traditional encoding algorithms that depended on only the present stimulus intensity. Thus, artificial touch can be sculpted by patterning the sensory feedback, and biologically inspired patterns elicit more interpretable and useful percepts.

Bionic reconstruction : Restoration of extremity function with osseointegrated and mind-controlled prostheses

Background

Loss of an extremity at any level has a major impact on a patient’s life. Using bionic reconstruction, extremity function can be restored and the patient reintegrated into daily life. Surgical procedures including selective nerve transfer and anchoring of prostheses into bone are combined with structured rehabilitation and modern prosthetic fitting. The patient is thereby able to use the prostheses intuitively and with multiple degrees of freedom.

Methods

This article presents the concept and approach for modern bionic reconstruction in detail and the relevant literature. The nerve transfer matrices for targeted muscle reinnervation (TMR) and the concept of osseointegration to optimally fit a patient with a modern prosthesis are described in detail. As a clinical example, the case of a patient who suffered from traumatic amputation and subsequently received TMR in combination with an osseointegrated implant and structured rehabilitation is presented.

Results

Using bionic reconstruction, basic hand functions can be restored and bimanual dexterity can expand the range of daily activities. Besides this approach to bionic reconstruction, its advantages and disadvantages are compared to hand transplantation. The limitations and perspectives of modern bionic reconstruction are also discussed.

Conclusions

Bionic reconstruction is a sophisticated method for restoring extremity function and nowadays can be considered a standard of care for all levels of upper extremity amputations. An interdisciplinary approach and structured rehabilitation are necessary to master prosthetic function to ultimately reintegrate patients into daily life.

Bionic hand as artificial organ: Current status and future perspectives

Even though the hand comprises only 1% of our body weight, about 30% of our central nervous systems (CNS) capacity is related to its control. The loss of a hand thus presents not only the loss of the most important tool allowing us to interact with our environment, but also leaves a dramatic sensory-motor deficit that challenges our CNS. Reconstruction of hand function is therefore not only an essential part of restoring body integrity and functional wholeness but also closes the loop of our neural circuits diminishing phantom sensation and neural pain. If biology fails to restore meaningful function, today we can resort to complex mechatronic replacement that have functional capabilities that in some respects even outperform biological alternatives, such as hand transplantation. As with replantation and transplantations, the challenge of bionic replacement is connecting the target with the CNS to achieve natural and intuitive control. In recent years, we have developed a number of strategies to improve neural interfacing, signal extraction, interpretation and stable mechanical attachment that are important parts of our current research. This work gives an overview of recent advances in bionic reconstruction, surgical refinements over technological interfacing, skeletal fixation, and modern rehabilitation tools that allow quick integration of prosthetic replacement.

Visuotactile synchrony of stimulation-induced sensation and natural somatosensation

OBJECTIVE

Previous studies suggest that somatosensory feedback has the potential to improve the functional performance of prostheses, reduce phantom pain, and enhance embodiment of sensory-enabled prosthetic devices. To maximize such benefits for amputees, the temporal properties of the sensory feedback must resemble those of natural somatosensation in an intact limb.

APPROACH

To better understand temporal perception of artificial sensation, we characterized the perception of visuotactile synchrony for tactile perception restored via peripheral nerve stimulation. We electrically activated nerves in the residual limbs of two trans-tibial amputees and two trans-radial amputees via non-penetrating nerve cuff electrodes, which elicited sensations referred to the missing limbs.

MAIN RESULTS

Our findings suggest that with respect to vision, stimulation-induced sensation has a point of subjective simultaneity (PSS; processing time) and just noticeable difference (JND; temporal sensitivity) that are similar to natural touch. The JND was not significantly different between the participants with upper- and lower-limb amputations. However, the PSS indicated that sensations evoked in the missing leg must occur significantly earlier than those in the hand to be perceived as maximally synchronous with vision. Furthermore, we examined visuotactile synchrony in the context of a functional task during which stimulation was triggered by pressure applied to the prosthesis. Stimulation-induced sensation could be delayed up to 111  ±  62 ms without the delay being reliably detected.

SIGNIFICANCE

The quantitative temporal properties of stimulation-induced perception were previously unknown and will contribute to design specifications for future sensory neuroprostheses.

Real-Time Performance of a Tactile Neuroprosthesis on Awake Behaving Rats

With the advancement of electrode and equipment technology, neuroprosthetics have become a promising alternative to partially compensate for the loss of sensorimotor function in amputees and patients with neurological diseases. Cortical neural interfaces are suitable especially for spinal cord injuries and amyotrophic lateral sclerosis. Although considerable success has been achieved in the literature by spike decoding of motor signals from the human brain, somatosensory feedback is essential for better motor control, interaction with objects, and the embodiment of prosthetic devices. In this paper, we present a tactile neuroprosthesis for rats based on intracortical microstimulation (ICMS). The rats wore mechanically-isolated boots covered with tactile sensors while performing a psychophysical detection task. The vibrotactile stimuli were measured by the artificial sensors and by using a real-time processor, this information was converted to electrical current pulses for ICMS. Some parameters of the real-time processor algorithm were specific to individual rats and were based on psychometric equivalence functions established earlier. Rats could detect the effects of the vibrotactile stimuli better (i.e., higher sensitivity indices) when the tactile neuroprosthesis was switched on compared to the boot only condition during active movement. In other words, the rats could decode the tactile information embedded in ICMS and use that in a behaviorally relevant manner. The presented animal model without peripheral nerve injury or amputation is also a promising tool to test various hardware and software components of neuroprosthetic systems in general.

Microneurography as a tool to develop decoding algorithms for peripheral neuro-controlled hand prostheses

BACKGROUND

The usability of dexterous hand prostheses is still hampered by the lack of natural and effective control strategies. A decoding strategy based on the processing of descending efferent neural signals recorded using peripheral neural interfaces could be a solution to such limitation. Unfortunately, this choice is still restrained by the reduced knowledge of the dynamics of human efferent signals recorded from the nerves and associated to hand movements.

FINDINGS

To address this issue, in this work we acquired neural efferent activities from healthy subjects performing hand-related tasks using ultrasound-guided microneurography, a minimally invasive technique, which employs needles, inserted percutaneously, to record from nerve fibers. These signals allowed us to identify neural features correlated with force and velocity of finger movements that were used to decode motor intentions. We developed computational models, which confirmed the potential translatability of these results showing how these neural features hold in absence of feedback and when implantable intrafascicular recording, rather than microneurography, is performed.

CONCLUSIONS

Our results are a proof of principle that microneurography could be used as a useful tool to assist the development of more effective hand prostheses.

Virtual Reality Provides an Effective Platform for Functional Evaluations of Closed-Loop Neuromyoelectric Control

Although recent advances in neuroprostheses offer opportunities for improved and intuitive control of advanced motorized and sensorized robotic arms, practical complications associated with such hardware can impede the research necessary for clinical translation. These hurdles potentially can be reduced with virtual reality environments (VREs) with embedded physics engines using virtual models of physical robotic hands. These software suites offer several advantages over physical prototypes, including high repeatability, reduced human error, elimination of many secondary sensory cues, and others. There are limited demonstrations of closed-loop prostheses in the VRE, and it is unclear whether VRE performance translates to the physical world. Here we describe how two trans-radial amputees with neural and intramuscular implants identified objects and performed activities of daily living with closed-loop control of prostheses in the VRE. Our initial evidence further suggests that capabilities with virtual prostheses may be predictors of physical prosthesis performance, demonstrating the utility of VREs for neuroprosthetic research.