Direct neural sensory feedback and control of a prosthetic arm

Psychophysical correspondence between vibrotactile intensity and intracortical microstimulation for tactile neuroprostheses in rats

OBJECTIVE

Recent studies showed that intracortical microstimulation (ICMS) generates artificial sensations which can be utilized as somatosensory feedback in cortical neuroprostheses. To mimic the natural psychophysical response, ICMS parameters are modulated according to psychometric equivalence functions (PEFs). PEFs match the intensity levels of ICMS and mechanical stimuli, which elicit equal detection probabilities, but they typically do not include the frequency as a control variable. We aimed to establish frequency-dependent PEFs for vibrotactile stimulation of the glabrous skin and ICMS in the primary somatosensory cortex of awake freely behaving rats.

APPROACH

We collected psychometric data for vibrotactile and ICMS detection at three stimulation frequencies (40, 60 and 80 Hz). The psychometric data were fitted with a model equation of two independent variables (stimulus intensity and frequency) and four subject-dependent parameters. For each rat, we constructed a separate PEF which was used to estimate the ICMS current amplitude for a given displacement amplitude and frequency. The ICMS frequency was set equal to the vibrotactile frequency. We validated the PEFs in a modified task which included randomly selected probe trials presented either with a vibrotactile or an ICMS stimulus, and also at frequencies and intensity levels not tested before.

MAIN RESULTS

The PEFs were generally successful in estimating the ICMS current intensities (no significant differences between vibrotactile and ICMS trials in Kolmogorov-Smirnov tests). Specifically, hit rates from both trial conditions were significantly correlated in 86% of the cases, and 52% of all data had perfect match in linear regression.

SIGNIFICANCE

The psychometric correspondence model presented in this study was constructed based on surface functions which define psychophysical detection probability as a function of stimulus intensity and frequency. Therefore, it may be used for the real-time modulation of the frequency and intensity of ICMS pulses in somatosensory neuroprostheses.

Discriminability of Single and Multichannel Intracortical Microstimulation within Somatosensory Cortex

The addition of tactile and proprioceptive feedback to neuroprosthetic limbs is expected to significantly improve the control of these devices. Intracortical microstimulation (ICMS) of somatosensory cortex is a promising method of delivering this sensory feedback. To date, the main focus of somatosensory ICMS studies has been to deliver discriminable signals, corresponding to varying intensity, to a single location in cortex. However, multiple independent and simultaneous streams of sensory information will need to be encoded by ICMS to provide functionally relevant feedback for a neuroprosthetic limb (e.g., encoding contact events and pressure on multiple digits). In this study, we evaluated the ability of an awake, behaving non-human primate (Macaca mulatta) to discriminate ICMS stimuli delivered on multiple electrodes spaced within somatosensory cortex. We delivered serial stimulation on single electrodes to evaluate the discriminability of sensations corresponding to ICMS of distinct cortical locations. Additionally, we delivered trains of multichannel stimulation, derived from a tactile sensor, synchronously across multiple electrodes. Our results indicate that discrimination of multiple ICMS stimuli is a challenging task, but that discriminable sensory percepts can be elicited by both single and multichannel ICMS on electrodes spaced within somatosensory cortex.

An integrated interface for peripheral neural system recording and stimulation: system design, electrical tests and in-vivo results

The prototype of an electronic bi-directional interface between the Peripheral Nervous System (PNS) and a neuro-controlled hand prosthesis is presented. The system is composed of 2 integrated circuits: a standard CMOS device for neural recording and a HVCMOS device for neural stimulation. The integrated circuits have been realized in 2 different 0.35μ m CMOS processes available from ams. The complete system incorporates 8 channels each including the analog front-end, the A/D conversion, based on a sigma delta architecture and a programmable stimulation module implemented as a 5-bit current DAC; two voltage boosters supply the output stimulation stage with a programmable voltage scalable up to 17V. Successful in-vivo experiments with rats having a TIME electrode implanted in the sciatic nerve were carried out, showing the capability of recording neural signals in the tens of microvolts, with a global noise of 7μ V r m s , and to selectively elicit the tibial and plantar muscles using different active sites of the electrode.

Key considerations in designing a somatosensory neuroprosthesis

In recent years, a consensus has emerged that somatosensory feedback needs to be provided for upper limb neuroprostheses to be useful. An increasingly promising approach to sensory restoration is to electrically stimulate neurons along the somatosensory neuraxis to convey information about the state of the prosthetic limb and about contact with objects. To date, efforts toward artificial sensory feedback have consisted mainly of demonstrating that some sensory information could be conveyed using a small number of stimulation patterns, generally delivered through single electrodes. However impressive these achievements are, results from different studies are hard to compare, as each research team implements different stimulation patterns and tests the elicited sensations differently. A critical question is whether different stimulation strategies will generalize from contrived laboratory settings to activities of daily living. Here, we lay out some key specifications that an artificial somatosensory channel should meet, discuss how different approaches should be evaluated, and caution about looming challenges that the field of sensory restoration will face.

Clinical applications of penetrating neural interfaces and Utah Electrode Array technologies

This paper briefly describes some of the recent progress in the development of penetrating microelectrode arrays and highlights the use of two of these devices, Utah electrode arrays and Utah slanted electrode arrays, in two therapeutic interventions: recording volitional skeletal motor commands from the central nervous system, and recording motor commands and evoking somatosensory percepts in the peripheral nervous system (PNS). The paper also briefly explores other potential sites for microelectrode array interventions that could be profitably pursued and that could have important consequences in enhancing the quality of life of patients that has been compromised by disorders of the central and PNSs.

Intracortical microstimulation of human somatosensory cortex

Intracortical microstimulation of the somatosensory cortex offers the potential for creating a sensory neuroprosthesis to restore tactile sensation. Whereas animal studies have suggested that both cutaneous and proprioceptive percepts can be evoked using this approach, the perceptual quality of the stimuli cannot be measured in these experiments. We show that microstimulation within the hand area of the somatosensory cortex of a person with long-term spinal cord injury evokes tactile sensations perceived as originating from locations on the hand and that cortical stimulation sites are organized according to expected somatotopic principles. Many of these percepts exhibit naturalistic characteristics (including feelings of pressure), can be evoked at low stimulation amplitudes, and remain stable for months. Further, modulating the stimulus amplitude grades the perceptual intensity of the stimuli, suggesting that intracortical microstimulation could be used to convey information about the contact location and pressure necessary to perform dexterous hand movements associated with object manipulation.

Task-Specific Somatosensory Feedback via Cortical Stimulation in Humans

Cortical stimulation through electrocorticographic (ECoG) electrodes is a potential method for providing sensory feedback in future prosthetic and rehabilitative applications. Here, we evaluate human subjects' ability to continuously modulate their motor behavior based on feedback from direct surface stimulation of the somatosensory cortex. Subjects wore a dataglove that measured their hand aperture position and received one of three stimuli over the hand sensory cortex based on their current hand position as compared to a target aperture position. Using cortical stimulation feedback, subjects adjusted their hand aperture to move towards the target aperture region. One subject was able to achieve accuracies and R² values well above chance (best performance: R² = 0.93; accuracy = 0.76/1). Performance dropped during the catch trial (same stimulus independent of the position) to below chance levels, suggesting that the subject had been using the varied sensory feedback to modulate their motor behavior. To our knowledge, this study represents one of the first demonstrations of using direct cortical surface stimulation of the human sensory cortex to perform a motor task, and is a first step towards developing closed-loop human sensorimotor brain-computer interfaces.

Classification of hand and wrist tasks of unknown force levels using muscle synergies

Muscle synergies have been proposed as a way for the central nervous system (CNS) to simplify the generation of motor commands and they have been shown to explain a large portion of the variation in the muscle patterns across a variety of conditions. However, whether human subjects are able to control prostheses proportionally with a small set of synergies has not been tested directly. Here we investigated if muscle synergies can be used to identify different wrist and hand motions. We recorded electromyographic (EMG) activity from eight arm muscles while the subjects exerted seven different intensity levels during the motions when performing seven classes of hand and wrist motion. From these data we extracted the muscle synergies and classified the tasks associated to each contraction intensity profile by linear discriminant analysis (LDA). We compared the performance obtained using muscle synergies with the performance of using the mean absolute values (MAV) as a feature. Also, the consistency of extracted muscle synergies was studied across intensity variations. While the synergies showed relative consistency particularly across closer intensity levels, average classification results generated with the synergies were less accurate than MAVs. These results indicate that although the performance of muscle synergies was very close to MAVs, they do not provide additional information for task identification across different exerted intensity levels.

A cross-modal feedback scheme for control of prosthetic grasp strength

Introduction

Given the lack of haptic feedback inherent in prosthetic devices, a natural and adaptable feedback scheme must be implemented. While multimodal feedback has proven successful in aiding dexterous performance, it can be mentally tasking on the individual. Conversely, cross-modal schemes relying on sensory substitution have proven to be equally effective in aiding task performance without cognitively burdening the user to the same degree.

Objectives

This experiment investigated the effectiveness of the cross-modal feedback scheme through using audio feedback to represent prosthetic grasping strength during dynamic control of a prosthetic hand.

Methods

A total of five individuals participated in two sets of experiments (four subjects in the first, one subject in the second). Participants were asked to control the grasping strength exerted by a prosthetic hand while using real-time audio feedback in order to reach up to three different levels of force within a trial set.

Results

The cross-modal feedback scheme successfully provided users with the robust ability to modulate grasping strength in real-time using only audio feedback.

Conclusion

Audio feedback effectively conveys haptic information to the user of a prosthetic hand. Retention of the training knowledge is evident and can be generalized to perform new (i.e. untrained) tasks.

Spectral and mathematical evaluation of electromyography signals for clinical use

The surface electromyography (SEMG) is a complicated biomedical signal, generated during voluntary or involuntary muscle activities and these muscle activities are always controlled by the nervous system. In this paper, the processing and analysis of SEMG signals at multiple muscle points for different operations were carried out. Myoelectric signals were detected using designed acquisition setup which consists of an instrumentation amplifier, filter circuit, an amplifier with gain adjustment. Further, Labview[Formula: see text]-based data programming code was used to record SEMG signals for independent activities. The whole system consists of bipolar noninvasive electrodes, signal acquisition protocols and signal conditioning at different levels. This work uses recorded SEMG signals generated by biceps and triceps muscles for four different arm activities. Feature extraction was done on the recorded signal for investigating the voluntary muscular contraction relationship for exercising statistic measured index method to evaluate distance between two independent groups by directly addressing the quality of signal in separability class for different arm movements. Thereafter repeated factorial analysis of variance technique was implemented to evaluate the effectiveness of processed signal. From these results, it demonstrates that the proposed method can be used as SEMG feature evaluation index.

Using multiple high-count electrode arrays in human median and ulnar nerves to restore sensorimotor function after previous transradial amputation of the hand

Peripheral nerve interfaces that can record from and stimulate large numbers of different nerve fibers selectively and independently may help restore intuitive and effective motor and sensory function after hand amputation. To this end, and extending previous work in two subjects, two 100-electrode Utah Slanted Electrode Arrays (USEAs) were implanted for four weeks in the residual ulnar and median nerves of a 50-year-old male whose left, dominant hand had been amputated 21 years previously. Subsequent experiments involved 1) recording from USEAs for real-time control of a virtual prosthetic hand; 2) stimulation to evoke somatosensory percepts; and 3) closed-loop sensorimotor control. Overall, partial motor control and sensation were achieved using USEAs. 1) Isolated action potentials recorded from nerve motor fibers, although sparse at these distal implant sites, were activated during fictive movements of the phantom hand. Unlike in our previous two subjects, electromyographic (EMG) activity contributed to most online recordings and decodes, but was reduced in offline analyses using common average referencing. Online and offline Kalman-filter decodes of thresholded neural or EMG spikes independently controlled different digits of the virtual hand with one or two degrees of freedom. 2) Microstimulation through individual electrodes of the two USEAs evoked up to 106 different percepts, covering much of the phantom hand. The subject discriminated among five perceived stimulus locations, and between two somatosensory submodalities at a single location. 3) USEA-evoked percepts, mimicking contact with either a near or distal virtual target, were used to terminate movements of the virtual hand controlled with USEA recordings comprised wholly or mostly of EMG. These results further indicate that USEAs can help restore sensory and motor function after hand loss.

Integrated and flexible multichannel interface for electrotactile stimulation

OBJECTIVE

The aim of the present work was to develop and test a flexible electrotactile stimulation system to provide real-time feedback to the prosthesis user. The system requirements were to accommodate the capabilities of advanced multi-DOF myoelectric hand prostheses and transmit the feedback variables (proprioception and force) using intuitive coding, with high resolution and after minimal training.

APPROACH

We developed a fully-programmable and integrated electrotactile interface supporting time and space distributed stimulation over custom designed flexible array electrodes. The system implements low-level access to individual stimulation channels as well as a set of high-level mapping functions translating the state of a multi-DoF prosthesis (aperture, grasping force, wrist rotation) into a set of predefined dynamic stimulation profiles. The system was evaluated using discrimination tests employing spatial and frequency coding (10 able-bodied subjects) and dynamic patterns (10 able-bodied and 6 amputee subjects). The outcome measure was the success rate (SR) in discrimination.

MAIN RESULTS

The more practical electrode with the common anode configuration performed similarly to the more usual concentric arrangement. The subjects could discriminate six spatial and four frequency levels with SR >90% after a few minutes of training, whereas the performance significantly deteriorated for more levels. The dynamic patterns were intuitive for the subjects, although amputees showed lower SR than able-bodied individuals (86% ± 10% versus 99% ± 3%).

SIGNIFICANCE

The tests demonstrated that the system was easy to setup and apply. The design and resolution of the multipad electrode was evaluated. Importantly, the novel dynamic patterns, which were successfully tested, can be superimposed to transmit multiple feedback variables intuitively and simultaneously. This is especially relevant for closing the loop in modern multifunction prostheses. Therefore, the proposed system is convenient for practical applications and can be used to implement sensory perception training and/or closed-loop control of myoelectric prostheses, providing grasping force and proprioceptive feedback.

Literature Review on Needs of Upper Limb Prosthesis Users

The loss of one hand can significantly affect the level of autonomy and the capability of performing daily living, working and social activities. The current prosthetic solutions contribute in a poor way to overcome these problems due to limitations in the interfaces adopted for controlling the prosthesis and to the lack of force or tactile feedback, thus limiting hand grasp capabilities. This paper presents a literature review on needs analysis of upper limb prosthesis users, and points out the main critical aspects of the current prosthetic solutions, in terms of users satisfaction and activities of daily living they would like to perform with the prosthetic device. The ultimate goal is to provide design inputs in the prosthetic field and, contemporary, increase user satisfaction rates and reduce device abandonment. A list of requirements for upper limb prostheses is proposed, grounded on the performed analysis on user needs. It wants to (i) provide guidelines for improving the level of acceptability and usefulness of the prosthesis, by accounting for hand functional and technical aspects; (ii) propose a control architecture of PNS-based prosthetic systems able to satisfy the analyzed user wishes; (iii) provide hints for improving the quality of the methods (e.g., questionnaires) adopted for understanding the user satisfaction with their prostheses.

Development and experimental evaluation of multi-fingered robot hand with adaptive impedance control for unknown environment grasping

This paper presents adaptive impedance controllers with adaptive sliding mode friction compensation for anthropomorphic artificial hand. A five-fingered anthropomorphic artificial hand with multi-sensory and Field-Programmable Gate Arra (FPGA)-based control hardware and software architecture is designed to fulfill the requirements of the grasping force controller. In order to improve the force-tracking precision, the indirect adaptive algorithm was applied to estimate the parameters of the environment. The generalized momentum-based disturbance observer was applied to estimate the contact force from the torque sensor. Based on the sensors of the finger, an adaptive sliding mode friction compensation algorithm was utilized to improve the accuracy of the position control. The performances of the force-tracking impedance controller and position-based joint impedance control for the five-fingered anthropomorphic artificial hand are analyzed and compared in this paper. Furthermore, the performances of the force-tracking impedance controller with environmental parameters adaptive estimation and without environmental parameters estimation are analyzed and compared. Experimental results prove that accurate force-tracking and stable torque/force response under uncertain environments of unknown stiffness and position can be achieved with the proposed adaptive force-tracking impedance controller with friction compensation on five-finger artificial hand.

Control of Prosthetic Hands via the Peripheral Nervous System

This paper intends to provide a critical review of the literature on the technological issues on control and sensorization of hand prostheses interfacing with the Peripheral Nervous System (i.e., PNS), and their experimental validation on amputees. The study opens with an in-depth analysis of control solutions and sensorization features of research and commercially available prosthetic hands. Pros and cons of adopted technologies, signal processing techniques and motion control solutions are investigated. Special emphasis is then dedicated to the recent studies on the restoration of tactile perception in amputees through neural interfaces. The paper finally proposes a number of suggestions for designing the prosthetic system able to re-establish a bidirectional communication with the PNS and foster the prosthesis natural control.

Microstimulation of the lumbar DRG recruits primary afferent neurons in localized regions of lower limb

Patterned microstimulation of the dorsal root ganglion (DRG) has been proposed as a method for delivering tactile and proprioceptive feedback to amputees. Previous studies demonstrated that large- and medium-diameter afferent neurons could be recruited separately, even several months after implantation. However, those studies did not examine the anatomical localization of sensory fibers recruited by microstimulation in the DRG. Achieving precise recruitment with respect to both modality and receptive field locations will likely be crucial to create a viable sensory neuroprosthesis. In this study, penetrating microelectrode arrays were implanted in the L5, L6, and L7 DRG of four isoflurane-anesthetized cats instrumented with nerve cuff electrodes around the proximal and distal branches of the sciatic and femoral nerves. A binary search was used to find the recruitment threshold for evoking a response in each nerve cuff. The selectivity of DRG stimulation was characterized by the ability to recruit individual distal branches to the exclusion of all others at threshold; 84.7% (n = 201) of the stimulation electrodes recruited a single nerve branch, with 9 of the 15 instrumented nerves recruited selectively. The median stimulation threshold was 0.68 nC/phase, and the median dynamic range (increase in charge while stimulation remained selective) was 0.36 nC/phase. These results demonstrate the ability of DRG microstimulation to achieve selective recruitment of the major nerve branches of the hindlimb, suggesting that this approach could be used to drive sensory input from localized regions of the limb. This sensory input might be useful for restoring tactile and proprioceptive feedback to a lower-limb amputee.

A phantom axon setup for validating models of action potential recordings

Electrode designs and strategies for electroneurogram recordings are often tested first by computer simulations and then by animal models, but they are rarely implanted for long-term evaluation in humans. The models show that the amplitude of the potential at the surface of an axon is higher in front of the nodes of Ranvier than at the internodes; however, this has not been investigated through in vivo measurements. An original experimental method is presented to emulate a single fiber action potential in an infinite conductive volume, allowing the potential of an axon to be recorded at both the nodes of Ranvier and the internodes, for a wide range of electrode-to-fiber radial distances. The paper particularly investigates the differences in the action potential amplitude along the longitudinal axis of an axon. At a short radial distance, the action potential amplitude measured in front of a node of Ranvier is two times larger than in the middle of two nodes. Moreover, farther from the phantom axon, the measured action potential amplitude is almost constant along the longitudinal axis. The results of this new method confirm the computer simulations, with a correlation of 97.6 %.

Microchannel neural interface manufacture by stacking silicone and metal foil laminae

OBJECTIVE

Microchannel neural interfaces (MNIs) overcome problems with recording from peripheral nerves by amplifying signals independent of node of Ranvier position. Selective recording and stimulation using an MNI requires good insulation between microchannels and a high electrode density. We propose that stacking microchannel laminae will improve selectivity over single layer MNI designs due to the increase in electrode number and an improvement in microchannel sealing.

APPROACH

This paper describes a manufacturing method for creating MNIs which overcomes limitations on electrode connectivity and microchannel sealing. Laser cut silicone-metal foil laminae were stacked using plasma bonding to create an array of microchannels containing tripolar electrodes. Electrodes were DC etched and electrode impedance and cyclic voltammetry were tested.

MAIN RESULTS

MNIs with 100 μm and 200 μm diameter microchannels were manufactured. High electrode density MNIs are achievable with electrodes present in every microchannel. Electrode impedances of 27.2 ± 19.8 kΩ at 1 kHz were achieved. Following two months of implantation in Lewis rat sciatic nerve, micro-fascicles were observed regenerating through the MNI microchannels.

SIGNIFICANCE

Selective MNIs with the peripheral nervous system may allow upper limb amputees to control prostheses intuitively.

Restoring motor control and sensory feedback in people with upper extremity amputations using arrays of 96 microelectrodes implanted in the median and ulnar nerves

OBJECTIVE

An important goal of neuroprosthetic research is to establish bidirectional communication between the user and new prosthetic limbs that are capable of controlling >20 different movements. One strategy for achieving this goal is to interface the prosthetic limb directly with efferent and afferent fibres in the peripheral nervous system using an array of intrafascicular microelectrodes. This approach would provide access to a large number of independent neural pathways for controlling high degree-of-freedom prosthetic limbs, as well as evoking multiple-complex sensory percepts.

APPROACH

Utah Slanted Electrode Arrays (USEAs, 96 recording/stimulating electrodes) were implanted for 30 days into the median (Subject 1-M, 31 years post-amputation) or ulnar (Subject 2-U, 1.5 years post-amputation) nerves of two amputees. Neural activity was recorded during intended movements of the subject's phantom fingers and a linear Kalman filter was used to decode the neural data. Microelectrode stimulation of varying amplitudes and frequencies was delivered via single or multiple electrodes to investigate the number, size and quality of sensory percepts that could be evoked. Device performance over time was assessed by measuring: electrode impedances, signal-to-noise ratios (SNRs), stimulation thresholds, number and stability of evoked percepts.

MAIN RESULTS

The subjects were able to proportionally, control individual fingers of a virtual robotic hand, with 13 different movements decoded offline (r = 0.48) and two movements decoded online. Electrical stimulation across one USEA evoked >80 sensory percepts. Varying the stimulation parameters modulated percept quality. Devices remained intrafascicularly implanted for the duration of the study with no significant changes in the SNRs or percept thresholds.

SIGNIFICANCE

This study demonstrated that an array of 96 microelectrodes can be implanted into the human peripheral nervous system for up to 1 month durations. Such an array could provide intuitive control of a virtual prosthetic hand with broad sensory feedback.

Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans

Restoration of touch after hand amputation is a desirable feature of ideal prostheses. Here, we show that texture discrimination can be artificially provided in human subjects by implementing a neuromorphic real-time mechano-neuro-transduction (MNT), which emulates to some extent the firing dynamics of SA1 cutaneous afferents. The MNT process was used to modulate the temporal pattern of electrical spikes delivered to the human median nerve via percutaneous microstimulation in four intact subjects and via implanted intrafascicular stimulation in one transradial amputee. Both approaches allowed the subjects to reliably discriminate spatial coarseness of surfaces as confirmed also by a hybrid neural model of the median nerve. Moreover, MNT-evoked EEG activity showed physiologically plausible responses that were superimposable in time and topography to the ones elicited by a natural mechanical tactile stimulation. These findings can open up novel opportunities for sensory restoration in the next generation of neuro-prosthetic hands.

DOI:http://dx.doi.org/10.7554/eLife.09148.001

Our hands provide us with a wide variety of information about our surroundings, enabling us to detect pain, temperature and pressure. Our sense of touch also allows us to interact with objects by feeling their texture and solidity. However, completely reproducing a sense of touch in artificial or prosthetic hands has proven challenging. While commercial prostheses can mimic the range of movements of natural limbs, even the latest experimental prostheses have only a limited ability to ‘feel’ the objects being manipulated. Oddo, Raspopovic et al. have now brought this ability a step closer by exploiting an artificial fingertip and appropriate neural interfaces through which different textures can be identified.

The initial experiments were performed in four healthy volunteers with intact limbs. Oddo, Raspopovic et al. connected the artificial fingertip to the volunteers via an electrode inserted into a nerve in the arm. When moved over a rough surface, sensors in the fingertip produced patterns of electrical pulses that stimulated the nerve, causing the volunteers to feel like they were touching the surface. The volunteers were even able to tell the difference between the different surface textures the artificial fingertip moved across.

The temporary electrodes used in this group of volunteers are unsuitable for use with prosthetic limbs because they can easily be knocked out of position. Therefore, in a further experiment involving a volunteer who had undergone an arm amputation a number of years previously, Oddo, Raspopovic et al. tested an implanted electrode array that could, in principle, remain in place long-term. This volunteer could also identify the different textures the artificial fingertip touched, with a slightly higher degree of accuracy than the previous group of intact volunteers. Further studies are now required to explore the potential of this approach in larger groups of volunteers.

DOI:http://dx.doi.org/10.7554/eLife.09148.002

Quantifying Different Tactile Sensations Evoked by Cutaneous Electrical Stimulation Using Electroencephalography Features

Psychophysical tests and standardized questionnaires are often used to analyze tactile sensation based on subjective judgment in conventional studies. In contrast with the subjective evaluation, a novel method based on electroencephalography (EEG) is proposed to explore the possibility of quantifying tactile sensation in an objective way. The proposed experiments adopt cutaneous electrical stimulation to generate two kinds of sensations (vibration and pressure) with three grades (low/medium/strong) on eight subjects. Event-related potentials (ERPs) and event-related synchronization/desynchronization (ERS/ERD) are extracted from EEG, which are used as evaluation indexes to distinguish between vibration and pressure, and also to discriminate sensation grades. Results show that five-phase P1–N1–P2–N2–P3 deflection is induced in EEG. Using amplitudes of latter ERP components (N2 and P3), vibration and pressure sensations can be discriminated on both individual and grand-averaged ERP ([Formula: see text]). The grand-average ERPs can distinguish the three sensations grades, but there is no significant difference on individuals. In addition, ERS/ERD features of mu rhythm (8–13[Formula: see text]Hz) are adopted. Vibration and pressure sensations can be discriminated on grand-average ERS/ERD ([Formula: see text]), but only some individuals show significant difference. The grand-averaged results show that most sensation grades can be differentiated, and most pairwise comparisons show significant difference on individuals ([Formula: see text]). The work suggests that ERP- and ERS/ERD-based EEG features may have potential to quantify tactile sensations for medical diagnosis or engineering applications.

Implantable neurotechnologies: a review of integrated circuit neural amplifiers

Neural signal recording is critical in modern day neuroscience research and emerging neural prosthesis programs. Neural recording requires the use of precise, low-noise amplifier systems to acquire and condition the weak neural signals that are transduced through electrode interfaces. Neural amplifiers and amplifier-based systems are available commercially or can be designed in-house and fabricated using integrated circuit (IC) technologies, resulting in very large-scale integration or application-specific integrated circuit solutions. IC-based neural amplifiers are now used to acquire untethered/portable neural recordings, as they meet the requirements of a miniaturized form factor, light weight and low power consumption. Furthermore, such miniaturized and low-power IC neural amplifiers are now being used in emerging implantable neural prosthesis technologies. This review focuses on neural amplifier-based devices and is presented in two interrelated parts. First, neural signal recording is reviewed, and practical challenges are highlighted. Current amplifier designs with increased functionality and performance and without penalties in chip size and power are featured. Second, applications of IC-based neural amplifiers in basic science experiments (e.g., cortical studies using animal models), neural prostheses (e.g., brain/nerve machine interfaces) and treatment of neuronal diseases (e.g., DBS for treatment of epilepsy) are highlighted. The review concludes with future outlooks of this technology and important challenges with regard to neural signal amplification.

Insights and Perspectives on Sensory-Motor Integration and Rehabilitation

The present review focuses on the flow and interaction of somatosensory-motor signals in the central and peripheral nervous system. Specifically, where incoming sensory signals from the periphery are processed and interpreted to initiate behaviors, and how ongoing behaviors produce sensory consequences encoded and used to fine-tune subsequent actions. We describe the structure–function relations of this loop, how these relations can be modeled and aspects of somatosensory-motor rehabilitation. The work reviewed here shows that it is imperative to understand the fundamental mechanisms of the somatosensory-motor system to restore accurate motor abilities and appropriate somatosensory feedback. Knowledge of the salient neural mechanisms of sensory-motor integration has begun to generate innovative approaches to improve rehabilitation training following neurological impairments such as stroke. The present work supports the integration of basic science principles of sensory-motor integration into rehabilitation procedures to create new solutions for sensory-motor disorders.

Implantable neurotechnologies: bidirectional neural interfaces--applications and VLSI circuit implementations

A bidirectional neural interface is a device that transfers information into and out of the nervous system. This class of devices has potential to improve treatment and therapy in several patient populations. Progress in very large-scale integration has advanced the design of complex integrated circuits. System-on-chip devices are capable of recording neural electrical activity and altering natural activity with electrical stimulation. Often, these devices include wireless powering and telemetry functions. This review presents the state of the art of bidirectional circuits as applied to neuroprosthetic, neurorepair, and neurotherapeutic systems.

Sensory feedback by peripheral nerve stimulation improves task performance in individuals with upper limb loss using a myoelectric prosthesis

OBJECTIVE

Tactile feedback is critical to grip and object manipulation. Its absence results in reliance on visual and auditory cues. Our objective was to assess the effect of sensory feedback on task performance in individuals with limb loss.

APPROACH

Stimulation of the peripheral nerves using implanted cuff electrodes provided two subjects with sensory feedback with intensity proportional to forces on the thumb, index, and middle fingers of their prosthetic hand during object manipulation. Both subjects perceived the sensation on their phantom hand at locations corresponding to the locations of the forces on the prosthetic hand. A bend sensor measured prosthetic hand span. Hand span modulated the intensity of sensory feedback perceived on the thenar eminence for subject 1 and the middle finger for subject 2. We performed three functional tests with the blindfolded subjects. First, the subject tried to determine whether or not a wooden block had been placed in his prosthetic hand. Second, the subject had to locate and remove magnetic blocks from a metal table. Third, the subject performed the Southampton Hand Assessment Procedure (SHAP). We also measured the subject's sense of embodiment with a survey and his self-confidence.

MAIN RESULTS

Blindfolded performance with sensory feedback was similar to sighted performance in the wooden block and magnetic block tasks. Performance on the SHAP, a measure of hand mechanical function and control, was similar with and without sensory feedback. An embodiment survey showed an improved sense of integration of the prosthesis in self body image with sensory feedback.

SIGNIFICANCE

Sensory feedback by peripheral nerve stimulation improved object discrimination and manipulation, embodiment, and confidence. With both forms of feedback, the blindfolded subjects tended toward results obtained with visual feedback.

Neural interfaces for somatosensory feedback: bringing life to a prosthesis

PURPOSE OF REVIEW

When an individual loses a limb, he/she loses touch with the world and with the people around him/her. Somatosensation is critical to the feeling of connection and control of one's own body. Decades of attempts to replace lost somatosensation by sensory substitutions have been ineffective outside of the laboratory. This review discusses important recent results demonstrating chronic somatosensory restoration through direct peripheral nerve stimulation.

RECENT FINDINGS

Stimulation of peripheral nerves results in somatosensory perception on the phantom limb. Sensations are localized to several independent and functionally relevant locations, such as the fingertips, thenar eminence, ulnar border and dorsal surface. Patterns in stimulation intensity change the perception experience by the user, opening new dimensions on neuromodulation.

SUMMARY

Neural interfaces with sophisticated stimulation paradigms create a user's perception of his/her hand to touch and manipulate objects. The pattern of intensity and frequency of stimulation is critical to the quality and intensity of perceived sensation. Restoring feeling has allowed the individuals to, 'feel [my] hand for the first time since the accident,' and 'feel [my] wife touch my hand'. Individuals using a prosthetic hand with sensation can pull cherries and grapes from the stem, open water bottles and move objects without destroying these objects - all while audio and visually deprived. After regaining sensation, phantom pain is eliminated in individuals that had frequent, sometimes debilitating, pain following limb loss. With over 5 subject-years of experience, this work is leading the evolution of a new era in prostheses. Somatosensory prosthetics as a standard procedure to augment and restore somatosensation are now within our reach.

Bioelectric interfaces for the peripheral nervous system

The peripheral nervous system (PNS) is an attractive target for those developing neural interfaces as an access point to the information flow coursing within our bodies. A successful neural interface could not only offer the means to understand basic neurophysiological mechanisms, such as how the body accomplishes complex coordinated control of multi degree of freedom body segments, but also could serve as the means of delivering treatment or therapies to restore physiological functions lost due to injury or disease. Our work in the development of such a neural interface focuses upon multi-microelectrode devices that are placed within the body of the nerve fascicle; mulit-channel intra-fascicular devices called the thin-film Longitudinal Intra-Fascicular Electrode (tfLIFE) and the Transversely Implanted Multi-Electrode (TIME). These structures provide high resolution access to the PNS and have demonstrated promise in animal work as well as in preliminary sub-acute work in human volunteers. However, work remains to improve upon their longevity and biocompatibility before full translation to clinical work can occur.

Estimation of the Electrode-Fiber Bioelectrical Coupling From Extracellularly Recorded Single Fiber Action Potentials

Selective peripheral neural interfaces are currently capable of detecting minute electrical signals from nearby nerve fibers as single fiber action potential (SFAP) waveforms. Each detected single unit has a distinct shape originating from the unique bioelectrical coupling that exists between the neuroprosthetic electrode, the nerve fiber and the extracellular milieu. The bioelectrical coupling manifests itself as a series of low-pass Bessel filters acting on the action currents along the nerve fiber. Here, we present a method to estimate the electrode-fiber bioelectrical coupling through a quantitative analysis of the spectral distribution of the single units extracellularly recorded with the thin-film longitudinal intrafascicular electrode (tfLIFE) in an in vivo mammalian peripheral nerve animal model. The bioelectrical coupling estimate is an estimate of the electrode sensitivity function traversed by the nerve fiber, suggesting that it is as a means to directly measure the spatial relationship between the nerve fiber and electrode. It not only reflects a shape change to the SFAP, but has implications for in situ nerve fiber location tracking, in situ diagnostics of nerves and neuroproshetic electrodes, and assessment of the biocompatibility of neural interfaces and the health of the reporting nerve fibers.

Modulation of grasping force in prosthetic hands using neural network-based predictive control

This chapter describes the implementation of a neural network-based predictive control system for driving a prosthetic hand. Nonlinearities associated with the electromechanical aspects of prosthetic devices present great challenges for precise control of this type of device. Model-based controllers may overcome this issue. Moreover, given the complexity of these kinds of electromechanical systems, neural network-based modeling arises as a good fit for modeling the fingers' dynamics. The results of simulations mimicking potential situations encountered during activities of daily living demonstrate the feasibility of this technique.

An Investigation of the Effects of Different Pulse Patterns of Transcutaneous Electrical Nerve Stimulation (TENS) on Perceptual Embodiment of a Rubber Hand in Healthy Human Participants With Intact Limbs

OBJECTIVE

The aim of this study was to investigate the strength of perceptual embodiment achieved during an adapted version of the rubber hand illusion (RHI) in response to a series of modified transcutaneous electrical nerve stimulation (TENS) pulse patterns with dynamic temporal and spatial characteristics which are more akin to the mechanical brush stroke in the original RHI.

MATERIALS AND METHODS

A repeated-measures counterbalanced experimental study was conducted where each participant was exposed to four TENS interventions: continuous pattern TENS; burst pattern TENS (fixed frequency of 2 bursts per second of 100 pulses per second); amplitude-modulated pattern TENS (intensity increasing from zero to a preset level, then back to zero again in a cyclical fashion); and sham (no current) TENS. Participants rated the intensity of the RHI using a three-item numerical rating scale (each item was ranked from 0 to 10). Friedman's analysis of ranks (one-factor repeated measure) was used to test the differences in perceptual embodiment between TENS innervations; alpha was set at p ≤ 0.05.

RESULTS

There were statistically significant differences in the intensity of misattribution and perceptual embodiment between sham and active TENS interventions, but no significant differences between the three active TENS conditions (amplitude-modulated TENS, burst TENS, and continuous TENS). Amplitude-modulated and burst TENS produced significantly higher intensity scores for misattribution sensation and perceptual embodiment compared with sham (no current) TENS, whereas continuous TENS did not.

CONCLUSION

The findings provide tentative, but not definitive, evidence that TENS parameters with dynamic spatial and temporal characteristics may produce more intense misattribution sensations and intense perceptual embodiment than parameters with static characteristics (e.g., continuous pulse patterns).

The role of tactile afference in shaping motor behaviour and implications for prosthetic innovation

The present review focusses on how tactile somatosensory afference is encoded and processed, and how this information is interpreted and acted upon in terms of motor control. We relate the fundamental workings of the sensorimotor system to the rehabilitation of amputees using modern prosthetic interventions. Our sense of touch is central to our everyday lives, from allowing us to manipulate objects accurately to giving us a sense of self-embodiment. There are a variety of specialised cutaneous mechanoreceptive afferents, which differ in terms of type and density according to the skin site. In humans, there is a dense innervation of our hands, which is reflected in their vast over-representation in somatosensory and motor cortical areas. We review the accumulated evidence from animal and human studies about the precise interplay between the somatosensory and motor systems, which is highly integrated in many brain areas and often not separable. The glabrous hand skin provides exquisite, discriminative detail about touch, which is useful for refining movements. When these signals are disrupted, such as through injury or amputation, the consequences are considerable. The development of sensory feedback in prosthetics offers a promising avenue for the full integration of a missing body part. Real-time touch feedback from motor intentions aids in grip control and the ability to distinguish different surfaces, even introducing the possibility of pleasure in artificial touch. Thus, our knowledge from fundamental research into sensorimotor interactions should be used to develop more realistic and integrative prostheses.

Spatial and Functional Selectivity of Peripheral Nerve Signal Recording With the Transversal Intrafascicular Multichannel Electrode (TIME)

The selection of suitable peripheral nerve electrodes for biomedical applications implies a trade-off between invasiveness and selectivity. The optimal design should provide the highest selectivity for targeting a large number of nerve fascicles with the least invasiveness and potential damage to the nerve. The transverse intrafascicular multichannel electrode (TIME), transversally inserted in the peripheral nerve, has been shown to be useful for the selective activation of subsets of axons, both at inter- and intra-fascicular levels, in the small sciatic nerve of the rat. In this study we assessed the capabilities of TIME for the selective recording of neural activity, considering the topographical selectivity and the distinction of neural signals corresponding to different sensory types. Topographical recording selectivity was proved by the differential recording of CNAPs from different subsets of nerve fibers, such as those innervating toes 2 and 4 of the hindpaw of the rat. Neural signals elicited by sensory stimuli applied to the rat paw were successfully recorded. Signal processing allowed distinguishing three different types of sensory stimuli such as tactile, proprioceptive and nociceptive ones with high performance. These findings further support the suitability of TIMEs for neuroprosthetic applications, by exploiting the transversal topographical structure of the peripheral nerves.

Vibrotactile grasping force and hand aperture feedback for myoelectric forearm prosthesis users

BACKGROUND

User feedback about grasping force and hand aperture is very important in object handling with myoelectric forearm prostheses but is lacking in current prostheses. Vibrotactile feedback increases the performance of healthy subjects in virtual grasping tasks, but no extensive validation on potential users has been performed.

OBJECTIVES

Investigate the performance of upper-limb loss subjects in grasping tasks with vibrotactile stimulation, providing hand aperture, and grasping force feedback.

STUDY DESIGN

Cross-over trial.

METHODS

A total of 10 subjects with upper-limb loss performed virtual grasping tasks while perceiving vibrotactile feedback. Hand aperture feedback was provided through an array of coin motors and grasping force feedback through a single miniature stimulator or an array of coin motors. Objects with varying sizes and weights had to be grasped by a virtual hand.

RESULTS

Percentages correctly applied hand apertures and correct grasping force levels were all higher for the vibrotactile feedback condition compared to the no-feedback condition. With visual feedback, the results were always better compared to the vibrotactile feedback condition. Task durations were comparable for all feedback conditions.

CONCLUSION

Vibrotactile grasping force and hand aperture feedback improves grasping performance of subjects with upper-limb loss. However, it should be investigated whether this is of additional value in daily-life tasks.

CLINICAL RELEVANCE

This study is a first step toward the implementation of sensory vibrotactile feedback for users of myoelectric forearm prostheses. Grasping force feedback is crucial for optimal object handling, and hand aperture feedback is essential for reduction of required visual attention. Grasping performance with feedback is evaluated for the potential users.

Effects of kinematic vibrotactile feedback on learning to control a virtual prosthetic arm

Background

After a limb is lost a prosthesis can restore function. For maximum utility, prosthetic limbs should accept movement commands and provide force and motion feedback, which can be conveyed with vibrotactile feedback (VIBF). While prior studies have shown that force-based VIBF benefits control, the merits of motion-based VIBF are unclear. Our goal was to clarify the effectiveness of position- and velocity-based VIBF for prosthetic arm control.

Methods

Healthy adults with normal limb function practiced a goal-directed task with a virtual myoelectric prosthetic arm. A linear resonant actuator on the wrist provided VIBF. Two groups with nine subjects each received amplitude modulated VIBF in addition to visual feedback while practicing the task. In one group, the VIBF was proportional to the virtual arm’s position, and in the other group, velocity. A control group of nine subjects received only visual feedback. Subjects practiced for 240 trials, followed by 180 trials with feedback manipulations for the VIBF groups. Performance was characterized by end-point error, movement time, and a composite skill measure that combined these quantities. A second experiment with a new group of five subjects assessed discrimination capabilities between different position- and velocity-based VIBF profiles.

Results

With practice all groups improved their skill in controlling the virtual prosthetic arm. Subjects who received additional position- and velocity-based VIBF learned at the same rate as the control group, who received only visual feedback (learning rate time constant: about 40 trials). When visual feedback was subsequently removed leaving only VIBF, performance was no better than with no feedback at all. When VIBF was removed leaving only visual feedback, about half of the participants performed better, instead of worse. The VIBF discrimination tests showed that subjects could detect virtual arm angular position and velocity differences of about 5 deg and 20 deg/s, respectively.

Conclusions

Kinematic VIBF did not increase the rate of skill acquisition or improve performance when controlling a virtual myoelectric prosthetic arm, whether provided in isolation or coupled with visual feedback. VIBF had a deleterious effect on performance for some individuals, who may have had difficulty integrating kinematic VIBF information into their control strategies.

Regenerative Engineering and Bionic Limbs

Amputations of the upper extremity are severely debilitating, current treatments support very basic limb movement, and patients undergo extensive physiotherapy and psychological counselling. There is no prosthesis that allows the amputees near-normal function. With increasing number of amputees due to injuries sustained in accidents, natural calamities and international conflicts, there is a growing requirement for novel strategies and new discoveries. Advances have been made in technological, material and in prosthesis integration where researchers are now exploring artificial prosthesis that integrate with the residual tissues and function based on signal impulses received from the residual nerves. Efforts are focused on challenging experts in different disciplines to integrate ideas and technologies to allow for the regeneration of injured tissues, recording on tissue signals and feed-back to facilitate responsive movements and gradations of muscle force. A fully functional replacement and regenerative or integrated prosthesis will rely on interface of biological process with robotic systems to allow individual control of movement such as at the elbow, forearm, digits and thumb in the upper extremity. Regenerative engineering focused on the regeneration of complex tissue and organ systems will be realized by the cross-fertilization of advances over the past thirty years in the fields of tissue engineering, nanotechnology, stem cell science, and developmental biology. The convergence of toolboxes crated within each discipline will allow interdisciplinary teams from engineering, science, and medicine to realize new strategies, mergers of disparate technologies, such as biophysics, smart bionics, and the healing power of the mind. Tackling the clinical challenges, interfacing the biological process with bionic technologies, engineering biological control of the electronic systems, and feed-back will be the important goals in regenerative engineering over the next two decades.

Stability and selectivity of a chronic, multi-contact cuff electrode for sensory stimulation in human amputees

OBJECTIVE

Stability and selectivity are important when restoring long-term, functional sensory feedback in individuals with limb-loss. Our objective is to demonstrate a chronic, clinical neural stimulation system for providing selective sensory response in two upper-limb amputees.

APPROACH

Multi-contact cuff electrodes were implanted in the median, ulnar, and radial nerves of the upper-limb.

MAIN RESULTS

Nerve stimulation produced a selective sensory response on 19 of 20 contacts and 16 of 16 contacts in subjects 1 and 2, respectively. Stimulation elicited multiple, distinct percept areas on the phantom and residual limb. Consistent threshold, impedance, and percept areas have demonstrated that the neural interface is stable for the duration of this on-going, chronic study.

SIGNIFICANCE

We have achieved selective nerve response from multi-contact cuff electrodes by demonstrating characteristic percept areas and thresholds for each contact. Selective sensory response remains consistent in two upper-limb amputees for 1 and 2 years, the longest multi-contact sensory feedback system to date. Our approach demonstrates selectivity and stability can be achieved through an extraneural interface, which can provide sensory feedback to amputees.

Rapid evaluation of the durability of cortical neural implants using accelerated aging with reactive oxygen species

OBJECTIVE

A challenge for implementing high bandwidth cortical brain-machine interface devices in patients is the limited functional lifespan of implanted recording electrodes. Development of implant technology currently requires extensive non-clinical testing to demonstrate device performance. However, testing the durability of the implants in vivo is time-consuming and expensive. Validated in vitro methodologies may reduce the need for extensive testing in animal models.

APPROACH

Here we describe an in vitro platform for rapid evaluation of implant stability. We designed a reactive accelerated aging (RAA) protocol that employs elevated temperature and reactive oxygen species (ROS) to create a harsh aging environment. Commercially available microelectrode arrays (MEAs) were placed in a solution of hydrogen peroxide at 87 °C for a period of 7 days. We monitored changes to the implants with scanning electron microscopy and broad spectrum electrochemical impedance spectroscopy (1 Hz-1 MHz) and correlated the physical changes with impedance data to identify markers associated with implant failure.

MAIN RESULTS

RAA produced a diverse range of effects on the structural integrity and electrochemical properties of electrodes. Temperature and ROS appeared to have different effects on structural elements, with increased temperature causing insulation loss from the electrode microwires, and ROS concentration correlating with tungsten metal dissolution. All array types experienced impedance declines, consistent with published literature showing chronic (>30 days) declines in array impedance in vivo. Impedance change was greatest at frequencies <10 Hz, and smallest at frequencies 1 kHz and above. Though electrode performance is traditionally characterized by impedance at 1 kHz, our results indicate that an impedance change at 1 kHz is not a reliable predictive marker of implant degradation or failure.

SIGNIFICANCE

ROS, which are known to be present in vivo, can create structural damage and change electrical properties of MEAs. Broad-spectrum electrical impedance spectroscopy demonstrates increased sensitivity to electrode damage compared with single-frequency measurements. RAA can be a useful tool to simulate worst-case in vivo damage resulting from chronic electrode implantation, simplifying the device development lifecycle.

A functional model and simulation of spinal motor pools and intrafascicular recordings of motoneuron activity in peripheral nerve

Decoding motor intent from recorded neural signals is essential for the development of effective neural-controlled prostheses. To facilitate the development of online decoding algorithms we have developed a software platform to simulate neural motor signals recorded with peripheral nerve electrodes, such as longitudinal intrafascicular electrodes (LIFEs). The simulator uses stored motor intent signals to drive a pool of simulated motoneurons with various spike shapes, recruitment characteristics, and firing frequencies. Each electrode records a weighted sum of a subset of simulated motoneuron activity patterns. As designed, the simulator facilitates development of a suite of test scenarios that would not be possible with actual data sets because, unlike with actual recordings, in the simulator the individual contributions to the simulated composite recordings are known and can be methodically varied across a set of simulation runs. In this manner, the simulation tool is suitable for iterative development of real-time decoding algorithms prior to definitive evaluation in amputee subjects with implanted electrodes. The simulation tool was used to produce data sets that demonstrate its ability to capture some features of neural recordings that pose challenges for decoding algorithms.

Stimulation selectivity of the “thin-film longitudinal intrafascicular electrode” (tfLIFE) and the “transverse intrafascicular multi-channel electrode” (TIME) in the large nerve animal model

Neural prostheses are limited by the availability of peripheral neural electrodes to record the user's intention or provide sensory feedback through functional electrical stimulation. Our objective was to compare the ability of the novel “transverse intrafascicular multi-channel electrode” (TIME) and an earlier generation “thin-film longitudinal intrafascicular electrode” (tfLIFE) to selectively stimulate nerve fascicles and activate forelimb muscles in pigs. TIME was designed to access a larger subpopulation of fascicles than tfLIFE and should therefore be able to selectively activate a larger number of muscles. Electrodes were implanted in the median nerve, and sequential electric stimulation was applied to individual contacts. The compound muscle action potentials of seven muscles were recorded to quantify muscle recruitment. As expected, TIME was able to recruit more muscles with higher selectivity than tfLIFE (significant difference when comparing the performance of an entire electrode); a similar activation current was used (no significant difference). Histological analysis revealed that electrodes were located between fascicles, which influenced the selectivity and activation current level. In conclusion, TIME is a viable neural interface for selective activation of multiple fascicles in human-sized nerves that may assist to pave the way for future neuroprosthesis applications.

Humans can integrate feedback of discrete events in their sensorimotor control of a robotic hand

Providing functionally effective sensory feedback to users of prosthetics is a largely unsolved challenge. Traditional solutions require high band-widths for providing feedback for the control of manipulation and yet have been largely unsuccessful. In this study, we have explored a strategy that relies on temporally discrete sensory feedback that is technically simple to provide. According to the Discrete Event-driven Sensory feedback Control (DESC) policy, motor tasks in humans are organized in phases delimited by means of sensory encoded discrete mechanical events. To explore the applicability of DESC for control, we designed a paradigm in which healthy humans operated an artificial robot hand to lift and replace an instrumented object, a task that can readily be learned and mastered under visual control. Assuming that the central nervous system of humans naturally organizes motor tasks based on a strategy akin to DESC, we delivered short-lasting vibrotactile feedback related to events that are known to forcefully affect progression of the grasp-lift-and-hold task. After training, we determined whether the artificial feedback had been integrated with the sensorimotor control by introducing short delays and we indeed observed that the participants significantly delayed subsequent phases of the task. This study thus gives support to the DESC policy hypothesis. Moreover, it demonstrates that humans can integrate temporally discrete sensory feedback while controlling an artificial hand and invites further studies in which inexpensive, noninvasive technology could be used in clever ways to provide physiologically appropriate sensory feedback in upper limb prosthetics with much lower band-width requirements than with traditional solutions.

A cognitive neuroprosthetic that uses cortical stimulation for somatosensory feedback

OBJECTIVE

Present day cortical brain-machine interfaces (BMIs) have made impressive advances using decoded brain signals to control extracorporeal devices. Although BMIs are used in a closed-loop fashion, sensory feedback typically is visual only. However medical case studies have shown that the loss of somesthesis in a limb greatly reduces the agility of the limb even when visual feedback is available.

APPROACH

To overcome this limitation, this study tested a closed-loop BMI that utilizes intracortical microstimulation to provide 'tactile' sensation to a non-human primate.

MAIN RESULT

Using stimulation electrodes in Brodmann area 1 of somatosensory cortex (BA1) and recording electrodes in the anterior intraparietal area, the parietal reach region and dorsal area 5 (area 5d), it was found that this form of feedback can be used in BMI tasks.

SIGNIFICANCE

Providing somatosensory feedback has the poyential to greatly improve the performance of cognitive neuroprostheses especially for fine control and object manipulation. Adding stimulation to a BMI system could therefore improve the quality of life for severely paralyzed patients.

Toward more versatile and intuitive cortical brain-machine interfaces

Brain-machine interfaces have great potential for the development of neuroprosthetic applications to assist patients suffering from brain injury or neurodegenerative disease. One type of brain-machine interface is a cortical motor prosthetic, which is used to assist paralyzed subjects. Motor prosthetics to date have typically used the motor cortex as a source of neural signals for controlling external devices. The review will focus on several new topics in the arena of cortical prosthetics. These include using: recordings from cortical areas outside motor cortex; local field potentials as a source of recorded signals; somatosensory feedback for more dexterous control of robotics; and new decoding methods that work in concert to form an ecology of decode algorithms. These new advances promise to greatly accelerate the applicability and ease of operation of motor prosthetics.