Sensing without touching: psychophysical performance based on cortical microstimulation

Primary somatosensory cortex organization for engineering artificial somatosensation

Somatosensory deficits from stroke, spinal cord injury, or other neurologic damage can lead to a significant degree of functional impairment. The primary (SI) and secondary (SII) somatosensory cortices encode information in a medial to lateral organization. SI is generally organized topographically, with more discrete cortical representations of specific body regions. SII regions corresponding to anatomical areas are less discrete and may represent a more functional rather than topographic organization. Human somatosensory research continues to map cortical areas of sensory processing with efforts primarily focused on hand and upper extremity information in SI. However, research into SII and other body regions is lacking. In this review, we synthesize the current state of knowledge regarding the cortical organization of human somatosensation and discuss potential applications for brain computer interface. In addition to accurate individualized mapping of cortical somatosensation, further research is required to uncover the neurophysiological mechanisms of how somatosensory information is encoded in the cortex.

Disentangling sensory precision and prior expectation of change in autism during tactile discrimination

Predictive coding theories suggest that core symptoms in autism spectrum disorders (ASD) may stem from atypical mechanisms of perceptual inference (i.e., inferring the hidden causes of sensations). Specifically, there would be an imbalance in the precision or weight ascribed to sensory inputs relative to prior expectations. Using three tactile behavioral tasks and computational modeling, we specifically targeted the implicit dynamics of sensory adaptation and perceptual learning in ASD. Participants were neurotypical and autistic adults without intellectual disability. In Experiment I, tactile detection thresholds and adaptation effects were measured to assess sensory precision. Experiments II and III relied on two-alternative forced choice tasks designed to elicit a time-order effect, where prior knowledge biases perceptual decisions. Our results suggest a subtler explanation than a simple imbalance in the prior/sensory weights, having to do with the dynamic nature of perception, that is the adjustment of precision weights to context. Compared to neurotypicals, autistic adults showed no difference in average performance and sensory sensitivity. Both groups managed to implicitly learn and adjust a prior that biased their perception. However, depending on the context, autistic participants showed no, normal or slower adaptation, a phenomenon that computational modeling of trial-to-trial responses helped us to associate with a higher expectation for sameness in ASD, and to dissociate from another observed robust difference in terms of response bias. These results point to atypical perceptual learning rather than altered perceptual inference per se, calling for further empirical and computational studies to refine the current predictive coding theories of ASD.

Neural Plasticity in Sensorimotor Brain-Machine Interfaces

Brain-machine interfaces (BMIs) aim to treat sensorimotor neurological disorders by creating artificial motor and/or sensory pathways. Introducing artificial pathways creates new relationships between sensory input and motor output, which the brain must learn to gain dexterous control. This review highlights the role of learning in BMIs to restore movement and sensation, and discusses how BMI design may influence neural plasticity and performance. The close integration of plasticity in sensory and motor function influences the design of both artificial pathways and will be an essential consideration for bidirectional devices that restore both sensory and motor function.

Restoration of sensory information via bionic hands

Individuals who have lost the use of their hands because of amputation or spinal cord injury can use prosthetic hands to restore their independence. A dexterous prosthesis requires the acquisition of control signals that drive the movements of the robotic hand, and the transmission of sensory signals to convey information to the user about the consequences of these movements. In this Review, we describe non-invasive and invasive technologies for conveying artificial sensory feedback through bionic hands, and evaluate the technologies' long-term prospects.

Modulating Brain Activity with Invasive Brain-Computer Interface: A Narrative Review

Brain-computer interface (BCI) can be used as a real-time bidirectional information gateway between the brain and machines. In particular, rapid progress in invasive BCI, propelled by recent developments in electrode materials, miniature and power-efficient electronics, and neural signal decoding technologies has attracted wide attention. In this review, we first introduce the concepts of neuronal signal decoding and encoding that are fundamental for information exchanges in BCI. Then, we review the history and recent advances in invasive BCI, particularly through studies using neural signals for controlling external devices on one hand, and modulating brain activity on the other hand. Specifically, regarding modulating brain activity, we focus on two types of techniques, applying electrical stimulation to cortical and deep brain tissues, respectively. Finally, we discuss the related ethical issues concerning the clinical application of this emerging technology.

Neuroprosthetics: from sensorimotor to cognitive disorders

Neuroprosthetics is a multidisciplinary field at the interface between neurosciences and biomedical engineering, which aims at replacing or modulating parts of the nervous system that get disrupted in neurological disorders or after injury. Although neuroprostheses have steadily evolved over the past 60 years in the field of sensory and motor disorders, their application to higher-order cognitive functions is still at a relatively preliminary stage. Nevertheless, a recent series of proof-of-concept studies suggest that electrical neuromodulation strategies might also be useful in alleviating some cognitive and memory deficits, in particular in the context of dementia. Here, we review the evolution of neuroprosthetics from sensorimotor to cognitive disorders, highlighting important common principles such as the need for neuroprosthetic systems that enable multisite bidirectional interactions with the nervous system.

Suppression of Glucocorticoid Response in Stressed Mice Using 50 Hz Electric Field According to Immobilization Degree and Posture

Various studies on immobilized BALB/c mice to evaluate changes in hormone levels associated with stress responses have advanced the characterization of multiple aspects of the biological actions of extremely low-frequency (ELF) electric fields (EFs). In this study, we aimed to investigate the effect of mouse posture on its stress responses and evaluate the importance of adjusting the stress degree in the model. Mice were immobilized inside centrifuge tubes and exposed to an ELF EF generated between parallel plate electrodes. Blood was collected under anesthesia immediately after EF exposure, and plasma glucocorticoids were assayed. The inhibitory effects of EFs on glucocorticoid elevation by immobilization were reproduced regardless whether mice were in the abdominal or lateral recumbent position, for the EF vector delivered to mice through the sagittal or frontal plane. The effect of ELF EF was reproduced in moderately and mildly stressed mice but not in severely immobilized mice. Hence, adjusting the stress degree is critical to the reproducibility of the results for this model. We characterized the effects of ELF EF on homeostasis, including the stress response, and provided valuable information for the scientific evaluation of the biological risks and medical applications of ELF EF.

Characterizing the short-latency evoked response to intracortical microstimulation across a multi-electrode array

Objective.Persons with tetraplegia can use brain-machine interfaces to make visually guided reaches with robotic arms. Without somatosensory feedback, these movements will likely be slow and imprecise, like those of persons who retain movement but have lost proprioception. Intracortical microstimulation (ICMS) has promise for providing artificial somatosensory feedback. ICMS that mimics naturally occurring neural activity, may allow afferent interfaces that are more informative and easier to learn than stimulation evoking unnaturalistic activity. To develop such biomimetic stimulation patterns, it is important to characterize the responses of neurons to ICMS.Approach.Using a Utah multi-electrode array, we recorded activity evoked by both single pulses and trains of ICMS at a wide range of amplitudes and frequencies in two rhesus macaques. As the electrical artifact caused by ICMS typically prevents recording for many milliseconds, we deployed a custom rapid-recovery amplifier with nonlinear gain to limit signal saturation on the stimulated electrode. Across all electrodes after stimulation, we removed the remaining slow return to baseline with acausal high-pass filtering of time-reversed recordings.Main results.After single pulses of stimulation, we recorded what was likely transsynaptically-evoked activity even on the stimulated electrode as early as ∼0.7 ms. This was immediately followed by suppressed neural activity lasting 10-150 ms. After trains, this long-lasting inhibition was replaced by increased firing rates for ∼100 ms. During long trains, the evoked response on the stimulated electrode decayed rapidly while the response was maintained on non-stimulated channels.Significance.The detailed description of the spatial and temporal response to ICMS can be used to better interpret results from experiments that probe circuit connectivity or function of cortical areas. These results can also contribute to the design of stimulation patterns to improve afferent interfaces for artificial sensory feedback.

The science and engineering behind sensitized brain-controlled bionic hands

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

Stress-Reducing Effect of a 50 Hz Electric Field in Mice after Repeated Immobilizations, Electric Field Shields, and Polarization of the Electrodes

Simple Summary

With the increasing demand for electricity and electrical equipment, humans are routinely and unintentionally exposed to electric fields (EFs). Although no considerable adverse effects of EF exposure have been observed, slight physiological effects are known to occur. Additionally, there are methods and devices that expose subjects to EF for medical purposes. The mechanism of the biological effects of EF has not been identified, because the effects are not strong and may involve the physical properties of EFs, which are invisible and easily disturbed by obstacles. In a simple and short experiment using mice, we found that EF has an inhibitory effect on glucocorticoid (GC) responses. The experiment’s reproducibility was almost 100%. We tried to improve the understanding of the biological effects of EF by structuring our observations of the stress-reducing effects under different conditions in the system. We found that the inhibitory effect on the GC response was attenuated by EF shielding. We compared the effects of EF shielding between the head and abdomen, and found that the effects of EF were attenuated in both conditions, but might be more attenuated when the head was shielded. Thus, it appears that the area where the EF is distributed and the body part are important for the biological effects of EF. Two experiments with different conditions were performed. These results will help advance the current understanding of the effects of EF on stress systems.

Abstract

In BALB/c mice, immobilization-increased plasma glucocorticoid (GC) levels are suppressed by extremely low frequency (ELF) electric fields (EF). The aim of this study was to advance our understanding of the biological effects of ELF-EF, using its suppressive effect on the GC response. Mice were exposed to a 50 Hz EF of 10 kV/m via a parallel plate electrode and immobilized as needed. We examined the suppressive effect of ELF-EF on GC level change after repeated immobilizations, electrode polarization, and EF shielding of different portions of the mouse body parts. Additionally, bodyweight changes owing to stress and EF were examined. Immobilization-induced reduction in the plasma GC levels was reproduced in mice with stress and EF exposure, regardless of the stress episode numbers and electrode polarization. Furthermore, when the head of mice was shielded from the EF, the suppressive effect was possibly relatively lower than that when the abdomen was shielded. The bodyweight of the mice decreased for 3 days after immobilization before recovering; ELF-EF did not affect the bodyweight. Thus, to elicit the biological effects of the EF, not only the size of the area where the EF is distributed but also the area where the field is distributed should be important. The results also confirmed the stableness of the present experimental system, at least in terms of the stress-reducing effect. In addition, the restriction in this study caused weight loss, but ELF-EF was not considered to affect it. The results improve the understanding of the biological effect and medical applications of ELF-EF.

Similarities Between Somatosensory Cortical Responses Induced via Natural Touch and Microstimulation in the Ventral Posterior Lateral Thalamus in Macaques

Lost sensations, such as touch, could be restored by microstimulation (MiSt) along the sensory neural substrate. Such neuroprosthetic sensory information can be used as feedback from an invasive brain-machine interface (BMI) to control a robotic arm/hand, such that tactile and proprioceptive feedback from the sensorized robotic arm/hand is directly given to the BMI user. Microstimulation in the human somatosensory thalamus (Vc) has been shown to produce somatosensory perceptions. However, until recently, systematic methods for using thalamic stimulation to evoke naturalistic touch perceptions were lacking. We have recently presented rigorous methods for determining a mapping between ventral posterior lateral thalamus (VPL) MiSt, and neural responses in the somatosensory cortex (S1), in a rodent model (Choi et al., 2016; Choi and Francis, 2018). Our technique minimizes the difference between S1 neural responses induced by natural sensory stimuli and those generated via VPL MiSt. Our goal is to develop systems that know what neural response a given MiSt will produce and possibly allow the development of natural “sensation.” To date, our optimization has been conducted in the rodent model and simulations. Here, we present data from simple non-optimized thalamic MiSt during peri-operative experiments, where we used MiSt in the VPL of macaques, which have a somatosensory system more like humans, as compared to our previous rat work (Li et al., 2014; Choi et al., 2016). We implanted arrays of microelectrodes across the hand area of the macaque S1 cortex as well as in the VPL. Multi and single-unit recordings were used to compare cortical responses to natural touch and thalamic MiSt in the anesthetized state. Post-stimulus time histograms were highly correlated between the VPL MiSt and natural touch modalities, adding support to the use of VPL MiSt toward producing a somatosensory neuroprosthesis in humans.

Stoney vs. Histed: Quantifying the spatial effects of intracortical microstimulation

BACKGROUND

Intracortical microstimulation (ICMS) is used to map neural circuits and restore lost sensory modalities such as vision, hearing, and somatosensation. The spatial effects of ICMS remain controversial: Stoney and colleagues proposed that the volume of somatic activation increased with stimulation intensity, while Histed et al., suggested activation density, but not somatic activation volume, increases with stimulation intensity.

OBJECTIVE

We used computational modeling to quantify the spatial effects of ICMS intensity and unify the apparently paradoxical findings of Histed and Stoney.

METHODS

We implemented a biophysically-based computational model of a cortical column comprising neurons with realistic morphology and representative synapses. We quantified the spatial effects of single pulses and short trains of ICMS, including the volume of activated neurons and the density of activated neurons as a function of stimulation intensity.

RESULTS

At all amplitudes, the dominant mode of somatic activation was by antidromic propagation to the soma following axonal activation, rather than via transsynaptic activation. There were no occurrences of direct activation of somata or dendrites. The volume over which antidromic action potentials were initiated grew with stimulation amplitude, while the volume of somatic activation increased marginally. However, the density of somatic activation within the activated volume increased with stimulation amplitude.

CONCLUSIONS

The results resolve the apparent paradox between Stoney and Histed's results by demonstrating that the volume over which action potentials are initiated grows with ICMS amplitude, consistent with Stoney. However, the volume occupied by the activated somata remains approximately constant, while the density of activated neurons within that volume increase, consistent with Histed.

Perception of microstimulation frequency in human somatosensory cortex

Microstimulation in the somatosensory cortex can evoke artificial tactile percepts and can be incorporated into bidirectional brain–computer interfaces (BCIs) to restore function after injury or disease. However, little is known about how stimulation parameters themselves affect perception. Here, we stimulated through microelectrode arrays implanted in the somatosensory cortex of two human participants with cervical spinal cord injury and varied the stimulus amplitude, frequency, and train duration. Increasing the amplitude and train duration increased the perceived intensity on all tested electrodes. Surprisingly, we found that increasing the frequency evoked more intense percepts on some electrodes but evoked less-intense percepts on other electrodes. These different frequency–intensity relationships were divided into three groups, which also evoked distinct percept qualities at different stimulus frequencies. Neighboring electrode sites were more likely to belong to the same group. These results support the idea that stimulation frequency directly controls tactile perception and that these different percepts may be related to the organization of somatosensory cortex, which will facilitate principled development of stimulation strategies for bidirectional BCIs.

Generating artificial sensations with spinal cord stimulation in primates and rodents

For patients who have lost sensory function due to a neurological injury such as spinal cord injury (SCI), stroke, or amputation, spinal cord stimulation (SCS) may provide a mechanism for restoring somatic sensations via an intuitive, non-visual pathway. Inspired by this vision, here we trained rhesus monkeys and rats to detect and discriminate patterns of epidural SCS. Thereafter, we constructed psychometric curves describing the relationship between different SCS parameters and the animal's ability to detect SCS and/or changes in its characteristics. We found that the stimulus detection threshold decreased with higher frequency, longer pulse-width, and increasing duration of SCS. Moreover, we found that monkeys were able to discriminate temporally- and spatially-varying patterns (i.e. variations in frequency and location) of SCS delivered through multiple electrodes. Additionally, sensory discrimination of SCS-induced sensations in rats obeyed Weber's law of just-noticeable differences. These findings suggest that by varying SCS intensity, temporal pattern, and location different sensory experiences can be evoked. As such, we posit that SCS can provide intuitive sensory feedback in neuroprosthetic devices.

Layer-specific parameters of intracortical microstimulation of the somatosensory cortex

Objective. Intracortical microstimulation of the primary somatosensory cortex (S1) has shown great progress in restoring touch sensations to patients with paralysis. Stimulation parameters such as amplitude, phase duration, and frequency can influence the quality of the evoked percept as well as the amount of charge necessary to elicit a response. Previous studies in V1 and auditory cortices have shown that the behavioral responses to stimulation amplitude and phase duration change across cortical depth. However, this depth-dependent response has yet to be investigated in S1. Similarly, to our knowledge, the response to microstimulation frequency across cortical depth remains unexplored.Approach. To assess these questions, we implanted rats in S1 with a microelectrode with electrode-sites spanning all layers of the cortex. A conditioned avoidance behavioral paradigm was used to measure detection thresholds and responses to phase duration and frequency across cortical depth.Main results. Analogous to other cortical areas, the sensitivity to charge and strength-duration chronaxies in S1 varied across cortical layers. Likewise, the sensitivity to microstimulation frequency was layer dependent.Significance. These findings suggest that cortical depth can play an important role in the fine-tuning of stimulation parameters and in the design of intracortical neuroprostheses for clinical applications.

Touch inhibits touch: sanshool-induced paradoxical tingling reveals perceptual interaction between somatosensory submodalities

Human perception of touch is mediated by inputs from multiple channels. Classical theories postulate independent contributions of each channel to each tactile feature, with little or no interaction between channels. In contrast to this view, we show that inputs from two sub-modalities of mechanical input channels interact to determine tactile perception. The flutter-range vibration channel was activated anomalously using hydroxy-α-sanshool, a bioactive compound of Szechuan pepper, which chemically induces vibration-like tingling sensations. We tested whether this tingling sensation on the lips was modulated by sustained mechanical pressure. Across four experiments, we show that sustained touch inhibits sanshool tingling sensations in a location-specific, pressure-level and time-dependent manner. Additional experiments ruled out the mediation of this interaction by nociceptive or affective (C-tactile) channels. These results reveal novel inhibitory influence from steady pressure onto flutter-range tactile perceptual channels, consistent with early-stage interactions between mechanoreceptor inputs within the somatosensory pathway.

Utility and lower limits of frequency detection in surface electrode stimulation for somatosensory brain-computer interface in humans

OBJECTIVE

Stimulation of the primary somatosensory cortex (S1) has been successful in evoking artificial somatosensation in both humans and animals, but much is unknown about the optimal stimulation parameters needed to generate robust percepts of somatosensation. In this study, the authors investigated frequency as an adjustable stimulation parameter for artificial somatosensation in a closed-loop brain-computer interface (BCI) system.

METHODS

Three epilepsy patients with subdural mini-electrocorticography grids over the hand area of S1 were asked to compare the percepts elicited with different stimulation frequencies. Amplitude, pulse width, and duration were held constant across all trials. In each trial, subjects experienced 2 stimuli and reported which they thought was given at a higher stimulation frequency. Two paradigms were used: first, 50 versus 100 Hz to establish the utility of comparing frequencies, and then 2, 5, 10, 20, 50, or 100 Hz were pseudorandomly compared.

RESULTS

As the magnitude of the stimulation frequency was increased, subjects described percepts that were "more intense" or "faster." Cumulatively, the participants achieved 98.0% accuracy when comparing stimulation at 50 and 100 Hz. In the second paradigm, the corresponding overall accuracy was 73.3%. If both tested frequencies were less than or equal to 10 Hz, accuracy was 41.7% and increased to 79.4% when one frequency was greater than 10 Hz (p = 0.01). When both stimulation frequencies were 20 Hz or less, accuracy was 40.7% compared with 91.7% when one frequency was greater than 20 Hz (p < 0.001). Accuracy was 85% in trials in which 50 Hz was the higher stimulation frequency. Therefore, the lower limit of detection occurred at 20 Hz, and accuracy decreased significantly when lower frequencies were tested. In trials testing 10 Hz versus 20 Hz, accuracy was 16.7% compared with 85.7% in trials testing 20 Hz versus 50 Hz (p < 0.05). Accuracy was greater than chance at frequency differences greater than or equal to 30 Hz.

CONCLUSIONS

Frequencies greater than 20 Hz may be used as an adjustable parameter to elicit distinguishable percepts. These findings may be useful in informing the settings and the degrees of freedom achievable in future BCI systems.

The temporal pattern of Intracortical Microstimulation pulses elicits distinct temporal and spatial recruitment of cortical neuropil and neurons

OBJECTIVE

The spacing or distribution of stimulation pulses of therapeutic neurostimulation waveforms-referred to here as the Temporal Pattern (TP)-has emerged as an important parameter for tuning the response to deep-brain stimulation and intracortical microstimulation (ICMS). While it has long been assumed that modulating the TP of ICMS may be effective by altering the rate coding of the neural response, it is unclear how it alters the neural response at the neural network level. The present study is designed to elucidate the neural response to TP at the network level.

APPROACH

We use in vivo two-photon imaging of ICMS in mice expressing the calcium sensor Thy1-GCaMP or the glutamate sensor hSyn-iGluSnFr to examine the layer II/III neural response to stimulations with different TPs. We study the neuronal calcium and glutamate response to TPs with the same average frequency (10Hz) and same total charge injection, but varying degrees of bursting. We also investigate one control pattern with an average frequency of 100Hz and 10X the charge injection.

MAIN RESULTS

Stimulation trains with the same average frequency (10 Hz) and same total charge injection but distinct temporal patterns recruits distinct sets of neurons. More-than-half (60% of 309 cells) prefer one temporal pattern over the other. Despite their distinct spatial recruitment patterns, both cells exhibit similar ability to follow 30s trains of both TPs without failing, and they exhibit similar levels of glutamate release during stimulation. Both neuronal calcium and glutamate release train to the bursting TP pattern (~21-fold increase in relative power at the frequency of bursting. Bursting also results in a statistically significant elevation in the correlation between somatic calcium activity and neuropil activity, which we explore as a metric for inhibitory-excitatory tone. Interestingly, soma-neuropil correlation during the bursting pattern is a statistically significant predictor of cell preference for TP, which exposes a key link between inhibitory-excitatory tone. Finally, using mesoscale imaging, we show that both TPs result in distal inhibition during stimulation, which reveals complex spatial and temporal interactions between temporal pattern and inhibitory-excitatory tone in ICMS.

SIGNIFICANCE

Our results may ultimately suggest that TP is a valuable parameter space to modulate inhibitory-excitatory tone as well as distinct network activity in ICMS. This presents a broader mechanism of action than rate coding, as previously thought. By implicating these additional mechanisms, TP may have broader utility in the clinic and should be pursued to expand the efficacy of ICMS therapies.

Brain (re)organisation following amputation: Implications for phantom limb pain

Following arm amputation the region that represented the missing hand in primary somatosensory cortex (S1) becomes deprived of its primary input, resulting in changed boundaries of the S1 body map. This remapping process has been termed 'reorganisation' and has been attributed to multiple mechanisms, including increased expression of previously masked inputs. In a maladaptive plasticity model, such reorganisation has been associated with phantom limb pain (PLP). Brain activity associated with phantom hand movements is also correlated with PLP, suggesting that preserved limb functional representation may serve as a complementary process. Here we review some of the most recent evidence for the potential drivers and consequences of brain (re)organisation following amputation, based on human neuroimaging. We emphasise other perceptual and behavioural factors consequential to arm amputation, such as non-painful phantom sensations, perceived limb ownership, intact hand compensatory behaviour or prosthesis use, which have also been related to both cortical changes and PLP. We also discuss new findings based on interventions designed to alter the brain representation of the phantom limb, including augmented/virtual reality applications and brain computer interfaces. These studies point to a close interaction of sensory changes and alterations in brain regions involved in body representation, pain processing and motor control. Finally, we review recent evidence based on methodological advances such as high field neuroimaging and multivariate techniques that provide new opportunities to interrogate somatosensory representations in the missing hand cortical territory. Collectively, this research highlights the need to consider potential contributions of additional brain mechanisms, beyond S1 remapping, and the dynamic interplay of contextual factors with brain changes for understanding and alleviating PLP.

Temporal patterns in electrical nerve stimulation: Burst gap code shapes tactile frequency perception

We have previously described a novel temporal encoding mechanism in the somatosensory system, where mechanical pulses grouped into periodic bursts create a perceived tactile frequency based on the duration of the silent gap between bursts, rather than the mean rate or the periodicity. This coding strategy may offer new opportunities for transmitting information to the brain using various sensory neural prostheses and haptic interfaces. However, it was not known whether the same coding mechanisms apply when using electrical stimulation, which recruits a different spectrum of afferents. Here, we demonstrate that the predictions of the burst gap coding model for frequency perception apply to burst stimuli delivered with electrical pulses, re-emphasising the importance of the temporal structure of spike patterns in neural processing and perception of tactile stimuli. Reciprocally, the electrical stimulation data confirm that the results observed with mechanical stimulation do indeed depend on neural processing mechanisms in the central nervous system, and are not due to skin mechanical factors and resulting patterns of afferent activation.

Generating Artificial Sensations with Spinal Cord Stimulation in Primates and Rodents.. [DOI: 10.1101/2020.05.09.085647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

For patients who have lost sensory function due to a neurological injury such as spinal cord injury (SCI), stroke, or amputation, spinal cord stimulation (SCS) may provide a mechanism for restoring somatic sensations via an intuitive, non-visual pathway. Inspired by this vision, here we trained rhesus monkeys and rats to detect and discriminate patterns of epidural SCS. Thereafter, we constructed psychometric curves describing the relationship between different SCS parameters and the animal’s ability to detect SCS and/or changes in its characteristics. We found that the stimulus detection threshold decreased with higher frequency, longer pulse-width, and increasing duration of SCS. Moreover, we found that monkeys were able to discriminate temporally- and spatially-varying patterns (i.e. variations in frequency and location) of SCS delivered through multiple electrodes. Additionally, sensory discrimination of SCS-induced sensations in rats obeyed Weber’s law of just noticeable differences. These findings suggest that by varying SCS intensity, temporal pattern, and location different sensory experiences can be evoked. As such, we posit that SCS can provide intuitive sensory feedback in neuroprosthetic devices.

Mapping mesoscale cortical connectivity in monkey sensorimotor cortex with optical imaging and microstimulation

To map in vivo cortical circuitry at the mesoscale, we applied a novel approach to map interareal functional connectivity. Electrical intracortical microstimulation (ICMS) in conjunction with optical imaging of intrinsic signals (OIS) was used map functional connections in somatosensory cortical areas in anesthetized squirrel monkeys. ICMS produced activations that were focal and that displayed responses which were stimulation intensity dependent. ICMS in supragranular layers of Brodmann Areas 3b, 1, 2, 3a, and M1 evoked interareal activation patterns that were topographically appropriate and appeared consistent with known anatomical connectivity. Specifically, ICMS revealed Area 3b connections with Area 1; Area 1 connections with Areas 2 and 3a; Area 2 connections with Areas 1, 3a, and M1; Area 3a connections with Areas M1, 1, and 2; and M1 connections with Areas 3a, 1, and 2. These somatosensory connectivity patterns were reminiscent of feedforward patterns observed anatomically, although feedback contributions are also likely present. Further consistent with anatomical connectivity, intra-areal and intra-areal patterns of activation were patchy with patch sizes of 200-300 μm. In summary, ICMS with OIS is a novel approach for mapping interareal and intra-areal connections in vivo. Comparisons with feedforward and feedback anatomical connectivity are discussed.

Turning Touch into Perception

Many brain areas modulate their activity during vibrotactile tasks. The activity from these areas may code the stimulus parameters, stimulus perception, or perceptual reports. Here, we discuss findings obtained in behaving monkeys aimed to understand these processes. In brief, neurons from the somatosensory thalamus and primary somatosensory cortex (S1) only code the stimulus parameters during the stimulation periods. In contrast, areas downstream of S1 code the stimulus parameters during not only the task components but also perception. Surprisingly, the midbrain dopamine system is an actor not considered before in perception. We discuss the evidence that it codes the subjective magnitude of a sensory percept. The findings reviewed here may help us to understand where and how sensation transforms into perception in the brain.

A Brain to Spine Interface for Transferring Artificial Sensory Information

Lack of sensory feedback is a major obstacle in the rapid absorption of prosthetic devices by the brain. While electrical stimulation of cortical and subcortical structures provides unique means to deliver sensory information to higher brain structures, these approaches require highly invasive surgery and are dependent on accurate targeting of brain structures. Here, we propose a semi-invasive method, Dorsal Column Stimulation (DCS) as a tool for transferring sensory information to the brain. Using this new approach, we show that rats can learn to discriminate artificial sensations generated by DCS and that DCS-induced learning results in corticostriatal plasticity. We also demonstrate a proof of concept brain-to-spine interface (BTSI), whereby tactile and artificial sensory information are decoded from the brain of an “encoder” rat, transformed into DCS pulses, and delivered to the spinal cord of a second “decoder” rat while the latter performs an analog-to-digital conversion during a sensory discrimination task. These results suggest that DCS can be used as an effective sensory channel to transmit prosthetic information to the brain or between brains, and could be developed as a novel platform for delivering tactile and proprioceptive feedback in clinical applications of brain-machine interfaces.

The frequency of cortical microstimulation shapes artificial touch

Intracortical microstimulation (ICMS) of the somatosensory cortex evokes vivid tactile sensations and can be used to convey sensory feedback from brain-controlled bionic hands. Changes in ICMS frequency lead to changes in the resulting sensation, but the discriminability of frequency has only been investigated over a narrow range of low frequencies. Furthermore, the sensory correlates of changes in ICMS frequency remain poorly understood. Specifically, it remains to be elucidated whether changes in frequency only modulate sensation magnitude-as do changes in amplitude-or whether they also modulate the quality of the sensation. To fill these gaps, we trained monkeys to discriminate the frequency of ICMS pulse trains over a wide range of frequencies (from 10 to 400 Hz). ICMS amplitude also varied across stimuli to dissociate sensation magnitude from ICMS frequency and ensure that animals could not make frequency judgments based on magnitude. We found that animals could consistently discriminate ICMS frequency up to ∼200 Hz but that the sensory correlates of frequency were highly electrode dependent: On some electrodes, changes in frequency were perceptually distinguishable from changes in amplitude-seemingly giving rise to a change in sensory quality; on others, they were not. We discuss the implications of our findings for neural coding and for brain-controlled bionic hands.

From thought to action: The brain-machine interface in posterior parietal cortex

A dramatic example of translational monkey research is the development of neural prosthetics for assisting paralyzed patients. A neuroprosthesis consists of implanted electrodes that can record the intended movement of a paralyzed part of the body, a computer algorithm that decodes the intended movement, and an assistive device such as a robot limb or computer that is controlled by these intended movement signals. This type of neuroprosthetic system is also referred to as a brain-machine interface (BMI) since it interfaces the brain with an external machine. In this review, we will concentrate on BMIs in which microelectrode recording arrays are implanted in the posterior parietal cortex (PPC), a high-level cortical area in both humans and monkeys that represents intentions to move. This review will first discuss the basic science research performed in healthy monkeys that established PPC as a good source of intention signals. Next, it will describe the first PPC implants in human patients with tetraplegia from spinal cord injury. From these patients the goals of movements could be quickly decoded, and the rich number of action variables found in PPC indicates that it is an appropriate BMI site for a very wide range of neuroprosthetic applications. We will discuss research on learning to use BMIs in monkeys and humans and the advances that are still needed, requiring both monkey and human research to enable BMIs to be readily available in the clinic.

Short reaction times in response to multi-electrode intracortical microstimulation may provide a basis for rapid movement-related feedback

OBJECTIVE

Tetraplegic patients using brain-machine interfaces can make visually guided reaches with robotic arms. However, restoring proprioceptive feedback to these patients will be critical, as evidenced by the movement deficit in patients with proprioceptive loss. Proprioception is critical in large part because it provides faster feedback than vision. Intracortical microstimulation (ICMS) is a promising approach, but the ICMS-evoked reaction time (RT) is typically slower than that to natural proprioceptive and often even visual cues, implying that ICMS feedback may not be fast enough to guide movement.

APPROACH

For most sensory modalities, RT decreases with increased stimulus intensity. Thus, it may be that stimulation intensities beyond what has previously been used will result in faster RTs. To test this, we compared the RT to ICMS applied through multi-electrode arrays in area 2 of somatosensory cortex to that of mechanical and visual cues.

MAIN RESULTS

We found that the RT to single-electrode ICMS decreased with increased current, frequency, and train length. For 100 µA, 330 Hz stimulation, the highest single-electrode intensity we tested routinely, most electrodes resulted in RTs slower than the mechanical cue but slightly faster than the visual cue. While increasing the current beyond 100 µA resulted in faster RTs, sustained stimulation at this level may damage tissue. Alternatively, by stimulating through multiple electrodes (mICMS), a large amount of current can be injected while keeping that through each electrode at a safe level. We found that stimulation with at least 480 µA equally distributed over 16 electrodes could produce RTs as much as 20 ms faster than the mechanical cue, roughly the conduction delay to cortex from the periphery.

SIGNIFICANCE

These results suggest that mICMS may provide a means to supply rapid, movement-related feedback. Future neuroprosthetics may need spatiotemporally patterned mICMS to convey useful somatosensory information. Novelty & Significance Intracortical microstimulation (ICMS) is a promising approach for providing artificial somatosensation to patients with spinal cord injury or limb amputation, but in prior experiments, subjects have been unable to respond as quickly to it as to natural cues. We have investigated the use of multi-electrode stimulation (mICMS) and discovered that it can produce reaction times as fast or faster even than natural mechanical cues. Although our stimulus trains were not modulated in time, this result opens the door to more complex spatiotemporal patterns of mICMS that might be used to rapidly write in complex somatosensory information to the CNS.

Gender and Age Differences in the Suppressive Effect of a 50 Hz Electric Field on the Immobilization-Induced Increase of Plasma Glucocorticoid in Mice

We developed an experimental system to characterize the suppressive effect of extremely low-frequency (ELF) electric fields (EFs) on the stress response. We assessed differences in the EF effects by age and gender. Control, EF-alone, immobilization-alone, and co-treated groups were subjected to an EF (50 Hz, 10 kV/m). Co-treated mice were exposed to the EF for 60 min, with immobilization during the latter half. Our results indicate that the suppressive effects of ELF EFs on the stress response in immobilized mice occur regardless of gender or age. As stress plays an important role in the onset and progression of various diseases, these findings may have broad implications for understanding the efficacy of EFs in animal, and perhaps human, health. Bioelectromagnetics. 2020;41:156-163. © 2019 Bioelectromagnetics Society.

Brain-Machine Interface-Based Rat-Robot Behavior Control

Brain-machine interface (BMI) provides a bidirectional pathway between the brain and external facilities. The machine-to-brain pathway makes it possible to send artificial information back into the biological brain, interfering neural activities and generating sensations. The idea of the BMI-assisted bio-robotic animal system is accomplished by stimulations on specific sites of the nervous system. With the technology of BMI, animals' locomotion behavior can be precisely controlled as robots, which made the animal turning into bio-robot. In this chapter, we reviewed our lab works focused on rat-robot navigation. The principles of rat-robot system have been briefly described first, including the target brain sites chosen for locomotion control and the design of remote control system. Some methodological advances made by optogenetic technologies for better modulation control have then been introduced. Besides, we also introduced our implementation of "mind-controlled" rat navigation system. Moreover, we have presented our efforts made on combining biological intelligence with artificial intelligence, with developments of automatic control and training system assisted with images or voices inputs. We concluded this chapter by discussing further developments to acquire environmental information as well as promising applications with write-in BMIs.

Global Tactile Coding in Rat Barrel Cortex in the Absence of Local Cues

Although whisker-related perception is based predominantly on local, near-instantaneous coding, global, intensive coding, which integrates the vibrotactile signal over time, has also been shown to play a role given appropriate behavioral conditions. Here, we study global coding in isolation by studying head-fixed rats that identified pulsatile stimuli differing in pulse frequency but not in pulse waveforms, thus abolishing perception based on local coding. We quantified time locking and spike counts as likely variables underpinning the 2 coding schemes. Both neurometric variables contained substantial stimulus information, carried even by spikes of single barrel cortex neurons. To elucidate which type of information is actually used by the rats, we systematically compared psychometric with neurometric sensitivity based on the 2 coding schemes. Neurometric performance was calculated by using a population-encoding model incorporating the properties of our recorded neuron sample. We found that sensitivity calculated from spike counts sampled over long periods (>1 s) matched the performance of rats better than the one carried by spikes time-locked to the stimulus. We conclude that spike counts are more relevant to tactile perception when instantaneous kinematic parameters are not available.

A Robust Encoding Scheme for Delivering Artificial Sensory Information via Direct Brain Stimulation

Innovations for creating somatosensation via direct electrical stimulation of the brain will be required for the next generation of bi-directional cortical neuroprostheses. The current lack of tactile perception and proprioceptive input likely imposes a fundamental limit on speed and accuracy of brain-controlled prostheses or re-animated limbs. This study addresses the unique challenge of identifying a robust, high bandwidth sensory encoding scheme in a high-dimensional parameter space. Previous studies demonstrated single dimensional encoding schemes delivering low bandwidth sensory information, but no comparison has been performed across parameters, nor with update rates suitable for real-time operation of a neuroprosthesis. Here, we report the first comprehensive measurement of the resolution of key stimulation parameters such as pulse amplitude, pulse width, frequency, train interval and number of pulses. Surprisingly, modulation of stimulation frequency was largely undetectable. While we initially expected high frequency content to be an ideal candidate for passing high throughput sensory signals to the brain, we found only modulation of very low frequencies were detectable. Instead, the charge-per-phase of each pulse yields the highest resolution sensory signal, and is the key parameter modulating perceived intensity. The stimulation encoding patterns were designed for high-bandwidth information transfer that will be required for bi-directional brain interfaces. Our discovery of the stimulation features which best encode perceived intensity have significant implications for design of any neural interface seeking to convey information directly to the brain via electrical stimulation.

Whisker-Mediated Touch System in Rodents: From Neuron to Behavior

A key question in systems neuroscience is to identify how sensory stimuli are represented in neuronal activity, and how the activity of sensory neurons in turn is “read out” by downstream neurons and give rise to behavior. The choice of a proper model system to address these questions, is therefore a crucial step. Over the past decade, the increasingly powerful array of experimental approaches that has become available in non-primate models (e.g., optogenetics and two-photon imaging) has spurred a renewed interest for the use of rodent models in systems neuroscience research. Here, I introduce the rodent whisker-mediated touch system as a structurally well-established and well-organized model system which, despite its simplicity, gives rise to complex behaviors. This system serves as a behaviorally efficient model system; known as nocturnal animals, along with their olfaction, rodents rely on their whisker-mediated touch system to collect information about their surrounding environment. Moreover, this system represents a well-studied circuitry with a somatotopic organization. At every stage of processing, one can identify anatomical and functional topographic maps of whiskers; “barrelettes” in the brainstem nuclei, “barreloids” in the sensory thalamus, and “barrels” in the cortex. This article provides a brief review on the basic anatomy and function of the whisker system in rodents.

Functional Frequency Discrimination From Cortical Somatosensory Stimulation in Humans

Recently, efforts to produce artificial sensation through cortical stimulation of primary somatosensory cortex (PSC) in humans have proven safe and reliable. Changes in stimulation parameters like frequency and amplitude have been shown to elicit different percepts, but without clearly defined psychometric profiles. This study investigates the functionally useful limits of frequency changes on the percepts felt by three epilepsy patients with subdural electrocorticography (ECoG) grids. Subjects performing a hidden target task were stimulated with parameters of constant amplitude, pulse-width, and pulse-duration, and a randomly selected set of two frequencies (20, 30, 40, 50, 60, and 100 Hz). They were asked to decide which target had the “higher” frequency. Objectively, an increase in frequency differences was associated with an increase in perceived intensity. Reliable detection of stimulation occurred at and above 40 Hz with a lower limit of detection around 20 Hz and a just-noticeable difference estimated at less than 10 Hz. These findings suggest that frequency can be used as a reliable, adjustable parameter and may be useful in establishing settings and thresholds of functionality in future BCI systems.

Remote-Controlled Fully Implantable Neural Stimulator for Freely Moving Small Animal

The application of a neural stimulator to small animals is highly desired for the investigation of electrophysiological studies and development of neuroprosthetic devices. For this purpose, it is essential for the device to be implemented with the capabilities of full implantation and wireless control. Here, we present a fully implantable stimulator with remote controllability, compact size, and minimal power consumption. Our stimulator consists of modular units of (1) a surface-type cortical array for inducing directional change of a rat, (2) a depth-type array for providing rewards, and (3) a package for accommodating the stimulating electronics, a battery and ZigBee telemetry, all of which are assembled after independent fabrication and implantation using customized flat cables and connectors. All three modules were packaged using liquid crystal polymer (LCP) to avoid any chemical reaction after implantation. After bench-top evaluation of device functionality, the stimulator was implanted into rats to train the animals to turn to the left (or right) following a directional cue applied to the barrel cortex. Functionality of the device was also demonstrated in a three-dimensional (3D) maze structure, by guiding the rats to better navigate in the maze. The movement of the rat could be wirelessly controlled by a combination of artificial sensation evoked by the surface electrode array and reward stimulation. We could induce rats to turn left or right in free space and help their navigation through the maze. The polymeric packaging and modular design could encapsulate the devices with strict size limitations, which made it possible to fully implant the device into rats. Power consumption was minimized by a dual-mode power-saving scheme with duty cycling. The present study demonstrated feasibility of the proposed neural stimulator to be applied to neuroprosthesis research.

Direct stimulation of somatosensory cortex results in slower reaction times compared to peripheral touch in humans

Direct cortical stimulation (DCS) of primary somatosensory cortex (S1) could help restore sensation and provide task-relevant feedback in a neuroprosthesis. However, the psychophysics of S1 DCS is poorly studied, including any comparison to cutaneous haptic stimulation. We compare the response times to DCS of human hand somatosensory cortex through electrocorticographic grids with response times to haptic stimuli delivered to the hand in four subjects. We found that subjects respond significantly slower to S1 DCS than to natural, haptic stimuli for a range of DCS train durations. Median response times for haptic stimulation varied from 198 ms to 313 ms, while median responses to reliably perceived DCS ranged from 254 ms for one subject, all the way to 528 ms for another. We discern no significant impact of learning or habituation through the analysis of blocked trials, and find no significant impact of cortical stimulation train duration on response times. Our results provide a realistic set of expectations for latencies with somatosensory DCS feedback for future neuroprosthetic applications and motivate the study of neural mechanisms underlying human perception of somatosensation via DCS.

Technical considerations for generating somatosensation via cortical stimulation in a closed-loop sensory/motor brain-computer interface system in humans

Somatosensory feedback is the next step in brain computer interface (BCI). Here, we compare three cortical stimulating array modalities for generating somatosensory percepts in BCI. We compared human subjects with either a 64-channel "mini"-electrocorticography grid (mECoG; 1.2-mm diameter exposed contacts with 3-mm spacing, N = 1) over the hand area of primary somatosensory cortex (S1), or a standard grid (sECoG; 1.5-mm diameter exposed contacts with 1-cm spacing, N = 1), to generate artificial somatosensation through direct electrical cortical stimulation. Finally, we reference data in the literature from a patient implanted with microelectrode arrays (MEA) placed in the S1 hand area. We compare stimulation results to assess coverage and specificity of the artificial percepts in the hand. Using the mECoG array, hand mapping revealed coverage of 41.7% of the hand area versus 100% for the sECoG array, and 18.8% for the MEA. On average, stimulation of a single electrode corresponded to sensation reported in 4.42 boxes (range 1-11 boxes) for the mECoG array, 19.11 boxes (range 4-48 boxes) for the sECoG grid, and 2.3 boxes (range 1-5 boxes) for the MEA. Sensation in any box, on average, corresponded to stimulation from 2.65 electrodes (range 1-5 electrodes) for the mECoG grid, 3.58 electrodes for the sECoG grid (range 2-4 electrodes), and 11.22 electrodes (range 2-17 electrodes) for the MEA. Based on these findings, we conclude that mECoG grids provide an excellent balance between spatial cortical coverage of the hand area of S1 and high-density resolution.

Cell Type Specific Representation of Vibro-tactile Stimuli in the Mouse Primary Somatosensory Cortex

Although the processing of whisker deflections in the barrel area of the rodent primary somatosensory cortex (S1) has been studied extensively, how cutaneous vibro-tactile stimuli are processed in the rodent S1 outside the barrel area has not been fully examined. Particularly, the cell-type specific representation of multiple vibration frequencies in genetically identified inhibitory cells in the S1 has not been examined. Using two-photon calcium imaging, we examined the responses to vibration stimuli of excitatory and inhibitory neurons in the S1 hind limb area of male and female mice. The excitatory cells showed relatively sharp selectivity to vibration stimuli, whereas the inhibitory cells exhibited less selectivity. The excitatory and inhibitory cells with different preferred stimuli were intermingled in a “salt and pepper” manner. Furthermore, the noise correlation tended to be especially strong in excitatory-inhibitory and inhibitory-inhibitory cell pairs that have similar stimulus selectivity. These results suggest that excitatory cells tend to represent specific stimulus information and work together with similarly tuned inhibitory cells as a functionally connected network.

Characterization of the suppressive effects of extremely-low-frequency electric fields on a stress-induced increase in the plasma glucocorticoid level in mice

We recently suggested that an increase in the plasma glucocorticoid (GC) level in immobilized mice is suppressed by a 50-Hz electric field (EF) in an EF strength-dependent manner. The present study aimed to assess the anti-stress effect of EFs in three scenarios: exposure to an EF of either 50 or 60 Hz, which are the standard power frequencies in most regions; varying levels of environmental brightness during EF exposure; complete or partial shielding of the mouse from the EF. We compared the GC levels and blood parameters among control, EF-alone, immobilization-alone, and co-treatment groups. There was no difference between EFs of 50 and 60 Hz in terms of the suppression of the immobilization-induced increase in GC, that is, the anti-stress effect upon EF exposure. Examination of the effects of three environmental illuminance levels, 0, 200, and 490 lux, revealed that the effect of the EF was influenced by environmental illuminance. Shielding of the mice from the EF by wrapping the animals with an electrically conductive sheet inhibited the EF effect, which showed a negative correlation with the area shielded. Hence, environmental illuminance and the body area exposed to the EF might influence the effects of an EF on stress-induced increases in plasma GC levels in mice. Because stress plays an important role in the onset and progression of various diseases, these findings may have broad implications for understanding the efficacy of EFs in health. Bioelectromagnetics. 39:516-528, 2018 © 2018 Wiley Periodicals, Inc.

Focal optogenetic suppression in macaque area MT biases direction discrimination and decision confidence, but only transiently

Insights from causal manipulations of brain activity depend on targeting the spatial and temporal scales most relevant for behavior. Using a sensitive perceptual decision task in monkeys, we examined the effects of rapid, reversible inactivation on a spatial scale previously achieved only with electrical microstimulation. Inactivating groups of similarly tuned neurons in area MT produced systematic effects on choice and confidence. Behavioral effects were attenuated over the course of each session, suggesting compensatory adjustments in the downstream readout of MT over tens of minutes. Compensation also occurred on a sub-second time scale: behavior was largely unaffected when the visual stimulus (and concurrent suppression) lasted longer than 350 ms. These trends were similar for choice and confidence, consistent with the idea of a common mechanism underlying both measures. The findings demonstrate the utility of hyperpolarizing opsins for linking neural population activity at fine spatial and temporal scales to cognitive functions in primates.

Engineering Artificial Somatosensation Through Cortical Stimulation in Humans

Sensory feedback is a critical aspect of motor control rehabilitation following paralysis or amputation. Current human studies have demonstrated the ability to deliver some of this sensory information via brain-machine interfaces, although further testing is needed to understand the stimulation parameters effect on sensation. Here, we report a systematic evaluation of somatosensory restoration in humans, using cortical stimulation with subdural mini-electrocorticography (mini-ECoG) grids. Nine epilepsy patients undergoing implantation of cortical electrodes for seizure localization were also implanted with a subdural 64-channel mini-ECoG grid over the hand area of the primary somatosensory cortex (S1). We mapped the somatotopic location and size of receptive fields evoked by stimulation of individual channels of the mini-ECoG grid. We determined the effects on perception by varying stimulus parameters of pulse width, current amplitude, and frequency. Finally, a target localization task was used to demonstrate the use of artificial sensation in a behavioral task. We found a replicable somatotopic representation of the hand on the mini-ECoG grid across most subjects during electrical stimulation. The stimulus-evoked sensations were usually of artificial quality, but in some cases were more natural and of a cutaneous or proprioceptive nature. Increases in pulse width, current strength and frequency generally produced similar quality sensations at the same somatotopic location, but with a perception of increased intensity. The subjects produced near perfect performance when using the evoked sensory information in target acquisition tasks. These findings indicate that electrical stimulation of somatosensory cortex through mini-ECoG grids has considerable potential for restoring useful sensation to patients with paralysis and amputation.

Assessing the quality of supplementary sensory feedback using the crossmodal congruency task

Advanced neural interfaces show promise in making prosthetic limbs more biomimetic and ultimately more intuitive and useful for patients. However, approaches to assess these emerging technologies are limited in scope and the insight they provide. When outfitting a prosthesis with a feedback system, such as a peripheral nerve interface, it would be helpful to quantify its physiological correspondence, i.e. how well the prosthesis feedback mimics the perceived feedback in an intact limb. Here we present an approach to quantify this aspect of feedback quality using the crossmodal congruency effect (CCE) task. We show that CCE scores are sensitive to feedback modality, an important characteristic for assessment purposes, but are confounded by the spatial separation between the expected and perceived location of a stimulus. Using data collected from 60 able-bodied participants trained to control a bypass prosthesis, we present a model that results in adjusted-CCE scores that are unaffected by percept misalignment which may result from imprecise neural stimulation. The adjusted-CCE score serves as a proxy for a feedback modality's physiological correspondence or 'naturalness'. This quantification approach gives researchers a tool to assess an aspect of emerging augmented feedback systems that is not measurable with current motor assessments.

Proprioceptive and cutaneous sensations in humans elicited by intracortical microstimulation

Pioneering work with nonhuman primates and recent human studies established intracortical microstimulation (ICMS) in primary somatosensory cortex (S1) as a method of inducing discriminable artificial sensation. However, these artificial sensations do not yet provide the breadth of cutaneous and proprioceptive percepts available through natural stimulation. In a tetraplegic human with two microelectrode arrays implanted in S1, we report replicable elicitations of sensations in both the cutaneous and proprioceptive modalities localized to the contralateral arm, dependent on both amplitude and frequency of stimulation. Furthermore, we found a subset of electrodes that exhibited multimodal properties, and that proprioceptive percepts on these electrodes were associated with higher amplitudes, irrespective of the frequency. These novel results demonstrate the ability to provide naturalistic percepts through ICMS that can more closely mimic the body’s natural physiological capabilities. Furthermore, delivering both cutaneous and proprioceptive sensations through artificial somatosensory feedback could improve performance and embodiment in brain-machine interfaces.

Nerves throughout the body send information about touch, temperature, body position and pain through the spinal cord to the brain. A part of the brain called the somatosensory cortex processes this information. Spinal cord injuries disrupt these messages. Even though the somatosensory cortex has not been damaged, sensation is lost for the affected body areas. No treatment exists to repair the spinal cord so the loss of sensation is permanent.

Applying electricity to the somatosensory cortex can produce artificial sensations. Scientists are testing this approach to restore a sense of touch for people with spinal cord injury. Early experiments show that using different patterns of electrical stimulation generates unnatural sensations in different body parts. People receiving the stimulation describe it as tingling or shocks. Scientists wonder if they can improve the technique to mimic feelings like touch or body position to make it easier for people with a spinal injury to move or use prostheses.

Now, Armenta Salas et al. generated more natural sensations in a person with a spinal cord injury. Instead of taking the usual approach of delivering large currents to the surface of cortex, they inserted small electrodes into the inside of the cortex to stimulate it with small currents. In the experiments, electrodes were implanted in the somatosensory cortex of a volunteer who had lost the use of his limbs and torso because of a spinal injury. Armenta Salas et al. applied different patterns of electrical stimuli and the volunteer reported what they felt like. The patient described sensations like a pinch or squeeze in the forearm or upper arm with certain patterns. In some cases, the patient reported the sensation of the arm moving with stronger electrical currents.

The experiments show that electrical stimulation of the brain can recreate some natural sensations. These sensations could help patients using robotic or prosthetic arms become more dexterous. It might also help patients view artificial limbs as part of their bodies, which could improve their sense of wellbeing.

ERAASR: an algorithm for removing electrical stimulation artifacts from multielectrode array recordings

OBJECTIVE

Electrical stimulation is a widely used and effective tool in systems neuroscience, neural prosthetics, and clinical neurostimulation. However, electrical artifacts evoked by stimulation prevent the detection of spiking activity on nearby recording electrodes, which obscures the neural population response evoked by stimulation. We sought to develop a method to clean artifact-corrupted electrode signals recorded on multielectrode arrays in order to recover the underlying neural spiking activity.

APPROACH

We created an algorithm, which performs estimation and removal of array artifacts via sequential principal components regression (ERAASR). This approach leverages the similar structure of artifact transients, but not spiking activity, across simultaneously recorded channels on the array, across pulses within a train, and across trials. The ERAASR algorithm requires no special hardware, imposes no requirements on the shape of the artifact or the multielectrode array geometry, and comprises sequential application of straightforward linear methods with intuitive parameters. The approach should be readily applicable to most datasets where stimulation does not saturate the recording amplifier.

MAIN RESULTS

The effectiveness of the algorithm is demonstrated in macaque dorsal premotor cortex using acute linear multielectrode array recordings and single electrode stimulation. Large electrical artifacts appeared on all channels during stimulation. After application of ERAASR, the cleaned signals were quiescent on channels with no spontaneous spiking activity, whereas spontaneously active channels exhibited evoked spikes which closely resembled spontaneously occurring spiking waveforms.

SIGNIFICANCE

We hope that enabling simultaneous electrical stimulation and multielectrode array recording will help elucidate the causal links between neural activity and cognition and facilitate naturalistic sensory protheses.

Intrinsic optical imaging study on cortical responses to electrical stimulation in ventral posterior medial nucleus of thalamus

Intracortical electrical micro-stimulation has been applied widely for the attempts on reconstruction of sensory functions. More recently, thalamic electrical stimulation has been proposed as a promising target for somatosensory stimulation. However, the cortical activations and mechanisms evoked by VPM stimulation remained unclear. In this report, the cortical neural responses to electrical stimulations were recorded by optical imaging of intrinsic signals. The impact of stimulation parameters was characterized to illustrate how the VPM stimulation alter cortical activities. Significant increases were found in cortical responses with increased stimulation amplitude or pulse width. However, frequency modulation exhibited significant inhibition with higher frequency stimulation. Our results suggest that optical imaging of intrinsic signals is sensitive and reliable to deep brain stimulations. These results may not only help to understand the modulation effects through thalamocortical pathway, but also show the possibility to use VPM stimulation to evoke frequency-tuned tactile sensations in rats.

Single-Cell Stimulation in Barrel Cortex Influences Psychophysical Detection Performance

A single whisker stimulus elicits action potentials in a sparse subset of neurons in somatosensory cortex. The precise contribution of these neurons to the animal's perception of a whisker stimulus is unknown. Here we show that single-cell stimulation in rat barrel cortex of both sexes influences the psychophysical detection of a near-threshold whisker stimulus in a cell type-dependent manner, without affecting false alarm rate. Counterintuitively, stimulation of single fast-spiking putative inhibitory neurons increased detection performance. Single-cell stimulation of putative excitatory neurons failed to change detection performance, except for a small subset of deep-layer neurons that were highly sensitive to whisker stimulation and that had an unexpectedly strong impact on detection performance. These findings indicate that the perceptual impact of excitatory barrel cortical neurons relates to their firing response to whisker stimulation and that strong activity in a single highly sensitive neuron in barrel cortex can already enhance sensory detection. Our data suggest that sensory detection is based on a decoding mechanism that lends a disproportionally large weight to interneurons and to deep-layer neurons showing a strong response to sensory stimulation.SIGNIFICANCE STATEMENT Rat whisker somatosensory cortex contains a variety of neuronal cell types with distinct anatomical and physiological characteristics. How each of these different cell types contribute to the animal's perception of whisker stimuli is unknown. We explored this question by using a powerful electrophysiological stimulation technique that allowed us to target and stimulate single neurons with different sensory response types in whisker cortex. In awake, behaving animals, trained to detect whisker stimulation, only costimulation of single fast-spiking inhibitory neurons or single deep-layer excitatory neurons with strong responses to whisker stimulation enhanced detection performance. Our data demonstrate that single cortical neurons can have measurable impact on the detection of sensory stimuli and suggest a decoding mechanism based on select cell types.

Somatosensory maps

Somatosensory areas containing topographic maps of the body surface are a major feature of parietal cortex. In primates, parietal cortex contains four somatosensory areas, each with its own map, with the primary cutaneous map in area 3b. Rodents have at least three parietal somatosensory areas. Maps are not isomorphic to the body surface, but magnify behaviorally important skin regions, which include the hands and face in primates, and the whiskers in rodents. Within each map, intracortical circuits process tactile information, mediate spatial integration, and support active sensation. Maps may also contain fine-scale representations of touch submodalities, or direction of tactile motion. Functional representations are more overlapping than suggested by textbook depictions of map topography. The whisker map in rodent somatosensory cortex is a canonic system for studying cortical microcircuits, sensory coding, and map plasticity. Somatosensory maps are plastic throughout life in response to altered use or injury. This chapter reviews basic principles and recent findings in primate, human, and rodent somatosensory maps.

Rapid Integration of Artificial Sensory Feedback during Operant Conditioning of Motor Cortex Neurons

Neuronal motor commands, whether generating real or neuroprosthetic movements, are shaped by ongoing sensory feedback from the displacement being produced. Here we asked if cortical stimulation could provide artificial feedback during operant conditioning of cortical neurons. Simultaneous two-photon imaging and real-time optogenetic stimulation were used to train mice to activate a single neuron in motor cortex (M1), while continuous feedback of its activity level was provided by proportionally stimulating somatosensory cortex. This artificial signal was necessary to rapidly learn to increase the conditioned activity, detect correct performance, and maintain the learned behavior. Population imaging in M1 revealed that learning-related activity changes are observed in the conditioned cell only, which highlights the functional potential of individual neurons in the neocortex. Our findings demonstrate the capacity of animals to use an artificially induced cortical channel in a behaviorally relevant way and reveal the remarkable speed and specificity at which this can occur.

•

All-optical brain-machine-brain interface for neuroprosthetic control

•

Mice rapidly learn to activate single neurons under optogenetically evoked feedback

•

Population imaging reveals that learning is restricted to the conditioned neuron

•

Novel “in cerebro” learning paradigm for neural circuit dissection