Perceived timing of cutaneous vibration and intracortical microstimulation of human somatosensory cortex

Sensory integration for neuroprostheses: from functional benefits to neural correlates

In the field of sensory neuroprostheses, one ultimate goal is for individuals to perceive artificial somatosensory information and use the prosthesis with high complexity that resembles an intact system. To this end, research has shown that stimulation-elicited somatosensory information improves prosthesis perception and task performance. While studies strive to achieve sensory integration, a crucial phenomenon that entails naturalistic interaction with the environment, this topic has not been commensurately reviewed. Therefore, here we present a perspective for understanding sensory integration in neuroprostheses. First, we review the engineering aspects and functional outcomes in sensory neuroprosthesis studies. In this context, we summarize studies that have suggested sensory integration. We focus on how they have used stimulation-elicited percepts to maximize and improve the reliability of somatosensory information. Next, we review studies that have suggested multisensory integration. These works have demonstrated that congruent and simultaneous multisensory inputs provided cognitive benefits such that an individual experiences a greater sense of authority over prosthesis movements (i.e., agency) and perceives the prosthesis as part of their own (i.e., ownership). Thereafter, we present the theoretical and neuroscience framework of sensory integration. We investigate how behavioral models and neural recordings have been applied in the context of sensory integration. Sensory integration models developed from intact-limb individuals have led the way to sensory neuroprosthesis studies to demonstrate multisensory integration. Neural recordings have been used to show how multisensory inputs are processed across cortical areas. Lastly, we discuss some ongoing research and challenges in achieving and understanding sensory integration in sensory neuroprostheses. Resolving these challenges would help to develop future strategies to improve the sensory feedback of a neuroprosthetic system.

Visual context affects the perceived timing of tactile sensations elicited through intra-cortical microstimulation

Intra-cortical microstimulation (ICMS) is a technique to provide tactile sensations for a somatosensory brain-machine interface (BMI). A viable BMI must function within the rich, multisensory environment of the real world, but how ICMS is integrated with other sensory modalities is poorly understood. To investigate how ICMS percepts are integrated with visual information, ICMS and visual stimuli were delivered at varying times relative to one another. Both visual context and ICMS current amplitude were found to bias the qualitative experience of ICMS. In two tetraplegic participants, ICMS and visual stimuli were more likely to be experienced as occurring simultaneously when visual stimuli were more realistic, demonstrating an effect of visual context on the temporal binding window. The peak of the temporal binding window varied but was consistently offset from zero, suggesting that multisensory integration with ICMS can suffer from temporal misalignment. Recordings from primary somatosensory cortex (S1) during catch trials where visual stimuli were delivered without ICMS demonstrated that S1 represents visual information related to ICMS across visual contexts.

Cortical activations associated with spatial remapping of finger touch using EEG

The spatial coding of tactile information is functionally essential for touch-based shape perception and motor control. However, the spatiotemporal dynamics of how tactile information is remapped from the somatotopic reference frame in the primary somatosensory cortex to the spatiotopic reference frame remains unclear. This study investigated how hand position in space or posture influences cortical somatosensory processing. Twenty-two healthy subjects received electrical stimulation to the right thumb (D1) or little finger (D5) in three position conditions: palm down on right side of the body (baseline), hand crossing the body midline (effect of position), and palm up (effect of posture). Somatosensory-evoked potentials (SEPs) were recorded using electroencephalography. One early-, two mid-, and two late-latency neurophysiological components were identified for both fingers: P50, P1, N125, P200, and N250. D1 and D5 showed different cortical activation patterns: compared with baseline, the crossing condition showed significant clustering at P1 for D1, and at P50 and N125 for D5; the change in posture showed a significant cluster at N125 for D5. Clusters predominated at centro-parietal electrodes. These results suggest that tactile remapping of fingers after electrical stimulation occurs around 100-125 ms in the parietal cortex.

Behavioral paradigm for the evaluation of stimulation-evoked somatosensory perception thresholds in rats

Intracortical microstimulation (ICMS) of the somatosensory cortex via penetrating microelectrode arrays (MEAs) can evoke cutaneous and proprioceptive sensations for restoration of perception in individuals with spinal cord injuries. However, ICMS current amplitudes needed to evoke these sensory percepts tend to change over time following implantation. Animal models have been used to investigate the mechanisms by which these changes occur and aid in the development of new engineering strategies to mitigate such changes. Non-human primates are commonly the animal of choice for investigating ICMS, but ethical concerns exist regarding their use. Rodents are a preferred animal model due to their availability, affordability, and ease of handling, but there are limited choices of behavioral tasks for investigating ICMS. In this study, we investigated the application of an innovative behavioral go/no-go paradigm capable of estimating ICMS-evoked sensory perception thresholds in freely moving rats. We divided animals into two groups, one receiving ICMS and a control group receiving auditory tones. Then, we trained the animals to nose-poke - a well-established behavioral task for rats - following either a suprathreshold ICMS current-controlled pulse train or frequency-controlled auditory tone. Animals received a sugar pellet reward when nose-poking correctly. When nose-poking incorrectly, animals received a mild air puff. After animals became proficient in this task, as defined by accuracy, precision, and other performance metrics, they continued to the next phase for perception threshold detection, where we varied the ICMS amplitude using a modified staircase method. Finally, we used non-linear regression to estimate perception thresholds. Results indicated that our behavioral protocol could estimate ICMS perception thresholds based on ~95% accuracy of rat nose-poke responses to the conditioned stimulus. This behavioral paradigm provides a robust methodology for evaluating stimulation-evoked somatosensory percepts in rats comparable to the evaluation of auditory percepts. In future studies, this validated methodology can be used to study the performance of novel MEA device technologies on ICMS-evoked perception threshold stability using freely moving rats or to investigate information processing principles in neural circuits related to sensory perception discrimination.

Behavioral Paradigm for the Evaluation of Stimulation-Evoked Somatosensory Perception Thresholds in Rats

Intracortical microstimulation (ICMS) of the somatosensory cortex via penetrating microelectrode arrays (MEAs) can evoke cutaneous and proprioceptive sensations for restoration of perception in individuals with spinal cord injuries. However, ICMS current amplitudes needed to evoke these sensory percepts tend to change over time following implantation. Animal models have been used to investigate the mechanisms by which these changes occur and aid in the development of new engineering strategies to mitigate such changes. Non-human primates are commonly the animal of choice for investigating ICMS, but ethical concerns exist regarding their use. Rodents are a preferred animal model due to their availability, affordability, and ease of handling, but there are limited choices of behavioral tasks for investigating ICMS. In this study, we investigated the application of an innovative behavioral go/no-go paradigm capable of estimating ICMS-evoked sensory perception thresholds in freely moving rats. We divided animals into two groups, one receiving ICMS and a control group receiving auditory tones. Then, we trained the animals to nose-poke - a well-established behavioral task for rats - following either a suprathreshold ICMS current-controlled pulse train or frequency-controlled auditory tone. Animals received a sugar pellet reward when nose-poking correctly. When nose-poking incorrectly, animals received a mild air puff. After animals became proficient in this task, as defined by accuracy, precision, and other performance metrics, they continued to the next phase for perception threshold detection, where we varied the ICMS amplitude using a modified staircase method. Finally, we used non-linear regression to estimate perception thresholds. Results indicated that our behavioral protocol could estimate ICMS perception thresholds based on ∼95% accuracy of rat nose-poke responses to the conditioned stimulus. This behavioral paradigm provides a robust methodology for evaluating stimulation-evoked somatosensory percepts in rats comparable to the evaluation of auditory percepts. In future studies, this validated methodology can be used to study the performance of novel MEA device technologies on ICMS-evoked perception threshold stability using freely moving rats or to investigate information processing principles in neural circuits related to sensory perception discrimination.

Dynamic amplitude modulation of microstimulation evokes biomimetic onset and offset transients and reduces depression of evoked calcium responses in sensory cortices

BACKGROUND

Intracortical microstimulation (ICMS) is an emerging approach to restore sensation to people with neurological injury or disease. Biomimetic microstimulation, or stimulus trains that mimic neural activity in the brain through encoding of onset and offset transients, could improve the utility of ICMS for brain-computer interface (BCI) applications, but how biomimetic microstimulation affects neural activation is not understood. Current "biomimetic" ICMS trains aim to reproduce the strong onset and offset transients evoked in the brain by sensory input through dynamic modulation of stimulus parameters. Stimulus induced depression of neural activity (decreases in evoked intensity over time) is also a potential barrier to clinical implementation of sensory feedback, and dynamic microstimulation may reduce this effect.

OBJECTIVE

We evaluated how bio-inspired ICMS trains with dynamic modulation of amplitude and/or frequency change the calcium response, spatial distribution, and depression of neurons in the somatosensory and visual cortices.

METHODS

Calcium responses of neurons were measured in Layer 2/3 of visual and somatosensory cortices of anesthetized GCaMP6s mice in response to ICMS trains with fixed amplitude and frequency (Fixed) and three dynamic ICMS trains that increased the stimulation intensity during the onset and offset of stimulation by modulating the amplitude (DynAmp), frequency (DynFreq), or amplitude and frequency (DynBoth). ICMS was provided for either 1-s with 4-s breaks (Short) or for 30-s with 15-s breaks (Long).

RESULTS

DynAmp and DynBoth trains evoked distinct onset and offset transients in recruited neural populations, while DynFreq trains evoked population activity similar to Fixed trains. Individual neurons had heterogeneous responses primarily based on how quickly they depressed to ICMS, where neurons farther from the electrode depressed faster and a small subpopulation (1-5%) were modulated by DynFreq trains. Neurons that depressed to Short trains were also more likely to depress to Long trains, but Long trains induced more depression overall due to the increased stimulation length. Increasing the amplitude during the hold phase resulted in an increase in recruitment and intensity which resulted in more depression and reduced offset responses. Dynamic amplitude modulation reduced stimulation induced depression by 14.6 ± 0.3% for Short and 36.1 ± 0.6% for Long trains. Ideal observers were 0.031 ± 0.009 s faster for onset detection and 1.33 ± 0.21 s faster for offset detection with dynamic amplitude encoding.

CONCLUSIONS

Dynamic amplitude modulation evokes distinct onset and offset transients, reduces depression of neural calcium activity, and decreases total charge injection for sensory feedback in BCIs by lowering recruitment of neurons during long maintained periods of ICMS. In contrast, dynamic frequency modulation evokes distinct onset and offset transients in a small subpopulation of neurons but also reduces depression in recruited neurons by reducing the rate of activation.

Revisiting the color-motion asynchrony

Color-motion asynchrony (CMA) refers to an illusion in which we perceive a change in color earlier than a change in motion direction when the two changes occur simultaneously. This phenomenon may indicate that color is processed earlier than motion in the visual system. However, the very existence of CMA is under question owing to contradictory findings and methodological deficits in previous studies. Here, we used both the motion and color correspondence tasks (experiment 1) and the temporal order judgment (TOJ) task (experiment 2) to re-examine CMA. Colored dots moved in one direction and changed their color/direction at some time, whereas the relative timing between color and direction changes varied across trials. In the correspondence task, participants reported which direction/color of dots with a particular color/direction lasted longer, the one before or after the change? In the TOJ task, participants reported whether the change in color or the change in motion direction occurred earlier. Results indicated that participants perceived the change in color earlier than the change in motion direction in either the motion or color correspondence task, with a stronger asynchrony in the former. In the TOJ task, although participants showed no difference in psychophysical measures, they responded faster when the change in color occurred before (versus after) the change in direction. Drift-diffusion modeling (DDM) revealed a lower decision threshold when the change in color occurred before (versus after) the change in direction, indicating less cautiousness was excised in judgment when the color changed earlier. These results confirmed the veracity of CMA in different tasks and point to the viability of analyzing response times in traditional psychophysical studies.

Clinical neuroscience and neurotechnology: An amazing symbiosis

In the last decades, clinical neuroscience found a novel ally in neurotechnologies, devices able to record and stimulate electrical activity in the nervous system. These technologies improved the ability to diagnose and treat neural disorders. Neurotechnologies are concurrently enabling a deeper understanding of healthy and pathological dynamics of the nervous system through stimulation and recordings during brain implants. On the other hand, clinical neurosciences are not only driving neuroengineering toward the most relevant clinical issues, but are also shaping the neurotechnologies thanks to clinical advancements. For instance, understanding the etiology of a disease informs the location of a therapeutic stimulation, but also the way stimulation patterns should be designed to be more effective/naturalistic. Here, we describe cases of fruitful integration such as Deep Brain Stimulation and cortical interfaces to highlight how this symbiosis between clinical neuroscience and neurotechnology is closer to a novel integrated framework than to a simple interdisciplinary interaction.