Behavioral Time Course of Microstimulation in Cortical Area MT

Micropools of reliable area MT neurons explain rapid motion detection

Many models of perceptually based decisions postulate that actions are initiated when accumulated sensory signals reach a threshold level of activity. These models have received considerable neurophysiological support from recordings of individual neurons while animals are engaged in motion discrimination tasks. These experiments have found that the activity of neurons in a particular visual area strongly associated with motion processing (MT), when pooled over hundreds of milliseconds, is sufficient to explain behavioral timing and performance. However, this level of pooling may be problematic for urgent perceptual decisions in which rapid detection dictates temporally precise integration. In this paper, we explore the physiological basis of one such task in which macaques detected brief (~70 ms) transients of coherent motion within ~240 ms. We find that a simple linear summation model based on realistic stimulus responses of as few as 40 correlated neurons can predict the reliability and timing of rapid motion detection. The model naturally reproduces a distinctive physiological relationship observed in rapid detection tasks in which the individual neurons with the most reliable stimulus responses are also the most predictive of impending behavioral choices. Remarkably, we observed this relationship across our simulated neuronal populations even when all neurons within the pool were weighted equally with respect to readout. These results demonstrate that small numbers of reliable sensory neurons can dominate perceptual judgments without any explicit reliability based weighting and are sufficient to explain the accuracy, latency, and temporal precision of rapid detection. NEW & NOTEWORTHY Computational and psychophysical models suggest that performance in many perceptual tasks may be based on the preferential sampling of reliable neurons. Recent studies of MT neurons during rapid motion detection, in which only those neurons with the most reliable sensory responses were strongly predictive of the animals' decisions, seemingly support this notion. Here we show that a simple threshold model without explicit reliability biases can explain both the behavioral accuracy and precision of these detections and the distribution of sensory- and choice-related signals across neurons.

ERAASR: an algorithm for removing electrical stimulation artifacts from multielectrode array recordings

OBJECTIVE

Electrical stimulation is a widely used and effective tool in systems neuroscience, neural prosthetics, and clinical neurostimulation. However, electrical artifacts evoked by stimulation prevent the detection of spiking activity on nearby recording electrodes, which obscures the neural population response evoked by stimulation. We sought to develop a method to clean artifact-corrupted electrode signals recorded on multielectrode arrays in order to recover the underlying neural spiking activity.

APPROACH

We created an algorithm, which performs estimation and removal of array artifacts via sequential principal components regression (ERAASR). This approach leverages the similar structure of artifact transients, but not spiking activity, across simultaneously recorded channels on the array, across pulses within a train, and across trials. The ERAASR algorithm requires no special hardware, imposes no requirements on the shape of the artifact or the multielectrode array geometry, and comprises sequential application of straightforward linear methods with intuitive parameters. The approach should be readily applicable to most datasets where stimulation does not saturate the recording amplifier.

MAIN RESULTS

The effectiveness of the algorithm is demonstrated in macaque dorsal premotor cortex using acute linear multielectrode array recordings and single electrode stimulation. Large electrical artifacts appeared on all channels during stimulation. After application of ERAASR, the cleaned signals were quiescent on channels with no spontaneous spiking activity, whereas spontaneously active channels exhibited evoked spikes which closely resembled spontaneously occurring spiking waveforms.

SIGNIFICANCE

We hope that enabling simultaneous electrical stimulation and multielectrode array recording will help elucidate the causal links between neural activity and cognition and facilitate naturalistic sensory protheses.

Key considerations in designing a somatosensory neuroprosthesis

In recent years, a consensus has emerged that somatosensory feedback needs to be provided for upper limb neuroprostheses to be useful. An increasingly promising approach to sensory restoration is to electrically stimulate neurons along the somatosensory neuraxis to convey information about the state of the prosthetic limb and about contact with objects. To date, efforts toward artificial sensory feedback have consisted mainly of demonstrating that some sensory information could be conveyed using a small number of stimulation patterns, generally delivered through single electrodes. However impressive these achievements are, results from different studies are hard to compare, as each research team implements different stimulation patterns and tests the elicited sensations differently. A critical question is whether different stimulation strategies will generalize from contrived laboratory settings to activities of daily living. Here, we lay out some key specifications that an artificial somatosensory channel should meet, discuss how different approaches should be evaluated, and caution about looming challenges that the field of sensory restoration will face.

Electrical and Optical Activation of Mesoscale Neural Circuits with Implications for Coding

Artificial activation of neural circuitry through electrical microstimulation and optogenetic techniques is important for both scientific discovery of circuit function and for engineered approaches to alleviate various disorders of the nervous system. However, evidence suggests that neural activity generated by artificial stimuli differs dramatically from normal circuit function, in terms of both the local neuronal population activity at the site of activation and the propagation to downstream brain structures. The precise nature of these differences and the implications for information processing remain unknown. Here, we used voltage-sensitive dye imaging of primary somatosensory cortex in the anesthetized rat in response to deflections of the facial vibrissae and electrical or optogenetic stimulation of thalamic neurons that project directly to the somatosensory cortex. Although the different inputs produced responses that were similar in terms of the average cortical activation, the variability of the cortical response was strikingly different for artificial versus sensory inputs. Furthermore, electrical microstimulation resulted in highly unnatural spatial activation of cortex, whereas optical input resulted in spatial cortical activation that was similar to that induced by sensory inputs. A thalamocortical network model suggested that observed differences could be explained by differences in the way in which artificial and natural inputs modulate the magnitude and synchrony of population activity. Finally, the variability structure in the response for each case strongly influenced the optimal inputs for driving the pathway from the perspective of an ideal observer of cortical activation when considered in the context of information transmission.

SIGNIFICANCE STATEMENT

Artificial activation of neural circuitry through electrical microstimulation and optogenetic techniques is important for both scientific discovery and clinical translation. However, neural activity generated by these artificial means differs dramatically from normal circuit function, both locally and in the propagation to downstream brain structures. The precise nature of these differences and the implications for information processing remain unknown. The significance of this work is in quantifying the differences, elucidating likely mechanisms underlying the differences, and determining the implications for information processing.

Modifying cognition and behavior with electrical microstimulation: implications for cognitive prostheses

A fundamental goal of cognitive neuroscience is to understand how brain activity generates complex mental states and behaviors. While neuronal activity may predict or correlate with behavioral responses in a cognitive task, the use of electrical microstimulation presents the possibility to augment such correlational findings with direct evidence for causal relationships. Although microstimulation has been used for many years as a tool for mapping sensory and motor function, its role in learning, memory and decision-making has emerged only recently. Focal microstimulation of higher cortical areas can produce complex mental states and sequences of action. However, the relationship between the locus of stimulation and the percepts or actions evoked is often stereotyped and inflexible. The challenge is to develop stimulation systems that do not have fixed output but can flexibly contribute to complex cognitive and behavioral tasks. We discuss how microstimulation has been instrumental in manipulating a wide spectrum of cognitive functions including working memory, perceptual decisions and executive control by enhancing attention, re-ordering temporal sequence of saccades, improving associative learning or cognitive performance. For example, stimulation in prefrontal, parietal and sensory cortices may establish causal effects on decision-making, while microstimulation of inferotemporal cortex or caudate nucleus enhances associative learning. Building cognitive prosthetics based on the insights gleaned from such studies may depend on the development of multiple-input, multiple-output (MIMO) devices that allow subjects to control stimulation with their own thoughts in a closed-loop system.

System identification of the nonlinear dynamics in the thalamocortical circuit in response to patterned thalamic microstimulation in vivo

OBJECTIVE

Nonlinear system identification approaches were used to develop a dynamical model of the network level response to patterns of microstimulation in vivo.

APPROACH

The thalamocortical circuit of the rodent vibrissa pathway was the model system, with voltage sensitive dye imaging capturing the cortical response to patterns of stimulation delivered from a single electrode in the ventral posteromedial thalamus. The results of simple paired stimulus experiments formed the basis for the development of a phenomenological model explicitly containing nonlinear elements observed experimentally. The phenomenological model was fit using datasets obtained with impulse train inputs, Poisson-distributed in time and uniformly varying in amplitude.

MAIN RESULTS

The phenomenological model explained 58% of the variance in the cortical response to out of sample patterns of thalamic microstimulation. Furthermore, while fit on trial-averaged data, the phenomenological model reproduced single trial response properties when simulated with noise added into the system during stimulus presentation. The simulations indicate that the single trial response properties were dependent on the relative sensitivity of the static nonlinearities in the two stages of the model, and ultimately suggest that electrical stimulation activates local circuitry through linear recruitment, but that this activity propagates in a highly nonlinear fashion to downstream targets.

SIGNIFICANCE

The development of nonlinear dynamical models of neural circuitry will guide information delivery for sensory prosthesis applications, and more generally reveal properties of population coding within neural circuits.

Insights into cortical mechanisms of behavior from microstimulation experiments

Even the simplest behaviors depend on a large number of neurons that are distributed across many brain regions. Because electrical microstimulation can change the activity of localized subsets of neurons, it has provided valuable evidence that specific neurons contribute to particular behaviors. Here we review what has been learned about cortical function from behavioral studies using microstimulation in animals and humans. Experiments that examine how microstimulation affects the perception of stimuli have shown that the effects of microstimulation are usually highly specific and can be related to the stimuli preferred by neurons at the stimulated site. Experiments that ask subjects to detect cortical microstimulation in the absence of other stimuli have provided further insights. Although subjects typically can detect microstimulation of primary sensory or motor cortex, they are generally unable to detect stimulation of most of cortex without extensive practice. With practice, however, stimulation of any part of cortex can become detected. These training effects suggest that some patterns of cortical activity cannot be readily accessed to guide behavior, but that the adult brain retains enough plasticity to learn to process novel patterns of neuronal activity arising anywhere in cortex.

The functional link between area MT neural fluctuations and detection of a brief motion stimulus

Fluctuations of neural firing rates in visual cortex are known to be correlated with variations in perceptual performance. It is important to know whether these fluctuations are functionally linked to perception in a causal manner or instead reflect non-causal processes that arise after the perceptual decision is made. We recorded from middle temporal (MT) neurons from monkey subjects while they detected the random occurrence of a brief 50 ms motion pulse that occurred in either of two (or simultaneously in both) random dot patches located in the same hemisphere. The receptive field parameters of the motion pulse were matched to that preferred by each MT neuron under study. This task contained uncertainty in both space and time because, on any given trial, the subjects did not know which patch would contain the motion pulse or when the motion pulse would occur. Covariations between MT activity and behavior began just before the motion pulse onset and peaked at the maximum neural response. These neural-behavioral covariations were strongest when only one patch contained the motion pulse and were still weakly present when a patch did not contain a motion pulse. A feedforward temporal integration model with two independent detector channels captured both the detection performance and evolution of the neural-behavior covariations over time and stimulus condition. The results suggest that, when detecting a brief visual stimulus, there is a causal relationship between fluctuations in neural activity and variations in behavior across trials.

Perceptual and neural consequences of rapid motion adaptation

Nervous systems adapt to the prevailing sensory environment, and the consequences of this adaptation can be observed in the responses of single neurons and in perception. Given the variety of timescales underlying events in the natural world, determining the temporal characteristics of adaptation is important to understanding how perception adjusts to its sensory environment. Previous work has shown that neural adaptation can occur on a timescale of milliseconds, but perceptual adaptation has generally been studied over relatively long timescales, typically on the order of seconds. This disparity raises important questions. Can perceptual adaptation be observed at brief, functionally relevant timescales? And if so, how do its properties relate to the rapid adaptation seen in cortical neurons? We address these questions in the context of visual motion processing, a perceptual modality characterized by rapid temporal dynamics. We demonstrate objectively that 25 ms of motion adaptation is sufficient to generate a motion aftereffect, an illusory sensation of movement experienced when a moving stimulus is replaced by a stationary pattern. This rapid adaptation occurs regardless of whether the adapting motion is perceived. In neurophysiological recordings from the middle temporal area of primate visual cortex, we find that brief motion adaptation evokes direction-selective responses to subsequently presented stationary stimuli. A simple model shows that these neural responses can explain the consequences of rapid perceptual adaptation. Overall, we show that the motion aftereffect is not merely an intriguing perceptual illusion, but rather a reflection of rapid neural and perceptual processes that can occur essentially every time we experience motion.

Neural correlates of subsecond time distortion in the middle temporal area of visual cortex

How does the brain represent the passage of time at the subsecond scale? Although different conceptual models for time perception have been proposed, its neurophysiological basis remains unknown. We took advantage of a visual duration illusion produced by stimulus novelty to link changes in cortical activity in monkeys with distortions of duration perception in humans. We found that human subjects perceived the duration of a subsecond motion pulse with a novel direction longer than a motion pulse with a repeated direction. Recording from monkeys viewing identical motion stimuli but performing a different behavioral task, we found that both the duration and amplitude of the neural response in the middle temporal area of visual cortex were positively correlated with the degree of novelty of the motion direction. In contrast to previous accounts that attribute distortions in duration perception to changes in the speed of a putative internal clock, our results suggest that the known adaptive properties of neural activity in visual cortex contributes to subsecond temporal distortions.