Stimulus-dependent differences in cortical versus subcortical contributions to visual detection in mice

The primary visual cortex (V1) and the superior colliculus (SC) both occupy stations early in the processing of visual information. They have long been thought to perform distinct functions, with the V1 supporting the perception of visual features and the SC regulating orienting to visual inputs. However, growing evidence suggests that the SC supports the perception of many of the same visual features traditionally associated with the V1. To distinguish V1 and SC contributions to visual processing, it is critical to determine whether both areas causally contribute to the detection of specific visual stimuli. Here, mice reported changes in visual contrast or luminance near their perceptual threshold while white noise patterns of optogenetic stimulation were delivered to V1 or SC inhibitory neurons. We then performed a reverse correlation analysis on the optogenetic stimuli to estimate a neuronal-behavioral kernel (NBK), a moment-to-moment estimate of the impact of V1 or SC inhibition on stimulus detection. We show that the earliest moments of stimulus-evoked activity in the SC are critical for the detection of both luminance and contrast changes. Strikingly, there was a robust stimulus-aligned modulation in the V1 contrast-detection NBK but no sign of a comparable modulation for luminance detection. The data suggest that behavioral detection of visual contrast depends on both V1 and SC spiking, whereas mice preferentially use SC activity to detect changes in luminance. Electrophysiological recordings showed that neurons in both the SC and V1 responded strongly to both visual stimulus types, while the reverse correlation analysis reveals when these neuronal signals actually contribute to visually guided behaviors.

Locus coeruleus norepinephrine contributes to visual-spatial attention by selectively enhancing perceptual sensitivity

Selectively focusing on a behaviorally relevant stimulus while ignoring irrelevant stimuli improves perception. Enhanced neuronal response gain is thought to support attention-related improvements in detection and discrimination. However, understanding of the neuronal pathways regulating perceptual sensitivity remains limited. Here, we report that responses of norepinephrine (NE) neurons in the locus coeruleus (LC) of non-human primates to behaviorally relevant sensory stimuli promote visual discrimination in a spatially selective way. LC-NE neurons spike in response to a visual stimulus appearing in the contralateral hemifield only when that stimulus is attended. This spiking is associated with enhanced behavioral sensitivity, is independent of motor control, and is absent on error trials. Furthermore, optogenetically activating LC-NE neurons selectively improves monkeys' contralateral stimulus detection without affecting motor criteria, supporting NE's causal role in granular cognitive control of selective attention at a cellular level, beyond its known diffuse and non-selective functions.

Normalization in mouse primary visual cortex

When multiple stimuli appear together in the receptive field of a visual cortical neuron, the response is typically close to the average of that neuron's response to each individual stimulus. The departure from a linear sum of each individual response is referred to as normalization. In mammals, normalization has been best characterized in the visual cortex of macaques and cats. Here we study visually evoked normalization in the visual cortex of awake mice using imaging of calcium indicators in large populations of layer 2/3 (L2/3) V1 excitatory neurons and electrophysiological recordings across layers in V1. Regardless of recording method, mouse visual cortical neurons exhibit normalization to varying degrees. The distributions of normalization strength are similar to those described in cats and macaques, albeit slightly weaker on average.

Rodent attention: Probing the mouse mind with reverse correlation

A novel approach to studying attention in mice reveals processes similar to those in humans and lays out an efficient way to explore its neuronal correlates in a genetically tractable animal model.

Temporal weighting of cortical and subcortical spikes reveals stimulus dependent differences in their contributions to behavior

The primary visual cortex (V1) and the superior colliculus (SC) both occupy stations early in the processing of visual information. They have long been thought to perform distinct functions, with V1 supporting perception of visual features and the SC regulating orienting to visual inputs. However, growing evidence suggests that the SC supports perception of many of the same visual features traditionally associated with V1. To distinguish V1 and SC contributions to visual processing, it is critical to determine whether both areas causally contribute to perception of specific visual stimuli. Here, mice reported changes in visual contrast or luminance near perceptual threshold while we presented white noise patterns of optogenetic stimulation to V1 or SC inhibitory neurons. We then performed a reverse correlation analysis on the optogenetic stimuli to estimate a neuronal-behavioral kernel (NBK), a moment-to-moment estimate of the impact of V1 or SC inhibition on stimulus detection. We show that the earliest moments of stimulus-evoked activity in SC are critical for detection of both luminance or contrast changes. Strikingly, there was a robust stimulus-aligned modulation in the V1 contrast-detection NBK, but no sign of a comparable modulation for luminance detection. The data suggest that perception of visual contrast depends on both V1 and SC spiking, whereas mice preferentially use SC activity to detect changes in luminance. Electrophysiological recordings showed that neurons in both SC and V1 responded strongly to both visual stimulus types, while the reverse correlation analysis reveals when these neuronal signals actually contribute to visually-guided behaviors.

Increments in visual motion coherence are more readily detected than decrements

Understanding the circuits that access and read out information in the cerebral cortex to guide behavior remains a challenge for systems-level neuroscience. Recent optogenetic experiments targeting specific cell classes in mouse primary visual cortex (V1) have shown that mice are sensitive to optically-induced increases in V1 spiking but are relatively insensitive to decreases in neuronal spiking of similar magnitude and time course. This asymmetry suggests that the readout of signals from cortex depends preferentially on increases in spike rate. We investigated whether humans display a similar asymmetry by measuring thresholds for detecting changes in the motion coherence of dynamic random dot stimuli. The middle temporal visual area (MT) has been shown to play an important role in discriminating random dot stimuli, and the responses of its individual neurons to dynamic random dots are well characterized. Although both increments and decrements in motion coherence have heterogeneous effects on MT responses, increments cause on average more increases in firing rates. Consistent with this, we found that subjects are more sensitive to increments of random dot motion coherence than to decrements of coherence. The magnitude of the difference in detectability was consistent with the expected difference in neuronal signal-to-noise associated with MT spike rate increases driven by coherence increments and decrements. The results add strength to the notion that the circuit mechanisms that read out cortical signals are relatively insensitive to decrements in cortical spiking.

Normalization in mouse primary visual cortex

When multiple stimuli appear together in the receptive field of a visual cortical neuron, the response is typically close to the average of that neuron's response to each individual stimulus. The departure from a linear sum of each individual response is referred to as normalization. In mammals, normalization has been best characterized in the visual cortex of macaques and cats. Here we study visually evoked normalization in the visual cortex of awake mice using optical imaging of calcium indicators in large populations of layer 2/3 (L2/3) V1 excitatory neurons and electrophysiological recordings across layers in V1. Regardless of recording method, mouse visual cortical neurons exhibit normalization to varying degrees. The distributions of normalization strength are similar to those described in cats and macaques, albeit slightly weaker on average.

Neuronal correlates of selective attention and effort in visual area V4 are invariant of motivational context

Task demands can differentially engage two fundamental attention components: selectivity (spatial bias) and effort (total nonselective attentional intensity). The relative contributions and interactions of these components in modulating neuronal signals remain unknown. We recorded V4 neurons while monkeys' spatially selective attention and effort were independently controlled by adjusting either task difficulty or reward size at two locations. Neurons were robustly modulated by either selective attention or effort. Notably, increasing overall effort to improve performance at a distant site reduced neuronal responses even when performance was unchanged for receptive field stimuli. This interaction between attentional selectivity and effort was evident in single-trial spiking and can be explained by divisive normalization of spatially distributed behavioral performance at the single-neuron level. Changing motivation using task difficulty or reward produced indistinguishable effects. These results provide a cellular-level mechanism of how attention components integrate to modulate sensory processing in different motivational contexts.

Perceptual Weighting of V1 Spikes Revealed by Optogenetic White Noise Stimulation

During visually guided behaviors, mere hundreds of milliseconds can elapse between a sensory input and its associated behavioral response. How spikes occurring at different times are integrated to drive perception and action remains poorly understood. We delivered random trains of optogenetic stimulation (white noise) to excite inhibitory interneurons in V1 of mice of both sexes while they performed a visual detection task. We then performed a reverse correlation analysis on the optogenetic stimuli to generate a neuronal-behavioral kernel, an unbiased, temporally precise estimate of how suppression of V1 spiking at different moments around the onset of a visual stimulus affects detection of that stimulus. Electrophysiological recordings enabled us to capture the effects of optogenetic stimuli on V1 responsivity and revealed that the earliest stimulus-evoked spikes are preferentially weighted for guiding behavior. These data demonstrate that white noise optogenetic stimulation is a powerful tool for understanding how patterns of spiking in neuronal populations are decoded in generating perception and action.SIGNIFICANCE STATEMENT During visually guided actions, continuous chains of neurons connect our retinas to our motoneurons. To unravel circuit contributions to behavior, it is crucial to establish the relative functional position(s) that different neural structures occupy in processing and relaying the signals that support rapid, precise responses. To address this question, we randomly inhibited activity in mouse V1 throughout the stimulus-response cycle while the animals did many repetitions of a visual task. The period that led to impaired performance corresponded to the earliest stimulus-driven response in V1, with no effect of inhibition immediately before or during late stages of the stimulus-driven response. This approach offers experimenters a powerful method for uncovering the temporal weighting of spikes from stimulus to response.

The Mind of a Mouse

Large scientific projects in genomics and astronomy are influential not because they answer any single question but because they enable investigation of continuously arising new questions from the same data-rich sources. Advances in automated mapping of the brain's synaptic connections (connectomics) suggest that the complicated circuits underlying brain function are ripe for analysis. We discuss benefits of mapping a mouse brain at the level of synapses.

Single trial neuronal activity dynamics of attentional intensity in monkey visual area V4

Understanding how activity of visual neurons represents distinct components of attention and their dynamics that account for improved visual performance remains elusive because single-unit experiments have not isolated the intensive aspect of attention from attentional selectivity. We isolated attentional intensity and its single trial dynamics as determined by spatially non-selective attentional performance in an orientation discrimination task while recording from neurons in monkey visual area V4. We found that attentional intensity is a distinct cognitive signal that can be distinguished from spatial selectivity, reward expectations and motor actions. V4 spiking on single trials encodes a combination of sensory and cognitive signals on different time scales. Attentional intensity and the detection of behaviorally relevant sensory signals are well represented, but immediate reward expectation and behavioral choices are poorly represented in V4 spiking. These results provide a detailed representation of perceptual and cognitive signals in V4 that are crucial for attentional performance.

An Open Resource for Non-human Primate Optogenetics

Optogenetics has revolutionized neuroscience in small laboratory animals, but its effect on animal models more closely related to humans, such as non-human primates (NHPs), has been mixed. To make evidence-based decisions in primate optogenetics, the scientific community would benefit from a centralized database listing all attempts, successful and unsuccessful, of using optogenetics in the primate brain. We contacted members of the community to ask for their contributions to an open science initiative. As of this writing, 45 laboratories around the world contributed more than 1,000 injection experiments, including precise details regarding their methods and outcomes. Of those entries, more than half had not been published. The resource is free for everyone to consult and contribute to on the Open Science Framework website. Here we review some of the insights from this initial release of the database and discuss methodological considerations to improve the success of optogenetic experiments in NHPs.

Different Inhibitory Interneuron Cell Classes Make Distinct Contributions to Visual Contrast Perception

While recent work has revealed how different inhibitory interneurons influence responses of cortical neurons to sensory stimuli, little is known about their distinct contributions to sensory perception. Here, we optogenetically activated different genetically defined interneurons [parvalbumin (PV), somatostatin (SST), vasoactive intestinal peptide (VIP)] in visual cortex (V1) of mice working at threshold in a contrast increment detection task. The visual stimulus was paired with optogenetic stimulation to assess how enhancing V1 inhibitory neuron activity during visual processing altered task performance. PV or SST activation impaired, while VIP stimulation improved, contrast increment detection. The impairment produced by PV or SST activation persisted over several weeks of testing. In contrast, mice learned to reliably detect VIP activation in the absence of any natural visual stimulus. Thus, different inhibitory signals make distinct contributions to visual contrast perception.

Spatially tuned normalization explains attention modulation variance within neurons

Spatial attention improves perception of attended parts of a scene, a behavioral enhancement accompanied by modulations of neuronal firing rates. These modulations vary in size across neurons in the same brain area. Models of normalization explain much of this variance in attention modulation with differences in tuned normalization across neurons (Lee J, Maunsell JHR. PLoS One 4: e4651, 2009; Ni AM, Ray S, Maunsell JHR. Neuron 73: 803-813, 2012). However, recent studies suggest that normalization tuning varies with spatial location both across and within neurons (Ruff DA, Alberts JJ, Cohen MR. J Neurophysiol 116: 1375-1386, 2016; Verhoef BE, Maunsell JHR. eLife 5: e17256, 2016). Here we show directly that attention modulation and normalization tuning do in fact covary within individual neurons, in addition to across neurons as previously demonstrated. We recorded the activity of isolated neurons in the middle temporal area of two rhesus monkeys as they performed a change-detection task that controlled the focus of spatial attention. Using the same two drifting Gabor stimuli and the same two receptive field locations for each neuron, we found that switching which stimulus was presented at which location affected both attention modulation and normalization in a correlated way within neurons. We present an equal-maximum-suppression spatially tuned normalization model that explains this covariance both across and within neurons: each stimulus generates equally strong suppression of its own excitatory drive, but its suppression of distant stimuli is typically less. This new model specifies how the tuned normalization associated with each stimulus location varies across space both within and across neurons, changing our understanding of the normalization mechanism and how attention modulations depend on this mechanism.NEW & NOTEWORTHY Tuned normalization studies have demonstrated that the variance in attention modulation size seen across neurons from the same cortical area can be largely explained by between-neuron differences in normalization strength. Here we demonstrate that attention modulation size varies within neurons as well and that this variance is largely explained by within-neuron differences in normalization strength. We provide a new spatially tuned normalization model that explains this broad range of observed normalization and attention effects.

Attention-related changes in correlated neuronal activity arise from normalization mechanisms

Attention is believed to enhance perception by altering the correlations between pairs of neurons. How attention changes neuronal correlations is unknown. Using multi-electrodes in primate visual cortex, we measured spike-count correlations when single or multiple stimuli were presented, and stimuli were attended or unattended. When stimuli were unattended, adding a suppressive, non-preferred, stimulus beside a preferred stimulus increased spike-count correlations between pairs of similarly-tuned neurons, but decreased spike-count correlations between pairs of oppositely-tuned neurons. These changes are explained by a stochastic normalization model containing populations of oppositely-tuned, mutually-suppressive neurons. Importantly, this model also explains why attention decreased (attend preferred stimulus) or increased (attend non-preferred stimulus) correlations: as an indirect consequence of attention-related changes in the inputs to normalization mechanisms. Our findings link normalization mechanisms to correlated neuronal activity and attention, showing that normalization mechanisms shape response correlations and that these correlations change when attention biases normalization mechanisms.

Neuronal Mechanisms of Visual Attention

Advances on several fronts have refined our understanding of the neuronal mechanisms of attention. This review focuses on recent progress in understanding visual attention through single-neuron recordings made in behaving subjects. Simultaneous recordings from populations of individual cells have shown that attention is associated with changes in the correlated firing of neurons that can enhance the quality of sensory representations. Other work has shown that sensory normalization mechanisms are important for explaining many aspects of how visual representations change with attention, and these mechanisms must be taken into account when evaluating attention-related neuronal modulations. Studies comparing different brain structures suggest that attention is composed of several cognitive processes, which might be controlled by different brain regions. Collectively, these and other recent findings provide a clearer picture of how representations in the visual system change when attention shifts from one target to another.

Neuronal Modulations in Visual Cortex Are Associated with Only One of Multiple Components of Attention

Neuronal signals related to visual attention are found in widespread brain regions, and these signals are generally assumed to participate in a common mechanism of attention. However, the behavioral effects of attention in detection can be separated into two distinct components: spatially selective shifts in either the criterion or sensitivity of the subject. Here we show that a paradigm used by many single-neuron studies of attention conflates behavioral changes in the subject's criterion and sensitivity. Then, using a task designed to dissociate these two components, we found that multiple aspects of attention-related neuronal modulations in area V4 of monkey visual cortex corresponded to behavioral shifts in sensitivity, but not criterion. This result suggests that separate components of attention are associated with signals in different brain regions and that attention is not a unitary process in the brain, but instead consists of distinct neurobiological mechanisms.

Do gamma oscillations play a role in cerebral cortex?

Gamma rhythm (which has a center frequency between 30 and 80 Hz) is modulated by cognitive mechanisms such as attention and memory, and has been hypothesized to play a role in mediating these processes by supporting communication channels between cortical areas or encoding information in its phase. We highlight several issues related to gamma rhythms, such as low and inconsistent power, its dependence on low-level stimulus features, problems due to conduction delays, and contamination due to spike-related activity that makes accurate estimation of gamma phase difficult. Gamma rhythm could be a potentially useful signature of excitation-inhibition interactions in the brain, but whether it also provides a mechanism for information processing or coding remains an open question.

Strength of gamma rhythm depends on normalization

Manipulating a divisive normalization mechanism independently of attention in monkeys suggests that gamma power reflects excitation-inhibition interactions rather than plays a functional role in attentional processing.

Neuronal assemblies often exhibit stimulus-induced rhythmic activity in the gamma range (30–80 Hz), whose magnitude depends on the attentional load. This has led to the suggestion that gamma rhythms form dynamic communication channels across cortical areas processing the features of behaviorally relevant stimuli. Recently, attention has been linked to a normalization mechanism, in which the response of a neuron is suppressed (normalized) by the overall activity of a large pool of neighboring neurons. In this model, attention increases the excitatory drive received by the neuron, which in turn also increases the strength of normalization, thereby changing the balance of excitation and inhibition. Recent studies have shown that gamma power also depends on such excitatory–inhibitory interactions. Could modulation in gamma power during an attention task be a reflection of the changes in the underlying excitation–inhibition interactions? By manipulating the normalization strength independent of attentional load in macaque monkeys, we show that gamma power increases with increasing normalization, even when the attentional load is fixed. Further, manipulations of attention that increase normalization increase gamma power, even when they decrease the firing rate. Thus, gamma rhythms could be a reflection of changes in the relative strengths of excitation and normalization rather than playing a functional role in communication or control.

Brain signals often show a stimulus-induced rhythm in the “gamma” band (30–80 Hz) whose magnitude depends on attentional load, leading to suggestions that gamma rhythm plays a functional role in routing signals across cortical areas. However, gamma power also depends on simple stimulus features such as size or contrast, which suggests that gamma could arise from basic cortical processes involving excitation–inhibition interactions. One such process is divisive normalization, a mechanism that suppresses the response of a neuron by the overall activity of a large pool of neighboring neurons. Recent studies have shown that attention increases the strength of both excitation and normalization. We hypothesized that the increase in gamma power in an attention task is due to the effect of attention on excitation and normalization. By manipulating the normalization strength independent of attentional load in macaque monkeys, we show that gamma power increases with increasing normalization, even when attentional load is held fixed. Thus, gamma rhythms could be a reflection of changes in the relative strengths of excitation and normalization rather than playing a functional role in communication or control.

Potential confounds in estimating trial-to-trial correlations between neuronal response and behavior using choice probabilities

Correlations between trial-to-trial fluctuations in the responses of individual sensory neurons and perceptual reports, commonly quantified with choice probability (CP), have been widely used as an important tool for assessing the contributions of neurons to behavior. These correlations are usually weak and often require a large number of trials for a reliable estimate. Therefore, working with measures such as CP warrants care in data analysis as well as rigorous controls during data collection. Here we identify potential confounds that can arise in data analysis and lead to biased estimates of CP, and suggest methods to avoid the bias. In particular, we show that the common practice of combining neuronal responses across different stimulus conditions with z-score normalization can result in an underestimation of CP when the ratio of the numbers of trials for the two behavioral response categories differs across the stimulus conditions. We also discuss the effects of using variable time intervals for quantifying neuronal response on CP measurements. Finally, we demonstrate that serious artifacts can arise in reaction time tasks that use varying measurement intervals if the mean neuronal response and mean behavioral performance vary over time within trials. To emphasize the importance of addressing these concerns in neurophysiological data, we present a set of data collected from V1 cells in macaque monkeys while the animals performed a detection task.

Tuned normalization explains the size of attention modulations

The effect of attention on firing rates varies considerably within a single cortical area. The firing rate of some neurons is greatly modulated by attention while others are hardly affected. The reason for this variability across neurons is unknown. We found that the variability in attention modulation across neurons in area MT of macaques can be well explained by variability in the strength of tuned normalization across neurons. The presence of tuned normalization also explains a striking asymmetry in attention effects within neurons: when two stimuli are in a neuron's receptive field, directing attention to the preferred stimulus modulates firing rates more than directing attention to the nonpreferred stimulus. These findings show that much of the neuron-to-neuron variability in modulation of responses by attention depends on variability in the way the neurons process multiple stimuli, rather than differences in the influence of top-down signals related to attention.

Insights into cortical mechanisms of behavior from microstimulation experiments

Even the simplest behaviors depend on a large number of neurons that are distributed across many brain regions. Because electrical microstimulation can change the activity of localized subsets of neurons, it has provided valuable evidence that specific neurons contribute to particular behaviors. Here we review what has been learned about cortical function from behavioral studies using microstimulation in animals and humans. Experiments that examine how microstimulation affects the perception of stimuli have shown that the effects of microstimulation are usually highly specific and can be related to the stimuli preferred by neurons at the stimulated site. Experiments that ask subjects to detect cortical microstimulation in the absence of other stimuli have provided further insights. Although subjects typically can detect microstimulation of primary sensory or motor cortex, they are generally unable to detect stimulation of most of cortex without extensive practice. With practice, however, stimulation of any part of cortex can become detected. These training effects suggest that some patterns of cortical activity cannot be readily accessed to guide behavior, but that the adult brain retains enough plasticity to learn to process novel patterns of neuronal activity arising anywhere in cortex.

Nine criteria for a measure of scientific output

Scientific research produces new knowledge, technologies, and clinical treatments that can lead to enormous returns. Often, the path from basic research to new paradigms and direct impact on society takes time. Precise quantification of scientific output in the short-term is not an easy task but is critical for evaluating scientists, laboratories, departments, and institutions. While there have been attempts to quantifying scientific output, we argue that current methods are not ideal and suffer from solvable difficulties. Here we propose criteria that a metric should have to be considered a good index of scientific output. Specifically, we argue that such an index should be quantitative, based on robust data, rapidly updated and retrospective, presented with confidence intervals, normalized by number of contributors, career stage and discipline, impractical to manipulate, and focused on quality over quantity. Such an index should be validated through empirical testing. The purpose of quantitatively evaluating scientific output is not to replace careful, rigorous review by experts but rather to complement those efforts. Because it has the potential to greatly influence the efficiency of scientific research, we have a duty to reflect upon and implement novel and rigorous ways of evaluating scientific output. The criteria proposed here provide initial steps toward the systematic development and validation of a metric to evaluate scientific output.

Psychophysical measurement of contrast sensitivity in the behaving mouse

To understand how activity in mammalian neural circuits controls behavior, the mouse is a promising model system due to the convergence of genetic, optical, and physiological methods. The ability to control and quantify behavior precisely is also essential for these studies. We developed an operant visual detection paradigm to make visual psychophysical measurements: head-fixed mice make responses by pressing a lever. We designed this task to permit neurophysiological studies of behavior in cerebral cortex, where activity is variable from trial to trial and neurons encode many types of information simultaneously. To study neural responses in the face of this complexity, we trained mice to do a task where they perform hundreds of trials daily and perceptual thresholds can be measured. We used this task to measure both visual acuity and the minimum detectable contrast in behaving mice. We found that the mouse contrast response function is similar in shape to other species. They can detect low-contrast stimuli, with a peak contrast threshold of 2%, equivalent to ∼15° eccentric in human vision. Mouse acuity is modest, with an upper limit near 0.5 cycles/°, consistent with prior data.

Using neuronal populations to study the mechanisms underlying spatial and feature attention

Visual attention affects both perception and neuronal responses. Whether the same neuronal mechanisms mediate spatial attention, which improves perception of attended locations, and nonspatial forms of attention has been a subject of considerable debate. Spatial and feature attention have similar effects on individual neurons. Because visual cortex is retinotopically organized, however, spatial attention can comodulate local neuronal populations, whereas feature attention generally requires more selective modulation. We compared the effects of feature and spatial attention on local and spatially separated populations by recording simultaneously from dozens of neurons in both hemispheres of V4. Feature and spatial attention affect the activity of local populations similarly, modulating both firing rates and correlations between pairs of nearby neurons. However, whereas spatial attention appears to act on local populations, feature attention is coordinated across hemispheres. Our results are consistent with a unified attentional mechanism that can modulate the responses of arbitrary subgroups of neurons.

Different origins of gamma rhythm and high-gamma activity in macaque visual cortex

During cognitive tasks electrical activity in the brain shows changes in power in specific frequency ranges, such as the alpha (8-12 Hz) or gamma (30-80 Hz) bands, as well as in a broad range above ∼80 Hz, called the high-gamma band. The role or significance of this broadband high-gamma activity is unclear. One hypothesis states that high-gamma oscillations serve just like gamma oscillations, operating at a higher frequency and consequently at a faster timescale. Another hypothesis states that high-gamma power is related to spiking activity. Because gamma power and spiking activity tend to co-vary during most stimulus manipulations (such as contrast modulations) or cognitive tasks (such as attentional modulation), it is difficult to dissociate these two hypotheses. We studied the relationship between high-gamma power, gamma rhythm, and spiking activity in the primary visual cortex (V1) of awake monkeys while varying the stimulus size, which increased the gamma power but decreased the firing rate, permitting a dissociation. We found that gamma power became anti-correlated with the high-gamma power, suggesting that the two phenomena are distinct and have different origins. On the other hand, high-gamma power remained tightly correlated with spiking activity under a wide range of stimulus manipulations. We studied this relationship using a signal processing technique called Matching Pursuit and found that action potentials are associated with sharp transients in the LFP with broadband power, which is visible at frequencies as low as ∼50 Hz. These results distinguish broadband high-gamma activity from gamma rhythms as an easily obtained and reliable electrophysiological index of neuronal firing near the microelectrode. Further, they highlight the importance of making a careful dissociation between gamma rhythms and spike-related transients that could be incorrectly decomposed as rhythms using traditional signal processing methods.

The effect of attention on neuronal responses to high and low contrast stimuli

It remains unclear how attention affects the tuning of individual neurons in visual cerebral cortex. Some observations suggest that attention preferentially enhances responses to low contrast stimuli, whereas others suggest that attention proportionally affects responses to all stimuli. Resolving how attention affects responses to different stimuli is essential for understanding the mechanism by which it acts. To explore the effects of attention on stimuli of different contrasts, we recorded from individual neurons in the middle temporal visual area (MT) of rhesus monkeys while shifting their attention between preferred and nonpreferred stimuli within their receptive fields. This configuration results in robust attentional modulation that makes it possible to readily distinguish whether attention acts preferentially on low contrast stimuli. We found no evidence for greater enhancement of low contrast stimuli. Instead, the strong attentional modulations were well explained by a model in which attention proportionally enhances responses to stimuli of all contrasts. These data, together with observations on the effects of attention on responses to other stimulus dimensions, suggest that the primary effect of attention in visual cortex may be to simply increase the strength of responses to all stimuli by the same proportion.

Microstimulation reveals limits in detecting different signals from a local cortical region

Behavioral performance depends on the activity of neurons in sensory cortex, but little is known about the brain's capacity to access specific neuronal signals to guide behavior. Even the individual sensory neurons that are most sensitive to a relevant stimulus are only weakly correlated with behavior, suggesting that behavioral decisions are based on the combined activity of groups of neurons with sensitivities well matched to task demands. To explore how flexibly different patterns of activity can be accessed from a given cortical region, we trained animals to detect electrical microstimulation of local V1 sites. By allowing the animals to become expert at the detection of microstimulation of specific V1 sites that corresponded to particular retinotopic locations, we could measure the effects of that training on the ability of those sites to support the detection of visual stimuli. Training to detect electrical activation caused a large, reversible, retinotopically localized impairment of thresholds for detecting visual stimuli. Retraining on visual detection restored normal thresholds and in turn impaired thresholds for detecting microstimulation. These results suggest that there are substantial limits to the types of signals for which a local cortical region can be simultaneously optimized.

Attention improves performance primarily by reducing interneuronal correlations

Visual attention can dramatically improve behavioural performance by allowing observers to focus on the important information in a complex scene. Attention also typically increases the firing rates of cortical sensory neurons. Rate increases improve the signal-to-noise ratio of individual neurons, and this improvement has been assumed to underlie attention-related improvements in behaviour. We recorded dozens of neurons simultaneously in visual area V4 and found that changes in single neurons accounted for only a small fraction of the improvement in the sensitivity of the population. Instead, over 80% of the attentional improvement in the population signal was caused by decreases in the correlations between the trial-to-trial fluctuations in the responses of pairs of neurons. These results suggest that the representation of sensory information in populations of neurons and the way attention affects the sensitivity of the population may only be understood by considering the interactions between neurons.

Computer-controlled electrical stimulation for quantitative mapping of human cortical function

Cortical mapping with electrical stimulation (ES) in neurosurgical patients typically involves the manually controlled delivery of suprathreshold electrical current to a discrete area of the brain. Limited numbers of trials and imprecise current delivery methods increase the variability of the behavioral response and make it difficult to collect quantitative mapping data, which is especially important in research studies of human cortical function. To overcome these limitations, the authors developed a method for computer-controlled delivery of defined electrical current to implanted intracranial electrodes. They demonstrate that stimulation can be time locked to a behavioral task to rapidly and systematically measure the detection threshold for ES in human visual cortex over many trials. Computer-controlled ES is well suited for the systematic and quantitative study of the function of virtually any region of cerebral cortex. It may be especially useful for studying human cortical regions that are not well characterized and for verifying the presence of stimulation-evoked percepts that are difficult to objectively confirm.

The Neuroscience Peer Review Consortium

As the Neuroscience Peer Review Consortium (NPRC) ends its first year, it is worth looking back to see how the experiment has worked.

In order to encourage dissemination of the details outlined in this Editorial, it will also be published in other journals in the Neuroscience Peer Review Consortium.

A normalization model of attentional modulation of single unit responses

Although many studies have shown that attention to a stimulus can enhance the responses of individual cortical sensory neurons, little is known about how attention accomplishes this change in response. Here, we propose that attention-based changes in neuronal responses depend on the same response normalization mechanism that adjusts sensory responses whenever multiple stimuli are present. We have implemented a model of attention that assumes that attention works only through this normalization mechanism, and show that it can replicate key effects of attention. The model successfully explains how attention changes the gain of responses to individual stimuli and also why modulation by attention is more robust and not a simple gain change when multiple stimuli are present inside a neuron's receptive field. Additionally, the model accounts well for physiological data that measure separately attentional modulation and sensory normalization of the responses of individual neurons in area MT in visual cortex. The proposal that attention works through a normalization mechanism sheds new light a broad range of observations on how attention alters the representation of sensory information in cerebral cortex.

Local cortical function after uncomplicated subdural electrode implantation. Laboratory investigation

OBJECTIVES

Although subdural electrodes are routinely used to map regional brain function, it is unknown if the presence of these implants hinders local cortical function. The authors used psychophysical methods to measure the effect of uncomplicated electrode implantation on local cortical function.

METHODS

Local field potentials were used to map receptive fields (RFs) for subdural electrodes that were unilaterally implanted on early visual cortex in 4 patients. After electrode implantation, patients did a task that required them to detect an orientation change in a flashing visual stimulus that was presented either inside the mapped RF or outside the RF in the diametrically opposite portion of the other hemifield. The size of the orientation change was varied to span a wide range of behavioral performance. Psychometric curves were generated by fitting behavioral responses to a logistic function. The threshold was defined as the point at which the fitted function crossed 50% detection.

RESULTS

Data were well fit by the logistic function in all 4 patients for both RF and non-RF conditions. None of the volunteers tested showed a statistically significant difference in detection threshold, reaction time, or in the slope of the psychometric function for stimuli presented inside or outside the RF.

CONCLUSIONS

Subdural electrodes implanted for extraoperative monitoring do not impair psychophysical performance for a task based on stimuli lying within the RF for recording electrodes. This finding suggests that these electrodes can be used reliably for accurate assessment of regional neurological function.

Spatial attention and the latency of neuronal responses in macaque area V4

The effects of attention on neuronal responses in visual cortex have been likened to a change in stimulus contrast. Attention and stimulus contrast both modulate the magnitude of neuronal responses. However, changes in stimulus contrast also affect the latency of visual responses. Although many neurophysiological studies have examined how attention affects the strength of neuronal responses, few have considered whether attention affects neuronal latencies. To compare directly the effects of stimulus contrast and attention, we recorded responses from individual neurons in area V4 of macaque monkeys while they performed a task that independently controlled spatial attention and stimulus contrast. As expected, changes in stimulus contrast affected both the magnitude and latency of neuronal responses. Although attention had the expected effects on the magnitudes of neuronal responses, we did not detect statistically reliable changes in neuronal latency. A direct comparison of the effects of contrast and attention revealed a reliable difference. When a shift in spatial attention decreased response magnitude, response latency increased much less than when the same magnitude change was caused by reducing stimulus contrast. Thus, attention is distinct from contrast in the way it affects the relationship between neuronal response magnitude and latency.

Behavioral detection of electrical microstimulation in different cortical visual areas

The extent to which areas in the visual cerebral cortex differ in their ability to support perceptions has been the subject of considerable speculation. Experiments examining the activity of individual neurons have suggested that activity in later stages of the visual cortex is more closely linked to perception than that in earlier stages [1-9]. In contrast, results from functional imaging, transcranial magnetic stimulation, and lesion studies have been interpreted as showing that earlier stages are more closely coupled to perception [10-15]. We examined whether neuronal activity in early and later stages differs in its ability to support detectable signals by measuring behavioral thresholds for detecting electrical microstimulation in different cortical areas in two monkeys. By training the animals to perform a two-alternative temporal forced-choice task, we obtained criterion-free thresholds from five visual areas--V1, V2, V3A, MT, and the inferotemporal cortex. Every site tested yielded a reliable threshold. Thresholds varied little within and between visual areas, rising gradually from early to later stages. We similarly found no systematic differences in the slopes of the psychometric detection functions from different areas. These results suggest that neuronal signals of similar magnitude evoked in any part of visual cortex can generate percepts.

Receptive Fields in Human Visual Cortex Mapped with Surface Electrodes

Most of our understanding of the functional organization of human visual cortex comes from lesion and functional imaging studies and by extrapolation from results obtained by neuroanatomical and neurophysiological studies in nonhuman primates. Although some single-unit and field potential recordings have been made in human visual cortex, none has provided quantitative characterization of spatial receptive fields (RFs) of individual sites. Here we use subdural electrodes implanted for clinical purposes to quantitatively measure response properties in different regions of human visual cortex. We find significant differences in RF size, response latency, and response magnitude for sites in early visual areas, versus sites in later stages of both the dorsal and ventral streams. In addition, we use this technique to estimate the cortical magnification factor in early human visual cortex. The spatial and temporal resolution of cortical surface recordings suggest that this technique is well suited to examine further issues in visual processing in humans.

Effects of task difficulty and target likelihood in area V4 of macaque monkeys

Spatial attention improves performance at attended locations and correspondingly modulates firing rates of cortical neurons. The size of these behavioral and neuronal effects depends on the difficulty of the task performed at the attended location. Psychological theorists have attributed this to a tighter focus of a fixed amount of processing resource at the attended location, but the effects of task difficulty on the distribution of neuronal effects of attention across the visual field have not been fully explored. We trained rhesus monkeys to do a detection task in which difficulty and spatial attention were manipulated independently. Probe stimuli were used to measure behavioral performance in different conditions of attention and difficulty. Animals performed better at attended locations and this advantage increased with difficulty, consistent with data from human psychophysics. Neuronal modulation by spatial attention was larger with greater difficulty. In two animals, increasing difficulty caused a modest increase in neuronal responses to visual stimuli regardless of the locus of spatial attention. In a third animal, which was previously trained to ignore multiple distracting stimuli, increasing task difficulty increased responses at the focus of attention and suppressed responses away from the focus of attention. The results show that difficulty can modulate effects of spatial attention in V4; it can alter the distribution of sensory responses across the visual scene in ways that may depend on the subject's behavioral strategy.

Effects of spatial attention on contrast response functions in macaque area V4

Previous single-unit studies of visual cortex have reported that spatial attention modulates responses to different orientations and directions proportionally, such that it does not change the width of tuning functions for these properties. Other studies have suggested that spatial attention causes a leftward shift in contrast response functions, such that its effects on responses to stimuli of different contrasts are not proportional. We have further explored the effects of attention on stimulus-response functions by measuring the responses of 131 individual V4 neurons in two monkeys while they did a task that controlled their spatial attention. Each neuron was tested with a set of stimuli that spanned complete ranges of orientation and contrast during different states of attention. Consistent with earlier reports, attention scaled responses to preferred and nonpreferred orientations proportionally. However, we did not find compelling evidence that the effects were best described by a leftward shift of the contrast response function. The modulation of neuronal responses by attention was well described by either a leftward shift or proportional scaling of the contrast response function. Consideration of differences in experimental design and analysis that may have contributed to this discrepancy suggests that it was premature to exclude a proportional scaling of responses to different contrasts by attention in favor of a leftward shift of contrast response functions. The current results reopen the possibility that the effects of attention on stimulus-response functions are well described by a single proportional increase in a neuron's response to all stimuli.

Feature-based attention in visual cortex

Although most studies of visual attention have examined the effects of shifting attention between different locations in the visual field, attention can also be directed to particular visual features, such as a color, orientation or a direction of motion. Single-unit studies have shown that attention to a feature modulates neuronal signals in a range of areas in monkey visual cortex. The location-independent property of feature-based attention makes it particularly well suited to modify selectively the neural representations of stimuli or parts within complex visual scenes that match the currently attended feature. This review is part of the TINS special issue on The Neural Substrates of Cognition.

Using Neuronal Latency to Determine Sensory–Motor Processing Pathways in Reaction Time Tasks

We describe a new technique that uses the timing of neuronal and behavioral responses to explore the contributions of individual neurons to specific behaviors. The approach uses both the mean neuronal latency and the trial-by-trial covariance between neuronal latency and behavioral response. Reliable measurements of these values were obtained from single-unit recordings made from anterior inferotemporal (AIT) cortex and the frontal eye fields (FEF) in monkeys while they performed a choice reaction time task. These neurophysiological data show that the responses of AIT neurons and some FEF neurons have little covariance with behavioral response, consistent with a largely “sensory” response. The responses of another group of FEF neurons with longer mean latency covary tightly with behavioral response, consistent with a largely “motor” response. A very small fraction of FEF neurons had responses consistent with an intermediate position in the sensory-motor pathway. These results suggest that this technique is a valuable tool for exploring the functional organization of neuronal circuits that underlie specific behaviors.

Attentional modulation of motion integration of individual neurons in the middle temporal visual area

We examined how spatially directed attention affected the integration of motion in neurons of the middle temporal (MT) area of visual cortex. We recorded from single MT neurons while monkeys performed a motion detection task under two attentional states. Using 0% coherent random dot motion, we estimated the optimal linear transfer function (or kernel) between the global motion and the neuronal response. This linear kernel filtered the random dot motion across direction, speed, and time. Slightly less than one-half of the neurons produced reasonably well defined kernels that also tended to account for both the directional selectivity and responses to coherent motion of different strengths. This subpopulation of cells had faster, more transient, and more robust responses to visual stimuli than neurons with kernels that did not contain well defined regions of integration. For those neurons that had large attentional modulation and produced well defined kernels, we found attention scaled the temporal profile of the transfer function with no appreciable shift in time or change in shape. Thus, for MT neurons described by a linear transfer function, attention produced a multiplicative scaling of the temporal integration window.

The effect of perceptual learning on neuronal responses in monkey visual area V4

Previous studies have shown that perceptual learning can substantially alter the response properties of neurons in the primary somatosensory and auditory cortices. Although psychophysical studies suggest that perceptual learning induces similar changes in primary visual cortex (V1), studies that have measured the response properties of individual neurons have failed to find effects of the size described for the other sensory systems. We have examined the effect of learning on neuronal response properties in a visual area that lies at a later stage of cortical processing, area V4. Adult macaque monkeys were trained extensively on orientation discrimination at a specific retinal location using a narrow range of orientations. During the course of training, the subjects achieved substantial improvement in orientation discrimination that was primarily restricted to the trained location. After training, neurons in V4 with receptive fields overlapping the trained location had stronger responses and narrower orientation tuning curves than neurons with receptive fields in the opposite, untrained hemifield. The changes were most prominent for neurons that preferred orientations close to the trained range of orientations. These results provide the first demonstration of perceptual learning modifying basic neuronal response properties at an intermediate level of visual cortex and give insights into the distribution of plasticity across adult visual cortex.

Anterior inferotemporal neurons of monkeys engaged in object recognition can be highly sensitive to object retinal position

Visual object recognition is computationally difficult because changes in an object's position, distance, pose, or setting may cause it to produce a different retinal image on each encounter. To robustly recognize objects, the primate brain must have mechanisms to compensate for these variations. Although these mechanisms are poorly understood, it is thought that they elaborate neuronal representations in the inferotemporal cortex that are sensitive to object form but substantially invariant to other image variations. This study examines this hypothesis for image variation resulting from changes in object position. We studied the effect of small differences (+/-1.5 degrees ) in the retinal position of small (0.6 degrees wide) visual forms on both the behavior of monkeys trained to identify those forms and the responses of 146 anterior IT (AIT) neurons collected during that behavior. Behavioral accuracy and speed were largely unaffected by these small changes in position. Consistent with previous studies, many AIT responses were highly selective for the forms. However, AIT responses showed far greater sensitivity to retinal position than predicted from their reported receptive field (RF) sizes. The median AIT neuron showed a approximately 60% response decrease between positions within +/-1.5 degrees of the center of gaze, and 52% of neurons were unresponsive to one or more of these positions. Consistent with previous studies, each neuron's rank order of target preferences was largely unaffected across position changes. Although we have not yet determined the conditions necessary to observe this marked position sensitivity in AIT responses, we rule out effects of spatial-frequency content, eye movements, and failures to include the RF center. To reconcile this observation with previous studies, we hypothesize that either AIT position sensitivity strongly depends on object size or that position sensitivity is sharpened by extensive visual experience at fixed retinal positions or by the presence of flanking distractors.

Attentional modulation in visual cortex depends on task timing

Paying attention to a stimulus selectively increases the ability to process it. For example, when subjects attend to a specific region of a visual scene, their sensitivity to changes at that location increases. A large number of studies describe the behavioural consequences and neurophysiological correlates of attending to spatial locations. There has, in contrast, been little study of the allocation of attention over time. Because subjects can anticipate predictable events with great temporal precision, it seems probable that they might dynamically shift their attention when performing a familiar perceptual task whose constraints changed over time. We trained monkeys to respond to a stimulus change where the probability of occurrence changed over time. Recording from area V4 of the visual cortex in these animals, we found that the modulation of neuronal responses changed according to the probability of the change occurring at that instant. Thus, we show that the attentional modulation of sensory neurons reflects a subject's anticipation of the timing of behaviourally relevant events.

Dynamics of neuronal responses in macaque MT and VIP during motion detection

We examined how the relationship between neuronal activity and behavior evolved over time during a motion-detection task. Recording from two regions of visual cortex that process motion, the middle temporal (MT) and ventral intraparietal (VIP) areas, we used the time it took subjects to detect a motion stimulus to evaluate the dynamics of the underlying neuronal signals. Single-neuron activity was correlated with stimulus detection and reaction time (RT) in both areas. The rising edge of the population response from both areas was highly predictive of RT using a simple threshold-detection model. The time course of the population responses, however, differed between MT and VIP. For MT, the onset of the neuronal response was relatively constant, whereas for VIP the onset of the neuronal responses increased with RT. In contrast to previous studies, we found that single neurons were not reliable detectors of the motion signal when constrained by realistic detection times.