Noise correlations have little influence on the coding of selective attention in area V1

Correlated variability and its attentional modulation depend on anatomical connectivity

Visual cortical neurons show variability in their responses to repeated presentations of a stimulus and a portion of this variability is shared across neurons. Attention may enhance visual perception by reducing shared spiking variability. However, shared variability and its attentional modulation are not consistent within or across cortical areas, and depend on additional factors such as neuronal type. A critical factor that has not been tested is actual anatomical connectivity. We measured spike count correlations among pairs of simultaneously recorded neurons in the primary visual cortex (V1) for which anatomical connectivity was inferred from spiking cross-correlations. Neurons were recorded in monkeys performing a contrast-change discrimination task requiring covert shifts in visual spatial attention. Accordingly, spike count correlations were compared across trials in which attention was directed toward or away from the visual stimulus overlapping recorded neuronal receptive fields. Consistent with prior findings, attention did not significantly alter spike count correlations among random pairings of unconnected V1 neurons. However, V1 neurons connected via excitatory synapses showed a significant reduction in spike count correlations with attention. Interestingly, V1 neurons connected via inhibitory synapses demonstrated high spike count correlations overall that were not modulated by attention. Correlated variability in excitatory circuits also depended upon neuronal tuning for contrast, the task-relevant stimulus feature. These results indicate that shared variability depends on the type of connectivity in neuronal circuits. Also, attention significantly reduces shared variability in excitatory circuits, even when attention effects on randomly sampled neurons within the same area are weak.

Chronic bisphenol A exposure triggers visual perception dysfunction through impoverished neuronal coding ability in the primary visual cortex

Contrast perception is a fundamental visual ability that allows us to distinguish objects from the background. However, whether it is perturbed by chronic exposure to environmental xenoestrogen, bisphenol A (BPA), is still elusive. Here, we used adult cats to explore BPA-induced changes in contrast sensitivity (CS) and its underlying neuronal coding mechanism. Behavioral results showed that 14 days of BPA exposure (0.4 mg/kg/day) was sufficient to induce CS declines at the tested spatial frequencies (0.05-2 cycles/deg) in all four cats. Furthermore, based on multi-channel electrophysiological recording and interneuronal correlation analysis, we found that the BPA-exposed cats exhibited an obvious up-regulation in noise correlation in the primary visual cortex (area 17, A17), thus providing a population neuronal coding basis for their perceptual dysfunction. Moreover, single neuron responses in A17 of BPA-exposed cats revealed a slight but marked decrease in CS compared to that of control cats. Additionally, these neuronal responses presented an overt decrease in signal-to-noise ratio, accompanied by increased trial-to-trial response variability (i.e., noise). To some extent, these neuron population and unit dysfunctions in A17 of BPA-exposed cats were attributable to decreased response activity of fast-spiking neurons. Together, our findings demonstrate that chronic BPA exposure restricts contrast perception, in response to impoverished neuronal coding ability in A17.

Modulation of Spike Count Correlations Between Macaque Primary Visual Cortex Neurons by Difficulty of Attentional Task

Studies have shown that spatial attention remarkably affects the trial-to-trial response variability shared between neurons. Difficulty in the attentional task adjusts how much concentration we maintain on what is currently important and what is filtered as irrelevant sensory information. However, how task difficulty mediates the interactions between neurons with separated receptive fields (RFs) that are attended to or attended away is still not clear. We examined spike count correlations between single-unit activities recorded simultaneously in the primary visual cortex (V1) while monkeys performed a spatial attention task with two levels of difficulty. Moreover, the RFs of the two neurons recorded were non-overlapping to allow us to study fluctuations in the correlated responses between competing visual inputs when the focus of attention was allocated to the RF of one neuron. While increasing difficulty in the spatial attention task, spike count correlations were either decreased to become negative between neuronal pairs, implying competition among them, with one neuron (or none) exhibiting attentional enhancement of firing rate, or increased to become positive, suggesting inter-neuronal cooperation, with one of the pair showing attentional suppression of spiking responses. Besides, the modulation of spike count correlations by task difficulty was independent of the attended locations. These findings provide evidence that task difficulty affects the functional interactions between different neuronal pools in V1 when selective attention resolves the spatial competition.

Correlated structure of neuronal firing in macaque visual cortex limits information for binocular depth discrimination

Variability in cortical neural activity potentially limits sensory discriminations. Theoretical work shows that information required to discriminate two similar stimuli is limited by the correlation structure of cortical variability. We investigated these information-limiting correlations by recording simultaneously from visual cortical areas primary visual cortex (V1) and extrastriate area V4 in macaque monkeys performing a binocular, stereo depth discrimination task. Within both areas, noise correlations on a rapid temporal scale (20–30 ms) were stronger for neuron pairs with similar selectivity for binocular depth, meaning that these correlations potentially limit information for making the discrimination. Between-area correlations (V1 to V4) were different, being weaker for neuron pairs with similar tuning and having a slower temporal scale (100+ ms). Fluctuations in these information-limiting correlations just prior to the detection event were associated with changes in behavioral accuracy. Although these correlations limit the recovery of information about sensory targets, their impact may be curtailed by integrative processing of signals across multiple brain areas.

NEW & NOTEWORTHY Correlated noise reduces the stimulus information in visual cortical neurons during experimental performance of binocular depth discriminations. The temporal scale of these correlations is important. Rapid (20–30 ms) correlations reduce information within and between areas V1 and V4, whereas slow (>100 ms) correlations between areas do not. Separate cortical areas appear to act together to maintain signal fidelity. Rapid correlations reduce the neuronal signal difference between stimuli and adversely affect perceptual discrimination.

Network dynamics of Broca's area during word selection

Current models of word-production in Broca's area (i.e. left ventro-lateral prefrontal cortex, VLPFC) posit that sequential and staggered semantic, lexical, phonological and articulatory processes precede articulation. Using millisecond-resolution intra-cranial recordings, we evaluated spatiotemporal dynamics and high frequency functional interconnectivity between left VLPFC regions during single-word production. Through the systematic variation of retrieval, selection, and phonological loads, we identified specific activation profiles and functional coupling patterns between these regions that fit within current psycholinguistic theories of word production. However, network interactions underpinning these processes activate in parallel (not sequentially), while the processes themselves are indexed by specific changes in network state. We found evidence that suggests that pars orbitalis is coupled with pars triangularis during lexical retrieval, while lexical selection is terminated via coupled activity with M1 at articulation onset. Taken together, this work reveals that speech production relies on very specific inter-regional couplings in rapid sequence in the language dominant hemisphere.

Spiking Suppression Precedes Cued Attentional Enhancement of Neural Responses in Primary Visual Cortex

Attending to a visual stimulus increases its detectability, even if gaze is directed elsewhere. This covert attentional selection is known to enhance spiking across many brain areas, including the primary visual cortex (V1). Here we investigate the temporal dynamics of attention-related spiking changes in V1 of macaques performing a task that separates attentional selection from the onset of visual stimulation. We found that preceding attentional enhancement there was a sharp, transient decline in spiking following presentation of an attention-guiding cue. This disruption of V1 spiking was not observed in a task-naïve subject that passively observed the same stimulus sequence, suggesting that sensory activation is insufficient to cause suppression. Following this suppression, attended stimuli evoked more spiking than unattended stimuli, matching previous reports of attention-related activity in V1. Laminar analyses revealed a distinct pattern of activation in feedback-associated layers during both the cue-induced suppression and subsequent attentional enhancement. These findings suggest that top-down modulation of V1 spiking can be bidirectional and result in either suppression or enhancement of spiking responses.

Conditioning sharpens the spatial representation of rewarded stimuli in mouse primary visual cortex

Reward is often employed as reinforcement in behavioral paradigms but it is unclear how the visuospatial aspect of a stimulus-reward association affects the cortical representation of visual space. Using a head-fixed paradigm, we conditioned mice to associate the same visual pattern in adjacent retinotopic regions with availability and absence of reward. Time-lapse intrinsic optical signal imaging under anesthesia showed that conditioning increased the spatial separation of mesoscale cortical representations of reward predicting- and non-reward predicting stimuli. Subsequent in vivo two-photon calcium imaging revealed that this improved separation correlated with enhanced population coding for retinotopic location, specifically for the trained orientation and spatially confined to the V1 region where rewarded and non-rewarded stimulus representations bordered. These results are corroborated by conditioning-induced differences in the correlation structure of population activity. Thus, the cortical representation of visual space is sharpened as consequence of associative stimulus-reward learning while the overall retinotopic map remains unaltered.

Adjusted regularization of cortical covariance

It is now common to record dozens to hundreds or more neurons simultaneously, and to ask how the network activity changes across experimental conditions. A natural framework for addressing questions of functional connectivity is to apply Gaussian graphical modeling to neural data, where each edge in the graph corresponds to a non-zero partial correlation between neurons. Because the number of possible edges is large, one strategy for estimating the graph has been to apply methods that aim to identify large sparse effects using an [Formula: see text] penalty. However, the partial correlations found in neural spike count data are neither large nor sparse, so techniques that perform well in sparse settings will typically perform poorly in the context of neural spike count data. Fortunately, the correlated firing for any pair of cortical neurons depends strongly on both their distance apart and the features for which they are tuned. We introduce a method that takes advantage of these known, strong effects by allowing the penalty to depend on them: thus, for example, the connection between pairs of neurons that are close together will be penalized less than pairs that are far apart. We show through simulations that this physiologically-motivated procedure performs substantially better than off-the-shelf generic tools, and we illustrate by applying the methodology to populations of neurons recorded with multielectrode arrays implanted in macaque visual cortex areas V1 and V4.

Spontaneous Fluctuations in Visual Cortical Responses Influence Population Coding Accuracy

Information processing in the cerebral cortex depends not only on the nature of incoming stimuli, but also on the state of neuronal networks at the time of stimulation. That is, the same stimulus will be processed differently depending on the neuronal context in which it is received. A major factor that could influence neuronal context is the background, or ongoing neuronal activity before stimulation. In visual cortex, ongoing activity is known to play a critical role in the development of local circuits, yet whether it influences the coding of visual features in adult cortex is unclear. Here, we investigate whether and how the information encoded by individual neurons and populations in primary visual cortex (V1) depends on the ongoing activity before stimulus presentation. We report that when individual neurons are in a "low" prestimulus state, they have a higher capacity to discriminate stimulus features, such as orientation, despite their reduction in evoked responses. By measuring the distribution of prestimulus activity across a population of neurons, we found that network discrimination accuracy is improved in the low prestimulus state. Thus, the distribution of ongoing activity states across the network creates an "internal context" that dynamically filters incoming stimuli to modulate the accuracy of sensory coding. The modulation of stimulus coding by ongoing activity state is consistent with recurrent network models in which ongoing activity dynamically controls the balanced background excitation and inhibition to individual neurons.

Cortical response states for enhanced sensory discrimination

Brain activity during wakefulness is characterized by rapid fluctuations in neuronal responses. Whether these fluctuations play any role in modulating the accuracy of behavioral responses is poorly understood. Here, we investigated whether and how trial changes in the population response impact sensory coding in monkey V1 and perceptual performance. Although the responses of individual neurons varied widely across trials, many cells tended to covary with the local population. When population activity was in a ‘low’ state, neurons had lower evoked responses and correlated variability, yet higher probability to predict perceptual accuracy. The impact of firing rate fluctuations on network and perceptual accuracy was strongest 200 ms before stimulus presentation, and it greatly diminished when the number of cells used to measure the state of the population was decreased. These findings indicate that enhanced perceptual discrimination occurs when population activity is in a ‘silent’ response mode in which neurons increase information extraction.

Attentional Modulation of Neuronal Activity Depends on Neuronal Feature Selectivity

Attention exerts a powerful influence on visual perception. The impact of attention on neuronal activity manifests at early visual information processing stages and progressively increases throughout the visual cortical hierarchy. However, the neuronal mechanisms of attention are unresolved. In particular, the rules governing attentional modulation of individual neurons, whether they are facilitated by or suppressed by attention, are not known. To obtain a more granular or neuron- and circuit-level understanding of the mechanisms of attention and to directly test the feature similarity gain model in V1, we compared attentional modulation with neuronal feature selectivity across a large population of V1 neurons in alert and behaving macaque monkeys trained on an attention-demanding contrast-change detection task. We utilized emerging multi-electrode array technology to record simultaneously from V1 neurons spanning all six cortical layers so that we could characterize the laminar position and physiological response properties of diverse V1 neuronal populations. We found significant relationships between attentional modulation and neuronal position within the cortical hierarchy, neuronal physiology, and neuronal feature selectivity. Our results support the feature similarity gain model and further suggest that attentional modulation depends critically upon the match between neuronal feature selectivity and the features required for the task.

Attention-related changes in correlated neuronal activity arise from normalization mechanisms

Attention is believed to enhance perception by altering the correlations between pairs of neurons. How attention changes neuronal correlations is unknown. Using multi-electrodes in primate visual cortex, we measured spike-count correlations when single or multiple stimuli were presented, and stimuli were attended or unattended. When stimuli were unattended, adding a suppressive, non-preferred, stimulus beside a preferred stimulus increased spike-count correlations between pairs of similarly-tuned neurons, but decreased spike-count correlations between pairs of oppositely-tuned neurons. These changes are explained by a stochastic normalization model containing populations of oppositely-tuned, mutually-suppressive neurons. Importantly, this model also explains why attention decreased (attend preferred stimulus) or increased (attend non-preferred stimulus) correlations: as an indirect consequence of attention-related changes in the inputs to normalization mechanisms. Our findings link normalization mechanisms to correlated neuronal activity and attention, showing that normalization mechanisms shape response correlations and that these correlations change when attention biases normalization mechanisms.

Hierarchical differences in population coding within auditory cortex

Most models of auditory cortical (AC) population coding have focused on primary auditory cortex (A1). Thus our understanding of how neural coding for sounds progresses along the cortical hierarchy remains obscure. To illuminate this, we recorded from two AC fields: A1 and middle lateral belt (ML) of rhesus macaques. We presented amplitude-modulated (AM) noise during both passive listening and while the animals performed an AM detection task ("active" condition). In both fields, neurons exhibit monotonic AM-depth tuning, with A1 neurons mostly exhibiting increasing rate-depth functions and ML neurons approximately evenly distributed between increasing and decreasing functions. We measured noise correlation (r_noise) between simultaneously recorded neurons and found that whereas engagement decreased average r_noise in A1, engagement increased average r_noise in ML. This finding surprised us, because attentive states are commonly reported to decrease average r_noise We analyzed the effect of r_noise on AM coding in both A1 and ML and found that whereas engagement-related shifts in r_noise in A1 enhance AM coding, r_noise shifts in ML have little effect. These results imply that the effect of r_noise differs between sensory areas, based on the distribution of tuning properties among the neurons within each population. A possible explanation of this is that higher areas need to encode nonsensory variables (e.g., attention, choice, and motor preparation), which impart common noise, thus increasing r_noise Therefore, the hierarchical emergence of r_noise-robust population coding (e.g., as we observed in ML) enhances the ability of sensory cortex to integrate cognitive and sensory information without a loss of sensory fidelity.NEW & NOTEWORTHY Prevailing models of population coding of sensory information are based on a limited subset of neural structures. An important and under-explored question in neuroscience is how distinct areas of sensory cortex differ in their population coding strategies. In this study, we compared population coding between primary and secondary auditory cortex. Our findings demonstrate striking differences between the two areas and highlight the importance of considering the diversity of neural structures as we develop models of population coding.

Structures of Neural Correlation and How They Favor Coding

The neural representation of information suffers from "noise"-the trial-to-trial variability in the response of neurons. The impact of correlated noise upon population coding has been debated, but a direct connection between theory and experiment remains tenuous. Here, we substantiate this connection and propose a refined theoretical picture. Using simultaneous recordings from a population of direction-selective retinal ganglion cells, we demonstrate that coding benefits from noise correlations. The effect is appreciable already in small populations, yet it is a collective phenomenon. Furthermore, the stimulus-dependent structure of correlation is key. We develop simple functional models that capture the stimulus-dependent statistics. We then use them to quantify the performance of population coding, which depends upon interplays of feature sensitivities and noise correlations in the population. Because favorable structures of correlation emerge robustly in circuits with noisy, nonlinear elements, they will arise and benefit coding beyond the confines of retina.

Model-Free Estimation of Tuning Curves and Their Attentional Modulation, Based on Sparse and Noisy Data

Tuning curves are the functions that relate the responses of sensory neurons to various values within one continuous stimulus dimension (such as the orientation of a bar in the visual domain or the frequency of a tone in the auditory domain). They are commonly determined by fitting a model e.g. a Gaussian or other bell-shaped curves to the measured responses to a small subset of discrete stimuli in the relevant dimension. However, as neuronal responses are irregular and experimental measurements noisy, it is often difficult to determine reliably the appropriate model from the data. We illustrate this general problem by fitting diverse models to representative recordings from area MT in rhesus monkey visual cortex during multiple attentional tasks involving complex composite stimuli. We find that all models can be well-fitted, that the best model generally varies between neurons and that statistical comparisons between neuronal responses across different experimental conditions are affected quantitatively and qualitatively by specific model choices. As a robust alternative to an often arbitrary model selection, we introduce a model-free approach, in which features of interest are extracted directly from the measured response data without the need of fitting any model. In our attentional datasets, we demonstrate that data-driven methods provide descriptions of tuning curve features such as preferred stimulus direction or attentional gain modulations which are in agreement with fit-based approaches when a good fit exists. Furthermore, these methods naturally extend to the frequent cases of uncertain model selection. We show that model-free approaches can identify attentional modulation patterns, such as general alterations of the irregular shape of tuning curves, which cannot be captured by fitting stereotyped conventional models. Finally, by comparing datasets across different conditions, we demonstrate effects of attention that are cell- and even stimulus-specific. Based on these proofs-of-concept, we conclude that our data-driven methods can reliably extract relevant tuning information from neuronal recordings, including cells whose seemingly haphazard response curves defy conventional fitting approaches.

Neuronal variability in orbitofrontal cortex during economic decisions

Neuroeconomic models assume that economic decisions are based on the activity of offer value cells in the orbitofrontal cortex (OFC), but testing this assertion has proven difficult. In principle, the decision made on a given trial should correlate with the stochastic fluctuations of these cells. However, this correlation, measured as a choice probability (CP), is small. Importantly, a neuron's CP reflects not only its individual contribution to the decision (termed readout weight), but also the intensity and the structure of correlated variability across the neuronal population (termed noise correlation). A precise mathematical relation between CPs, noise correlations, and readout weights was recently derived by Haefner and colleagues (Haefner RM, Gerwinn S, Macke JH, Bethge M. Nat Neurosci 16: 235-242, 2013) for a linear decision model. In this framework, concurrent measurements of noise correlations and CPs can provide quantitative information on how a population of cells contributes to a decision. Here we examined neuronal variability in the OFC of rhesus monkeys during economic decisions. Noise correlations had similar structure but considerably lower strength compared with those typically measured in sensory areas during perceptual decisions. In contrast, variability in the activity of individual cells was high and comparable to that recorded in other cortical regions. Simulation analyses based on Haefner's equation showed that noise correlations measured in the OFC combined with a plausible readout of offer value cells reproduced the experimental measures of CPs. In other words, the results obtained for noise correlations and those obtained for CPs taken together support the hypothesis that economic decisions are primarily based on the activity of offer value cells.

High-fidelity coding with correlated neurons

Positive correlations in the activity of neurons are widely observed in the brain. Previous studies have shown these correlations to be detrimental to the fidelity of population codes, or at best marginally favorable compared to independent codes. Here, we show that positive correlations can enhance coding performance by astronomical factors. Specifically, the probability of discrimination error can be suppressed by many orders of magnitude. Likewise, the number of stimuli encoded—the capacity—can be enhanced more than tenfold. These effects do not necessitate unrealistic correlation values, and can occur for populations with a few tens of neurons. We further show that both effects benefit from heterogeneity commonly seen in population activity. Error suppression and capacity enhancement rest upon a pattern of correlation. Tuning of one or several effective parameters can yield a limit of perfect coding: the corresponding pattern of positive correlation leads to a ‘lock-in’ of response probabilities that eliminates variability in the subspace relevant for stimulus discrimination. We discuss the nature of this pattern and we suggest experimental tests to identify it.

Traditionally, sensory neuroscience has focused on correlating inputs from the physical world with the response of a single neuron. Two stimuli can be distinguished solely from the response of one neuron if one stimulus elicits a response and the other does not. But as soon as one departs from extremely simple stimuli, single-cell coding becomes less effective, because cells often respond weakly and unreliably. High fidelity coding then relies upon populations of cells, and correlation among those cells can greatly affect the neural code. While previous theoretical studies have demonstrated a potential coding advantage of correlation, they allowed only a marginal improvement in coding power. Here, we present a scenario in which a pattern of correlation among neurons in a population yields an improvement in coding performance by several orders of magnitude. By “improvement” we mean that a neural population is much better at both distinguishing stimuli and at encoding a large number of them. The scenario we propose does not invoke unrealistic values of correlation. What is more, it is even effective for small neural populations and in subtle cases in which single-cell coding fails utterly. These results demonstrate a previously unappreciated potential for correlated population coding.

Mutual information of local field potentials distinguishes area-V2 stripe compartments

PURPOSE

Determining how information is represented by populations of neurons in different cortical areas is critical to our understanding of the brain mechanisms of visual perception. Recently, information-theoretical approaches have been applied to the analysis of spike trains of multiple neurons. However, other neurophysiological signals, such as local field potentials (LFPs), offer a different source of information worthy of investigating in this way. In this study, we investigate how the modular organization of area V2 of macaque monkeys impacts the information represented in LFPs.

MATERIALS AND METHODS

LFPs were recorded from a 32-channel microelectrode array implanted in area V2 of an anesthetized macaque monkey. The electrode positions were recovered in histological tissue stained for cytochrome oxidase (CO) to reveal the modular organization of V2. Visual stimuli consisted of a variety of moving gratings that differed in orientation, direction, spatial frequency, and chromatic content.

RESULTS

LFPs were separated into different frequency bands for analysis of mutual information as a function of stimulus type and CO-stripe location. High-γ-band LFPs revealed the highest information content across the electrode array. The distributions of total mutual information as well as mutual information due to correlations varied greatly by CO stripe. This analysis indicates that local correlations within each CO stripe generally reduce mutual information, whereas correlations between stripes greatly increase mutual information.

CONCLUSION

The decomposition mutual information based on the power of different frequency bands of LFPs provides new insight into the impact of modular architecture on population coding in area V2. Unlike other cortical areas, such as V1, where mutual information based on LFP correlations is largely determined by cortical separation, mutual information in V2 is also fundamentally determined by the CO-stripe architecture.

Simultaneous selection by object-based attention in visual and frontal cortex

Models of visual attention hold that top-down signals from frontal cortex influence information processing in visual cortex. It is unknown whether situations exist in which visual cortex actively participates in attentional selection. To investigate this question, we simultaneously recorded neuronal activity in the frontal eye fields (FEF) and primary visual cortex (V1) during a curve-tracing task in which attention shifts are object-based. We found that accurate performance was associated with similar latencies of attentional selection in both areas and that the latency in both areas increased if the task was made more difficult. The amplitude of the attentional signals in V1 saturated early during a trial, whereas these selection signals kept increasing for a longer time in FEF, until the moment of an eye movement, as if FEF integrated attentional signals present in early visual cortex. In erroneous trials, we observed an interareal latency difference because FEF selected the wrong curve before V1 and imposed its erroneous decision onto visual cortex. The neuronal activity in visual and frontal cortices was correlated across trials, and this trial-to-trial coupling was strongest for the attended curve. These results imply that selective attention relies on reciprocal interactions within a large network of areas that includes V1 and FEF.

Subjective visual perception: from local processing to emergent phenomena of brain activity

The combination of electrophysiological recordings with ambiguous visual stimulation made possible the detection of neurons that represent the content of subjective visual perception and perceptual suppression in multiple cortical and subcortical brain regions. These neuronal populations, commonly referred to as the neural correlates of consciousness, are more likely to be found in the temporal and prefrontal cortices as well as the pulvinar, indicating that the content of perceptual awareness is represented with higher fidelity in higher-order association areas of the cortical and thalamic hierarchy, reflecting the outcome of competitive interactions between conflicting sensory information resolved in earlier stages. However, despite the significant insights into conscious perception gained through monitoring the activities of single neurons and small, local populations, the immense functional complexity of the brain arising from correlations in the activity of its constituent parts suggests that local, microscopic activity could only partially reveal the mechanisms involved in perceptual awareness. Rather, the dynamics of functional connectivity patterns on a mesoscopic and macroscopic level could be critical for conscious perception. Understanding these emergent spatio-temporal patterns could be informative not only for the stability of subjective perception but also for spontaneous perceptual transitions suggested to depend either on the dynamics of antagonistic ensembles or on global intrinsic activity fluctuations that may act upon explicit neural representations of sensory stimuli and induce perceptual reorganization. Here, we review the most recent results from local activity recordings and discuss the potential role of effective, correlated interactions during perceptual awareness.

Attention-induced variance and noise correlation reduction in macaque V1 is mediated by NMDA receptors

Attention improves perception by affecting different aspects of the neuronal code. It enhances firing rates, it reduces firing rate variability and noise correlations of neurons, and it alters the strength of oscillatory activity. Attention-induced rate enhancement in striate cortex requires cholinergic mechanisms. The neuropharmacological mechanisms responsible for attention-induced variance and noise correlation reduction or those supporting changes in oscillatory activity are unknown. We show that ionotropic glutamatergic receptor activation is required for attention-induced rate variance, noise correlation, and LFP gamma power reduction in macaque V1, but not for attention-induced rate modulations. NMDA receptors mediate attention-induced variance reduction and attention-induced noise correlation reduction. Our results demonstrate that attention improves sensory processing by a variety of mechanisms that are dissociable at the receptor level.

Luminance contrast has little influence on the spread of object-based attention

We direct our attention to those visual stimuli that are relevant to our behavioral goals. Some of the visual stimuli that surround us are represented more strongly, because they have a higher luminance contrast. However, selective attention also boosts the representation of visual stimuli. It is not yet well understood how attention and contrast interact. Some previous theories proposed that attentional effects are strongest at low contrast, others that they are strongest at high contrast and yet others that the effects of selective attention are largely independent of contrast. In the present study, we investigated the interaction between selective attention and luminance contrast with a contour-grouping task that provides a sensitive measure of the spread of object-based attention, with delays of several hundreds of milliseconds. We find that the spread of object-based attention is largely independent of contrast, and that subjects experience little difficulty in grouping low-contrast contour elements in the presence of other contour elements with a much higher contrast. The results imply that object-based attention and contrast have largely independent effects on visual processing.

Spatial and temporal scales of neuronal correlation in visual area V4

The spiking activity of nearby cortical neurons is correlated on both short and long time scales. Understanding this shared variability in firing patterns is critical for appreciating the representation of sensory stimuli in ensembles of neurons, the coincident influences of neurons on common targets, and the functional implications of microcircuitry. Our knowledge about neuronal correlations, however, derives largely from experiments that used different recording methods, analysis techniques, and cortical regions. Here we studied the structure of neuronal correlation in area V4 of alert macaques using recording and analysis procedures designed to match those used previously in primary visual cortex (V1), the major input to V4. We found that the spatial and temporal properties of correlations in V4 were remarkably similar to those of V1, with two notable differences: correlated variability in V4 was approximately one-third the magnitude of that in V1 and synchrony in V4 was less temporally precise than in V1. In both areas, spontaneous activity (measured during fixation while viewing a blank screen) was approximately twice as correlated as visual-evoked activity. The results provide a foundation for understanding how the structure of neuronal correlation differs among brain regions and stages in cortical processing and suggest that it is likely governed by features of neuronal circuits that are shared across the visual cortex.

A unified selection signal for attention and reward in primary visual cortex

Stimuli associated with high rewards evoke stronger neuronal activity than stimuli associated with lower rewards in many brain regions. It is not well understood how these reward effects influence activity in sensory cortices that represent low-level stimulus features. Here, we investigated the effects of reward information in the primary visual cortex (area V1) of monkeys. We found that the reward value of a stimulus relative to the value of other stimuli is a good predictor of V1 activity. Relative value biases the competition between stimuli, just as has been shown for selective attention. The neuronal latency of this reward value effect in V1 was similar to the latency of attentional influences. Moreover, V1 neurons with a strong value effect also exhibited a strong attention effect, which implies that relative value and top-down attention engage overlapping, if not identical, neuronal selection mechanisms. Our findings demonstrate that the effects of reward value reach down to the earliest sensory processing levels of the cerebral cortex and imply that theories about the effects of reward coding and top-down attention on visual representations should be unified.

Top-down influences on visual processing

Re-entrant or feedback pathways between cortical areas carry rich and varied information about behavioural context, including attention, expectation, perceptual tasks, working memory and motor commands. Neurons receiving such inputs effectively function as adaptive processors that are able to assume different functional states according to the task being executed. Recent data suggest that the selection of particular inputs, representing different components of an association field, enable neurons to take on different functional roles. In this Review, we discuss the various top-down influences exerted on the visual cortical pathways and highlight the dynamic nature of the receptive field, which allows neurons to carry information that is relevant to the current perceptual demands.

Top-down modulation of lateral interactions in visual cortex

The primary visual cortex (V1) changes its computation according to the perceptual task being performed. We propose that this cognitive modulation results from gating of V1 intrinsic connections. To test this idea, using behavioral paradigms that engage top-down modulation of V1 contextual interactions, we recorded from chronically implanted electrode arrays in macaques. We observed task-dependent changes in interactions between V1 sites measured both by correlation between spike trains and by coherence between local field potentials (LFP-LFP coherence). The direction of the changes in aggregate activity, as measured by LFPs, depended on perceptual strategy: perceptual grouping increased LFP coherence between sites crucial for the task, whereas perceptual segregation lowered the LFP coherence. Using spiking activity as a measure, we found that the behaviorally driven changes in correlation structure between neurons dramatically increased the stimulus-related information that they convey; this additional increase in encoded information at the level of neuronal ensembles equals that obtained from task-driven reconfigurations of neural tuning curves. The improvements in information encoding were strongest for stimuli with greatest discrimination difficulty.

Correlated discharges in the primate prefrontal cortex before and after working memory training

The correlation of discharges between single neurons can provide information about the computations and network properties of neuronal populations during the performance of cognitive tasks. In recent years, dynamic modulation of neuronal correlations by attention has been revealed during the execution of behavioral tasks. Much less is known about the influence of learning and performing a task itself. We therefore sought to quantify the correlated firing of simultaneously recorded pairs of neurons in the prefrontal cortex of naïve monkeys that were only required to fixate, and to examine how this correlation was altered after they had learned to perform a working memory task. We found that the trial-to-trial correlation of discharge rates between pairs of neurons (noise correlation) differed across neurons depending on their responsiveness and selectivity for stimuli, even before training in a working memory task. After monkeys had learned to perform the task, correlated firing decreased overall, although the effects varied according to the functional properties of the neurons. The greatest decreases were observed on comparison of populations of neurons that exhibited elevated firing rates during the trial events and those that had more similar spatial and temporal tuning. Greater decreases in noise correlation were also observed for pairs comprising one fast spiking neuron (putative interneuron) and one regular spiking neuron (putative pyramidal neuron) than pairs comprising regular spiking neurons only. Our results demonstrate that learning and performance of a cognitive task alters the correlation structure of neuronal firing in the prefrontal cortex.

Decorrelation of spiking variability and improved information transfer through feedforward divisive normalization

Response variability is often positively correlated in pairs of similarly tuned neurons in the visual cortex. Many authors have considered correlated variability to prevent postsynaptic neurons from averaging across large groups of inputs to obtain reliable stimulus estimates. However, a simple average of variability ignores nonlinearities in cortical signal integration. This study shows that feedforward divisive normalization of a neuron's inputs effectively decorrelates their variability. Furthermore, we show that optimal linear estimates of a stimulus parameter that are based on normalized inputs are more accurate than those based on nonnormalized inputs, due partly to reduced correlations, and that these estimates improve with increasing population size up to several thousand neurons. This suggests that neurons may possess a simple mechanism for substantially decorrelating noise in their inputs. Further work is needed to reconcile this conclusion with past evidence that correlated noise impairs visual perception.

Perceptual learning reduces interneuronal correlations in macaque visual cortex

Responses of neurons in early visual cortex change little with training and appear insufficient to account for perceptual learning. Behavioral performance, however, relies on population activity, and the accuracy of a population code is constrained by correlated noise among neurons. We tested whether training changes interneuronal correlations in the dorsal medial superior temporal area, which is involved in multisensory heading perception. Pairs of single units were recorded simultaneously in two groups of subjects: animals trained extensively in a heading discrimination task, and "naive" animals that performed a passive fixation task. Correlated noise was significantly weaker in trained versus naive animals, which might be expected to improve coding efficiency. However, we show that the observed uniform reduction in noise correlations leads to little change in population coding efficiency when all neurons are decoded. Thus, global changes in correlated noise among sensory neurons may be insufficient to account for perceptual learning.

Measuring and interpreting neuronal correlations

Mounting evidence suggests that understanding how the brain encodes information and performs computations will require studying the correlations between neurons. The recent advent of recording techniques such as multielectrode arrays and two-photon imaging has made it easier to measure correlations, opening the door for detailed exploration of their properties and contributions to cortical processing. However, studies have reported discrepant findings, providing a confusing picture. Here we briefly review these studies and conduct simulations to explore the influence of several experimental and physiological factors on correlation measurements. Differences in response strength, the time window over which spikes are counted, spike sorting conventions and internal states can all markedly affect measured correlations and systematically bias estimates. Given these complicating factors, we offer guidelines for interpreting correlation data and a discussion of how best to evaluate the effect of correlations on cortical processing.

Laminar differences in gamma and alpha coherence in the ventral stream

Attention to a stimulus enhances both neuronal responses and gamma frequency synchrony in visual area V4, both of which should increase the impact of attended information on downstream neurons. To determine whether gamma synchrony is common throughout the ventral stream, we recorded from neurons in the superficial and deep layers of V1, V2, and V4 in two rhesus monkeys. We found an unexpected striking difference in gamma synchrony in the superficial vs. deep layers. In all three areas, spike-field coherence in the gamma (40-60 Hz) frequency range was largely confined to the superficial layers, whereas the deep layers showed maximal coherence at low frequencies (6-16 Hz), which included the alpha range. In the superficial layers of V2 and V4, gamma synchrony was enhanced by attention, whereas in the deep layers, alpha synchrony was reduced by attention. Unlike these major differences in synchrony, attentional effects on firing rates and noise correlation did not differ substantially between the superficial and deep layers. The results suggest that synchrony plays very different roles in feedback and feedforward projections.

The effects of pooling on spike train correlations

Neurons integrate inputs from thousands of afferents. Similarly, some experimental techniques record the pooled activity of large populations of cells. When cells in these populations are correlated, the correlation coefficient between the collective activity of two subpopulations is typically much larger than the correlation coefficient between individual cells: The act of pooling individual cell signals amplifies correlations. We give an overview of this phenomenon and present several implications. In particular, we show that pooling leads to synchronization in feedforward networks and that it can amplify and otherwise distort correlations between recorded signals.

Neuronal activity in the visual cortex reveals the temporal order of cognitive operations

Most mental processes consist of a number of processing steps that are executed sequentially. The timing of the individual mental operations can usually only be estimated indirectly, from the pattern of reaction times. In vision, however, many processing steps are associated with the modulation of neuronal activity in early visual areas. Here we exploited this association to elucidate the time course of neuronal activity related to each of the self-paced mental processing steps in complex visual tasks. We trained monkeys to perform two tasks, search-trace and trace-search, which required performing a sequence of two operations: a visual search for a specific color and the mental tracing of a curve. We used multielectrode recording techniques to monitor the representations of multiple visual items in area V1 at the same time and found that the relevant curve as well as the target of visual search evoked enhanced neuronal activity with a timing that depended on the order of operations. This modulation of neuronal activity in early visual areas could allow these areas to (1) act as a cognitive blackboard that permits the exchange of information between successive processing steps of a sequential visual task and to (2) contribute to the orderly progression of task-dependent endogenous attention shifts that are driven by task structure and evolve over hundreds of milliseconds.

A neuronal population measure of attention predicts behavioral performance on individual trials

Visual attention improves perception for an attended location or feature and also modulates the responses of sensory neurons. In laboratory studies, the sensory stimuli and task instructions are held constant within an attentional condition, but despite experimenters' best efforts, attention likely varies from moment to moment. Because most previous studies have focused on single neurons, it has been impossible to use neuronal responses to identify attentional fluctuations and determine whether these are associated with changes in behavior. We show that an instantaneous measure of attention based on the responses of a modest number of neurons in area V4 of the rhesus monkey (Macaca mulatta) can reliably predict large changes in an animal's ability to perform a difficult psychophysical task. Unexpectedly, this measure shows that the amount of attention allocated at any moment to locations in opposite hemifields is uncorrelated, suggesting that animals allocate attention to each stimulus independently rather than moving their attentional focus from one location to another.

Separable codes for attention and luminance contrast in the primary visual cortex

The visual system encodes the features of visual stimuli as well as their behavioral relevance. Stimuli with a high luminance contrast evoke more activity in the visual cortex than stimuli with a low contrast. At the same time, attended stimuli evoke more activity than nonattended stimuli. There is a debate about how visual features and attention jointly determine neuronal activity in the visual cortex. Some studies suggested that attention increases apparent contrast (Reynolds et al., 2000), others that attention amplifies responses by a constant factor (Williford and Maunsell, 2006), and yet others that attention and contrast have largely additive effects (Buracas and Boynton, 2007; Thiele et al., 2009). The influence of attention on contrast sensitivity differs between neurons, raising the possibility that attention and contrast could be coded conjointly in a population of neurons. Here we investigate this possibility by recording neuronal activity at multiple sites in the primary visual cortex of macaque monkeys using multielectrode recording techniques and support vector machines to decode attended stimuli as well as stimulus contrast. We find that many, but not all, V1 neurons are influenced by attention and that the effects of attention and contrast are additive on average. Stimulus contrast can be decoded from neuronal responses not strongly modulated by attention, whereas the attended stimulus can be decoded as the difference in activity of cells that are influenced by attention and cells that are not. The success of the approach suggests that visual attention and stimulus contrast are represented by largely separable codes.

Generation of Spatiotemporally Correlated Spike Trains and Local Field Potentials Using a Multivariate Autoregressive Process

Experimental advances allowing for the simultaneous recording of activity at multiple sites have significantly increased our understanding of the spatiotemporal patterns in neural activity. The impact of such patterns on neural coding is a fundamental question in neuroscience. The simulation of spike trains with predetermined activity patterns is therefore an important ingredient in the study of potential neural codes. Such artificially generated spike trains could also be used to manipulate cortical neurons in vitro and in vivo. Here, we propose a method to generate spike trains with given mean firing rates and cross-correlations. To capture this statistical structure we generate a point process by thresholding a stochastic process that is continuous in space and discrete in time. This stochastic process is obtained by filtering Gaussian noise through a multivariate autoregressive (AR) model. The parameters of the AR model are obtained by a nonlinear transformation of the point-process correlations to the continuous-process correlations. The proposed method is very efficient and allows for the simulation of large neural populations. It can be optimized to the structure of spatiotemporal correlations and generalized to nonstationary processes and spatiotemporal patterns of local field potentials and spike trains.

Pooling and correlated neural activity

Correlations between spike trains can strongly modulate neuronal activity and affect the ability of neurons to encode information. Neurons integrate inputs from thousands of afferents. Similarly, a number of experimental techniques are designed to record pooled cell activity. We review and generalize a number of previous results that show how correlations between cells in a population can be amplified and distorted in signals that reflect their collective activity. The structure of the underlying neuronal response can significantly impact correlations between such pooled signals. Therefore care needs to be taken when interpreting pooled recordings, or modeling networks of cells that receive inputs from large presynaptic populations. We also show that the frequently observed runaway synchrony in feedforward chains is primarily due to the pooling of correlated inputs.

Attention improves performance primarily by reducing interneuronal correlations

Visual attention can dramatically improve behavioural performance by allowing observers to focus on the important information in a complex scene. Attention also typically increases the firing rates of cortical sensory neurons. Rate increases improve the signal-to-noise ratio of individual neurons, and this improvement has been assumed to underlie attention-related improvements in behaviour. We recorded dozens of neurons simultaneously in visual area V4 and found that changes in single neurons accounted for only a small fraction of the improvement in the sensitivity of the population. Instead, over 80% of the attentional improvement in the population signal was caused by decreases in the correlations between the trial-to-trial fluctuations in the responses of pairs of neurons. These results suggest that the representation of sensory information in populations of neurons and the way attention affects the sensitivity of the population may only be understood by considering the interactions between neurons.

Stimulus-dependent correlations and population codes

The magnitude of correlations between stimulus-driven responses of pairs of neurons can itself be stimulus dependent. We examine how this dependence affects the information carried by neural populations about the stimuli that drive them. Stimulus-dependent changes in correlations can both carry information directly and modulate the information separately carried by the firing rates and variances. We use Fisher information to quantify these effects and show that, although stimulus-dependent correlations often carry little information directly, their modulatory effects on the overall information can be large. In particular, if the stimulus dependence is such that correlations increase with stimulus-induced firing rates, this can significantly enhance the information of the population when the structure of correlations is determined solely by the stimulus. However, in the presence of additional strong spatial decay of correlations, such stimulus dependence may have a negative impact. Opposite relationships hold when correlations decrease with firing rates.