Attention Increases Spike Count Correlations between Visual Cortical Areas

Correlated variability and its attentional modulation depend on anatomical connectivity

Visual cortical neurons show variability in their responses to repeated presentations of a stimulus and a portion of this variability is shared across neurons. Attention may enhance visual perception by reducing shared spiking variability. However, shared variability and its attentional modulation are not consistent within or across cortical areas, and depend on additional factors such as neuronal type. A critical factor that has not been tested is actual anatomical connectivity. We measured spike count correlations among pairs of simultaneously recorded neurons in the primary visual cortex (V1) for which anatomical connectivity was inferred from spiking cross-correlations. Neurons were recorded in monkeys performing a contrast-change discrimination task requiring covert shifts in visual spatial attention. Accordingly, spike count correlations were compared across trials in which attention was directed toward or away from the visual stimulus overlapping recorded neuronal receptive fields. Consistent with prior findings, attention did not significantly alter spike count correlations among random pairings of unconnected V1 neurons. However, V1 neurons connected via excitatory synapses showed a significant reduction in spike count correlations with attention. Interestingly, V1 neurons connected via inhibitory synapses demonstrated high spike count correlations overall that were not modulated by attention. Correlated variability in excitatory circuits also depended upon neuronal tuning for contrast, the task-relevant stimulus feature. These results indicate that shared variability depends on the type of connectivity in neuronal circuits. Also, attention significantly reduces shared variability in excitatory circuits, even when attention effects on randomly sampled neurons within the same area are weak.

Circuit-motivated generalized affine models characterize stimulus-dependent visual cortical shared variability

Correlated variability in the visual cortex is modulated by stimulus properties. The stimulus dependence of correlated variability impacts stimulus coding and is indicative of circuit structure. An affine model combining a multiplicative factor and an additive offset has been proposed to explain how correlated variability in primary visual cortex (V1) depends on stimulus orientations. However, whether the affine model could be extended to explain modulations by other stimulus variables or variability shared between two brain areas is unknown. Motivated by a simple neural circuit mechanism, we modified the affine model to better explain the contrast dependence of neural variability shared within either primary or secondary visual cortex (V1 or V2) as well as the orientation dependence of neural variability shared between V1 and V2. Our results bridge neural circuit mechanisms and statistical models and provide a parsimonious explanation for the stimulus dependence of correlated variability within and between visual areas.

Distinct feedforward and feedback pathways for cell-type specific attention effects

Selective attention is thought to depend on enhanced firing activity in extrastriate areas. Theories suggest that this enhancement depends on selective inter-areal communication via gamma (30-80 Hz) phase-locking. To test this, we simultaneously recorded from different cell types and cortical layers of macaque V1 and V4. We find that while V1-V4 gamma phase-locking between local field potentials increases with attention, the V1 gamma rhythm does not engage V4 excitatory-neurons, but only fast-spiking interneurons in L4 of V4. By contrast, attention enhances V4 spike-rates in both excitatory and inhibitory cells, most strongly in L2/3. The rate increase in L2/3 of V4 precedes V1 in time. These findings suggest enhanced signal transmission with attention does not depend on inter-areal gamma phase-locking and show that the endogenous gamma rhythm has cell-type- and layer-specific effects on downstream target areas. Similar findings were made in the mouse visual system, based on opto-tagging of identified interneurons.

Brain-state mediated modulation of inter-laminar dependencies in visual cortex

Spatial attention is critical for recognizing behaviorally relevant objects in a cluttered environment. How the deployment of spatial attention aids the hierarchical computations of object recognition remains unclear. We investigated this in the laminar cortical network of visual area V4, an area strongly modulated by attention. We found that deployment of attention strengthened unique dependencies in neural activity across cortical layers. On the other hand, shared dependencies were reduced within the excitatory population of a layer. Surprisingly, attention strengthened unique dependencies within a laminar population. Crucially, these modulation patterns were also observed during successful behavioral outcomes that are thought to be mediated by internal brain state fluctuations. Successful behavioral outcomes were also associated with phases of reduced neural excitability, suggesting a mechanism for enhanced information transfer during optimal states. Our results suggest common computation goals of optimal sensory states that are attained by either task demands or internal fluctuations.

Multiple objects evoke fluctuating responses in several regions of the visual pathway

How neural representations preserve information about multiple stimuli is mysterious. Because tuning of individual neurons is coarse (e.g., visual receptive field diameters can exceed perceptual resolution), the populations of neurons potentially responsive to each individual stimulus can overlap, raising the question of how information about each item might be segregated and preserved in the population. We recently reported evidence for a potential solution to this problem: when two stimuli were present, some neurons in the macaque visual cortical areas V1 and V4 exhibited fluctuating firing patterns, as if they responded to only one individual stimulus at a time (Jun et al., 2022). However, whether such an information encoding strategy is ubiquitous in the visual pathway and thus could constitute a general phenomenon remains unknown. Here, we provide new evidence that such fluctuating activity is also evoked by multiple stimuli in visual areas responsible for processing visual motion (middle temporal visual area, MT), and faces (middle fundus and anterolateral face patches in inferotemporal cortex - areas MF and AL), thus extending the scope of circumstances in which fluctuating activity is observed. Furthermore, consistent with our previous results in the early visual area V1, MT exhibits fluctuations between the representations of two stimuli when these form distinguishable objects but not when they fuse into one perceived object, suggesting that fluctuating activity patterns may underlie visual object formation. Taken together, these findings point toward an updated model of how the brain preserves sensory information about multiple stimuli for subsequent processing and behavioral action.

Activity-dependent recruitment of inhibition and excitation in the awake mammalian cortex during electrical stimulation

Electrical stimulation is an effective tool for mapping and altering brain connectivity, with applications ranging from treating pharmacology-resistant neurological disorders to providing sensory feedback for neural prostheses. Paramount to the success of these applications is the ability to manipulate electrical currents to precisely control evoked neural activity patterns. However, little is known about stimulation-evoked responses in inhibitory neurons nor how stimulation-evoked activity patterns depend on ongoing neural activity. In this study, we used 2-photon imaging and cell-type specific labeling to measure single-cell responses of excitatory and inhibitory neurons to electrical stimuli in the visual cortex of awake mice. Our data revealed strong interactions between electrical stimulation and pre-stimulus activity of single neurons in awake animals and distinct recruitment and response patterns for excitatory and inhibitory neurons. This work demonstrates the importance of cell-type-specific labeling of neurons in future studies.

Brain-state mediated modulation of inter-laminar dependencies in visual cortex

Spatial attention is a quintessential example of adaptive information processing in the brain and is critical for recognizing behaviorally relevant objects in a cluttered environment. Object recognition is mediated by neural encoding along the ventral visual hierarchy. How the deployment of spatial attention aids these hierarchical computations is unclear. Prior studies point to two distinct mechanisms: an improvement in the efficacy of information directed from one encoding stage to another, and/or a suppression of shared information within encoding stages. To test these proposals, it is crucial to estimate the attentional modulation of unique information flow across and shared information within the encoding stages of the visual hierarchy. We investigated this in the multi-stage laminar network of visual area V4, an area strongly modulated by attention. Using network-based dependency estimation from multivariate data, we quantified the modulation of inter-layer information flow during a change detection task and found that deployment of attention indeed strengthened unique dependencies between the input and superficial layers. Using the partial information decomposition framework, we estimated the modulation of shared dependencies and found that they are reduced specifically in the putative excitatory subpopulations within a layer. Surprisingly, we found a strengthening of unique dependencies within the laminar populations, a finding not previously predicted. Crucially, these modulation patterns were also observed during successful behavioral outcomes (hits) that are thought to be mediated by endogenous brain state fluctuations, and not by experimentally imposed attentive states. Finally, phases of endogenous fluctuations that were optimal for 'hits' were associated with reduced neural excitability. A reduction in neural excitability, potentially mediated by diminished shared inputs, suggests a novel mechanism for enhancing unique information transmission during optimal states. By decomposing the modulation of multivariate information, and combined with prior theoretical work, our results suggest common computations of optimal sensory states that are attained by either task demands or endogenous fluctuations.

Silences, spikes and bursts: Three-part knot of the neural code

When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.

Targeted V1 comodulation supports task-adaptive sensory decisions

Sensory-guided behavior requires reliable encoding of stimulus information in neural populations, and flexible, task-specific readout. The former has been studied extensively, but the latter remains poorly understood. We introduce a theory for adaptive sensory processing based on functionally-targeted stochastic modulation. We show that responses of neurons in area V1 of monkeys performing a visual discrimination task exhibit low-dimensional, rapidly fluctuating gain modulation, which is stronger in task-informative neurons and can be used to decode from neural activity after few training trials, consistent with observed behavior. In a simulated hierarchical neural network model, such labels are learned quickly and can be used to adapt downstream readout, even after several intervening processing stages. Consistently, we find the modulatory signal estimated in V1 is also present in the activity of simultaneously recorded MT units, and is again strongest in task-informative neurons. These results support the idea that co-modulation facilitates task-adaptive hierarchical information routing.

Different roles of response covariability and its attentional modulation in the sensory cortex and posterior parietal cortex

The covariability of neural responses in the neuron population is highly relevant to the information encoding. Cognitive processes, such as attention, are found to modulate the covariability in the visual cortex to improve information encoding, suggesting the computational advantage of covariability modulation in the neural system. However, is the covariability modulation a general mechanism for enhanced information encoding throughout the information processing pathway, or only adopted in certain processing stages, depending on the property of neural representation? Here, with ultrahigh-field MRI, we examined the covariability, which was estimated by noise correlation, in different attention states in the early visual cortex and posterior parietal cortex (PPC) of the human brain, and its relationship to the quality of information encoding. Our results showed that while attention decreased the covariability to improve the stimulus encoding in the early visual cortex, covariability modulation was not observed in the PPC, where covariability had little impact on information encoding. Further, attention promoted the information flow between the early visual cortex and PPC, with an apparent emphasis on a flow from high- to low-dimensional representations, suggesting the existence of a reduction in the dimensionality of neural representation from the early visual cortex to PPC. Finally, the neural response patterns in the PPC could predict the amplitudes of covariability change in the early visual cortex, indicating a top-down control from the PPC to early visual cortex. Our findings reveal the specific roles of the sensory cortex and PPC during attentional modulation of covariability, determined by the complexity and fidelity of the neural representation in each cortical region.

Multiple objects evoke fluctuating responses in several regions of the visual pathway

How neural representations preserve information about multiple stimuli is mysterious. Because tuning of individual neurons is coarse (for example, visual receptive field diameters can exceed perceptual resolution), the populations of neurons potentially responsive to each individual stimulus can overlap, raising the question of how information about each item might be segregated and preserved in the population. We recently reported evidence for a potential solution to this problem: when two stimuli were present, some neurons in the macaque visual cortical areas V1 and V4 exhibited fluctuating firing patterns, as if they responded to only one individual stimulus at a time. However, whether such an information encoding strategy is ubiquitous in the visual pathway and thus could constitute a general phenomenon remains unknown. Here we provide new evidence that such fluctuating activity is also evoked by multiple stimuli in visual areas responsible for processing visual motion (middle temporal visual area, MT), and faces (middle fundus and anterolateral face patches in inferotemporal cortex - areas MF and AL), thus extending the scope of circumstances in which fluctuating activity is observed. Furthermore, consistent with our previous results in the early visual area V1, MT exhibits fluctuations between the representations of two stimuli when these form distinguishable objects but not when they fuse into one perceived object, suggesting that fluctuating activity patterns may underlie visual object formation. Taken together, these findings point toward an updated model of how the brain preserves sensory information about multiple stimuli for subsequent processing and behavioral action.

Impact Statement

We find neural fluctuations in multiple areas along the visual cortical hierarchy that could allow the brain to represent distinct co-occurring visual stimuli.

Resolving Non-identifiability Mitigates Bias in Models of Neural Tuning and Functional Coupling

In the brain, all neurons are driven by the activity of other neurons, some of which maybe simultaneously recorded, but most are not. As such, models of neuronal activity need to account for simultaneously recorded neurons and the influences of unmeasured neurons. This can be done through inclusion of model terms for observed external variables (e.g., tuning to stimuli) as well as terms for latent sources of variability. Determining the influence of groups of neurons on each other relative to other influences is important to understand brain functioning. The parameters of statistical models fit to data are commonly used to gain insight into the relative importance of those influences. Scientific interpretation of models hinge upon unbiased parameter estimates. However, evaluation of biased inference is rarely performed and sources of bias are poorly understood. Through extensive numerical study and analytic calculation, we show that common inference procedures and models are typically biased. We demonstrate that accurate parameter selection before estimation resolves model non-identifiability and mitigates bias. In diverse neurophysiology data sets, we found that contributions of coupling to other neurons are often overestimated while tuning to exogenous variables are underestimated in common methods. We explain heterogeneity in observed biases across data sets in terms of data statistics. Finally, counter to common intuition, we found that model non-identifiability contributes to bias, not variance, making it a particularly insidious form of statistical error. Together, our results identify the causes of statistical biases in common models of neural data, provide inference procedures to mitigate that bias, and reveal and explain the impact of those biases in diverse neural data sets.

Spatial Attention Modulates Neuronal Interactions between Simple and Complex Cells in V1

Visual perception is profoundly modulated by spatial attention, which can selectively prioritize goal-related information. Previous studies found spatial attention facilitated the efficacy of neuronal communication between visual cortices with hierarchical organizations. In the primary visual cortex (V1), there is also a hierarchical connection between simple (S) and complex (C) cells. We wonder whether and how spatial attention modulates neuronal communication within V1, especially for neuronal pairs with heterogeneous visual input. We simultaneously recorded the pairs' activity from macaque monkeys when they performed a spatial-attention-involved task, then applied likelihood-based Granger causality analysis to explore attentional modulation of neuronal interactions. First, a significant attention-related decrease in Granger causality was found in S-C pairs, which primarily displayed in the S-to-C feedforward connection. Second, the interaction strength of the feedforward connection was significantly higher than that of the feedback under attend toward (AT) conditions. Although information flow did not alter as the attentional focus shifted, the strength of communications between target- and distractor-stimuli-covered neurons differed only when attending to complex cells' receptive fields (RFs). Furthermore, pairs' communications depended on the attentional modulation of neurons' firing rates. Our findings demonstrate spatial attention does not induce specific information flow but rather amplifies directed communication within V1.

Size tuning of neural response variability in laminar circuits of macaque primary visual cortex

A defining feature of the cortex is its laminar organization, which is likely critical for cortical information processing. For example, visual stimuli of different size evoke distinct patterns of laminar activity. Visual information processing is also influenced by the response variability of individual neurons and the degree to which this variability is correlated among neurons. To elucidate laminar processing, we studied how neural response variability across the layers of macaque primary visual cortex is modulated by visual stimulus size. Our laminar recordings revealed that single neuron response variability and the shared variability among neurons are tuned for stimulus size, and this size-tuning is layer-dependent. In all layers, stimulation of the receptive field (RF) reduced single neuron variability, and the shared variability among neurons, relative to their pre-stimulus values. As the stimulus was enlarged beyond the RF, both single neuron and shared variability increased in supragranular layers, but either did not change or decreased in other layers. Surprisingly, we also found that small visual stimuli could increase variability relative to baseline values. Our results suggest multiple circuits and mechanisms as the source of variability in different layers and call for the development of new models of neural response variability.

Spatial and temporal correlations in neural networks with structured connectivity

Correlated fluctuations in the activity of neural populations reflect the network's dynamics and connectivity. The temporal and spatial dimensions of neural correlations are interdependent. However, prior theoretical work mainly analyzed correlations in either spatial or temporal domains, oblivious to their interplay. We show that the network dynamics and connectivity jointly define the spatiotemporal profile of neural correlations. We derive analytical expressions for pairwise correlations in networks of binary units with spatially arranged connectivity in one and two dimensions. We find that spatial interactions among units generate multiple timescales in auto- and cross-correlations. Each timescale is associated with fluctuations at a particular spatial frequency, making a hierarchical contribution to the correlations. External inputs can modulate the correlation timescales when spatial interactions are nonlinear, and the modulation effect depends on the operating regime of network dynamics. These theoretical results open new ways to relate connectivity and dynamics in cortical networks via measurements of spatiotemporal neural correlations.

Coordinated multiplexing of information about separate objects in visual cortex

Sensory receptive fields are large enough that they can contain more than one perceptible stimulus. How, then, can the brain encode information about each of the stimuli that may be present at a given moment? We recently showed that when more than one stimulus is present, single neurons can fluctuate between coding one vs. the other(s) across some time period, suggesting a form of neural multiplexing of different stimuli (Caruso et al., 2018). Here, we investigate (a) whether such coding fluctuations occur in early visual cortical areas; (b) how coding fluctuations are coordinated across the neural population; and (c) how coordinated coding fluctuations depend on the parsing of stimuli into separate vs. fused objects. We found coding fluctuations do occur in macaque V1 but only when the two stimuli form separate objects. Such separate objects evoked a novel pattern of V1 spike count ('noise') correlations involving distinct distributions of positive and negative values. This bimodal correlation pattern was most pronounced among pairs of neurons showing the strongest evidence for coding fluctuations or multiplexing. Whether a given pair of neurons exhibited positive or negative correlations depended on whether the two neurons both responded better to the same object or had different object preferences. Distinct distributions of spike count correlations based on stimulus preferences were also seen in V4 for separate objects but not when two stimuli fused to form one object. These findings suggest multiple objects evoke different response dynamics than those evoked by single stimuli, lending support to the multiplexing hypothesis and suggesting a means by which information about multiple objects can be preserved despite the apparent coarseness of sensory coding.

The locus coeruleus mediates behavioral flexibility

Behavioral flexibility is the ability to adjust behavioral strategies in response to changing environmental contingencies. A major hypothesis in the field posits that the activity of neurons in the locus coeruleus (LC) plays an important role in mediating behavioral flexibility. To test this hypothesis, we developed a tactile-based rule-shift detection task in which mice responded to left and right whisker deflections in a context-dependent manner and exhibited varying degrees of switching behavior. Recording spiking activity from optogenetically tagged neurons in the LC at millisecond precision during task performance revealed a prominent graded correlation between baseline LC activity and behavioral flexibility, where higher baseline activity following a rule change was associated with faster behavioral switching to the new rule. Increasing baseline LC activity with optogenetic activation accelerated task switching and improved task performance. Overall, our study provides important evidence to reveal the link between LC activity and behavioral flexibility.

Spatial Attention Modulates Spike Count Correlations and Granger Causality in the Primary Visual Cortex

The influence of spatial attention on neural interactions has been revealed even in early visual information processing stages. It resolves the process of competing for sensory information about objects perceived as targets and distractors. However, the attentional modulation of the interaction between pairs of neurons with non-overlapping receptive fields (RFs) is not well known. Here, we investigated the activity of anatomically distant neurons in two behaving monkeys’ primary visual cortex (V1), when they performed a spatial attention task detecting color change. We compared attentional modulation from the perspective of spike count correlations and Granger causality among simple and complex cells. An attention-related increase in spike count correlations and a decrease in Granger causality were found. The results showed that spatial attention significantly influenced only the interactions between rather than within simple and complex cells. Furthermore, we found that the attentional modulation of neuronal interactions changed with neuronal pairs’ preferred directions differences. Thus, we found that spatial attention increased the functional communications and competing connectivities when attending to the neurons’ RFs, which impacts the interactions only between simple and complex cells. Our findings enrich the model of simple and complex cells and further understand the way that attention influences the neurons’ activities.

State-dependent effects of neural stimulation on brain function and cognition

Invasive and non-invasive brain stimulation methods are widely used in neuroscience to establish causal relationships between distinct brain regions and the sensory, cognitive and motor functions they subserve. When combined with concurrent brain imaging, such stimulation methods can reveal patterns of neuronal activity responsible for regulating simple and complex behaviours at the level of local circuits and across widespread networks. Understanding how fluctuations in physiological states and task demands might influence the effects of brain stimulation on neural activity and behaviour is at the heart of how we use these tools to understand cognition. Here we review the concept of such 'state-dependent' changes in brain activity in response to neural stimulation, and consider examples from research on altered states of consciousness (for example, sleep and anaesthesia) and from task-based manipulations of selective attention and working memory. We relate relevant findings from non-invasive methods used in humans to those obtained from direct electrical and optogenetic stimulation of neuronal ensembles in animal models. Given the widespread use of brain stimulation as a research tool in the laboratory and as a means of augmenting or restoring brain function, consideration of the influence of changing physiological and cognitive states is crucial for increasing the reliability of these interventions.

Emergent reliability in sensory cortical coding and inter-area communication

Reliable sensory discrimination must arise from high-fidelity neural representations and communication between brain areas. However, how neocortical sensory processing overcomes the substantial variability of neuronal sensory responses remains undetermined1-6. Here we imaged neuronal activity in eight neocortical areas concurrently and over five days in mice performing a visual discrimination task, yielding longitudinal recordings of more than 21,000 neurons. Analyses revealed a sequence of events across the neocortex starting from a resting state, to early stages of perception, and through the formation of a task response. At rest, the neocortex had one pattern of functional connections, identified through sets of areas that shared activity cofluctuations7,8. Within about 200 ms after the onset of the sensory stimulus, such connections rearranged, with different areas sharing cofluctuations and task-related information. During this short-lived state (approximately 300 ms duration), both inter-area sensory data transmission and the redundancy of sensory encoding peaked, reflecting a transient increase in correlated fluctuations among task-related neurons. By around 0.5 s after stimulus onset, the visual representation reached a more stable form, the structure of which was robust to the prominent, day-to-day variations in the responses of individual cells. About 1 s into stimulus presentation, a global fluctuation mode conveyed the upcoming response of the mouse to every area examined and was orthogonal to modes carrying sensory data. Overall, the neocortex supports sensory performance through brief elevations in sensory coding redundancy near the start of perception, neural population codes that are robust to cellular variability, and widespread inter-area fluctuation modes that transmit sensory data and task responses in non-interfering channels.

Estimating null and potent modes of feedforward communication in a computational model of cortical activity

Communication across anatomical areas of the brain is key to both sensory and motor processes. Dimensionality reduction approaches have shown that the covariation of activity across cortical areas follows well-delimited patterns. Some of these patterns fall within the "potent space" of neural interactions and generate downstream responses; other patterns fall within the "null space" and prevent the feedforward propagation of synaptic inputs. Despite growing evidence for the role of null space activity in visual processing as well as preparatory motor control, a mechanistic understanding of its neural origins is lacking. Here, we developed a mean-rate model that allowed for the systematic control of feedforward propagation by potent and null modes of interaction. In this model, altering the number of null modes led to no systematic changes in firing rates, pairwise correlations, or mean synaptic strengths across areas, making it difficult to characterize feedforward communication with common measures of functional connectivity. A novel measure termed the null ratio captured the proportion of null modes relayed from one area to another. Applied to simultaneous recordings of primate cortical areas V1 and V2 during image viewing, the null ratio revealed that feedforward interactions have a broad null space that may reflect properties of visual stimuli.

Cortical state dynamics and selective attention define the spatial pattern of correlated variability in neocortex

Correlated activity fluctuations in the neocortex influence sensory responses and behavior. Neural correlations reflect anatomical connectivity but also change dynamically with cognitive states such as attention. Yet, the network mechanisms defining the population structure of correlations remain unknown. We measured correlations within columns in the visual cortex. We show that the magnitude of correlations, their attentional modulation, and dependence on lateral distance are explained by columnar On-Off dynamics, which are synchronous activity fluctuations reflecting cortical state. We developed a network model in which the On-Off dynamics propagate across nearby columns generating spatial correlations with the extent controlled by attentional inputs. This mechanism, unlike previous proposals, predicts spatially non-uniform changes in correlations during attention. We confirm this prediction in our columnar recordings by showing that in superficial layers the largest changes in correlations occur at intermediate lateral distances. Our results reveal how spatially structured patterns of correlated variability emerge through interactions of cortical state dynamics, anatomical connectivity, and attention.

Attention improves information flow between neuronal populations without changing the communication subspace

Visual attention allows observers to change the influence of different parts of a visual scene on their behavior, suggesting that information can be flexibly shared between visual cortex and neurons involved in decision making. We investigated the neural substrate of flexible information routing by analyzing the activity of populations of visual neurons in the medial temporal area (MT) and oculo-motor neurons in the superior colliculus (SC) while rhesus monkeys switched spatial attention. We demonstrated that attention increases the efficacy of visuomotor communication: trial-to-trial variability in SC population activity could be better predicted by the activity of the MT population (and vice versa) when attention was directed toward their joint receptive fields. Surprisingly, this improvement in prediction was not explained by changes in the dimensionality of the shared subspace or in the magnitude of local or shared pairwise noise correlations. These results lay a foundation for future theoretical and experimental studies into how visual attention can flexibly change information flow between sensory and decision neurons.

Modulation of Spike Count Correlations Between Macaque Primary Visual Cortex Neurons by Difficulty of Attentional Task

Studies have shown that spatial attention remarkably affects the trial-to-trial response variability shared between neurons. Difficulty in the attentional task adjusts how much concentration we maintain on what is currently important and what is filtered as irrelevant sensory information. However, how task difficulty mediates the interactions between neurons with separated receptive fields (RFs) that are attended to or attended away is still not clear. We examined spike count correlations between single-unit activities recorded simultaneously in the primary visual cortex (V1) while monkeys performed a spatial attention task with two levels of difficulty. Moreover, the RFs of the two neurons recorded were non-overlapping to allow us to study fluctuations in the correlated responses between competing visual inputs when the focus of attention was allocated to the RF of one neuron. While increasing difficulty in the spatial attention task, spike count correlations were either decreased to become negative between neuronal pairs, implying competition among them, with one neuron (or none) exhibiting attentional enhancement of firing rate, or increased to become positive, suggesting inter-neuronal cooperation, with one of the pair showing attentional suppression of spiking responses. Besides, the modulation of spike count correlations by task difficulty was independent of the attended locations. These findings provide evidence that task difficulty affects the functional interactions between different neuronal pools in V1 when selective attention resolves the spatial competition.

Neurophysiological considerations for visual implants

Neural implants have the potential to restore visual capabilities in blind individuals by electrically stimulating the neurons of the visual system. This stimulation can produce visual percepts known as phosphenes. The ideal location of electrical stimulation for achieving vision restoration is widely debated and dependent on the physiological properties of the targeted tissue. Here, the neurophysiology of several potential target structures within the visual system will be explored regarding their benefits and downfalls in producing phosphenes. These regions will include the lateral geniculate nucleus, primary visual cortex, visual area 2, visual area 3, visual area 4 and the middle temporal area. Based on the existing engineering limitations of neural prostheses, we anticipate that electrical stimulation of any singular brain region will be incapable of achieving high-resolution naturalistic perception including color, texture, shape and motion. As improvements in visual acuity facilitate improvements in quality of life, emulating naturalistic vision should be one of the ultimate goals of visual prostheses. To achieve this goal, we propose that multiple brain areas will need to be targeted in unison enabling different aspects of vision to be recreated.

Bridging neuronal correlations and dimensionality reduction

Two commonly used approaches to study interactions among neurons are spike count correlation, which describes pairs of neurons, and dimensionality reduction, applied to a population of neurons. Although both approaches have been used to study trial-to-trial neuronal variability correlated among neurons, they are often used in isolation and have not been directly related. We first established concrete mathematical and empirical relationships between pairwise correlation and metrics of population-wide covariability based on dimensionality reduction. Applying these insights to macaque V4 population recordings, we found that the previously reported decrease in mean pairwise correlation associated with attention stemmed from three distinct changes in population-wide covariability. Overall, our work builds the intuition and formalism to bridge between pairwise correlation and population-wide covariability and presents a cautionary tale about the inferences one can make about population activity by using a single statistic, whether it be mean pairwise correlation or dimensionality.

Enhancing visual motion discrimination by desynchronizing bifocal oscillatory activity

Visual motion discrimination involves reciprocal interactions in the alpha band between the primary visual cortex (V1) and mediotemporal areas (V5/MT). We investigated whether modulating alpha phase synchronization using individualized multisite transcranial alternating current stimulation (tACS) over V5 and V1 regions would improve motion discrimination. We tested 3 groups of healthy subjects with the following conditions: (1) individualized In-Phase V1_alpha-V5_alpha tACS (0° lag), (2) individualized Anti-Phase V1_alpha-V5_alpha tACS (180° lag) and (3) sham tACS. Motion discrimination and EEG activity were recorded before, during and after tACS. Performance significantly improved in the Anti-Phase group compared to the In-Phase group 10 and 30 min after stimulation. This result was explained by decreases in bottom-up alpha-V1 gamma-V5 phase-amplitude coupling. One possible explanation of these results is that Anti-Phase V1_alpha-V5_alpha tACS might impose an optimal phase lag between stimulation sites due to the inherent speed of wave propagation, hereby supporting optimized neuronal communication.

Working memory gates visual input to primate prefrontal neurons

Visually guided behavior relies on the integration of sensory input and information held in working memory (WM). Yet it remains unclear how this is accomplished at the level of neural circuits. We studied the direct visual cortical inputs to neurons within a visuomotor area of prefrontal cortex in behaving monkeys. We show that the efficacy of visual input to prefrontal cortex is gated by information held in WM. Surprisingly, visual input to prefrontal neurons was found to target those with both visual and motor properties, rather than preferentially targeting other visual neurons. Furthermore, activity evoked from visual cortex was larger in magnitude, more synchronous, and more rapid, when monkeys remembered locations that matched the location of visual input. These results indicate that WM directly influences the circuitry that transforms visual input into visually guided behavior.

Top-down coordination of local cortical state during selective attention

Spontaneous fluctuations in cortical excitability influence sensory processing and behavior. These fluctuations, long thought to reflect global changes in cortical state, were recently found to be modulated locally within a retinotopic map during spatially selective attention. We report that periods of vigorous (On) and faint (Off) spiking activity, the signature of cortical state fluctuations, are coordinated across brain areas with retinotopic precision. Top-down attention enhanced interareal local state coordination, traversing along the reverse cortical hierarchy. The extent of local state coordination between areas was predictive of behavioral performance. Our results show that cortical state dynamics are shared across brain regions, modulated by cognitive demands and relevant for behavior.

Electric Stimulation Elicits Heterogeneous Responses in ON but Not OFF Retinal Ganglion Cells to Transmit Rich Neural Information

Retinal implants electrically stimulate surviving retinal neurons to restore vision in people blinded by outer retinal degeneration. Although the healthy retina is known to transmit a vast amount of visual information to the brain, it has not been studied whether prosthetic vision contains a similar amount of information. Here, we assessed the neural information transmitted by population responses arising in brisk transient (BT) and brisk sustained (BS) subtypes of ON and OFF retinal ganglion cells (RGCs) in the rabbit retina. To correlate the response heterogeneity and the information transmission, we first quantified the cell-to-cell heterogeneity by calculating the spike time tiling coefficient (STTC) across spiking patterns of RGCs in each type. Then, we computed the neural information encoded by the RGC population in a given type. In responses to light stimulation, spiking activities were more heterogeneous in OFF than ON RGCs (STTC_AVG = 0.36, 0.45, 0.77 and 0.55 for OFF BT, OFF BS, ON BT, and ON BS, respectively). Interestingly, however, in responses to electric stimulation, both BT and BS subtypes of OFF RGCs showed remarkably homogeneous spiking patterns across cells (STTC_AVG = 0.93 and 0.82 for BT and BS, respectively), whereas the two subtypes of ON RGCs showed slightly increased populational heterogeneity compared to light-evoked responses (STTC_AVG = 0.71 and 0.63 for BT and BS, respectively). Consequently, the neural information encoded by the electrically-evoked responses of a population of 15 RGCs was substantially lower in the OFF than the ON pathway: OFF BT and BS cells transmit only ~23% and ~53% of the neural information transmitted by their ON counterparts. Together with previously-reported natural spiking activities in ON RGCs, the higher neural information may make ON responses more recognizable, eliciting the biased percepts of bright phosphenes.

Statistical methods for dissecting interactions between brain areas

The brain is composed of many functionally distinct areas. This organization supports distributed processing, and requires the coordination of signals across areas. Our understanding of how populations of neurons in different areas interact with each other is still in its infancy. As the availability of recordings from large populations of neurons across multiple brain areas increases, so does the need for statistical methods that are well suited for dissecting and interrogating these recordings. Here we review multivariate statistical methods that have been, or could be, applied to this class of recordings. By leveraging population responses, these methods can provide a rich description of inter-areal interactions. At the same time, these methods can introduce interpretational challenges. We thus conclude by discussing how to interpret the outputs of these methods to further our understanding of inter-areal interactions.

Slow Drift of Neural Activity as a Signature of Impulsivity in Macaque Visual and Prefrontal Cortex

An animal's decision depends not only on incoming sensory evidence but also on its fluctuating internal state. This state embodies multiple cognitive factors, such as arousal and fatigue, but it is unclear how these factors influence the neural processes that encode sensory stimuli and form a decision. We discovered that, unprompted by task conditions, animals slowly shifted their likelihood of detecting stimulus changes over the timescale of tens of minutes. Neural population activity from visual area V4, as well as from prefrontal cortex, slowly drifted together with these behavioral fluctuations. We found that this slow drift, rather than altering the encoding of the sensory stimulus, acted as an impulsivity signal, overriding sensory evidence to dictate the final decision. Overall, this work uncovers an internal state embedded in population activity across multiple brain areas and sheds further light on how internal states contribute to the decision-making process.

Principles of Corticocortical Communication: Proposed Schemes and Design Considerations

Nearly all brain functions involve routing neural activity among a distributed network of areas. Understanding this routing requires more than a description of interareal anatomical connectivity: it requires understanding what controls the flow of signals through interareal circuitry and how this communication might be modulated to allow flexible behavior. Here we review proposals of how communication, particularly between visual cortical areas, is instantiated and modulated, highlighting recent work that offers new perspectives. We suggest transitioning from a focus on assessing changes in the strength of interareal interactions, as often seen in studies of interareal communication, to a broader consideration of how different signaling schemes might contribute to computation. To this end, we discuss a set of features that might be desirable for a communication scheme.

Coding Perceptual Decisions: From Single Units to Emergent Signaling Properties in Cortical Circuits

Spiking activity in single neurons of the primate visual cortex has been tightly linked to perceptual decisions. Any mechanism that reads out these perceptual signals to support behavior must respect the underlying neuroanatomy that shapes the functional properties of sensory neurons. Spatial distribution and timing of inputs to the next processing levels are critical, as conjoint activity of precursor neurons increases the spiking rate of downstream neurons and ultimately drives behavior. I set out how correlated activity might coalesce into a micropool of task-sensitive neurons signaling a particular percept to determine perceptual decision signals locally and for flexible interarea transmission depending on the task context. As data from more and more neurons and their complex interactions are analyzed, the space of computational mechanisms must be constrained based on what is plausible within neurobiological limits. This review outlines experiments to test the new perspectives offered by these extended methods.

Shaping the Cortical Landscape: Functions and Mechanisms of Top-Down Cortical Feedback Pathways

Cortical feedback pathways are proposed to guide cognition and behavior according to context and goal-direction. At the cellular level, cortical feedback pathways target multiple excitatory and inhibitory populations. However, we currently lack frameworks that link how the cellular mechanisms of cortical feedback pathways underlie their cognitive/behavioral functions. To establish this link, we expand on the framework of signal routing, the ability of cortical feedback pathways to proactively modulate how feedforward signals are propagated throughout the cortex. We propose that cortical feedback modulates routing through multiple mechanisms: preparing intended motor representations, setting the trigger conditions for evoking cortical outputs, altering coupling strengths between cortical regions, and suppressing expected sensory representations. In developing this framework, we first define the anatomy of cortical feedback pathways and identify recent advances in studying their functions at high specificity and resolution. Second, we review the diverse functions of cortical feedback pathways throughout the cortical hierarchy and evaluate these functions from the framework of signal routing. Third, we review the conserved cellular targets and circuit impacts of cortical feedback. Fourth, we introduce the concept of the “cortical landscape,” a graphical depiction of the routes through cortex that are favored at a specific moment in time. We propose that the cortical landscape, analogous to energy landscapes in physics and chemistry, can capture important features of signal routing including coupling strength, trigger conditions, and preparatory states. By resolving the cortical landscape, we may be able to quantify how the cellular processes of cortical feedback ultimately shape cognition and behavior.

The asynchronous state's relation to large-scale potentials in cortex

Understanding the relation between large-scale potentials (M/EEG) and their underlying neural activity can improve the precision of research and clinical diagnosis. Recent insights into cortical dynamics highlighted a state of strongly reduced spike count correlations, termed the asynchronous state (AS). The AS has received considerable attention from experimenters and theorists alike, regarding its implications for cortical dynamics and coding of information. However, how reconcilable are these vanishing correlations in the AS with large-scale potentials such as M/EEG observed in most experiments? Typically the latter are assumed to be based on underlying correlations in activity, in particular between subthreshold potentials. We survey the occurrence of the AS across brain states, regions, and layers and argue for a reconciliation of this seeming disparity: large-scale potentials are either observed, first, at transitions between cortical activity states, which entail transient changes in population firing rate, as well as during the AS, and, second, on the basis of sufficiently large, asynchronous populations that only need to exhibit weak correlations in activity. Cells with no or little spiking activity can contribute to large-scale potentials via their subthreshold currents, while they do not contribute to the estimation of spiking correlations, defining the AS. Furthermore, third, the AS occurs only within particular cortical regions and layers associated with the currently selected modality, allowing for correlations at other times and between other areas and layers.

Simultaneous multi-area recordings suggest that attention improves performance by reshaping stimulus representations

Visual attention dramatically improves individuals' ability to see and modulates the responses of neurons in every known visual and oculomotor area, but whether such modulations can account for perceptual improvements is unclear. We measured the relationship between populations of visual neurons, oculomotor neurons and behavior during detection and discrimination tasks. We found that neither of the two prominent hypothesized neuronal mechanisms underlying attention (which concern changes in information coding and the way sensory information is read out) provide a satisfying account of the observed behavioral improvements. Instead, our results are more consistent with the hypothesis that attention reshapes the representation of attended stimuli to more effectively influence behavior. Our results suggest a path toward understanding the neural underpinnings of perception and cognition in health and disease by analyzing neuronal responses in ways that are constrained by behavior and interactions between brain areas.

Dynamic origin of spike and wave discharges in the brain

Spike and wave discharges are the main electrographic characteristic of a number of epileptic brain disorders including childhood absence epilepsy and photosensitive epilepsy. The basic dynamic mechanism that underlies the occurrence of these abnormal electrical patterns in the brain is not well understood. The current paper aims to provide a dynamic explanation for features and generation mechanism of spike and wave discharges in the brain. The main proposition of this study is that epileptic seizures could be interpreted as a resonance phenomenon rather than a limit cycle behavior. To shows this, a revised version of Jansen-Rit neural mass model is employed. The system can switch between monostable and bistable regimes, which are considered in this paper as wake and sleep states of the brain, respectively. In particular, it is shown that, in monostable region, the model can depict the alpha rhythm and alpha rhythm suppression due to mental activity. Frequency responses of the model near the bistable regime demonstrate that high amplitude harmonic excitation may lead to spike and wave like oscillations. Based on the computational results and the concept of stochastic resonance, a model for absence epilepsy is presented which can simulate spontaneous transitions between ictal and interictal states. Finally, it is shown that spike and wave discharges during epileptic seizures can be explained as a resonance phenomenon in a nonlinear system.

Limited Attention Diminishes Spatial Suppression From Large Field Glass Patterns

Glass patterns (GPs) consist of randomly distributed dot pairs (dipoles) whose orientations are determined by specific geometric transforms. We investigated the role of visuospatial attention in the processing of global form from GPs by measuring the effect of distraction on adaptation to GPs. In the nondistracted condition, observers were adapted to coherent GPs. After the adaptation period, they were presented with a test GP divided in two halves along the vertical and were required to judge which side of the test GP was more coherent. In the attention-distracted condition, a high-load rapid serial visual presentation task was performed during the adapting period. The magnitude of the form after-effect was measured using a technique that measures the coherence level at which the test GP appears random. The rationale was that if attention has a modulatory effect on the spatial summation of dipoles, in the attention-distracted condition, we should expect a weaker form after-effect. However, the results showed stronger form after-effect in the attention-distracted condition than in the nondistracted condition, suggesting that distraction during adaptation increases the strength of form adaptation. Additional experiments suggested that distraction may reduce the spatial suppression from large-scale textures, strengthening the spatial summation of local-oriented signals.

Cortical Areas Interact through a Communication Subspace

Most brain functions involve interactions among multiple, distinct areas or nuclei. For instance, visual processing in primates requires the appropriate relaying of signals across many distinct cortical areas. Yet our understanding of how populations of neurons in interconnected brain areas communicate is in its infancy. Here we investigate how trial-to-trial fluctuations of population responses in primary visual cortex (V1) are related to simultaneously recorded population responses in area V2. Using dimensionality reduction methods, we find that V1-V2 interactions occur through a communication subspace: V2 fluctuations are related to a small subset of V1 population activity patterns, distinct from the largest fluctuations shared among neurons within V1. In contrast, interactions between subpopulations within V1 are less selective. We propose that the communication subspace may be a general, population-level mechanism by which activity can be selectively routed across brain areas.

Understanding Sensory Information Processing Through Simultaneous Multi-area Population Recordings

The goal of sensory neuroscience is to understand how the brain creates its myriad of representations of the world, and uses these representations to produce perception and behavior. Circuits of neurons in spatially segregated regions of brain tissue have distinct functional specializations, and these regions are connected to form a functional processing hierarchy. Advances in technology for recording neuronal activity from multiple sites in multiple cortical areas mean that we are now able to collect data that reflects how information is transformed within and between connected members of this hierarchy. This advance is an important step in understanding the brain because, after the sensory organs have transduced a physical signal, every processing stage takes the activity of other neurons as its input, not measurements of the physical world. However, as we explore the potential of studying how populations of neurons in multiple areas respond in concert, we must also expand both the analytical tools that we use to make sense of these data and the scope of the theories that we attempt to define. In this article, we present an overview of some of the most promising analytical approaches for making inferences from population recordings in multiple brain areas, such as dimensionality reduction and measuring changes in correlated variability, and examine how they may be used to address longstanding questions in sensory neuroscience.

Circuit Models of Low-Dimensional Shared Variability in Cortical Networks

Trial-to-trial variability is a reflection of the circuitry and cellular physiology that make up a neuronal network. A pervasive yet puzzling feature of cortical circuits is that despite their complex wiring, population-wide shared spiking variability is low dimensional. Previous model cortical networks cannot explain this global variability, and rather assume it is from external sources. We show that if the spatial and temporal scales of inhibitory coupling match known physiology, networks of model spiking neurons internally generate low-dimensional shared variability that captures population activity recorded in vivo. Shifting spatial attention into the receptive field of visual neurons has been shown to differentially modulate shared variability within and between brain areas. A top-down modulation of inhibitory neurons in our network provides a parsimonious mechanism for this attentional modulation. Our work provides a critical link between observed cortical circuit structure and realistic shared neuronal variability and its modulation.

Attentional fluctuations induce shared variability in macaque primary visual cortex

Variability in neuronal responses to identical stimuli is frequently correlated across a population. Attention is thought to reduce these correlations by suppressing noisy inputs shared by the population. However, even with precise control of the visual stimulus, the subject’s attentional state varies across trials. While these state fluctuations are bound to induce some degree of correlated variability, it is currently unknown how strong their effect is, as previous studies generally do not dissociate changes in attentional strength from changes in attentional state variability. We designed a novel paradigm that does so and find both a pronounced effect of attentional fluctuations on correlated variability at long timescales and attention-dependent reductions in correlations at short timescales. These effects predominate in layers 2/3, as expected from a feedback signal such as attention. Thus, significant portions of correlated variability can be attributed to fluctuations in internally generated signals, like attention, rather than noise.

Attention reduces correlated variability in population activity, however the effect of fluctuations in attentional state has not been studied. Here, the authors report in a novel visual task that fluctuations in attentional allocation have a pronounced effect on correlated variability at longer timescales.

Cognition as a Window into Neuronal Population Space

Understanding how cognitive processes affect the responses of sensory neurons may clarify the relationship between neuronal population activity and behavior. However, tools for analyzing neuronal activity have not kept up with technological advances in recording from large neuronal populations. Here, we describe prevalent hypotheses of how cognitive processes affect sensory neurons, driven largely by a model based on the activity of single neurons or pools of neurons as the units of computation. We then use simple simulations to expand this model to a new conceptual framework that focuses on subspaces of population activity as the relevant units of computation, uses comparisons between brain areas or to behavior to guide analyses of these subspaces, and suggests that population activity is optimized to decode the large variety of stimuli and tasks that animals encounter in natural behavior. This framework provides new ways of understanding the ever-growing quantity of recorded population activity data.

Normalization and the Cholinergic Microcircuit: A Unified Basis for Attention

Attention alters three key properties of population neural activity - firing rate, rate variability, and shared variability between neurons. All three properties are well explained by a single canonical computation - normalization - that acts across hierarchically integrated brain systems. Combining data from rodents and nonhuman primates, we argue that cortical cholinergic modulation originating from the basal forebrain closely mimics the effects of directed attention on these three properties of population neural activity. Cholinergic modulation of the cortical microcircuit underlying normalization may represent a key biological basis for the rapid and flexible changes in population neuronal coding that are required by directed attention.

Functional Connectomes in Time Domain from Simulated Neurotransmitter Release Based on Electrocorticograms

This paper uses a newly defined functional connectome and connectome values calculated in time domain of simulated neurotransmitter release (NTR) from an electrocorticogram (ECoG) to distinguish between conditioned and unconditioned stimuli. The NTR derived from multiple channels releasing one quantum at the same time suggests that one functional connectome occurs across those channels at that time. During the first 600 ms after conditional stimulation, the connectome indexes of the 64-channel NTR trains were sorted from the 8 to 20 Hz band obtained from filtered rabbit ECoGs recorded from the visual cortices. In the small scale visual cortex area, this association was significantly larger than the habituation, even though the trial-to-trail variability of large scale synchrony after conditional stimulation is increased, which is also consistent with the hypothesis that attention decreases coherence of lower frequency within each cortical area. The increased conectome index suggests that the stimuli related to association are able to generate stronger substantial responses in the small scale visual cortex than habituation. That is, besides of the background cortical states as well as attention-related decreases in synchrony of lower frequency, the increased part of neurotransmitters released simultaneously from the pre-synaptic terminals of small scale visual cortex for association is larger than habituation.

Early steps toward understanding neuronal communication

PURPOSE OF REVIEW

The computational power of the brain arises from the complex interactions between neurons. One straightforward method to quantify the strength of neuronal interactions is by measuring correlation and coherence. Efforts to measure correlation have been advancing rapidly of late, spurred by the development of advanced recording technologies enabling recording from many neurons and brain areas simultaneously. This review highlights recent results that provide clues into the principles of neural coordination, connections to cognitive and neurological phenomena, and key directions for future research.

RECENT FINDINGS

The correlation structure of neural activity in the brain has important consequences for the encoding properties of neural populations. Recent studies have shown that this correlation structure is not fixed, but adapts in a variety of contexts in ways that appear beneficial to task performance. By studying these changes in biological neural networks and computational models, researchers have improved our understanding of the principles guiding neural communication.

SUMMARY

Correlation and coherence are highly informative metrics for studying coding and communication in the brain. Recent findings have emphasized how the brain modifies correlation structure dynamically in order to improve information-processing in a goal-directed fashion. One key direction for future research concerns how to leverage these dynamic changes for therapeutic purposes.

Learning and attention reveal a general relationship between population activity and behavior

Prior studies have demonstrated that correlated variability changes with cognitive processes that improve perceptual performance. We tested whether correlated variability covaries with subjects' performance-whether performance improves quickly with attention or slowly with perceptual learning. We found a single, consistent relationship between correlated variability and behavioral performance, regardless of the time frame of correlated variability change. This correlated variability was oriented along the dimensions in population space used by the animal on a trial-by-trial basis to make decisions. That subjects' choices were predicted by specific dimensions that were aligned with the correlated variability axis clarifies long-standing paradoxes about the relationship between shared variability and behavior.

Neuronal Correlations in MT and MST Impair Population Decoding of Opposite Directions of Random Dot Motion

The study of neuronal responses to random-dot motion patterns has provided some of the most valuable insights into how the activity of neurons is related to perception. In the opposite directions of motion paradigm, the motion signal strength is decreased by manipulating the coherence of random dot patterns to examine how well the activity of single neurons represents the direction of motion. To extend this paradigm to populations of neurons, studies have used modelling based on data from pairs of neurons, but several important questions require further investigation with larger neuronal datasets. We recorded neuronal populations in the middle temporal (MT) and medial superior temporal (MST) areas of anaesthetized marmosets with electrode arrays, while varying the coherence of random dot patterns in two opposite directions of motion (left and right). Using the spike rates of simultaneously recorded neurons, we decoded the direction of motion at each level of coherence with linear classifiers. We found that the presence of correlations had a detrimental effect to decoding performance, but that learning the correlation structure produced better decoding performance compared to decoders that ignored the correlation structure. We also found that reducing motion coherence increased neuronal correlations, but decoders did not need to be optimized for each coherence level. Finally, we showed that decoder weights depend of left-right selectivity at 100% coherence, rather than the preferred direction. These results have implications for understanding how the information encoded by populations of neurons is affected by correlations in spiking activity.

Functional dissection of signal and noise in MT and LIP during decision-making

During perceptual decision making, responses in the middle temporal (MT) and lateral intraparietal (LIP) areas appear to map onto theoretically defined quantities, with MT representing instantaneous motion evidence and LIP reflecting the accumulated evidence. However, several aspects of the transformation between the two areas have not been empirically tested. We therefore performed multi-stage systems identification analyses of the simultaneous activity of MT and LIP during individual decisions. We found that monkeys based their choices on evidence presented in early epochs of the motion stimulus, and that substantial early weighting of motion was present in MT responses. LIP’s responses recapitulated MT’s early weighting and contained a choice-dependent buildup that was distinguishable from motion integration. Furthermore, trial-by-trial variability in LIP did not depend on MT activity. These results identify important deviations from the idealizations of MT and LIP and motivate inquiry into sensorimotor computations that may intervene between MT and LIP.