Feedforward origins of response variability underlying contrast invariant orientation tuning in cat visual cortex

Response sub-additivity and variability quenching in visual cortex

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

Trial-by-trial variability in cortical responses exhibits scaling of spatial correlations predicted from critical dynamics

In the mammalian cortex, even simple sensory inputs or movements activate many neurons, with each neuron responding variably to repeated stimuli-a phenomenon known as trial-by-trial variability. Understanding the spatial patterns and dynamics of this variability is challenging. Using cellular 2-photon imaging, we study visual and auditory responses in the primary cortices of awake mice. We focus on how individual neurons' responses differed from the overall population. We find consistent spatial correlations in these differences that are unique to each trial and linearly scale with the cortical area observed, a characteristic of critical dynamics as confirmed in our neuronal simulations. Using chronic multi-electrode recordings, we observe similar scaling in the prefrontal and premotor cortex of non-human primates during self-initiated and visually cued motor tasks. These results suggest that trial-by-trial variability, rather than being random noise, reflects a critical, fluctuation-dominated state in the cortex, supporting the brain's efficiency in processing information.

Modeling the diverse effects of divisive normalization on noise correlations

Divisive normalization, a prominent descriptive model of neural activity, is employed by theories of neural coding across many different brain areas. Yet, the relationship between normalization and the statistics of neural responses beyond single neurons remains largely unexplored. Here we focus on noise correlations, a widely studied pairwise statistic, because its stimulus and state dependence plays a central role in neural coding. Existing models of covariability typically ignore normalization despite empirical evidence suggesting it affects correlation structure in neural populations. We therefore propose a pairwise stochastic divisive normalization model that accounts for the effects of normalization and other factors on covariability. We first show that normalization modulates noise correlations in qualitatively different ways depending on whether normalization is shared between neurons, and we discuss how to infer when normalization signals are shared. We then apply our model to calcium imaging data from mouse primary visual cortex (V1), and find that it accurately fits the data, often outperforming a popular alternative model of correlations. Our analysis indicates that normalization signals are often shared between V1 neurons in this dataset. Our model will enable quantifying the relation between normalization and covariability in a broad range of neural systems, which could provide new constraints on circuit mechanisms of normalization and their role in information transmission and representation.

Effects of stochastic coding on olfactory discrimination in flies and mice

Sparse coding can improve discrimination of sensory stimuli by reducing overlap between their representations. Two factors, however, can offset sparse coding's benefits: similar sensory stimuli have significant overlap and responses vary across trials. To elucidate the effects of these 2 factors, we analyzed odor responses in the fly and mouse olfactory regions implicated in learning and discrimination-the mushroom body (MB) and the piriform cortex (PCx). We found that neuronal responses fall along a continuum from extremely reliable across trials to extremely variable or stochastic. Computationally, we show that the observed variability arises from noise within central circuits rather than sensory noise. We propose this coding scheme to be advantageous for coarse- and fine-odor discrimination. More reliable cells enable quick discrimination between dissimilar odors. For similar odors, however, these cells overlap and do not provide distinguishing information. By contrast, more unreliable cells are decorrelated for similar odors, providing distinguishing information, though these benefits only accrue with extended training with more trials. Overall, we have uncovered a conserved, stochastic coding scheme in vertebrates and invertebrates, and we identify a candidate mechanism, based on variability in a winner-take-all (WTA) inhibitory circuit, that improves discrimination with training.

Amplified cortical neural responses as animals learn to use novel activity patterns

Cerebral cortex supports representations of the world in patterns of neural activity, used by the brain to make decisions and guide behavior. Past work has found diverse, or limited, changes in the primary sensory cortex in response to learning, suggesting that the key computations might occur in downstream regions. Alternatively, sensory cortical changes may be central to learning. We studied cortical learning by using controlled inputs we insert: we trained mice to recognize entirely novel, non-sensory patterns of cortical activity in the primary visual cortex (V1) created by optogenetic stimulation. As animals learned to use these novel patterns, we found that their detection abilities improved by an order of magnitude or more. The behavioral change was accompanied by large increases in V1 neural responses to fixed optogenetic input. Neural response amplification to novel optogenetic inputs had little effect on existing visual sensory responses. A recurrent cortical model shows that this amplification can be achieved by a small mean shift in recurrent network synaptic strength. Amplification would seem to be desirable to improve decision-making in a detection task; therefore, these results suggest that adult recurrent cortical plasticity plays a significant role in improving behavioral performance during learning.

Sensory coding and contrast invariance emerge from the control of plastic inhibition over emergent selectivity

Visual stimuli are represented by a highly efficient code in the primary visual cortex, but the development of this code is still unclear. Two distinct factors control coding efficiency: Representational efficiency, which is determined by neuronal tuning diversity, and metabolic efficiency, which is influenced by neuronal gain. How these determinants of coding efficiency are shaped during development, supported by excitatory and inhibitory plasticity, is only partially understood. We investigate a fully plastic spiking network of the primary visual cortex, building on phenomenological plasticity rules. Our results suggest that inhibitory plasticity is key to the emergence of tuning diversity and accurate input encoding. We show that inhibitory feedback (random and specific) increases the metabolic efficiency by implementing a gain control mechanism. Interestingly, this led to the spontaneous emergence of contrast-invariant tuning curves. Our findings highlight that (1) interneuron plasticity is key to the development of tuning diversity and (2) that efficient sensory representations are an emergent property of the resulting network.

Synaptic plasticity is crucial for the development of efficient input representation in the different sensory cortices, such as the primary visual cortex. Efficient visual representation is determined by two factors: representational efficiency, i.e. how many different input features can be represented, and metabolic efficiency, i.e. how many spikes are required to represent a specific feature. Previous research has pointed out the importance of plasticity at excitatory synapses to achieve high representational efficiency and feedback inhibition as a gain control mechanism for controlling metabolic efficiency. However, it is only partially understood how the influence of inhibitory plasticity on excitatory plasticity can lead to an efficient representation. Using a spiking neural network, we show that plasticity at feed-forward and feedback inhibitory synapses is necessary for the emergence of well-distributed neuronal selectivity to improve representational efficiency. Further, the emergent balance between excitatory and inhibitory currents improves the metabolic efficiency, and leads to contrast-invariant tuning as an inherent network property. Extending previous work, our simulation results highlight the importance of plasticity at inhibitory synapses.

What is the dynamical regime of cerebral cortex?

Many studies have shown that the excitation and inhibition received by cortical neurons remain roughly balanced across many conditions. A key question for understanding the dynamical regime of cortex is the nature of this balancing. Theorists have shown that network dynamics can yield systematic cancellation of most of a neuron's excitatory input by inhibition. We review a wide range of evidence pointing to this cancellation occurring in a regime in which the balance is loose, meaning that the net input remaining after cancellation of excitation and inhibition is comparable in size with the factors that cancel, rather than tight, meaning that the net input is very small relative to the canceling factors. This choice of regime has important implications for cortical functional responses, as we describe: loose balance, but not tight balance, can yield many nonlinear population behaviors seen in sensory cortical neurons, allow the presence of correlated variability, and yield decrease of that variability with increasing external stimulus drive as observed across multiple cortical areas.

Representation of visual uncertainty through neural gain variability

Uncertainty is intrinsic to perception. Neural circuits which process sensory information must therefore also represent the reliability of this information. How they do so is a topic of debate. We propose a model of visual cortex in which average neural response strength encodes stimulus features, while cross-neuron variability in response gain encodes the uncertainty of these features. To test this model, we studied spiking activity of neurons in macaque V1 and V2 elicited by repeated presentations of stimuli whose uncertainty was manipulated in distinct ways. We show that gain variability of individual neurons is tuned to stimulus uncertainty, that this tuning is specific to the features encoded by these neurons and largely invariant to the source of uncertainty. We demonstrate that this behavior naturally arises from known gain-control mechanisms, and illustrate how downstream circuits can jointly decode stimulus features and their uncertainty from sensory population activity.

Neurophysiological basis of contrast dependent BOLD orientation tuning

Recent work in early visual cortex of humans has shown that the BOLD signal exhibits contrast dependent orientation tuning, with an inverse oblique effect (oblique > cardinal) at high contrast and a horizontal effect (vertical > horizontal) at low contrast. This finding is at odds with decades of neurophysiological research demonstrating contrast invariant orientation tuning in primate visual cortex, yet the source of this discrepancy is unclear. We hypothesized that contrast dependent BOLD orientation tuning may arise due to contrast dependent influences of feedforward (FF) and feedback (FB) synaptic activity, indexed through gamma and alpha rhythms, respectively. To quantify this, we acquired EEG and BOLD in healthy humans to generate and compare orientation tuning curves across all neural frequency bands with BOLD. As expected, BOLD orientation selectivity in V1 was contrast dependent, preferring oblique orientations at high contrast and vertical at low contrast. On the other hand, EEG orientation tuning was contrast invariant, though frequency-specific, with an inverse-oblique effect in the gamma band (FF) and a horizontal effect in the alpha band (FB). Therefore, high-contrast BOLD orientation tuning closely matched FF activity, while at low contrast, BOLD best resembled FB orientation tuning. These results suggest that contrast dependent BOLD orientation tuning arises due to the reduced contribution of FF input to overall neurophysiological activity at low contrast, shifting BOLD orientation tuning towards the orientation preferences of FB at low contrast.

Dynamics and sources of response variability and its coordination in visual cortex

The trial-to-trial response variability in sensory cortices and the extent to which this variability can be coordinated among cortical units have strong implications for cortical signal processing. Yet, little is known about the relative contributions and dynamics of defined sources to the cortical response variability and their correlations across cortical units. To fill this knowledge gap, here we obtained and analyzed multisite local field potential (LFP) recordings from visual cortex of turtles in response to repeated naturalistic movie clips and decomposed cortical across-trial LFP response variability into three defined sources, namely, input, network, and local fluctuations. We found that input fluctuations dominate cortical response variability immediately following stimulus onset, whereas network fluctuations dominate the response variability in the steady state during continued visual stimulation. Concurrently, we found that the network fluctuations dominate the correlations of the variability during the ongoing and steady-state epochs, but not immediately following stimulus onset. Furthermore, simulations of various model networks indicated that (i) synaptic time constants, leading to oscillatory activity, and (ii) synaptic clustering and synaptic depression, leading to spatially constrained pockets of coherent activity, are both essential features of cortical circuits to mediate the observed relative contributions and dynamics of input, network, and local fluctuations to the cortical LFP response variability and their correlations across recording sites. In conclusion, these results show how a mélange of multiscale thalamocortical circuit features mediate a complex stimulus-modulated cortical activity that, when naively related to the visual stimulus alone, appears disguised as high and coordinated across-trial response variability.

The Dynamical Regime of Sensory Cortex: Stable Dynamics around a Single Stimulus-Tuned Attractor Account for Patterns of Noise Variability

Correlated variability in cortical activity is ubiquitously quenched following stimulus onset, in a stimulus-dependent manner. These modulations have been attributed to circuit dynamics involving either multiple stable states (“attractors”) or chaotic activity. Here we show that a qualitatively different dynamical regime, involving fluctuations about a single, stimulus-driven attractor in a loosely balanced excitatory-inhibitory network (the stochastic “stabilized supralinear network”), best explains these modulations. Given the supralinear input/output functions of cortical neurons, increased stimulus drive strengthens effective network connectivity. This shifts the balance from interactions that amplify variability to suppressive inhibitory feedback, quenching correlated variability around more strongly driven steady states. Comparing to previously published and original data analyses, we show that this mechanism, unlike previous proposals, uniquely accounts for the spatial patterns and fast temporal dynamics of variability suppression. Specifying the cortical operating regime is key to understanding the computations underlying perception.

•

A simple network model explains stimulus-tuning of cortical variability suppression

•

Inhibition stabilizes recurrently interacting neurons with supralinear I/O functions

•

Stimuli strengthen inhibitory stabilization around a stable state, quenching variability

•

Single-trial V1 data are compatible with this model and rules out competing proposals

Thalamus exhibits less sensory variability quenching than cortex

Spiking activity exhibits a large degree of variability across identical trials, which has been shown to be significantly reduced by stimulus onset in a wide range of cortical areas. Whether similar dynamics apply to the thalamus and in particular to the pulvinar is largely unknown. Here, we examined electrophysiological recordings from two adult rhesus macaques performing a perceptual task and comparatively investigated trial-to-trial variability in higher-order thalamus (ventral and dorsal pulvinar), the lateral geniculate nucleus (LGN) and visual cortex (area V4) prior to and following the presentation of a visual stimulus. We found spiking variability during stable fixation prior to stimulus onset to be considerably lower in both pulvinar and the LGN as compared to area V4. In contrast to the prominent variability reduction in V4 upon stimulus onset, variability in the thalamic nuclei was largely unaffected by visual stimulation. There was a small but significant variability decrease in the dorsal pulvinar, but not in the ventral portion of the pulvinar, which is closely connected to visual cortices and would thus have been expected to reflect cortical response properties. This dissociation did not stem from differences in response strength or mean firing rates and indicates fundamental differences in variability quenching between thalamus and cortex.

Stochastic neural field model of stimulus-dependent variability in cortical neurons

We use stochastic neural field theory to analyze the stimulus-dependent tuning of neural variability in ring attractor networks. We apply perturbation methods to show how the neural field equations can be reduced to a pair of stochastic nonlinear phase equations describing the stochastic wandering of spontaneously formed tuning curves or bump solutions. These equations are analyzed using a modified version of the bivariate von Mises distribution, which is well-known in the theory of circular statistics. We first consider a single ring network and derive a simple mathematical expression that accounts for the experimentally observed bimodal (or M-shaped) tuning of neural variability. We then explore the effects of inter-network coupling on stimulus-dependent variability in a pair of ring networks. These could represent populations of cells in two different layers of a cortical hypercolumn linked via vertical synaptic connections, or two different cortical hypercolumns linked by horizontal patchy connections within the same layer. We find that neural variability can be suppressed or facilitated, depending on whether the inter-network coupling is excitatory or inhibitory, and on the relative strengths and biases of the external stimuli to the two networks. These results are consistent with the general observation that increasing the mean firing rate via external stimuli or modulating drives tends to reduce neural variability.

Membrane Potential Correlates of Network Decorrelation and Improved SNR by Cholinergic Activation in the Somatosensory Cortex

The nucleus basalis (NB) projects cholinergic axons to the cortex, where they play a major role in arousal, attention, and learning. Cholinergic inputs shift cortical dynamics from synchronous to asynchronous and improve the signal-to-noise ratio (SNR) of sensory responses. However, the underlying mechanisms of these changes remain unclear. Using simultaneous extracellular and whole-cell patch recordings in layer 4 of the mouse barrel cortex, we show that electrical or optogenetic activation of the cholinergic system has a differential effect on ongoing and sensory evoked activities. Cholinergic activation profoundly reduced the large spontaneous fluctuations in membrane potential and decorrelated ongoing activity. However, NB stimulation had no effect on the response to whisker stimulation or on signal correlations. These effects of cholinergic activation provide a unified explanation for the increased SNR of sensory response and for the reduction in noise correlations and explain the shift into the desynchronized cortical state, which are the hallmarks of arousal and attention.SIGNIFICANCE STATEMENT Attention increases the signal-to-noise ratio (SNR) of cortical sensory response, which may reflect either reduction in background firing rate or increased sensory response. Extracellular recordings showed that attention also reduces the correlation in network activity. These effects are partially mediated by cholinergic axons from the nucleus basalis projecting to the entire cortex. To reveal the cellular and synaptic correlates of these cholinergic effects, we performed simultaneous intracellular and LFP recordings in the somatosensory cortex. Global or local cholinergic activation increased the SNR of sensory response mainly by reducing the rate and amplitude of background synaptic activity and also reduced network correlations. Therefore, coding of sensory information is enhanced by the cholinergic system mainly due to a reduction in spontaneous activity.

State dependence of stimulus-induced variability tuning in macaque MT

Behavioral states marked by varying levels of arousal and attention modulate some properties of cortical responses (e.g. average firing rates or pairwise correlations), yet it is not fully understood what drives these response changes and how they might affect downstream stimulus decoding. Here we show that changes in state modulate the tuning of response variance-to-mean ratios (Fano factors) in a fashion that is neither predicted by a Poisson spiking model nor changes in the mean firing rate, with a substantial effect on stimulus discriminability. We recorded motion-sensitive neurons in middle temporal cortex (MT) in two states: alert fixation and light, opioid anesthesia. Anesthesia tended to lower average spike counts, without decreasing trial-to-trial variability compared to the alert state. Under anesthesia, within-trial fluctuations in excitability were correlated over longer time scales compared to the alert state, creating supra-Poisson Fano factors. In contrast, alert-state MT neurons have higher mean firing rates and largely sub-Poisson variability that is stimulus-dependent and cannot be explained by firing rate differences alone. The absence of such stimulus-induced variability tuning in the anesthetized state suggests different sources of variability between states. A simple model explains state-dependent shifts in the distribution of observed Fano factors via a suppression in the variance of gain fluctuations in the alert state. A population model with stimulus-induced variability tuning and behaviorally constrained information-limiting correlations explores the potential enhancement in stimulus discriminability by the cortical population in the alert state.

The brain controls behavior fluidly in a wide variety of cognitive contexts that alter the precision of neural responses. We examine how neural variability changes versus the mean response as a function of the stimulus and the behavioral state. We show that this scaled variability can have qualitatively different stimulus tuning in different behavioral contexts. In alert primates, scaled variability is tuned to the direction of motion of a visual stimulus and decreases around the preferred direction of each neuron. Under anesthesia, neurons show flat scaled variability tuning and, overall, responses are significantly more variable. We develop a simple model that includes a parameter describing firing rate gain fluctuations that can explain these changes. Our results suggest that tuned decreases in scaled variability during wakefulness may be mediated by an active process that suppresses synchronization and makes information transmission more reliable.

Contrast gain control in mouse auditory cortex

The neocortex is thought to employ a number of canonical computations, but little is known about whether these computations rely on shared mechanisms across different neural populations. In recent years, the mouse has emerged as a powerful model organism for the dissection of the circuits and mechanisms underlying various aspects of neural processing and therefore provides an important avenue for research into putative canonical computations. One such computation is contrast gain control, the systematic adjustment of neural gain in accordance with the contrast of sensory input, which helps to construct neural representations that are robust to the presence of background stimuli. Here, we characterized contrast gain control in the mouse auditory cortex. We performed laminar extracellular recordings in the auditory cortex of the anesthetized mouse while varying the contrast of the sensory input. We observed that an increase in stimulus contrast resulted in a compensatory reduction in the gain of neural responses, leading to representations in the mouse auditory cortex that are largely contrast invariant. Contrast gain control was present in all cortical layers but was found to be strongest in deep layers, indicating that intracortical mechanisms may contribute to these gain changes. These results lay a foundation for investigations into the mechanisms underlying contrast adaptation in the mouse auditory cortex. NEW & NOTEWORTHY We investigated whether contrast gain control, the systematic reduction in neural gain in response to an increase in sensory contrast, exists in the mouse auditory cortex. We performed extracellular recordings in the mouse auditory cortex while presenting sensory stimuli with varying contrasts and found this form of processing was widespread. This finding provides evidence that contrast gain control may represent a canonical cortical computation and lays a foundation for investigations into the underlying mechanisms.

Mechanisms of Orientation Selectivity in the Primary Visual Cortex

The mechanisms underlying the emergence of orientation selectivity in the visual cortex have been, and continue to be, the subjects of intense scrutiny. Orientation selectivity reflects a dramatic change in the representation of the visual world: Whereas afferent thalamic neurons are generally orientation insensitive, neurons in the primary visual cortex (V1) are extremely sensitive to stimulus orientation. This profound change in the receptive field structure along the visual pathway has positioned V1 as a model system for studying the circuitry that underlies neural computations across the neocortex. The neocortex is characterized anatomically by the relative uniformity of its circuitry despite its role in processing distinct signals from region to region. A combination of physiological, anatomical, and theoretical studies has shed some light on the circuitry components necessary for generating orientation selectivity in V1. This targeted effort has led to critical insights, as well as controversies, concerning how neural circuits in the neocortex perform computations.

Orientation Tuning of Correlated Activity in the Developing Lateral Geniculate Nucleus

Neural circuits and the cells that comprise them undergo developmental changes in the spatial organization of their connections and in their temporal response properties. Within the lateral geniculate nucleus (LGN) of the dorsal thalamus, these changes have pronounced effects on the spatiotemporal receptive fields (STRFs) of neurons. An open and unresolved question is how STRF maturation affects stimulus-evoked correlated activity between pairs of LGN neurons during development. This is an important question to answer because stimulus-evoked correlated activity likely plays a role in establishing the specificity of thalamocortical connectivity and the receptive fields (RFs) of postsynaptic cortical neurons. Using multielectrode recording methods and white noise stimuli, we recorded neural activity from ensembles of LGN neurons in cats across early development. As expected, there was a progressive maturation of the spatial and temporal properties of visual responses. Using drifting bar stimuli and cross-correlation analysis, we also determined the orientation-tuning bandwidth of correlated activity between pairs of LGN neurons at different stages of development (Sillito and Jones, 2002; Andolina et al., 2007; Stanley et al., 2012; Kelly et al., 2014). Despite the larger RFs and slower responses of immature LGN neurons compared with mature neurons, our results show that correlated activity in the LGN was as tightly tuned for orientation early in development as it was in the adult. Closer examination revealed this age-invariant orientation tuning of correlated activity likely involves cellular mechanisms related to spike fatigue in young animals and a progressive decrease in response latency with development.SIGNIFICANCE STATEMENT Orientation tuning is a fundamental property of neurons in primary visual cortex. An important and unresolved question is how orientation tuning emerges during brain development. This study explores a potential mechanism for the establishment of orientation tuning based on correlated activity patterns among ensembles of maturing neurons in the lateral geniculate nucleus (LGN) of the thalamus. Results show that correlated activity between pairs of LGN neurons is more tightly tuned than predictions based simply on receptive field size, indicating that correlated activity has the properties needed to play an important role in the development of geniculocortical circuits and the emergence of cortical orientation tuning.

Comparison of mechanisms for contrast-invariance of orientation selectivity in simple cells

The simple cells of the visual cortex respond over a narrow range of stimulus orientations, and this tuning is invariant to the contrast at which the stimulus is presented. The inputs to a single cell derive from a population of thalamic cells that provide a bell-shaped tuning width and offset that increases with stimulus contrast. Synaptic depression, noise and inhibition have been proposed as feedforward mechanisms to explain why these increases do not appear in simple cells. The extent to which these three mechanisms contribute to contrast-invariant orientation tuning is unknown. Consequently, the aim was to test the hypothesis that these mechanisms do not contribute equally. Unlike previous studies, all mechanisms were examined using the same network model based on Banitt et al. (2007). The results showed that thalamocortical synaptic noise was essential and sufficient to widen tuning widths at low contrasts to that of higher contrasts but could not counteract the offset at higher contrasts. Thalamocortical synaptic depression could only be used to counteract a small fraction of the offset otherwise the relationship between contrast and response rate was disrupted. Only broadly tuned simple and complex cell inhibition could counteract the remaining offset for all stimulus contrasts but complex cell inhibition reduced the gain of the response. These results suggest unequal contributions of these feedforward mechanisms with thalamic synaptic noise widening tuning widths for low contrasts, synaptic depression counteracting a small component of the offset and synaptic inhibition completely removing the remaining offset to produce contrast-invariant orientation tuning.

Local and thalamic origins of correlated ongoing and sensory-evoked cortical activities

Thalamic inputs of cells in sensory cortices are outnumbered by local connections. Thus, it was suggested that robust sensory response in layer 4 emerges due to synchronized thalamic activity. To investigate the role of both inputs in the generation of correlated cortical activities, we isolated the thalamic excitatory inputs of cortical cells by optogenetically silencing cortical firing. In anaesthetized mice, we measured the correlation between isolated thalamic synaptic inputs of simultaneously patched nearby layer 4 cells of the barrel cortex. Here we report that in contrast to correlated activity of excitatory synaptic inputs in the intact cortex, isolated thalamic inputs exhibit lower variability and asynchronous spontaneous and sensory-evoked inputs. These results are further supported in awake mice when we recorded the excitatory inputs of individual cortical cells simultaneously with the local field potential in a nearby site. Our results therefore indicate that cortical synchronization emerges by intracortical coupling.

Sensory cortices receive input from cortical cells and the thalamus, yet it is unknown how these inputs interact to generate synchronous activity. Here authors show that unlike cortical inputs, thalamic inputs are asynchronous, suggesting that cortical synchronization is due to intracortical coupling.

Fluctuation scaling in the visual cortex at threshold

Fluctuation scaling relates trial-to-trial variability to the average response by a power function in many physical processes. Here we address whether fluctuation scaling holds in sensory psychophysics and its functional role in visual processing. We report experimental evidence of fluctuation scaling in human color vision and form perception at threshold. Subjects detected thresholds in a psychophysical masking experiment that is considered a standard reference for studying suppression between neurons in the visual cortex. For all subjects, the analysis of threshold variability that results from the masking task indicates that fluctuation scaling is a global property that modulates detection thresholds with a scaling exponent that departs from 2, β=2.48±0.07. We also examine a generalized version of fluctuation scaling between the sample kurtosis K and the sample skewness S of threshold distributions. We find that K and S are related and follow a unique quadratic form K=(1.19±0.04)S^{2}+(2.68±0.06) that departs from the expected 4/3 power function regime. A random multiplicative process with weak additive noise is proposed based on a Langevin-type equation. The multiplicative process provides a unifying description of fluctuation scaling and the quadratic S-K relation and is related to on-off intermittency in sensory perception. Our findings provide an insight into how the human visual system interacts with the external environment. The theoretical methods open perspectives for investigating fluctuation scaling and intermittency effects in a wide variety of natural, economic, and cognitive phenomena.

Push-Pull Receptive Field Organization and Synaptic Depression: Mechanisms for Reliably Encoding Naturalistic Stimuli in V1

Neurons in the primary visual cortex are known for responding vigorously but with high variability to classical stimuli such as drifting bars or gratings. By contrast, natural scenes are encoded more efficiently by sparse and temporal precise spiking responses. We used a conductance-based model of the visual system in higher mammals to investigate how two specific features of the thalamo-cortical pathway, namely push-pull receptive field organization and fast synaptic depression, can contribute to this contextual reshaping of V1 responses. By comparing cortical dynamics evoked respectively by natural vs. artificial stimuli in a comprehensive parametric space analysis, we demonstrate that the reliability and sparseness of the spiking responses during natural vision is not a mere consequence of the increased bandwidth in the sensory input spectrum. Rather, it results from the combined impacts of fast synaptic depression and push-pull inhibition, the later acting for natural scenes as a form of “effective” feed-forward inhibition as demonstrated in other sensory systems. Thus, the combination of feedforward-like inhibition with fast thalamo-cortical synaptic depression by simple cells receiving a direct structured input from thalamus composes a generic computational mechanism for generating a sparse and reliable encoding of natural sensory events.

Canonical computations of cerebral cortex

The idea that there is a fundamental cortical circuit that performs canonical computations remains compelling though far from proven. Here we review evidence for two canonical operations within sensory cortical areas: a feedforward computation of selectivity; and a recurrent computation of gain in which, given sufficiently strong external input, perhaps from multiple sources, intracortical input largely, but not completely, cancels this external input. This operation leads to many characteristic cortical nonlinearities in integrating multiple stimuli. The cortical computation must combine such local processing with hierarchical processing across areas. We point to important changes in moving from sensory cortex to motor and frontal cortex and the possibility of substantial differences between cortex in rodents vs. species with columnar organization of selectivity.

State-dependent and cell type-specific temporal processing in auditory thalamocortical circuit

Ongoing spontaneous activity in cortical circuits defines cortical states, but it still remains unclear how cortical states shape sensory processing across cortical laminae and what type of response properties emerge in the cortex. Recording neural activity from the auditory cortex (AC) and medial geniculate body (MGB) simultaneously with electrical stimulations of the basal forebrain (BF) in urethane-anesthetized rats, we investigated state-dependent spontaneous and auditory-evoked activities in the auditory thalamocortical circuit. BF stimulation induced a short-lasting desynchronized state, with sparser firing and increased power at gamma frequency in superficial layers. In this desynchronized state, the reduction in onset response variability in both AC and MGB was accompanied by cell type-specific firing, with decreased responses of cortical broad spiking cells, but increased responses of cortical narrow spiking cells. This onset response was followed by distinct temporal evolution in AC, with quicker rebound firing in infragranular layers. This temporal profile was associated with improved processing of temporally structured stimuli across AC layers to varying degrees, but not in MGB. Thus, the reduction in response variability during the desynchronized state can be seen subcortically whereas the improvement of temporal tuning emerges across AC layers, emphasizing the importance of state-dependent intracortical processing in hearing.

Contrast invariance of orientation tuning in cat primary visual cortex neurons depends on stimulus size

KEY POINTS

The process of orientation tuning is an important and well-characterized feature of neurons in primary visual cortex. The combination of ascending and descending circuits involved is not only relevant to understanding visual processing but the function of neocortex in general. The classic feed-forward model of orientation tuning predicts a broadening effect due to increasing contrast; yet, experimental results consistently report contrast invariance. We show here that contrast invariance actually depends on stimulus size such that large stimuli extending beyond the neuron's receptive field engage circuits that promote invariance, whereas optimally sized, smaller stimuli result in contrast variance that is more in line with the classical orientation tuning model. These results illustrate the importance of optimizing stimulus parameters to best reflect the sensory pathways under study and provide new clues about different circuits that may be involved in variant and invariant response properties.

ABSTRACT

Selective response to stimulus orientation is a key feature of neurons in primary visual cortex, yet the underlying mechanisms generating orientation tuning are not fully understood. The combination of feed-forward and cortical mechanisms involved is not only relevant to understanding visual processing but the function of neocortex in general. The classic feed-forward model predicts that orientation tuning should broaden considerably with increasing contrast; however, experimental results consistently report contrast invariance. We show here, in primary visual cortex of anaesthetized cats under neuromuscular blockade, that contrast invariance occurs when visual stimuli are large enough to include the extraclassical surround (ECS), which is likely to involve circuits of suppression that may not be entirely feed-forward in origin. On the other hand, when stimulus size is optimized to the classical receptive field of each neuron, the population average shows a statistically significant 40% increase in tuning width at high contrast, demonstrating that contrast variance of orientation tuning can occur. Conversely, our results also suggest that the phenomenon of contrast invariance relies in part on the presence of the ECS. Moreover, these results illustrate the importance of optimizing stimulus parameters to best reflect the neural pathways under study.

Emergence of Functional Specificity in Balanced Networks with Synaptic Plasticity

In rodent visual cortex, synaptic connections between orientation-selective neurons are unspecific at the time of eye opening, and become to some degree functionally specific only later during development. An explanation for this two-stage process was proposed in terms of Hebbian plasticity based on visual experience that would eventually enhance connections between neurons with similar response features. For this to work, however, two conditions must be satisfied: First, orientation selective neuronal responses must exist before specific recurrent synaptic connections can be established. Second, Hebbian learning must be compatible with the recurrent network dynamics contributing to orientation selectivity, and the resulting specific connectivity must remain stable for unspecific background activity. Previous studies have mainly focused on very simple models, where the receptive fields of neurons were essentially determined by feedforward mechanisms, and where the recurrent network was small, lacking the complex recurrent dynamics of large-scale networks of excitatory and inhibitory neurons. Here we studied the emergence of functionally specific connectivity in large-scale recurrent networks with synaptic plasticity. Our results show that balanced random networks, which already exhibit highly selective responses at eye opening, can develop feature-specific connectivity if appropriate rules of synaptic plasticity are invoked within and between excitatory and inhibitory populations. If these conditions are met, the initial orientation selectivity guides the process of Hebbian learning and, as a result, functionally specific and a surplus of bidirectional connections emerge. Our results thus demonstrate the cooperation of synaptic plasticity and recurrent dynamics in large-scale functional networks with realistic receptive fields, highlight the role of inhibition as a critical element in this process, and paves the road for further computational studies of sensory processing in neocortical network models equipped with synaptic plasticity.

In primary visual cortex of mammals, neurons are selective to the orientation of contrast edges. In some species, as cats and monkeys, neurons preferring similar orientations are adjacent on the cortical surface, leading to smooth orientation maps. In rodents, in contrast, such spatial orientation maps do not exist, and neurons of different specificities are mixed in a salt-and-pepper fashion. During development, however, a “functional” map of orientation selectivity emerges, where connections between neurons of similar preferred orientations are selectively enhanced. Here we show how such feature-specific connectivity can arise in realistic neocortical networks of excitatory and inhibitory neurons. Our results demonstrate how recurrent dynamics can work in cooperation with synaptic plasticity to form networks where neurons preferring similar stimulus features connect more strongly together. Such networks, in turn, are known to enhance the specificity of neuronal responses to a stimulus. Our study thus reveals how self-organizing connectivity in neuronal networks enable them to achieve new or enhanced functions, and it underlines the essential role of recurrent inhibition and plasticity in this process.

Cortical state determines global variability and correlations in visual cortex

The response of neurons in sensory cortex to repeated stimulus presentations is highly variable. To investigate the nature of this variability, we compared the spike activity of neurons in the primary visual cortex (V1) of cats with that of their afferents from lateral geniculate nucleus (LGN), in response to similar stimuli. We found variability to be much higher in V1 than in LGN. To investigate the sources of the additional variability, we measured the spiking activity of large V1 populations and found that much of the variability was shared across neurons: the variable portion of the responses of one neuron could be well predicted from the summed activity of the rest of the neurons. Variability thus mostly reflected global fluctuations affecting all neurons. The size and prevalence of these fluctuations, both in responses to stimuli and in ongoing activity, depended on cortical state, being larger in synchronized states than in more desynchronized states. Contrary to previous reports, these fluctuations invested the overall population, regardless of preferred orientation. The global fluctuations substantially increased variability in single neurons and correlations among pairs of neurons. Once this effect was removed, pairwise correlations were reduced and were similar regardless of cortical state. These results highlight the importance of cortical state in controlling cortical operation and can help reconcile previous studies, which differed widely in their estimate of neuronal variability and pairwise correlations.

The effects of short-term synaptic depression at thalamocortical synapses on orientation tuning in cat V1

We examine the effects of short-term synaptic depression on the orientation tuning of the LGN input to simple cells in cat primary visual cortex (V1). The total LGN input has an untuned component as well as a tuned component, both of which grow with stimulus contrast. The untuned component is not visible in the firing rate responses of the simple cells. The suppression of the contribution of the untuned input component to firing rate responses is key to establishing orientation selectivity and its invariance with stimulus contrast. It has been argued that synaptic depression of LGN inputs could contribute to the selective suppression of the untuned component and thus contribute to the tuning observed in simple cells. We examine this using a model fit to the depression observed at thalamocortical synapses in-vivo, and compare this to an earlier model fit based on in-vitro observations. We examine the tuning of both the conductance and the firing rate induced in simple cells by the net LGN input. We find that depression causes minimal suppression of the untuned component. The primary effect of depression is to cause the contrast response curve to saturate at lower contrasts without differentially affecting the tuned vs. untuned components. This effect is slightly weaker for in-vivo vs. in-vitro parameters. Thus, synaptic depression of LGN inputs does not appreciably contribute to the orientation tuning of V1 simple cells.

Poisson-like spiking in circuits with probabilistic synapses

Neuronal activity in cortex is variable both spontaneously and during stimulation, and it has the remarkable property that it is Poisson-like over broad ranges of firing rates covering from virtually zero to hundreds of spikes per second. The mechanisms underlying cortical-like spiking variability over such a broad continuum of rates are currently unknown. We show that neuronal networks endowed with probabilistic synaptic transmission, a well-documented source of variability in cortex, robustly generate Poisson-like variability over several orders of magnitude in their firing rate without fine-tuning of the network parameters. Other sources of variability, such as random synaptic delays or spike generation jittering, do not lead to Poisson-like variability at high rates because they cannot be sufficiently amplified by recurrent neuronal networks. We also show that probabilistic synapses predict Fano factor constancy of synaptic conductances. Our results suggest that synaptic noise is a robust and sufficient mechanism for the type of variability found in cortex.

Neurons in cortex fire irregularly and in an irreproducible way under repeated presentations of an identical stimulus. Where is this spiking variability coming from? One unexplored possibility is that cortical variability originates from the amplification of a particular type of noise that is present throughout cortex: synaptic failures. In this paper we found that probabilistic synapses are sufficient to lead to cortical-like firing for several orders of magnitude in firing rate. Moreover, the resulting variability displays the property that variance of the spike counts is proportional to the mean for every cell in the network, the so-called Poisson-like firing, a well-known property of sensory cortical firing responses. We finally argue that far from being harmful, probabilistic synapses allow networks to sample neuronal states and sustain probabilistic population codes. Therefore, synaptic noise is not only a robust mechanism for the type of variability found in cortex, but it also provides cortical circuits with computational properties to perform probabilistic inference under noisy and ambiguous stimulation.

Mean-field analysis of orientation selectivity in inhibition-dominated networks of spiking neurons

Mechanisms underlying the emergence of orientation selectivity in the primary visual cortex are highly debated. Here we study the contribution of inhibition-dominated random recurrent networks to orientation selectivity, and more generally to sensory processing. By simulating and analyzing large-scale networks of spiking neurons, we investigate tuning amplification and contrast invariance of orientation selectivity in these networks. In particular, we show how selective attenuation of the common mode and amplification of the modulation component take place in these networks. Selective attenuation of the baseline, which is governed by the exceptional eigenvalue of the connectivity matrix, removes the unspecific, redundant signal component and ensures the invariance of selectivity across different contrasts. Selective amplification of modulation, which is governed by the operating regime of the network and depends on the strength of coupling, amplifies the informative signal component and thus increases the signal-to-noise ratio. Here, we perform a mean-field analysis which accounts for this process.

Genetic disruption of the On visual pathway affects cortical orientation selectivity and contrast sensitivity in mice

The retina signals stimulus contrast via parallel On and Off pathways and sends the information to higher visual centers. Here we study the role of the On pathway using mice that have null mutations in the On-specific GRM6 receptor in the retina (Pinto LH, Vitaterna MH, Shimomura K, Siepka SM, Balannik V, McDearmon EL, Omura C, Lumayag S, Invergo BM, Brandon M, Glawe B, Cantrell DR, Donald R, Inayat S, Olvera MA, Vessey KA, Kirstan A, McCall MA, Maddox D, Morgans CW, Young B, Pletcher MT, Mullins RF, Troy JB, Takahashi JS. Vis Neurosci 24: 111-123, 2007; Maddox DM, Vessey KA, Yarbrough GL, Invergo BM, Cantrell DR, Inayat S, Balannik V, Hicks WL, Hawes NL, Byers S, Smith RS, Hurd R, Howell D, Gregg RG, Chang B, Naggert JK, Troy JB, Pinto LH, Nishina PM, McCall MA. J Physiol 586: 4409-4424, 2008). In these "nob" mice, single unit recordings in the primary visual cortex (V1) reveal degraded selectivity for orientations due to an increased response at nonpreferred orientations. Contrast sensitivity in the nob mice is reduced with severe deficits at low contrast, consistent with the phenotype of night blindness in human patients with mutations in Grm6. These cortical deficits can be largely explained by reduced input drive and increased response variability seen in nob V1. Interestingly, increased variability is also observed in the superior colliculus of these mice but does not affect its tuning properties. Further, the increased response variability in the nob mice is traced to the retina, a result phenocopied by acute pharmacological blockade of the On pathway in wild-type retina. Together, our results suggest that the On and Off pathways normally interact to increase response reliability in the retina, which in turn propagates to various central visual targets and affects their functional properties.

Orientation-selective responses in the mouse lateral geniculate nucleus

The dorsal lateral geniculate nucleus (dLGN) receives visual information from the retina and transmits it to the cortex. In this study, we made extracellular recordings in the dLGN of both anesthetized and awake mice, and found that a surprisingly high proportion of cells were selective for stimulus orientation. The orientation selectivity of dLGN cells was unchanged after silencing the visual cortex pharmacologically, indicating that it is not due to cortical feedback. The orientation tuning of some dLGN cells correlated with their elongated receptive fields, while in others orientation selectivity was observed despite the fact that their receptive fields were circular, suggesting that their retinal input might already be orientation selective. Consistently, we revealed orientation/axis-selective ganglion cells in the mouse retina using multielectrode arrays in an in vitro preparation. Furthermore, the orientation tuning of dLGN cells was largely maintained at different stimulus contrasts, which could be sufficiently explained by a simple linear feedforward model. We also compared the degree of orientation selectivity in different visual structures under the same recording condition. Compared with the dLGN, orientation selectivity is greatly improved in the visual cortex, but is similar in the superior colliculus, another major retinal target. Together, our results demonstrate prominent orientation selectivity in the mouse dLGN, which may potentially contribute to visual processing in the cortex.

Spontaneous and task-evoked brain activity negatively interact

A widely held assumption is that spontaneous and task-evoked brain activity sum linearly, such that the recorded brain response in each single trial is the algebraic sum of the constantly changing ongoing activity and the stereotypical evoked activity. Using functional magnetic resonance imaging signals acquired from normal humans, we show that this assumption is invalid. Across widespread cortices, evoked activity interacts negatively with ongoing activity, such that higher prestimulus baseline results in less activation or more deactivation. As a consequence of this negative interaction, trial-to-trial variability of cortical activity decreases following stimulus onset. We further show that variability reduction follows overlapping but distinct spatial pattern from that of task-activation/deactivation and it contains behaviorally relevant information. These results favor an alternative perspective to the traditional dichotomous framework of ongoing and evoked activity. That is, to view the brain as a nonlinear dynamical system whose trajectory is tighter when performing a task. Further, incoming sensory stimuli modulate the brain's activity in a manner that depends on its initial state. We propose that across-trial variability may provide a new approach to brain mapping in the context of cognitive experiments.

Broadening of inhibitory tuning underlies contrast-dependent sharpening of orientation selectivity in mouse visual cortex

Orientation selectivity (OS) in the visual cortex has been found to be invariant to increases in stimulus contrast, a finding that cannot be accounted for by the original, purely excitatory Hubel and Wiesel model. This property of OS may be important for preserving the quality of perceived stimulus across a range of stimulus intensity. The synaptic mechanisms that can prevent a broadening of OS caused by contrast-dependent strengthening of excitatory inputs to cortical neurons remain unknown. Using in vivo loose-patch recordings, we found in excitatory neurons in layer 4 of mouse primary visual cortex (V1) that the spike response to the preferred orientation was elevated as contrast increased while that to the orthogonal orientation remained unchanged, resulting in an overall sharpening rather than a weakening of OS. Whole-cell voltage-clamp recordings further revealed that contrast increases resulted in a scaling up of excitatory conductance at all stimulus orientations. Inhibitory conductance was enhanced at a similar level as excitation for the preferred orientation, but at a significantly higher level for the orthogonal orientation. Modeling revealed that the resulting broadening of inhibitory tuning is critical for maintaining and sharpening OS at high contrast. Finally, two-photon imaging guided recordings from parvalbumin-positive (PV) inhibitory neurons revealed that the broadening of inhibition can be attributed to a contrast-dependent broadening of spike-response tuning of PV neurons. Together our results suggest that modulation of synaptic inhibition in the mouse V1 cortical circuit preserves the sharpness of response selectivity during changes of stimulus strength.

Mechanisms of neuronal computation in mammalian visual cortex

Orientation selectivity in the primary visual cortex (V1) is a receptive field property that is at once simple enough to make it amenable to experimental and theoretical approaches and yet complex enough to represent a significant transformation in the representation of the visual image. As a result, V1 has become an area of choice for studying cortical computation and its underlying mechanisms. Here we consider the receptive field properties of the simple cells in cat V1--the cells that receive direct input from thalamic relay cells--and explore how these properties, many of which are highly nonlinear, arise. We have found that many receptive field properties of V1 simple cells fall directly out of Hubel and Wiesel's feedforward model when the model incorporates realistic neuronal and synaptic mechanisms, including threshold, synaptic depression, response variability, and the membrane time constant.

Response variability of frontal eye field neurons modulates with sensory input and saccade preparation but not visual search salience

Discharge rate modulation of frontal eye field (FEF) neurons has been identified with a representation of visual search salience (physical conspicuity and behavioral relevance) and saccade preparation. We tested whether salience or saccade preparation are evident in the trial-to-trial variability of discharge rate. We quantified response variability via the Fano factor in FEF neurons recorded in monkeys performing efficient and inefficient visual search tasks. Response variability declined following stimulus presentation in most neurons, but despite clear discharge rate modulation, variability did not change with target salience. Instead, we found that response variability was modulated by stimulus luminance and the number of items in the visual field independently of attentional demands. Response variability declined to a minimum before saccade initiation, and presaccadic response variability was directionally tuned. In addition, response variability was correlated with the response time of memory-guided saccades. These results indicate that the trial-by-trial response variability of FEF neurons reflects saccade preparation and the strength of sensory input, but not visual search salience or attentional allocation.