Inhibitory stabilization of the cortical network underlies visual surround suppression

Modeling the Emergence of Circuit Organization and Function during Development

Developing neural circuits show unique patterns of spontaneous activity and structured network connectivity shaped by diverse activity-dependent plasticity mechanisms. Based on extensive experimental work characterizing patterns of spontaneous activity in different brain regions over development, theoretical and computational models have played an important role in delineating the generation and function of individual features of spontaneous activity and their role in the plasticity-driven formation of circuit connectivity. Here, we review recent modeling efforts that explore how the developing cortex and hippocampus generate spontaneous activity, focusing on specific connectivity profiles and the gradual strengthening of inhibition as the key drivers behind the observed developmental changes in spontaneous activity. We then discuss computational models that mechanistically explore how different plasticity mechanisms use this spontaneous activity to instruct the formation and refinement of circuit connectivity, from the formation of single neuron receptive fields to sensory feature maps and recurrent architectures. We end by highlighting several open challenges regarding the functional implications of the discussed circuit changes, wherein models could provide the missing step linking immature developmental and mature adult information processing capabilities.

Delayed Accumulation of Inhibitory Input Explains Gamma Frequency Variation with Changing Contrast in an Inhibition Stabilized Network

Gamma rhythm (30-70 Hz), thought to represent the interactions between excitatory and inhibitory populations, can be induced by presenting achromatic gratings in the primary visual cortex (V1) and is sensitive to stimulus properties such as size and contrast. In addition, gamma occurs in short bursts and shows a "frequency falloff" effect where its peak frequency is high after stimulus onset and slowly decreases to a steady state. Recently, these size-contrast properties and temporal characteristics were replicated in a self-oscillating Wilson-Cowan (WC) model operating as an inhibition stabilized network (ISN), stimulated by Ornstein-Uhlenbeck (OU) type inputs. In particular, frequency falloff was explained by delayed and slowly accumulated inputs arriving at local inhibitory populations. We hypothesized that if the stimulus is preceded by another higher contrast stimulus, frequency falloff could be abolished or reversed, since the excessive inhibition will now take more time to dissipate. We presented gratings at different contrasts consecutively to two female monkeys while recording gamma using microelectrode arrays in V1 and confirmed this prediction. Further, this model also replicated a characteristic pattern of gamma frequency modulation to counter-phasing stimuli as reported previously. These phenomena were also replicated by an ISN model subject to slow adaptation in feedforward excitatory input. Thus, ISN model with delayed surround input or adapted feedforward input replicates gamma frequency responses to time-varying contrasts.

Contextual modulation emerges by integrating feedforward and feedback processing in mouse visual cortex

Sensory systems use context to infer meaning. Accordingly, context profoundly influences neural responses to sensory stimuli. However, a cohesive understanding of the circuit mechanisms governing contextual effects across different stimulus conditions is still lacking. Here we present a unified circuit model of mouse visual cortex that accounts for the main standard forms of contextual modulation. This data-driven and biologically realistic circuit, including three primary inhibitory cell types, sheds light on how bottom-up, top-down, and recurrent inputs are integrated across retinotopic space to generate contextual effects in layer 2/3. We establish causal relationships between neural responses, geometrical features of the inputs, and the connectivity patterns. The model not only reveals how a single canonical cortical circuit differently modulates sensory response depending on context but also generates multiple testable predictions, offering insights that apply to broader neural circuitry.

Exact linear theory of perturbation response in a space- and feature-dependent cortical circuit model

What are the principles that govern the responses of cortical networks to their inputs and the emergence of these responses from recurrent connectivity? Recent experiments have probed these questions by measuring cortical responses to two-photon optogenetic perturbations of single cells in the mouse primary visual cortex. A robust theoretical framework is needed to determine the implications of these responses for cortical recurrence. Here we propose a novel analytical approach: a formulation of the dependence of cell-type-specific connectivity on spatial distance that yields an exact solution for the linear perturbation response of a model with multiple cell types and space- and feature-dependent connectivity. Importantly and unlike previous approaches, the solution is valid in regimes of strong as well as weak intra-cortical coupling. Analysis reveals the structure of connectivity implied by various features of single-cell perturbation responses, such as the surprisingly narrow spatial radius of nearby excitation beyond which inhibition dominates, the number of transitions between mean excitation and inhibition thereafter, and the dependence of these responses on feature preferences. Comparison of these results to existing optogenetic perturbation data yields constraints on cell-type-specific connection strengths and their tuning dependence. Finally, we provide experimental predictions regarding the response of inhibitory neurons to single-cell perturbations and the modulation of perturbation response by neuronal gain; the latter can explain observed differences in the feature-tuning of perturbation responses in the presence vs. absence of visual stimuli.

Unconditional stability of a recurrent neural circuit implementing divisive normalization

Stability in recurrent neural models poses a significant challenge, particularly in developing biologically plausible neurodynamical models that can be seamlessly trained. Traditional cortical circuit models are notoriously difficult to train due to expansive nonlinearities in the dynamical system, leading to an optimization problem with nonlinear stability constraints that are difficult to impose. Conversely, recurrent neural networks (RNNs) excel in tasks involving sequential data but lack biological plausibility and interpretability. In this work, we address these challenges by linking dynamic divisive normalization (DN) to the stability of "oscillatory recurrent gated neural integrator circuits" (ORGaNICs), a biologically plausible recurrent cortical circuit model that dynamically achieves DN and that has been shown to simulate a wide range of neurophysiological phenomena. By using the indirect method of Lyapunov, we prove the remarkable property of unconditional local stability for an arbitrary-dimensional ORGaNICs circuit when the recurrent weight matrix is the identity. We thus connect ORGaNICs to a system of coupled damped harmonic oscillators, which enables us to derive the circuit's energy function, providing a normative principle of what the circuit, and individual neurons, aim to accomplish. Further, for a generic recurrent weight matrix, we prove the stability of the 2D model and demonstrate empirically that stability holds in higher dimensions. Finally, we show that ORGaNICs can be trained by backpropagation through time without gradient clipping/scaling, thanks to its intrinsic stability property and adaptive time constants, which address the problems of exploding, vanishing, and oscillating gradients. By evaluating the model's performance on RNN benchmarks, we find that ORGaNICs outperform alternative neurodynamical models on static image classification tasks and perform comparably to LSTMs on sequential tasks.

Dissociation of focal and large-scale inhibitory functions in the older adults: A multimodal MRI study

BACKGROUND

The decline of inhibitory in cognitive aging is linked to reduced cognitive and mental capacities in older adults. However, this decline often shows inconsistent clinical presentations, suggesting varied impacts on different inhibition-related tasks. Inhibitory control, a multifaceted construct, involves various types of inhibition. Understanding these components is crucial for comprehending how aging affects inhibitory functions. Our research investigates the influences of aging on large-scale and focal-scale inhibitory and examines the relationship with brain markers.

METHODS

We examined the impact of aging on inhibitory in 18 younger (20-35 years) and 17 older adults (65-85 years) using focal and large-scale inhibition tasks. The Gabor task assessed focal-scale inhibition, while the Stop Signal Task (SST) evaluated large-scale inhibition. Participants underwent neuropsychological assessments and MRI scans, including magnetic resonance spectroscopy (MRS) and structural and resting fMRI.

RESULTS

Older adults exhibited a marked decline in inhibitory function, with slower SST responses indicating compromised large-scale inhibition. Conversely, the Gabor task showed no significant age-related changes. MRS findings revealed decreased levels of GABA, glutamate, glutamine, and NAA in the pre-SMA, correlating with observed large-scale inhibition in older adults. Additionally, pre-SMA seed-based functional connectivity analysis showed reduced brain network connections in older adults, potentially contributing to inhibitory control deficits.

CONCLUSIONS

Our study elucidates the differential effects of aging on inhibitory functions. While large-scale inhibition is more vulnerable to aging, focal-scale inhibition is relatively preserved. These findings highlight the importance of targeted cognitive interventions and underscore the necessity of a multifaceted approach in aging research.

Identifying the impact of local connectivity patterns on dynamics in excitatory-inhibitory networks

Networks of excitatory and inhibitory (EI) neurons form a canonical circuit in the brain. Seminal theoretical results on dynamics of such networks are based on the assumption that synaptic strengths depend on the type of neurons they connect, but are otherwise statistically independent. Recent synaptic physiology datasets however highlight the prominence of specific connectivity patterns that go well beyond what is expected from independent connections. While decades of influential research have demonstrated the strong role of the basic EI cell type structure, to which extent additional connectivity features influence dynamics remains to be fully determined. Here we examine the effects of pair-wise connectivity motifs on the linear dynamics in excitatory-inhibitory networks using an analytical framework that approximates the connectivity in terms of low-rank structures. This low-rank approximation is based on a mathematical derivation of the dominant eigenvalues of the connectivity matrix, and predicts the impact on responses to external inputs of connectivity motifs and their interactions with cell-type structure. Our results reveal that a particular pattern of connectivity, chain motifs, have a much stronger impact on dominant eigenmodes than other pair-wise motifs. In particular, an over-representation of chain motifs induces a strong positive eigenvalue in inhibition-dominated networks and generates a potential instability that requires revisiting the classical excitation-inhibition balance criteria. Examining effects of external inputs, we show that chain motifs can on their own induce paradoxical responses, where an increased input to inhibitory neurons leads to a decrease in their activity due to the recurrent feedback. These findings have direct implications for the interpretation of experiments in which responses to optogenetic perturbations are measured and used to infer the dynamical regime of cortical circuits.

Cellular-resolution optogenetics reveals attenuation-by-suppression in visual cortical neurons

The relationship between neurons' input and spiking output is central to brain computation. Studies in vitro and in anesthetized animals suggest that nonlinearities emerge in cells' input-output (IO; activation) functions as network activity increases, yet how neurons transform inputs in vivo has been unclear. Here, we characterize cortical principal neurons' activation functions in awake mice using two-photon optogenetics. We deliver fixed inputs at the soma while neurons' activity varies with sensory stimuli. We find that responses to fixed optogenetic input are nearly unchanged as neurons are excited, reflecting a linear response regime above neurons' resting point. In contrast, responses are dramatically attenuated by suppression. This attenuation is a powerful means to filter inputs arriving to suppressed cells, privileging other inputs arriving to excited neurons. These results have two major implications. First, somatic neural activation functions in vivo accord with the activation functions used in recent machine learning systems. Second, neurons' IO functions can filter sensory inputs-not only do sensory stimuli change neurons' spiking outputs, but these changes also affect responses to input, attenuating responses to some inputs while leaving others unchanged.

Structural influences on synaptic plasticity: The role of presynaptic connectivity in the emergence of E/I co-tuning

Cortical neurons are versatile and efficient coding units that develop strong preferences for specific stimulus characteristics. The sharpness of tuning and coding efficiency is hypothesized to be controlled by delicately balanced excitation and inhibition. These observations suggest a need for detailed co-tuning of excitatory and inhibitory populations. Theoretical studies have demonstrated that a combination of plasticity rules can lead to the emergence of excitation/inhibition (E/I) co-tuning in neurons driven by independent, low-noise signals. However, cortical signals are typically noisy and originate from highly recurrent networks, generating correlations in the inputs. This raises questions about the ability of plasticity mechanisms to self-organize co-tuned connectivity in neurons receiving noisy, correlated inputs. Here, we study the emergence of input selectivity and weight co-tuning in a neuron receiving input from a recurrent network via plastic feedforward connections. We demonstrate that while strong noise levels destroy the emergence of co-tuning in the readout neuron, introducing specific structures in the non-plastic pre-synaptic connectivity can re-establish it by generating a favourable correlation structure in the population activity. We further show that structured recurrent connectivity can impact the statistics in fully plastic recurrent networks, driving the formation of co-tuning in neurons that do not receive direct input from other areas. Our findings indicate that the network dynamics created by simple, biologically plausible structural connectivity patterns can enhance the ability of synaptic plasticity to learn input-output relationships in higher brain areas.

Local stimulation of pyramidal neurons in deep cortical layers of anesthetized rats enhances cortical visual information processing

In the primary visual cortex area V1 activation of inhibitory interneurons, which provide negative feedback for excitatory pyramidal neurons, can improve visual response reliability and orientation selectivity. Moreover, optogenetic activation of one class of interneurons, parvalbumin (PV) positive cells, reduces the receptive field (RF) width. These data suggest that in V1 the negative feedback improves visual information processing. However, according to information theory, noise can limit information content in a signal, and to the best of our knowledge, in V1 signal-to-noise ratio (SNR) has never been estimated following either pyramidal or inhibitory neuron activation. Therefore, we optogenetically activated pyramidal or PV neurons in the deep layers of cortical area V1 and measured the SNR and RF area in nearby pyramidal neurons. Activation of pyramidal or PV neurons increased the SNR by 267% and 318%, respectively, and reduced the RF area to 60.1% and 77.5%, respectively, of that of the control. A simple integrate-and-fire neuron model demonstrated that an improved SNR and a reduced RF area can increase the amount of information encoded by neurons. We conclude that in V1 activation of pyramidal neurons improves visual information processing since the location of the visual stimulus can be pinpointed more accurately (via a reduced RF area), and more information is encoded by neurons (due to increased SNR).

GABAergic inhibition in human hMT+ predicts visuo-spatial intelligence mediated through the frontal cortex

The prevailing opinion emphasizes fronto-parietal network (FPN) is key in mediating general fluid intelligence (gF). Meanwhile, recent studies show that human MT complex (hMT+), located at the occipito-temporal border and involved in 3D perception processing, also plays a key role in gF. However, the underlying mechanism is not clear, yet. To investigate this issue, our study targets visuo-spatial intelligence, which is considered to have high loading on gF. We use ultra-high field magnetic resonance spectroscopy (MRS) to measure GABA/Glu concentrations in hMT+ combining resting-state fMRI functional connectivity (FC), behavioral examinations including hMT+ perception suppression test and gF subtest in visuo-spatial component. Our findings show that both GABA in hMT+ and frontal-hMT+ functional connectivity significantly correlate with the performance of visuo-spatial intelligence. Further, serial mediation model demonstrates that the effect of hMT+ GABA on visuo-spatial gF is fully mediated by the hMT+ frontal FC. Together our findings highlight the importance in integrating sensory and frontal cortices in mediating the visuo-spatial component of general fluid intelligence.

Prefrontal synaptic regulation of homeostatic sleep pressure revealed through synaptic chemogenetics

Sleep is regulated by homeostatic processes, yet the biological basis of sleep pressure that accumulates during wakefulness, triggers sleep, and dissipates during sleep remains elusive. We explored a causal relationship between cellular synaptic strength and electroencephalography delta power indicating macro-level sleep pressure by developing a theoretical framework and a molecular tool to manipulate synaptic strength. The mathematical model predicted that increased synaptic strength promotes the neuronal "down state" and raises the delta power. Our molecular tool (synapse-targeted chemically induced translocation of Kalirin-7, SYNCit-K), which induces dendritic spine enlargement and synaptic potentiation through chemically induced translocation of protein Kalirin-7, demonstrated that synaptic potentiation of excitatory neurons in the prefrontal cortex (PFC) increases nonrapid eye movement sleep amounts and delta power. Thus, synaptic strength of PFC excitatory neurons dictates sleep pressure in mammals.

Coordinated changes in a cortical circuit sculpt effects of novelty on neural dynamics

Recent studies have found dramatic cell-type-specific responses to stimulus novelty, highlighting the importance of analyzing the cortical circuitry at this granularity to understand brain function. Although initial work characterized activity by cell type, the alterations in cortical circuitry due to interacting novelty effects remain unclear. We investigated circuit mechanisms underlying the observed neural dynamics in response to novel stimuli using a large-scale public dataset of electrophysiological recordings in behaving mice and a population network model. The model was constrained by multi-patch synaptic physiology and electron microscopy data. We found generally weaker connections under novel stimuli, with shifts in the balance between somatostatin (SST) and vasoactive intestinal polypeptide (VIP) populations and increased excitatory influences on parvalbumin (PV) and SST populations. These findings systematically characterize how cortical circuits adapt to stimulus novelty.

Presubicular VIP expressing interneurons receive facilitating excitation from anterior thalamus

The presubiculum is part of the parahippocampal cortex and plays a fundamental role for orientation in space. Many principal neurons of the presubiculum signal head direction, and show persistent firing when the head of an animal is oriented in a specific preferred direction. GABAergic neurons of the presubiculum control the timing, sensitivity and selectivity of head directional signals from the anterior thalamic nuclei. However, the role of vasoactive intestinal peptide (VIP) expressing interneurons in the presubicular microcircuit has not yet been addressed. Here, we examined the intrinsic properties of VIP interneurons as well as their input connectivity following photostimulation of anterior thalamic axons. We show that presubicular VIP interneurons are more densely distributed in superficial than in deep layers. They are highly excitable. Three groups emerged from the unsupervised cluster analysis of their electrophysiological properties. We demonstrate a frequency dependent recruitment of VIP cells by thalamic afferences and facilitating synaptic input dynamics. Our data provide initial insight into the contribution of VIP interneurons for the integration of thalamic head direction information in the presubiculum.

Behavioral state and stimulus strength regulate the role of somatostatin interneurons in stabilizing network activity

Inhibition stabilization enables cortical circuits to encode sensory signals across diverse contexts. Somatostatin-expressing (SST) interneurons are well-suited for this role through their strong recurrent connectivity with excitatory pyramidal cells. We developed a cortical circuit model predicting that SST cells become increasingly important for stabilization as sensory input strengthens. We tested this prediction in mouse primary visual cortex by manipulating excitatory input to SST cells, a key parameter for inhibition stabilization, with a novel cell-type specific pharmacological method to selectively block glutamatergic receptors on SST cells. Consistent with our model predictions, we find antagonizing glutamatergic receptors drives a paradoxical facilitation of SST cells with increasing stimulus contrast. In addition, we find even stronger engagement of SST-dependent stabilization when the mice are aroused. Thus, we reveal that the role of SST cells in cortical processing gradually switches as a function of both input strength and behavioral state.

A layered microcircuit model of somatosensory cortex with three interneuron types and cell-type-specific short-term plasticity

Three major types of GABAergic interneurons, parvalbumin-, somatostatin-, and vasoactive intestinal peptide-expressing (PV, SOM, VIP) cells, play critical but distinct roles in the cortical microcircuitry. Their specific electrophysiology and connectivity shape their inhibitory functions. To study the network dynamics and signal processing specific to these cell types in the cerebral cortex, we developed a multi-layer model incorporating biologically realistic interneuron parameters from rodent somatosensory cortex. The model is fitted to in vivo data on cell-type-specific population firing rates. With a protocol of cell-type-specific stimulation, network responses when activating different neuron types are examined. The model reproduces the experimentally observed inhibitory effects of PV and SOM cells and disinhibitory effect of VIP cells on excitatory cells. We further create a version of the model incorporating cell-type-specific short-term synaptic plasticity (STP). While the ongoing activity with and without STP is similar, STP modulates the responses of Exc, SOM, and VIP cells to cell-type-specific stimulation, presumably by changing the dominant inhibitory pathways. With slight adjustments, the model also reproduces sensory responses of specific interneuron types recorded in vivo. Our model provides predictions on network dynamics involving cell-type-specific short-term plasticity and can serve to explore the computational roles of inhibitory interneurons in sensory functions.

State modulation in spatial networks with three interneuron subtypes

Several inhibitory interneuron subtypes have been identified as critical in regulating sensory responses. However, the specific contribution of each interneuron subtype remains uncertain. In this work, we explore the contributions of cell-type specific activity and synaptic connections to dynamics of a spatially organized spiking neuron network. We find that the firing rates of the somatostatin (SOM) interneurons align closely with the level of network synchrony irrespective of the target of modulatory input. Further analysis reveals that inhibition from SOM to parvalbumin (PV) interneurons must be limited to allow gradual transitions from asynchrony to synchrony and that the strength of recurrent excitation onto SOM neurons determines the level of synchrony achievable in the network. Our results are consistent with recent experimental findings on cell-type specific manipulations. Overall, our results highlight common dynamic regimes achieved across modulations of different cell populations and identify SOM cells as the main driver of network synchrony.

A comprehensive data-driven model of cat primary visual cortex

Knowledge integration based on the relationship between structure and function of the neural substrate is one of the main targets of neuroinformatics and data-driven computational modeling. However, the multiplicity of data sources, the diversity of benchmarks, the mixing of observables of different natures, and the necessity of a long-term, systematic approach make such a task challenging. Here we present a first snapshot of a long-term integrative modeling program designed to address this issue in the domain of the visual system: a comprehensive spiking model of cat primary visual cortex. The presented model satisfies an extensive range of anatomical, statistical and functional constraints under a wide range of visual input statistics. In the presence of physiological levels of tonic stochastic bombardment by spontaneous thalamic activity, the modeled cortical reverberations self-generate a sparse asynchronous ongoing activity that quantitatively matches a range of experimentally measured statistics. When integrating feed-forward drive elicited by a high diversity of visual contexts, the simulated network produces a realistic, quantitatively accurate interplay between visually evoked excitatory and inhibitory conductances; contrast-invariant orientation-tuning width; center surround interactions; and stimulus-dependent changes in the precision of the neural code. This integrative model offers insights into how the studied properties interact, contributing to a better understanding of visual cortical dynamics. It provides a basis for future development towards a comprehensive model of low-level perception.

Adult neurogenesis improves spatial information encoding in the mouse hippocampus

Adult neurogenesis is a unique form of neuronal plasticity in which newly generated neurons are integrated into the adult dentate gyrus in a process that is modulated by environmental stimuli. Adult-born neurons can contribute to spatial memory, but it is unknown whether they alter neural representations of space in the hippocampus. Using in vivo two-photon calcium imaging, we find that male and female mice previously housed in an enriched environment, which triggers an increase in neurogenesis, have increased spatial information encoding in the dentate gyrus. Ablating adult neurogenesis blocks the effect of enrichment and lowers spatial information, as does the chemogenetic silencing of adult-born neurons. Both ablating neurogenesis and silencing adult-born neurons decreases the calcium activity of dentate gyrus neurons, resulting in a decreased amplitude of place-specific responses. These findings are in contrast with previous studies that suggested a predominantly inhibitory action for adult-born neurons. We propose that adult neurogenesis improves representations of space by increasing the gain of dentate gyrus neurons and thereby improving their ability to tune to spatial features. This mechanism may mediate the beneficial effects of environmental enrichment on spatial learning and memory.

Lateral inhibition in V1 controls neural & perceptual contrast sensitivity

Lateral inhibition is a central principle for sensory system function. It is thought to operate by the activation of inhibitory neurons that restrict the spatial spread of sensory excitation. Much work on the role of inhibition in sensory systems has focused on visual cortex; however, the neurons, computations, and mechanisms underlying cortical lateral inhibition remain debated, and its importance for visual perception remains unknown. Here, we tested how lateral inhibition from PV or SST neurons in mouse primary visual cortex (V1) modulates neural and perceptual sensitivity to stimulus contrast. Lateral inhibition from PV neurons reduced neural and perceptual sensitivity to visual contrast in a uniform subtractive manner, whereas lateral inhibition from SST neurons more effectively changed the slope (or gain) of neural and perceptual contrast sensitivity. A neural circuit model identified spatially extensive lateral projections from SST neurons as the key factor, and we confirmed this with anatomy and direct subthreshold measurements of a larger spatial footprint for SST versus PV lateral inhibition. Together, these results define cell-type specific computational roles for lateral inhibition in V1, and establish their unique consequences on sensitivity to contrast, a fundamental aspect of the visual world.

Learning Fixed Points of Recurrent Neural Networks by Reparameterizing the Network Model

In computational neuroscience, recurrent neural networks are widely used to model neural activity and learning. In many studies, fixed points of recurrent neural networks are used to model neural responses to static or slowly changing stimuli, such as visual cortical responses to static visual stimuli. These applications raise the question of how to train the weights in a recurrent neural network to minimize a loss function evaluated on fixed points. In parallel, training fixed points is a central topic in the study of deep equilibrium models in machine learning. A natural approach is to use gradient descent on the Euclidean space of weights. We show that this approach can lead to poor learning performance due in part to singularities that arise in the loss surface. We use a reparameterization of the recurrent network model to derive two alternative learning rules that produce more robust learning dynamics. We demonstrate that these learning rules avoid singularities and learn more effectively than standard gradient descent. The new learning rules can be interpreted as steepest descent and gradient descent, respectively, under a non-Euclidean metric on the space of recurrent weights. Our results question the common, implicit assumption that learning in the brain should be expected to follow the negative Euclidean gradient of synaptic weights.

The mechanics of correlated variability in segregated cortical excitatory subnetworks

Understanding the genesis of shared trial-to-trial variability in neuronal population activity within the sensory cortex is critical to uncovering the biological basis of information processing in the brain. Shared variability is often a reflection of the structure of cortical connectivity since it likely arises, in part, from local circuit inputs. A series of experiments from segregated networks of (excitatory) pyramidal neurons in the mouse primary visual cortex challenge this view. Specifically, the across-network correlations were found to be larger than predicted given the known weak cross-network connectivity. We aim to uncover the circuit mechanisms responsible for these enhanced correlations through biologically motivated cortical circuit models. Our central finding is that coupling each excitatory subpopulation with a specific inhibitory subpopulation provides the most robust network-intrinsic solution in shaping these enhanced correlations. This result argues for the existence of excitatory-inhibitory functional assemblies in early sensory areas which mirror not just response properties but also connectivity between pyramidal cells. Furthermore, our findings provide theoretical support for recent experimental observations showing that cortical inhibition forms structural and functional subnetworks with excitatory cells, in contrast to the classical view that inhibition is a nonspecific blanket suppression of local excitation.

Synapse-type-specific competitive Hebbian learning forms functional recurrent networks

Cortical networks exhibit complex stimulus-response patterns that are based on specific recurrent interactions between neurons. For example, the balance between excitatory and inhibitory currents has been identified as a central component of cortical computations. However, it remains unclear how the required synaptic connectivity can emerge in developing circuits where synapses between excitatory and inhibitory neurons are simultaneously plastic. Using theory and modeling, we propose that a wide range of cortical response properties can arise from a single plasticity paradigm that acts simultaneously at all excitatory and inhibitory connections-Hebbian learning that is stabilized by the synapse-type-specific competition for a limited supply of synaptic resources. In plastic recurrent circuits, this competition enables the formation and decorrelation of inhibition-balanced receptive fields. Networks develop an assembly structure with stronger synaptic connections between similarly tuned excitatory and inhibitory neurons and exhibit response normalization and orientation-specific center-surround suppression, reflecting the stimulus statistics during training. These results demonstrate how neurons can self-organize into functional networks and suggest an essential role for synapse-type-specific competitive learning in the development of cortical circuits.

The stabilized supralinear network accounts for the contrast dependence of visual cortical gamma oscillations

When stimulated, neural populations in the visual cortex exhibit fast rhythmic activity with frequencies in the gamma band (30-80 Hz). The gamma rhythm manifests as a broad resonance peak in the power-spectrum of recorded local field potentials, which exhibits various stimulus dependencies. In particular, in macaque primary visual cortex (V1), the gamma peak frequency increases with increasing stimulus contrast. Moreover, this contrast dependence is local: when contrast varies smoothly over visual space, the gamma peak frequency in each cortical column is controlled by the local contrast in that column's receptive field. No parsimonious mechanistic explanation for these contrast dependencies of V1 gamma oscillations has been proposed. The stabilized supralinear network (SSN) is a mechanistic model of cortical circuits that has accounted for a range of visual cortical response nonlinearities and contextual modulations, as well as their contrast dependence. Here, we begin by showing that a reduced SSN model without retinotopy robustly captures the contrast dependence of gamma peak frequency, and provides a mechanistic explanation for this effect based on the observed non-saturating and supralinear input-output function of V1 neurons. Given this result, the local dependence on contrast can trivially be captured in a retinotopic SSN which however lacks horizontal synaptic connections between its cortical columns. However, long-range horizontal connections in V1 are in fact strong, and underlie contextual modulation effects such as surround suppression. We thus explored whether a retinotopically organized SSN model of V1 with strong excitatory horizontal connections can exhibit both surround suppression and the local contrast dependence of gamma peak frequency. We found that retinotopic SSNs can account for both effects, but only when the horizontal excitatory projections are composed of two components with different patterns of spatial fall-off with distance: a short-range component that only targets the source column, combined with a long-range component that targets columns neighboring the source column. We thus make a specific qualitative prediction for the spatial structure of horizontal connections in macaque V1, consistent with the columnar structure of cortex.

Cortical determinants of loudness perception and auditory hypersensitivity

Parvalbumin-expressing inhibitory neurons (PVNs) stabilize cortical network activity, generate gamma rhythms, and regulate experience-dependent plasticity. Here, we observed that activation or inactivation of PVNs functioned like a volume knob in the mouse auditory cortex (ACtx), turning neural and behavioral classification of sound level up or down over a 20dB range. PVN loudness adjustments were "sticky", such that a single bout of 40Hz PVN stimulation sustainably suppressed ACtx sound responsiveness, potentiated feedforward inhibition, and behaviorally desensitized mice to loudness. Sensory sensitivity is a cardinal feature of autism, aging, and peripheral neuropathy, prompting us to ask whether PVN stimulation can persistently desensitize mice with ACtx hyperactivity, PVN hypofunction, and loudness hypersensitivity triggered by cochlear sensorineural damage. We found that a single 16-minute bout of 40Hz PVN stimulation session restored normal loudness perception for one week, showing that perceptual deficits triggered by irreversible peripheral injuries can be reversed through targeted cortical circuit interventions.

Ex Vivo Cortical Circuits Learn to Predict and Spontaneously Replay Temporal Patterns

It has been proposed that prediction and timing are computational primitives of neocortical microcircuits, specifically, that neural mechanisms are in place to allow neocortical circuits to autonomously learn the temporal structure of external stimuli and generate internal predictions. To test this hypothesis, we trained cortical organotypic slices on two specific temporal patterns using dual-optical stimulation. After 24-hours of training, whole-cell recordings revealed network dynamics consistent with training-specific timed prediction. Unexpectedly, there was replay of the learned temporal structure during spontaneous activity. Furthermore, some neurons exhibited timed prediction errors. Mechanistically our results indicate that learning relied in part on asymmetric connectivity between distinct neuronal ensembles with temporally-ordered activation. These findings further suggest that local cortical microcircuits are intrinsically capable of learning temporal information and generating predictions, and that the learning rules underlying temporal learning and spontaneous replay can be intrinsic to local cortical microcircuits and not necessarily dependent on top-down interactions.

Single-cell optogenetics reveals attenuation-by-suppression in visual cortical neurons

The relationship between neurons' input and spiking output is central to brain computation. Studies in vitro and in anesthetized animals suggest nonlinearities emerge in cells' input-output (activation) functions as network activity increases, yet how neurons transform inputs in vivo has been unclear. Here, we characterize cortical principal neurons' activation functions in awake mice using two-photon optogenetics. We deliver fixed inputs at the soma while neurons' activity varies with sensory stimuli. We find responses to fixed optogenetic input are nearly unchanged as neurons are excited, reflecting a linear response regime above neurons' resting point. In contrast, responses are dramatically attenuated by suppression. This attenuation is a powerful means to filter inputs arriving to suppressed cells, privileging other inputs arriving to excited neurons. These results have two major implications. First, somatic neural activation functions in vivo accord with the activation functions used in recent machine learning systems. Second, neurons' IO functions can filter sensory inputs - not only do sensory stimuli change neurons' spiking outputs, but these changes also affect responses to input, attenuating responses to some inputs while leaving others unchanged.

Top-down modulation in canonical cortical circuits with short-term plasticity

Cortical dynamics and computations are strongly influenced by diverse GABAergic interneurons, including those expressing parvalbumin (PV), somatostatin (SST), and vasoactive intestinal peptide (VIP). Together with excitatory (E) neurons, they form a canonical microcircuit and exhibit counterintuitive nonlinear phenomena. One instance of such phenomena is response reversal, whereby SST neurons show opposite responses to top-down modulation via VIP depending on the presence of bottom-up sensory input, indicating that the network may function in different regimes under different stimulation conditions. Combining analytical and computational approaches, we demonstrate that model networks with multiple interneuron subtypes and experimentally identified short-term plasticity mechanisms can implement response reversal. Surprisingly, despite not directly affecting SST and VIP activity, PV-to-E short-term depression has a decisive impact on SST response reversal. We show how response reversal relates to inhibition stabilization and the paradoxical effect in the presence of several short-term plasticity mechanisms demonstrating that response reversal coincides with a change in the indispensability of SST for network stabilization. In summary, our work suggests a role of short-term plasticity mechanisms in generating nonlinear phenomena in networks with multiple interneuron subtypes and makes several experimentally testable predictions.

A primary sensory cortical interareal feedforward inhibitory circuit for tacto-visual integration

Tactile sensation and vision are often both utilized for the exploration of objects that are within reach though it is not known whether or how these two distinct sensory systems combine such information. Here in mice, we used a combination of stereo photogrammetry for 3D reconstruction of the whisker array, brain-wide anatomical tracing and functional connectivity analysis to explore the possibility of tacto-visual convergence in sensory space and within the circuitry of the primary visual cortex (VISp). Strikingly, we find that stimulation of the contralateral whisker array suppresses visually evoked activity in a tacto-visual sub-region of VISp whose visual space representation closely overlaps with the whisker search space. This suppression is mediated by local fast-spiking interneurons that receive a direct cortico-cortical input predominantly from layer 6 neurons located in the posterior primary somatosensory barrel cortex (SSp-bfd). These data demonstrate functional convergence within and between two primary sensory cortical areas for multisensory object detection and recognition.

Neural correlates of perceptual similarity masking in primate V1

Visual detection is a fundamental natural task. Detection becomes more challenging as the similarity between the target and the background in which it is embedded increases, a phenomenon termed 'similarity masking'. To test the hypothesis that V1 contributes to similarity masking, we used voltage sensitive dye imaging (VSDI) to measure V1 population responses while macaque monkeys performed a detection task under varying levels of target-background similarity. Paradoxically, we find that during an initial transient phase, V1 responses to the target are enhanced, rather than suppressed, by target-background similarity. This effect reverses in the second phase of the response, so that in this phase V1 signals are positively correlated with the behavioral effect of similarity. Finally, we show that a simple model with delayed divisive normalization can qualitatively account for our findings. Overall, our results support the hypothesis that a nonlinear gain control mechanism in V1 contributes to perceptual similarity masking.

Visual surround suppression at the neural and perceptual levels

Surround suppression was initially identified as a phenomenon at the neural level in which stimuli outside the neuron's receptive field alone cannot activate responses but can modulate neural responses to stimuli covered inside the receptive field. Subsequent studies showed that surround suppression is not only a critical property of neurons across species and brain areas but also has been found in visual perceptions. More importantly, surround suppression varies across individuals and shows significant differences between normal controls and patients with certain mental disorders. Here, we combined results from related literature and summarized the findings derived from physiological and psychophysical evidence. We first outline the basic properties of surround suppression in the visual system and perceptions. Then, we mainly summarize the differences in perceptual surround suppression among different human subjects. Our review suggests that there is no consensus regarding whether the strength of perceptual surround suppression could be used as an effective index to distinguish particular populations. Then, we summarized the similar mechanisms for surround suppression and cognitive impairments to further explore the potential clinical applications of surround suppression. A clearer understanding of the mechanisms of surround suppression in neural responses and perceptions is necessary for facilitating its clinical applications.

Response sub-additivity and variability quenching in visual cortex

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

The influence of cortical activity on perception depends on behavioral state and sensory context

The mechanistic link between neural circuit activity and behavior remains unclear. While manipulating cortical activity can bias certain behaviors and elicit artificial percepts, some tasks can still be solved when cortex is silenced or removed. Here, mice were trained to perform a visual detection task during which we selectively targeted groups of visually responsive and co-tuned neurons in L2/3 of primary visual cortex (V1) for two-photon photostimulation. The influence of photostimulation was conditional on two key factors: the behavioral state of the animal and the contrast of the visual stimulus. The detection of low-contrast stimuli was enhanced by photostimulation, while the detection of high-contrast stimuli was suppressed, but crucially, only when mice were highly engaged in the task. When mice were less engaged, our manipulations of cortical activity had no effect on behavior. The behavioral changes were linked to specific changes in neuronal activity. The responses of non-photostimulated neurons in the local network were also conditional on two factors: their functional similarity to the photostimulated neurons and the contrast of the visual stimulus. Functionally similar neurons were increasingly suppressed by photostimulation with increasing visual stimulus contrast, correlating with the change in behavior. Our results show that the influence of cortical activity on perception is not fixed, but dynamically and contextually modulated by behavioral state, ongoing activity and the routing of information through specific circuits.

Stable fixed points of combinatorial threshold-linear networks

Combinatorial threshold-linear networks (CTLNs) are a special class of recurrent neural networks whose dynamics are tightly controlled by an underlying directed graph. Recurrent networks have long been used as models for associative memory and pattern completion, with stable fixed points playing the role of stored memory patterns in the network. In prior work, we showed that target-free cliques of the graph correspond to stable fixed points of the dynamics, and we conjectured that these are the only stable fixed points possible [1, 2]. In this paper, we prove that the conjecture holds in a variety of special cases, including for networks with very strong inhibition and graphs of size n ≤ 4 . We also provide further evi-dence for the conjecture by showing that sparse graphs and graphs that are nearly cliques can never support stable fixed points. Finally, we translate some results from extremal com-binatorics to obtain an upper bound on the number of stable fixed points of CTLNs in cases where the conjecture holds.

Primate neocortex performs balanced sensory amplification

The sensory cortex amplifies relevant features of external stimuli. This sensitivity and selectivity arise through the transformation of inputs by cortical circuitry. We characterize the circuit mechanisms and dynamics of cortical amplification by making large-scale simultaneous measurements of single cells in awake primates and testing computational models. By comparing network activity in both driven and spontaneous states with models, we identify the circuit as operating in a regime of non-normal balanced amplification. Incoming inputs are strongly but transiently amplified by strong recurrent feedback from the disruption of excitatory-inhibitory balance in the network. Strong inhibition rapidly quenches responses, thereby permitting the tracking of time-varying stimuli.

Learning what matters: Synaptic plasticity with invariance to second-order input correlations

Cortical populations of neurons develop sparse representations adapted to the statistics of the environment. To learn efficient population codes, synaptic plasticity mechanisms must differentiate relevant latent features from spurious input correlations, which are omnipresent in cortical networks. Here, we develop a theory for sparse coding and synaptic plasticity that is invariant to second-order correlations in the input. Going beyond classical Hebbian learning, our learning objective explains the functional form of observed excitatory plasticity mechanisms, showing how Hebbian long-term depression (LTD) cancels the sensitivity to second-order correlations so that receptive fields become aligned with features hidden in higher-order statistics. Invariance to second-order correlations enhances the versatility of biologically realistic learning models, supporting optimal decoding from noisy inputs and sparse population coding from spatially correlated stimuli. In a spiking model with triplet spike-timing-dependent plasticity (STDP), we show that individual neurons can learn localized oriented receptive fields, circumventing the need for input preprocessing, such as whitening, or population-level lateral inhibition. The theory advances our understanding of local unsupervised learning in cortical circuits, offers new interpretations of the Bienenstock-Cooper-Munro and triplet STDP models, and assigns a specific functional role to synaptic LTD mechanisms in pyramidal neurons.

The logic of recurrent circuits in the primary visual cortex

Recurrent cortical activity sculpts visual perception by refining, amplifying or suppressing visual input. However, the rules that govern the influence of recurrent activity remain enigmatic. We used ensemble-specific two-photon optogenetics in the mouse visual cortex to isolate the impact of recurrent activity from external visual input. We found that the spatial arrangement and the visual feature preference of the stimulated ensemble and the neighboring neurons jointly determine the net effect of recurrent activity. Photoactivation of these ensembles drives suppression in all cells beyond 30 µm but uniformly drives activation in closer similarly tuned cells. In nonsimilarly tuned cells, compact, cotuned ensembles drive net suppression, while diffuse, cotuned ensembles drive activation. Computational modeling suggests that highly local recurrent excitatory connectivity and selective convergence onto inhibitory neurons explain these effects. Our findings reveal a straightforward logic in which space and feature preference of cortical ensembles determine their impact on local recurrent activity.

Serotonergic Modulation of the Excitation/Inhibition Balance in the Visual Cortex

Serotonergic neurons constitute one of the main systems of neuromodulators, whose diffuse projections regulate the functions of the cerebral cortex. Serotonin (5-HT) is known to play a crucial role in the differential modulation of cortical activity related to behavioral contexts. Some features of the 5-HT signaling organization suggest its possible participation as a modulator of activity-dependent synaptic changes during the critical period of the primary visual cortex (V1). Cells of the serotonergic system are among the first neurons to differentiate and operate. During postnatal development, ramifications from raphe nuclei become massively distributed in the visual cortical area, remarkably increasing the availability of 5-HT for the regulation of excitatory and inhibitory synaptic activity. A substantial amount of evidence has demonstrated that synaptic plasticity at pyramidal neurons of the superficial layers of V1 critically depends on a fine regulation of the balance between excitation and inhibition (E/I). 5-HT could therefore play an important role in controlling this balance, providing the appropriate excitability conditions that favor synaptic modifications. In order to explore this possibility, the present work used in vitro intracellular electrophysiological recording techniques to study the effects of 5-HT on the E/I balance of V1 layer 2/3 neurons, during the critical period. Serotonergic action on the E/I balance has been analyzed on spontaneous activity, evoked synaptic responses, and long-term depression (LTD). Our results pointed out that the predominant action of 5-HT implies a reduction in the E/I balance. 5-HT promoted LTD at excitatory synapses while blocking it at inhibitory synaptic sites, thus shifting the Hebbian alterations of synaptic strength towards lower levels of E/I balance.

Circuit mechanism for suppression of frontal cortical ignition during NREM sleep

Conscious perception is greatly diminished during sleep, but the underlying circuit mechanism is poorly understood. We show that cortical ignition-a brain process shown to be associated with conscious awareness in humans and non-human primates-is strongly suppressed during non-rapid-eye-movement (NREM) sleep in mice due to reduced cholinergic modulation and rapid inhibition of cortical responses. Brain-wide functional ultrasound imaging and cell-type-specific calcium imaging combined with optogenetics showed that activity propagation from visual to frontal cortex is markedly reduced during NREM sleep due to strong inhibition of frontal pyramidal neurons. Chemogenetic activation and inactivation of basal forebrain cholinergic neurons powerfully increased and decreased visual-to-frontal activity propagation, respectively. Furthermore, although multiple subtypes of dendrite-targeting GABAergic interneurons in the frontal cortex are more active during wakefulness, soma-targeting parvalbumin-expressing interneurons are more active during sleep. Chemogenetic manipulation of parvalbumin interneurons showed that sleep/wake-dependent cortical ignition is strongly modulated by perisomatic inhibition of pyramidal neurons.

Excitation creates a distributed pattern of cortical suppression due to varied recurrent input

Dense local, recurrent connections are a major feature of cortical circuits, yet how they affect neurons' responses has been unclear, with some studies reporting weak recurrent effects, some reporting amplification, and others indicating local suppression. Here, we show that optogenetic input to mouse V1 excitatory neurons generates salt-and-pepper patterns of both excitation and suppression. Responses in individual neurons are not strongly predicted by that neuron's direct input. A balanced-state network model reconciles a set of diverse observations: the observed dynamics, suppressed responses, decoupling of input and output, and long tail of excited responses. The model shows recurrent excitatory-excitatory connections are strong and also variable across neurons. Together, these results demonstrate that excitatory recurrent connections can have major effects on cortical computations by shaping and changing neurons' responses to input.

Mechanisms underlying reshuffling of visual responses by optogenetic stimulation in mice and monkeys

The ability to optogenetically perturb neural circuits opens an unprecedented window into mechanisms governing circuit function. We analyzed and theoretically modeled neuronal responses to visual and optogenetic inputs in mouse and monkey V1. In both species, optogenetic stimulation of excitatory neurons strongly modulated the activity of single neurons yet had weak or no effects on the distribution of firing rates across the population. Thus, the optogenetic inputs reshuffled firing rates across the network. Key statistics of mouse and monkey responses lay on a continuum, with mice/monkeys occupying the low-/high-rate regions, respectively. We show that neuronal reshuffling emerges generically in randomly connected excitatory/inhibitory networks, provided the coupling strength (combination of recurrent coupling and external input) is sufficient that powerful inhibitory feedback cancels the mean optogenetic input. A more realistic model, distinguishing tuned visual vs. untuned optogenetic input in a structured network, reduces the coupling strength needed to explain reshuffling.

Amplitude- and frequency-dependent activation of layer II/III neurons by intracortical microstimulation

Intracortical microstimulation (ICMS) has been used for the development of brain machine interfaces. However, further understanding about the spatiotemporal responses of neurons to different electrical stimulation parameters is necessary to inform the design of optimal therapies. In this study, we employed in vivo electrophysiological recording, two-photon calcium imaging, and electric field simulation to evaluate the acute effect of ICMS on layer II/III neurons. Our results show that stimulation frequency non-linearly modulates neuronal responses, whereas the magnitude of responses is linearly correlated to the electric field strength and stimulation amplitude before reaching a steady state. Temporal dynamics of neurons' responses depends more on stimulation frequency and their distance to the stimulation electrode. In addition, amplitude-dependent post-stimulation suppression was observed within ∼500 μm of the stimulation electrode, as evidenced by both calcium imaging and local field potentials. These findings provide insights for selecting stimulation parameters to achieve desirable spatiotemporal specificity of ICMS.

Response retention and apparent motion effect in visual cortex models

Apparent motion is a visual illusion in which stationary stimuli, flashing in distinct spatial locations at certain time intervals, are perceived as one stimulus moving between these locations. In the primary visual cortex, apparent-motion stimuli produce smooth spatio-temporal patterns of activity similar to those produced by continuously moving stimuli. An important prerequisite for producing such activity patterns is prolongation of responses to brief stimuli. Indeed, a brief stimulus can evoke in the visual cortex a long response, outlasting the stimulus by hundreds of milliseconds. Here we use firing-rate based models with simple ring structure, and biologically-detailed conductance-based refractory density (CBRD) model with retinotopic space representation to analyze the response retention and the origin of smooth profiles of activity in response to apparent-motion stimuli. We show that the strength of recurrent connectivity is the major factor that endorses neuronal networks with the ability for response retention. The same strengths of recurrent connections mediate the appearance of bump attractor in the ring models. Factors such as synaptic depression, NMDA receptor mediated currents, and conductances regulating spike adaptation influence response retention, but cannot substitute for the weakness of recurrent connections to reproduce response retention in models with weak connectivity. However, the weakness of lateral recurrent connections can be compensated by layering: in multi-layer models even with weaker connections the activity retains due to its feedforward propagation from layer to layer. Using CBRD model with retinotopic space representation we further show that smooth spatio-temporal profiles of activity in response to apparent-motion stimuli are produced in the models expressing response retention, but not in the models that fail to produce response retention. Together, these results demonstrate a link between response retention and the ability of neuronal networks to generate spatio-temporal patterns of activity, which are compatible with perception of apparent motion.

Adaptive oscillators support Bayesian prediction in temporal processing

Humans excel at predictively synchronizing their behavior with external rhythms, as in dance or music performance. The neural processes underlying rhythmic inferences are debated: whether predictive perception relies on high-level generative models or whether it can readily be implemented locally by hard-coded intrinsic oscillators synchronizing to rhythmic input remains unclear and different underlying computational mechanisms have been proposed. Here we explore human perception for tone sequences with some temporal regularity at varying rates, but with considerable variability. Next, using a dynamical systems perspective, we successfully model the participants behavior using an adaptive frequency oscillator which adjusts its spontaneous frequency based on the rate of stimuli. This model better reflects human behavior than a canonical nonlinear oscillator and a predictive ramping model-both widely used for temporal estimation and prediction-and demonstrate that the classical distinction between absolute and relative computational mechanisms can be unified under this framework. In addition, we show that neural oscillators may constitute hard-coded physiological priors-in a Bayesian sense-that reduce temporal uncertainty and facilitate the predictive processing of noisy rhythms. Together, the results show that adaptive oscillators provide an elegant and biologically plausible means to subserve rhythmic inference, reconciling previously incompatible frameworks for temporal inferential processes.

NEURAL CORRELATES OF PERCEPTUAL SIMILARITY MASKING IN PRIMATE V1

Visual detection is a fundamental natural task. Detection becomes more challenging as the similarity between the target and the background in which it is embedded increases, a phenomenon termed "similarity masking". To test the hypothesis that V1 contributes to similarity masking, we used voltage sensitive dye imaging (VSDI) to measure V1 population responses while macaque monkeys performed a detection task under varying levels of target-background similarity. Paradoxically, we find that during an initial transient phase, V1 responses to the target are enhanced, rather than suppressed, by target-background similarity. This effect reverses in the second phase of the response, so that in this phase V1 signals are positively correlated with the behavioral effect of similarity. Finally, we show that a simple model with delayed divisive normalization can qualitatively account for our findings. Overall, our results support the hypothesis that a nonlinear gain control mechanism in V1 contributes to perceptual similarity masking.

VIP interneurons regulate cortical size tuning and visual perception

Cortical circuit function is regulated by extensively interconnected, diverse populations of GABAergic interneurons that may play key roles in shaping circuit operation according to behavioral context. A specialized population of interneurons that co-express vasoactive intestinal peptides (VIP-INs) are activated during arousal and innervate other INs and pyramidal neurons (PNs). Although state-dependent modulation of VIP-INs has been extensively studied, their role in regulating sensory processing is less well understood. We examined the impact of VIP-INs in the primary visual cortex of awake behaving mice. Loss of VIP-IN activity alters the behavioral state-dependent modulation of somatostatin-expressing INs (SST-INs) but not PNs. In contrast, reduced VIP-IN activity globally disrupts visual feature selectivity for stimulus size. Moreover, the impact of VIP-INs on perceptual behavior varies with context and is more acute for small than large visual cues. VIP-INs thus contribute to both state-dependent modulation of cortical activity and sensory context-dependent perceptual performance.

Generalizing biological surround suppression based on center surround similarity via deep neural network models

Sensory perception is dramatically influenced by the context. Models of contextual neural surround effects in vision have mostly accounted for Primary Visual Cortex (V1) data, via nonlinear computations such as divisive normalization. However, surround effects are not well understood within a hierarchy, for neurons with more complex stimulus selectivity beyond V1. We utilized feedforward deep convolutional neural networks and developed a gradient-based technique to visualize the most suppressive and excitatory surround. We found that deep neural networks exhibited a key signature of surround effects in V1, highlighting center stimuli that visually stand out from the surround and suppressing responses when the surround stimulus is similar to the center. We found that in some neurons, especially in late layers, when the center stimulus was altered, the most suppressive surround surprisingly can follow the change. Through the visualization approach, we generalized previous understanding of surround effects to more complex stimuli, in ways that have not been revealed in visual cortices. In contrast, the suppression based on center surround similarity was not observed in an untrained network. We identified further successes and mismatches of the feedforward CNNs to the biology. Our results provide a testable hypothesis of surround effects in higher visual cortices, and the visualization approach could be adopted in future biological experimental designs.

Propagation of activity through the cortical hierarchy and perception are determined by neural variability

Brains are composed of anatomically and functionally distinct regions performing specialized tasks, but regions do not operate in isolation. Orchestration of complex behaviors requires communication between brain regions, but how neural dynamics are organized to facilitate reliable transmission is not well understood. Here we studied this process directly by generating neural activity that propagates between brain regions and drives behavior, assessing how neural populations in sensory cortex cooperate to transmit information. We achieved this by imaging two densely interconnected regions-the primary and secondary somatosensory cortex (S1 and S2)-in mice while performing two-photon photostimulation of S1 neurons and assigning behavioral salience to the photostimulation. We found that the probability of perception is determined not only by the strength of the photostimulation but also by the variability of S1 neural activity. Therefore, maximizing the signal-to-noise ratio of the stimulus representation in cortex relative to the noise or variability is critical to facilitate activity propagation and perception.

Inhibitory stabilized network behaviour in a balanced neural mass model of a cortical column

Strong inhibitory recurrent connections can reduce the tendency for a neural network to become unstable. This is known as inhibitory stabilization; networks that are unstable in the absence of strong inhibitory feedback because of their unstable excitatory recurrent connections are known as Inhibition Stabilized Networks (ISNs). One of the characteristics of ISNs is their "paradoxical response", where perturbing the inhibitory neurons with additional excitatory input results in a decrease in their activity after a temporal delay instead of increasing their activity. Here, we develop a model of populations of neurons across different layers of cortex. Within each layer, there is one population of inhibitory neurons and one population of excitatory neurons. The connectivity weights across different populations in the model are derived from a synaptic physiology database provided by the Allen Institute. The model shows a gradient of excitation-inhibition balance across different layers in the cortex, where superficial layers are more inhibitory dominated compared to deeper layers. To investigate the presence of ISNs across different layers, we measured the membrane potentials of neural populations in the model after perturbing inhibitory populations. The results show that layer 2/3 in the model does not operate in the ISN regime but layers 4 and 5 do operate in the ISN regime. These results accord with neurophysiological findings that explored the presence of ISNs across different layers in the cortex. The results show that there may be a systematic macroscopic gradient of inhibitory stabilization across different layers in the cortex that depends on the level of excitation-inhibition balance, and that the strength of the paradoxical response increases as the model moves closer to bifurcation points.

Investigating the ability of astrocytes to drive neural network synchrony

Recent experimental works have implicated astrocytes as a significant cell type underlying several neuronal processes in the mammalian brain, from encoding sensory information to neurological disorders. Despite this progress, it is still unclear how astrocytes are communicating with and driving their neuronal neighbors. While previous computational modeling works have helped propose mechanisms responsible for driving these interactions, they have primarily focused on interactions at the synaptic level, with microscale models of calcium dynamics and neurotransmitter diffusion. Since it is computationally infeasible to include the intricate microscale details in a network-scale model, little computational work has been done to understand how astrocytes may be influencing spiking patterns and synchronization of large networks. We overcome this issue by first developing an "effective" astrocyte that can be easily implemented to already established network frameworks. We do this by showing that the astrocyte proximity to a synapse makes synaptic transmission faster, weaker, and less reliable. Thus, our "effective" astrocytes can be incorporated by considering heterogeneous synaptic time constants, which are parametrized only by the degree of astrocytic proximity at that synapse. We then apply our framework to large networks of exponential integrate-and-fire neurons with various spatial structures. Depending on key parameters, such as the number of synapses ensheathed and the strength of this ensheathment, we show that astrocytes can push the network to a synchronous state and exhibit spatially correlated patterns.