Decorrelation of neural-network activity by inhibitory feedback

Neural manifolds in V1 change with top-down signals from V4 targeting the foveal region

High-dimensional brain activity is often organized into lower-dimensional neural manifolds. However, the neural manifolds of the visual cortex remain understudied. Here, we study large-scale multi-electrode electrophysiological recordings of macaque (Macaca mulatta) areas V1, V4, and DP with a high spatiotemporal resolution. We find that the population activity of V1 contains two separate neural manifolds, which correlate strongly with eye closure (eyes open/closed) and have distinct dimensionalities. Moreover, we find strong top-down signals from V4 to V1, particularly to the foveal region of V1, which are significantly stronger during the eyes-open periods. Finally, in silico simulations of a balanced spiking neuron network qualitatively reproduce the experimental findings. Taken together, our analyses and simulations suggest that top-down signals modulate the population activity of V1. We postulate that the top-down modulation during the eyes-open periods prepares V1 for fast and efficient visual responses, resulting in a type of visual stand-by state.

Gradient-free training of recurrent neural networks using random perturbations

Recurrent neural networks (RNNs) hold immense potential for computations due to their Turing completeness and sequential processing capabilities, yet existing methods for their training encounter efficiency challenges. Backpropagation through time (BPTT), the prevailing method, extends the backpropagation (BP) algorithm by unrolling the RNN over time. However, this approach suffers from significant drawbacks, including the need to interleave forward and backward phases and store exact gradient information. Furthermore, BPTT has been shown to struggle to propagate gradient information for long sequences, leading to vanishing gradients. An alternative strategy to using gradient-based methods like BPTT involves stochastically approximating gradients through perturbation-based methods. This learning approach is exceptionally simple, necessitating only forward passes in the network and a global reinforcement signal as feedback. Despite its simplicity, the random nature of its updates typically leads to inefficient optimization, limiting its effectiveness in training neural networks. In this study, we present a new approach to perturbation-based learning in RNNs whose performance is competitive with BPTT, while maintaining the inherent advantages over gradient-based learning. To this end, we extend the recently introduced activity-based node perturbation (ANP) method to operate in the time domain, leading to more efficient learning and generalization. We subsequently conduct a range of experiments to validate our approach. Our results show similar performance, convergence time and scalability when compared to BPTT, strongly outperforming standard node perturbation and weight perturbation methods. These findings suggest that perturbation-based learning methods offer a versatile alternative to gradient-based methods for training RNNs which can be ideally suited for neuromorphic computing applications.

The mechanics of correlated variability in segregated cortical excitatory subnetworks

Understanding the genesis of shared trial-to-trial variability in neuronal population activity within the sensory cortex is critical to uncovering the biological basis of information processing in the brain. Shared variability is often a reflection of the structure of cortical connectivity since it likely arises, in part, from local circuit inputs. A series of experiments from segregated networks of (excitatory) pyramidal neurons in the mouse primary visual cortex challenge this view. Specifically, the across-network correlations were found to be larger than predicted given the known weak cross-network connectivity. We aim to uncover the circuit mechanisms responsible for these enhanced correlations through biologically motivated cortical circuit models. Our central finding is that coupling each excitatory subpopulation with a specific inhibitory subpopulation provides the most robust network-intrinsic solution in shaping these enhanced correlations. This result argues for the existence of excitatory-inhibitory functional assemblies in early sensory areas which mirror not just response properties but also connectivity between pyramidal cells. Furthermore, our findings provide theoretical support for recent experimental observations showing that cortical inhibition forms structural and functional subnetworks with excitatory cells, in contrast to the classical view that inhibition is a nonspecific blanket suppression of local excitation.

Shared input and recurrency in neural networks for metabolically efficient information transmission

Shared input to a population of neurons induces noise correlations, which can decrease the information carried by a population activity. Inhibitory feedback in recurrent neural networks can reduce the noise correlations and thus increase the information carried by the population activity. However, the activity of inhibitory neurons is costly. This inhibitory feedback decreases the gain of the population. Thus, depolarization of its neurons requires stronger excitatory synaptic input, which is associated with higher ATP consumption. Given that the goal of neural populations is to transmit as much information as possible at minimal metabolic costs, it is unclear whether the increased information transmission reliability provided by inhibitory feedback compensates for the additional costs. We analyze this problem in a network of leaky integrate-and-fire neurons receiving correlated input. By maximizing mutual information with metabolic cost constraints, we show that there is an optimal strength of recurrent connections in the network, which maximizes the value of mutual information-per-cost. For higher values of input correlation, the mutual information-per-cost is higher for recurrent networks with inhibitory feedback compared to feedforward networks without any inhibitory neurons. Our results, therefore, show that the optimal synaptic strength of a recurrent network can be inferred from metabolically efficient coding arguments and that decorrelation of the input by inhibitory feedback compensates for the associated increased metabolic costs.

Evaluating the Diagnostic Value of Electrovestibulography (EVestG) in Alzheimer's Patients with Mixed Pathology: A Pilot Study

Background and Objectives: Diagnosis of dementia subtypes caused by different brain pathophysiologies, particularly Alzheimer's disease (AD) from AD mixed with levels of cerebrovascular disease (CVD) symptomology (AD-CVD), is challenging due to overlapping symptoms. In this pilot study, the potential of Electrovestibulography (EVestG) for identifying AD, AD-CVD, and healthy control populations was investigated. Materials and Methods: A novel hierarchical multiclass diagnostic algorithm based on the outcomes of its lower levels of binary classifications was developed using data of 16 patients with AD, 13 with AD-CVD, and 24 healthy age-matched controls, and then evaluated on a blind testing dataset made up of a new population of 12 patients diagnosed with AD, 9 with AD-CVD, and 8 healthy controls. Multivariate analysis was run to test the between population differences while controlling for sex and age covariates. Results: The accuracies of the multiclass diagnostic algorithm were found to be 85.7% and 79.6% for the training and blind testing datasets, respectively. While a statistically significant difference was found between the populations after accounting for sex and age, no significant effect was found for sex or age covariates. The best characteristic EVestG features were extracted from the upright sitting and supine up/down stimulus responses. Conclusions: Two EVestG movements (stimuli) and their most informative features that are best selective of the above-populations' separations were identified, and a hierarchy diagnostic algorithm was developed for three-way classification. Given that the two stimuli predominantly stimulate the otholithic organs, physiological and experimental evidence supportive of the results are presented. Disruptions of inhibition associated with GABAergic activity might be responsible for the changes in the EVestG features.

Neuronal functional connectivity is impaired in a layer dependent manner near the chronically implanted microelectrodes

Objective

This study aims to reveal longitudinal changes in functional network connectivity within and across different brain structures near the chronically implanted microelectrode. While it is well established that the foreign-body response (FBR) contributes to the gradual decline of the signals recorded from brain implants over time, how does the FBR impact affect the functional stability of neural circuits near implanted Brain-Computer Interfaces (BCIs) remains unknown. This research aims to illuminate how the chronic FBR can alter local neural circuit function and the implications for BCI decoders.

Approach

This study utilized multisite Michigan-style microelectrodes that span all cortical layers and the hippocampal CA1 region to collect spontaneous and visually-evoked electrophysiological activity. Alterations in neuronal activity near the microelectrode were tested assessing cross-frequency synchronization of LFP and spike entrainment to LFP oscillatory activity throughout 16 weeks after microelectrode implantation.

Main Results

The study found that cortical layer 4, the input-receiving layer, maintained activity over the implantation time. However, layers 2/3 rapidly experienced severe impairment, leading to a loss of proper intralaminar connectivity in the downstream output layers 5/6. Furthermore, the impairment of interlaminar connectivity near the microelectrode was unidirectional, showing decreased connectivity from Layers 2/3 to Layers 5/6 but not the reverse direction. In the hippocampus, CA1 neurons gradually became unable to properly entrain to the surrounding LFP oscillations.

Significance

This study provides a detailed characterization of network connectivity dysfunction over long-term microelectrode implantation periods. This new knowledge could contribute to the development of targeted therapeutic strategies aimed at improving the health of the tissue surrounding brain implants and potentially inform engineering of adaptive decoders as the FBR progresses. Our study's understanding of the dynamic changes in the functional network over time opens the door to developing interventions for improving the long-term stability and performance of intracortical microelectrodes.

Rapid compensatory plasticity revealed by dynamic correlated activity in monkeys in vivo

To produce adaptive behavior, neural networks must balance between plasticity and stability. Computational work has demonstrated that network stability requires plasticity mechanisms to be counterbalanced by rapid compensatory processes. However, such processes have yet to be experimentally observed. Here we demonstrate that repeated optogenetic activation of excitatory neurons in monkey visual cortex (area V1) induces a population-wide dynamic reduction in the strength of neuronal interactions over the timescale of minutes during the awake state, but not during rest. This new form of rapid plasticity was observed only in the correlation structure, with firing rates remaining stable across trials. A computational network model operating in the balanced regime confirmed experimental findings and revealed that inhibitory plasticity is responsible for the decrease in correlated activity in response to repeated light stimulation. These results provide the first experimental evidence for rapid homeostatic plasticity that primarily operates during wakefulness, which stabilizes neuronal interactions during strong network co-activation.

Geometry of population activity in spiking networks with low-rank structure

Recurrent network models are instrumental in investigating how behaviorally-relevant computations emerge from collective neural dynamics. A recently developed class of models based on low-rank connectivity provides an analytically tractable framework for understanding of how connectivity structure determines the geometry of low-dimensional dynamics and the ensuing computations. Such models however lack some fundamental biological constraints, and in particular represent individual neurons in terms of abstract units that communicate through continuous firing rates rather than discrete action potentials. Here we examine how far the theoretical insights obtained from low-rank rate networks transfer to more biologically plausible networks of spiking neurons. Adding a low-rank structure on top of random excitatory-inhibitory connectivity, we systematically compare the geometry of activity in networks of integrate-and-fire neurons to rate networks with statistically equivalent low-rank connectivity. We show that the mean-field predictions of rate networks allow us to identify low-dimensional dynamics at constant population-average activity in spiking networks, as well as novel non-linear regimes of activity such as out-of-phase oscillations and slow manifolds. We finally exploit these results to directly build spiking networks that perform nonlinear computations.

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Animals rely on different decision strategies when faced with ambiguous or uncertain cues. Depending on the context, decisions may be biased towards events that were most frequently experienced in the past, or be more explorative. A particular type of decision making central to cognition is sequential memory recall in response to ambiguous cues. A previously developed spiking neuronal network implementation of sequence prediction and recall learns complex, high-order sequences in an unsupervised manner by local, biologically inspired plasticity rules. In response to an ambiguous cue, the model deterministically recalls the sequence shown most frequently during training. Here, we present an extension of the model enabling a range of different decision strategies. In this model, explorative behavior is generated by supplying neurons with noise. As the model relies on population encoding, uncorrelated noise averages out, and the recall dynamics remain effectively deterministic. In the presence of locally correlated noise, the averaging effect is avoided without impairing the model performance, and without the need for large noise amplitudes. We investigate two forms of correlated noise occurring in nature: shared synaptic background inputs, and random locking of the stimulus to spatiotemporal oscillations in the network activity. Depending on the noise characteristics, the network adopts various recall strategies. This study thereby provides potential mechanisms explaining how the statistics of learned sequences affect decision making, and how decision strategies can be adjusted after learning.

Signal denoising through topographic modularity of neural circuits

Information from the sensory periphery is conveyed to the cortex via structured projection pathways that spatially segregate stimulus features, providing a robust and efficient encoding strategy. Beyond sensory encoding, this prominent anatomical feature extends throughout the neocortex. However, the extent to which it influences cortical processing is unclear. In this study, we combine cortical circuit modeling with network theory to demonstrate that the sharpness of topographic projections acts as a bifurcation parameter, controlling the macroscopic dynamics and representational precision across a modular network. By shifting the balance of excitation and inhibition, topographic modularity gradually increases task performance and improves the signal-to-noise ratio across the system. We demonstrate that in biologically constrained networks, such a denoising behavior is contingent on recurrent inhibition. We show that this is a robust and generic structural feature that enables a broad range of behaviorally relevant operating regimes, and provide an in-depth theoretical analysis unraveling the dynamical principles underlying the mechanism.

Input correlations impede suppression of chaos and learning in balanced firing-rate networks

Neural circuits exhibit complex activity patterns, both spontaneously and evoked by external stimuli. Information encoding and learning in neural circuits depend on how well time-varying stimuli can control spontaneous network activity. We show that in firing-rate networks in the balanced state, external control of recurrent dynamics, i.e., the suppression of internally-generated chaotic variability, strongly depends on correlations in the input. A distinctive feature of balanced networks is that, because common external input is dynamically canceled by recurrent feedback, it is far more difficult to suppress chaos with common input into each neuron than through independent input. To study this phenomenon, we develop a non-stationary dynamic mean-field theory for driven networks. The theory explains how the activity statistics and the largest Lyapunov exponent depend on the frequency and amplitude of the input, recurrent coupling strength, and network size, for both common and independent input. We further show that uncorrelated inputs facilitate learning in balanced networks.

Disrupted-in-schizophrenia-1 is required for normal pyramidal cell-interneuron communication and assembly dynamics in the prefrontal cortex

We interrogated prefrontal circuit function in mice lacking Disrupted-in-schizophrenia-1 (Disc1-mutant mice), a risk factor for psychiatric disorders. Single-unit recordings in awake mice revealed reduced average firing rates of fast-spiking interneurons (INTs), including optogenetically identified parvalbumin-positive cells, and a lower proportion of INTs phase-coupled to ongoing gamma oscillations. Moreover, we observed decreased spike transmission efficacy at local pyramidal cell (PYR)-INT connections in vivo, suggesting a reduced excitatory effect of local glutamatergic inputs as a potential mechanism of lower INT rates. On the network level, impaired INT function resulted in altered activation of PYR assemblies: While assembly activations defined as coactivations within 25 ms were observed equally often, the expression strength of individual assembly patterns was significantly higher in Disc1-mutant mice. Our data, thus, reveal a role of Disc1 in shaping the properties of prefrontal assembly patterns by setting INT responsiveness to glutamatergic drive.

NNMT: Mean-Field Based Analysis Tools for Neuronal Network Models

Mean-field theory of neuronal networks has led to numerous advances in our analytical and intuitive understanding of their dynamics during the past decades. In order to make mean-field based analysis tools more accessible, we implemented an extensible, easy-to-use open-source Python toolbox that collects a variety of mean-field methods for the leaky integrate-and-fire neuron model. The Neuronal Network Mean-field Toolbox (NNMT) in its current state allows for estimating properties of large neuronal networks, such as firing rates, power spectra, and dynamical stability in mean-field and linear response approximation, without running simulations. In this article, we describe how the toolbox is implemented, show how it is used to reproduce results of previous studies, and discuss different use-cases, such as parameter space explorations, or mapping different network models. Although the initial version of the toolbox focuses on methods for leaky integrate-and-fire neurons, its structure is designed to be open and extensible. It aims to provide a platform for collecting analytical methods for neuronal network model analysis, such that the neuroscientific community can take maximal advantage of them.

Loss of neuronal heterogeneity in epileptogenic human tissue impairs network resilience to sudden changes in synchrony

A myriad of pathological changes associated with epilepsy can be recast as decreases in cell and circuit heterogeneity. We thus propose recontextualizing epileptogenesis as a process where reduction in cellular heterogeneity, in part, renders neural circuits less resilient to seizure. By comparing patch clamp recordings from human layer 5 (L5) cortical pyramidal neurons from epileptogenic and non-epileptogenic tissue, we demonstrate significantly decreased biophysical heterogeneity in seizure-generating areas. Implemented computationally, this renders model neural circuits prone to sudden transitions into synchronous states with increased firing activity, paralleling ictogenesis. This computational work also explains the surprising finding of significantly decreased excitability in the population-activation functions of neurons from epileptogenic tissue. Finally, mathematical analyses reveal a bifurcation structure arising only with low heterogeneity and associated with seizure-like dynamics. Taken together, this work provides experimental, computational, and mathematical support for the theory that ictogenic dynamics accompany a reduction in biophysical heterogeneity.

Separate Functional Subnetworks of Excitatory Neurons Show Preference to Periodic and Random Sound Structures

Auditory cortex (ACX) neurons are sensitive to spectro-temporal sound patterns and violations in patterns induced by rare stimuli embedded within streams of sounds. We investigate the auditory cortical representation of repeated presentations of sequences of sounds with standard stimuli (common) with an embedded deviant (rare) stimulus in two conditions, Periodic (Fixed deviant position) or Random (Random deviant position). We used extracellular single-unit and two-photon Ca2+ imaging recordings in layer 2/3 neurons of the mouse (Mus musculus) ACX of either sex. Population single-unit average responses increased over repetitions in the Random condition and were suppressed or did not change in the Periodic condition, showing general irregularity preference. A subset of neurons showed the opposite behavior, indicating regularity preference. Furthermore, pairwise noise correlations were higher in the Random condition than in the Periodic condition, suggesting a role of recurrent connections in the observed differential adaptation. Functional two-photon Ca2+ imaging showed that excitatory (EX), and inhibitory (IN) neurons [parvalbumin-positive (PV) and somatostatin-positive (SOM)] also had different categories of long-term adaptation as observed with single-units. However, examination of functional connectivity between pairs of neurons of different categories showed that EX-PV connected pairs behaved opposite to the EX-EX and EX-SOM pairs, with more connections outside category in Random condition than Periodic condition. Finally, considering Regularity, Irregularity, and no preference of connected pairs of neurons showed that EX-EX and EX-SOM pairs were in largely separate functional subnetworks with different preferences, not EX-PV pairs. Thus, separate subnetworks underlie coding of periodic and random sound sequences.SIGNIFICANCE STATEMENT Studying how the auditory cortex (ACX) neurons respond to streams of sound sequences help us understand the importance of changes in dynamic acoustic noisy scenes around us. Humans and animals are sensitive to regularity and its violations in sound sequences. Psychophysical tasks in humans show that the auditory brain differentially responds to Periodic and Random structures, independent of the listener's attentional states. Here, we show that mouse ACX L2/3 neurons detect changes and respond differently to patterns over long-time scales. The differential functional connectivity profile obtained in response to two different sound contexts suggests the vital role of recurrent connections in the auditory cortical network. Furthermore, the excitatory-inhibitory neuronal interactions can contribute to detecting the changing sound patterns.

Hasty sensorimotor decisions rely on an overlap of broad and selective changes in motor activity

Humans and other animals are able to adjust their speed–accuracy trade-off (SAT) at will depending on the urge to act, favoring either cautious or hasty decision policies in different contexts. An emerging view is that SAT regulation relies on influences exerting broad changes on the motor system, tuning its activity up globally when hastiness is at premium. The present study aimed to test this hypothesis. A total of 50 participants performed a task involving choices between left and right index fingers, in which incorrect choices led either to a high or to a low penalty in 2 contexts, inciting them to emphasize either cautious or hasty policies. We applied transcranial magnetic stimulation (TMS) on multiple motor representations, eliciting motor-evoked potentials (MEPs) in 9 finger and leg muscles. MEP amplitudes allowed us to probe activity changes in the corresponding finger and leg representations, while participants were deliberating about which index to choose. Our data indicate that hastiness entails a broad amplification of motor activity, although this amplification was limited to the chosen side. On top of this effect, we identified a local suppression of motor activity, surrounding the chosen index representation. Hence, a decision policy favoring speed over accuracy appears to rely on overlapping processes producing a broad (but not global) amplification and a surround suppression of motor activity. The latter effect may help to increase the signal-to-noise ratio of the chosen representation, as supported by single-trial correlation analyses indicating a stronger differentiation of activity changes in finger representations in the hasty context.

Many have argued that the regulation of the speed-accuracy tradeoff relies on an urgency signal, which implements "collapsing decision thresholds" by tuning neural activity in a global manner in decision-related structures. This study indicates that the reality is more subtle, with several aspects of "urgency" being specifically targeted to particular corticospinal populations within the motor system.

Global organization of neuronal activity only requires unstructured local connectivity

Modern electrophysiological recordings simultaneously capture single-unit spiking activities of hundreds of neurons spread across large cortical distances. Yet, this parallel activity is often confined to relatively low-dimensional manifolds. This implies strong coordination also among neurons that are most likely not even connected. Here, we combine in vivo recordings with network models and theory to characterize the nature of mesoscopic coordination patterns in macaque motor cortex and to expose their origin: We find that heterogeneity in local connectivity supports network states with complex long-range cooperation between neurons that arises from multi-synaptic, short-range connections. Our theory explains the experimentally observed spatial organization of covariances in resting state recordings as well as the behaviorally related modulation of covariance patterns during a reach-to-grasp task. The ubiquity of heterogeneity in local cortical circuits suggests that the brain uses the described mechanism to flexibly adapt neuronal coordination to momentary demands.

How connectivity rules and synaptic properties shape the efficacy of pattern separation in the entorhinal cortex-dentate gyrus-CA3 network

Pattern separation is a fundamental brain computation that converts small differences in input patterns into large differences in output patterns. Several synaptic mechanisms of pattern separation have been proposed, including code expansion, inhibition and plasticity; however, which of these mechanisms play a role in the entorhinal cortex (EC)-dentate gyrus (DG)-CA3 circuit, a classical pattern separation circuit, remains unclear. Here we show that a biologically realistic, full-scale EC-DG-CA3 circuit model, including granule cells (GCs) and parvalbumin-positive inhibitory interneurons (PV+-INs) in the DG, is an efficient pattern separator. Both external gamma-modulated inhibition and internal lateral inhibition mediated by PV+-INs substantially contributed to pattern separation. Both local connectivity and fast signaling at GC-PV+-IN synapses were important for maximum effectiveness. Similarly, mossy fiber synapses with conditional detonator properties contributed to pattern separation. By contrast, perforant path synapses with Hebbian synaptic plasticity and direct EC-CA3 connection shifted the network towards pattern completion. Our results demonstrate that the specific properties of cells and synapses optimize higher-order computations in biological networks and might be useful to improve the deep learning capabilities of technical networks.

Chronic bisphenol A exposure triggers visual perception dysfunction through impoverished neuronal coding ability in the primary visual cortex

Contrast perception is a fundamental visual ability that allows us to distinguish objects from the background. However, whether it is perturbed by chronic exposure to environmental xenoestrogen, bisphenol A (BPA), is still elusive. Here, we used adult cats to explore BPA-induced changes in contrast sensitivity (CS) and its underlying neuronal coding mechanism. Behavioral results showed that 14 days of BPA exposure (0.4 mg/kg/day) was sufficient to induce CS declines at the tested spatial frequencies (0.05-2 cycles/deg) in all four cats. Furthermore, based on multi-channel electrophysiological recording and interneuronal correlation analysis, we found that the BPA-exposed cats exhibited an obvious up-regulation in noise correlation in the primary visual cortex (area 17, A17), thus providing a population neuronal coding basis for their perceptual dysfunction. Moreover, single neuron responses in A17 of BPA-exposed cats revealed a slight but marked decrease in CS compared to that of control cats. Additionally, these neuronal responses presented an overt decrease in signal-to-noise ratio, accompanied by increased trial-to-trial response variability (i.e., noise). To some extent, these neuron population and unit dysfunctions in A17 of BPA-exposed cats were attributable to decreased response activity of fast-spiking neurons. Together, our findings demonstrate that chronic BPA exposure restricts contrast perception, in response to impoverished neuronal coding ability in A17.

Excitatory-inhibitory balance modulates the formation and dynamics of neuronal assemblies in cortical networks

Repetitive activation of subpopulations of neurons leads to the formation of neuronal assemblies, which can guide learning and behavior. Recent technological advances have made the artificial induction of these assemblies feasible, yet how various parameters of induction can be optimized is not clear. Here, we studied this question in large-scale cortical network models with excitatory-inhibitory balance. We found that the background network in which assemblies are embedded can strongly modulate their dynamics and formation. Networks with dominant excitatory interactions enabled a fast formation of assemblies, but this was accompanied by recruitment of other non-perturbed neurons, leading to some degree of nonspecific induction. On the other hand, networks with strong excitatory-inhibitory interactions ensured that the formation of assemblies remained constrained to the perturbed neurons, but slowed down the induction. Our results suggest that these two regimes can be suitable for computational and cognitive tasks with different trade-offs between speed and specificity.

Odor-evoked increases in olfactory bulb mitral cell spiking variability

The spiking variability of neural networks has important implications for how information is encoded to higher brain regions. It has been well documented by numerous labs in many cortical and motor regions that spiking variability decreases with stimulus onset, yet whether this principle holds in the OB has not been tested. In stark contrast to this common view, we demonstrate that the onset of sensory input can cause an increase in the variability of neural activity in the mammalian OB. We show this in both anesthetized and awake rodents. Furthermore, we use computational models to describe the mechanisms of this phenomenon. Our findings establish sensory evoked increases in spiking variability as a viable alternative coding strategy.

The neural basis for violations of Weber's law in self-motion perception

A prevailing view is that Weber's law constitutes a fundamental principle of perception. This widely accepted psychophysical law states that the minimal change in a given stimulus that can be perceived increases proportionally with amplitude and has been observed across systems and species in hundreds of studies. Importantly, however, Weber's law is actually an oversimplification. Notably, there exist violations of Weber's law that have been consistently observed across sensory modalities. Specifically, perceptual performance is better than that predicted from Weber's law for the higher stimulus amplitudes commonly found in natural sensory stimuli. To date, the neural mechanisms mediating such violations of Weber's law in the form of improved perceptual performance remain unknown. Here, we recorded from vestibular thalamocortical neurons in rhesus monkeys during self-motion stimulation. Strikingly, we found that neural discrimination thresholds initially increased but saturated for higher stimulus amplitudes, thereby causing the improved neural discrimination performance required to explain perception. Theory predicts that stimulus-dependent neural variability and/or response nonlinearities will determine discrimination threshold values. Using computational methods, we thus investigated the mechanisms mediating this improved performance. We found that the structure of neural variability, which initially increased but saturated for higher amplitudes, caused improved discrimination performance rather than response nonlinearities. Taken together, our results reveal the neural basis for violations of Weber's law and further provide insight as to how variability contributes to the adaptive encoding of natural stimuli with continually varying statistics.

SyNC, a Computationally Extensive and Realistic Neural Net to Identify Relative Impacts of Synaptopathy Mechanisms on Glutamatergic Neurons and Their Networks in Autism and Complex Neurological Disorders

Synaptic function and experience-dependent plasticity across multiple synapses are dependent on the types of neurons interacting as well as the intricate mechanisms that operate at the molecular level of the synapse. To understand the complexity of information processing at synaptic networks will rely in part on effective computational models. Such models should also evaluate disruptions to synaptic function by multiple mechanisms. By co-development of algorithms alongside hardware, real time analysis metrics can be co-prioritized along with biological complexity. The hippocampus is implicated in autism spectrum disorders (ASD) and within this region glutamatergic neurons constitute 90% of the neurons integral to the functioning of neuronal networks. Here we generate a computational model referred to as ASD interrogator (ASDint) and corresponding hardware to enable in silicon analysis of multiple ASD mechanisms affecting glutamatergic neuron synapses. The hardware architecture Synaptic Neuronal Circuit, SyNC, is a novel GPU accelerator or neural net, that extends discovery by acting as a biologically relevant realistic neuron synapse in real time. Co-developed ASDint and SyNC expand spiking neural network models of plasticity to comparative analysis of retrograde messengers. The SyNC model is realized in an ASIC architecture, which enables the ability to compute increasingly complex scenarios without sacrificing area efficiency of the model. Here we apply the ASDint model to analyse neuronal circuitry dysfunctions associated with autism spectral disorder (ASD) synaptopathies and their effects on the synaptic learning parameter and demonstrate SyNC on an ideal ASDint scenario. Our work highlights the value of secondary pathways in regard to evaluating complex ASD synaptopathy mechanisms. By comparing the degree of variation in the synaptic learning parameter to the response obtained from simulations of the ideal scenario we determine the potency and time of the effect of a particular evaluated mechanism. Hence simulations of such scenarios in even a small neuronal network now allows us to identify relative impacts of changed parameters and their effect on synaptic function. Based on this, we can estimate the minimum fraction of a neuron exhibiting a particular dysfunction scenario required to lead to complete failure of a neural network to coordinate pre-synaptic and post-synaptic outputs.

NetPyNE Implementation and Scaling of the Potjans-Diesmann Cortical Microcircuit Model

The Potjans-Diesmann cortical microcircuit model is a widely used model originally implemented in NEST. Here, we reimplemented the model using NetPyNE, a high-level Python interface to the NEURON simulator, and reproduced the findings of the original publication. We also implemented a method for scaling the network size that preserves first- and second-order statistics, building on existing work on network theory. Our new implementation enabled the use of more detailed neuron models with multicompartmental morphologies and multiple biophysically realistic ion channels. This opens the model to new research, including the study of dendritic processing, the influence of individual channel parameters, the relation to local field potentials, and other multiscale interactions. The scaling method we used provides flexibility to increase or decrease the network size as needed when running these CPU-intensive detailed simulations. Finally, NetPyNE facilitates modifying or extending the model using its declarative language; optimizing model parameters; running efficient, large-scale parallelized simulations; and analyzing the model through built-in methods, including local field potential calculation and information flow measures.

On the Complexity of Resting State Spiking Activity in Monkey Motor Cortex

Resting state has been established as a classical paradigm of brain activity studies, mostly based on large-scale measurements such as functional magnetic resonance imaging or magneto- and electroencephalography. This term typically refers to a behavioral state characterized by the absence of any task or stimuli. The corresponding neuronal activity is often called idle or ongoing. Numerous modeling studies on spiking neural networks claim to mimic such idle states, but compare their results with task- or stimulus-driven experiments, or to results from experiments with anesthetized subjects. Both approaches might lead to misleading conclusions. To provide a proper basis for comparing physiological and simulated network dynamics, we characterize simultaneously recorded single neurons' spiking activity in monkey motor cortex at rest and show the differences from spontaneous and task- or stimulus-induced movement conditions. We also distinguish between rest with open eyes and sleepy rest with eyes closed. The resting state with open eyes shows a significantly higher dimensionality, reduced firing rates, and less balance between population level excitation and inhibition than behavior-related states.

Balanced networks under spike-time dependent plasticity

The dynamics of local cortical networks are irregular, but correlated. Dynamic excitatory–inhibitory balance is a plausible mechanism that generates such irregular activity, but it remains unclear how balance is achieved and maintained in plastic neural networks. In particular, it is not fully understood how plasticity induced changes in the network affect balance, and in turn, how correlated, balanced activity impacts learning. How do the dynamics of balanced networks change under different plasticity rules? How does correlated spiking activity in recurrent networks change the evolution of weights, their eventual magnitude, and structure across the network? To address these questions, we develop a theory of spike–timing dependent plasticity in balanced networks. We show that balance can be attained and maintained under plasticity–induced weight changes. We find that correlations in the input mildly affect the evolution of synaptic weights. Under certain plasticity rules, we find an emergence of correlations between firing rates and synaptic weights. Under these rules, synaptic weights converge to a stable manifold in weight space with their final configuration dependent on the initial state of the network. Lastly, we show that our framework can also describe the dynamics of plastic balanced networks when subsets of neurons receive targeted optogenetic input.

Animals are able to learn complex tasks through changes in individual synapses between cells. Such changes lead to the coevolution of neural activity patterns and the structure of neural connectivity, but the consequences of these interactions are not fully understood. We consider plasticity in model neural networks which achieve an average balance between the excitatory and inhibitory synaptic inputs to different cells, and display cortical–like, irregular activity. We extend the theory of balanced networks to account for synaptic plasticity and show which rules can maintain balance, and which will drive the network into a different state. This theory of plasticity can provide insights into the relationship between stimuli, network dynamics, and synaptic circuitry.

Ion-channel regulation of response decorrelation in a heterogeneous multi-scale model of the dentate gyrus

Heterogeneities in biological neural circuits manifest in afferent connectivity as well as in local-circuit components such as neuronal excitability, neural structure and local synaptic strengths. The expression of adult neurogenesis in the dentate gyrus (DG) amplifies local-circuit heterogeneities and guides heterogeneities in afferent connectivity. How do neurons and their networks endowed with these distinct forms of heterogeneities respond to perturbations to individual ion channels, which are known to change under several physiological and pathophysiological conditions? We sequentially traversed the ion channels-neurons-network scales and assessed the impact of eliminating individual ion channels on conductance-based neuronal and network models endowed with disparate local-circuit and afferent heterogeneities. We found that many ion channels differentially contributed to specific neuronal or network measurements, and the elimination of any given ion channel altered several functional measurements. We then quantified the impact of ion-channel elimination on response decorrelation, a well-established metric to assess the ability of neurons in a network to convey complementary information, in DG networks endowed with different forms of heterogeneities. Notably, we found that networks constructed with structurally immature neurons exhibited functional robustness, manifesting as minimal changes in response decorrelation in the face of ion-channel elimination. Importantly, the average change in output correlation was dependent on the eliminated ion channel but invariant to input correlation. Our analyses suggest that neurogenesis-driven structural heterogeneities could assist the DG network in providing functional resilience to molecular perturbations.

•

Perturbations at one scale result in a cascading impact on physiology across scales.

•

Heterogeneous multi-scale models used to assess the impact of ion-channel deletion.

•

Mapping of structural components to functional outcomes is many-to-many.

•

Differential & variable impact of ion channel deletion on response decorrelation.

•

Neurogenesis-induced structural heterogeneity confers resilience to perturbations.

Local Homeostatic Regulation of the Spectral Radius of Echo-State Networks

Recurrent cortical networks provide reservoirs of states that are thought to play a crucial role for sequential information processing in the brain. However, classical reservoir computing requires manual adjustments of global network parameters, particularly of the spectral radius of the recurrent synaptic weight matrix. It is hence not clear if the spectral radius is accessible to biological neural networks. Using random matrix theory, we show that the spectral radius is related to local properties of the neuronal dynamics whenever the overall dynamical state is only weakly correlated. This result allows us to introduce two local homeostatic synaptic scaling mechanisms, termed flow control and variance control, that implicitly drive the spectral radius toward the desired value. For both mechanisms the spectral radius is autonomously adapted while the network receives and processes inputs under working conditions. We demonstrate the effectiveness of the two adaptation mechanisms under different external input protocols. Moreover, we evaluated the network performance after adaptation by training the network to perform a time-delayed XOR operation on binary sequences. As our main result, we found that flow control reliably regulates the spectral radius for different types of input statistics. Precise tuning is however negatively affected when interneural correlations are substantial. Furthermore, we found a consistent task performance over a wide range of input strengths/variances. Variance control did however not yield the desired spectral radii with the same precision, being less consistent across different input strengths. Given the effectiveness and remarkably simple mathematical form of flow control, we conclude that self-consistent local control of the spectral radius via an implicit adaptation scheme is an interesting and biological plausible alternative to conventional methods using set point homeostatic feedback controls of neural firing.

Inhibitory stabilization and cortical computation

Neuronal networks with strong recurrent connectivity provide the brain with a powerful means to perform complex computational tasks. However, high-gain excitatory networks are susceptible to instability, which can lead to runaway activity, as manifested in pathological regimes such as epilepsy. Inhibitory stabilization offers a dynamic, fast and flexible compensatory mechanism to balance otherwise unstable networks, thus enabling the brain to operate in its most efficient regimes. Here we review recent experimental evidence for the presence of such inhibition-stabilized dynamics in the brain and discuss their consequences for cortical computation. We show how the study of inhibition-stabilized networks in the brain has been facilitated by recent advances in the technological toolbox and perturbative techniques, as well as a concomitant development of biologically realistic computational models. By outlining future avenues, we suggest that inhibitory stabilization can offer an exemplary case of how experimental neuroscience can progress in tandem with technology and theory to advance our understanding of the brain.

Theory of neuronal perturbome in cortical networks

Brains are composed of networks of neurons that are highly interconnected. A central question in neuroscience is how such neuronal networks operate in tandem to make a functioning brain. To understand this, we need to study how neurons interact with each other in action, such as when viewing a visual scene or performing a motor task. One way to approach this question is by perturbing the activity of functioning neurons and measuring the resulting influence on other neurons. By using computational models of neuronal networks, we studied how this influence in visual networks depends on connectivity. Our results help to interpret contradictory results from previous experimental studies and explain how different connectivity patterns can enhance information processing during natural vision.

To unravel the functional properties of the brain, we need to untangle how neurons interact with each other and coordinate in large-scale recurrent networks. One way to address this question is to measure the functional influence of individual neurons on each other by perturbing them in vivo. Application of such single-neuron perturbations in mouse visual cortex has recently revealed feature-specific suppression between excitatory neurons, despite the presence of highly specific excitatory connectivity, which was deemed to underlie feature-specific amplification. Here, we studied which connectivity profiles are consistent with these seemingly contradictory observations, by modeling the effect of single-neuron perturbations in large-scale neuronal networks. Our numerical simulations and mathematical analysis revealed that, contrary to the prima facie assumption, neither inhibition dominance nor broad inhibition alone were sufficient to explain the experimental findings; instead, strong and functionally specific excitatory–inhibitory connectivity was necessary, consistent with recent findings in the primary visual cortex of rodents. Such networks had a higher capacity to encode and decode natural images, and this was accompanied by the emergence of response gain nonlinearities at the population level. Our study provides a general computational framework to investigate how single-neuron perturbations are linked to cortical connectivity and sensory coding and paves the road to map the perturbome of neuronal networks in future studies.

Task-evoked activity quenches neural correlations and variability across cortical areas

Many large-scale functional connectivity studies have emphasized the importance of communication through increased inter-region correlations during task states. In contrast, local circuit studies have demonstrated that task states primarily reduce correlations among pairs of neurons, likely enhancing their information coding by suppressing shared spontaneous activity. Here we sought to adjudicate between these conflicting perspectives, assessing whether co-active brain regions during task states tend to increase or decrease their correlations. We found that variability and correlations primarily decrease across a variety of cortical regions in two highly distinct data sets: non-human primate spiking data and human functional magnetic resonance imaging data. Moreover, this observed variability and correlation reduction was accompanied by an overall increase in dimensionality (reflecting less information redundancy) during task states, suggesting that decreased correlations increased information coding capacity. We further found in both spiking and neural mass computational models that task-evoked activity increased the stability around a stable attractor, globally quenching neural variability and correlations. Together, our results provide an integrative mechanistic account that encompasses measures of large-scale neural activity, variability, and correlations during resting and task states.

Firing rate homeostasis counteracts changes in stability of recurrent neural networks caused by synapse loss in Alzheimer's disease

The impairment of cognitive function in Alzheimer's disease is clearly correlated to synapse loss. However, the mechanisms underlying this correlation are only poorly understood. Here, we investigate how the loss of excitatory synapses in sparsely connected random networks of spiking excitatory and inhibitory neurons alters their dynamical characteristics. Beyond the effects on the activity statistics, we find that the loss of excitatory synapses on excitatory neurons reduces the network's sensitivity to small perturbations. This decrease in sensitivity can be considered as an indication of a reduction of computational capacity. A full recovery of the network's dynamical characteristics and sensitivity can be achieved by firing rate homeostasis, here implemented by an up-scaling of the remaining excitatory-excitatory synapses. Mean-field analysis reveals that the stability of the linearised network dynamics is, in good approximation, uniquely determined by the firing rate, and thereby explains why firing rate homeostasis preserves not only the firing rate but also the network's sensitivity to small perturbations.

Self-consistent formulations for stochastic nonlinear neuronal dynamics

Neural dynamics is often investigated with tools from bifurcation theory. However, many neuron models are stochastic, mimicking fluctuations in the input from unknown parts of the brain or the spiking nature of signals. Noise changes the dynamics with respect to the deterministic model; in particular classical bifurcation theory cannot be applied. We formulate the stochastic neuron dynamics in the Martin-Siggia-Rose de Dominicis-Janssen (MSRDJ) formalism and present the fluctuation expansion of the effective action and the functional renormalization group (fRG) as two systematic ways to incorporate corrections to the mean dynamics and time-dependent statistics due to fluctuations in the presence of nonlinear neuronal gain. To formulate self-consistency equations, we derive a fundamental link between the effective action in the Onsager-Machlup (OM) formalism, which allows the study of phase transitions, and the MSRDJ effective action, which is computationally advantageous. These results in particular allow the derivation of an OM effective action for systems with non-Gaussian noise. This approach naturally leads to effective deterministic equations for the first moment of the stochastic system; they explain how nonlinearities and noise cooperate to produce memory effects. Moreover, the MSRDJ formulation yields an effective linear system that has identical power spectra and linear response. Starting from the better known loopwise approximation, we then discuss the use of the fRG as a method to obtain self-consistency beyond the mean. We present a new efficient truncation scheme for the hierarchy of flow equations for the vertex functions by adapting the Blaizot, Méndez, and Wschebor approximation from the derivative expansion to the vertex expansion. The methods are presented by means of the simplest possible example of a stochastic differential equation that has generic features of neuronal dynamics.

Portraits of communication in neuronal networks

The brain is organized as a network of highly specialized networks of spiking neurons. To exploit such a modular architecture for computation, the brain has to be able to regulate the flow of spiking activity between these specialized networks. In this Opinion article, we review various prominent mechanisms that may underlie communication between neuronal networks. We show that communication between neuronal networks can be understood as trajectories in a two-dimensional state space, spanned by the properties of the input. Thus, we propose a common framework to understand neuronal communication mediated by seemingly different mechanisms. We also suggest that the nesting of slow (for example, alpha-band and theta-band) oscillations and fast (gamma-band) oscillations can serve as an important control mechanism that allows or prevents spiking signals to be routed between specific networks. We argue that slow oscillations can modulate the time required to establish network resonance or entrainment and, thereby, regulate communication between neuronal networks.

Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks

The massively parallel nature of biological information processing plays an important role due to its superiority in comparison to human-engineered computing devices. In particular, it may hold the key to overcoming the von Neumann bottleneck that limits contemporary computer architectures. Physical-model neuromorphic devices seek to replicate not only this inherent parallelism, but also aspects of its microscopic dynamics in analog circuits emulating neurons and synapses. However, these machines require network models that are not only adept at solving particular tasks, but that can also cope with the inherent imperfections of analog substrates. We present a spiking network model that performs Bayesian inference through sampling on the BrainScaleS neuromorphic platform, where we use it for generative and discriminative computations on visual data. By illustrating its functionality on this platform, we implicitly demonstrate its robustness to various substrate-specific distortive effects, as well as its accelerated capability for computation. These results showcase the advantages of brain-inspired physical computation and provide important building blocks for large-scale neuromorphic applications.

Deterministic networks for probabilistic computing

Neuronal network models of high-level brain functions such as memory recall and reasoning often rely on the presence of some form of noise. The majority of these models assumes that each neuron in the functional network is equipped with its own private source of randomness, often in the form of uncorrelated external noise. In vivo, synaptic background input has been suggested to serve as the main source of noise in biological neuronal networks. However, the finiteness of the number of such noise sources constitutes a challenge to this idea. Here, we show that shared-noise correlations resulting from a finite number of independent noise sources can substantially impair the performance of stochastic network models. We demonstrate that this problem is naturally overcome by replacing the ensemble of independent noise sources by a deterministic recurrent neuronal network. By virtue of inhibitory feedback, such networks can generate small residual spatial correlations in their activity which, counter to intuition, suppress the detrimental effect of shared input. We exploit this mechanism to show that a single recurrent network of a few hundred neurons can serve as a natural noise source for a large ensemble of functional networks performing probabilistic computations, each comprising thousands of units.

The asynchronous state's relation to large-scale potentials in cortex

Understanding the relation between large-scale potentials (M/EEG) and their underlying neural activity can improve the precision of research and clinical diagnosis. Recent insights into cortical dynamics highlighted a state of strongly reduced spike count correlations, termed the asynchronous state (AS). The AS has received considerable attention from experimenters and theorists alike, regarding its implications for cortical dynamics and coding of information. However, how reconcilable are these vanishing correlations in the AS with large-scale potentials such as M/EEG observed in most experiments? Typically the latter are assumed to be based on underlying correlations in activity, in particular between subthreshold potentials. We survey the occurrence of the AS across brain states, regions, and layers and argue for a reconciliation of this seeming disparity: large-scale potentials are either observed, first, at transitions between cortical activity states, which entail transient changes in population firing rate, as well as during the AS, and, second, on the basis of sufficiently large, asynchronous populations that only need to exhibit weak correlations in activity. Cells with no or little spiking activity can contribute to large-scale potentials via their subthreshold currents, while they do not contribute to the estimation of spiking correlations, defining the AS. Furthermore, third, the AS occurs only within particular cortical regions and layers associated with the currently selected modality, allowing for correlations at other times and between other areas and layers.

Inferring and validating mechanistic models of neural microcircuits based on spike-train data

The interpretation of neuronal spike train recordings often relies on abstract statistical models that allow for principled parameter estimation and model selection but provide only limited insights into underlying microcircuits. In contrast, mechanistic models are useful to interpret microcircuit dynamics, but are rarely quantitatively matched to experimental data due to methodological challenges. Here we present analytical methods to efficiently fit spiking circuit models to single-trial spike trains. Using derived likelihood functions, we statistically infer the mean and variance of hidden inputs, neuronal adaptation properties and connectivity for coupled integrate-and-fire neurons. Comprehensive evaluations on synthetic data, validations using ground truth in-vitro and in-vivo recordings, and comparisons with existing techniques demonstrate that parameter estimation is very accurate and efficient, even for highly subsampled networks. Our methods bridge statistical, data-driven and theoretical, model-based neurosciences at the level of spiking circuits, for the purpose of a quantitative, mechanistic interpretation of recorded neuronal population activity.

It is difficult to fit mechanistic, biophysically constrained circuit models to spike train data from in vivo extracellular recordings. Here the authors present analytical methods that enable efficient parameter estimation for integrate-and-fire circuit models and inference of the underlying connectivity structure in subsampled networks.

Training dynamically balanced excitatory-inhibitory networks

The construction of biologically plausible models of neural circuits is crucial for understanding the computational properties of the nervous system. Constructing functional networks composed of separate excitatory and inhibitory neurons obeying Dale’s law presents a number of challenges. We show how a target-based approach, when combined with a fast online constrained optimization technique, is capable of building functional models of rate and spiking recurrent neural networks in which excitation and inhibition are balanced. Balanced networks can be trained to produce complicated temporal patterns and to solve input-output tasks while retaining biologically desirable features such as Dale’s law and response variability.

The Dynamical Regime of Sensory Cortex: Stable Dynamics around a Single Stimulus-Tuned Attractor Account for Patterns of Noise Variability

Correlated variability in cortical activity is ubiquitously quenched following stimulus onset, in a stimulus-dependent manner. These modulations have been attributed to circuit dynamics involving either multiple stable states (“attractors”) or chaotic activity. Here we show that a qualitatively different dynamical regime, involving fluctuations about a single, stimulus-driven attractor in a loosely balanced excitatory-inhibitory network (the stochastic “stabilized supralinear network”), best explains these modulations. Given the supralinear input/output functions of cortical neurons, increased stimulus drive strengthens effective network connectivity. This shifts the balance from interactions that amplify variability to suppressive inhibitory feedback, quenching correlated variability around more strongly driven steady states. Comparing to previously published and original data analyses, we show that this mechanism, unlike previous proposals, uniquely accounts for the spatial patterns and fast temporal dynamics of variability suppression. Specifying the cortical operating regime is key to understanding the computations underlying perception.

•

A simple network model explains stimulus-tuning of cortical variability suppression

•

Inhibition stabilizes recurrently interacting neurons with supralinear I/O functions

•

Stimuli strengthen inhibitory stabilization around a stable state, quenching variability

•

Single-trial V1 data are compatible with this model and rules out competing proposals

Decoupling of timescales reveals sparse convergent CPG network in the adult spinal cord

During the generation of rhythmic movements, most spinal neurons receive an oscillatory synaptic drive. The neuronal architecture underlying this drive is unknown, and the corresponding network size and sparseness have not yet been addressed. If the input originates from a small central pattern generator (CPG) with dense divergent connectivity, it will induce correlated input to all receiving neurons, while sparse convergent wiring will induce a weak correlation, if any. Here, we use pairwise recordings of spinal neurons to measure synaptic correlations and thus infer the wiring architecture qualitatively. A strong correlation on a slow timescale implies functional relatedness and a common source, which will also cause correlation on fast timescale due to shared synaptic connections. However, we consistently find marginal coupling between slow and fast correlations regardless of neuronal identity. This suggests either sparse convergent connectivity or a CPG network with recurrent inhibition that actively decorrelates common input.

Second type of criticality in the brain uncovers rich multiple-neuron dynamics

Cortical networks that have been found to operate close to a critical point exhibit joint activations of large numbers of neurons. However, in motor cortex of the awake macaque monkey, we observe very different dynamics: massively parallel recordings of 155 single-neuron spiking activities show weak fluctuations on the population level. This a priori suggests that motor cortex operates in a noncritical regime, which in models, has been found to be suboptimal for computational performance. However, here, we show the opposite: The large dispersion of correlations across neurons is the signature of a second critical regime. This regime exhibits a rich dynamical repertoire hidden from macroscopic brain signals but essential for high performance in such concepts as reservoir computing. An analytical link between the eigenvalue spectrum of the dynamics, the heterogeneity of connectivity, and the dispersion of correlations allows us to assess the closeness to the critical point.

Correlated states in balanced neuronal networks

Understanding the magnitude and structure of interneuronal correlations and their relationship to synaptic connectivity structure is an important and difficult problem in computational neuroscience. Early studies show that neuronal network models with excitatory-inhibitory balance naturally create very weak spike train correlations, defining the "asynchronous state." Later work showed that, under some connectivity structures, balanced networks can produce larger correlations between some neuron pairs, even when the average correlation is very small. All of these previous studies assume that the local network receives feedforward synaptic input from a population of uncorrelated spike trains. We show that when spike trains providing feedforward input are correlated, the downstream recurrent network produces much larger correlations. We provide an in-depth analysis of the resulting "correlated state" in balanced networks and show that, unlike the asynchronous state, it produces a tight excitatory-inhibitory balance consistent with in vivo cortical recordings.

Disparate forms of heterogeneities and interactions among them drive channel decorrelation in the dentate gyrus: Degeneracy and dominance

The ability of a neuronal population to effectuate channel decorrelation, which is one form of response decorrelation, has been identified as an essential prelude to efficient neural encoding. To what extent are diverse forms of local and afferent heterogeneities essential in accomplishing channel decorrelation in the dentate gyrus (DG)? Here, we incrementally incorporated four distinct forms of biological heterogeneities into conductance-based network models of the DG and systematically delineate their relative contributions to channel decorrelation. First, to effectively incorporate intrinsic heterogeneities, we built physiologically validated heterogeneous populations of granule (GC) and basket cells (BC) through independent stochastic search algorithms spanning exhaustive parametric spaces. These stochastic search algorithms, which were independently constrained by experimentally determined ion channels and by neurophysiological signatures, revealed cellular-scale degeneracy in the DG. Specifically, in GC and BC populations, disparate parametric combinations yielded similar physiological signatures, with underlying parameters exhibiting significant variability and weak pair-wise correlations. Second, we introduced synaptic heterogeneities through randomization of local synaptic strengths. Third, in including adult neurogenesis, we subjected the valid model populations to randomized structural plasticity and matched neuronal excitability to electrophysiological data. We assessed networks comprising different combinations of these three local heterogeneities with identical or heterogeneous afferent inputs from the entorhinal cortex. We found that the three forms of local heterogeneities were independently and synergistically capable of mediating significant channel decorrelation when the network was driven by identical afferent inputs. However, when we incorporated afferent heterogeneities into the network to account for the divergence in DG afferent connectivity, the impact of all three forms of local heterogeneities was significantly suppressed by the dominant role of afferent heterogeneities in mediating channel decorrelation. Our results unveil a unique convergence of cellular- and network-scale degeneracy in the emergence of channel decorrelation in the DG, whereby disparate forms of local and afferent heterogeneities could synergistically drive input discriminability.

Inhibition increases response variability and reduces stimulus discrimination in random networks of cortical neurons

Much of what is known about the contribution of inhibition to stimulus discrimination is due to extensively studied sensory systems, which are highly structured neural circuits. The effect of inhibition on stimulus representation in less structured networks is not as clear. Here we exercise a biosynthetic approach in order to study the impacts of inhibition on stimulus representation in non-specialized network anatomy. Combining pharmacological manipulation, multisite electrical stimulation and recording from ex-vivo randomly rewired networks of cortical neurons, we quantified the effects of inhibition on response variability and stimulus discrimination at the population and single unit levels. We find that blocking inhibition quenches variability of responses evoked by repeated stimuli and enhances discrimination between stimuli that invade the network from different spatial loci. Enhanced stimulus discrimination is reserved for representation schemes that are based on temporal relation between spikes emitted in groups of neurons. Our data indicate that - under intact inhibition - the response to a given stimulus is a noisy version of the response evoked in the absence of inhibition. Spatial analysis suggests that the dispersion effect of inhibition is due to disruption of an otherwise coherent, wave-like propagation of activity.

Parvalbumin+ interneurons obey unique connectivity rules and establish a powerful lateral-inhibition microcircuit in dentate gyrus

Parvalbumin-positive (PV⁺) GABAergic interneurons in hippocampal microcircuits are thought to play a key role in several higher network functions, such as feedforward and feedback inhibition, network oscillations, and pattern separation. Fast lateral inhibition mediated by GABAergic interneurons may implement a winner-takes-all mechanism in the hippocampal input layer. However, it is not clear whether the functional connectivity rules of granule cells (GCs) and interneurons in the dentate gyrus are consistent with such a mechanism. Using simultaneous patch-clamp recordings from up to seven GCs and up to four PV⁺ interneurons in the dentate gyrus, we find that connectivity is structured in space, synapse-specific, and enriched in specific disynaptic motifs. In contrast to the neocortex, lateral inhibition in the dentate gyrus (in which a GC inhibits neighboring GCs via a PV⁺ interneuron) is ~ 10-times more abundant than recurrent inhibition (in which a GC inhibits itself). Thus, unique connectivity rules may enable the dentate gyrus to perform specific higher-order computations.

GABAergic interneurons are known to provide inhibition to allow computational function of neuronal network. Here, Espinoza and colleagues show that connectivity of granule cells and interneurons in the dentate gyrus of mouse hippocampus are consistent with the circuit architecture capable of performing a winners-take-all mechanism.

A multi-scale layer-resolved spiking network model of resting-state dynamics in macaque visual cortical areas

Cortical activity has distinct features across scales, from the spiking statistics of individual cells to global resting-state networks. We here describe the first full-density multi-area spiking network model of cortex, using macaque visual cortex as a test system. The model represents each area by a microcircuit with area-specific architecture and features layer- and population-resolved connectivity between areas. Simulations reveal a structured asynchronous irregular ground state. In a metastable regime, the network reproduces spiking statistics from electrophysiological recordings and cortico-cortical interaction patterns in fMRI functional connectivity under resting-state conditions. Stable inter-area propagation is supported by cortico-cortical synapses that are moderately strong onto excitatory neurons and stronger onto inhibitory neurons. Causal interactions depend on both cortical structure and the dynamical state of populations. Activity propagates mainly in the feedback direction, similar to experimental results associated with visual imagery and sleep. The model unifies local and large-scale accounts of cortex, and clarifies how the detailed connectivity of cortex shapes its dynamics on multiple scales. Based on our simulations, we hypothesize that in the spontaneous condition the brain operates in a metastable regime where cortico-cortical projections target excitatory and inhibitory populations in a balanced manner that produces substantial inter-area interactions while maintaining global stability.

The mammalian cortex fulfills its complex tasks by operating on multiple temporal and spatial scales from single cells to entire areas comprising millions of cells. These multi-scale dynamics are supported by specific network structures at all levels of organization. Since models of cortex hitherto tend to concentrate on a single scale, little is known about how cortical structure shapes the multi-scale dynamics of the network. We here present dynamical simulations of a multi-area network model at neuronal and synaptic resolution with population-specific connectivity based on extensive experimental data which accounts for a wide range of dynamical phenomena. Our model elucidates relationships between local and global scales in cortex and provides a platform for future studies of cortical function.

The Interplay Between Cortical State and Perceptual Learning: A Focused Review

Measurements of population activity in alert animals have demonstrated that the intrinsic response state of the cortex has profound effects on the neuronal representation of sensory inputs, raising the possibility that cortical state could influence the behavioral performance in perceptual learning (PL). PL is a process by which sensory experience leads to gradual and semi-permanent improvements in perceptual judgment, and it is generally agreed that these improvements are modulated by sensory cortical areas. Although the precise neural mechanisms underlying the improved perceptual judgment remain unclear, cortical state has been shown to impact the behavioral outcome of PL. We discuss several ways in which cortical state might influence PL based on the recent evidence for state-dependent modulation of sensory encoding. Conversely, training in a certain perceptual task feeds back to modulate cortical state, suggesting a bi-directional relationship between cortical state and behavioral outcomes of PL. We highlight the recent studies that shed light on the mechanism of the interplay between cortical state and PL.

Inhibitory Interneurons Regulate Temporal Precision and Correlations in Cortical Circuits

GABAergic interneurons, which are highly diverse, have long been thought to contribute to the timing of neural activity as well as to the generation and shaping of brain rhythms. GABAergic activity is crucial not only for entrainment of oscillatory activity across a neural population, but also for precise regulation of the timing of action potentials and the suppression of slow-timescale correlations. The diversity of inhibition provides the potential for flexible regulation of patterned activity, but also poses a challenge to identifying the elements of excitatory-inhibitory interactions underlying network engagement. This review highlights the key roles of inhibitory interneurons in spike correlations and brain rhythms, describes several scales on which GABAergic inhibition regulates timing in neural networks, and identifies potential consequences of inhibitory dysfunction.