Measuring and interpreting neuronal correlations

Neural tuning and representational geometry

A central goal of neuroscience is to understand the representations formed by brain activity patterns and their connection to behaviour. The classic approach is to investigate how individual neurons encode stimuli and how their tuning determines the fidelity of the neural representation. Tuning analyses often use the Fisher information to characterize the sensitivity of neural responses to small changes of the stimulus. In recent decades, measurements of large populations of neurons have motivated a complementary approach, which focuses on the information available to linear decoders. The decodable information is captured by the geometry of the representational patterns in the multivariate response space. Here we review neural tuning and representational geometry with the goal of clarifying the relationship between them. The tuning induces the geometry, but different sets of tuned neurons can induce the same geometry. The geometry determines the Fisher information, the mutual information and the behavioural performance of an ideal observer in a range of psychophysical tasks. We argue that future studies can benefit from considering both tuning and geometry to understand neural codes and reveal the connections between stimuli, brain activity and behaviour.

Trial-to-Trial Variability of Spiking Delay Activity in Prefrontal Cortex Constrains Burst-Coding Models of Working Memory

A hallmark neuronal correlate of working memory (WM) is stimulus-selective spiking activity of neurons in PFC during mnemonic delays. These observations have motivated an influential computational modeling framework in which WM is supported by persistent activity. Recently, this framework has been challenged by arguments that observed persistent activity may be an artifact of trial-averaging, which potentially masks high variability of delay activity at the single-trial level. In an alternative scenario, WM delay activity could be encoded in bursts of selective neuronal firing which occur intermittently across trials. However, this alternative proposal has not been tested on single-neuron spike-train data. Here, we developed a framework for addressing this issue by characterizing the trial-to-trial variability of neuronal spiking quantified by Fano factor (FF). By building a doubly stochastic Poisson spiking model, we first demonstrated that the burst-coding proposal implies a significant increase in FF positively correlated with firing rate, and thus loss of stability across trials during the delay. Simulation of spiking cortical circuit WM models further confirmed that FF is a sensitive measure that can well dissociate distinct WM mechanisms. We then tested these predictions on datasets of single-neuron recordings from macaque PFC during three WM tasks. In sharp contrast to the burst-coding model predictions, we only found a small fraction of neurons showing increased WM-dependent burstiness, and stability across trials during delay was strengthened in empirical data. Therefore, reduced trial-to-trial variability during delay provides strong constraints on the contribution of single-neuron intermittent bursting to WM maintenance.SIGNIFICANCE STATEMENT There are diverging classes of theoretical models explaining how information is maintained in working memory by cortical circuits. In an influential model class, neurons exhibit persistent elevated memorandum-selective firing, whereas a recently developed class of burst-coding models suggests that persistent activity is an artifact of trial-averaging, and spiking is sparse in each single trial, subserved by brief intermittent bursts. However, this alternative picture has not been characterized or tested on empirical spike-train data. Here we combine mathematical analysis, computational model simulation, and experimental data analysis to test empirically these two classes of models and show that the trial-to-trial variability of empirical spike trains is not consistent with burst coding. These findings provide constraints for theoretical models of working memory.

Motor training improves coordination and anxiety in symptomatic Mecp2-null mice despite impaired functional connectivity within the motor circuit

Rett syndrome (RTT) is a severe neurodevelopmental disorder caused by loss of function of the X-linked methyl-CpG–binding protein 2 (MECP2). Several case studies report that gross motor function can be improved in children with RTT through treadmill walking, but whether the MeCP2-deficient motor circuit can support actual motor learning remains unclear. We used two-photon calcium imaging to simultaneously observe layer (L) 2/3 and L5a excitatory neuronal activity in the motor cortex (M1) while mice adapted to changing speeds on a computerized running wheel. Despite circuit hypoactivity and weakened functional connectivity across L2/3 and L5a, the Mecp2-null circuit’s firing pattern evolved with improved performance over 2 weeks. Moreover, trained mice became less anxious and lived 20% longer than untrained mice. Because motor deficits and anxiety are core symptoms of RTT, which is not diagnosed until well after symptom onset, these results underscore the benefit of motor learning.

Removing independent noise in systems neuroscience data using DeepInterpolation

Progress in many scientific disciplines is hindered by the presence of independent noise. Technologies for measuring neural activity (calcium imaging, extracellular electrophysiology and functional magnetic resonance imaging (fMRI)) operate in domains in which independent noise (shot noise and/or thermal noise) can overwhelm physiological signals. Here, we introduce DeepInterpolation, a general-purpose denoising algorithm that trains a spatiotemporal nonlinear interpolation model using only raw noisy samples. Applying DeepInterpolation to two-photon calcium imaging data yielded up to six times more neuronal segments than those computed from raw data with a 15-fold increase in the single-pixel signal-to-noise ratio (SNR), uncovering single-trial network dynamics that were previously obscured by noise. Extracellular electrophysiology recordings processed with DeepInterpolation yielded 25% more high-quality spiking units than those computed from raw data, while DeepInterpolation produced a 1.6-fold increase in the SNR of individual voxels in fMRI datasets. Denoising was attained without sacrificing spatial or temporal resolution and without access to ground truth training data. We anticipate that DeepInterpolation will provide similar benefits in other domains in which independent noise contaminates spatiotemporally structured datasets.

Primary visual cortex straightens natural video trajectories

Many sensory-driven behaviors rely on predictions about future states of the environment. Visual input typically evolves along complex temporal trajectories that are difficult to extrapolate. We test the hypothesis that spatial processing mechanisms in the early visual system facilitate prediction by constructing neural representations that follow straighter temporal trajectories. We recorded V1 population activity in anesthetized macaques while presenting static frames taken from brief video clips, and developed a procedure to measure the curvature of the associated neural population trajectory. We found that V1 populations straighten naturally occurring image sequences, but entangle artificial sequences that contain unnatural temporal transformations. We show that these effects arise in part from computational mechanisms that underlie the stimulus selectivity of V1 cells. Together, our findings reveal that the early visual system uses a set of specialized computations to build representations that can support prediction in the natural environment.

Many behaviours depend on predictions about the environment. Here the authors find neural populations in primary visual cortex to straighten the temporal trajectories of natural video clips, facilitating the extrapolation of past observations.

The population doctrine in cognitive neuroscience

A major shift is happening within neurophysiology: a population doctrine is drawing level with the single-neuron doctrine that has long dominated the field. Population-level ideas have so far had their greatest impact in motor neuroscience, but they hold great promise for resolving open questions in cognition as well. Here, we codify the population doctrine and survey recent work that leverages this view to specifically probe cognition. Our discussion is organized around five core concepts that provide a foundation for population-level thinking: (1) state spaces, (2) manifolds, (3) coding dimensions, (4) subspaces, and (5) dynamics. The work we review illustrates the progress and promise that population-level thinking holds for cognitive neuroscience-for delivering new insight into attention, working memory, decision-making, executive function, learning, and reward processing.

Modulation of the dynamical state in cortical network models

Cortical neural responses can be modulated by various factors, such as stimulus inputs and the behavior state of the animal. Understanding the circuit mechanisms underlying modulations of network dynamics is important to understand the flexibility of circuit computations. Identifying the dynamical state of a network is an important first step to predict network responses to external stimulus and top-down modulatory inputs. Models in stable or unstable dynamical regimes require different analytic tools to estimate the network responses to inputs and the structure of neural variability. In this article, I review recent cortical models of state-dependent responses and their predictions about the underlying modulatory mechanisms.

Uncovering structured responses of neural populations recorded from macaque monkeys with linear support vector machines

When a mammal, such as a macaque monkey, sees a complex natural image, many neurons in its visual cortex respond simultaneously. Here, we provide a protocol for studying the structure of population responses in laminar recordings with a machine learning model, the linear support vector machine. To unravel the role of single neurons in population responses and the structure of noise correlations, we use a multivariate decoding technique on time-averaged responses.

For complete details on the use and execution of this protocol, please refer to Koren et al. (2020a).

•

Linear support vector machine (SVM) is an efficient model for decoding from neural data

•

Permutation test is a rigorous method for testing the significance of results

•

Neural responses along the cortical depth are heterogeneous

•

Decoding weights and noise correlations share a similar structure

Bridging neuronal correlations and dimensionality reduction

Two commonly used approaches to study interactions among neurons are spike count correlation, which describes pairs of neurons, and dimensionality reduction, applied to a population of neurons. Although both approaches have been used to study trial-to-trial neuronal variability correlated among neurons, they are often used in isolation and have not been directly related. We first established concrete mathematical and empirical relationships between pairwise correlation and metrics of population-wide covariability based on dimensionality reduction. Applying these insights to macaque V4 population recordings, we found that the previously reported decrease in mean pairwise correlation associated with attention stemmed from three distinct changes in population-wide covariability. Overall, our work builds the intuition and formalism to bridge between pairwise correlation and population-wide covariability and presents a cautionary tale about the inferences one can make about population activity by using a single statistic, whether it be mean pairwise correlation or dimensionality.

Information Theoretic Approaches to Deciphering the Neural Code with Functional Fluorescence Imaging

Information theoretic metrics have proven useful in quantifying the relationship between behaviorally relevant parameters and neuronal activity with relatively few assumptions. However, these metrics are typically applied to action potential (AP) recordings and were not designed for the slow timescales and variable amplitudes typical of functional fluorescence recordings (e.g., calcium imaging). The lack of research guidelines on how to apply and interpret these metrics with fluorescence traces means the neuroscience community has yet to realize the power of information theoretic metrics. Here, we used computational methods to create mock AP traces with known amounts of information. From these, we generated fluorescence traces and examined the ability of different information metrics to recover the known information values. We provide guidelines for how to use information metrics when applying them to functional fluorescence and demonstrate their appropriate application to GCaMP6f population recordings from mouse hippocampal neurons imaged during virtual navigation.

High-speed, cortex-wide volumetric recording of neuroactivity at cellular resolution using light beads microscopy

Two-photon microscopy has enabled high-resolution imaging of neuroactivity at depth within scattering brain tissue. However, its various realizations have not overcome the tradeoffs between speed and spatiotemporal sampling that would be necessary to enable mesoscale volumetric recording of neuroactivity at cellular resolution and speed compatible with resolving calcium transients. Here, we introduce light beads microscopy (LBM), a scalable and spatiotemporally optimal acquisition approach limited only by fluorescence lifetime, where a set of axially separated and temporally distinct foci record the entire axial imaging range near-simultaneously, enabling volumetric recording at 1.41 × 10⁸ voxels per second. Using LBM, we demonstrate mesoscopic and volumetric imaging at multiple scales in the mouse cortex, including cellular-resolution recordings within ~3 × 5 × 0.5 mm volumes containing >200,000 neurons at ~5 Hz and recordings of populations of ~1 million neurons within ~5.4 × 6 × 0.5 mm volumes at ~2 Hz, as well as higher speed (9.6 Hz) subcellular-resolution volumetric recordings. LBM provides an opportunity for discovering the neurocomputations underlying cortex-wide encoding and processing of information in the mammalian brain.

Stimulus-dependent representational drift in primary visual cortex

To produce consistent sensory perception, neurons must maintain stable representations of sensory input. However, neurons in many regions exhibit progressive drift across days. Longitudinal studies have found stable responses to artificial stimuli across sessions in visual areas, but it is unclear whether this stability extends to naturalistic stimuli. We performed chronic 2-photon imaging of mouse V1 populations to directly compare the representational stability of artificial versus naturalistic visual stimuli over weeks. Responses to gratings were highly stable across sessions. However, neural responses to naturalistic movies exhibited progressive representational drift across sessions. Differential drift was present across cortical layers, in inhibitory interneurons, and could not be explained by differential response strength or higher order stimulus statistics. However, representational drift was accompanied by similar differential changes in local population correlation structure. These results suggest representational stability in V1 is stimulus-dependent and may relate to differences in preexisting circuit architecture of co-tuned neurons.

Sparse Coding in Temporal Association Cortex Improves Complex Sound Discriminability

The mouse auditory cortex is comprised of several auditory fields spanning the dorsoventral axis of the temporal lobe. The ventral most auditory field is the temporal association cortex (TeA), which remains largely unstudied. Using Neuropixels probes, we simultaneously recorded from primary auditory cortex (AUDp), secondary auditory cortex (AUDv), and TeA, characterizing neuronal responses to pure tones and frequency modulated (FM) sweeps in awake head-restrained female mice. As compared with AUDp and AUDv, single-unit (SU) responses to pure tones in TeA were sparser, delayed, and prolonged. Responses to FMs were also sparser. Population analysis showed that the sparser responses in TeA render it less sensitive to pure tones, yet more sensitive to FMs. When characterizing responses to pure tones under anesthesia, the distinct signature of TeA was changed considerably as compared with that in awake mice, implying that responses in TeA are strongly modulated by non-feedforward connections. Together, these findings provide a basic electrophysiological description of TeA as an integral part of sound processing along the cortical hierarchy.SIGNIFICANCE STATEMENT This is the first comprehensive characterization of the auditory responses in the awake mouse auditory temporal association cortex (TeA). The study provides the foundations for further investigation of TeA and its involvement in auditory learning, plasticity, auditory driven behaviors etc. The study was conducted using state of the art data collection tools, allowing for simultaneous recording from multiple cortical regions and numerous neurons.

The unbiased estimation of the fraction of variance explained by a model

The correlation coefficient squared, r², is commonly used to validate quantitative models on neural data, yet it is biased by trial-to-trial variability: as trial-to-trial variability increases, measured correlation to a model’s predictions decreases. As a result, models that perfectly explain neural tuning can appear to perform poorly. Many solutions to this problem have been proposed, but no consensus has been reached on which is the least biased estimator. Some currently used methods substantially overestimate model fit, and the utility of even the best performing methods is limited by the lack of confidence intervals and asymptotic analysis. We provide a new estimator, r^ER2, that outperforms all prior estimators in our testing, and we provide confidence intervals and asymptotic guarantees. We apply our estimator to a variety of neural data to validate its utility. We find that neural noise is often so great that confidence intervals of the estimator cover the entire possible range of values ([0, 1]), preventing meaningful evaluation of the quality of a model’s predictions. This leads us to propose the use of the signal-to-noise ratio (SNR) as a quality metric for making quantitative comparisons across neural recordings. Analyzing a variety of neural data sets, we find that up to ∼ 40% of some state-of-the-art neural recordings do not pass even a liberal SNR criterion. Moving toward more reliable estimates of correlation, and quantitatively comparing quality across recording modalities and data sets, will be critical to accelerating progress in modeling biological phenomena.

Quantifying the similarity between a model and noisy data is fundamental to advancing the scientific understanding of biological phenomena, and it is particularly relevant to modeling neuronal responses. A ubiquitous metric of similarity is the correlation coefficient, but this metric depends on a variety of factors that are irrelevant to the similarity between a model and data. While neuroscientists have recognized this problem and proposed corrected methods, no consensus has been reached as to which are effective. Prior methods have wide variation in their accuracy, and even the most successful methods lack confidence intervals, leaving uncertainty about the reliability of any particular estimate. We address these issues by developing a new estimator along with an associated confidence interval that outperforms all prior methods. We also demonstrate how a signal-to-noise ratio can be used to usefully threshold and compare noisy experimental data across studies and recording paradigms.

Noise Correlations for Faster and More Robust Learning

Distributed population codes are ubiquitous in the brain and pose a challenge to downstream neurons that must learn an appropriate readout. Here we explore the possibility that this learning problem is simplified through inductive biases implemented by stimulus-independent noise correlations that constrain learning to task-relevant dimensions. We test this idea in a set of neural networks that learn to perform a perceptual discrimination task. Correlations among similarly tuned units were manipulated independently of an overall population signal-to-noise ratio to test how the format of stored information affects learning. Higher noise correlations among similarly tuned units led to faster and more robust learning, favoring homogenous weights assigned to neurons within a functionally similar pool, and could emerge through Hebbian learning. When multiple discriminations were learned simultaneously, noise correlations across relevant feature dimensions sped learning, whereas those across irrelevant feature dimensions slowed it. Our results complement the existing theory on noise correlations by demonstrating that when such correlations are produced without significant degradation of the signal-to-noise ratio, they can improve the speed of readout learning by constraining it to appropriate dimensions.SIGNIFICANCE STATEMENT Positive noise correlations between similarly tuned neurons theoretically reduce the representational capacity of the brain, yet they are commonly observed, emerge dynamically in complex tasks, and persist even in well-trained animals. Here we show that such correlations, when embedded in a neural population with a fixed signal-to-noise ratio, can improve the speed and robustness with which an appropriate readout is learned. In a simple discrimination task such correlations can emerge naturally through Hebbian learning. In more complex tasks that require multiple discriminations, correlations between neurons that similarly encode the task-relevant feature improve learning by constraining it to the appropriate task dimension.

Frequency Selectivity of Neural Circuits With Heterogeneous Discrete Transmission Delays

Neurons are connected to other neurons by axons and dendrites that conduct signals with finite velocities, resulting in delays between the firing of a neuron and the arrival of the resultant impulse at other neurons. Since delays greatly complicate the analytical treatment and interpretation of models, they are usually neglected or taken to be uniform, leading to a lack in the comprehension of the effects of delays in neural systems. This letter shows that heterogeneous transmission delays make small groups of neurons respond selectively to inputs with differing frequency spectra. By studying a single integrate-and-fire neuron receiving correlated time-shifted inputs, it is shown how the frequency response is linked to both the strengths and delay times of the afferent connections. The results show that incorporating delays alters the functioning of neural networks, and changes the effect that neural connections and synaptic strengths have.

Decision-related feedback in visual cortex lacks spatial selectivity

Feedback in the brain is thought to convey contextual information that underlies our flexibility to perform different tasks. Empirical and computational work on the visual system suggests this is achieved by targeting task-relevant neuronal subpopulations. We combine two tasks, each resulting in selective modulation by feedback, to test whether the feedback reflected the combination of both selectivities. We used visual feature-discrimination specified at one of two possible locations and uncoupled the decision formation from motor plans to report it, while recording in macaque mid-level visual areas. Here we show that although the behavior is spatially selective, using only task-relevant information, modulation by decision-related feedback is spatially unselective. Population responses reveal similar stimulus-choice alignments irrespective of stimulus relevance. The results suggest a common mechanism across tasks, independent of the spatial selectivity these tasks demand. This may reflect biological constraints and facilitate generalization across tasks. Our findings also support a previously hypothesized link between feature-based attention and decision-related activity.

Feedback modulates visual neurons, thought to help achieve flexible task performance. Here, the authors show decision-related feedback is not only relayed to task-relevant neurons, suggesting a broader mechanism and supporting a previously hypothesized link to feature-based attention.

Information capacity and robustness of encoding in the medial prefrontal cortex are modulated by the bioavailability of serotonin and the time elapsed from the cue during a reward-driven task

Serotonin (5-HT) is a key neuromodulator of medial prefrontal cortex (mPFC) functions. Pharmacological manipulation of systemic 5-HT bioavailability alters the electrical activity of mPFC neurons. However, 5-HT modulation at the population level is not well characterized. In the present study, we made single neuron extracellular recordings in the mPFC of rats performing an operant conditioning task, and analyzed the effect of systemic administration of fluoxetine (a selective serotonin reuptake inhibitor) on the information encoded in the firing activity of the neural population. Chronic (longer than 15 days), but not acute (less than 15 days), fluoxetine administration reduced the firing rate of mPFC neurons. Moreover, fluoxetine treatment enhanced pairwise entropy but diminished noise correlation and redundancy in the information encoded, thus showing how mPFC differentially encodes information as a function of 5-HT bioavailability. Information about the occurrence of the reward-predictive stimulus was maximized during reward consumption, around 3 to 4 s after the presentation of the cue, and it was higher under chronic fluoxetine treatment. However, the encoded information was less robust to noise corruption when compared to control conditions.

Accounting for Biases in the Estimation of Neuronal Signal Correlation

Signal correlation (rs) is commonly defined as the correlation between the tuning curves of two neurons and is widely used as a metric of tuning similarity. It is fundamental to how populations of neurons represent stimuli and has been central to many studies of neural coding. Yet the classic estimate, Pearson's correlation coefficient, [Formula: see text], between the average responses of two neurons to a set of stimuli suffers from confounding biases. The estimate [Formula: see text] can be downwardly biased by trial-to-trial variability and also upwardly biased by trial-to-trial correlation between neurons, and these biases can hide important aspects of neural coding. Here we provide analytic results on the source of these biases and explore them for ranges of parameters that are relevant for electrophysiological experiments. We then provide corrections for these biases that we validate in simulation. Furthermore, we apply these corrected estimators to make the following novel experimental observation in cortical area MT: pairs of nearby neurons that are strongly tuned for motion direction tend to have high signal correlation, and pairs that are weakly tuned tend to have low signal correlation. We dismiss a trivial explanation for this and find that an analogous trend holds for orientation tuning in the primary visual cortex. We also consider the potential consequences for encoding whereby the association of signal correlation and tuning strength naturally regularizes the dimensionality of downstream computations.SIGNIFICANCE STATEMENT Fundamental to how cortical neurons encode information about the environment is their functional similarity, that is, the redundancy in what they encode and their shared noise. These properties have been extensively studied theoretically and experimentally throughout the nervous system, but here we show that a common estimator of functional similarity has confounding biases. We characterize these biases and provide estimators that do not suffer from them. Using our improved estimators, we demonstrate a novel result, that is, there is a positive relationship between tuning curve similarity and amplitude for nearby neurons in the visual cortical motion area MT. We provide a simple stochastic model explaining this relationship and discuss how it would naturally regularize the dimensionality of neural encoding.

Direct extraction of signal and noise correlations from two-photon calcium imaging of ensemble neuronal activity

Neuronal activity correlations are key to understanding how populations of neurons collectively encode information. While two-photon calcium imaging has created a unique opportunity to record the activity of large populations of neurons, existing methods for inferring correlations from these data face several challenges. First, the observations of spiking activity produced by two-photon imaging are temporally blurred and noisy. Secondly, even if the spiking data were perfectly recovered via deconvolution, inferring network-level features from binary spiking data is a challenging task due to the non-linear relation of neuronal spiking to endogenous and exogenous inputs. In this work, we propose a methodology to explicitly model and directly estimate signal and noise correlations from two-photon fluorescence observations, without requiring intermediate spike deconvolution. We provide theoretical guarantees on the performance of the proposed estimator and demonstrate its utility through applications to simulated and experimentally recorded data from the mouse auditory cortex.

The thalamus and tinnitus: Bridging the gap between animal data and findings in humans

The neuronal mechanisms underlying tinnitus are yet to be revealed. Tinnitus, an auditory phantom sensation, used to be approached as a purely auditory domain symptom. More recently, the modulatory impact of non-auditory brain regions on the percept and burden of tinnitus are explored. The thalamus is uniquely situated to facilitate the communication between auditory and non-auditory subcortical and cortical structures. Traditionally, animal models of tinnitus have focussed on subcortical auditory structures, and research with human participants has been concerned with cortical activity in auditory and non-auditory areas. Recently, both research fields have investigated the connectivity between subcortical and cortical regions and between auditory and non-auditory areas. We show that even though the different fields employ different methods to investigate the activity and connectivity of brain areas, there is consistency in the results on tinnitus between these different approaches. This consistency between human and animals research is observed for tinnitus with peripherally instigated hearing damage, and for results obtained with salicylate and noise-induced tinnitus. The thalamus integrates input from limbic and prefrontal areas and modulates auditory activity via its connections to both subcortical and cortical auditory areas. Reported altered activity and connectivity of the auditory, prefrontal, and limbic regions suggest a more systemic approach is necessary to understand the origins and impact of tinnitus.

A Sparse Probabilistic Code Underlies the Limits of Behavioral Discrimination

The cortical code that underlies perception must enable subjects to perceive the world at time scales relevant for behavior. We find that mice can integrate visual stimuli very quickly (<100 ms) to reach plateau performance in an orientation discrimination task. To define features of cortical activity that underlie performance at these time scales, we measured single-unit responses in the mouse visual cortex at time scales relevant to this task. In contrast to high-contrast stimuli of longer duration, which elicit reliable activity in individual neurons, stimuli at the threshold of perception elicit extremely sparse and unreliable responses in the primary visual cortex such that the activity of individual neurons does not reliably report orientation. Integrating information across neurons, however, quickly improves performance. Using a linear decoding model, we estimate that integrating information over 50–100 neurons is sufficient to account for behavioral performance. Thus, at the limits of visual perception, the visual system integrates information encoded in the probabilistic firing of unreliable single units to generate reliable behavior.

Temporally precise population coding of dynamic sounds by auditory cortex

Fluctuations in the amplitude envelope of complex sounds provide critical cues for hearing, particularly for speech and animal vocalizations. Responses to amplitude modulation (AM) in the ascending auditory pathway have chiefly been described for single neurons. How neural populations might collectively encode and represent information about AM remains poorly characterized, even in primary auditory cortex (A1). We modeled population responses to AM based on data recorded from A1 neurons in awake squirrel monkeys and evaluated how accurately single trial responses to modulation frequencies from 4 to 512 Hz could be decoded as functions of population size, composition, and correlation structure. We found that a population-based decoding model that simulated convergent, equally weighted inputs was highly accurate and remarkably robust to the inclusion of neurons that were individually poor decoders. By contrast, average rate codes based on convergence performed poorly; effective decoding using average rates was only possible when the responses of individual neurons were segregated, as in classical population decoding models using labeled lines. The relative effectiveness of dynamic rate coding in auditory cortex was explained by shared modulation phase preferences among cortical neurons, despite heterogeneity in rate-based modulation frequency tuning. Our results indicate significant population-based synchrony in primary auditory cortex and suggest that robust population coding of the sound envelope information present in animal vocalizations and speech can be reliably achieved even with indiscriminate pooling of cortical responses. These findings highlight the importance of firing rate dynamics in population-based sensory coding.NEW & NOTEWORTHY Fundamental questions remain about population coding in primary auditory cortex (A1). In particular, issues of spike timing in models of neural populations have been largely ignored. We find that spike-timing in response to sound envelope fluctuations is highly similar across neuron populations in A1. This property of shared envelope phase preference allows for a simple population model involving unweighted convergence of neuronal responses to classify amplitude modulation frequencies with high accuracy.

Synergistic population coding of natural communication stimuli by hindbrain electrosensory neurons

Understanding how neural populations encode natural stimuli with complex spatiotemporal structure to give rise to perception remains a central problem in neuroscience. Here we investigated population coding of natural communication stimuli by hindbrain neurons within the electrosensory system of weakly electric fish Apteronotus leptorhynchus. Overall, we found that simultaneously recorded neural activities were correlated: signal but not noise correlations were variable depending on the stimulus waveform as well as the distance between neurons. Combining the neural activities using an equal-weight sum gave rise to discrimination performance between different stimulus waveforms that was limited by redundancy introduced by noise correlations. However, using an evolutionary algorithm to assign different weights to individual neurons before combining their activities (i.e., a weighted sum) gave rise to increased discrimination performance by revealing synergistic interactions between neural activities. Our results thus demonstrate that correlations between the neural activities of hindbrain electrosensory neurons can enhance information about the structure of natural communication stimuli that allow for reliable discrimination between different waveforms by downstream brain areas.

Multidimensional population activity in an electrically coupled inhibitory circuit in the cerebellar cortex

Inhibitory neurons orchestrate the activity of excitatory neurons and play key roles in circuit function. Although individual interneurons have been studied extensively, little is known about their properties at the population level. Using random-access 3D two-photon microscopy, we imaged local populations of cerebellar Golgi cells (GoCs), which deliver inhibition to granule cells. We show that population activity is organized into multiple modes during spontaneous behaviors. A slow, network-wide common modulation of GoC activity correlates with the level of whisking and locomotion, while faster (<1 s) differential population activity, arising from spatially mixed heterogeneous GoC responses, encodes more precise information. A biologically detailed GoC circuit model reproduced the common population mode and the dimensionality observed experimentally, but these properties disappeared when electrical coupling was removed. Our results establish that local GoC circuits exhibit multidimensional activity patterns that could be used for inhibition-mediated adaptive gain control and spatiotemporal patterning of downstream granule cells.

On the Complexity of Resting State Spiking Activity in Monkey Motor Cortex

Resting state has been established as a classical paradigm of brain activity studies, mostly based on large-scale measurements such as functional magnetic resonance imaging or magneto- and electroencephalography. This term typically refers to a behavioral state characterized by the absence of any task or stimuli. The corresponding neuronal activity is often called idle or ongoing. Numerous modeling studies on spiking neural networks claim to mimic such idle states, but compare their results with task- or stimulus-driven experiments, or to results from experiments with anesthetized subjects. Both approaches might lead to misleading conclusions. To provide a proper basis for comparing physiological and simulated network dynamics, we characterize simultaneously recorded single neurons' spiking activity in monkey motor cortex at rest and show the differences from spontaneous and task- or stimulus-induced movement conditions. We also distinguish between rest with open eyes and sleepy rest with eyes closed. The resting state with open eyes shows a significantly higher dimensionality, reduced firing rates, and less balance between population level excitation and inhibition than behavior-related states.

Information Capacity of a Stochastically Responding Neuron Assembly

In this work, certain aspects of the structure of the overlapping groups of neurons encoding specific signals are examined. Individual neurons are assumed to respond stochastically to input signal. Identification of a particular signal is assumed to result from the aggregate activity of a group of neurons, which we call information pathway. Conditions for definite response and for non-interference of pathways are derived. These conditions constrain the response properties of individual neurons and the allowed overlap among pathways. Under these constrains, and under the simplifying assumption that all pathways have similar structure, the information capacity of the system is derived. Furthermore, we show that there is a definite advantage in the information capacity if pathway neurons areinterspersed among the neuron assembly.

Balanced networks under spike-time dependent plasticity

The dynamics of local cortical networks are irregular, but correlated. Dynamic excitatory–inhibitory balance is a plausible mechanism that generates such irregular activity, but it remains unclear how balance is achieved and maintained in plastic neural networks. In particular, it is not fully understood how plasticity induced changes in the network affect balance, and in turn, how correlated, balanced activity impacts learning. How do the dynamics of balanced networks change under different plasticity rules? How does correlated spiking activity in recurrent networks change the evolution of weights, their eventual magnitude, and structure across the network? To address these questions, we develop a theory of spike–timing dependent plasticity in balanced networks. We show that balance can be attained and maintained under plasticity–induced weight changes. We find that correlations in the input mildly affect the evolution of synaptic weights. Under certain plasticity rules, we find an emergence of correlations between firing rates and synaptic weights. Under these rules, synaptic weights converge to a stable manifold in weight space with their final configuration dependent on the initial state of the network. Lastly, we show that our framework can also describe the dynamics of plastic balanced networks when subsets of neurons receive targeted optogenetic input.

Animals are able to learn complex tasks through changes in individual synapses between cells. Such changes lead to the coevolution of neural activity patterns and the structure of neural connectivity, but the consequences of these interactions are not fully understood. We consider plasticity in model neural networks which achieve an average balance between the excitatory and inhibitory synaptic inputs to different cells, and display cortical–like, irregular activity. We extend the theory of balanced networks to account for synaptic plasticity and show which rules can maintain balance, and which will drive the network into a different state. This theory of plasticity can provide insights into the relationship between stimuli, network dynamics, and synaptic circuitry.

Large-Scale and Multiscale Networks in the Rodent Brain during Novelty Exploration

Neural activity is coordinated across multiple spatial and temporal scales, and these patterns of coordination are implicated in both healthy and impaired cognitive operations. However, empirical cross-scale investigations are relatively infrequent, because of limited data availability and to the difficulty of analyzing rich multivariate datasets. Here, we applied frequency-resolved multivariate source-separation analyses to characterize a large-scale dataset comprising spiking and local field potential (LFP) activity recorded simultaneously in three brain regions (prefrontal cortex, parietal cortex, hippocampus) in freely-moving mice. We identified a constellation of multidimensional, inter-regional networks across a range of frequencies (2-200 Hz). These networks were reproducible within animals across different recording sessions, but varied across different animals, suggesting individual variability in network architecture. The theta band (∼4-10 Hz) networks had several prominent features, including roughly equal contribution from all regions and strong inter-network synchronization. Overall, these findings demonstrate a multidimensional landscape of large-scale functional activations of cortical networks operating across multiple spatial, spectral, and temporal scales during open-field exploration.

Correlated structure of neuronal firing in macaque visual cortex limits information for binocular depth discrimination

Variability in cortical neural activity potentially limits sensory discriminations. Theoretical work shows that information required to discriminate two similar stimuli is limited by the correlation structure of cortical variability. We investigated these information-limiting correlations by recording simultaneously from visual cortical areas primary visual cortex (V1) and extrastriate area V4 in macaque monkeys performing a binocular, stereo depth discrimination task. Within both areas, noise correlations on a rapid temporal scale (20–30 ms) were stronger for neuron pairs with similar selectivity for binocular depth, meaning that these correlations potentially limit information for making the discrimination. Between-area correlations (V1 to V4) were different, being weaker for neuron pairs with similar tuning and having a slower temporal scale (100+ ms). Fluctuations in these information-limiting correlations just prior to the detection event were associated with changes in behavioral accuracy. Although these correlations limit the recovery of information about sensory targets, their impact may be curtailed by integrative processing of signals across multiple brain areas.

NEW & NOTEWORTHY Correlated noise reduces the stimulus information in visual cortical neurons during experimental performance of binocular depth discriminations. The temporal scale of these correlations is important. Rapid (20–30 ms) correlations reduce information within and between areas V1 and V4, whereas slow (>100 ms) correlations between areas do not. Separate cortical areas appear to act together to maintain signal fidelity. Rapid correlations reduce the neuronal signal difference between stimuli and adversely affect perceptual discrimination.

Functional and Structural Properties of Highly Responsive Somatosensory Neurons in Mouse Barrel Cortex

Sparse population activity is a well-known feature of supragranular sensory neurons in neocortex. The mechanisms underlying sparseness are not well understood because a direct link between the neurons activated in vivo, and their cellular properties investigated in vitro has been missing. We used two-photon calcium imaging to identify a subset of neurons in layer L2/3 (L2/3) of mouse primary somatosensory cortex that are highly active following principal whisker vibrotactile stimulation. These high responders (HRs) were then tagged using photoconvertible green fluorescent protein for subsequent targeting in the brain slice using intracellular patch-clamp recordings and biocytin staining. This approach allowed us to investigate the structural and functional properties of HRs that distinguish them from less active control cells. Compared to less responsive L2/3 neurons, HRs displayed increased levels of stimulus-evoked and spontaneous activity, elevated noise and spontaneous pairwise correlations, and stronger coupling to the population response. Intrinsic excitability was reduced in HRs, while we found no evidence for differences in other electrophysiological and morphological parameters. Thus, the choice of which neurons participate in stimulus encoding may be determined largely by network connectivity rather than by cellular structure and function.

Distinct patterns of activity in individual cortical neurons and local networks in primary somatosensory cortex of mice evoked by square-wave mechanical limb stimulation

Artificial forms of mechanical limb stimulation are used within multiple fields of study to determine the level of cortical excitability and to map the trajectory of neuronal recovery from cortical damage or disease. Square-wave mechanical or electrical stimuli are often used in these studies, but a characterization of sensory-evoked response properties to square-waves with distinct fundamental frequencies but overlapping harmonics has not been performed. To distinguish between somatic stimuli, the primary somatosensory cortex must be able to represent distinct stimuli with unique patterns of activity, even if they have overlapping features. Thus, mechanical square-wave stimulation was used in conjunction with regional and cellular imaging to examine regional and cellular response properties evoked by different frequencies of stimulation. Flavoprotein autofluorescence imaging was used to map the somatosensory cortex of anaesthetized C57BL/6 mice, and in vivo two-photon Ca2+ imaging was used to define patterns of neuronal activation during mechanical square-wave stimulation of the contralateral forelimb or hindlimb at various frequencies (3, 10, 100, 200, and 300 Hz). The data revealed that neurons within the limb associated somatosensory cortex responding to various frequencies of square-wave stimuli exhibit stimulus-specific patterns of activity. Subsets of neurons were found to have sensory-evoked activity that is either primarily responsive to single stimulus frequencies or broadly responsive to multiple frequencies of limb stimulation. High frequency stimuli were shown to elicit more population activity, with a greater percentage of the population responding and greater percentage of cells with high amplitude responses. Stimulus-evoked cell-cell correlations within these neuronal networks varied as a function of frequency of stimulation, such that each stimulus elicited a distinct pattern that was more consistent across multiple trials of the same stimulus compared to trials at different frequencies of stimulation. The variation in cortical response to different square-wave stimuli can thus be represented by the population pattern of supra-threshold Ca2+ transients, the magnitude and temporal properties of the evoked activity, and the structure of the stimulus-evoked correlation between neurons.

Population Coding of Natural Electrosensory Stimuli by Midbrain Neurons

Natural stimuli display spatiotemporal characteristics that typically vary over orders of magnitude, and their encoding by sensory neurons remains poorly understood. We investigated population coding of highly heterogeneous natural electrocommunication stimuli in Apteronotus leptorhynchus of either sex. Neuronal activities were positively correlated with one another in the absence of stimulation, and correlation magnitude decayed with increasing distance between recording sites. Under stimulation, we found that correlations between trial-averaged neuronal responses (i.e., signal correlations) were positive and higher in magnitude for neurons located close to another, but that correlations between the trial-to-trial variability (i.e., noise correlations) were independent of physical distance. Overall, signal and noise correlations were independent of stimulus waveform as well as of one another. To investigate how neuronal populations encoded natural electrocommunication stimuli, we considered a nonlinear decoder for which the activities were combined. Decoding performance was best for a timescale of 6 ms, indicating that midbrain neurons transmit information via precise spike timing. A simple summation of neuronal activities (equally weighted sum) revealed that noise correlations limited decoding performance by introducing redundancy. Using an evolution algorithm to optimize performance when considering instead unequally weighted sums of neuronal activities revealed much greater performance values, indicating that midbrain neuron populations transmit information that reliably enable discrimination between different stimulus waveforms. Interestingly, we found that different weight combinations gave rise to similar discriminability, suggesting robustness. Our results have important implications for understanding how natural stimuli are integrated by downstream brain areas to give rise to behavioral responses.SIGNIFICANCE STATEMENT We show that midbrain electrosensory neurons display correlations between their activities and that these can significantly impact performance of decoders. While noise correlations limited discrimination performance by introducing redundancy, considering unequally weighted sums of neuronal activities gave rise to much improved performance and mitigated the deleterious effects of noise correlations. Further analysis revealed that increased discriminability was achieved by making trial-averaged responses more separable, as well as by reducing trial-to-trial variability by eliminating noise correlations. We further found that multiple combinations of weights could give rise to similar discrimination performances, which suggests that such combinatorial codes could be achieved in the brain. We conclude that the activities of midbrain neuronal populations can be used to reliably discriminate between highly heterogeneous stimulus waveforms.

Individual Alpha Frequency Determines the Impact of Bottom-Up Drive on Visual Processing

Endogenous alpha oscillations propagate from higher-order to early visual cortical regions, consistent with the observed modulation of these oscillations by top-down factors. However, bottom-up manipulations also influence alpha oscillations, and little is known about how these top-down and bottom-up processes interact to impact behavior. To address this, participants performed a detection task while viewing a stimulus flickering at multiple alpha band frequencies. Bottom-up drive at a participant's endogenous alpha frequency either impaired or enhanced perception, depending on the frequency, but not amplitude, of their endogenous alpha oscillation. Fast alpha drive impaired perceptual performance in participants with faster endogenous alpha oscillations, while participants with slower oscillations displayed enhanced performance. This interaction was reflected in slower endogenous oscillatory dynamics in participants with fast alpha oscillations and more rapid dynamics in participants with slow endogenous oscillations when receiving high-frequency bottom-up drive. This central tendency may suggest that driving visual circuits at alpha band frequencies that are away from the peak alpha frequency improves perception through dynamical interactions with the endogenous oscillation. As such, studies that causally manipulate neural oscillations via exogenous stimulation should carefully consider interacting effects of bottom-up drive and endogenous oscillations on behavior.

Decoding of Attentional State Using High-Frequency Local Field Potential Is As Accurate As Using Spikes

Local field potentials (LFPs) in visual cortex are reliably modulated when the subject's focus of attention is cued into versus out of the receptive field of the recorded sites, similar to modulation of spikes. However, human psychophysics studies have used an additional attention condition, neutral cueing, for decades. The effect of neutral cueing on spikes was examined recently and found to be intermediate between cued and uncued conditions. However, whether LFPs are also precise enough to represent graded states of attention is unknown. We found in rhesus monkeys that LFPs during neutral cueing were also intermediate between cued and uncued conditions. For a single electrode, attention was more discriminable using high frequency (>30 Hz) LFP power than spikes, which is expected because LFP represents a population signal and therefore is expected to be less noisy than spikes. However, previous studies have shown that when multiple electrodes are used, spikes can outperform LFPs. Surprisingly, in our study, spikes did not outperform LFPs when discriminability was computed using multiple electrodes, even though the LFP activity was highly correlated across electrodes compared with spikes. These results constrain the spatial scale over which attention operates and highlight the usefulness of LFPs in studying attention.

High-precision coding in visual cortex

Individual neurons in visual cortex provide the brain with unreliable estimates of visual features. It is not known whether the single-neuron variability is correlated across large neural populations, thus impairing the global encoding of stimuli. We recorded simultaneously from up to 50,000 neurons in mouse primary visual cortex (V1) and in higher order visual areas and measured stimulus discrimination thresholds of 0.35° and 0.37°, respectively, in an orientation decoding task. These neural thresholds were almost 100 times smaller than the behavioral discrimination thresholds reported in mice. This discrepancy could not be explained by stimulus properties or arousal states. Furthermore, behavioral variability during a sensory discrimination task could not be explained by neural variability in V1. Instead, behavior-related neural activity arose dynamically across a network of non-sensory brain areas. These results imply that perceptual discrimination in mice is limited by downstream decoders, not by neural noise in sensory representations.

Efficient and robust coding in heterogeneous recurrent networks

Cortical networks show a large heterogeneity of neuronal properties. However, traditional coding models have focused on homogeneous populations of excitatory and inhibitory neurons. Here, we analytically derive a class of recurrent networks of spiking neurons that close to optimally track a continuously varying input online, based on two assumptions: 1) every spike is decoded linearly and 2) the network aims to reduce the mean-squared error between the input and the estimate. From this we derive a class of predictive coding networks, that unifies encoding and decoding and in which we can investigate the difference between homogeneous networks and heterogeneous networks, in which each neurons represents different features and has different spike-generating properties. We find that in this framework, 'type 1' and 'type 2' neurons arise naturally and networks consisting of a heterogeneous population of different neuron types are both more efficient and more robust against correlated noise. We make two experimental predictions: 1) we predict that integrators show strong correlations with other integrators and resonators are correlated with resonators, whereas the correlations are much weaker between neurons with different coding properties and 2) that 'type 2' neurons are more coherent with the overall network activity than 'type 1' neurons.

Functional and directed connectivity of the cortico-limbic network in mice in vivo

Higher cognitive processes and emotional regulation depend on densely interconnected telencephalic and limbic areas. Central structures of this cortico-limbic network are ventral hippocampus (vHC), medial prefrontal cortex (PFC), basolateral amygdala (BLA) and nucleus accumbens (NAC). Human and animal studies have revealed both anatomical and functional alterations in specific connections of this network in several psychiatric disorders. However, it is often not clear whether functional alterations within these densely interconnected brain areas are caused by modifications in the direct pathways, or alternatively through indirect interactions. We performed multi-site extracellular recordings of spontaneous activity in three different brain regions to study the functional connectivity in the BLA-NAC-PFC-vHC network of the lightly anesthetized mouse in vivo. We show that BLA, NAC, PFC and vHC are functionally connected in distinct frequency bands and determined the influence of a third brain region on this connectivity. In addition to describing mutual synchronicity, we determined the strength of functional connectivity for each region in the BLA-NAC-PFC-vHC network. We find a region-specificity in the strength of feedforward and feedback connections for each region in its interaction with other areas in the network. Our results provide insights into functional and directed connectivity in the cortico-limbic network of adult wild-type mice, which may be helpful to further elucidate the pathophysiological changes of this network in psychiatric disorders and to develop target-specific therapeutic interventions.

Noise in Neurons and Synapses Enables Reliable Associative Memory Storage in Local Cortical Circuits

Neural networks in the brain can function reliably despite various sources of errors and noise present at every step of signal transmission. These sources include errors in the presynaptic inputs to the neurons, noise in synaptic transmission, and fluctuations in the neurons’ postsynaptic potentials (PSPs). Collectively they lead to errors in the neurons’ outputs which are, in turn, injected into the network. Does unreliable network activity hinder fundamental functions of the brain, such as learning and memory retrieval? To explore this question, this article examines the effects of errors and noise on the properties of model networks of inhibitory and excitatory neurons involved in associative sequence learning. The associative learning problem is solved analytically and numerically, and it is also shown how memory sequences can be loaded into the network with a biologically more plausible perceptron-type learning rule. Interestingly, the results reveal that errors and noise during learning increase the probability of memory recall. There is a trade-off between the capacity and reliability of stored memories, and, noise during learning is required for optimal retrieval of stored information. What is more, networks loaded with associative memories to capacity display many structural and dynamical features observed in local cortical circuits in mammals. Based on the similarities between the associative and cortical networks, this article predicts that connections originating from more unreliable neurons or neuron classes in the cortex are more likely to be depressed or eliminated during learning, while connections onto noisier neurons or neuron classes have lower probabilities and higher weights.

Weakly correlated synapses promote dimension reduction in deep neural networks

By controlling synaptic and neural correlations, deep learning has achieved empirical successes in improving classification performances. How synaptic correlations affect neural correlations to produce disentangled hidden representations remains elusive. Here we propose a simplified model of dimension reduction, taking into account pairwise correlations among synapses, to reveal the mechanism underlying how the synaptic correlations affect dimension reduction. Our theory determines the scaling of synaptic correlations requiring only mathematical self-consistency for both binary and continuous synapses. The theory also predicts that weakly correlated synapses encourage dimension reduction compared to their orthogonal counterparts. In addition, these synapses attenuate the decorrelation process along the network depth. These two computational roles are explained by a proposed mean-field equation. The theoretical predictions are in excellent agreement with numerical simulations, and the key features are also captured by deep learning with Hebbian rules.

Estimating Fisher discriminant error in a linear integrator model of neural population activity

Decoding approaches provide a useful means of estimating the information contained in neuronal circuits. In this work, we analyze the expected classification error of a decoder based on Fisher linear discriminant analysis. We provide expressions that relate decoding error to the specific parameters of a population model that performs linear integration of sensory input. Results show conditions that lead to beneficial and detrimental effects of noise correlation on decoding. Further, the proposed framework sheds light on the contribution of neuronal noise, highlighting cases where, counter-intuitively, increased noise may lead to improved decoding performance. Finally, we examined the impact of dynamical parameters, including neuronal leak and integration time constant, on decoding. Overall, this work presents a fruitful approach to the study of decoding using a comprehensive theoretical framework that merges dynamical parameters with estimates of readout error.

Temporally multiplexed dual-plane imaging of neural activity with four-dimensional precision

Spatiotemporal patterns of neural activity generate brain functions, such as perception, memory, and behavior. Four-dimensional (4-D: x, y, z, t) analyses of such neural activity will facilitate understanding of brain functions. However, conventional two-photon microscope systems observe single-plane brain tissue alone at a time with cellular resolution. It faces a trade-off between the spatial resolution in the x-, y-, and z-axes and the temporal resolution by a limited point-by-point scan speed. To overcome this trade-off in 4-D imaging, we developed a holographic two-photon microscope for dual-plane imaging. A spatial light modulator (SLM) provided an additional focal plane at a different depth. Temporal multiplexing of split lasers with an optical chopper allowed fast imaging of two different focal planes. We simultaneously recorded the activities of neurons on layers 2/3 and 5 of the cerebral cortex in awake mice in vivo. The present study demonstrated the proof-of-concept of dual-plane two-photon imaging of neural circuits by using the temporally multiplexed SLM-based microscope. The temporally multiplexed holographic microscope, combined with in vivo labeling with genetically encoded probes, enabled 4-D imaging and analysis of neural activities at cellular resolution and physiological timescales. Large-scale 4-D imaging and analysis will facilitate studies of not only the nervous system but also of various biological systems.

Behavior needs neural variability

Human and non-human animal behavior is highly malleable and adapts successfully to internal and external demands. Such behavioral success stands in striking contrast to the apparent instability in neural activity (i.e., variability) from which it arises. Here, we summon the considerable evidence across scales, species, and imaging modalities that neural variability represents a key, undervalued dimension for understanding brain-behavior relationships at inter- and intra-individual levels. We believe that only by incorporating a specific focus on variability will the neural foundation of behavior be comprehensively understood.

The Functional Relevance of Task-State Functional Connectivity

Resting-state functional connectivity has provided substantial insight into intrinsic brain network organization, yet the functional importance of task-related change from that intrinsic network organization remains unclear. Indeed, such task-related changes are known to be small, suggesting they may have only minimal functional relevance. Alternatively, despite their small amplitude, these task-related changes may be essential for the ability of the human brain to adaptively alter its functionality via rapid changes in inter-regional relationships. We used activity flow mapping-an approach for building empirically derived network models-to quantify the functional importance of task-state functional connectivity (above and beyond resting-state functional connectivity) in shaping cognitive task activations in the (female and male) human brain. We found that task-state functional connectivity could be used to better predict independent fMRI activations across all 24 task conditions and all 360 cortical regions tested. Further, we found that prediction accuracy was strongly driven by individual-specific functional connectivity patterns, while functional connectivity patterns from other tasks (task-general functional connectivity) still improved predictions beyond resting-state functional connectivity. Additionally, since activity flow models simulate how task-evoked activations (which underlie behavior) are generated, these results may provide mechanistic insight into why prior studies found correlations between task-state functional connectivity and individual differences in behavior. These findings suggest that task-related changes to functional connections play an important role in dynamically reshaping brain network organization, shifting the flow of neural activity during task performance.SIGNIFICANCE STATEMENT Human cognition is highly dynamic, yet the functional network organization of the human brain is highly similar across rest and task states. We hypothesized that, despite this overall network stability, task-related changes from the intrinsic (resting-state) network organization of the brain strongly contribute to brain activations during cognitive task performance. Given that cognitive task activations emerge through network interactions, we leveraged connectivity-based models to predict independent cognitive task activations using resting-state versus task-state functional connectivity. This revealed that task-related changes in functional network organization increased prediction accuracy of cognitive task activations substantially, demonstrating their likely functional relevance for dynamic cognitive processes despite the small size of these task-related network changes.

Scaling of sensory information in large neural populations shows signatures of information-limiting correlations

How is information distributed across large neuronal populations within a given brain area? Information may be distributed roughly evenly across neuronal populations, so that total information scales linearly with the number of recorded neurons. Alternatively, the neural code might be highly redundant, meaning that total information saturates. Here we investigate how sensory information about the direction of a moving visual stimulus is distributed across hundreds of simultaneously recorded neurons in mouse primary visual cortex. We show that information scales sublinearly due to correlated noise in these populations. We compartmentalized noise correlations into information-limiting and nonlimiting components, then extrapolate to predict how information grows with even larger neural populations. We predict that tens of thousands of neurons encode 95% of the information about visual stimulus direction, much less than the number of neurons in primary visual cortex. These findings suggest that the brain uses a widely distributed, but nonetheless redundant code that supports recovering most sensory information from smaller subpopulations.

Lessons From Deep Neural Networks for Studying the Coding Principles of Biological Neural Networks

One of the central goals in systems neuroscience is to understand how information is encoded in the brain, and the standard approach is to identify the relation between a stimulus and a neural response. However, the feature of a stimulus is typically defined by the researcher's hypothesis, which may cause biases in the research conclusion. To demonstrate potential biases, we simulate four likely scenarios using deep neural networks trained on the image classification dataset CIFAR-10 and demonstrate the possibility of selecting suboptimal/irrelevant features or overestimating the network feature representation/noise correlation. Additionally, we present studies investigating neural coding principles in biological neural networks to which our points can be applied. This study aims to not only highlight the importance of careful assumptions and interpretations regarding the neural response to stimulus features but also suggest that the comparative study between deep and biological neural networks from the perspective of machine learning can be an effective strategy for understanding the coding principles of the brain.

A Diversity of Intrinsic Timescales Underlie Neural Computations

Neural processing occurs across a range of temporal scales. To facilitate this, the brain uses fast-changing representations reflecting momentary sensory input alongside more temporally extended representations, which integrate across both short and long temporal windows. The temporal flexibility of these representations allows animals to behave adaptively. Short temporal windows facilitate adaptive responding in dynamic environments, while longer temporal windows promote the gradual integration of information across time. In the cognitive and motor domains, the brain sets overarching goals to be achieved within a long temporal window, which must be broken down into sequences of actions and precise movement control processed across much shorter temporal windows. Previous human neuroimaging studies and large-scale artificial network models have ascribed different processing timescales to different cortical regions, linking this to each region's position in an anatomical hierarchy determined by patterns of inter-regional connectivity. However, even within cortical regions, there is variability in responses when studied with single-neuron electrophysiology. Here, we review a series of recent electrophysiology experiments that demonstrate the heterogeneity of temporal receptive fields at the level of single neurons within a cortical region. This heterogeneity appears functionally relevant for the computations that neurons perform during decision-making and working memory. We consider anatomical and biophysical mechanisms that may give rise to a heterogeneity of timescales, including recurrent connectivity, cortical layer distribution, and neurotransmitter receptor expression. Finally, we reflect on the computational relevance of each brain region possessing a heterogeneity of neuronal timescales. We argue that this architecture is of particular importance for sensory, motor, and cognitive computations.

Noise-Correlation Is Modulated by Reward Expectation in the Primary Motor Cortex Bilaterally During Manual and Observational Tasks in Primates

Reward modulation is represented in the motor cortex (M1) and could be used to implement more accurate decoding models to improve brain-computer interfaces (BCIs; Zhao et al., 2018). Analyzing trial-to-trial noise-correlations between neural units in the presence of rewarding (R) and non-rewarding (NR) stimuli adds to our understanding of cortical network dynamics. We utilized Pearson's correlation coefficient to measure shared variability between simultaneously recorded units (32-112) and found significantly higher noise-correlation and positive correlation between the populations' signal- and noise-correlation during NR trials as compared to R trials. This pattern is evident in data from two non-human primates (NHPs) during single-target center out reaching tasks, both manual and action observation versions. We conducted a mean matched noise-correlation analysis to decouple known interactions between event-triggered firing rate changes and neural correlations. Isolated reward discriminatory units demonstrated stronger correlational changes than units unresponsive to reward firing rate modulation, however, the qualitative response was similar, indicating correlational changes within the network as a whole can serve as another information channel to be exploited by BCIs that track the underlying cortical state, such as reward expectation, or attentional modulation. Reward expectation and attention in return can be utilized with reinforcement learning (RL) towards autonomous BCI updating.

Approaches to inferring multi-regional interactions from simultaneous population recordings: Inferring multi-regional interactions from simultaneous population recordings

Most past studies of neural representations and dynamics have focused on recordings from single brain areas. However, growing evidence of brain-wide, parallel representations of cognitive variables suggests that analyzing neural representations and dynamics in individual brain areas can benefit from understanding the context of multi-regional interactions that support them. Moreover, perturbation experiments revealed that the manner in which these parallel representations interact with each other can differ dramatically across different pairs of brain areas. Recent advances in recording technology offer a potentially powerful substrate to study how multi-regional interactions coordinate neural representations in individual brain areas and dictate behavior on a single-trial basis through simultaneous recordings of multiple brain areas. We review pragmatic approaches to studying multi-regional interactions and illustrate them in the concrete context of a rodent delayed response task paradigm.