Spontaneous and evoked activity patterns diverge over development

Modeling the Emergence of Circuit Organization and Function during Development

Developing neural circuits show unique patterns of spontaneous activity and structured network connectivity shaped by diverse activity-dependent plasticity mechanisms. Based on extensive experimental work characterizing patterns of spontaneous activity in different brain regions over development, theoretical and computational models have played an important role in delineating the generation and function of individual features of spontaneous activity and their role in the plasticity-driven formation of circuit connectivity. Here, we review recent modeling efforts that explore how the developing cortex and hippocampus generate spontaneous activity, focusing on specific connectivity profiles and the gradual strengthening of inhibition as the key drivers behind the observed developmental changes in spontaneous activity. We then discuss computational models that mechanistically explore how different plasticity mechanisms use this spontaneous activity to instruct the formation and refinement of circuit connectivity, from the formation of single neuron receptive fields to sensory feature maps and recurrent architectures. We end by highlighting several open challenges regarding the functional implications of the discussed circuit changes, wherein models could provide the missing step linking immature developmental and mature adult information processing capabilities.

The developmental emergence of reliable cortical representations

The fundamental structure of cortical networks arises early in development before the onset of sensory experience. However, how endogenously generated networks respond to the onset of sensory experience and how they form mature sensory representations with experience remain unclear. In this study, we examined this 'nature-nurture transform' at the single-trial level using chronic in vivo calcium imaging in ferret visual cortex. At eye opening, visual stimulation evokes robust patterns of modular cortical network activity that are highly variable within and across trials, severely limiting stimulus discriminability. These initial stimulus-evoked modular patterns are distinct from spontaneous network activity patterns present before and at the time of eye opening. Within a week of normal visual experience, cortical networks develop low-dimensional, highly reliable stimulus representations that correspond with reorganized patterns of spontaneous activity. Using a computational model, we propose that reliable visual representations derive from the alignment of feedforward and recurrent cortical networks shaped by novel patterns of visually driven activity.

Flexibility of intrinsic neural timescales during distinct behavioral states

Recent neuroimaging studies demonstrate a heterogeneity of timescales prevalent in the brain's ongoing spontaneous activity, labeled intrinsic neural timescales (INT). At the same time, neural timescales also reflect stimulus- or task-related activity. The relationship of the INT during the brain's spontaneous activity with their involvement in task states including behavior remains unclear. To address this question, we combined calcium imaging data of spontaneously behaving mice and human electroencephalography (EEG) during rest and task states with computational modeling. We obtained four primary findings: (i) the distinct behavioral states can be accurately predicted from INT, (ii) INT become longer during behavioral states compared to rest, (iii) INT change from rest to task is correlated negatively with the variability of INT during rest, (iv) neural mass modeling shows a key role of recurrent connections in mediating the rest-task change of INT. Extending current findings, our results show the dynamic nature of the brain's INT in reflecting continuous behavior through their flexible rest-task modulation possibly mediated by recurrent connections.

Orthogonalization of spontaneous and stimulus-driven activity by hierarchical neocortical areal network in primates

How biological neural networks reliably process information in the presence of spontaneous activity remains controversial. In mouse primary visual cortex (V1), stimulus-evoked and spontaneous activity show orthogonal (dissimilar) patterns, which is advantageous for separating sensory signals from internal noise. However, studies in carnivore and primate V1, which have functional columns, have reported high similarity between stimulus-evoked and spontaneous activity. Thus, the mechanism of signal-noise separation in the columnar visual cortex may be different from that in rodents. To address this issue, we compared spontaneous and stimulus-evoked activity in marmoset V1 and higher visual areas. In marmoset V1, spontaneous and stimulus-evoked activity showed similar patterns as expected. However, in marmoset higher visual areas, spontaneous and stimulus-evoked activity were progressively orthogonalized along the cortical hierarchy, eventually reaching levels comparable to those in mouse V1. These results suggest that orthogonalization of spontaneous and stimulus-evoked activity is a general principle of cortical computation.

Analysis methods for large-scale neuronal recordings

Simultaneous recordings from hundreds or thousands of neurons are becoming routine because of innovations in instrumentation, molecular tools, and data processing software. Such recordings can be analyzed with data science methods, but it is not immediately clear what methods to use or how to adapt them for neuroscience applications. We review, categorize, and illustrate diverse analysis methods for neural population recordings and describe how these methods have been used to make progress on longstanding questions in neuroscience. We review a variety of approaches, ranging from the mathematically simple to the complex, from exploratory to hypothesis-driven, and from recently developed to more established methods. We also illustrate some of the common statistical pitfalls in analyzing large-scale neural data.

Fantastic beasts and how to study them: rethinking experimental animal behavior

Humans have been trying to understand animal behavior at least since recorded history. Recent rapid development of new technologies has allowed us to make significant progress in understanding the physiological and molecular mechanisms underlying behavior, a key goal of neuroethology. However, there is a tradeoff when studying animal behavior and its underlying biological mechanisms: common behavior protocols in the laboratory are designed to be replicable and controlled, but they often fail to encompass the variability and breadth of natural behavior. This Commentary proposes a framework of 10 key questions that aim to guide researchers in incorporating a rich natural context into their experimental design or in choosing a new animal study system. The 10 questions cover overarching experimental considerations that can provide a template for interspecies comparisons, enable us to develop studies in new model organisms and unlock new experiments in our quest to understand behavior.

Simultaneous, cortex-wide and cellular-resolution neuronal population dynamics reveal an unbounded scaling of dimensionality with neuron number

The brain's remarkable properties arise from collective activity of millions of neurons. Widespread application of dimensionality reduction to multi-neuron recordings implies that neural dynamics can be approximated by low-dimensional "latent" signals reflecting neural computations. However, what would be the biological utility of such a redundant and metabolically costly encoding scheme and what is the appropriate resolution and scale of neural recording to understand brain function? Imaging the activity of one million neurons at cellular resolution and near-simultaneously across mouse cortex, we demonstrate an unbounded scaling of dimensionality with neuron number. While half of the neural variance lies within sixteen behavior-related dimensions, we find this unbounded scaling of dimensionality to correspond to an ever-increasing number of internal variables without immediate behavioral correlates. The activity patterns underlying these higher dimensions are fine-grained and cortex-wide, highlighting that large-scale recording is required to uncover the full neural substrates of internal and potentially cognitive processes.

Revealing and reshaping attractor dynamics in large networks of cortical neurons

Attractors play a key role in a wide range of processes including learning and memory. Due to recent innovations in recording methods, there is increasing evidence for the existence of attractor dynamics in the brain. Yet, our understanding of how these attractors emerge or disappear in a biological system is lacking. By following the spontaneous network bursts of cultured cortical networks, we are able to define a vocabulary of spatiotemporal patterns and show that they function as discrete attractors in the network dynamics. We show that electrically stimulating specific attractors eliminates them from the spontaneous vocabulary, while they are still robustly evoked by the electrical stimulation. This seemingly paradoxical finding can be explained by a Hebbian-like strengthening of specific pathways into the attractors, at the expense of weakening non-evoked pathways into the same attractors. We verify this hypothesis and provide a mechanistic explanation for the underlying changes supporting this effect.

Sensory cortical ensembles exhibit differential coupling to ripples in distinct hippocampal subregions

Cortical neurons activated during recent experiences often reactivate with dorsal hippocampal CA1 ripples during subsequent rest. Less is known about cortical interactions with intermediate hippocampal CA1, whose connectivity, functions, and ripple events differ from dorsal CA1. We identified three clusters of putative excitatory neurons in mouse visual cortex that are preferentially excited together with either dorsal or intermediate CA1 ripples or suppressed before both ripples. Neurons in each cluster were evenly distributed across primary and higher visual cortices and co-active even in the absence of ripples. These ensembles exhibited similar visual responses but different coupling to thalamus and pupil-indexed arousal. We observed a consistent activity sequence preceding and predicting ripples: (1) suppression of ripple-suppressed cortical neurons, (2) thalamic silence, and (3) activation of intermediate CA1-ripple-activated cortical neurons. We propose that coordinated dynamics of these ensembles relay visual experiences to distinct hippocampal subregions for incorporation into different cognitive maps.

Repeated passive visual experience modulates spontaneous and non-familiar stimuli-evoked neural activity

Familiarity creates subjective memory of repeated innocuous experiences, reduces neural and behavioral responsiveness to those experiences, and enhances novelty detection. The neural correlates of the internal model of familiarity and the cellular mechanisms of enhanced novelty detection following multi-day repeated passive experience remain elusive. Using the mouse visual cortex as a model system, we test how the repeated passive experience of a 45° orientation-grating stimulus for multiple days alters spontaneous and non-familiar stimuli evoked neural activity in neurons tuned to familiar or non-familiar stimuli. We found that familiarity elicits stimulus competition such that stimulus selectivity reduces in neurons tuned to the familiar 45° stimulus; it increases in those tuned to the 90° stimulus but does not affect neurons tuned to the orthogonal 135° stimulus. Furthermore, neurons tuned to orientations 45° apart from the familiar stimulus dominate local functional connectivity. Interestingly, responsiveness to natural images, which consists of familiar and non-familiar orientations, increases subtly in neurons that exhibit stimulus competition. We also show the similarity between familiar grating stimulus-evoked and spontaneous activity increases, indicative of an internal model of altered experience.

A role for cortical interneurons as adversarial discriminators

The brain learns representations of sensory information from experience, but the algorithms by which it does so remain unknown. One popular theory formalizes representations as inferred factors in a generative model of sensory stimuli, meaning that learning must improve this generative model and inference procedure. This framework underlies many classic computational theories of sensory learning, such as Boltzmann machines, the Wake/Sleep algorithm, and a more recent proposal that the brain learns with an adversarial algorithm that compares waking and dreaming activity. However, in order for such theories to provide insights into the cellular mechanisms of sensory learning, they must be first linked to the cell types in the brain that mediate them. In this study, we examine whether a subtype of cortical interneurons might mediate sensory learning by serving as discriminators, a crucial component in an adversarial algorithm for representation learning. We describe how such interneurons would be characterized by a plasticity rule that switches from Hebbian plasticity during waking states to anti-Hebbian plasticity in dreaming states. Evaluating the computational advantages and disadvantages of this algorithm, we find that it excels at learning representations in networks with recurrent connections but scales poorly with network size. This limitation can be partially addressed if the network also oscillates between evoked activity and generative samples on faster timescales. Consequently, we propose that an adversarial algorithm with interneurons as discriminators is a plausible and testable strategy for sensory learning in biological systems.

Repeated passive visual experience modulates spontaneous and non-familiar stimulievoked neural activity

Familiarity creates subjective memory of repeated innocuous experiences, reduces neural and behavioral responsiveness to those experiences, and enhances novelty detection. The neural correlates of the internal model of familiarity and the cellular mechanisms of enhanced novelty detection following multi-day repeated passive experience remain elusive. Using the mouse visual cortex as a model system, we test how the repeated passive experience of a 45° orientation-grating stimulus for multiple days alters spontaneous and non-familiar stimuli evoked neural activity in neurons tuned to familiar or non-familiar stimuli. We found that familiarity elicits stimulus competition such that stimulus selectivity reduces in neurons tuned to the familiar 45° stimulus; it increases in those tuned to the 90° stimulus but does not affect neurons tuned to the orthogonal 135° stimulus. Furthermore, neurons tuned to orientations 45° apart from the familiar stimulus dominate local functional connectivity. Interestingly, responsiveness to natural images, which consists of familiar and non-familiar orientations, increases subtly in neurons that exhibit stimulus competition. We also show the similarity between familiar grating stimulus-evoked and spontaneous activity increases, indicative of an internal model of altered experience.

Brain mechanisms of mental processing: from evoked and spontaneous brain activities to enactive brain activity

Within the context of the computer metaphor, evoked brain activity acts as a primary carrier for the brain mechanisms of mental processing. However, many studies have found that evoked brain activity is not the major part of brain activity. Instead, spontaneous brain activity exhibits greater intensity and coevolves with evoked brain activity through continuous interaction. Spontaneous and evoked brain activities are similar but not identical. They are not separate parts, but always dynamically interact with each other. Therefore, the enactive cognition theory further states that the brain is characterized by unified and active patterns of activity. The brain adjusts its activity pattern by minimizing the error between expectation and stimulation, adapting to the ever-changing environment. Therefore, the dynamic regulation of brain activity in response to task situations is the core brain mechanism of mental processing. Beyond the evoked brain activity and spontaneous brain activity, the enactive brain activity provides a novel framework to completely describe brain activities during mental processing. It is necessary for upcoming researchers to introduce innovative indicators and paradigms for investigating enactive brain activity during mental processing.

Sensory cortical ensembles exhibit differential coupling to ripples in distinct hippocampal subregions

Cortical neurons activated during recent experiences often reactivate with dorsal hippocampal CA1 sharp-wave ripples (SWRs) during subsequent rest. Less is known about cortical interactions with intermediate hippocampal CA1, whose connectivity, functions, and SWRs differ from those of dorsal CA1. We identified three clusters of visual cortical excitatory neurons that are excited together with either dorsal or intermediate CA1 SWRs, or suppressed before both SWRs. Neurons in each cluster were distributed across primary and higher visual cortices and co-active even in the absence of SWRs. These ensembles exhibited similar visual responses but different coupling to thalamus and pupil-indexed arousal. We observed a consistent activity sequence: (i) suppression of SWR-suppressed cortical neurons, (ii) thalamic silence, and (iii) activation of the cortical ensemble preceding and predicting intermediate CA1 SWRs. We propose that the coordinated dynamics of these ensembles relay visual experiences to distinct hippocampal subregions for incorporation into different cognitive maps.

fmr1 Mutation Alters the Early Development of Sensory Coding and Hunting and Social Behaviors in Larval Zebrafish

Autism spectrum disorders (ASDs) are developmental in origin; however, little is known about how they affect the early development of behavior and sensory coding. The most common inherited form of autism is Fragile X syndrome (FXS), caused by a mutation in FMR1 Mutation of fmr1 in zebrafish causes anxiety-like behavior, hyperactivity, and hypersensitivity in auditory and visual processing. Here, we show that zebrafish fmr1-/- mutant larvae of either sex also display changes in hunting behavior, tectal coding, and social interaction. During hunting, they were less successful at catching prey and displayed altered behavioral sequences. In the tectum, representations of prey-like stimuli were more diffuse and had higher dimensionality. In a social behavioral assay, they spent more time observing a conspecific but responded more slowly to social cues. However, when given a choice of rearing environment fmr1-/- larvae preferred one with reduced visual stimulation, and rearing them in this environment reduced genotype-specific effects on tectal excitability. Together, these results shed new light on how fmr1-/- changes the early development of neural systems and behavior in a vertebrate.SIGNIFICANCE STATEMENT Autism spectrum disorders (ASDs) are caused by changes in early neural development. Animal models of ASDs offer the opportunity to study these developmental processes in greater detail than in humans. Here, we found that a zebrafish mutant for a gene which in humans causes one type of ASD showed early alterations in hunting behavior, social behavior, and how visual stimuli are represented in the brain. However, we also found that mutant fish preferred reduced visual stimulation, and rearing them in this environment reduced alterations in neural activity patterns. These results suggest interesting new directions for using zebrafish as a model to study the development of brain and behavior in ASDs, and how the impact of ASDs could potentially be reduced.

A Novel Mechanism for T1R-Independent Taste Responses to Concentrated Sugars

Recent findings from our laboratory demonstrated that the rostral nucleus of the solitary tract (rNST) retains some responsiveness to sugars in double-knock-out mice lacking either the T1R1+T1R3 (KO1+3) or T1R2+T1R3 (KO2+3) taste receptor heterodimers. Here, we extended these findings in the parabrachial nucleus (PBN) of male and female KO1+3 mice using warm stimuli to optimize sugar responses and employing additional concentrations and pharmacological agents to probe mechanisms. PBN T1R-independent sugar responses, including those to concentrated glucose, were more evident than in rNST. Similar to the NST, there were no "sugar-best" neurons in KO1+3 mice. Nevertheless, 1000 mm glucose activated nearly 55% of PBN neurons, with responses usually occurring in neurons that also displayed acid and amiloride-insensitive NaCl responses. In wild-type (WT) mice, concentrated sugars activated the same electrolyte-sensitive neurons but also "sugar-best" cells. Regardless of genotype, phlorizin, an inhibitor of the sodium-glucose co-transporter (SGLT), a component of a hypothesized alternate glucose-sensing mechanism, did not diminish responses to 1000 mm glucose. The efficacy of concentrated sugars for driving neurons broadly responsive to electrolytes implied an origin from Type III taste bud cells. To test this, we used the carbonic anhydrase (CA) inhibitor dorzolamide (DRZ), previously shown to inhibit amiloride-insensitive sodium responses arising from Type III taste bud cells. Dorzolamide had no effect on sugar-elicited responses in WT sugar-best PBN neurons but strongly suppressed them in WT and KO1+3 electrolyte-generalist neurons. These findings suggest a novel T1R-independent mechanism for hyperosmotic sugars, involving a CA-dependent mechanism in Type III taste bud cells.SIGNIFICANCE STATEMENT Since the discovery of Tas1r receptors for sugars and artificial sweeteners, evidence has accrued that mice lacking these receptors maintain some behavioral, physiological, and neural responsiveness to sugars. But the substrate(s) has remained elusive. Here, we recorded from parabrachial nucleus (PBN) taste neurons and identified T1R-independent responses to hyperosmotic sugars dependent on carbonic anhydrase (CA) and occurring primarily in neurons broadly responsive to NaCl and acid, implying an origin from Type III taste bud cells. The effectiveness of different sugars in driving these T1R-independent responses did not correlate with their efficacy in driving licking, suggesting they evoke a nonsweet sensation. Nevertheless, these salient responses are likely to comprise an adequate cue for learned preferences that occur in the absence of T1R receptors.

Cortex-wide spontaneous activity non-linearly steers propagating sensory-evoked activity in awake mice

The brain responds highly variably to identical sensory inputs, but there is no consensus on the nature of this variability. We explore this question using cortex-wide optical voltage imaging and whisker stimulation in awake mice. Clustering analysis reveals that the sensory-evoked activity propagates over the cortex via distinct pathways associated with distinct behavioral states. The pathway taken by each trial is independent of the level of primary sensory-evoked activation but is partially predictable by the spatiotemporal features of the preceding cortical spontaneous activity patterns. The sensory inputs reduce trial-to-trial variability in brain activity and alter temporal autocorrelation in spatial activity pattern evolutions, suggesting non-linear interactions between evoked activities and spontaneous activities. Further, evoked activities and spontaneous activities occupy different positions in the state space, suggesting that sensory inputs can intricately interact with the internal state to generate large-scale evoked activity patterns not frequented by spontaneous brain states.

Formation and computational implications of assemblies in neural circuits

In the brain, patterns of neural activity represent sensory information and store it in non-random synaptic connectivity. A prominent theoretical hypothesis states that assemblies, groups of neurons that are strongly connected to each other, are the key computational units underlying perception and memory formation. Compatible with these hypothesised assemblies, experiments have revealed groups of neurons that display synchronous activity, either spontaneously or upon stimulus presentation, and exhibit behavioural relevance. While it remains unclear how assemblies form in the brain, theoretical work has vastly contributed to the understanding of various interacting mechanisms in this process. Here, we review the recent theoretical literature on assembly formation by categorising the involved mechanisms into four components: synaptic plasticity, symmetry breaking, competition and stability. We highlight different approaches and assumptions behind assembly formation and discuss recent ideas of assemblies as the key computational unit in the brain. Abstract figure legend Assembly Formation. Assemblies are groups of strongly connected neurons formed by the interaction of multiple mechanisms and with vast computational implications. Four interacting components are thought to drive assembly formation: synaptic plasticity, symmetry breaking, competition and stability. This article is protected by copyright. All rights reserved.

Not so spontaneous: Multi-dimensional representations of behaviors and context in sensory areas

Sensory areas are spontaneously active in the absence of sensory stimuli. This spontaneous activity has long been studied; however, its functional role remains largely unknown. Recent advances in technology, allowing large-scale neural recordings in the awake and behaving animal, have transformed our understanding of spontaneous activity. Studies using these recordings have discovered high-dimensional spontaneous activity patterns, correlation between spontaneous activity and behavior, and dissimilarity between spontaneous and sensory-driven activity patterns. These findings are supported by evidence from developing animals, where a transition toward these characteristics is observed as the circuit matures, as well as by evidence from mature animals across species. These newly revealed characteristics call for the formulation of a new role for spontaneous activity in neural sensory computation.

Learning cortical representations through perturbed and adversarial dreaming

Humans and other animals learn to extract general concepts from sensory experience without extensive teaching. This ability is thought to be facilitated by offline states like sleep where previous experiences are systemically replayed. However, the characteristic creative nature of dreams suggests that learning semantic representations may go beyond merely replaying previous experiences. We support this hypothesis by implementing a cortical architecture inspired by generative adversarial networks (GANs). Learning in our model is organized across three different global brain states mimicking wakefulness, non-rapid eye movement (NREM), and REM sleep, optimizing different, but complementary, objective functions. We train the model on standard datasets of natural images and evaluate the quality of the learned representations. Our results suggest that generating new, virtual sensory inputs via adversarial dreaming during REM sleep is essential for extracting semantic concepts, while replaying episodic memories via perturbed dreaming during NREM sleep improves the robustness of latent representations. The model provides a new computational perspective on sleep states, memory replay, and dreams, and suggests a cortical implementation of GANs.