Emergence of spontaneous assembly activity in developing neural networks without afferent input

Embryonically active piriform cortex neurons promote intracortical recurrent connectivity during development

Neuronal activity plays a critical role in the maturation of circuits that propagate sensory information into the brain. How widely does early activity regulate circuit maturation across the developing brain? Here, we used targeted recombination in active populations (TRAP) to perform a brain-wide survey for prenatally active neurons in mice and identified the piriform cortex as an abundantly TRAPed region. Whole-cell recordings in neonatal slices revealed preferential interconnectivity within embryonically TRAPed piriform neurons and their enhanced synaptic connectivity with other piriform neurons. In vivo Neuropixels recordings in neonates demonstrated that embryonically TRAPed piriform neurons exhibit broad functional connectivity within piriform and lead spontaneous synchronized population activity during a transient neonatal period, when recurrent connectivity is strengthening. Selectively activating or silencing these neurons in neonates enhanced or suppressed recurrent synaptic strength, respectively. Thus, embryonically TRAPed piriform neurons represent an interconnected hub-like population whose activity promotes recurrent connectivity in early development.

Embryonically Active Piriform Cortex Neurons Promote Intracortical Recurrent Connectivity during Development

Neuronal activity plays a critical role in the maturation of circuits that propagate sensory information into the brain. How widely does early activity regulate circuit maturation across the developing brain? Here, we used Targeted Recombination in Active Populations (TRAP) to perform a brain-wide survey for prenatally active neurons in mice and identified the piriform cortex as an abundantly TRAPed region. Whole-cell recordings in neonatal slices revealed preferential interconnectivity within embryonically TRAPed piriform neurons and their enhanced synaptic connectivity with other piriform neurons. In vivo Neuropixels recordings in neonates demonstrated that embryonically TRAPed piriform neurons exhibit broad functional connectivity within piriform and lead spontaneous synchronized population activity during a transient neonatal period, when recurrent connectivity is strengthening. Selectively activating or silencing of these neurons in neonates enhanced or suppressed recurrent synaptic strength, respectively. Thus, embryonically TRAPed piriform neurons represent an interconnected hub-like population whose activity promotes recurrent connectivity in early development.

Piezo1-mediated spontaneous calcium transients in satellite glia impact dorsal root ganglia development

Spontaneous Ca2+ transients of neural cells is a hallmark of the developing nervous system. It is widely accepted that chemical signals, like neurotransmitters, contribute to spontaneous Ca2+ transients in the nervous system. Here, we reveal an additional mechanism of spontaneous Ca2+ transients that is mechanosensitive in the peripheral nervous system (PNS) using intravital imaging of growing dorsal root ganglia (DRG) in zebrafish embryos. GCaMP6s imaging shows that developing DRG satellite glia contain distinct spontaneous Ca2+ transients, classified into simultaneous, isolated, and microdomains. Longitudinal analysis over days in development demonstrates that as DRG satellite glia become more synchronized, isolated Ca2+ transients remain constant. Using a chemical screen, we identify that Ca2+ transients in DRG glia are dependent on mechanical properties, which we confirmed using an experimental application of mechanical force. We find that isolated spontaneous Ca2+ transients of the glia during development is altered by manipulation of mechanosensitive protein Piezo1, which is expressed in the developing ganglia. In contrast, simultaneous Ca2+ transients of DRG satellite glia is not Piezo1-mediated, thus demonstrating that distinct mechanisms mediate subtypes of spontaneous Ca2+ transients. Activating Piezo1 eventually impacts the cell abundance of DRG cells and behaviors that are driven by DRG neurons. Together, our results reveal mechanistically distinct subtypes of Ca2+ transients in satellite glia and introduce mechanobiology as a critical component of spontaneous Ca2+ transients in the developing PNS.

Modeling cholinergic retinal waves: starburst amacrine cells shape wave generation, propagation, and direction bias

Stage II cholinergic retinal waves are one of the first instances of neural activity in the visual system as they are present at a developmental timepoint in which light-evoked activity remains largely undetectable. These waves of spontaneous neural activity sweeping across the developing retina are generated by starburst amacrine cells, depolarize retinal ganglion cells, and drive the refinement of retinofugal projections to numerous visual centers in the brain. Building from several well-established models, we assemble a spatial computational model of starburst amacrine cell-mediated wave generation and wave propagation that includes three significant advancements. First, we model the intrinsic spontaneous bursting of the starburst amacrine cells, including the slow afterhyperpolarization, which shapes the stochastic process of wave generation. Second, we establish a mechanism of wave propagation using reciprocal acetylcholine release, synchronizing the bursting activity of neighboring starburst amacrine cells. Third, we model the additional starburst amacrine cell release of GABA, changing the spatial propagation of retinal waves and in certain instances, the directional bias of the retinal wave front. In total, these advancements comprise a now more comprehensive model of wave generation, propagation, and direction bias.

Neural assemblies uncovered by generative modeling explain whole-brain activity statistics and reflect structural connectivity

Patterns of endogenous activity in the brain reflect a stochastic exploration of the neuronal state space that is constrained by the underlying assembly organization of neurons. Yet, it remains to be shown that this interplay between neurons and their assembly dynamics indeed suffices to generate whole-brain data statistics. Here, we recorded the activity from ∼40,000 neurons simultaneously in zebrafish larvae, and show that a data-driven generative model of neuron-assembly interactions can accurately reproduce the mean activity and pairwise correlation statistics of their spontaneous activity. This model, the compositional Restricted Boltzmann Machine (cRBM), unveils ∼200 neural assemblies, which compose neurophysiological circuits and whose various combinations form successive brain states. We then performed in silico perturbation experiments to determine the interregional functional connectivity, which is conserved across individual animals and correlates well with structural connectivity. Our results showcase how cRBMs can capture the coarse-grained organization of the zebrafish brain. Notably, this generative model can readily be deployed to parse neural data obtained by other large-scale recording techniques.

Computational models of Idling brain activity for memory processing

Studying the underlying neural mechanisms of cognitive functions of the brain is one of the central questions in modern biology. Moreover, it has significantly impacted the development of novel technologies in artificial intelligence. Spontaneous activity is a unique feature of the brain and is currently lacking in many artificially constructed intelligent machines. Spontaneous activity may represent the brain's idling states, which are internally driven by neuronal networks and possibly participate in offline processing during awake, sleep, and resting states. Evidence is accumulating that the brain's spontaneous activity is not mere noise but part of the mechanisms to process information about previous experiences. A bunch of literature has shown how previous sensory and behavioral experiences influence the subsequent patterns of brain activity with various methods in various animals. It seems, however, that the patterns of neural activity and their computational roles differ significantly from area to area and from function to function. In this article, I review the various forms of the brain's spontaneous activity, especially those observed during memory processing, and some attempts to model the generation mechanisms and computational roles of such activities.

Formation and computational implications of assemblies in neural circuits

In the brain, patterns of neural activity represent sensory information and store it in non-random synaptic connectivity. A prominent theoretical hypothesis states that assemblies, groups of neurons that are strongly connected to each other, are the key computational units underlying perception and memory formation. Compatible with these hypothesised assemblies, experiments have revealed groups of neurons that display synchronous activity, either spontaneously or upon stimulus presentation, and exhibit behavioural relevance. While it remains unclear how assemblies form in the brain, theoretical work has vastly contributed to the understanding of various interacting mechanisms in this process. Here, we review the recent theoretical literature on assembly formation by categorising the involved mechanisms into four components: synaptic plasticity, symmetry breaking, competition and stability. We highlight different approaches and assumptions behind assembly formation and discuss recent ideas of assemblies as the key computational unit in the brain. Abstract figure legend Assembly Formation. Assemblies are groups of strongly connected neurons formed by the interaction of multiple mechanisms and with vast computational implications. Four interacting components are thought to drive assembly formation: synaptic plasticity, symmetry breaking, competition and stability. This article is protected by copyright. All rights reserved.

Spontaneous dynamics of synaptic weights in stochastic models with pair-based spike-timing-dependent plasticity

We investigate spike-timing dependent plasticity (STPD) in the case of a synapse connecting two neuronal cells. We develop a theoretical analysis of several STDP rules using Markovian theory. In this context there are two different timescales, fast neuronal activity and slower synaptic weight updates. Exploiting this timescale separation, we derive the long-time limits of a single synaptic weight subject to STDP. We show that the pairing model of presynaptic and postsynaptic spikes controls the synaptic weight dynamics for small external input on an excitatory synapse. This result implies in particular that mean-field analysis of plasticity may miss some important properties of STDP. Anti-Hebbian STDP favors the emergence of a stable synaptic weight. In the case of an inhibitory synapse the pairing schemes matter less, and we observe convergence of the synaptic weight to a nonnull value only for Hebbian STDP. We extensively study different asymptotic regimes for STDP rules, raising interesting questions for future work on adaptative neuronal networks and, more generally, on adaptative systems.

Drifting assemblies for persistent memory: Neuron transitions and unsupervised compensation

Change is ubiquitous in living beings. In particular, the connectome and neural representations can change. Nevertheless, behaviors and memories often persist over long times. In a standard model, associative memories are represented by assemblies of strongly interconnected neurons. For faithful storage these assemblies are assumed to consist of the same neurons over time. Here we propose a contrasting memory model with complete temporal remodeling of assemblies, based on experimentally observed changes of synapses and neural representations. The assemblies drift freely as noisy autonomous network activity and spontaneous synaptic turnover induce neuron exchange. The gradual exchange allows activity-dependent and homeostatic plasticity to conserve the representational structure and keep inputs, outputs, and assemblies consistent. This leads to persistent memory. Our findings explain recent experimental results on temporal evolution of fear memory representations and suggest that memory systems need to be understood in their completeness as individual parts may constantly change.

Model-based decoupling of evoked and spontaneous neural activity in calcium imaging data

The pattern of neural activity evoked by a stimulus can be substantially affected by ongoing spontaneous activity. Separating these two types of activity is particularly important for calcium imaging data given the slow temporal dynamics of calcium indicators. Here we present a statistical model that decouples stimulus-driven activity from low dimensional spontaneous activity in this case. The model identifies hidden factors giving rise to spontaneous activity while jointly estimating stimulus tuning properties that account for the confounding effects that these factors introduce. By applying our model to data from zebrafish optic tectum and mouse visual cortex, we obtain quantitative measurements of the extent that neurons in each case are driven by evoked activity, spontaneous activity, and their interaction. By not averaging away potentially important information encoded in spontaneous activity, this broadly applicable model brings new insight into population-level neural activity within single trials.

Autonomous emergence of connectivity assemblies via spike triplet interactions

Non-random connectivity can emerge without structured external input driven by activity-dependent mechanisms of synaptic plasticity based on precise spiking patterns. Here we analyze the emergence of global structures in recurrent networks based on a triplet model of spike timing dependent plasticity (STDP), which depends on the interactions of three precisely-timed spikes, and can describe plasticity experiments with varying spike frequency better than the classical pair-based STDP rule. We derive synaptic changes arising from correlations up to third-order and describe them as the sum of structural motifs, which determine how any spike in the network influences a given synaptic connection through possible connectivity paths. This motif expansion framework reveals novel structural motifs under the triplet STDP rule, which support the formation of bidirectional connections and ultimately the spontaneous emergence of global network structure in the form of self-connected groups of neurons, or assemblies. We propose that under triplet STDP assembly structure can emerge without the need for externally patterned inputs or assuming a symmetric pair-based STDP rule common in previous studies. The emergence of non-random network structure under triplet STDP occurs through internally-generated higher-order correlations, which are ubiquitous in natural stimuli and neuronal spiking activity, and important for coding. We further demonstrate how neuromodulatory mechanisms that modulate the shape of the triplet STDP rule or the synaptic transmission function differentially promote structural motifs underlying the emergence of assemblies, and quantify the differences using graph theoretic measures.

Emergent non-random connectivity structures in different brain regions are tightly related to specific patterns of neural activity and support diverse brain functions. For instance, self-connected groups of neurons, known as assemblies, have been proposed to represent functional units in brain circuits and can emerge even without patterned external instruction. Here we investigate the emergence of non-random connectivity in recurrent networks using a particular plasticity rule, triplet STDP, which relies on the interaction of spike triplets and can capture higher-order statistical dependencies in neural activity. We derive the evolution of the synaptic strengths in the network and explore the conditions for the self-organization of connectivity into assemblies. We demonstrate key differences of the triplet STDP rule compared to the classical pair-based rule in terms of how assemblies are formed, including the realistic asymmetric shape and influence of novel connectivity motifs on network plasticity driven by higher-order correlations. Assembly formation depends on the specific shape of the STDP window and synaptic transmission function, pointing towards an important role of neuromodulatory signals on formation of intrinsically generated assemblies.

Reliable Sequential Activation of Neural Assemblies by Single Pyramidal Cells in a Three-Layered Cortex

Recent studies reveal the occasional impact of single neurons on surround firing statistics and even simple behaviors. Exploiting the advantages of a simple cortex, we examined the influence of single pyramidal neurons on surrounding cortical circuits. Brief activation of single neurons triggered reliable sequences of firing in tens of other excitatory and inhibitory cortical neurons, reflecting cascading activity through local networks, as indicated by delayed yet precisely timed polysynaptic subthreshold potentials. The evoked patterns were specific to the pyramidal cell of origin, extended over hundreds of micrometers from their source, and unfolded over up to 200 ms. Simultaneous activation of pyramidal cell pairs indicated balanced control of population activity, preventing paroxysmal amplification. Single cortical pyramidal neurons can thus trigger reliable postsynaptic activity that can propagate in a reliable fashion through cortex, generating rapidly evolving and non-random firing sequences reminiscent of those observed in mammalian hippocampus during "replay" and in avian song circuits.

Modulating grid cell scale and intrinsic frequencies via slow high-threshold conductances: A simplified model

Grid cells in the medial entorhinal cortex (MEC) have known spatial periodic firing fields which provide a metric for the representation of self-location and path planning. The hexagonal tessellation pattern of grid cells scales up progressively along the MEC's layer II dorsal-to-ventral axis. This scaling gradient has been hypothesized to originate either from inter-population synaptic dynamics as postulated by attractor networks, or from projected theta frequency waves to different axis levels, as in oscillatory models. Alternatively, cellular dynamics and specifically slow high-threshold conductances have been proposed to have an impact on the grid cell scale. To test the hypothesis that intrinsic hyperpolarization-activated cation currents account for both the scaled gradient and the oscillatory frequencies observed along the dorsal-to-ventral axis, we have modeled and analyzed data from a population of grid cells simulated with spiking neurons interacting through low-dimensional attractor dynamics. We observed that the intrinsic neuronal membrane properties of simulated cells were sufficient to induce an increase in grid scale and potentiate differences in the membrane potential oscillatory frequency. Overall, our results suggest that the after-spike dynamics of cation currents may play a major role in determining the grid cells' scale and that oscillatory frequencies are a consequence of intrinsic cellular properties that are specific to different levels of the dorsal-to-ventral axis in the MEC layer II.

Topological reinforcement as a principle of modularity emergence in brain networks

Modularity is a ubiquitous topological feature of structural brain networks at various scales. Although a variety of potential mechanisms have been proposed, the fundamental principles by which modularity emerges in neural networks remain elusive. We tackle this question with a plasticity model of neural networks derived from a purely topological perspective. Our topological reinforcement model acts enhancing the topological overlap between nodes, that is, iteratively allowing connections between non-neighbor nodes with high neighborhood similarity. This rule reliably evolves synthetic random networks toward a modular architecture. Such final modular structure reflects initial "proto-modules," thus allowing to predict the modules of the evolved graph. Subsequently, we show that this topological selection principle might be biologically implemented as a Hebbian rule. Concretely, we explore a simple model of excitable dynamics, where the plasticity rule acts based on the functional connectivity (co-activations) between nodes. Results produced by the activity-based model are consistent with the ones from the purely topological rule in terms of the final network configuration and modules composition. Our findings suggest that the selective reinforcement of topological overlap may be a fundamental mechanism contributing to modularity emergence in brain networks.

Theoretical Models of Neural Development

Constructing a functioning nervous system requires the precise orchestration of a vast array of mechanical, molecular, and neural-activity-dependent cues. Theoretical models can play a vital role in helping to frame quantitative issues, reveal mathematical commonalities between apparently diverse systems, identify what is and what is not possible in principle, and test the abilities of specific mechanisms to explain the data. This review focuses on the progress that has been made over the last decade in our theoretical understanding of neural development.