Highly nonrandom features of synaptic connectivity in local cortical circuits

Equal levels of pre- and postsynaptic potentiation produce unequal outcomes

Which proportion of the long-term potentiation (LTP) expressed in the bulk of excitatory synapses is postsynaptic and which presynaptic remains debatable. To understand better the possible impact of either LTP form, we explored a realistic model of a CA1 pyramidal cell equipped with known membrane mechanisms and multiple, stochastic excitatory axo-spinous synapses. Our simulations were designed to establish an input-output transfer function, the dependence between the frequency of presynaptic action potentials triggering probabilistic synaptic discharges and the average frequency of postsynaptic spiking. We found that, within the typical physiological range, potentiation of the postsynaptic current results in a greater overall output than an equivalent increase in presynaptic release probability. This difference grows stronger at lower input frequencies and lower release probabilities. Simulations with a non-hierarchical circular network of principal neurons indicated that equal increases in either synaptic fidelity or synaptic strength of individual connections also produce distinct changes in network activity, although the network phenomenology is likely to be complex. These observations should help to interpret the machinery of LTP phenomena documented in situ. This article is part of a discussion meeting issue 'Long-term potentiation: 50 years on'.

Stimulus type shapes the topology of cellular functional networks in mouse visual cortex

On the timescale of sensory processing, neuronal networks have relatively fixed anatomical connectivity, while functional interactions between neurons can vary depending on the ongoing activity of the neurons within the network. We thus hypothesized that different types of stimuli could lead those networks to display stimulus-dependent functional connectivity patterns. To test this hypothesis, we analyzed single-cell resolution electrophysiological data from the Allen Institute, with simultaneous recordings of stimulus-evoked activity from neurons across 6 different regions of mouse visual cortex. Comparing the functional connectivity patterns during different stimulus types, we made several nontrivial observations: (1) while the frequencies of different functional motifs were preserved across stimuli, the identities of the neurons within those motifs changed; (2) the degree to which functional modules are contained within a single brain region increases with stimulus complexity. Altogether, our work reveals unexpected stimulus-dependence to the way groups of neurons interact to process incoming sensory information.

The neuron as a direct data-driven controller

In the quest to model neuronal function amid gaps in physiological data, a promising strategy is to develop a normative theory that interprets neuronal physiology as optimizing a computational objective. This study extends current normative models, which primarily optimize prediction, by conceptualizing neurons as optimal feedback controllers. We posit that neurons, especially those beyond early sensory areas, steer their environment toward a specific desired state through their output. This environment comprises both synaptically interlinked neurons and external motor sensory feedback loops, enabling neurons to evaluate the effectiveness of their control via synaptic feedback. To model neurons as biologically feasible controllers which implicitly identify loop dynamics, infer latent states, and optimize control we utilize the contemporary direct data-driven control (DD-DC) framework. Our DD-DC neuron model explains various neurophysiological phenomena: the shift from potentiation to depression in spike-timing-dependent plasticity with its asymmetry, the duration and adaptive nature of feedforward and feedback neuronal filters, the imprecision in spike generation under constant stimulation, and the characteristic operational variability and noise in the brain. Our model presents a significant departure from the traditional, feedforward, instant-response McCulloch-Pitts-Rosenblatt neuron, offering a modern, biologically informed fundamental unit for constructing neural networks.

Fear learning induces synaptic potentiation between engram neurons in the rat lateral amygdala

The lateral amygdala (LA) encodes fear memories by potentiating sensory inputs associated with threats and, in the process, recruits 10-30% of its neurons per fear memory engram. However, how the local network within the LA processes this information and whether it also plays a role in storing it are still largely unknown. Here, using ex vivo 12-patch-clamp and in vivo 32-electrode electrophysiological recordings in the LA of fear-conditioned rats, in combination with activity-dependent fluorescent and optogenetic tagging and recall, we identified a sparsely connected network between principal LA neurons that is organized in clusters. Fear conditioning specifically causes potentiation of synaptic connections between learning-recruited neurons. These findings of synaptic plasticity in an autoassociative excitatory network of the LA may suggest a basic principle through which a small number of pyramidal neurons could encode a large number of memories.

Nondifferentiable activity in the brain

Spike raster plots of numerous neurons show vertical stripes, indicating that neurons exhibit synchronous activity in the brain. We seek to determine whether these coherent dynamics are caused by smooth brainwave activity or by something else. By analyzing biological data, we find that their cross-correlograms exhibit not only slow undulation but also a cusp at the origin, in addition to possible signs of monosynaptic connectivity. Here we show that undulation emerges if neurons are subject to smooth brainwave oscillations while a cusp results from nondifferentiable fluctuations. While modern analysis methods have achieved good connectivity estimation by adapting the models to slow undulation, they still make false inferences due to the cusp. We devise a new analysis method that may solve both problems. We also demonstrate that oscillations and nondifferentiable fluctuations may emerge in simulations of large-scale neural networks.

Preconfigured architecture of the developing mouse brain

In the adult brain, structural and functional parameters, such as synaptic sizes and neuronal firing rates, follow right-skewed and heavy-tailed distributions. While this organization is thought to have significant implications, its development is still largely unknown. Here, we address this knowledge gap by investigating a large-scale dataset recorded from the prefrontal cortex and the olfactory bulb of mice aged 4-60 postnatal days. We show that firing rates and spike train interactions have a largely stable distribution shape throughout the first 60 postnatal days and that the prefrontal cortex displays a functional small-world architecture. Moreover, early brain activity exhibits an oligarchical organization, where high-firing neurons have hub-like properties. In a neural network model, we show that analogously right-skewed and heavy-tailed synaptic parameters are instrumental to consistently recapitulate the experimental data. Thus, functional and structural parameters in the developing brain are already extremely distributed, suggesting that this organization is preconfigured and not experience dependent.

Intrinsic dynamics of randomly clustered networks generate place fields and preplay of novel environments

During both sleep and awake immobility, hippocampal place cells reactivate time-compressed versions of sequences representing recently experienced trajectories in a phenomenon known as replay. Intriguingly, spontaneous sequences can also correspond to forthcoming trajectories in novel environments experienced later, in a phenomenon known as preplay. Here, we present a model showing that sequences of spikes correlated with the place fields underlying spatial trajectories in both previously experienced and future novel environments can arise spontaneously in neural circuits with random, clustered connectivity rather than pre-configured spatial maps. Moreover, the realistic place fields themselves arise in the circuit from minimal, landmark-based inputs. We find that preplay quality depends on the network's balance of cluster isolation and overlap, with optimal preplay occurring in small-world regimes of high clustering yet short path lengths. We validate the results of our model by applying the same place field and preplay analyses to previously published rat hippocampal place cell data. Our results show that clustered recurrent connectivity can generate spontaneous preplay and immediate replay of novel environments. These findings support a framework whereby novel sensory experiences become associated with preexisting "pluripotent" internal neural activity patterns.

Dynamics of spike transmission and suppression between principal cells and interneurons in the hippocampus and entorhinal cortex

Synaptic excitation and inhibition are essential for neuronal communication. However, the variables that regulate synaptic excitation and inhibition in the intact brain remain largely unknown. Here, we examined how spike transmission and suppression between principal cells (PCs) and interneurons (INTs) are modulated by activity history, brain state, cell type, and somatic distance between presynaptic and postsynaptic neurons by applying cross-correlogram analyses to datasets recorded from the dorsal hippocampus and medial entorhinal cortex (MEC) of 11 male behaving and sleeping Long Evans rats. The strength, temporal delay, and brain-state dependency of the spike transmission and suppression depended on the subregions/layers. The spike transmission probability of PC-INT excitatory pairs that showed short-term depression versus short-term facilitation was higher in CA1 and lower in CA3. Likewise, the intersomatic distance affected the proportion of PC-INT excitatory pairs that showed short-term depression and facilitation in the opposite manner in CA1 compared with CA3. The time constant of depression was longer, while that of facilitation was shorter in MEC than in CA1 and CA3. During sharp-wave ripples, spike transmission showed a larger gain in the MEC than in CA1 and CA3. The intersomatic distance affected the spike transmission gain during sharp-wave ripples differently in CA1 versus CA3. A subgroup of MEC layer 3 (EC3) INTs preferentially received excitatory inputs from and inhibited MEC layer 2 (EC2) PCs. The EC2 PC-EC3 INT excitatory pairs, most of which showed short-term depression, exhibited higher spike transmission probabilities than the EC2 PC-EC2 INT and EC3 PC-EC3 INT excitatory pairs. EC2 putative stellate cells exhibited stronger spike transmission to and received weaker spike suppression from EC3 INTs than EC2 putative pyramidal cells. This study provides detailed comparisons of monosynaptic interaction dynamics in the hippocampal-entorhinal loop, which may help to elucidate circuit operations.

Neuronal avalanche dynamics regulated by spike-timing-dependent plasticity under different topologies and heterogeneities

Neuronal avalanches, a critical state of network self-organization, have been widely observed in electrophysiological records at different signal levels and spatial scales of the brain, which has significant influence on information transmission and processing in the brain. In this paper, the collective behavior of neuron firing is studied based on Leaky Integrate-and-Fire model and we induce spike-timing-dependent plasticity (STDP) to update the connection weight through competition between adjacent neurons in different network topologies. The result shows that STDP can facilitate the synchronization of the network and increase the probability of large-scale neuron avalanche obviously. Moreover, both the structure of STDP and network connection density can affect the generation of avalanche critical states, specifically, learning rate has positive correlation effect on the slope of power-law distribution and time constant has negative correction on it. However, when we the increase of heterogeneity in network, STDP can only has obvious promotion in synchrony under suitable level of heterogeneity. And we find that the process of long-term potentiation is sensitive to the adjustment of time constant and learning rate, unlike long-term depression, which is only sensitive to learning rate in heterogeneity network. It is suggested that presented results could facilitate our understanding on synchronization in various neural networks under the effect of STDP learning rules.

Deep Learning without Weight Symmetry

Backpropagation (BP), a foundational algorithm for training artificial neural networks, predominates in contemporary deep learning. Although highly successful, it is often considered biologically implausible. A significant limitation arises from the need for precise symmetry between connections in the backward and forward pathways to backpropagate gradient signals accurately, which is not observed in biological brains. Researchers have proposed several algorithms to alleviate this symmetry constraint, such as feedback alignment and direct feedback alignment. However, their divergence from backpropagation dynamics presents challenges, particularly in deeper networks and convolutional layers. Here we introduce the Product Feedback Alignment (PFA) algorithm. Our findings demonstrate that PFA closely approximates BP and achieves comparable performance in deep convolutional networks while avoiding explicit weight symmetry. Our results offer a novel solution to the longstanding weight symmetry problem, leading to more biologically plausible learning in deep convolutional networks compared to earlier methods.

Microstimulation reveals anesthetic state-dependent effective connectivity of neurons in cerebral cortex

Complex neuronal interactions underlie cortical information processing that can be compromised in altered states of consciousness. Here intracortical microstimulation was applied to investigate the state-dependent effective connectivity of neurons in rat visual cortex in vivo. Extracellular activity was recorded at 32 sites in layers 5/6 while stimulating with charge-balanced discrete pulses at each electrode in random order. The same stimulation pattern was applied at three levels of anesthesia with desflurane and in wakefulness. Spikes were sorted and classified by their waveform features as putative excitatory and inhibitory neurons. Microstimulation caused early (<10ms) increase followed by prolonged (11-100ms) decrease in spiking of all neurons throughout the electrode array. The early response of excitatory but not inhibitory neurons decayed rapidly with distance from the stimulation site over 1mm. Effective connectivity of neurons with significant stimulus response was dense in wakefulness and sparse under anesthesia. Network motifs were identified in graphs of effective connectivity constructed from monosynaptic cross-correlograms. The number of motifs, especially those of higher order, increased rapidly as the anesthesia was withdrawn indicating a substantial increase in network connectivity as the animals woke up. The results illuminate the impact of anesthesia on functional integrity of local circuits affecting the state of consciousness.

Learning with filopodia and spines: Complementary strong and weak competition lead to specialized, graded, and protected receptive fields

Filopodia are thin synaptic protrusions that have been long known to play an important role in early development. Recently, they have been found to be more abundant in the adult cortex than previously thought, and more plastic than spines (button-shaped mature synapses). Inspired by these findings, we introduce a new model of synaptic plasticity that jointly describes learning of filopodia and spines. The model assumes that filopodia exhibit strongly competitive learning dynamics -similarly to additive spike-timing-dependent plasticity (STDP). At the same time it proposes that, if filopodia undergo sufficient potentiation, they consolidate into spines. Spines follow weakly competitive learning, classically associated with multiplicative, soft-bounded models of STDP. This makes spines more stable and sensitive to the fine structure of input correlations. We show that our learning rule has a selectivity comparable to additive STDP and captures input correlations as well as multiplicative models of STDP. We also show how it can protect previously formed memories and perform synaptic consolidation. Overall, our results can be seen as a phenomenological description of how filopodia and spines could cooperate to overcome the individual difficulties faced by strong and weak competition mechanisms.

Mimicking Bidirectional Inhibitory Synapse Using a Porous-Confined Ionic Memristor with Electrolyte/Tris(4-aminophenyl)amine Neurotransmitter

Ionic memristors can emulate brain-like functions of biological synapses for neuromorphic technologies. Apart from the widely studied excitatory-excitatory and excitatory-inhibitory synapses, reports on memristors with the inhibitory-inhibitory synaptic behaviors remain a challenge. Here, the first biaxially inhibited artificial synapse is demonstrated, consisting of a solid electrolyte and conjugated microporous polymers bilayer as neurotransmitter, with the former serving as an ion reservoir and the latter acting as a confined transport. Due to the migration, trapping, and de-trapping of ions within the nanoslits, the device poses inhibitory synaptic plasticity under both positive and negative stimuli. Remarkably, the artificial synapse is able to maintain a low level of stable nonvolatile memory over a long period of time (≈60 min) after multiple stimuli, with feature-inferencing/-training capabilities of neural node in neuromorphic computing. This work paves a reliable strategy for constructing nanochannel ionic memristive materials toward fully inhibitory synaptic devices.

Non-Negative Matrix Factorization for Analyzing State Dependent Neuronal Network Dynamics in Calcium Recordings

Calcium imaging allows recording from hundreds of neurons in vivo with the ability to resolve single cell activity. Evaluating and analyzing neuronal responses, while also considering all dimensions of the data set to make specific conclusions, is extremely difficult. Often, descriptive statistics are used to analyze these forms of data. These analyses, however, remove variance by averaging the responses of single neurons across recording sessions, or across combinations of neurons, to create single quantitative metrics, losing the temporal dynamics of neuronal activity, and their responses relative to each other. Dimensionally Reduction (DR) methods serve as a good foundation for these analyses because they reduce the dimensions of the data into components, while still maintaining the variance. Non-negative Matrix Factorization (NMF) is an especially promising DR analysis method for analyzing activity recorded in calcium imaging because of its mathematical constraints, which include positivity and linearity. We adapt NMF for our analyses and compare its performance to alternative dimensionality reduction methods on both artificial and in vivo data. We find that NMF is well-suited for analyzing calcium imaging recordings, accurately capturing the underlying dynamics of the data, and outperforming alternative methods in common use.

NEURD: automated proofreading and feature extraction for connectomics

We are now in the era of millimeter-scale electron microscopy (EM) volumes collected at nanometer resolution (Shapson-Coe et al., 2021; Consortium et al., 2021). Dense reconstruction of cellular compartments in these EM volumes has been enabled by recent advances in Machine Learning (ML) (Lee et al., 2017; Wu et al., 2021; Lu et al., 2021; Macrina et al., 2021). Automated segmentation methods can now yield exceptionally accurate reconstructions of cells, but despite this accuracy, laborious post-hoc proofreading is still required to generate large connectomes free of merge and split errors. The elaborate 3-D meshes of neurons produced by these segmentations contain detailed morphological information, from the diameter, shape, and branching patterns of axons and dendrites, down to the fine-scale structure of dendritic spines. However, extracting information about these features can require substantial effort to piece together existing tools into custom workflows. Building on existing open-source software for mesh manipulation, here we present "NEURD", a software package that decomposes each meshed neuron into a compact and extensively-annotated graph representation. With these feature-rich graphs, we implement workflows to automate a variety of tasks that would otherwise require extensive manual effort, such as state of the art automated post-hoc proofreading of merge errors, cell classification, spine detection, axon-dendritic proximities, and computation of other features. These features enable many downstream analyses of neural morphology and connectivity, making these new massive and complex datasets more accessible to neuroscience researchers focused on a variety of scientific questions.

Directed and acyclic synaptic connectivity in the human layer 2-3 cortical microcircuit

The computational capabilities of neuronal networks are fundamentally constrained by their specific connectivity. Previous studies of cortical connectivity have mostly been carried out in rodents; whether the principles established therein also apply to the evolutionarily expanded human cortex is unclear. We studied network properties within the human temporal cortex using samples obtained from brain surgery. We analyzed multineuron patch-clamp recordings in layer 2-3 pyramidal neurons and identified substantial differences compared with rodents. Reciprocity showed random distribution, synaptic strength was independent from connection probability, and connectivity of the supragranular temporal cortex followed a directed and mostly acyclic graph topology. Application of these principles in neuronal models increased dimensionality of network dynamics, suggesting a critical role for cortical computation.

Modulation of metastable ensemble dynamics explains optimal coding at moderate arousal in auditory cortex

Performance during perceptual decision-making exhibits an inverted-U relationship with arousal, but the underlying network mechanisms remain unclear. Here, we recorded from auditory cortex (A1) of behaving mice during passive tone presentation, while tracking arousal via pupillometry. We found that tone discriminability in A1 ensembles was optimal at intermediate arousal, revealing a population-level neural correlate of the inverted-U relationship. We explained this arousal-dependent coding using a spiking network model with a clustered architecture. Specifically, we show that optimal stimulus discriminability is achieved near a transition between a multi-attractor phase with metastable cluster dynamics (low arousal) and a single-attractor phase (high arousal). Additional signatures of this transition include arousal-induced reductions of overall neural variability and the extent of stimulus-induced variability quenching, which we observed in the empirical data. Altogether, this study elucidates computational principles underlying interactions between pupil-linked arousal, sensory processing, and neural variability, and suggests a role for phase transitions in explaining nonlinear modulations of cortical computations.

Causal connectivity measures for pulse-output network reconstruction: Analysis and applications

The causal connectivity of a network is often inferred to understand network function. It is arguably acknowledged that the inferred causal connectivity relies on the causality measure one applies, and it may differ from the network's underlying structural connectivity. However, the interpretation of causal connectivity remains to be fully clarified, in particular, how causal connectivity depends on causality measures and how causal connectivity relates to structural connectivity. Here, we focus on nonlinear networks with pulse signals as measured output, e.g., neural networks with spike output, and address the above issues based on four commonly utilized causality measures, i.e., time-delayed correlation coefficient, time-delayed mutual information, Granger causality, and transfer entropy. We theoretically show how these causality measures are related to one another when applied to pulse signals. Taking a simulated Hodgkin-Huxley network and a real mouse brain network as two illustrative examples, we further verify the quantitative relations among the four causality measures and demonstrate that the causal connectivity inferred by any of the four well coincides with the underlying network structural connectivity, therefore illustrating a direct link between the causal and structural connectivity. We stress that the structural connectivity of pulse-output networks can be reconstructed pairwise without conditioning on the global information of all other nodes in a network, thus circumventing the curse of dimensionality. Our framework provides a practical and effective approach for pulse-output network reconstruction.

Ensemble learning and ground-truth validation of synaptic connectivity inferred from spike trains

Probing the architecture of neuronal circuits and the principles that underlie their functional organization remains an important challenge of modern neurosciences. This holds true, in particular, for the inference of neuronal connectivity from large-scale extracellular recordings. Despite the popularity of this approach and a number of elaborate methods to reconstruct networks, the degree to which synaptic connections can be reconstructed from spike-train recordings alone remains controversial. Here, we provide a framework to probe and compare connectivity inference algorithms, using a combination of synthetic ground-truth and in vitro data sets, where the connectivity labels were obtained from simultaneous high-density microelectrode array (HD-MEA) and patch-clamp recordings. We find that reconstruction performance critically depends on the regularity of the recorded spontaneous activity, i.e., their dynamical regime, the type of connectivity, and the amount of available spike-train data. We therefore introduce an ensemble artificial neural network (eANN) to improve connectivity inference. We train the eANN on the validated outputs of six established inference algorithms and show how it improves network reconstruction accuracy and robustness. Overall, the eANN demonstrated strong performance across different dynamical regimes, worked well on smaller datasets, and improved the detection of synaptic connectivity, especially inhibitory connections. Results indicated that the eANN also improved the topological characterization of neuronal networks. The presented methodology contributes to advancing the performance of inference algorithms and facilitates our understanding of how neuronal activity relates to synaptic connectivity.

Inference of network connectivity from temporally binned spike trains

BACKGROUND

Processing neural activity to reconstruct network connectivity is a central focus of neuroscience, yet the spatiotemporal requisites of biological nervous systems are challenging for current neuronal sensing modalities. Consequently, methods that leverage limited data to successfully infer synaptic connections, predict activity at single unit resolution, and decipher their effect on whole systems, can uncover critical information about neural processing. Despite the emergence of powerful methods for inferring connectivity, network reconstruction based on temporally subsampled data remains insufficiently unexplored.

NEW METHOD

We infer synaptic weights by processing firing rates within variable time bins for a heterogeneous feed-forward network of excitatory, inhibitory, and unconnected units. We assess classification and optimize model parameters for postsynaptic spike train reconstruction. We test our method on a physiological network of leaky integrate-and-fire neurons displaying bursting patterns and assess prediction of postsynaptic activity from microelectrode array data.

RESULTS

Results reveal parameters for improved prediction and performance and suggest that lower resolution data and limited access to neurons can be preferred.

COMPARISON WITH EXISTING METHOD(S)

Recent computational methods demonstrate highly improved reconstruction of connectivity from networks of parallel spike trains by considering spike lag, time-varying firing rates, and other underlying dynamics. However, these methods insufficiently explore temporal subsampling representative of novel data types.

CONCLUSIONS

We provide a framework for reverse engineering neural networks from data with limited temporal quality, describing optimal parameters for each bin size, which can be further improved using non-linear methods and applied to more complicated readouts and connectivity distributions in multiple brain circuits.

Markov Blankets and Mirror Symmetries-Free Energy Minimization and Mesocortical Anatomy

A theoretical account of development in mesocortical anatomy is derived from the free energy principle, operating in a neural field with both Hebbian and anti-Hebbian neural plasticity. An elementary structural unit is proposed, in which synaptic connections at mesoscale are arranged in paired patterns with mirror symmetry. Exchanges of synaptic flux in each pattern form coupled spatial eigenmodes, and the line of mirror reflection between the paired patterns operates as a Markov blanket, so that prediction errors in exchanges between the pairs are minimized. The theoretical analysis is then compared to the outcomes from a biological model of neocortical development, in which neuron precursors are selected by apoptosis for cell body and synaptic connections maximizing synchrony and also minimizing axonal length. It is shown that this model results in patterns of connection with the anticipated mirror symmetries, at micro-, meso- and inter-arial scales, among lateral connections, and in cortical depth. This explains the spatial organization and functional significance of neuron response preferences, and is compatible with the structural form of both columnar and noncolumnar cortex. Multi-way interactions of mirrored representations can provide a preliminary anatomically realistic model of cortical information processing.

Non-homogenous axonal bouton distribution in whole-brain single-cell neuronal networks

We examined the distribution of pre-synaptic contacts in axons of mouse neurons and constructed whole-brain single-cell neuronal networks using an extensive dataset of 1,891 fully reconstructed neurons. We found that bouton locations were not homogeneous throughout the axon and among brain regions. As our algorithm was able to generate whole-brain single-cell connectivity matrices from full morphology reconstruction datasets, we further found that non-homogeneous bouton locations have a significant impact on network wiring, including degree distribution, triad census, and community structure. By perturbing neuronal morphology, we further explored the link between anatomical details and network topology. In our in silico exploration, we found that dendritic and axonal tree span would have the greatest impact on network wiring, followed by synaptic contact deletion. Our results suggest that neuroanatomical details must be carefully addressed in studies of whole-brain networks at the single-cell level.

Emergence of co-tuning in inhibitory neurons as a network phenomenon mediated by randomness, correlations, and homeostatic plasticity

Cortical excitatory neurons show clear tuning to stimulus features, but the tuning properties of inhibitory interneurons are ambiguous. While inhibitory neurons have been considered to be largely untuned, some studies show that some parvalbumin-expressing (PV) neurons do show feature selectivity and participate in co-tuned subnetworks with pyramidal neurons. In this study, we first use mean-field theory to demonstrate that a combination of homeostatic plasticity governing the synaptic dynamics of the connections from PV to excitatory neurons, heterogeneity in the excitatory postsynaptic potentials that impinge on PV neurons, and shared correlated input from layer 4 results in the functional and structural self-organization of PV subnetworks. Second, we show that structural and functional feature tuning of PV neurons emerges more clearly at the network level, i.e., that population-level measures identify functional and structural co-tuning of PV neurons that are not evident in pairwise individual-level measures. Finally, we show that such co-tuning can enhance network stability at the cost of reduced feature selectivity.

Functional specificity of recurrent inhibition in visual cortex

In the neocortex, neural activity is shaped by the interaction of excitatory and inhibitory neurons, defined by the organization of their synaptic connections. Although connections among excitatory pyramidal neurons are sparse and functionally tuned, inhibitory connectivity is thought to be dense and largely unstructured. By measuring in vivo visual responses and synaptic connectivity of parvalbumin-expressing (PV+) inhibitory cells in mouse primary visual cortex, we show that the synaptic weights of their connections to nearby pyramidal neurons are specifically tuned according to the similarity of the cells' responses. Individual PV+ cells strongly inhibit those pyramidal cells that provide them with strong excitation and share their visual selectivity. This structured organization of inhibitory synaptic weights provides a circuit mechanism for tuned inhibition onto pyramidal cells despite dense connectivity, stabilizing activity within feature-specific excitatory ensembles while supporting competition between them.

Cortical cell assemblies and their underlying connectivity: An in silico study

Recent developments in experimental techniques have enabled simultaneous recordings from thousands of neurons, enabling the study of functional cell assemblies. However, determining the patterns of synaptic connectivity giving rise to these assemblies remains challenging. To address this, we developed a complementary, simulation-based approach, using a detailed, large-scale cortical network model. Using a combination of established methods we detected functional cell assemblies from the stimulus-evoked spiking activity of 186,665 neurons. We studied how the structure of synaptic connectivity underlies assembly composition, quantifying the effects of thalamic innervation, recurrent connectivity, and the spatial arrangement of synapses on dendrites. We determined that these features reduce up to 30%, 22%, and 10% of the uncertainty of a neuron belonging to an assembly. The detected assemblies were activated in a stimulus-specific sequence and were grouped based on their position in the sequence. We found that the different groups were affected to different degrees by the structural features we considered. Additionally, connectivity was more predictive of assembly membership if its direction aligned with the temporal order of assembly activation, if it originated from strongly interconnected populations, and if synapses clustered on dendritic branches. In summary, reversing Hebb's postulate, we showed how cells that are wired together, fire together, quantifying how connectivity patterns interact to shape the emergence of assemblies. This includes a qualitative aspect of connectivity: not just the amount, but also the local structure matters; from the subcellular level in the form of dendritic clustering to the presence of specific network motifs.

Does the brain behave like a (complex) network? I. Dynamics

Graph theory is now becoming a standard tool in system-level neuroscience. However, endowing observed brain anatomy and dynamics with a complex network structure does not entail that the brain actually works as a network. Asking whether the brain behaves as a network means asking whether network properties count. From the viewpoint of neurophysiology and, possibly, of brain physics, the most substantial issues a network structure may be instrumental in addressing relate to the influence of network properties on brain dynamics and to whether these properties ultimately explain some aspects of brain function. Here, we address the dynamical implications of complex network, examining which aspects and scales of brain activity may be understood to genuinely behave as a network. To do so, we first define the meaning of networkness, and analyse some of its implications. We then examine ways in which brain anatomy and dynamics can be endowed with a network structure and discuss possible ways in which network structure may be shown to represent a genuine organisational principle of brain activity, rather than just a convenient description of its anatomy and dynamics.

Network Statistics of the Whole-Brain Connectome of Drosophila

Brains comprise complex networks of neurons and connections. Network analysis applied to the wiring diagrams of brains can offer insights into how brains support computations and regulate information flow. The completion of the first whole-brain connectome of an adult Drosophila, the largest connectome to date, containing 130,000 neurons and millions of connections, offers an unprecedented opportunity to analyze its network properties and topological features. To gain insights into local connectivity, we computed the prevalence of two- and three-node network motifs, examined their strengths and neurotransmitter compositions, and compared these topological metrics with wiring diagrams of other animals. We discovered that the network of the fly brain displays rich club organization, with a large population (30% percent of the connectome) of highly connected neurons. We identified subsets of rich club neurons that may serve as integrators or broadcasters of signals. Finally, we examined subnetworks based on 78 anatomically defined brain regions or neuropils. These data products are shared within the FlyWire Codex and will serve as a foundation for models and experiments exploring the relationship between neural activity and anatomical structure.

A generative model of the connectome with dynamic axon growth

Connectome generative models, otherwise known as generative network models, provide insight into the wiring principles underpinning brain network organization. While these models can approximate numerous statistical properties of empirical networks, they typically fail to explicitly characterize an important contributor to brain organization - axonal growth. Emulating the chemoaffinity guided axonal growth, we provide a novel generative model in which axons dynamically steer the direction of propagation based on distance-dependent chemoattractive forces acting on their growth cones. This simple dynamic growth mechanism, despite being solely geometry-dependent, is shown to generate axonal fiber bundles with brain-like geometry and features of complex network architecture consistent with the human brain, including lognormally distributed connectivity weights, scale-free nodal degrees, small-worldness, and modularity. We demonstrate that our model parameters can be fitted to individual connectomes, enabling connectome dimensionality reduction and comparison of parameters between groups. Our work offers an opportunity to bridge studies of axon guidance and connectome development, providing new avenues for understanding neural development from a computational perspective.

Fibroblast mediated dynamics in diffusively uncoupled myocytes: a simulation study using 2-cell motifs

In healthy hearts myocytes are typically coupled to nearest neighbours through gap junctions. Under pathological conditions such as fibrosis, or in scar tissue, or across ablation lines myocytes can uncouple from their neighbours. Electrical conduction may still occur via fibroblasts that not only couple proximal myocytes but can also couple otherwise unconnected regions. We hypothesise that such coupling can alter conduction between myocytes via introduction of delays or by initiation of premature stimuli that can potentially result in reentry or conduction blocks. To test this hypothesis we have developed several 2-cell motifs and investigated the effect of fibroblast mediated electrical coupling between uncoupled myocytes. We have identified various regimes of myocyte behaviour that depend on the strength of gap-junctional conductance, connection topology, and parameters of the myocyte and fibroblast models. These motifs are useful in developing a mechanistic understanding of long-distance coupling on myocyte dynamics and enable the characterisation of interaction between different features such as myocyte and fibroblast properties, coupling strengths and pacing period. They are computationally inexpensive and allow for incorporation of spatial effects such as conduction velocity. They provide a framework for constructing scar tissue boundaries and enable linking of cellular level interactions with scar induced arrhythmia.

Noise-induced synchrony of two-neuron motifs with asymmetric noise and uneven coupling

Synchronous dynamics play a pivotal role in various cognitive processes. Previous studies extensively investigate noise-induced synchrony in coupled neural oscillators, with a focus on scenarios featuring uniform noise and equal coupling strengths between neurons. However, real-world or experimental settings frequently exhibit heterogeneity, including deviations from uniformity in coupling and noise patterns. This study investigates noise-induced synchrony in a pair of coupled excitable neurons operating in a heterogeneous environment, where both noise intensity and coupling strength can vary independently. Each neuron is an excitable oscillator, represented by the normal form of Hopf bifurcation (HB). In the absence of stimulus, these neurons remain quiescent but can be triggered by perturbations, such as noise. Typically, noise and coupling exert opposing influences on neural dynamics, with noise diminishing coherence and coupling promoting synchrony. Our results illustrate the ability of asymmetric noise to induce synchronization in such coupled neural oscillators, with synchronization becoming increasingly pronounced as the system approaches the excitation threshold (i.e., HB). Additionally, we find that uneven coupling strengths and noise asymmetries are factors that can promote in-phase synchrony. Notably, we identify an optimal synchronization state when the absolute difference in coupling strengths is maximized, regardless of the specific coupling strengths chosen. Furthermore, we establish a robust relationship between coupling asymmetry and the noise intensity required to maximize synchronization. Specifically, when one oscillator (receiver neuron) receives a strong input from the other oscillator (source neuron) and the source neuron receives significantly weaker or no input from the receiver neuron, synchrony is maximized when the noise applied to the receiver neuron is much weaker than that applied to the source neuron. These findings reveal the significant connection between uneven coupling and asymmetric noise in coupled neuronal oscillators, shedding light on the enhanced propensity for in-phase synchronization in two-neuron motifs with one-way connections compared to those with two-way connections. This research contributes to a deeper understanding of the functional roles of network motifs that may serve within neuronal dynamics.

How connectivity structure shapes rich and lazy learning in neural circuits

In theoretical neuroscience, recent work leverages deep learning tools to explore how some network attributes critically influence its learning dynamics. Notably, initial weight distributions with small (resp. large) variance may yield a rich (resp. lazy) regime, where significant (resp. minor) changes to network states and representation are observed over the course of learning. However, in biology, neural circuit connectivity could exhibit a low-rank structure and therefore differs markedly from the random initializations generally used for these studies. As such, here we investigate how the structure of the initial weights -- in particular their effective rank -- influences the network learning regime. Through both empirical and theoretical analyses, we discover that high-rank initializations typically yield smaller network changes indicative of lazier learning, a finding we also confirm with experimentally-driven initial connectivity in recurrent neural networks. Conversely, low-rank initialization biases learning towards richer learning. Importantly, however, as an exception to this rule, we find lazier learning can still occur with a low-rank initialization that aligns with task and data statistics. Our research highlights the pivotal role of initial weight structures in shaping learning regimes, with implications for metabolic costs of plasticity and risks of catastrophic forgetting.

Quantifying and Maximizing the Information Flux in Recurrent Neural Networks

Free-running recurrent neural networks (RNNs), especially probabilistic models, generate an ongoing information flux that can be quantified with the mutual information I[x→(t),x→(t+1)] between subsequent system states x→. Although previous studies have shown that I depends on the statistics of the network's connection weights, it is unclear how to maximize I systematically and how to quantify the flux in large systems where computing the mutual information becomes intractable. Here, we address these questions using Boltzmann machines as model systems. We find that in networks with moderately strong connections, the mutual information I is approximately a monotonic transformation of the root-mean-square averaged Pearson correlations between neuron pairs, a quantity that can be efficiently computed even in large systems. Furthermore, evolutionary maximization of I[x→(t),x→(t+1)] reveals a general design principle for the weight matrices enabling the systematic construction of systems with a high spontaneous information flux. Finally, we simultaneously maximize information flux and the mean period length of cyclic attractors in the state-space of these dynamical networks. Our results are potentially useful for the construction of RNNs that serve as short-time memories or pattern generators.

Model-Agnostic Neural Mean Field With The Refractory SoftPlus Transfer Function

Due to the complexity of neuronal networks and the nonlinear dynamics of individual neurons, it is challenging to develop a systems-level model which is accurate enough to be useful yet tractable enough to apply. Mean-field models which extrapolate from single-neuron descriptions to large-scale models can be derived from the neuron's transfer function, which gives its firing rate as a function of its synaptic input. However, analytically derived transfer functions are applicable only to the neurons and noise models from which they were originally derived. In recent work, approximate transfer functions have been empirically derived by fitting a sigmoidal curve, which imposes a maximum firing rate and applies only in the diffusion limit, restricting applications. In this paper, we propose an approximate transfer function called Refractory SoftPlus, which is simple yet applicable to a broad variety of neuron types. Refractory SoftPlus activation functions allow the derivation of simple empirically approximated mean-field models using simulation results, which enables prediction of the response of a network of randomly connected neurons to a time-varying external stimulus with a high degree of accuracy. These models also support an accurate approximate bifurcation analysis as a function of the level of recurrent input. Finally, the model works without assuming large presynaptic rates or small postsynaptic potential size, allowing mean-field models to be developed even for populations with large interaction terms.

Structure and function of the hippocampal CA3 module

The hippocampal formation is crucial for learning and memory, with submodule CA3 thought to be the substrate of pattern completion. However, the underlying synaptic and computational mechanisms of this network are not well understood. Here, we perform circuit reconstruction of a CA3 module using three dimensional (3D) electron microscopy data and combine this with functional connectivity recordings and computational simulations to determine possible CA3 network mechanisms. Direct measurements of connectivity schemes with both physiological measurements and structural 3D EM revealed a high connectivity rate, multi-fold higher than previously assumed. Mathematical modelling indicated that such CA3 networks can robustly generate pattern completion and replay memory sequences. In conclusion, our data demonstrate that the connectivity scheme of the hippocampal submodule is well suited for efficient memory storage and retrieval.

Simultaneous interneuron labeling reveals population-level interactions among parvalbumin, somatostatin, and pyramidal neurons in cortex

Cortical interneurons shape network activity in cell type-specific ways, and are also influenced by interactions with other cell types. These specific cell-type interactions are understudied, as transgenic labeling methods typically restrict labeling to one neuron type at a time. Although recent methods have enabled post-hoc identification of cell types, these are not available to many labs. Here, we present a method to distinguish between two red fluorophores in vivo, which allowed imaging of activity in somatostatin (SOM), parvalbumin (PV), and putative pyramidal neurons (PYR) in mouse association cortex. We compared population events of elevated activity and observed that the PYR network state corresponded to the ratio between mean SOM and PV neuron activity, demonstrating the importance of simultaneous labeling to explain dynamics. These results extend previous findings in sensory cortex, as activity became sparser and less correlated when the ratio between SOM and PV activity was high.

Linear and nonlinear integrate-and-fire neurons driven by synaptic shot noise with reversal potentials

The steady-state firing rate and firing-rate response of the leaky and exponential integrate-and-fire models receiving synaptic shot noise with excitatory and inhibitory reversal potentials is examined. For the particular case where the underlying synaptic conductances are exponentially distributed, it is shown that the master equation for a population of such model neurons can be reduced from an integrodifferential form to a more tractable set of three differential equations. The system is nevertheless more challenging analytically than for current-based synapses: where possible, analytical results are provided with an efficient numerical scheme and code provided for other quantities. The increased tractability of the framework developed supports an ongoing critical comparison between models in which synapses are treated with and without reversal potentials, such as recently in the context of networks with balanced excitatory and inhibitory conductances.

Explicit mutual information for simple networks and neurons with lognormal activities

Networks with stochastic variables described by heavy-tailed lognormal distribution are ubiquitous in nature, and hence they deserve an exact information-theoretic characterization. We derive analytical formulas for mutual information between elements of different networks with correlated lognormally distributed activities. In a special case, we find an explicit expression for mutual information between neurons when neural activities and synaptic weights are lognormally distributed, as suggested by experimental data. Comparison of this expression with the case when these two variables have short tails reveals that mutual information with heavy tails for neurons and synapses is generally larger and can diverge for some finite variances in presynaptic firing rates and synaptic weights. This result suggests that evolution might prefer brains with heterogeneous dynamics to optimize information processing.

Protosequences in human cortical organoids model intrinsic states in the developing cortex

Neuronal firing sequences are thought to be the basic building blocks of neural coding and information broadcasting within the brain. However, when sequences emerge during neurodevelopment remains unknown. We demonstrate that structured firing sequences are present in spontaneous activity of human brain organoids and ex vivo neonatal brain slices from the murine somatosensory cortex. We observed a balance between temporally rigid and flexible firing patterns that are emergent phenomena in human brain organoids and early postnatal murine somatosensory cortex, but not in primary dissociated cortical cultures. Our findings suggest that temporal sequences do not arise in an experience-dependent manner, but are rather constrained by an innate preconfigured architecture established during neurogenesis. These findings highlight the potential for brain organoids to further explore how exogenous inputs can be used to refine neuronal circuits and enable new studies into the genetic mechanisms that govern assembly of functional circuitry during early human brain development.

Efficient, continual, and generalized learning in the brain - neural mechanism of Mental Schema 2.0

There has been tremendous progress in artificial neural networks (ANNs) over the past decade; however, the gap between ANNs and the biological brain as a learning device remains large. With the goal of closing this gap, this paper reviews learning mechanisms in the brain by focusing on three important issues in ANN research: efficiency, continuity, and generalization. We first discuss the method by which the brain utilizes a variety of self-organizing mechanisms to maximize learning efficiency, with a focus on the role of spontaneous activity of the brain in shaping synaptic connections to facilitate spatiotemporal learning and numerical processing. Then, we examined the neuronal mechanisms that enable lifelong continual learning, with a focus on memory replay during sleep and its implementation in brain-inspired ANNs. Finally, we explored the method by which the brain generalizes learned knowledge in new situations, particularly from the mathematical generalization perspective of topology. Besides a systematic comparison in learning mechanisms between the brain and ANNs, we propose "Mental Schema 2.0," a new computational property underlying the brain's unique learning ability that can be implemented in ANNs.

Information encoded in volumes and areas of dendritic spines is nearly maximal across mammalian brains

Many experiments suggest that long-term information associated with neuronal memory resides collectively in dendritic spines. However, spines can have a limited size due to metabolic and neuroanatomical constraints, which should effectively limit the amount of encoded information in excitatory synapses. This study investigates how much information can be stored in the population of sizes of dendritic spines, and whether it is optimal in any sense. It is shown here, using empirical data for several mammalian brains across different regions and physiological conditions, that dendritic spines nearly maximize entropy contained in their volumes and surface areas for a given mean size in cortical and hippocampal regions. Although both short- and heavy-tailed fitting distributions approach [Formula: see text] of maximal entropy in the majority of cases, the best maximization is obtained primarily for short-tailed gamma distribution. We find that most empirical ratios of standard deviation to mean for spine volumes and areas are in the range [Formula: see text], which is close to the theoretical optimal ratios coming from entropy maximization for gamma and lognormal distributions. On average, the highest entropy is contained in spine length ([Formula: see text] bits per spine), and the lowest in spine volume and area ([Formula: see text] bits), although the latter two are closer to optimality. In contrast, we find that entropy density (entropy per spine size) is always suboptimal. Our results suggest that spine sizes are almost as random as possible given the constraint on their size, and moreover the general principle of entropy maximization is applicable and potentially useful to information and memory storing in the population of cortical and hippocampal excitatory synapses, and to predicting their morphological properties.

Translating single-neuron axonal reconstructions into meso-scale connectivity statistics in the mouse somatosensory thalamus

Characterizing the connectomic and morphological diversity of thalamic neurons is key for better understanding how the thalamus relays sensory inputs to the cortex. The recent public release of complete single-neuron morphological reconstructions enables the analysis of previously inaccessible connectivity patterns from individual neurons. Here we focus on the Ventral Posteromedial (VPM) nucleus and characterize the full diversity of 257 VPM neurons, obtained by combining data from the MouseLight and Braintell projects. Neurons were clustered according to their most dominantly targeted cortical area and further subdivided by their jointly targeted areas. We obtained a 2D embedding of morphological diversity using the dissimilarity between all pairs of axonal trees. The curved shape of the embedding allowed us to characterize neurons by a 1-dimensional coordinate. The coordinate values were aligned both with the progression of soma position along the dorsal-ventral and lateral-medial axes and with that of axonal terminals along the posterior-anterior and medial-lateral axes, as well as with an increase in the number of branching points, distance from soma and branching width. Taken together, we have developed a novel workflow for linking three challenging aspects of connectomics, namely the topography, higher order connectivity patterns and morphological diversity, with VPM as a test-case. The workflow is linked to a unified access portal that contains the morphologies and integrated with 2D cortical flatmap and subcortical visualization tools. The workflow and resulting processed data have been made available in Python, and can thus be used for modeling and experimentally validating new hypotheses on thalamocortical connectivity.

Multistability in neural systems with random cross-connections

Neural circuits with multiple discrete attractor states could support a variety of cognitive tasks according to both empirical data and model simulations. We assess the conditions for such multistability in neural systems using a firing rate model framework, in which clusters of similarly responsive neurons are represented as single units, which interact with each other through independent random connections. We explore the range of conditions in which multistability arises via recurrent input from other units while individual units, typically with some degree of self-excitation, lack sufficient self-excitation to become bistable on their own. We find many cases of multistability-defined as the system possessing more than one stable fixed point-in which stable states arise via a network effect, allowing subsets of units to maintain each others' activity because their net input to each other when active is sufficiently positive. In terms of the strength of within-unit self-excitation and standard deviation of random cross-connections, the region of multistability depends on the response function of units. Indeed, multistability can arise with zero self-excitation, purely through zero-mean random cross-connections, if the response function rises supralinearly at low inputs from a value near zero at zero input. We simulate and analyze finite systems, showing that the probability of multistability can peak at intermediate system size, and connect with other literature analyzing similar systems in the infinite-size limit. We find regions of multistability with a bimodal distribution for the number of active units in a stable state. Finally, we find evidence for a log-normal distribution of sizes of attractor basins, which produces Zipf's Law when enumerating the proportion of trials within which random initial conditions lead to a particular stable state of the system.

Using Human-Induced Pluripotent Stem Cell Derived Neurons on Microelectrode Arrays to Model Neurological Disease: A Review

In situ physiological signals of in vitro neural disease models are essential for studying pathogenesis and drug screening. Currently, an increasing number of in vitro neural disease models are established using human-induced pluripotent stem cell (hiPSC) derived neurons (hiPSC-DNs) to overcome interspecific gene expression differences. Microelectrode arrays (MEAs) can be readily interfaced with two-dimensional (2D), and more recently, three-dimensional (3D) neural stem cell-derived in vitro models of the human brain to monitor their physiological activity in real time. Therefore, MEAs are emerging and useful tools to model neurological disorders and disease in vitro using human iPSCs. This is enabling a real-time window into neuronal signaling at the network scale from patient derived. This paper provides a comprehensive review of MEA's role in analyzing neural disease models established by hiPSC-DNs. It covers the significance of MEA fabrication, surface structure and modification schemes for hiPSC-DNs culturing and signal detection. Additionally, this review discusses advances in the development and use of MEA technology to study in vitro neural disease models, including epilepsy, autism spectrum developmental disorder (ASD), and others established using hiPSC-DNs. The paper also highlights the application of MEAs combined with hiPSC-DNs in detecting in vitro neurotoxic substances. Finally, the future development and outlook of multifunctional and integrated devices for in vitro medical diagnostics and treatment are discussed.

Compressive sensing of functional connectivity maps from patterned optogenetic stimulation of neuronal ensembles

Mapping functional connectivity between neurons is an essential step toward probing the neural computations mediating behavior. Accurately determining synaptic connectivity maps in populations of neurons is challenging in terms of yield, accuracy, and experimental time. Here, we developed a compressive sensing approach to reconstruct synaptic connectivity maps based on random two-photon cell-targeted optogenetic stimulation and membrane voltage readout of many putative postsynaptic neurons. Using a biophysical network model of interconnected populations of excitatory and inhibitory neurons, we characterized mapping recall and precision as a function of network observability, sparsity, number of neurons stimulated, off-target stimulation, synaptic reliability, propagation latency, and network topology. We found that mapping can be achieved with far fewer measurements than the standard pairwise sequential approach, with network sparsity and synaptic reliability serving as primary determinants of the performance. Our results suggest a rapid and efficient method to reconstruct functional connectivity of sparsely connected neuronal networks.

Whole-Brain Evaluation of Cortical Microconnectomes

The brain is an organ that functions as a network of many elements connected in a nonuniform manner. In the brain, the neocortex is evolutionarily newest and is thought to be primarily responsible for the high intelligence of mammals. In the mature mammalian brain, all cortical regions are expected to have some degree of homology, but have some variations of local circuits to achieve specific functions performed by individual regions. However, few cellular-level studies have examined how the networks within different cortical regions differ. This study aimed to find rules for systematic changes of connectivity (microconnectomes) across 16 different cortical region groups. We also observed unknown trends in basic parameters in vitro such as firing rate and layer thickness across brain regions. Results revealed that the frontal group shows unique characteristics such as dense active neurons, thick cortex, and strong connections with deeper layers. This suggests the frontal side of the cortex is inherently capable of driving, even in isolation and that frontal nodes provide the driving force generating a global pattern of spontaneous synchronous activity, such as the default mode network. This finding provides a new hypothesis explaining why disruption in the frontal region causes a large impact on mental health.

Shared and divergent principles of synaptic transmission between cortical excitatory neurons in rodent and human brain

Information transfer between principal neurons in neocortex occurs through (glutamatergic) synaptic transmission. In this focussed review, we provide a detailed overview on the strength of synaptic neurotransmission between pairs of excitatory neurons in human and laboratory animals with a specific focus on data obtained using patch clamp electrophysiology. We reach two major conclusions: (1) the synaptic strength, measured as unitary excitatory postsynaptic potential (or uEPSP), is remarkably consistent across species, cortical regions, layers and/or cell-types (median 0.5 mV, interquartile range 0.4-1.0 mV) with most variability associated with the cell-type specific connection studied (min 0.1-max 1.4 mV), (2) synaptic function cannot be generalized across human and rodent, which we exemplify by discussing the differences in anatomical and functional properties of pyramidal-to-pyramidal connections within human and rodent cortical layers 2 and 3. With only a handful of studies available on synaptic transmission in human, it is obvious that much remains unknown to date. Uncovering the shared and divergent principles of synaptic transmission across species however, will almost certainly be a pivotal step toward understanding human cognitive ability and brain function in health and disease.

The Intrinsic Similarity of Topological Structure in Biological Neural Networks

Most previous studies mainly have focused on the analysis of structural properties of individual neuronal networks from C. elegans. In recent years, an increasing number of synapse-level neural maps, also known as biological neural networks, have been reconstructed. However, it is not clear whether there are intrinsic similarities of structural properties of biological neural networks from different brain compartments or species. To explore this issue, we collected nine connectomes at synaptic resolution including C. elegans, and analyzed their structural properties. We found that these biological neural networks possess small-world properties and modules. Excluding the Drosophila larval visual system, these networks have rich clubs. The distributions of synaptic connection strength for these networks can be fitted by the truncated pow-law distributions. Additionally, compared with the power-law model, a log-normal distribution is a better model to fit the complementary cumulative distribution function (CCDF) of degree for these neuronal networks. Moreover, we also observed that these neural networks belong to the same superfamily based on the significance profile (SP) of small subgraphs in the network. Taken together, these findings suggest that biological neural networks share intrinsic similarities in their topological structure, revealing some principles underlying the formation of biological neural networks within and across species.

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Introduction

Spiking neural networks (SNNs), inspired by biological neural networks, have received a surge of interest due to its temporal encoding. Biological neural networks are driven by multiple plasticities, including spike timing-dependent plasticity (STDP), structural plasticity, and homeostatic plasticity, making network connection patterns and weights to change continuously during the lifecycle. However, it is unclear how these plasticities interact to shape neural networks and affect neural signal processing.

Method

Here, we propose a reward-modulated self-organization recurrent network with structural plasticity (RSRN-SP) to investigate this issue. Specifically, RSRN-SP uses spikes to encode information, and incorporate multiple plasticities including reward-modulated spike timing-dependent plasticity (R-STDP), homeostatic plasticity, and structural plasticity. On the one hand, combined with homeostatic plasticity, R-STDP is presented to guide the updating of synaptic weights. On the other hand, structural plasticity is utilized to simulate the growth and pruning of synaptic connections.

Results and discussion

Extensive experiments for sequential learning tasks are conducted to demonstrate the representational ability of the RSRN-SP, including counting task, motion prediction, and motion generation. Furthermore, the simulations also indicate that the characteristics arose from the RSRN-SP are consistent with biological observations.

Logarithmically scaled, gamma distributed neuronal spiking

Naturally log-scaled quantities abound in the nervous system. Distributions of these quantities have non-intuitive properties, which have implications for data analysis and the understanding of neural circuits. Here, we review the log-scaled statistics of neuronal spiking and the relevant analytical probability distributions. Recent work using log-scaling revealed that interspike intervals of forebrain neurons segregate into discrete modes reflecting spiking at different timescales and are each well-approximated by a gamma distribution. Each neuron spends most of the time in an irregular spiking 'ground state' with the longest intervals, which determines the mean firing rate of the neuron. Across the entire neuronal population, firing rates are log-scaled and well approximated by the gamma distribution, with a small number of highly active neurons and an overabundance of low rate neurons (the 'dark matter'). These results are intricately linked to a heterogeneous balanced operating regime, which confers upon neuronal circuits multiple computational advantages and has evolutionarily ancient origins.

From single-neuron dynamics to higher-order circuit motifs in control and pathological brain networks

The convergence of advanced single-cell in vivo functional imaging techniques, computational modelling tools and graph-based network analytics has heralded new opportunities to study single-cell dynamics across large-scale networks, providing novel insights into principles of brain communication and pointing towards potential new strategies for treating neurological disorders. A major recent finding has been the identification of unusually richly connected hub cells that have capacity to synchronize networks and may also be critical in network dysfunction. While hub neurons are traditionally defined by measures that consider solely the number and strength of connections, novel higher-order graph analytics now enables the mining of massive networks for repeating subgraph patterns called motifs. As an illustration of the power offered by higher-order analysis of neuronal networks, we highlight how recent methodological advances uncovered a new functional cell type, the superhub, that is predicted to play a major role in regulating network dynamics. Finally, we discuss open questions that will be critical for assessing the importance of higher-order cellular-scale network analytics in understanding brain function in health and disease.