Hub-activated signal transmission in complex networks

Logarithmically scaled, gamma distributed neuronal spiking

Naturally log-scaled quantities abound in the nervous system. Distributions of these quantities have non-intuitive properties, which have implications for data analysis and the understanding of neural circuits. Here, we review the log-scaled statistics of neuronal spiking and the relevant analytical probability distributions. Recent work using log-scaling revealed that interspike intervals of forebrain neurons segregate into discrete modes reflecting spiking at different timescales and are each well-approximated by a gamma distribution. Each neuron spends most of the time in an irregular spiking 'ground state' with the longest intervals, which determines the mean firing rate of the neuron. Across the entire neuronal population, firing rates are log-scaled and well approximated by the gamma distribution, with a small number of highly active neurons and an overabundance of low rate neurons (the 'dark matter'). These results are intricately linked to a heterogeneous balanced operating regime, which confers upon neuronal circuits multiple computational advantages and has evolutionarily ancient origins.

Structure and function in artificial, zebrafish and human neural networks

Network science provides a set of tools for the characterization of the structure and functional behavior of complex systems. Yet a major problem is to quantify how the structural domain is related to the dynamical one. In other words, how the diversity of dynamical states of a system can be predicted from the static network structure? Or the reverse problem: starting from a set of signals derived from experimental recordings, how can one discover the network connections or the causal relations behind the observed dynamics? Despite the advances achieved over the last two decades, many challenges remain concerning the study of the structure-dynamics interplay of complex systems. In neuroscience, progress is typically constrained by the low spatio-temporal resolution of experiments and by the lack of a universal inferring framework for empirical systems. To address these issues, applications of network science and artificial intelligence to neural data have been rapidly growing. In this article, we review important recent applications of methods from those fields to the study of the interplay between structure and functional dynamics of human and zebrafish brain. We cover the selection of topological features for the characterization of brain networks, inference of functional connections, dynamical modeling, and close with applications to both the human and zebrafish brain. This review is intended to neuroscientists who want to become acquainted with techniques from network science, as well as to researchers from the latter field who are interested in exploring novel application scenarios in neuroscience.

Inferring missing edges in a graph from observed collective patterns

Many real-life networks are incomplete. Dynamical observations can allow estimating missing edges. Such procedures, often summarized under the term 'network inference', typically evaluate the statistical correlations among pairs of nodes to determine connectivity. Here, we offer an alternative approach: completing an incomplete network by observing its collective behavior. We illustrate this approach for the case of patterns emerging in reaction-diffusion systems on graphs, where collective behaviors can be associated with eigenvectors of the network's Laplacian matrix. Our method combines a partial spectral decomposition of the network's Laplacian matrix with eigenvalue assignment by matching the patterns to the eigenvectors of the incomplete graph. We show that knowledge of a few collective patterns can allow the prediction of missing edges and that this result holds across a range of network architectures. We present a numerical case study using activator-inhibitor dynamics and we illustrate that the main requirement for the observed patterns is that they are not confined to subsets of nodes, but involve the whole network.

High-frequency oscillations and sequence generation in two-population models of hippocampal region CA1

Hippocampal sharp wave/ripple oscillations are a prominent pattern of collective activity, which consists of a strong overall increase of activity with superimposed (140 − 200 Hz) ripple oscillations. Despite its prominence and its experimentally demonstrated importance for memory consolidation, the mechanisms underlying its generation are to date not understood. Several models assume that recurrent networks of inhibitory cells alone can explain the generation and main characteristics of the ripple oscillations. Recent experiments, however, indicate that in addition to inhibitory basket cells, the pattern requires in vivo the activity of the local population of excitatory pyramidal cells. Here, we study a model for networks in the hippocampal region CA1 incorporating such a local excitatory population of pyramidal neurons. We start by investigating its ability to generate ripple oscillations using extensive simulations. Using biologically plausible parameters, we find that short pulses of external excitation triggering excitatory cell spiking are required for sharp/wave ripple generation with oscillation patterns similar to in vivo observations. Our model has plausible values for single neuron, synapse and connectivity parameters, random connectivity and no strong feedforward drive to the inhibitory population. Specifically, whereas temporally broad excitation can lead to high-frequency oscillations in the ripple range, sparse pyramidal cell activity is only obtained with pulse-like external CA3 excitation. Further simulations indicate that such short pulses could originate from dendritic spikes in the apical or basal dendrites of CA1 pyramidal cells, which are triggered by coincident spike arrivals from hippocampal region CA3. Finally we show that replay of sequences by pyramidal neurons and ripple oscillations can arise intrinsically in CA1 due to structured connectivity that gives rise to alternating excitatory pulse and inhibitory gap coding; the latter denotes phases of silence in specific basket cell groups, which induce selective disinhibition of groups of pyramidal neurons. This general mechanism for sequence generation leads to sparse pyramidal cell and dense basket cell spiking, does not rely on synfire chain-like feedforward excitation and may be relevant for other brain regions as well.

Dynamical Mechanism Underlying Scale-Free Network Reorganization in Low Acetylcholine States Corresponding to Slow Wave Sleep

Sleep is indispensable for most animals' cognitive functions, and is hypothesized to be a major factor in memory consolidation. Although we do not fully understand the mechanisms of network reorganisation driving memory consolidation, available data suggests that sleep-associated neurochemical changes may be important for such processes. In particular, global acetylcholine levels change across the sleep/wake cycle, with high cholinergic tone during wake and REM sleep and low cholinergic tone during slow wave sleep. Furthermore, experimental perturbation of cholinergic tone has been shown to impact memory storage. Through in silico modeling of neuronal networks, we show how spiking dynamics change in highly heterogenous networks under varying levels of cholinergic tone, with neuronal networks under high cholinergic modulation firing asynchronously and at high frequencies, while those under low cholinergic modulation exhibit synchronous patterns of activity. We further examined the network's dynamics and its reorganization mediated via changing levels of acetylcholine within the context of different scale-free topologies, comparing network activity within the hub cells, a small group of neurons having high degree connectivity, and with the rest of the network. We show a dramatic, state-dependent change in information flow throughout the network, with highly active hub cells integrating information in a high-acetylcholine state, and transferring it to rest of the network in a low-acetylcholine state. This result is experimentally corroborated by frequency-dependent frequency changes observed in vivo experiments. Together, these findings provide insight into how new neurons are recruited into memory traces during sleep, a mechanism which may underlie system memory consolidation.

Analyzing the competition of gamma rhythms with delayed pulse-coupled oscillators in phase representation

Networks of neurons can generate oscillatory activity as result of various types of coupling that lead to synchronization. A prominent type of oscillatory activity is gamma (30-80 Hz) rhythms, which may play an important role in neuronal information processing. Two mechanisms have mainly been proposed for their generation: (1) interneuron network gamma (ING) and (2) pyramidal-interneuron network gamma (PING). In vitro and in vivo experiments have shown that both mechanisms can exist in the same cortical circuits. This raises the questions: How do ING and PING interact when both can in principle occur? Are the network dynamics a superposition, or do ING and PING interact in a nonlinear way and if so, how? In this article, we first generalize the phase representation for nonlinear one-dimensional pulse coupled oscillators as introduced by Mirollo and Strogatz to type II oscillators whose phase response curve (PRC) has zero crossings. We then give a full theoretical analysis for the regular gamma-like oscillations of simple networks consisting of two neural oscillators, an "E neuron" mimicking a synchronized group of pyramidal cells, and an "I neuron" representing such a group of interneurons. Motivated by experimental findings, we choose the E neuron to have a type I PRC [leaky integrate-and-fire (LIF) neuron], while the I neuron has either a type I or type II PRC (LIF or "sine" neuron). The phase representation allows us to define in a simple manner scenarios of interaction between the two neurons, which are independent of the types and the details of the neuron models. The presence of delay in the couplings leads to an increased number of scenarios relevant for gamma-like oscillatory patterns. We analytically derive the set of such scenarios and describe their occurrence in terms of parameter values such as synaptic connectivity and drive to the E and I neurons. The networks can be tuned to oscillate in an ING or PING mode. We focus particularly on the transition region where both rhythms compete to govern the network dynamics and compare with oscillations in reduced networks, which can only generate either ING or PING. Our analytically derived oscillation frequency diagrams indicate that except for small coexistence regions, the networks generate ING if the oscillation frequency of the reduced ING network exceeds that of the reduced PING network, and vice versa. For networks with the LIF I neuron, the network oscillation frequency slightly exceeds the frequencies of corresponding reduced networks, while it lies between them for networks with the sine I neuron. In networks oscillating in ING (PING) mode, the oscillation frequency responds faster to changes in the drive to the I (E) neuron than to changes in the drive to the E (I) neuron. This finding suggests a method to analyze which mechanism governs an observed network oscillation. Notably, also when the network operates in ING mode, the E neuron can spike before the I neuron such that relative spike times of the pyramidal cells and the interneurons alone are not conclusive for distinguishing ING and PING.

Cortical Dynamics in Presence of Assemblies of Densely Connected Weight-Hub Neurons

Experimental measurements of pairwise connection probability of pyramidal neurons together with the distribution of synaptic weights have been used to construct randomly connected model networks. However, several experimental studies suggest that both wiring and synaptic weight structure between neurons show statistics that differ from random networks. Here we study a network containing a subset of neurons which we call weight-hub neurons, that are characterized by strong inward synapses. We propose a connectivity structure for excitatory neurons that contain assemblies of densely connected weight-hub neurons, while the pairwise connection probability and synaptic weight distribution remain consistent with experimental data. Simulations of such a network with generalized integrate-and-fire neurons display regular and irregular slow oscillations akin to experimentally observed up/down state transitions in the activity of cortical neurons with a broad distribution of pairwise spike correlations. Moreover, stimulation of a model network in the presence or absence of assembly structure exhibits responses similar to light-evoked responses of cortical layers in optogenetically modified animals. We conclude that a high connection probability into and within assemblies of excitatory weight-hub neurons, as it likely is present in some but not all cortical layers, changes the dynamics of a layer of cortical microcircuitry significantly.

Sleep regulation of the distribution of cortical firing rates

Sleep is thought to mediate both mnemonic and homeostatic functions. However, the mechanism by which this brain state can simultaneously implement the 'selective' plasticity needed to consolidate novel memory traces and the 'general' plasticity necessary to maintain a well-functioning neuronal system is unclear. Recent findings show that both of these functions differentially affect neurons based on their intrinsic firing rate, a ubiquitous neuronal heterogeneity. Furthermore, they are both implemented by the NREM slow oscillation, which also distinguishes neurons based on firing rate during sequential activity at the DOWN→UP transition. These findings suggest a mechanism by which spiking activity during the slow oscillation acts to maintain network statistics that promote a skewed distribution of neuronal firing rates, and perturbation of that activity by hippocampal replay acts to integrate new memory traces into the existing cortical network.

Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains

Coherent neural spiking and local field potentials are believed to be signatures of the binding and transfer of information in the brain. Coherent activity has now been measured experimentally in many regions of mammalian cortex. Recently experimental evidence has been presented suggesting that neural information is encoded and transferred in packets, i.e., in stereotypical, correlated spiking patterns of neural activity. Due to their relevance to coherent spiking, synfire chains are one of the main theoretical constructs that have been appealed to in order to describe coherent spiking and information transfer phenomena. However, for some time, it has been known that synchronous activity in feedforward networks asymptotically either approaches an attractor with fixed waveform and amplitude, or fails to propagate. This has limited the classical synfire chain’s ability to explain graded neuronal responses. Recently, we have shown that pulse-gated synfire chains are capable of propagating graded information coded in mean population current or firing rate amplitudes. In particular, we showed that it is possible to use one synfire chain to provide gating pulses and a second, pulse-gated synfire chain to propagate graded information. We called these circuits synfire-gated synfire chains (SGSCs). Here, we present SGSCs in which graded information can rapidly cascade through a neural circuit, and show a correspondence between this type of transfer and a mean-field model in which gating pulses overlap in time. We show that SGSCs are robust in the presence of variability in population size, pulse timing and synaptic strength. Finally, we demonstrate the computational capabilities of SGSC-based information coding by implementing a self-contained, spike-based, modular neural circuit that is triggered by streaming input, processes the input, then makes a decision based on the processed information and shuts itself down.

Cognitive tasks are associated with the dynamic excitation of neural assemblies. When we consider how quickly and flexibly such collectives may be formed and incorporated in a task, a persistent question has been: how can the brain rapidly evoke and involve different neural assemblies in a computation, when synaptic coupling changes only slowly? Here, we demonstrate mechanisms whereby information may be rapidly and selectively routed through a neural circuit, and sub-circuits may be turned on and off. The resulting information processing framework achieves the goal that has been pursued, but until now largely not attained, of achieving faithful, flexible information transfer across many synapses and dynamic excitation of neural assemblies with fixed connectivities.

A Unified Dynamic Model for Learning, Replay, and Sharp-Wave/Ripples

Hippocampal activity is fundamental for episodic memory formation and consolidation. During phases of rest and sleep, it exhibits sharp-wave/ripple (SPW/R) complexes, which are short episodes of increased activity with superimposed high-frequency oscillations. Simultaneously, spike sequences reflecting previous behavior, such as traversed trajectories in space, are replayed. Whereas these phenomena are thought to be crucial for the formation and consolidation of episodic memory, their neurophysiological mechanisms are not well understood. Here we present a unified model showing how experience may be stored and thereafter replayed in association with SPW/Rs. We propose that replay and SPW/Rs are tightly interconnected as they mutually generate and support each other. The underlying mechanism is based on the nonlinear dendritic computation attributable to dendritic sodium spikes that have been prominently found in the hippocampal regions CA1 and CA3, where SPW/Rs and replay are also generated. Besides assigning SPW/Rs a crucial role for replay and thus memory processing, the proposed mechanism also explains their characteristic features, such as the oscillation frequency and the overall wave form. The results shed a new light on the dynamical aspects of hippocampal circuit learning.

SIGNIFICANCE STATEMENT

During phases of rest and sleep, the hippocampus, the "memory center" of the brain, generates intermittent patterns of strongly increased overall activity with high-frequency oscillations, the so-called sharp-wave/ripples. We investigate their role in learning and memory processing. They occur together with replay of activity sequences reflecting previous behavior. Developing a unifying computational model, we propose that both phenomena are tightly linked, by mutually generating and supporting each other. The underlying mechanism depends on nonlinear amplification of synchronous inputs that has been prominently found in the hippocampus. Besides assigning sharp-wave/ripples a crucial role for replay generation and thus memory processing, the proposed mechanism also explains their characteristic features, such as the oscillation frequency and the overall wave form.

A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding

Neural oscillations can enhance feature recognition (Azouz and Gray Proceedings of the National Academy of Sciences of the United States of America, 97, 8110-8115 2000), modulate interactions between neurons (Womelsdorf et al. Science, 316, 1609-01612 2007), and improve learning and memory (Markowska et al. The Journal of Neuroscience, 15, 2063-2073 1995). Numerical studies have shown that coherent spiking can give rise to windows in time during which information transfer can be enhanced in neuronal networks (Abeles Israel Journal of Medical Sciences, 18, 83-92 1982; Lisman and Idiart Science, 267, 1512-1515 1995, Salinas and Sejnowski Nature Reviews. Neuroscience, 2, 539-550 2001). Unanswered questions are: 1) What is the transfer mechanism? And 2) how well can a transfer be executed? Here, we present a pulse-based mechanism by which a graded current amplitude may be exactly propagated from one neuronal population to another. The mechanism relies on the downstream gating of mean synaptic current amplitude from one population of neurons to another via a pulse. Because transfer is pulse-based, information may be dynamically routed through a neural circuit with fixed connectivity. We demonstrate the transfer mechanism in a realistic network of spiking neurons and show that it is robust to noise in the form of pulse timing inaccuracies, random synaptic strengths and finite size effects. We also show that the mechanism is structurally robust in that it may be implemented using biologically realistic pulses. The transfer mechanism may be used as a building block for fast, complex information processing in neural circuits. We show that the mechanism naturally leads to a framework wherein neural information coding and processing can be considered as a product of linear maps under the active control of a pulse generator. Distinct control and processing components combine to form the basis for the binding, propagation, and processing of dynamically routed information within neural pathways. Using our framework, we construct example neural circuits to 1) maintain a short-term memory, 2) compute time-windowed Fourier transforms, and 3) perform spatial rotations. We postulate that such circuits, with automatic and stereotyped control and processing of information, are the neural correlates of Crick and Koch's zombie modes.

Oscillation-induced signal transmission and gating in neural circuits

Reliable signal transmission constitutes a key requirement for neural circuit function. The propagation of synchronous pulse packets through recurrent circuits is hypothesized to be one robust form of signal transmission and has been extensively studied in computational and theoretical works. Yet, although external or internally generated oscillations are ubiquitous across neural systems, their influence on such signal propagation is unclear. Here we systematically investigate the impact of oscillations on propagating synchrony. We find that for standard, additive couplings and a net excitatory effect of oscillations, robust propagation of synchrony is enabled in less prominent feed-forward structures than in systems without oscillations. In the presence of non-additive coupling (as mediated by fast dendritic spikes), even balanced oscillatory inputs may enable robust propagation. Here, emerging resonances create complex locking patterns between oscillations and spike synchrony. Interestingly, these resonances make the circuits capable of selecting specific pathways for signal transmission. Oscillations may thus promote reliable transmission and, in co-action with dendritic nonlinearities, provide a mechanism for information processing by selectively gating and routing of signals. Our results are of particular interest for the interpretation of sharp wave/ripple complexes in the hippocampus, where previously learned spike patterns are replayed in conjunction with global high-frequency oscillations. We suggest that the oscillations may serve to stabilize the replay.

Rhythmic activity in the brain is ubiquitous, its functions are debated. Here we show that it may contribute to the reliable transmission of information within brain areas. We find that its effect is particularly strong if we take nonlinear coupling into account. This experimentally found neuronal property implies that inputs which arrive nearly simultaneously can have a much stronger impact than expected from the sum of their individuals strengths. In such systems, rhythmic activity supports information transmission even if its positive and negative part exactly cancels all the time. Further, the information transmission can adapt to the oscillation frequency to optimally benefit from it. Finally, we show that rhythms with different frequencies may enable or disable communication channels, and are thus suitable for the steering of information flow.

Clique of functional hubs orchestrates population bursts in developmentally regulated neural networks

It has recently been discovered that single neuron stimulation can impact network dynamics in immature and adult neuronal circuits. Here we report a novel mechanism which can explain in neuronal circuits, at an early stage of development, the peculiar role played by a few specific neurons in promoting/arresting the population activity. For this purpose, we consider a standard neuronal network model, with short-term synaptic plasticity, whose population activity is characterized by bursting behavior. The addition of developmentally inspired constraints and correlations in the distribution of the neuronal connectivities and excitabilities leads to the emergence of functional hub neurons, whose stimulation/deletion is critical for the network activity. Functional hubs form a clique, where a precise sequential activation of the neurons is essential to ignite collective events without any need for a specific topological architecture. Unsupervised time-lagged firings of supra-threshold cells, in connection with coordinated entrainments of near-threshold neurons, are the key ingredients to orchestrate population activity.

To which extent a single neuron can influence brain circuits/networks dynamics? Why only a few neurons display such a strong power? These open questions are inspired by recent experimental observations in developing and adult neuronal circuits, as well as by classical debates within the framework of the single neuron doctrine. In this work we identify and present a mechanism which can explain in neuronal circuits, at some early stage of their development, how and why only a few specific neurons can exhibit such power. For this purpose, we consider a standard neuronal network model whose population activity is characterized by bursting behavior. The introduction of a distribution of correlated neuronal excitabilities and degrees, inspired by the simultaneous presence of younger and older neurons in the network, leads to the emergence of functional hub neurons. These critical cells, whenever perturbed, are capable of suppressing network synchronization. Notably, we show that their strong influence on the population dynamics is not related to their structural properties, but to their operational and structural integration into a clique. These results highlight how network-wide effects can be induced by single neurons without any need for a specific topological architecture.