Oscillation-induced signal transmission and gating in neural circuits

Inter-areal transmission of multiple neural signals through frequency-division-multiplexing communication

Inter-areal information transmission in the brain cortex relates to cognitive functions. Researches used to pay attention to activity pattern transmission, signals gating, or routing in neuronal networks. However, the underlying mechanism of simultaneous transmission of multiple neural signals in the same channel across networks remains unclear. In this work, we construct a two-layer feedforward neuronal network (sender-receiver) with each layer's intrinsic rhythms consisting of slow- (low-frequency) and fast- gamma rhythms (high-frequency), investigating how to realize simultaneous transmission of multiple signals in neuronal systems. With the aid of resonance and frequency analysis, it is shown that low- and high-frequency signals can be transmitted simultaneously in such a feedforward network through frequency division multiplexing (FDM) communication. The transmission performance is related to the local resonance, connectivity, as well as background noise. Moreover, low- and high-frequency signals can also be gated or selected with appropriate adjustments of recurrent connection strength and delay, and background noise. Our model might provide a novel insight into the underlying mechanism of complex signals communication between different cortex areas.

Neurodynamical Computing at the Information Boundaries of Intelligent Systems

Artificial intelligence has not achieved defining features of biological intelligence despite models boasting more parameters than neurons in the human brain. In this perspective article, we synthesize historical approaches to understanding intelligent systems and argue that methodological and epistemic biases in these fields can be resolved by shifting away from cognitivist brain-as-computer theories and recognizing that brains exist within large, interdependent living systems. Integrating the dynamical systems view of cognition with the massive distributed feedback of perceptual control theory highlights a theoretical gap in our understanding of nonreductive neural mechanisms. Cell assemblies—properly conceived as reentrant dynamical flows and not merely as identified groups of neurons—may fill that gap by providing a minimal supraneuronal level of organization that establishes a neurodynamical base layer for computation. By considering information streams from physical embodiment and situational embedding, we discuss this computational base layer in terms of conserved oscillatory and structural properties of cortical-hippocampal networks. Our synthesis of embodied cognition, based in dynamical systems and perceptual control, aims to bypass the neurosymbolic stalemates that have arisen in artificial intelligence, cognitive science, and computational neuroscience.

Translational neuronal ensembles: Neuronal microcircuits in psychology, physiology, pharmacology and pathology

Multi-recording techniques show evidence that neurons coordinate their firing forming ensembles and that brain networks are made by connections between ensembles. While “canonical” microcircuits are composed of interconnected principal neurons and interneurons, it is not clear how they participate in recorded neuronal ensembles: “groups of neurons that show spatiotemporal co-activation”. Understanding synapses and their plasticity has become complex, making hard to consider all details to fill the gap between cellular-synaptic and circuit levels. Therefore, two assumptions became necessary: First, whatever the nature of the synapses these may be simplified by “functional connections”. Second, whatever the mechanisms to achieve synaptic potentiation or depression, the resultant synaptic weights are relatively stable. Both assumptions have experimental basis cited in this review, and tools to analyze neuronal populations are being developed based on them. Microcircuitry processing followed with multi-recording techniques show temporal sequences of neuronal ensembles resembling computational routines. These sequences can be aligned with the steps of behavioral tasks and behavior can be modified upon their manipulation, supporting the hypothesis that they are memory traces. In vitro, recordings show that these temporal sequences can be contained in isolated tissue of histological scale. Sequences found in control conditions differ from those recorded in pathological tissue obtained from animal disease models and those recorded after the actions of clinically useful drugs to treat disease states, setting the basis for new bioassays to test drugs with potential clinical use. These findings make the neuronal ensembles theoretical framework a dynamic neuroscience paradigm.

High-frequency oscillations and sequence generation in two-population models of hippocampal region CA1

Hippocampal sharp wave/ripple oscillations are a prominent pattern of collective activity, which consists of a strong overall increase of activity with superimposed (140 − 200 Hz) ripple oscillations. Despite its prominence and its experimentally demonstrated importance for memory consolidation, the mechanisms underlying its generation are to date not understood. Several models assume that recurrent networks of inhibitory cells alone can explain the generation and main characteristics of the ripple oscillations. Recent experiments, however, indicate that in addition to inhibitory basket cells, the pattern requires in vivo the activity of the local population of excitatory pyramidal cells. Here, we study a model for networks in the hippocampal region CA1 incorporating such a local excitatory population of pyramidal neurons. We start by investigating its ability to generate ripple oscillations using extensive simulations. Using biologically plausible parameters, we find that short pulses of external excitation triggering excitatory cell spiking are required for sharp/wave ripple generation with oscillation patterns similar to in vivo observations. Our model has plausible values for single neuron, synapse and connectivity parameters, random connectivity and no strong feedforward drive to the inhibitory population. Specifically, whereas temporally broad excitation can lead to high-frequency oscillations in the ripple range, sparse pyramidal cell activity is only obtained with pulse-like external CA3 excitation. Further simulations indicate that such short pulses could originate from dendritic spikes in the apical or basal dendrites of CA1 pyramidal cells, which are triggered by coincident spike arrivals from hippocampal region CA3. Finally we show that replay of sequences by pyramidal neurons and ripple oscillations can arise intrinsically in CA1 due to structured connectivity that gives rise to alternating excitatory pulse and inhibitory gap coding; the latter denotes phases of silence in specific basket cell groups, which induce selective disinhibition of groups of pyramidal neurons. This general mechanism for sequence generation leads to sparse pyramidal cell and dense basket cell spiking, does not rely on synfire chain-like feedforward excitation and may be relevant for other brain regions as well.

Vulnerability in dynamically driven oscillatory networks and power grids

Vulnerability of networks has so far been quantified mainly for structural properties. In driven systems, however, vulnerability intrinsically relies on the collective response dynamics. As shown recently, dynamic response patterns emerging in driven oscillator networks and AC power grid models are highly heterogeneous and nontrivial, depending jointly on the driving frequency, the interaction topology of the network, and the node or nodes driven. Identifying which nodes are most susceptible to dynamic driving and may thus make the system as a whole vulnerable to external input signals, however, remains a challenge. Here, we propose an easy-to-compute Dynamic Vulnerability Index (DVI) for identifying those nodes that exhibit largest amplitude responses to dynamic driving signals with given power spectra and thus are most vulnerable. The DVI is based on linear response theory, as such generic, and enables robust predictions. It thus shows potential for a wide range of applications across dynamically driven networks, for instance, for identifying the vulnerable nodes in power grids driven by fluctuating inputs from renewable energy sources and fluctuating power output to consumers.

Dissociated neuronal phase- and amplitude-coupling patterns in the human brain

Coupling of neuronal oscillations may reflect and facilitate the communication between neuronal populations. Two primary neuronal coupling modes have been described: phase-coupling and amplitude-coupling. Theoretically, both coupling modes are independent, but so far, their neuronal relationship remains unclear. Here, we combined MEG, source-reconstruction and simulations to systematically compare cortical amplitude-coupling and phase-coupling patterns in the human brain. Importantly, we took into account a critical bias of amplitude-coupling measures due to phase-coupling. We found differences between both coupling modes across a broad frequency range and most of the cortex. Furthermore, by combining empirical measurements and simulations we ruled out that these results were caused by methodological biases, but instead reflected genuine neuronal amplitude coupling. Our results show that cortical phase- and amplitude-coupling patterns are non-redundant, which may reflect at least partly distinct neuronal mechanisms. Furthermore, our findings highlight and clarify the compound nature of amplitude coupling measures.

Fluctuation-induced distributed resonances in oscillatory networks

Across physics, biology, and engineering, the collective dynamics of oscillatory networks often evolve into self-organized operating states. How such networks respond to external fluctuating signals fundamentally underlies their function, yet is not well understood. Here, we present a theory of dynamic network response patterns and reveal how distributed resonance patterns emerge in oscillatory networks once the dynamics of the oscillatory units become more than one-dimensional. The network resonances are topology specific and emerge at an intermediate frequency content of the input signals, between global yet homogeneous responses at low frequencies and localized responses at high frequencies. Our analysis reveals why these patterns arise and where in the network they are most prominent. These results may thus provide general theoretical insights into how fluctuating signals induce response patterns in networked systems and simultaneously help to develop practical guiding principles for real-world network design and control.

Analyzing the competition of gamma rhythms with delayed pulse-coupled oscillators in phase representation

Networks of neurons can generate oscillatory activity as result of various types of coupling that lead to synchronization. A prominent type of oscillatory activity is gamma (30-80 Hz) rhythms, which may play an important role in neuronal information processing. Two mechanisms have mainly been proposed for their generation: (1) interneuron network gamma (ING) and (2) pyramidal-interneuron network gamma (PING). In vitro and in vivo experiments have shown that both mechanisms can exist in the same cortical circuits. This raises the questions: How do ING and PING interact when both can in principle occur? Are the network dynamics a superposition, or do ING and PING interact in a nonlinear way and if so, how? In this article, we first generalize the phase representation for nonlinear one-dimensional pulse coupled oscillators as introduced by Mirollo and Strogatz to type II oscillators whose phase response curve (PRC) has zero crossings. We then give a full theoretical analysis for the regular gamma-like oscillations of simple networks consisting of two neural oscillators, an "E neuron" mimicking a synchronized group of pyramidal cells, and an "I neuron" representing such a group of interneurons. Motivated by experimental findings, we choose the E neuron to have a type I PRC [leaky integrate-and-fire (LIF) neuron], while the I neuron has either a type I or type II PRC (LIF or "sine" neuron). The phase representation allows us to define in a simple manner scenarios of interaction between the two neurons, which are independent of the types and the details of the neuron models. The presence of delay in the couplings leads to an increased number of scenarios relevant for gamma-like oscillatory patterns. We analytically derive the set of such scenarios and describe their occurrence in terms of parameter values such as synaptic connectivity and drive to the E and I neurons. The networks can be tuned to oscillate in an ING or PING mode. We focus particularly on the transition region where both rhythms compete to govern the network dynamics and compare with oscillations in reduced networks, which can only generate either ING or PING. Our analytically derived oscillation frequency diagrams indicate that except for small coexistence regions, the networks generate ING if the oscillation frequency of the reduced ING network exceeds that of the reduced PING network, and vice versa. For networks with the LIF I neuron, the network oscillation frequency slightly exceeds the frequencies of corresponding reduced networks, while it lies between them for networks with the sine I neuron. In networks oscillating in ING (PING) mode, the oscillation frequency responds faster to changes in the drive to the I (E) neuron than to changes in the drive to the E (I) neuron. This finding suggests a method to analyze which mechanism governs an observed network oscillation. Notably, also when the network operates in ING mode, the E neuron can spike before the I neuron such that relative spike times of the pyramidal cells and the interneurons alone are not conclusive for distinguishing ING and PING.

Effects of Calcium Spikes in the Layer 5 Pyramidal Neuron on Coincidence Detection and Activity Propagation

The role of dendritic spiking mechanisms in neural processing is so far poorly understood. To investigate the role of calcium spikes in the functional properties of the single neuron and recurrent networks, we investigated a three compartment neuron model of the layer 5 pyramidal neuron with calcium dynamics in the distal compartment. By performing single neuron simulations with noisy synaptic input and occasional large coincident input at either just the distal compartment or at both somatic and distal compartments, we show that the presence of calcium spikes confers a substantial advantage for coincidence detection in the former case and a lesser advantage in the latter. We further show that the experimentally observed critical frequency phenomenon, in which action potentials triggered by stimuli near the soma above a certain frequency trigger a calcium spike at distal dendrites, leading to further somatic depolarization, is not exhibited by a neuron receiving realistically noisy synaptic input, and so is unlikely to be a necessary component of coincidence detection. We next investigate the effect of calcium spikes in propagation of spiking activities in a feed-forward network (FFN) embedded in a balanced recurrent network. The excitatory neurons in the network are again connected to either just the distal, or both somatic and distal compartments. With purely distal connectivity, activity propagation is stable and distinguishable for a large range of recurrent synaptic strengths if the feed-forward connections are sufficiently strong, but propagation does not occur in the absence of calcium spikes. When connections are made to both the somatic and the distal compartments, activity propagation is achieved for neurons with active calcium dynamics at a much smaller number of neurons per pool, compared to a network of passive neurons, but quickly becomes unstable as the strength of recurrent synapses increases. Activity propagation at higher scaling factors can be stabilized by increasing network inhibition or introducing short term depression in the excitatory synapses, but the signal to noise ratio remains low. Our results demonstrate that the interaction of synchrony with dendritic spiking mechanisms can have profound consequences for the dynamics on the single neuron and network level.

Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains

Coherent neural spiking and local field potentials are believed to be signatures of the binding and transfer of information in the brain. Coherent activity has now been measured experimentally in many regions of mammalian cortex. Recently experimental evidence has been presented suggesting that neural information is encoded and transferred in packets, i.e., in stereotypical, correlated spiking patterns of neural activity. Due to their relevance to coherent spiking, synfire chains are one of the main theoretical constructs that have been appealed to in order to describe coherent spiking and information transfer phenomena. However, for some time, it has been known that synchronous activity in feedforward networks asymptotically either approaches an attractor with fixed waveform and amplitude, or fails to propagate. This has limited the classical synfire chain’s ability to explain graded neuronal responses. Recently, we have shown that pulse-gated synfire chains are capable of propagating graded information coded in mean population current or firing rate amplitudes. In particular, we showed that it is possible to use one synfire chain to provide gating pulses and a second, pulse-gated synfire chain to propagate graded information. We called these circuits synfire-gated synfire chains (SGSCs). Here, we present SGSCs in which graded information can rapidly cascade through a neural circuit, and show a correspondence between this type of transfer and a mean-field model in which gating pulses overlap in time. We show that SGSCs are robust in the presence of variability in population size, pulse timing and synaptic strength. Finally, we demonstrate the computational capabilities of SGSC-based information coding by implementing a self-contained, spike-based, modular neural circuit that is triggered by streaming input, processes the input, then makes a decision based on the processed information and shuts itself down.

Cognitive tasks are associated with the dynamic excitation of neural assemblies. When we consider how quickly and flexibly such collectives may be formed and incorporated in a task, a persistent question has been: how can the brain rapidly evoke and involve different neural assemblies in a computation, when synaptic coupling changes only slowly? Here, we demonstrate mechanisms whereby information may be rapidly and selectively routed through a neural circuit, and sub-circuits may be turned on and off. The resulting information processing framework achieves the goal that has been pursued, but until now largely not attained, of achieving faithful, flexible information transfer across many synapses and dynamic excitation of neural assemblies with fixed connectivities.

A Unified Dynamic Model for Learning, Replay, and Sharp-Wave/Ripples

Hippocampal activity is fundamental for episodic memory formation and consolidation. During phases of rest and sleep, it exhibits sharp-wave/ripple (SPW/R) complexes, which are short episodes of increased activity with superimposed high-frequency oscillations. Simultaneously, spike sequences reflecting previous behavior, such as traversed trajectories in space, are replayed. Whereas these phenomena are thought to be crucial for the formation and consolidation of episodic memory, their neurophysiological mechanisms are not well understood. Here we present a unified model showing how experience may be stored and thereafter replayed in association with SPW/Rs. We propose that replay and SPW/Rs are tightly interconnected as they mutually generate and support each other. The underlying mechanism is based on the nonlinear dendritic computation attributable to dendritic sodium spikes that have been prominently found in the hippocampal regions CA1 and CA3, where SPW/Rs and replay are also generated. Besides assigning SPW/Rs a crucial role for replay and thus memory processing, the proposed mechanism also explains their characteristic features, such as the oscillation frequency and the overall wave form. The results shed a new light on the dynamical aspects of hippocampal circuit learning.

SIGNIFICANCE STATEMENT

During phases of rest and sleep, the hippocampus, the "memory center" of the brain, generates intermittent patterns of strongly increased overall activity with high-frequency oscillations, the so-called sharp-wave/ripples. We investigate their role in learning and memory processing. They occur together with replay of activity sequences reflecting previous behavior. Developing a unifying computational model, we propose that both phenomena are tightly linked, by mutually generating and supporting each other. The underlying mechanism depends on nonlinear amplification of synchronous inputs that has been prominently found in the hippocampus. Besides assigning sharp-wave/ripples a crucial role for replay generation and thus memory processing, the proposed mechanism also explains their characteristic features, such as the oscillation frequency and the overall wave form.

Dynamic effective connectivity in cortically embedded systems of recurrently coupled synfire chains

As a candidate mechanism of neural representation, large numbers of synfire chains can efficiently be embedded in a balanced recurrent cortical network model. Here we study a model in which multiple synfire chains of variable strength are randomly coupled together to form a recurrent system. The system can be implemented both as a large-scale network of integrate-and-fire neurons and as a reduced model. The latter has binary-state pools as basic units but is otherwise isomorphic to the large-scale model, and provides an efficient tool for studying its behavior. Both the large-scale system and its reduced counterpart are able to sustain ongoing endogenous activity in the form of synfire waves, the proliferation of which is regulated by negative feedback caused by collateral noise. Within this equilibrium, diverse repertoires of ongoing activity are observed, including meta-stability and multiple steady states. These states arise in concert with an effective connectivity structure (ECS). The ECS admits a family of effective connectivity graphs (ECGs), parametrized by the mean global activity level. Of these graphs, the strongly connected components and their associated out-components account to a large extent for the observed steady states of the system. These results imply a notion of dynamic effective connectivity as governing neural computation with synfire chains, and related forms of cortical circuitry with complex topologies.

Neural Sequence Generation Using Spatiotemporal Patterns of Inhibition

Stereotyped sequences of neural activity are thought to underlie reproducible behaviors and cognitive processes ranging from memory recall to arm movement. One of the most prominent theoretical models of neural sequence generation is the synfire chain, in which pulses of synchronized spiking activity propagate robustly along a chain of cells connected by highly redundant feedforward excitation. But recent experimental observations in the avian song production pathway during song generation have shown excitatory activity interacting strongly with the firing patterns of inhibitory neurons, suggesting a process of sequence generation more complex than feedforward excitation. Here we propose a model of sequence generation inspired by these observations in which a pulse travels along a spatially recurrent excitatory chain, passing repeatedly through zones of local feedback inhibition. In this model, synchrony and robust timing are maintained not through redundant excitatory connections, but rather through the interaction between the pulse and the spatiotemporal pattern of inhibition that it creates as it circulates the network. These results suggest that spatially and temporally structured inhibition may play a key role in sequence generation.

Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning

Sharp wave ripples (SPW-Rs) represent the most synchronous population pattern in the mammalian brain. Their excitatory output affects a wide area of the cortex and several subcortical nuclei. SPW-Rs occur during "off-line" states of the brain, associated with consummatory behaviors and non-REM sleep, and are influenced by numerous neurotransmitters and neuromodulators. They arise from the excitatory recurrent system of the CA3 region and the SPW-induced excitation brings about a fast network oscillation (ripple) in CA1. The spike content of SPW-Rs is temporally and spatially coordinated by a consortium of interneurons to replay fragments of waking neuronal sequences in a compressed format. SPW-Rs assist in transferring this compressed hippocampal representation to distributed circuits to support memory consolidation; selective disruption of SPW-Rs interferes with memory. Recently acquired and pre-existing information are combined during SPW-R replay to influence decisions, plan actions and, potentially, allow for creative thoughts. In addition to the widely studied contribution to memory, SPW-Rs may also affect endocrine function via activation of hypothalamic circuits. Alteration of the physiological mechanisms supporting SPW-Rs leads to their pathological conversion, "p-ripples," which are a marker of epileptogenic tissue and can be observed in rodent models of schizophrenia and Alzheimer's Disease. Mechanisms for SPW-R genesis and function are discussed in this review.

A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding

Neural oscillations can enhance feature recognition (Azouz and Gray Proceedings of the National Academy of Sciences of the United States of America, 97, 8110-8115 2000), modulate interactions between neurons (Womelsdorf et al. Science, 316, 1609-01612 2007), and improve learning and memory (Markowska et al. The Journal of Neuroscience, 15, 2063-2073 1995). Numerical studies have shown that coherent spiking can give rise to windows in time during which information transfer can be enhanced in neuronal networks (Abeles Israel Journal of Medical Sciences, 18, 83-92 1982; Lisman and Idiart Science, 267, 1512-1515 1995, Salinas and Sejnowski Nature Reviews. Neuroscience, 2, 539-550 2001). Unanswered questions are: 1) What is the transfer mechanism? And 2) how well can a transfer be executed? Here, we present a pulse-based mechanism by which a graded current amplitude may be exactly propagated from one neuronal population to another. The mechanism relies on the downstream gating of mean synaptic current amplitude from one population of neurons to another via a pulse. Because transfer is pulse-based, information may be dynamically routed through a neural circuit with fixed connectivity. We demonstrate the transfer mechanism in a realistic network of spiking neurons and show that it is robust to noise in the form of pulse timing inaccuracies, random synaptic strengths and finite size effects. We also show that the mechanism is structurally robust in that it may be implemented using biologically realistic pulses. The transfer mechanism may be used as a building block for fast, complex information processing in neural circuits. We show that the mechanism naturally leads to a framework wherein neural information coding and processing can be considered as a product of linear maps under the active control of a pulse generator. Distinct control and processing components combine to form the basis for the binding, propagation, and processing of dynamically routed information within neural pathways. Using our framework, we construct example neural circuits to 1) maintain a short-term memory, 2) compute time-windowed Fourier transforms, and 3) perform spatial rotations. We postulate that such circuits, with automatic and stereotyped control and processing of information, are the neural correlates of Crick and Koch's zombie modes.

When less is more: non-monotonic spike sequence processing in neurons

Fundamental response properties of neurons centrally underly the computational capabilities of both individual nerve cells and neural networks. Most studies on neuronal input-output relations have focused on continuous-time inputs such as constant or noisy sinusoidal currents. Yet, most neurons communicate via exchanging action potentials (spikes) at discrete times. Here, we systematically analyze the stationary spiking response to regular spiking inputs and reveal that it is generically non-monotonic. Our theoretical analysis shows that the underlying mechanism relies solely on a combination of the discrete nature of the communication by spikes, the capability of locking output to input spikes and limited resources required for spike processing. Numerical simulations of mathematically idealized and biophysically detailed models, as well as neurophysiological experiments confirm and illustrate our theoretical predictions.