Structure of spontaneous UP and DOWN transitions self-organizing in a cortical network model

Computational models of Idling brain activity for memory processing

Studying the underlying neural mechanisms of cognitive functions of the brain is one of the central questions in modern biology. Moreover, it has significantly impacted the development of novel technologies in artificial intelligence. Spontaneous activity is a unique feature of the brain and is currently lacking in many artificially constructed intelligent machines. Spontaneous activity may represent the brain's idling states, which are internally driven by neuronal networks and possibly participate in offline processing during awake, sleep, and resting states. Evidence is accumulating that the brain's spontaneous activity is not mere noise but part of the mechanisms to process information about previous experiences. A bunch of literature has shown how previous sensory and behavioral experiences influence the subsequent patterns of brain activity with various methods in various animals. It seems, however, that the patterns of neural activity and their computational roles differ significantly from area to area and from function to function. In this article, I review the various forms of the brain's spontaneous activity, especially those observed during memory processing, and some attempts to model the generation mechanisms and computational roles of such activities.

Transient and Persistent UP States during Slow-wave Oscillation and their Implications for Cell-Assembly Dynamics

The membrane potentials of cortical neurons in vivo exhibit spontaneous fluctuations between a depolarized UP state and a resting DOWN state during the slow-wave sleeps or in the resting states. This oscillatory activity is believed to engage in memory consolidation although the underlying mechanisms remain unknown. Recently, it has been shown that UP-DOWN state transitions exhibit significantly different temporal profiles in different cortical regions, presumably reflecting differences in the underlying network structure. Here, we studied in computational models whether and how the connection configurations of cortical circuits determine the macroscopic network behavior during the slow-wave oscillation. Inspired by cortical neurobiology, we modeled three types of synaptic weight distributions, namely, log-normal, sparse log-normal and sparse Gaussian. Both analytic and numerical results suggest that a larger variance of weight distribution results in a larger chance of having significantly prolonged UP states. However, the different weight distributions only produce similar macroscopic behavior. We further confirmed that prolonged UP states enrich the variety of cell assemblies activated during these states. Our results suggest the role of persistent UP states for the prolonged repetition of a selected set of cell assemblies during memory consolidation.

Cortical response states for enhanced sensory discrimination

Brain activity during wakefulness is characterized by rapid fluctuations in neuronal responses. Whether these fluctuations play any role in modulating the accuracy of behavioral responses is poorly understood. Here, we investigated whether and how trial changes in the population response impact sensory coding in monkey V1 and perceptual performance. Although the responses of individual neurons varied widely across trials, many cells tended to covary with the local population. When population activity was in a ‘low’ state, neurons had lower evoked responses and correlated variability, yet higher probability to predict perceptual accuracy. The impact of firing rate fluctuations on network and perceptual accuracy was strongest 200 ms before stimulus presentation, and it greatly diminished when the number of cells used to measure the state of the population was decreased. These findings indicate that enhanced perceptual discrimination occurs when population activity is in a ‘silent’ response mode in which neurons increase information extraction.

Sensory coding accuracy and perceptual performance are improved during the desynchronized cortical state

Cortical activity changes continuously during the course of the day. At a global scale, population activity varies between the ‘synchronized’ state during sleep and ‘desynchronized’ state during waking. However, whether local fluctuations in population synchrony during wakefulness modulate the accuracy of sensory encoding and behavioral performance is poorly understood. Here, we show that populations of cells in monkey visual cortex exhibit rapid fluctuations in synchrony ranging from desynchronized responses, indicative of high alertness, to highly synchronized responses. These fluctuations are local and control the trial variability in population coding accuracy and behavioral performance in a discrimination task. When local population activity is desynchronized, the correlated variability between neurons is reduced, and network and behavioral performance are enhanced. These findings demonstrate that the structure of variability in local cortical populations is not noise but rather controls how sensory information is optimally integrated with ongoing processes to guide network coding and behavior.

Changes in synchrony of cortical populations are observed across the sleep-wake cycle, however the effect of fluctuations in synchrony during wakefulness is not understood. Here the authors show that visual cortical neurons have improved sensory encoding accuracy as well as improved perceptual performance during periods of local population desynchrony.

Synaptic Mechanisms of Memory Consolidation during Sleep Slow Oscillations

Sleep is critical for regulation of synaptic efficacy, memories, and learning. However, the underlying mechanisms of how sleep rhythms contribute to consolidating memories acquired during wakefulness remain unclear. Here we studied the role of slow oscillations, 0.2-1 Hz rhythmic transitions between Up and Down states during stage 3/4 sleep, on dynamics of synaptic connectivity in the thalamocortical network model implementing spike-timing-dependent synaptic plasticity. We found that the spatiotemporal pattern of Up-state propagation determines the changes of synaptic strengths between neurons. Furthermore, an external input, mimicking hippocampal ripples, delivered to the cortical network results in input-specific changes of synaptic weights, which persisted after stimulation was removed. These synaptic changes promoted replay of specific firing sequences of the cortical neurons. Our study proposes a neuronal mechanism on how an interaction between hippocampal input, such as mediated by sharp wave-ripple events, cortical slow oscillations, and synaptic plasticity, may lead to consolidation of memories through preferential replay of cortical cell spike sequences during slow-wave sleep.

SIGNIFICANCE STATEMENT

Sleep is critical for memory and learning. Replay during sleep of temporally ordered spike sequences related to a recent experience was proposed to be a neuronal substrate of memory consolidation. However, specific mechanisms of replay or how spike sequence replay leads to synaptic changes that underlie memory consolidation are still poorly understood. Here we used a detailed computational model of the thalamocortical system to report that interaction between slow cortical oscillations and synaptic plasticity during deep sleep can underlie mapping hippocampal memory traces to persistent cortical representation. This study provided, for the first time, a mechanistic explanation of how slow-wave sleep may promote consolidation of recent memory events.

Excitatory and inhibitory STDP jointly tune feedforward neural circuits to selectively propagate correlated spiking activity

Spike-timing-dependent plasticity (STDP) has been well established between excitatory neurons and several computational functions have been proposed in various neural systems. Despite some recent efforts, however, there is a significant lack of functional understanding of inhibitory STDP (iSTDP) and its interplay with excitatory STDP (eSTDP). Here, we demonstrate by analytical and numerical methods that iSTDP contributes crucially to the balance of excitatory and inhibitory weights for the selection of a specific signaling pathway among other pathways in a feedforward circuit. This pathway selection is based on the high sensitivity of STDP to correlations in spike times, which complements a recent proposal for the role of iSTDP in firing-rate based selection. Our model predicts that asymmetric anti-Hebbian iSTDP exceeds asymmetric Hebbian iSTDP for supporting pathway-specific balance, which we show is useful for propagating transient neuronal responses. Furthermore, we demonstrate how STDPs at excitatory-excitatory, excitatory-inhibitory, and inhibitory-excitatory synapses cooperate to improve the pathway selection. We propose that iSTDP is crucial for shaping the network structure that achieves efficient processing of synchronous spikes.

Stable learning in stochastic network states

The mammalian cerebral cortex is characterized in vivo by irregular spontaneous activity, but how this ongoing dynamics affects signal processing and learning remains unknown. The associative plasticity rules demonstrated in vitro, mostly in silent networks, are based on the detection of correlations between presynaptic and postsynaptic activity and hence are sensitive to spontaneous activity and spurious correlations. Therefore, they cannot operate in realistic network states. Here, we present a new class of spike-timing-dependent plasticity learning rules with local floating plasticity thresholds, the slow dynamics of which account for metaplasticity. This novel algorithm is shown to both correctly predict homeostasis in synaptic weights and solve the problem of asymptotic stable learning in noisy states. It is shown to naturally encompass many other known types of learning rule, unifying them into a single coherent framework. The mixed presynaptic and postsynaptic dependency of the floating plasticity threshold is justified by a cascade of known molecular pathways, which leads to experimentally testable predictions.

Stability versus neuronal specialization for STDP: long-tail weight distributions solve the dilemma

Spike-timing-dependent plasticity (STDP) modifies the weight (or strength) of synaptic connections between neurons and is considered to be crucial for generating network structure. It has been observed in physiology that, in addition to spike timing, the weight update also depends on the current value of the weight. The functional implications of this feature are still largely unclear. Additive STDP gives rise to strong competition among synapses, but due to the absence of weight dependence, it requires hard boundaries to secure the stability of weight dynamics. Multiplicative STDP with linear weight dependence for depression ensures stability, but it lacks sufficiently strong competition required to obtain a clear synaptic specialization. A solution to this stability-versus-function dilemma can be found with an intermediate parametrization between additive and multiplicative STDP. Here we propose a novel solution to the dilemma, named log-STDP, whose key feature is a sublinear weight dependence for depression. Due to its specific weight dependence, this new model can produce significantly broad weight distributions with no hard upper bound, similar to those recently observed in experiments. Log-STDP induces graded competition between synapses, such that synapses receiving stronger input correlations are pushed further in the tail of (very) large weights. Strong weights are functionally important to enhance the neuronal response to synchronous spike volleys. Depending on the input configuration, multiple groups of correlated synaptic inputs exhibit either winner-share-all or winner-take-all behavior. When the configuration of input correlations changes, individual synapses quickly and robustly readapt to represent the new configuration. We also demonstrate the advantages of log-STDP for generating a stable structure of strong weights in a recurrently connected network. These properties of log-STDP are compared with those of previous models. Through long-tail weight distributions, log-STDP achieves both stable dynamics for and robust competition of synapses, which are crucial for spike-based information processing.

Stereotypical spatiotemporal activity patterns during slow-wave activity in the neocortex

Alternating epochs of activity and silence are a characteristic feature of neocortical networks during certain sleep cycles and deep states of anesthesia. The mechanism and functional role of these slow oscillations (<1 Hz) have not yet been fully characterized. Experimental and theoretical studies show that slow-wave oscillations can be generated autonomously by neocortical tissue but become more regular through a thalamo-cortical feedback loop. Evidence for a functional role of slow-wave activity comes from EEG recordings in humans during sleep, which show that activity travels as stereotypical waves over the entire brain, thought to play a role in memory consolidation. We used an animal model to investigate activity wave propagation on a smaller scale, namely within the rat somatosensory cortex. Signals from multiple extracellular microelectrodes in combination with one intracellular recording in the anesthetized animal in vivo were utilized to monitor the spreading of activity. We found that activity propagation in most animals showed a clear preferred direction, suggesting that it often originated from a similar location in the cortex. In addition, the breakdown of active states followed a similar pattern with slightly weaker direction preference but a clear correlation to the direction of activity spreading, supporting the notion of a wave-like phenomenon similar to that observed after strong sensory stimulation in sensory areas. Taken together, our findings support the idea that activity waves during slow-wave sleep do not occur spontaneously at random locations within the network, as was suggested previously, but follow preferred synaptic pathways on a small spatial scale.

Irregular dynamics in up and down cortical states

Complex coherent dynamics is present in a wide variety of neural systems. A typical example is the voltage transitions between up and down states observed in cortical areas in the brain. In this work, we study this phenomenon via a biologically motivated stochastic model of up and down transitions. The model is constituted by a simple bistable rate dynamics, where the synaptic current is modulated by short-term synaptic processes which introduce stochasticity and temporal correlations. A complete analysis of our model, both with mean-field approaches and numerical simulations, shows the appearance of complex transitions between high (up) and low (down) neural activity states, driven by the synaptic noise, with permanence times in the up state distributed according to a power-law. We show that the experimentally observed large fluctuation in up and down permanence times can be explained as the result of sufficiently noisy dynamical synapses with sufficiently large recovery times. Static synapses cannot account for this behavior, nor can dynamical synapses in the absence of noise.

Sequential Reinstatement of Neocortical Activity during Slow Oscillations Depends on Cells' Global Activity

During Slow Wave Sleep (SWS), cortical activity is dominated by endogenous processes modulated by slow oscillations (0.1–1 Hz): cell ensembles fluctuate between states of sustained activity (UP states) and silent epochs (DOWN states). We investigate here the temporal structure of ensemble activity during UP states by means of multiple single unit recordings in the prefrontal cortex of naturally sleeping rats. As previously shown, the firing rate of each PFC cell peaks at a distinct time lag after the DOWN/UP transition in a consistent order. We show here that, conversely, the latency of the first spike after the UP state onset depends primarily on the session-averaged firing rates of cells (which can be considered as an indirect measure of their intrinsic excitability). This latency can be explained by a simple homogeneous process (Poisson model) of cell firing, with sleep averaged firing rates employed as parameters. Thus, at DOWN/UP transitions, neurons are affected both by a slow process, possibly originating in the cortical network, modulating the time course of firing for each cell, and by a fast, relatively stereotyped reinstatement of activity, related mostly to global activity levels.

Spike timing-dependent plasticity is affected by the interplay of intrinsic and network oscillations

Spike timing-dependent plasticity (STDP) is a form of Hebbian learning which is thought to underlie structure formation during development, and learning and memory in later life. In this paper we show that the intrinsic properties of the postsynaptic neuron might have a deep influence on STDP dynamics by shaping the causal correlation between the pre- and the postsynaptic spike trains. The cell-specific effect of STDP is particularly evident in the presence of an oscillatory component in a cell input. In this case, the cell-specific phase response to an oscillatory modulation biases the oscillating afferents towards potentiation or depression, depending upon the intrinsic dynamics of the postsynaptic neuron and the period of the modulation.

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity--strengthening correlated input pathways

Spike-timing-dependent plasticity (STDP) determines the evolution of the synaptic weights according to their pre- and post-synaptic activity, which in turn changes the neuronal activity. In this paper, we extend previous studies of input selectivity induced by (STDP) for single neurons to the biologically interesting case of a neuronal network with fixed recurrent connections and plastic connections from external pools of input neurons. We use a theoretical framework based on the Poisson neuron model to analytically describe the network dynamics (firing rates and spike-time correlations) and thus the evolution of the synaptic weights. This framework incorporates the time course of the post-synaptic potentials and synaptic delays. Our analysis focuses on the asymptotic states of a network stimulated by two homogeneous pools of "steady" inputs, namely Poisson spike trains which have fixed firing rates and spike-time correlations. The (STDP) model extends rate-based learning in that it can implement, at the same time, both a stabilization of the individual neuron firing rates and a slower weight specialization depending on the input spike-time correlations. When one input pathway has stronger within-pool correlations, the resulting synaptic dynamics induced by (STDP) are shown to be similar to those arising in the case of a purely feed-forward network: the weights from the more correlated inputs are potentiated at the expense of the remaining input connections.

Discrete- and continuous-time probabilistic models and algorithms for inferring neuronal UP and DOWN states

UP and DOWN states, the periodic fluctuations between increased and decreased spiking activity of a neuronal population, are a fundamental feature of cortical circuits. Understanding UP-DOWN state dynamics is important for understanding how these circuits represent and transmit information in the brain. To date, limited work has been done on characterizing the stochastic properties of UP-DOWN state dynamics. We present a set of Markov and semi-Markov discrete- and continuous-time probability models for estimating UP and DOWN states from multiunit neural spiking activity. We model multiunit neural spiking activity as a stochastic point process, modulated by the hidden (UP and DOWN) states and the ensemble spiking history. We estimate jointly the hidden states and the model parameters by maximum likelihood using an expectation-maximization (EM) algorithm and a Monte Carlo EM algorithm that uses reversible-jump Markov chain Monte Carlo sampling in the E-step. We apply our models and algorithms in the analysis of both simulated multiunit spiking activity and actual multi- unit spiking activity recorded from primary somatosensory cortex in a behaving rat during slow-wave sleep. Our approach provides a statistical characterization of UP-DOWN state dynamics that can serve as a basis for verifying and refining mechanistic descriptions of this process.

Spontaneous events outline the realm of possible sensory responses in neocortical populations

Neocortical assemblies produce complex activity patterns both in response to sensory stimuli and spontaneously without sensory input. To investigate the structure of these patterns, we recorded from populations of 40-100 neurons in auditory and somatosensory cortices of anesthetized and awake rats using silicon microelectrodes. Population spike time patterns were broadly conserved across multiple sensory stimuli and spontaneous events. Although individual neurons showed timing variations between stimuli, these were not sufficient to disturb a generally conserved sequential organization observed at the population level, lasting for approximately 100 ms with spiking reliability decaying progressively after event onset. Preserved constraints were also seen in population firing rate vectors, with vectors evoked by individual stimuli occupying subspaces of a larger but still constrained space outlined by the set of spontaneous events. These results suggest that population spike patterns are drawn from a limited "vocabulary," sampled widely by spontaneous events but more narrowly by sensory responses.

Double Trouble? Potential for Hyperexcitability Following Both Channelopathic up- and Downregulation of I(h) in Epilepsy

Studies of pathological ion channel regulation as an underlying mechanism of epilepsy have revealed alterations in the h-current in several animal models. While earlier reports indicate that downregulation of the h-current is pro-excitatory on the single neuron level, we found an upregulation of I(h) in hyperexcitable CA1 pyramidal neuron dendrites following experimental febrile seizures. In addition, in several CA1 pyramidal neuron computational models of different complexity, h-current upregulation has been shown to lead to pro-excitable effects. This focused review examines the complex impact of altered h-current on neuronal resting membrane potential (RMP) and input resistance (R(in)), as well as reported interactions with other ionic conductances.

Statistical significance of precisely repeated intracellular synaptic patterns

Can neuronal networks produce patterns of activity with millisecond accuracy? It may seem unlikely, considering the probabilistic nature of synaptic transmission. However, some theories of brain function predict that such precision is feasible and can emerge from the non-linearity of the action potential generation in circuits of connected neurons. Several studies have presented evidence for and against this hypothesis. Our earlier work supported the precision hypothesis, based on results demonstrating that precise patterns of synaptic inputs could be found in intracellular recordings from neurons in brain slices and in vivo. To test this hypothesis, we devised a method for finding precise repeats of activity and compared repeats found in the data to those found in surrogate datasets made by shuffling the original data. Because more repeats were found in the original data than in the surrogate data sets, we argued that repeats were not due to chance occurrence. Mokeichev et al. (2007) challenged these conclusions, arguing that the generation of surrogate data was insufficiently rigorous. We have now reanalyzed our previous data with the methods introduced from Mokeichev et al. (2007). Our reanalysis reveals that repeats are statistically significant, thus supporting our earlier conclusions, while also supporting many conclusions that Mokeichev et al. (2007) drew from their recent in vivo recordings. Moreover, we also show that the conditions under which the membrane potential is recorded contributes significantly to the ability to detect repeats and may explain conflicting results. In conclusion, our reevaluation resolves the methodological contradictions between Ikegaya et al. (2004) and Mokeichev et al. (2007), but demonstrates the validity of our previous conclusion that spontaneous network activity is non-randomly organized.

Emergence of functional hierarchy in a multiple timescale neural network model: a humanoid robot experiment

It is generally thought that skilled behavior in human beings results from a functional hierarchy of the motor control system, within which reusable motor primitives are flexibly integrated into various sensori-motor sequence patterns. The underlying neural mechanisms governing the way in which continuous sensori-motor flows are segmented into primitives and the way in which series of primitives are integrated into various behavior sequences have, however, not yet been clarified. In earlier studies, this functional hierarchy has been realized through the use of explicit hierarchical structure, with local modules representing motor primitives in the lower level and a higher module representing sequences of primitives switched via additional mechanisms such as gate-selecting. When sequences contain similarities and overlap, however, a conflict arises in such earlier models between generalization and segmentation, induced by this separated modular structure. To address this issue, we propose a different type of neural network model. The current model neither makes use of separate local modules to represent primitives nor introduces explicit hierarchical structure. Rather than forcing architectural hierarchy onto the system, functional hierarchy emerges through a form of self-organization that is based on two distinct types of neurons, each with different time properties ("multiple timescales"). Through the introduction of multiple timescales, continuous sequences of behavior are segmented into reusable primitives, and the primitives, in turn, are flexibly integrated into novel sequences. In experiments, the proposed network model, coordinating the physical body of a humanoid robot through high-dimensional sensori-motor control, also successfully situated itself within a physical environment. Our results suggest that it is not only the spatial connections between neurons but also the timescales of neural activity that act as important mechanisms leading to functional hierarchy in neural systems.