The effect of STDP temporal kernel structure on the learning dynamics of single excitatory and inhibitory synapses

STDP-based associative memory formation and retrieval

Spike-timing-dependent plasticity (STDP) is a biological process in which the precise order and timing of neuronal spikes affect the degree of synaptic modification. While there has been numerous research focusing on the role of STDP in neural coding, the functional implications of STDP at the macroscopic level in the brain have not been fully explored yet. In this work, we propose a neurodynamical model based on STDP that renders storage and retrieval of a group of associative memories. We showed that the function of STDP at the macroscopic level is to form a "memory plane" in the neural state space which dynamically encodes high dimensional data. We derived the analytic relation between the input, the memory plane, and the induced macroscopic neural oscillations around the memory plane. Such plane produces a limit cycle in reaction to a similar memory cue, which can be used for retrieval of the original input.

Spontaneous dynamics of synaptic weights in stochastic models with pair-based spike-timing-dependent plasticity

We investigate spike-timing dependent plasticity (STPD) in the case of a synapse connecting two neuronal cells. We develop a theoretical analysis of several STDP rules using Markovian theory. In this context there are two different timescales, fast neuronal activity and slower synaptic weight updates. Exploiting this timescale separation, we derive the long-time limits of a single synaptic weight subject to STDP. We show that the pairing model of presynaptic and postsynaptic spikes controls the synaptic weight dynamics for small external input on an excitatory synapse. This result implies in particular that mean-field analysis of plasticity may miss some important properties of STDP. Anti-Hebbian STDP favors the emergence of a stable synaptic weight. In the case of an inhibitory synapse the pairing schemes matter less, and we observe convergence of the synaptic weight to a nonnull value only for Hebbian STDP. We extensively study different asymptotic regimes for STDP rules, raising interesting questions for future work on adaptative neuronal networks and, more generally, on adaptative systems.

STDP and the distribution of preferred phases in the whisker system

Rats and mice use their whiskers to probe the environment. By rhythmically swiping their whiskers back and forth they can detect the existence of an object, locate it, and identify its texture. Localization can be accomplished by inferring the whisker’s position. Rhythmic neurons that track the phase of the whisking cycle encode information about the azimuthal location of the whisker. These neurons are characterized by preferred phases of firing that are narrowly distributed. Consequently, pooling the rhythmic signal from several upstream neurons is expected to result in a much narrower distribution of preferred phases in the downstream population, which however has not been observed empirically. Here, we show how spike timing dependent plasticity (STDP) can provide a solution to this conundrum. We investigated the effect of STDP on the utility of a neural population to transmit rhythmic information downstream using the framework of a modeling study. We found that under a wide range of parameters, STDP facilitated the transfer of rhythmic information despite the fact that all the synaptic weights remained dynamic. As a result, the preferred phase of the downstream neuron was not fixed, but rather drifted in time at a drift velocity that depended on the preferred phase, thus inducing a distribution of preferred phases. We further analyzed how the STDP rule governs the distribution of preferred phases in the downstream population. This link between the STDP rule and the distribution of preferred phases constitutes a natural test for our theory.

The distribution of preferred phases of whisking neurons in the somatosensory system of rats and mice presents a conundrum: a simple pooling model predicts a distribution that is an order of magnitude narrower than what is observed empirically. Here, we suggest that this non-trivial distribution may result from activity-dependent plasticity in the form of spike timing dependent plasticity (STDP). We show that under STDP, the synaptic weights do not converge to a fixed value, but rather remain dynamic. As a result, the preferred phases of the whisking neurons vary in time, hence inducing a non-trivial distribution of preferred phases, which is governed by the STDP rule. Our results imply that the considerable synaptic volatility which has long been viewed as a difficulty that needs to be overcome, may actually be an underlying principle of the organization of the central nervous system.

Robust rhythmogenesis via spike-timing-dependent plasticity

Rhythmic activity has been observed in numerous animal species ranging from insects to humans, and in relation to a wide range of cognitive tasks. Various experimental and theoretical studies have investigated rhythmic activity. The theoretical efforts have mainly been focused on the neuronal dynamics, under the assumption that network connectivity satisfies certain fine-tuning conditions required to generate oscillations. However, it remains unclear how this fine-tuning is achieved. Here we investigated the hypothesis that spike-timing-dependent plasticity (STDP) can provide the underlying mechanism for tuning synaptic connectivity to generate rhythmic activity. We addressed this question in a modeling study. We examined STDP dynamics in the framework of a network of excitatory and inhibitory neuronal populations that has been suggested to underlie the generation of oscillations in the gamma range. Mean-field Fokker-Planck equations for the synaptic weight dynamics are derived in the limit of slow learning. We drew on this approximation to determine which types of STDP rules drive the system to exhibit rhythmic activity, and we demonstrate how the parameters that characterize the plasticity rule govern the rhythmic activity. Finally, we propose a mechanism that can ensure the robustness of self-developing processes in general, and for rhythmogenesis in particular.

Multiplexing rhythmic information by spike timing dependent plasticity

Rhythmic activity has been associated with a wide range of cognitive processes including the encoding of sensory information, navigation, the transfer of information and others. Rhythmic activity in the brain has also been suggested to be used for multiplexing information. Multiplexing is the ability to transmit more than one signal via the same channel. Here we focus on frequency division multiplexing, in which different signals are transmitted in different frequency bands. Recent work showed that spike-timing-dependent plasticity (STDP) can facilitate the transfer of rhythmic activity downstream the information processing pathway. However, STDP has also been known to generate strong winner-take-all like competition between subgroups of correlated synaptic inputs. This competition between different rhythmicity channels, induced by STDP, may prevent the multiplexing of information. Thus, raising doubts whether STDP is consistent with the idea of multiplexing. This study explores whether STDP can facilitate the multiplexing of information across multiple frequency channels, and if so, under what conditions. We address this question in a modelling study, investigating the STDP dynamics of two populations synapsing downstream onto the same neuron in a feed-forward manner. Each population was assumed to exhibit rhythmic activity, albeit in a different frequency band. Our theory reveals that the winner-take-all like competitions between the two populations is limited, in the sense that different rhythmic populations will not necessarily fully suppress each other. Furthermore, we found that for a wide range of parameters, the network converged to a solution in which the downstream neuron responded to both rhythms. Yet, the synaptic weights themselves did not converge to a fixed point, rather remained dynamic. These findings imply that STDP can support the multiplexing of rhythmic information, and demonstrate how functionality (multiplexing of information) can be retained in the face of continuous remodeling of all the synaptic weights. The constraints on the types of STDP rules that can support multiplexing provide a natural test for our theory.

Spike timing dependent plasticity (STDP) quantifies the change in the synaptic efficacy as a function of the temporal relationship between pre- and post-synaptic firing. STDP can be viewed as a microscopic unsupervised learning rule, and a wide range of such microscopic learning rules have been described empirically. Since there is no supervisor in unsupervised learning (which would provide with the system its goal), theoreticians have struggled with the question of the possible computational roles of the various STDP rules. Previous studies have focused on the possible contribution of STDP to the spontaneous development of spatial structure. However, the rich temporal repertoire of reported STDP rules has largely been ignored. Here we studied the contribution of STDP to the development of temporal structure. We show how STDP can shape synaptic efficacies to facilitate the transfer of rhythmic information downstream and to enable the multiplexing of information across different frequency channels. Our work emphasizes the relationship between the temporal structure of the STDP rule and the rhythmic activity it can support.

Rhythmogenesis evolves as a consequence of long-term plasticity of inhibitory synapses

Brain rhythms are widely believed to reflect numerous cognitive processes. Changes in rhythmicity have been associated with pathological states. However, the mechanism underlying these rhythms remains unknown. Here, we present a theoretical analysis of the evolvement of rhythm generating capabilities in neuronal circuits. We tested the hypothesis that brain rhythms can be acquired via an intrinsic unsupervised learning process of activity dependent plasticity. Specifically, we focused on spike timing dependent plasticity (STDP) of inhibitory synapses. We detail how rhythmicity can develop via STDP under certain conditions that serve as a natural prediction of the hypothesis. We show how global features of the STDP rule govern and stabilize the resultant rhythmic activity. Finally, we demonstrate how rhythmicity is retained even in the face of synaptic variability. This study suggests a role for inhibitory plasticity that is beyond homeostatic processes.

General differential Hebbian learning: Capturing temporal relations between events in neural networks and the brain

Learning in biologically relevant neural-network models usually relies on Hebb learning rules. The typical implementations of these rules change the synaptic strength on the basis of the co-occurrence of the neural events taking place at a certain time in the pre- and post-synaptic neurons. Differential Hebbian learning (DHL) rules, instead, are able to update the synapse by taking into account the temporal relation, captured with derivatives, between the neural events happening in the recent past. The few DHL rules proposed so far can update the synaptic weights only in few ways: this is a limitation for the study of dynamical neurons and neural-network models. Moreover, empirical evidence on brain spike-timing-dependent plasticity (STDP) shows that different neurons express a surprisingly rich repertoire of different learning processes going far beyond existing DHL rules. This opens up a second problem of how capturing such processes with DHL rules. Here we propose a general DHL (G-DHL) rule generating the existing rules and many others. The rule has a high expressiveness as it combines in different ways the pre- and post-synaptic neuron signals and derivatives. The rule flexibility is shown by applying it to various signals of artificial neurons and by fitting several different STDP experimental data sets. To these purposes, we propose techniques to pre-process the neural signals and capture the temporal relations between the neural events of interest. We also propose a procedure to automatically identify the rule components and parameters that best fit different STDP data sets, and show how the identified components might be used to heuristically guide the search of the biophysical mechanisms underlying STDP. Overall, the results show that the G-DHL rule represents a useful means to study time-sensitive learning processes in both artificial neural networks and brain.

Timing-dependent LTP and LTD in mouse primary visual cortex following different visual deprivation models

Visual deprivation during the critical period induces long-lasting changes in cortical circuitry by adaptively modifying neuro-transmission and synaptic connectivity at synapses. Spike timing-dependent plasticity (STDP) is considered a strong candidate for experience-dependent changes. However, the visual deprivation forms that affect timing-dependent long-term potentiation(LTP) and long-term depression(LTD) remain unclear. Here, we demonstrated the temporal window changes of tLTP and tLTD, elicited by coincidental pre- and post-synaptic firing, following different modes of 6-day visual deprivation. Markedly broader temporal windows were found in robust tLTP and tLTD in the V1M of the deprived visual cortex in mice after 6-day MD and DE. The underlying mechanism for the changes seen with visual deprivation in juvenile mice using 6 days of dark exposure or monocular lid suture involves an increased fraction of NR2b-containing NMDAR and the consequent prolongation of NMDAR-mediated response duration. Moreover, a decrease in NR2A protein expression at the synapse is attributable to the reduction of the NR2A/2B ratio in the deprived cortex.

Shaping Neural Circuits by High Order Synaptic Interactions

Spike timing dependent plasticity (STDP) is believed to play an important role in shaping the structure of neural circuits. Here we show that STDP generates effective interactions between synapses of different neurons, which were neglected in previous theoretical treatments, and can be described as a sum over contributions from structural motifs. These interactions can have a pivotal influence on the connectivity patterns that emerge under the influence of STDP. In particular, we consider two highly ordered forms of structure: wide synfire chains, in which groups of neurons project to each other sequentially, and self connected assemblies. We show that high order synaptic interactions can enable the formation of both structures, depending on the form of the STDP function and the time course of synaptic currents. Furthermore, within a certain regime of biophysical parameters, emergence of the ordered connectivity occurs robustly and autonomously in a stochastic network of spiking neurons, without a need to expose the neural network to structured inputs during learning.

Plasticity between neural connections plays a key role in our ability to process and store information. One of the fundamental questions on plasticity, is the extent to which local processes, affecting individual synapses, are responsible for large scale structures of neural connectivity. Here we focus on two types of structures: synfire chains and self connected assemblies. These structures are often proposed as forms of neural connectivity that can support brain functions such as memory and generation of motor activity. We show that an important plasticity mechanism, spike timing dependent plasticity, can lead to autonomous emergence of these large scale structures in the brain: in contrast to previous theoretical proposals, we show that the emergence can occur autonomously even if instructive signals are not fed into the neural network while its form is shaped by synaptic plasticity.

Oscillations via Spike-Timing Dependent Plasticity in a Feed-Forward Model

Neuronal oscillatory activity has been reported in relation to a wide range of cognitive processes including the encoding of external stimuli, attention, and learning. Although the specific role of these oscillations has yet to be determined, it is clear that neuronal oscillations are abundant in the central nervous system. This raises the question of the origin of these oscillations: are the mechanisms for generating these oscillations genetically hard-wired or can they be acquired via a learning process? Here, we study the conditions under which oscillatory activity emerges through a process of spike timing dependent plasticity (STDP) in a feed-forward architecture. First, we analyze the effect of oscillations on STDP-driven synaptic dynamics of a single synapse, and study how the parameters that characterize the STDP rule and the oscillations affect the resultant synaptic weight. Next, we analyze STDP-driven synaptic dynamics of a pre-synaptic population of neurons onto a single post-synaptic cell. The pre-synaptic neural population is assumed to be oscillating at the same frequency, albeit with different phases, such that the net activity of the pre-synaptic population is constant in time. Thus, in the homogeneous case in which all synapses are equal, the post-synaptic neuron receives constant input and hence does not oscillate. To investigate the transition to oscillatory activity, we develop a mean-field Fokker-Planck approximation of the synaptic dynamics. We analyze the conditions causing the homogeneous solution to lose its stability. The findings show that oscillatory activity appears through a mechanism of spontaneous symmetry breaking. However, in the general case the homogeneous solution is unstable, and the synaptic dynamics does not converge to a different fixed point, but rather to a limit cycle. We show how the temporal structure of the STDP rule determines the stability of the homogeneous solution and the drift velocity of the limit cycle.

Oscillatory activity in the brain has been described in relation to many cognitive states and tasks, including the encoding of external stimuli, attention, learning and consolidation of memory. However, without tuning of synaptic weights with the preferred phase of firing the oscillatory signal may not be able to propagate downstream—due to distractive interference. Here we investigate how synaptic plasticity can facilitate the transmission of oscillatory signal downstream along the information processing pathway in the brain. We show that basic synaptic plasticity rules, that have been reported empirically, are sufficient to generate the required tuning that enables the propagation of the oscillatory signal. In addition, our work presents a synaptic learning process that does not converge to a stationary state, but rather remains dynamic. We demonstrate how the functionality of the system, i.e., transmission of oscillatory activity, can be maintained in the face of constant remodeling of synaptic weights.