A novel learning rule for long-term plasticity of short-term synaptic plasticity enhances temporal processing

Differential Short-Term Plasticity of PV and SST Neurons Accounts for Adaptation and Facilitation of Cortical Neurons to Auditory Tones

Cortical responses to sensory stimuli are strongly modulated by temporal context. One of the best studied examples of such modulation is sensory adaptation. We first show that in response to repeated tones pyramidal (Pyr) neurons in male mouse auditory cortex (A1) exhibit facilitating and stable responses, in addition to adapting responses. To examine the potential mechanisms underlying these distinct temporal profiles, we developed a reduced spiking model of sensory cortical circuits that incorporated the signature short-term synaptic plasticity (STP) profiles of the inhibitory parvalbumin (PV) and somatostatin (SST) interneurons. The model accounted for all three temporal response profiles as the result of dynamic changes in excitatory/inhibitory balance produced by STP, primarily through shifts in the relative latency of Pyr and inhibitory neurons. Transition between the three response profiles was possible by changing the strength of the inhibitory PV→Pyr and SST→Pyr synapses. The model predicted that a unit's latency would be related to its temporal profile. Consistent with this prediction, the latency of stable units was significantly shorter than that of adapting and facilitating units. Furthermore, because of the history-dependence of STP the model generated a paradoxical prediction: that inactivation of inhibitory neurons during one tone would decrease the response of A1 neurons to a subsequent tone. Indeed, we observed that optogenetic inactivation of PV neurons during one tone counterintuitively decreased the spiking of Pyr neurons to a subsequent tone 400 ms later. These results provide evidence that STP is critical to temporal context-dependent responses in the sensory cortex.SIGNIFICANCE STATEMENT Our perception of speech and music depends strongly on temporal context, i.e., the significance of a stimulus depends on the preceding stimuli. Complementary neural mechanisms are needed to sometimes ignore repetitive stimuli (e.g., the tic of a clock) or detect meaningful repetition (e.g., consecutive tones in Morse code). We modeled a neural circuit that accounts for diverse experimentally-observed response profiles in auditory cortex (A1) neurons, based on known forms of short-term synaptic plasticity (STP). Whether the simulated circuit reduced, maintained, or enhanced its response to repeated tones depended on the relative dominance of two different types of inhibitory cells. The model made novel predictions that were experimentally validated. Results define an important role for STP in temporal context-dependent perception.

A New Approach to the Fabrication of Memristive Neuromorphic Devices: Compositionally Graded Films

Energy-efficient computing paradigms beyond conventional von-Neumann architecture, such as neuromorphic computing, require novel devices that enable information storage at nanoscale in an analogue way and in-memory computing. Memristive devices with long-/short-term synaptic plasticity are expected to provide a more capable neuromorphic system compared to traditional Si-based complementary metal-oxide-semiconductor circuits. Here, compositionally graded oxide films of Al-doped Mg_xZn_1−xO (g-Al:MgZnO) are studied to fabricate a memristive device, in which the composition of the film changes continuously through the film thickness. Compositional grading in the films should give rise to asymmetry of Schottky barrier heights at the film-electrode interfaces. The g-Al:MgZnO films are grown by using aerosol-assisted chemical vapor deposition. The current-voltage (I-V) and capacitance-voltage (C-V) characteristics of the films show self-rectifying memristive behaviors which are dependent on maximum applied voltage and repeated application of electrical pulses. Endurance and retention performance tests of the device show stable bipolar resistance switching (BRS) with a short-term memory effect. The short-term memory effects are ascribed to the thermally activated release of the trapped electrons near/at the g-Al:MgZnO film-electrode interface of the device. The volatile resistive switching can be used as a potential selector device in a crossbar memory array and a short-term synapse in neuromorphic computing.

Discrimination of Motion Direction in a Robot Using a Phenomenological Model of Synaptic Plasticity

Recognizing and tracking the direction of moving stimuli is crucial to the control of much animal behaviour. In this study, we examine whether a bio-inspired model of synaptic plasticity implemented in a robotic agent may allow the discrimination of motion direction of real-world stimuli. Starting with a well-established model of short-term synaptic plasticity (STP), we develop a microcircuit motif of spiking neurons capable of exhibiting preferential and nonpreferential responses to changes in the direction of an orientation stimulus in motion. While the robotic agent processes sensory inputs, the STP mechanism introduces direction-dependent changes in the synaptic connections of the microcircuit, resulting in a population of units that exhibit a typical cortical response property observed in primary visual cortex (V1), namely, direction selectivity. Visually evoked responses from the model are then compared to those observed in multielectrode recordings from V1 in anesthetized macaque monkeys, while sinusoidal gratings are displayed on a screen. Overall, the model highlights the role of STP as a complementary mechanism in explaining the direction selectivity and applies these insights in a physical robot as a method for validating important response characteristics observed in experimental data from V1, namely, direction selectivity.

Short-Term Synaptic Plasticity as a Mechanism for Sensory Timing

The ability to detect time intervals and temporal patterns is critical to some of the most fundamental computations the brain performs, including the ability to communicate and appraise a dynamically changing environment. Many of these computations take place on the scale of tens to hundreds of milliseconds. Electrophysiological evidence shows that some neurons respond selectively to duration, interval, rate, or order. Because the time constants of many time-varying neural and synaptic properties, including short-term synaptic plasticity (STP), are also in the range of tens to hundreds of milliseconds, they are strong candidates to underlie the formation of temporally selective neurons. Neurophysiological studies indicate that STP is indeed one of the mechanisms that contributes to temporal selectivity, and computational models demonstrate that neurons embedded in local microcircuits exhibit temporal selectivity if their synapses undergo STP. Converging evidence suggests that some forms of temporal selectivity emerge from the dynamic changes in the balance of excitation and inhibition imposed by STP.

Synaptic Transmission Optimization Predicts Expression Loci of Long-Term Plasticity

Long-term modifications of neuronal connections are critical for reliable memory storage in the brain. However, their locus of expression-pre- or postsynaptic-is highly variable. Here we introduce a theoretical framework in which long-term plasticity performs an optimization of the postsynaptic response statistics toward a given mean with minimal variance. Consequently, the state of the synapse at the time of plasticity induction determines the ratio of pre- and postsynaptic modifications. Our theory explains the experimentally observed expression loci of the hippocampal and neocortical synaptic potentiation studies we examined. Moreover, the theory predicts presynaptic expression of long-term depression, consistent with experimental observations. At inhibitory synapses, the theory suggests a statistically efficient excitatory-inhibitory balance in which changes in inhibitory postsynaptic response statistics specifically target the mean excitation. Our results provide a unifying theory for understanding the expression mechanisms and functions of long-term synaptic transmission plasticity.

Degeneracy in the regulation of short-term plasticity and synaptic filtering by presynaptic mechanisms

KEY POINTS

We develop a new biophysically rooted, physiologically constrained conductance-based synaptic model to mechanistically account for short-term facilitation and depression, respectively through residual calcium and transmitter depletion kinetics. We address the specific question of how presynaptic components (including voltage-gated ion channels, pumps, buffers and release-handling mechanisms) and interactions among them define synaptic filtering and short-term plasticity profiles. Employing global sensitivity analyses (GSAs), we show that near-identical synaptic filters and short-term plasticity profiles could emerge from disparate presynaptic parametric combinations with weak pairwise correlations. Using virtual knockout models, a technique to address the question of channel-specific contributions within the GSA framework, we unveil the differential and variable impact of each ion channel on synaptic physiology. Our conclusions strengthen the argument that parametric and interactional complexity in biological systems should not be viewed from the limited curse-of-dimensionality standpoint, but from the evolutionarily advantageous perspective of providing functional robustness through degeneracy.

ABSTRACT

Information processing in neurons is known to emerge as a gestalt of pre- and post-synaptic filtering. However, the impact of presynaptic mechanisms on synaptic filters has not been quantitatively assessed. Here, we developed a biophysically rooted, conductance-based model synapse that was endowed with six different voltage-gated ion channels, calcium pumps, calcium buffer and neurotransmitter-replenishment mechanisms in the presynaptic terminal. We tuned our model to match the short-term plasticity profile and band-pass structure of Schaffer collateral synapses, and performed sensitivity analyses to demonstrate that presynaptic voltage-gated ion channels regulated synaptic filters through changes in excitability and associated calcium influx. These sensitivity analyses also revealed that calcium- and release-control mechanisms were effective regulators of synaptic filters, but accomplished this without changes in terminal excitability or calcium influx. Next, to perform global sensitivity analysis, we generated 7000 randomized models spanning 15 presynaptic parameters, and computed eight different physiological measurements in each of these models. We validated these models by applying experimentally obtained bounds on their measurements, and found 104 (∼1.5%) models to match the validation criteria for all eight measurements. Analysing these valid models, we demonstrate that analogous synaptic filters emerge from disparate combinations of presynaptic parameters exhibiting weak pairwise correlations. Finally, using virtual knockout models, we establish the variable and differential impact of different presynaptic channels on synaptic filters, underlining the critical importance of interactions among different presynaptic components in defining synaptic physiology. Our results have significant implications for protein-localization strategies required for physiological robustness and for degeneracy in long-term synaptic plasticity profiles.

Does the Cerebral Cortex Exploit High-Dimensional, Non-linear Dynamics for Information Processing?

The discovery of stimulus induced synchronization in the visual cortex suggested the possibility that the relations among low-level stimulus features are encoded by the temporal relationship between neuronal discharges. In this framework, temporal coherence is considered a signature of perceptual grouping. This insight triggered a large number of experimental studies which sought to investigate the relationship between temporal coordination and cognitive functions. While some core predictions derived from the initial hypothesis were confirmed, these studies, also revealed a rich dynamical landscape beyond simple coherence whose role in signal processing is still poorly understood. In this paper, a framework is presented which establishes links between the various manifestations of cortical dynamics by assigning specific coding functions to low-dimensional dynamic features such as synchronized oscillations and phase shifts on the one hand and high-dimensional non-linear, non-stationary dynamics on the other. The data serving as basis for this synthetic approach have been obtained with chronic multisite recordings from the visual cortex of anesthetized cats and from monkeys trained to solve cognitive tasks. It is proposed that the low-dimensional dynamics characterized by synchronized oscillations and large-scale correlations are substates that represent the results of computations performed in the high-dimensional state-space provided by recurrently coupled networks.

Presynaptic Adenosine Receptor-Mediated Regulation of Diverse Thalamocortical Short-Term Plasticity in the Mouse Whisker Pathway

Short-term synaptic plasticity (STP) sets the sensitivity of a synapse to incoming activity and determines the temporal patterns that it best transmits. In “driver” thalamocortical (TC) synaptic populations, STP is dominated by depression during stimulation from rest. However, during ongoing stimulation, lemniscal TC connections onto layer 4 neurons in mouse barrel cortex express variable STP. Each synapse responds to input trains with a distinct pattern of depression or facilitation around its mean steady-state response. As a result, in common with other synaptic populations, lemniscal TC synapses express diverse rather than uniform dynamics, allowing for a rich representation of temporally varying stimuli. Here, we show that this STP diversity is regulated presynaptically. Presynaptic adenosine receptors of the A1R type, but not kainate receptors (KARs), modulate STP behavior. Blocking the receptors does not eliminate diversity, indicating that diversity is related to heterogeneous expression of multiple mechanisms in the pathway from presynaptic calcium influx to neurotransmitter release.

Emulating short-term synaptic dynamics with memristive devices

Neuromorphic architectures offer great promise for achieving computation capacities beyond conventional Von Neumann machines. The essential elements for achieving this vision are highly scalable synaptic mimics that do not undermine biological fidelity. Here we demonstrate that single solid-state TiO₂ memristors can exhibit non-associative plasticity phenomena observed in biological synapses, supported by their metastable memory state transition properties. We show that, contrary to conventional uses of solid-state memory, the existence of rate-limiting volatility is a key feature for capturing short-term synaptic dynamics. We also show how the temporal dynamics of our prototypes can be exploited to implement spatio-temporal computation, demonstrating the memristors full potential for building biophysically realistic neural processing systems.

Unified pre- and postsynaptic long-term plasticity enables reliable and flexible learning

Although it is well known that long-term synaptic plasticity can be expressed both pre- and postsynaptically, the functional consequences of this arrangement have remained elusive. We show that spike-timing-dependent plasticity with both pre- and postsynaptic expression develops receptive fields with reduced variability and improved discriminability compared to postsynaptic plasticity alone. These long-term modifications in receptive field statistics match recent sensory perception experiments. Moreover, learning with this form of plasticity leaves a hidden postsynaptic memory trace that enables fast relearning of previously stored information, providing a cellular substrate for memory savings. Our results reveal essential roles for presynaptic plasticity that are missed when only postsynaptic expression of long-term plasticity is considered, and suggest an experience-dependent distribution of pre- and postsynaptic strength changes.

Adaptation of short-term plasticity parameters via error-driven learning may explain the correlation between activity-dependent synaptic properties, connectivity motifs and target specificity

The anatomical connectivity among neurons has been experimentally found to be largely non-random across brain areas. This means that certain connectivity motifs occur at a higher frequency than would be expected by chance. Of particular interest, short-term synaptic plasticity properties were found to colocalize with specific motifs: an over-expression of bidirectional motifs has been found in neuronal pairs where short-term facilitation dominates synaptic transmission among the neurons, whereas an over-expression of unidirectional motifs has been observed in neuronal pairs where short-term depression dominates. In previous work we found that, given a network with fixed short-term properties, the interaction between short- and long-term plasticity of synaptic transmission is sufficient for the emergence of specific motifs. Here, we introduce an error-driven learning mechanism for short-term plasticity that may explain how such observed correspondences develop from randomly initialized dynamic synapses. By allowing synapses to change their properties, neurons are able to adapt their own activity depending on an error signal. This results in more rich dynamics and also, provided that the learning mechanism is target-specific, leads to specialized groups of synapses projecting onto functionally different targets, qualitatively replicating the experimental results of Wang and collaborators.

A model of order-selectivity based on dynamic changes in the balance of excitation and inhibition produced by short-term synaptic plasticity

Determining the order of sensory events separated by a few hundred milliseconds is critical to many forms of sensory processing, including vocalization and speech discrimination. Although many experimental studies have recorded from auditory order-sensitive and order-selective neurons, the underlying mechanisms are poorly understood. Here we demonstrate that universal properties of cortical synapses-short-term synaptic plasticity of excitatory and inhibitory synapses-are well suited for the generation of order-selective neural responses. Using computational models of canonical disynaptic circuits, we show that the dynamic changes in the balance of excitation and inhibition imposed by short-term plasticity lead to the generation of order-selective responses. Parametric analyses predict that among the forms of short-term plasticity expressed at excitatory-to-excitatory, excitatory-to-inhibitory, and inhibitory-to-excitatory synapses, the single most important contributor to order-selectivity is the paired-pulse depression of inhibitory postsynaptic potentials (IPSPs). A topographic model of the auditory cortex that incorporates short-term plasticity accounts for both context-dependent suppression and enhancement in response to paired tones. Together these results provide a framework to account for an important computational problem based on ubiquitous synaptic properties that did not yet have a clearly established computational function. Additionally, these studies suggest that disynaptic circuits represent a fundamental computational unit that is capable of processing both spatial and temporal information.

Diverse thalamocortical short-term plasticity elicited by ongoing stimulation

To produce sensation, neuronal pathways must transmit and process stimulus patterns that unfold over time. This behavior is determined by short-term synaptic plasticity (STP), which shapes the temporal filtering properties of synapses in a pathway. We explored STP variability across thalamocortical (TC) synapses, measuring whole-cell responses to stimulation of TC fibers in layer 4 neurons of mouse barrel cortex in vitro. As expected, STP during stimulation from rest was dominated by depression. However, STP during ongoing stimulation was strikingly diverse across TC connections. Diversity took the form of variable tuning to the latest interstimulus interval: some connections responded weakly to shorter intervals, while other connections were facilitated. These behaviors did not cluster into categories but formed a continuum. Diverse tuning did not require disynaptic inhibition. Hence, monosynaptic excitatory lemniscal TC connections onto layer 4 do not behave uniformly during ongoing stimulation. Each connection responds differentially to particular stimulation intervals, enriching the ability of the pathway to convey complex, temporally fluctuating information.

Role of synaptic dynamics and heterogeneity in neuronal learning of temporal code

Temporal codes are believed to play important roles in neuronal representation of information. Neuronal ability to classify and learn temporal spiking patterns is thus essential for successful extraction and processing of information. Understanding neuronal learning of temporal code has been complicated, however, by the intrinsic stochasticity of synaptic transmission. Using a computational model of a learning neuron, the tempotron, we studied the effects of synaptic unreliability and short-term dynamics on the neuron's ability to learn spike timing rules. Our results suggest that such a model neuron can learn to classify spike timing patterns even with unreliable synapses, albeit with a significantly reduced success rate. We explored strategies to improve correct spike timing classification and found that firing clustered spike bursts significantly improves learning performance. Furthermore, rapid activity-dependent modulation of synaptic unreliability, implemented with realistic models of dynamic synapses, further improved classification of different burst properties and spike timing modalities. Neuronal models with only facilitating or only depressing inputs exhibited preference for specific types of spike timing rules, but a mixture of facilitating and depressing synapses permitted much improved learning of multiple rules. We tested applicability of these findings to real neurons by considering neuronal learning models with the naturally distributed input release probabilities found in excitatory hippocampal synapses. Our results suggest that spike bursts comprise several encoding modalities that can be learned effectively with stochastic dynamic synapses, and that distributed release probabilities significantly improve learning performance. Synaptic unreliability and dynamics may thus play important roles in the neuron's ability to learn spike timing rules during decoding.

Probabilistic inference of short-term synaptic plasticity in neocortical microcircuits

Short-term synaptic plasticity is highly diverse across brain area, cortical layer, cell type, and developmental stage. Since short-term plasticity (STP) strongly shapes neural dynamics, this diversity suggests a specific and essential role in neural information processing. Therefore, a correct characterization of short-term synaptic plasticity is an important step towards understanding and modeling neural systems. Phenomenological models have been developed, but they are usually fitted to experimental data using least-mean-square methods. We demonstrate that for typical synaptic dynamics such fitting may give unreliable results. As a solution, we introduce a Bayesian formulation, which yields the posterior distribution over the model parameters given the data. First, we show that common STP protocols yield broad distributions over some model parameters. Using our result we propose a experimental protocol to more accurately determine synaptic dynamics parameters. Next, we infer the model parameters using experimental data from three different neocortical excitatory connection types. This reveals connection-specific distributions, which we use to classify synaptic dynamics. Our approach to demarcate connection-specific synaptic dynamics is an important improvement on the state of the art and reveals novel features from existing data.

Chronic electrical stimulation homeostatically decreases spontaneous activity, but paradoxically increases evoked network activity

Neural dynamics generated within cortical networks play a fundamental role in brain function. However, the learning rules that allow recurrent networks to generate functional dynamic regimes, and the degree to which these regimes are themselves plastic, are not known. In this study we examined plasticity of network dynamics in cortical organotypic slices in response to chronic changes in activity. Studies have typically manipulated network activity pharmacologically; we used chronic electrical stimulation to increase activity in in vitro cortical circuits in a more physiological manner. Slices were stimulated with "implanted" electrodes for 4 days. Chronic electrical stimulation or treatment with bicuculline decreased spontaneous activity as predicted by homeostatic learning rules. Paradoxically, however, whereas bicuculline decreased evoked network activity, chronic stimulation actually increased the likelihood that evoked stimulation elicited polysynaptic activity, despite a decrease in evoked monosynaptic strength. Furthermore, there was an inverse correlation between spontaneous and evoked activity, suggesting a homeostatic tradeoff between spontaneous and evoked activity. Within-slice experiments revealed that cells close to the stimulated electrode exhibited more evoked polysynaptic activity and less spontaneous activity than cells close to a control electrode. Collectively, our results establish that chronic stimulation changes the dynamic regimes of networks. In vitro studies of homeostatic plasticity typically lack any external input, and thus neurons must rely on "spontaneous" activity to reach homeostatic "set points." However, in the presence of external input we propose that homeostatic learning rules seem to shift networks from spontaneous to evoked regimes.

Developmental shift of short-term synaptic plasticity in cortical organotypic slices

Although short-term synaptic plasticity (STP) is ubiquitous in neocortical synapses its functional role in neural computations is not well understood. Critical to elucidating the function of STP will be to understand how STP itself changes with development and experience. Previous studies have reported developmental changes in STP using acute slices. It is not clear, however, to what extent the changes in STP are a function of local ontogenetic programs or the result of the many different sensory and experience-dependent changes that accompany development in vivo. To address this question we examined the in vitro development of STP in organotypic slices cultured for up to 4 weeks. Paired recordings were performed in L5 pyramidal neurons at different stages of in vitro development. We observed a shift in STP in the form of a decrease in the paired-pulse ratio (PPR) (less depression) from the second to fourth week in vitro. This shift in STP was not accompanied by a change in initial excitatory postsynaptic potential (EPSP) amplitude. Fitting STP to a quantitative model indicated that the developmental shift is consistent with presynaptic changes. Importantly, despite the change in the PPR we did not observe changes in the time constant governing STP. Since these experiments were conducted in vitro our results indicate that the shift in STP does not depend on in vivo sensory experience. Although sensory experience may shape STP, we suggest that developmental shifts in STP are at least in part ontogenetically determined.

A history of spike-timing-dependent plasticity

How learning and memory is achieved in the brain is a central question in neuroscience. Key to today's research into information storage in the brain is the concept of synaptic plasticity, a notion that has been heavily influenced by Hebb's (1949) postulate. Hebb conjectured that repeatedly and persistently co-active cells should increase connective strength among populations of interconnected neurons as a means of storing a memory trace, also known as an engram. Hebb certainly was not the first to make such a conjecture, as we show in this history. Nevertheless, literally thousands of studies into the classical frequency-dependent paradigm of cellular learning rules were directly inspired by the Hebbian postulate. But in more recent years, a novel concept in cellular learning has emerged, where temporal order instead of frequency is emphasized. This new learning paradigm - known as spike-timing-dependent plasticity (STDP) - has rapidly gained tremendous interest, perhaps because of its combination of elegant simplicity, biological plausibility, and computational power. But what are the roots of today's STDP concept? Here, we discuss several centuries of diverse thinking, beginning with philosophers such as Aristotle, Locke, and Ribot, traversing, e.g., Lugaro's plasticità and Rosenblatt's perceptron, and culminating with the discovery of STDP. We highlight interactions between theoretical and experimental fields, showing how discoveries sometimes occurred in parallel, seemingly without much knowledge of the other field, and sometimes via concrete back-and-forth communication. We point out where the future directions may lie, which includes interneuron STDP, the functional impact of STDP, its mechanisms and its neuromodulatory regulation, and the linking of STDP to the developmental formation and continuous plasticity of neuronal networks.