1
|
Wang X, Jin Y, Hao K. Computational Modeling of Structural Synaptic Plasticity in Echo State Networks. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:11254-11266. [PMID: 33760748 DOI: 10.1109/tcyb.2021.3060466] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Most existing studies on computational modeling of neural plasticity have focused on synaptic plasticity. However, regulation of the internal weights in the reservoir based on synaptic plasticity often results in unstable learning dynamics. In this article, a structural synaptic plasticity learning rule is proposed to train the weights and add or remove neurons within the reservoir, which is shown to be able to alleviate the instability of the synaptic plasticity, and to contribute to increase the memory capacity of the network as well. Our experimental results also reveal that a few stronger connections may last for a longer period of time in a constantly changing network structure, and are relatively resistant to decay or disruptions in the learning process. These results are consistent with the evidence observed in biological systems. Finally, we show that an echo state network (ESN) using the proposed structural plasticity rule outperforms an ESN using synaptic plasticity and three state-of-the-art ESNs on four benchmark tasks.
Collapse
|
2
|
Dorman DB, Blackwell KT. Synaptic Plasticity Is Predicted by Spatiotemporal Firing Rate Patterns and Robust to In Vivo-like Variability. Biomolecules 2022; 12:1402. [PMID: 36291612 PMCID: PMC9599115 DOI: 10.3390/biom12101402] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 09/13/2022] [Accepted: 09/28/2022] [Indexed: 11/22/2022] Open
Abstract
Synaptic plasticity, the experience-induced change in connections between neurons, underlies learning and memory in the brain. Most of our understanding of synaptic plasticity derives from in vitro experiments with precisely repeated stimulus patterns; however, neurons exhibit significant variability in vivo during repeated experiences. Further, the spatial pattern of synaptic inputs to the dendritic tree influences synaptic plasticity, yet is not considered in most synaptic plasticity rules. Here, we investigate how spatiotemporal synaptic input patterns produce plasticity with in vivo-like conditions using a data-driven computational model with a plasticity rule based on calcium dynamics. Using in vivo spike train recordings as inputs to different size clusters of spines, we show that plasticity is strongly robust to trial-to-trial variability of spike timing. In addition, we derive general synaptic plasticity rules describing how spatiotemporal patterns of synaptic inputs control the magnitude and direction of plasticity. Synapses that strongly potentiated have greater firing rates and calcium concentration later in the trial, whereas strongly depressing synapses have hiring firing rates early in the trial. The neighboring synaptic activity influences the direction and magnitude of synaptic plasticity, with small clusters of spines producing the greatest increase in synaptic strength. Together, our results reveal that calcium dynamics can unify diverse plasticity rules and reveal how spatiotemporal firing rate patterns control synaptic plasticity.
Collapse
Affiliation(s)
- Daniel B. Dorman
- Interdisciplinary Program in Neuroscience, George Mason University, Fairfax, VA 22030, USA
| | - Kim T. Blackwell
- Interdisciplinary Program in Neuroscience, George Mason University, Fairfax, VA 22030, USA
- Department of Bioengineering, Volgenau School of Engineering, George Mason University, Fairfax, VA 22030, USA
| |
Collapse
|
3
|
Multicoding in neural information transfer suggested by mathematical analysis of the frequency-dependent synaptic plasticity in vivo. Sci Rep 2020; 10:13974. [PMID: 32811844 PMCID: PMC7435278 DOI: 10.1038/s41598-020-70876-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2020] [Accepted: 08/04/2020] [Indexed: 11/29/2022] Open
Abstract
Two elements of neural information processing have primarily been proposed: firing rate and spike timing of neurons. In the case of synaptic plasticity, although spike-timing-dependent plasticity (STDP) depending on presynaptic and postsynaptic spike times had been considered the most common rule, recent studies have shown the inhibitory nature of the brain in vivo for precise spike timing, which is key to the STDP. Thus, the importance of the firing frequency in synaptic plasticity in vivo has been recognized again. However, little is understood about how the frequency-dependent synaptic plasticity (FDP) is regulated in vivo. Here, we focused on the presynaptic input pattern, the intracellular calcium decay time constants, and the background synaptic activity, which vary depending on neuron types and the anatomical and physiological environment in the brain. By analyzing a calcium-based model, we found that the synaptic weight differs depending on these factors characteristic in vivo, even if neurons receive the same input rate. This finding suggests the involvement of multifaceted factors other than input frequency in FDP and even neural coding in vivo.
Collapse
|
4
|
Bell M, Bartol T, Sejnowski T, Rangamani P. Dendritic spine geometry and spine apparatus organization govern the spatiotemporal dynamics of calcium. J Gen Physiol 2019; 151:1017-1034. [PMID: 31324651 PMCID: PMC6683673 DOI: 10.1085/jgp.201812261] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2018] [Revised: 05/10/2019] [Accepted: 06/17/2019] [Indexed: 01/27/2023] Open
Abstract
Dendritic spines are small subcompartments that protrude from the dendrites of neurons and are important for signaling activity and synaptic communication. These subcompartments have been characterized to have different shapes. While it is known that these shapes are associated with spine function, the specific nature of these shape-function relationships is not well understood. In this work, we systematically investigated the relationship between the shape and size of both the spine head and spine apparatus, a specialized endoplasmic reticulum compartment within the spine head, in modulating rapid calcium dynamics using mathematical modeling. We developed a spatial multicompartment reaction-diffusion model of calcium dynamics in three dimensions with various flux sources, including N-methyl-D-aspartate receptors (NMDARs), voltage-sensitive calcium channels (VSCCs), and different ion pumps on the plasma membrane. Using this model, we make several important predictions. First, the volume to surface area ratio of the spine regulates calcium dynamics. Second, membrane fluxes impact calcium dynamics temporally and spatially in a nonlinear fashion. Finally, the spine apparatus can act as a physical buffer for calcium by acting as a sink and rescaling the calcium concentration. These predictions set the stage for future experimental investigations of calcium dynamics in dendritic spines.
Collapse
Affiliation(s)
- Miriam Bell
- Department of Mechanical and Aerospace Engineering, University of California, San Diego, La Jolla, CA
| | - Tom Bartol
- Howard Hughes Medical Institute, Salk Institute for Biological Studies, La Jolla, CA
| | - Terrence Sejnowski
- Howard Hughes Medical Institute, Salk Institute for Biological Studies, La Jolla, CA
- Division of Biological Sciences, University of California, San Diego, San Diego, CA
| | - Padmini Rangamani
- Department of Mechanical and Aerospace Engineering, University of California, San Diego, La Jolla, CA
| |
Collapse
|
5
|
Foncelle A, Mendes A, Jędrzejewska-Szmek J, Valtcheva S, Berry H, Blackwell KT, Venance L. Modulation of Spike-Timing Dependent Plasticity: Towards the Inclusion of a Third Factor in Computational Models. Front Comput Neurosci 2018; 12:49. [PMID: 30018546 PMCID: PMC6037788 DOI: 10.3389/fncom.2018.00049] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2018] [Accepted: 06/06/2018] [Indexed: 11/13/2022] Open
Abstract
In spike-timing dependent plasticity (STDP) change in synaptic strength depends on the timing of pre- vs. postsynaptic spiking activity. Since STDP is in compliance with Hebb's postulate, it is considered one of the major mechanisms of memory storage and recall. STDP comprises a system of two coincidence detectors with N-methyl-D-aspartate receptor (NMDAR) activation often posited as one of the main components. Numerous studies have unveiled a third component of this coincidence detection system, namely neuromodulation and glia activity shaping STDP. Even though dopaminergic control of STDP has most often been reported, acetylcholine, noradrenaline, nitric oxide (NO), brain-derived neurotrophic factor (BDNF) or gamma-aminobutyric acid (GABA) also has been shown to effectively modulate STDP. Furthermore, it has been demonstrated that astrocytes, via the release or uptake of glutamate, gate STDP expression. At the most fundamental level, the timing properties of STDP are expected to depend on the spatiotemporal dynamics of the underlying signaling pathways. However in most cases, due to technical limitations experiments grant only indirect access to these pathways. Computational models carefully constrained by experiments, allow for a better qualitative understanding of the molecular basis of STDP and its regulation by neuromodulators. Recently, computational models of calcium dynamics and signaling pathway molecules have started to explore STDP emergence in ex and in vivo-like conditions. These models are expected to reproduce better at least part of the complex modulation of STDP as an emergent property of the underlying molecular pathways. Elucidation of the mechanisms underlying STDP modulation and its consequences on network dynamics is of critical importance and will allow better understanding of the major mechanisms of memory storage and recall both in health and disease.
Collapse
Affiliation(s)
- Alexandre Foncelle
- INRIA, Villeurbanne, France
- LIRIS UMR 5205 CNRS-INSA, University of Lyon, Villeurbanne, France
| | - Alexandre Mendes
- Dynamic and Pathophysiology of Neuronal Networks, Center for Interdisciplinary Research in Biology (CIRB), College de France, INSERM U1050, CNRS UMR7241, Labex Memolife, Paris, France
- University Pierre et Marie Curie, ED 158, Paris, France
| | | | - Silvana Valtcheva
- Dynamic and Pathophysiology of Neuronal Networks, Center for Interdisciplinary Research in Biology (CIRB), College de France, INSERM U1050, CNRS UMR7241, Labex Memolife, Paris, France
- University Pierre et Marie Curie, ED 158, Paris, France
| | - Hugues Berry
- INRIA, Villeurbanne, France
- LIRIS UMR 5205 CNRS-INSA, University of Lyon, Villeurbanne, France
| | - Kim T. Blackwell
- The Krasnow Institute for Advanced Studies, George Mason University, Fairfax, VA, United States
| | - Laurent Venance
- Dynamic and Pathophysiology of Neuronal Networks, Center for Interdisciplinary Research in Biology (CIRB), College de France, INSERM U1050, CNRS UMR7241, Labex Memolife, Paris, France
- University Pierre et Marie Curie, ED 158, Paris, France
| |
Collapse
|
6
|
Gardner B, Grüning A. Supervised Learning in Spiking Neural Networks for Precise Temporal Encoding. PLoS One 2016; 11:e0161335. [PMID: 27532262 PMCID: PMC4988787 DOI: 10.1371/journal.pone.0161335] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2016] [Accepted: 08/03/2016] [Indexed: 11/24/2022] Open
Abstract
Precise spike timing as a means to encode information in neural networks is biologically supported, and is advantageous over frequency-based codes by processing input features on a much shorter time-scale. For these reasons, much recent attention has been focused on the development of supervised learning rules for spiking neural networks that utilise a temporal coding scheme. However, despite significant progress in this area, there still lack rules that have a theoretical basis, and yet can be considered biologically relevant. Here we examine the general conditions under which synaptic plasticity most effectively takes place to support the supervised learning of a precise temporal code. As part of our analysis we examine two spike-based learning methods: one of which relies on an instantaneous error signal to modify synaptic weights in a network (INST rule), and the other one relying on a filtered error signal for smoother synaptic weight modifications (FILT rule). We test the accuracy of the solutions provided by each rule with respect to their temporal encoding precision, and then measure the maximum number of input patterns they can learn to memorise using the precise timings of individual spikes as an indication of their storage capacity. Our results demonstrate the high performance of the FILT rule in most cases, underpinned by the rule’s error-filtering mechanism, which is predicted to provide smooth convergence towards a desired solution during learning. We also find the FILT rule to be most efficient at performing input pattern memorisations, and most noticeably when patterns are identified using spikes with sub-millisecond temporal precision. In comparison with existing work, we determine the performance of the FILT rule to be consistent with that of the highly efficient E-learning Chronotron rule, but with the distinct advantage that our FILT rule is also implementable as an online method for increased biological realism.
Collapse
Affiliation(s)
- Brian Gardner
- Department of Computer Science, University of Surrey, Guildford, United Kingdom
- * E-mail:
| | - André Grüning
- Department of Computer Science, University of Surrey, Guildford, United Kingdom
| |
Collapse
|
7
|
Zhang Y, Li P, Jin Y, Choe Y. A Digital Liquid State Machine With Biologically Inspired Learning and Its Application to Speech Recognition. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2015; 26:2635-2649. [PMID: 25643415 DOI: 10.1109/tnnls.2015.2388544] [Citation(s) in RCA: 42] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
This paper presents a bioinspired digital liquid-state machine (LSM) for low-power very-large-scale-integration (VLSI)-based machine learning applications. To the best of the authors' knowledge, this is the first work that employs a bioinspired spike-based learning algorithm for the LSM. With the proposed online learning, the LSM extracts information from input patterns on the fly without needing intermediate data storage as required in offline learning methods such as ridge regression. The proposed learning rule is local such that each synaptic weight update is based only upon the firing activities of the corresponding presynaptic and postsynaptic neurons without incurring global communications across the neural network. Compared with the backpropagation-based learning, the locality of computation in the proposed approach lends itself to efficient parallel VLSI implementation. We use subsets of the TI46 speech corpus to benchmark the bioinspired digital LSM. To reduce the complexity of the spiking neural network model without performance degradation for speech recognition, we study the impacts of synaptic models on the fading memory of the reservoir and hence the network performance. Moreover, we examine the tradeoffs between synaptic weight resolution, reservoir size, and recognition performance and present techniques to further reduce the overhead of hardware implementation. Our simulation results show that in terms of isolated word recognition evaluated using the TI46 speech corpus, the proposed digital LSM rivals the state-of-the-art hidden Markov-model-based recognizer Sphinx-4 and outperforms all other reported recognizers including the ones that are based upon the LSM or neural networks.
Collapse
|
8
|
Saudargienė A, Graham BP. Inhibitory control of site-specific synaptic plasticity in a model CA1 pyramidal neuron. Biosystems 2015; 130:37-50. [PMID: 25769669 DOI: 10.1016/j.biosystems.2015.03.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2014] [Revised: 10/31/2014] [Accepted: 03/06/2015] [Indexed: 11/28/2022]
Abstract
A computational model of a biochemical network underlying synaptic plasticity is combined with simulated on-going electrical activity in a model of a hippocampal pyramidal neuron to study the impact of synapse location and inhibition on synaptic plasticity. The simulated pyramidal neuron is activated by the realistic stimulation protocol of causal and anticausal spike pairings of presynaptic and postsynaptic action potentials in the presence and absence of spatially targeted inhibition provided by basket, bistratified and oriens-lacunosum moleculare (OLM) interneurons. The resulting Spike-timing-dependent plasticity (STDP) curves depend strongly on the number of pairing repetitions, the synapse location and the timing and strength of inhibition.
Collapse
Affiliation(s)
- Aušra Saudargienė
- Department of Informatics, Vytautas Magnus University, Kaunas LT-44404, Lithuania.
| | - Bruce P Graham
- Computer Science and Mathematics, School of Natural Sciences, University of Stirling, Stirling FK9 4LA, UK
| |
Collapse
|
9
|
Abstract
Calcium plays a role in long-term plasticity by triggering postsynaptic signaling pathways for both the strengthening (LTP) and weakening (LTD) of synapses. Since these are opposing processes, several hypotheses have been developed to explain how calcium can trigger LTP in some situations and LTD in others. These hypotheses fall broadly into three categories, based on the amplitude of calcium concentration, the duration of the calcium elevation, and the location of the calcium influx. Here we review the experimental evidence for and against each of these hypotheses and the recent computational models utilizing each. We argue that with new experimental techniques for the precise visualization of calcium and new computational techniques for the modeling of calcium diffusion, it is time to take a new look at the location hypothesis.
Collapse
Affiliation(s)
- R C Evans
- George Mason University, The Krasnow Institute for Advanced Studies, MS 2A1, Fairfax, Virginia 22030-444
| | - K T Blackwell
- George Mason University, The Krasnow Institute for Advanced Studies, MS 2A1, Fairfax, Virginia 22030-444
| |
Collapse
|
10
|
Chrol-Cannon J, Jin Y. Computational modeling of neural plasticity for self-organization of neural networks. Biosystems 2014; 125:43-54. [PMID: 24769242 DOI: 10.1016/j.biosystems.2014.04.003] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2013] [Revised: 04/03/2014] [Accepted: 04/04/2014] [Indexed: 11/28/2022]
Abstract
Self-organization in biological nervous systems during the lifetime is known to largely occur through a process of plasticity that is dependent upon the spike-timing activity in connected neurons. In the field of computational neuroscience, much effort has been dedicated to building up computational models of neural plasticity to replicate experimental data. Most recently, increasing attention has been paid to understanding the role of neural plasticity in functional and structural neural self-organization, as well as its influence on the learning performance of neural networks for accomplishing machine learning tasks such as classification and regression. Although many ideas and hypothesis have been suggested, the relationship between the structure, dynamics and learning performance of neural networks remains elusive. The purpose of this article is to review the most important computational models for neural plasticity and discuss various ideas about neural plasticity's role. Finally, we suggest a few promising research directions, in particular those along the line that combines findings in computational neuroscience and systems biology, and their synergetic roles in understanding learning, memory and cognition, thereby bridging the gap between computational neuroscience, systems biology and computational intelligence.
Collapse
Affiliation(s)
- Joseph Chrol-Cannon
- Department of Computing, University of Surrey, Guildford GU2 7XH, United Kingdom
| | - Yaochu Jin
- Department of Computing, University of Surrey, Guildford GU2 7XH, United Kingdom.
| |
Collapse
|
11
|
Standage D, Trappenberg T, Blohm G. Calcium-dependent calcium decay explains STDP in a dynamic model of hippocampal synapses. PLoS One 2014; 9:e86248. [PMID: 24465987 PMCID: PMC3899242 DOI: 10.1371/journal.pone.0086248] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2013] [Accepted: 12/12/2013] [Indexed: 11/18/2022] Open
Abstract
It is widely accepted that the direction and magnitude of synaptic plasticity depends on post-synaptic calcium flux, where high levels of calcium lead to long-term potentiation and moderate levels lead to long-term depression. At synapses onto neurons in region CA1 of the hippocampus (and many other synapses), NMDA receptors provide the relevant source of calcium. In this regard, post-synaptic calcium captures the coincidence of pre- and post-synaptic activity, due to the blockage of these receptors at low voltage. Previous studies show that under spike timing dependent plasticity (STDP) protocols, potentiation at CA1 synapses requires post-synaptic bursting and an inter-pairing frequency in the range of the hippocampal theta rhythm. We hypothesize that these requirements reflect the saturation of the mechanisms of calcium extrusion from the post-synaptic spine. We test this hypothesis with a minimal model of NMDA receptor-dependent plasticity, simulating slow extrusion with a calcium-dependent calcium time constant. In simulations of STDP experiments, the model accounts for latency-dependent depression with either post-synaptic bursting or theta-frequency pairing (or neither) and accounts for latency-dependent potentiation when both of these requirements are met. The model makes testable predictions for STDP experiments and our simple implementation is tractable at the network level, demonstrating associative learning in a biophysical network model with realistic synaptic dynamics.
Collapse
Affiliation(s)
- Dominic Standage
- Department of Biomedical and Molecular Sciences and Center for Neuroscience Studies, Queen’s University, Kingston, Ontario, Canada
- * E-mail:
| | - Thomas Trappenberg
- Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Gunnar Blohm
- Department of Biomedical and Molecular Sciences and Center for Neuroscience Studies, Queen’s University, Kingston, Ontario, Canada
| |
Collapse
|
12
|
Bhalla US. Multiscale modeling and synaptic plasticity. PROGRESS IN MOLECULAR BIOLOGY AND TRANSLATIONAL SCIENCE 2014; 123:351-86. [PMID: 24560151 DOI: 10.1016/b978-0-12-397897-4.00012-7] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
Synaptic plasticity is a major convergence point for theory and computation, and the process of plasticity engages physiology, cell, and molecular biology. In its many manifestations, plasticity is at the hub of basic neuroscience questions about memory and development, as well as more medically themed questions of neural damage and recovery. As an important cellular locus of memory, synaptic plasticity has received a huge amount of experimental and theoretical attention. If computational models have tended to pick specific aspects of plasticity, such as STDP, and reduce them to an equation, some experimental studies are equally guilty of oversimplification each time they identify a new molecule and declare it to be the last word in plasticity and learning. Multiscale modeling begins with the acknowledgment that synaptic function spans many levels of signaling, and these are so tightly coupled that we risk losing essential features of plasticity if we focus exclusively on any one level. Despite the technical challenges and gaps in data for model specification, an increasing number of multiscale modeling studies have taken on key questions in plasticity. These have provided new insights, but importantly, they have opened new avenues for questioning. This review discusses a wide range of multiscale models in plasticity, including their technical landscape and their implications.
Collapse
Affiliation(s)
- Upinder S Bhalla
- National Centre for Biological Sciences, Bangalore, Karnataka, India
| |
Collapse
|