1
|
Ingram R, Volianskis A. Promiscuous involvement of metabotropic glutamate receptors in the storage of N-methyl-d-aspartate receptor-dependent short-term potentiation. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230445. [PMID: 38853548 PMCID: PMC11343307 DOI: 10.1098/rstb.2023.0445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Revised: 04/03/2024] [Accepted: 04/04/2024] [Indexed: 06/11/2024] Open
Abstract
Short- and long-term forms of N-methyl-d-aspartate receptor (NMDAR)-dependent potentiation (most commonly termed short-term potentiation (STP) and long-term potentiation (LTP)) are co-induced in hippocampal slices by theta-burst stimulation, which mimics naturally occurring patterns of neuronal activity. While NMDAR-dependent LTP (NMDAR-LTP) is said to be the cellular correlate of long-term memory storage, NMDAR-dependent STP (NMDAR-STP) is thought to underlie the encoding of shorter-lasting memories. The mechanisms of NMDAR-LTP have been researched much more extensively than those of NMDAR-STP, which is characterized by its extreme stimulation dependence. Thus, in the absence of low-frequency test stimulation, which is used to test the magnitude of potentiation, NMDAR-STP does not decline until the stimulation is resumed. NMDAR-STP represents, therefore, an inverse variant of Hebbian synaptic plasticity, illustrating that inactive synapses can retain their strength unchanged until they become active again. The mechanisms, by which NMDAR-STP is stored in synapses without a decrement, are unknown and we report here that activation of metabotropic glutamate receptors may be critical in maintaining the potentiated state of synaptic transmission. This article is part of a discussion meeting issue 'Long-term potentiation: 50 years on'.
Collapse
Affiliation(s)
- Rachael Ingram
- Centre for Neuroscience, Surgery and Trauma, Blizard Institute, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, LondonE1 2AT, UK
| | - Arturas Volianskis
- Centre for Neuroscience, Surgery and Trauma, Blizard Institute, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, LondonE1 2AT, UK
- School of Biosciences, Cardiff University, Museum Avenue, CardiffCF10 3AX, UK
| |
Collapse
|
2
|
Kim J, Bustamante E, Sotonyi P, Maxwell N, Parameswaran P, Kent JK, Wetsel WC, Soderblom EJ, Rácz B, Soderling SH. Presynaptic Rac1 in the hippocampus selectively regulates working memory. eLife 2024; 13:RP97289. [PMID: 39046788 PMCID: PMC11268886 DOI: 10.7554/elife.97289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/25/2024] Open
Abstract
One of the most extensively studied members of the Ras superfamily of small GTPases, Rac1 is an intracellular signal transducer that remodels actin and phosphorylation signaling networks. Previous studies have shown that Rac1-mediated signaling is associated with hippocampal-dependent working memory and longer-term forms of learning and memory and that Rac1 can modulate forms of both pre- and postsynaptic plasticity. How these different cognitive functions and forms of plasticity mediated by Rac1 are linked, however, is unclear. Here, we show that spatial working memory in mice is selectively impaired following the expression of a genetically encoded Rac1 inhibitor at presynaptic terminals, while longer-term cognitive processes are affected by Rac1 inhibition at postsynaptic sites. To investigate the regulatory mechanisms of this presynaptic process, we leveraged new advances in mass spectrometry to identify the proteomic and post-translational landscape of presynaptic Rac1 signaling. We identified serine/threonine kinases and phosphorylated cytoskeletal signaling and synaptic vesicle proteins enriched with active Rac1. The phosphorylated sites in these proteins are at positions likely to have regulatory effects on synaptic vesicles. Consistent with this, we also report changes in the distribution and morphology of synaptic vesicles and in postsynaptic ultrastructure following presynaptic Rac1 inhibition. Overall, this study reveals a previously unrecognized presynaptic role of Rac1 signaling in cognitive processes and provides insights into its potential regulatory mechanisms.
Collapse
Affiliation(s)
- Jaebin Kim
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
| | - Edwin Bustamante
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
| | - Peter Sotonyi
- Department of Anatomy and Histology, University of Veterinary MedicineBudapestHungary
| | - Nicholas Maxwell
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
| | - Pooja Parameswaran
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
| | - Julie K Kent
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
| | - William C Wetsel
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
- Department of Psychiatry and Behavioral Sciences, Duke University School of MedicineDurhamUnited States
- Mouse Behavioral and Neuroendocrine Analysis Core Facility, Duke University School of MedicineDurhamUnited States
- Department of Neurobiology, Duke University School of MedicineDurhamUnited States
| | - Erik J Soderblom
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
- Proteomics and Metabolomics Shared Resource and Center for Genomic and Computational Biology, Duke University School of MedicineDurhamUnited States
| | - Bence Rácz
- Department of Anatomy and Histology, University of Veterinary MedicineBudapestHungary
| | - Scott H Soderling
- Department of Cell Biology, Duke University School of MedicineDurhamUnited States
- Department of Neurobiology, Duke University School of MedicineDurhamUnited States
| |
Collapse
|
3
|
Dor A, Harrison C, Irani SR, Al-Diwani A, Grogan J, Manohar S. N-Methyl-D-Aspartate Receptor-Antibody Encephalitis Impairs Maintenance of Attention to Items in Working Memory. J Neurosci 2024; 44:e1500232024. [PMID: 38830760 PMCID: PMC11236588 DOI: 10.1523/jneurosci.1500-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 04/23/2024] [Accepted: 04/28/2024] [Indexed: 06/05/2024] Open
Abstract
NMDA receptors (NMDARs) may be crucial to working memory (WM). Computational models predict that they sustain neural firing and produce associative memory, which may underpin maintaining and binding information, respectively. We test this in patients with antibodies to NMDAR (n = 10, female) and compare them with healthy control participants (n = 55, 20 male, 35 female). Patients were tested after recovery with a task that separates two aspects of WM: sustaining attention and feature binding. Participants had to remember two colored arrows. Then attention was directed to one of them. After a variable delay, they reported the direction of either the same arrow (congruent cue) or of the other arrow (incongruent cue). We asked how congruency affected recall precision and measured types of error. Patients had difficulty in both sustaining attention to an item over time and feature binding. Controls were less precise after longer delays and incongruent cues. In contrast, patients did not benefit from congruent cues at longer delays [group × congruency (long condition); p = 0.041], indicating they could not sustain attention. Additionally, patients reported the wrong item (misbinding errors) more than controls after congruent cues [group × delay (congruent condition), main effect of group; p ≤ 0.001]. Our results suggest NMDARs are critical for both maintaining attention and feature binding.
Collapse
Affiliation(s)
- Afrose Dor
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, United Kingdom
| | - Corin Harrison
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| | - Sarosh R Irani
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, United Kingdom
| | - Adam Al-Diwani
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, United Kingdom
- Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - John Grogan
- Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
| | - Sanjay Manohar
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| |
Collapse
|
4
|
Lundqvist M, Miller EK, Nordmark J, Liljefors J, Herman P. Beta: bursts of cognition. Trends Cogn Sci 2024; 28:662-676. [PMID: 38658218 DOI: 10.1016/j.tics.2024.03.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 03/11/2024] [Accepted: 03/20/2024] [Indexed: 04/26/2024]
Abstract
Beta oscillations are linked to the control of goal-directed processing of sensory information and the timing of motor output. Recent evidence demonstrates they are not sustained but organized into intermittent high-power bursts mediating timely functional inhibition. This implies there is a considerable moment-to-moment variation in the neural dynamics supporting cognition. Beta bursts thus offer new opportunities for studying how sensory inputs are selectively processed, reshaped by inhibitory cognitive operations and ultimately result in motor actions. Recent method advances reveal diversity in beta bursts that provide deeper insights into their function and the underlying neural circuit activity motifs. We propose that brain-wide, spatiotemporal patterns of beta bursting reflect various cognitive operations and that their dynamics reveal nonlinear aspects of cortical processing.
Collapse
Affiliation(s)
- Mikael Lundqvist
- Division of Psychology, Department of Clinical Neuroscience, Karolinska Institutet, Solna, Sweden; The Picower Institute for Learning & Memory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| | - Earl K Miller
- The Picower Institute for Learning & Memory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Jonatan Nordmark
- Division of Psychology, Department of Clinical Neuroscience, Karolinska Institutet, Solna, Sweden
| | - Johan Liljefors
- Division of Psychology, Department of Clinical Neuroscience, Karolinska Institutet, Solna, Sweden
| | - Pawel Herman
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden; Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden
| |
Collapse
|
5
|
Bays PM, Schneegans S, Ma WJ, Brady TF. Representation and computation in visual working memory. Nat Hum Behav 2024; 8:1016-1034. [PMID: 38849647 DOI: 10.1038/s41562-024-01871-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 03/22/2024] [Indexed: 06/09/2024]
Abstract
The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.
Collapse
Affiliation(s)
- Paul M Bays
- Department of Psychology, University of Cambridge, Cambridge, UK
| | | | - Wei Ji Ma
- Center for Neural Science and Department of Psychology, New York University, New York, NY, USA
| | - Timothy F Brady
- Department of Psychology, University of California, San Diego, La Jolla, CA, USA.
| |
Collapse
|
6
|
Samona EA, Chowdury A, Kopchick J, Thomas P, Rajan U, Khatib D, Zajac-Benitez C, Amirsadri A, Haddad L, Stanley JA, Diwadkar VA. The importance of covert memory consolidation in schizophrenia: Dysfunctional network profiles of the hippocampus and the dorsolateral prefrontal cortex. Psychiatry Res Neuroimaging 2024; 340:111805. [PMID: 38447230 PMCID: PMC11188056 DOI: 10.1016/j.pscychresns.2024.111805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 01/24/2024] [Accepted: 02/20/2024] [Indexed: 03/08/2024]
Abstract
Altered brain network profiles in schizophrenia (SCZ) during memory consolidation are typically observed during task-active periods such as encoding or retrieval. However active processes are also sub served by covert periods of memory consolidation. These periods are active in that they allow memories to be recapitulated even in the absence of overt sensorimotor processing. It is plausible that regions central to memory formation like the dlPFC and the hippocampus, exert network signatures during covert periods. Are these signatures altered in patients? The question is clinically relevant because real world learning and memory is facilitated by covert processing, and may be impaired in schizophrenia. Here, we compared network signatures of the dlPFC and the hippocampus during covert periods of a learning and memory task. Because behavioral proficiency increased non-linearly, functional connectivity of the dlPFC and hippocampus [psychophysiological interaction (PPI)] was estimated for each of the Early (linear increases in performance) and Late (asymptotic performance) covert periods. During Early periods, we observed hypo-modulation by the hippocampus but hyper-modulation by dlPFC. Conversely, during Late periods, we observed hypo-modulation by both the dlPFC and the hippocampus. We stitch these results into a conceptual model of network deficits during covert periods of memory consolidation.
Collapse
Affiliation(s)
- Elias A Samona
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Asadur Chowdury
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - John Kopchick
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Patricia Thomas
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Usha Rajan
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Dalal Khatib
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Caroline Zajac-Benitez
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Alireza Amirsadri
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Luay Haddad
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Jeffrey A Stanley
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
| | - Vaibhav A Diwadkar
- Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States.
| |
Collapse
|
7
|
Penny W. Stochastic attractor models of visual working memory. PLoS One 2024; 19:e0301039. [PMID: 38568927 PMCID: PMC10990203 DOI: 10.1371/journal.pone.0301039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 03/10/2024] [Indexed: 04/05/2024] Open
Abstract
This paper investigates models of working memory in which memory traces evolve according to stochastic attractor dynamics. These models have previously been shown to account for response-biases that are manifest across multiple trials of a visual working memory task. Here we adapt this approach by making the stable fixed points correspond to the multiple items to be remembered within a single-trial, in accordance with standard dynamical perspectives of memory, and find evidence that this multi-item model can provide a better account of behavioural data from continuous-report tasks. Additionally, the multi-item model proposes a simple mechanism by which swap-errors arise: memory traces diffuse away from their initial state and are captured by the attractors of other items. Swap-error curves reveal the evolution of this process as a continuous function of time throughout the maintenance interval and can be inferred from experimental data. Consistent with previous findings, we find that empirical memory performance is not well characterised by a purely-diffusive process but rather by a stochastic process that also embodies error-correcting dynamics.
Collapse
Affiliation(s)
- W. Penny
- School of Psychology, University East Anglia, Norwich, United Kingdom
| |
Collapse
|
8
|
Fitz H, Hagoort P, Petersson KM. Neurobiological Causal Models of Language Processing. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:225-247. [PMID: 38645618 PMCID: PMC11025648 DOI: 10.1162/nol_a_00133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 12/18/2023] [Indexed: 04/23/2024]
Abstract
The language faculty is physically realized in the neurobiological infrastructure of the human brain. Despite significant efforts, an integrated understanding of this system remains a formidable challenge. What is missing from most theoretical accounts is a specification of the neural mechanisms that implement language function. Computational models that have been put forward generally lack an explicit neurobiological foundation. We propose a neurobiologically informed causal modeling approach which offers a framework for how to bridge this gap. A neurobiological causal model is a mechanistic description of language processing that is grounded in, and constrained by, the characteristics of the neurobiological substrate. It intends to model the generators of language behavior at the level of implementational causality. We describe key features and neurobiological component parts from which causal models can be built and provide guidelines on how to implement them in model simulations. Then we outline how this approach can shed new light on the core computational machinery for language, the long-term storage of words in the mental lexicon and combinatorial processing in sentence comprehension. In contrast to cognitive theories of behavior, causal models are formulated in the "machine language" of neurobiology which is universal to human cognition. We argue that neurobiological causal modeling should be pursued in addition to existing approaches. Eventually, this approach will allow us to develop an explicit computational neurobiology of language.
Collapse
Affiliation(s)
- Hartmut Fitz
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Peter Hagoort
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Karl Magnus Petersson
- Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Faculty of Medicine and Biomedical Sciences, University of Algarve, Faro, Portugal
| |
Collapse
|
9
|
Kim J, Bustamante E, Sotonyi P, Maxwell ND, Parameswaran P, Kent JK, Wetsel WC, Soderblom EJ, Rácz B, Soderling SH. Presynaptic Rac1 in the hippocampus selectively regulates working memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.18.585488. [PMID: 38562715 PMCID: PMC10983896 DOI: 10.1101/2024.03.18.585488] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
One of the most extensively studied members of the Ras superfamily of small GTPases, Rac1 is an intracellular signal transducer that remodels actin and phosphorylation signaling networks. Previous studies have shown that Rac1-mediated signaling is associated with hippocampal-dependent working memory and longer-term forms of learning and memory and that Rac1 can modulate forms of both pre- and postsynaptic plasticity. How these different cognitive functions and forms of plasticity mediated by Rac1 are linked, however, is unclear. Here, we show that spatial working memory is selectively impaired following the expression of a genetically encoded Rac1-inhibitor at presynaptic terminals, while longer-term cognitive processes are affected by Rac1 inhibition at postsynaptic sites. To investigate the regulatory mechanisms of this presynaptic process, we leveraged new advances in mass spectrometry to identify the proteomic and post-translational landscape of presynaptic Rac1 signaling. We identified serine/threonine kinases and phosphorylated cytoskeletal signaling and synaptic vesicle proteins enriched with active Rac1. The phosphorylated sites in these proteins are at positions likely to have regulatory effects on synaptic vesicles. Consistent with this, we also report changes in the distribution and morphology of synaptic vesicles and in postsynaptic ultrastructure following presynaptic Rac1 inhibition. Overall, this study reveals a previously unrecognized presynaptic role of Rac1 signaling in cognitive processes and provides insights into its potential regulatory mechanisms.
Collapse
Affiliation(s)
- Jaebin Kim
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
| | - Edwin Bustamante
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
| | - Peter Sotonyi
- Department of Anatomy and Histology, University of Veterinary Medicine, Budapest, Hungary
| | - Nicholas D Maxwell
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
| | - Pooja Parameswaran
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
| | - Julie K Kent
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
| | - William C Wetsel
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
- Mouse Behavioral and Neuroendocrine Analysis Core Facility, Duke University Medical School, Durham, North Carolina, USA
- Department of Neurobiology, Duke University Medical School, Durham, North Carolina, USA
| | - Erik J Soderblom
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
- Mouse Behavioral and Neuroendocrine Analysis Core Facility, Duke University Medical School, Durham, North Carolina, USA
| | - Bence Rácz
- Department of Anatomy and Histology, University of Veterinary Medicine, Budapest, Hungary
| | - Scott H Soderling
- Department of Cell Biology, Duke University Medical School, Durham, North Carolina, USA
- Department of Neurobiology, Duke University Medical School, Durham, North Carolina, USA
| |
Collapse
|
10
|
Yiling Y, Klon-Lipok J, Shapcott K, Lazar A, Singer W. Dynamic fading memory and expectancy effects in the monkey primary visual cortex. Proc Natl Acad Sci U S A 2024; 121:e2314855121. [PMID: 38354261 PMCID: PMC10895277 DOI: 10.1073/pnas.2314855121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 01/10/2024] [Indexed: 02/16/2024] Open
Abstract
In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.
Collapse
Affiliation(s)
- Yang Yiling
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Johanna Klon-Lipok
- Max Planck Institute for Brain Research, Frankfurt am Main60438, Germany
| | - Katharine Shapcott
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Andreea Lazar
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
| | - Wolf Singer
- Ernst Strüngmann Institute for Neuroscience in Cooperation with Max Planck Society, Frankfurt am Main60528, Germany
- Max Planck Institute for Brain Research, Frankfurt am Main60438, Germany
- Frankfurt Institute for Advanced Studies, Frankfurt am Main60438, Germany
| |
Collapse
|
11
|
Lansner A, Fiebig F, Herman P. Fast Hebbian plasticity and working memory. Curr Opin Neurobiol 2023; 83:102809. [PMID: 37980802 DOI: 10.1016/j.conb.2023.102809] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 10/10/2023] [Accepted: 10/19/2023] [Indexed: 11/21/2023]
Abstract
Theories and models of working memory (WM) were at least since the mid-1990s dominated by the persistent activity hypothesis. The past decade has seen rising concerns about the shortcomings of sustained activity as the mechanism for short-term maintenance of WM information in the light of accumulating experimental evidence for so-called activity-silent WM and the fundamental difficulty in explaining robust multi-item WM. In consequence, alternative theories are now explored mostly in the direction of fast synaptic plasticity as the underlying mechanism. The question of non-Hebbian vs Hebbian synaptic plasticity emerges naturally in this context. In this review, we focus on fast Hebbian plasticity and trace the origins of WM theories and models building on this form of associative learning.
Collapse
Affiliation(s)
- Anders Lansner
- Stockholm University, Department of Mathematics, SE-106 91 Stockholm, Sweden; KTH Royal Institute of Technology, Dept of Computational Science and Technology, 100 44 Stockholm, Sweden; SeRC (Swedish e-Science Research Center), Sweden.
| | - Florian Fiebig
- KTH Royal Institute of Technology, Dept of Computational Science and Technology, 100 44 Stockholm, Sweden.
| | - Pawel Herman
- KTH Royal Institute of Technology, Dept of Computational Science and Technology, 100 44 Stockholm, Sweden; Digital Futures, KTH Royal Institute of Technology, Stockholm, Sweden; SeRC (Swedish e-Science Research Center), Sweden. https://twitter.com/PHermanKTHbrain
| |
Collapse
|
12
|
Sacouto L, Wichert A. Competitive learning to generate sparse representations for associative memory. Neural Netw 2023; 168:32-43. [PMID: 37734137 DOI: 10.1016/j.neunet.2023.09.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 08/07/2023] [Accepted: 09/03/2023] [Indexed: 09/23/2023]
Abstract
One of the most well established brain principles, Hebbian learning, has led to the theoretical concept of neural assemblies. Based on it, many interesting brain theories have spawned. Palm's work implements this concept through multiple binary Willshaw associative memories, in a model that not only has a wide cognitive explanatory power but also makes neuroscientific predictions. Yet, Willshaw's associative memory can only achieve top capacity when the stored vectors are extremely sparse (number of active bits can grow logarithmically with the vector's length). This strict requirement makes it difficult to apply any model that uses this associative memory, like Palm's, to real data. Hence the fact that most works apply the memory to optimal randomly generated codes that do not represent any information. This issue creates the need for encoders that can take real data, and produce sparse representations - a problem which is also raised following Barlow's efficient coding principle. In this work, we propose a biologically-constrained network that encodes images into codes that are suitable for Willshaw's associative memory. The network is organized into groups of neurons that specialize on local receptive fields, and learn through a competitive scheme. After conducting auto- and hetero-association experiments on two visual data sets, we can conclude that our network not only beats sparse coding baselines, but also that it comes close to the performance achieved using optimal random codes.
Collapse
Affiliation(s)
- Luis Sacouto
- INESC-id & Instituto Superior Tecnico, University of Lisbon, Av. Rovisco Pais 1, Lisbon, 1049-001, Portugal.
| | - Andreas Wichert
- INESC-id & Instituto Superior Tecnico, University of Lisbon, Av. Rovisco Pais 1, Lisbon, 1049-001, Portugal.
| |
Collapse
|
13
|
Huang Q, Luo M, Mi Y, Luo H. "Leader-Follower" Dynamic Perturbation Manipulates Multi-Item Working Memory in Humans. eNeuro 2023; 10:ENEURO.0472-22.2023. [PMID: 37914409 PMCID: PMC10668215 DOI: 10.1523/eneuro.0472-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 10/22/2023] [Accepted: 10/25/2023] [Indexed: 11/03/2023] Open
Abstract
Manipulating working memory (WM) is a central yet challenging notion. Previous studies suggest that WM items with varied memory strengths reactivate at different latencies, supporting a time-based mechanism. Motivated by this view, here we developed a purely bottom-up "Leader-Follower" behavioral approach to manipulate WM in humans. Specifically, task-irrelevant flickering color disks that are bound to each of the memorized items are presented during the delay period, and the ongoing luminance sequences of the color disks follow a Leader-Follower relationship, that is, a hundreds of milliseconds temporal lag. We show that this dynamic behavioral approach leads to better memory performance for the item associated with the temporally advanced luminance sequence (Leader) than the item with the temporally lagged luminance sequence (Follower), yet with limited effectiveness. Together, our findings constitute evidence for the essential role of temporal dynamics in WM operation and offer a promising, noninvasive WM manipulation approach.
Collapse
Affiliation(s)
- Qiaoli Huang
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
- Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Minghao Luo
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
| | - Yuanyuan Mi
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China
| | - Huan Luo
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
| |
Collapse
|
14
|
Lu L, Gao Z, Wei Z, Yi M. Working memory depends on the excitatory-inhibitory balance in neuron-astrocyte network. CHAOS (WOODBURY, N.Y.) 2023; 33:013127. [PMID: 36725632 DOI: 10.1063/5.0126890] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/18/2022] [Accepted: 12/19/2022] [Indexed: 06/18/2023]
Abstract
Previous studies have shown that astrocytes are involved in information processing and working memory (WM) in the central nervous system. Here, the neuron-astrocyte network model with biological properties is built to study the effects of excitatory-inhibitory balance and neural network structures on WM tasks. It is found that the performance metrics of WM tasks under the scale-free network are higher than other network structures, and the WM task can be successfully completed when the proportion of excitatory neurons in the network exceeds 30%. There exists an optimal region for the proportion of excitatory neurons and synaptic weight that the memory performance metrics of the WM tasks are higher. The multi-item WM task shows that the spatial calcium patterns for different items overlap significantly in the astrocyte network, which is consistent with the formation of cognitive memory in the brain. Moreover, complex image tasks show that cued recall can significantly reduce systematic noise and maintain the stability of the WM tasks. The results may contribute to understand the mechanisms of WM formation and provide some inspirations into the dynamic storage and recall of memory.
Collapse
Affiliation(s)
- Lulu Lu
- School of Mathematics and Physics, China University of Geosciences, Wuhan 430074, China
| | - Zhuoheng Gao
- School of Mathematics and Physics, China University of Geosciences, Wuhan 430074, China
| | - Zhouchao Wei
- School of Mathematics and Physics, China University of Geosciences, Wuhan 430074, China
| | - Ming Yi
- School of Mathematics and Physics, China University of Geosciences, Wuhan 430074, China
| |
Collapse
|
15
|
Myeong J, Klyachko VA. Rapid astrocyte-dependent facilitation amplifies multi-vesicular release in hippocampal synapses. Cell Rep 2022; 41:111820. [PMID: 36516768 PMCID: PMC9805313 DOI: 10.1016/j.celrep.2022.111820] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 09/30/2022] [Accepted: 11/21/2022] [Indexed: 12/15/2022] Open
Abstract
Synaptic facilitation is a major form of short-term plasticity typically driven by an increase in residual presynaptic calcium. Using near-total internal reflection fluorescence (near-TIRF) imaging of single vesicle release in cultured hippocampal synapses, we demonstrate a distinctive, release-dependent form of facilitation in which probability of vesicle release is higher following a successful glutamate release event than following a failure. This phenomenon has an onset of ≤500 ms and lasts several seconds, resulting in clusters of successful release events. The release-dependent facilitation requires neuronal contact with astrocytes and astrocytic glutamate uptake by EAAT1. It is not observed in neurons grown alone or in the presence of astrocyte-conditioned media. This form of facilitation dynamically amplifies multi-vesicular release. Facilitation-evoked release events exhibit spatial clustering and have a preferential localization toward the active zone center. These results uncover a rapid astrocyte-dependent form of facilitation acting via modulation of multi-vesicular release and displaying distinctive spatiotemporal properties.
Collapse
Affiliation(s)
- Jongyun Myeong
- Department of Cell Biology and Physiology, Washington University School of Medicine, St. Louis, MO 63132, USA
| | - Vitaly A. Klyachko
- Department of Cell Biology and Physiology, Washington University School of Medicine, St. Louis, MO 63132, USA,Lead contact,Correspondence:
| |
Collapse
|
16
|
Bocincova A, Buschman TJ, Stokes MG, Manohar SG. Neural signature of flexible coding in prefrontal cortex. Proc Natl Acad Sci U S A 2022; 119:e2200400119. [PMID: 36161948 PMCID: PMC9546590 DOI: 10.1073/pnas.2200400119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Accepted: 08/15/2022] [Indexed: 11/18/2022] Open
Abstract
The ability of prefrontal cortex to quickly encode novel associations is crucial for adaptive behavior and central to working memory. Fast Hebbian changes in synaptic strength permit forming new associations, but neuronal signatures of this have been elusive. We devised a trialwise index of pattern similarity to look for rapid changes in population codes. Based on a computational model of working memory, we hypothesized that synaptic strength-and consequently, the tuning of neurons-could change if features of a subsequent stimulus need to be "reassociated," i.e., if bindings between features need to be broken to encode the new item. As a result, identical stimuli might elicit different neural responses. As predicted, neural response similarity dropped following rebinding, but only in prefrontal cortex. The history-dependent changes were expressed on top of traditional, fixed selectivity and were not explainable by carryover of previous firing into the current trial or by neural adaptation.
Collapse
Affiliation(s)
- Andrea Bocincova
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, United Kingdom
| | - Timothy J. Buschman
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08540
- Department of Psychology, Princeton University, Princeton, NJ 08540
| | - Mark G. Stokes
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| | - Sanjay G. Manohar
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX3 9DU, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| |
Collapse
|
17
|
Tiddia G, Golosio B, Fanti V, Paolucci PS. Simulations of working memory spiking networks driven by short-term plasticity. Front Integr Neurosci 2022; 16:972055. [PMID: 36262372 PMCID: PMC9574057 DOI: 10.3389/fnint.2022.972055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Accepted: 08/29/2022] [Indexed: 11/15/2022] Open
Abstract
Working Memory (WM) is a cognitive mechanism that enables temporary holding and manipulation of information in the human brain. This mechanism is mainly characterized by a neuronal activity during which neuron populations are able to maintain an enhanced spiking activity after being triggered by a short external cue. In this study, we implement, using the NEST simulator, a spiking neural network model in which the WM activity is sustained by a mechanism of short-term synaptic facilitation related to presynaptic calcium kinetics. The model, which is characterized by leaky integrate-and-fire neurons with exponential postsynaptic currents, is able to autonomously show an activity regime in which the memory information can be stored in a synaptic form as a result of synaptic facilitation, with spiking activity functional to facilitation maintenance. The network is able to simultaneously keep multiple memories by showing an alternated synchronous activity which preserves the synaptic facilitation within the neuron populations holding memory information. The results shown in this study confirm that a WM mechanism can be sustained by synaptic facilitation.
Collapse
Affiliation(s)
- Gianmarco Tiddia
- Department of Physics, University of Cagliari, Monserrato, Italy
- Istituto Nazionale di Fisica Nucleare (INFN), Sezione di Cagliari, Monserrato, Italy
| | - Bruno Golosio
- Department of Physics, University of Cagliari, Monserrato, Italy
- Istituto Nazionale di Fisica Nucleare (INFN), Sezione di Cagliari, Monserrato, Italy
- *Correspondence: Bruno Golosio
| | - Viviana Fanti
- Department of Physics, University of Cagliari, Monserrato, Italy
- Istituto Nazionale di Fisica Nucleare (INFN), Sezione di Cagliari, Monserrato, Italy
| | | |
Collapse
|
18
|
Becker S, Nold A, Tchumatchenko T. Modulation of working memory duration by synaptic and astrocytic mechanisms. PLoS Comput Biol 2022; 18:e1010543. [PMID: 36191056 PMCID: PMC9560596 DOI: 10.1371/journal.pcbi.1010543] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 10/13/2022] [Accepted: 09/05/2022] [Indexed: 12/24/2022] Open
Abstract
Short-term synaptic plasticity and modulations of the presynaptic vesicle release rate are key components of many working memory models. At the same time, an increasing number of studies suggests a potential role of astrocytes in modulating higher cognitive function such as WM through their influence on synaptic transmission. Which influence astrocytic signaling could have on the stability and duration of WM representations, however, is still unclear. Here, we introduce a slow, activity-dependent astrocytic regulation of the presynaptic release probability in a synaptic attractor model of WM. We compare and analyze simulations of a simple WM protocol in firing rate and spiking networks with and without astrocytic regulation, and underpin our observations with analyses of the phase space dynamics in the rate network. We find that the duration and stability of working memory representations are altered by astrocytic signaling and by noise. We show that astrocytic signaling modulates the mean duration of WM representations. Moreover, if the astrocytic regulation is strong, a slow presynaptic timescale introduces a ‘window of vulnerability’, during which WM representations are easily disruptable by noise before being stabilized. We identify two mechanisms through which noise from different sources in the network can either stabilize or destabilize WM representations. Our findings suggest that (i) astrocytic regulation can act as a crucial determinant for the duration of WM representations in synaptic attractor models of WM, and (ii) that astrocytic signaling could facilitate different mechanisms for volitional top-down control of WM representations and their duration. The ability to form memories and recall them is one of the fascinating features of our brain. Working memory operates like a memory scratch pad storing ongoing information for further processing. Here, we present a computational model dissecting the influence of astrocytes on the stability and duration of working memories. We find that a long astrocytic time constant can influence the mean duration of working memory representations and generate a “window of vulnerability”, during which some memories are tagged for long-term survival while some are terminated. The fraction of memories in the survival and termination groups could be regulated by adjusting the strength of astrocytic feedback or its time constant. This indicates that astrocytic signaling can be viewed as a candidate mechanism for top-down control of working memory representations and their duration.
Collapse
Affiliation(s)
- Sophia Becker
- Laboratory of Computational Neuroscience, Brain Mind Institute, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
- Theory of Neural Dynamics group, Max Planck Institute for Brain Research, Frankfurt am Main, Germany
| | - Andreas Nold
- Theory of Neural Dynamics group, Max Planck Institute for Brain Research, Frankfurt am Main, Germany
- Institute of Experimental Epileptology and Cognition Research, Life and Brain Center, Universitätsklinikum Bonn, Bonn, Germany
| | - Tatjana Tchumatchenko
- Theory of Neural Dynamics group, Max Planck Institute for Brain Research, Frankfurt am Main, Germany
- Institute of Experimental Epileptology and Cognition Research, Life and Brain Center, Universitätsklinikum Bonn, Bonn, Germany
- Institute for Physiological Chemistry, Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany
- * E-mail:
| |
Collapse
|
19
|
Lundqvist M, Rose J, Brincat SL, Warden MR, Buschman TJ, Herman P, Miller EK. Reduced variability of bursting activity during working memory. Sci Rep 2022; 12:15050. [PMID: 36064880 PMCID: PMC9445015 DOI: 10.1038/s41598-022-18577-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 08/16/2022] [Indexed: 12/03/2022] Open
Abstract
Working memories have long been thought to be maintained by persistent spiking. However, mounting evidence from multiple-electrode recording (and single-trial analyses) shows that the underlying spiking is better characterized by intermittent bursts of activity. A counterargument suggested this intermittent activity is at odds with observations that spike-time variability reduces during task performance. However, this counterargument rests on assumptions, such as randomness in the timing of the bursts, which may not be correct. Thus, we analyzed spiking and LFPs from monkeys’ prefrontal cortex (PFC) to determine if task-related reductions in variability can co-exist with intermittent spiking. We found that it does because both spiking and associated gamma bursts were task-modulated, not random. In fact, the task-related reduction in spike variability could largely be explained by a related reduction in gamma burst variability. Our results provide further support for the intermittent activity models of working memory as well as novel mechanistic insights into how spike variability is reduced during cognitive tasks.
Collapse
Affiliation(s)
- Mikael Lundqvist
- Department of Psychology, Department of Clinical Neuroscience, Karolinska Institute, Solna, Sweden. .,The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
| | - Jonas Rose
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.,Faculty of Psychology, Neural Basis of Learning, Ruhr University Bochum, 44801, Bochum, Germany
| | - Scott L Brincat
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Melissa R Warden
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.,Department of Neurobiology and Behavior, Cornell University, Ithaca, NY, 14853, USA
| | - Timothy J Buschman
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.,Princeton Neuroscience Institute, Princeton University, Washington Rd., Princeton, NJ, 08540, USA
| | - Pawel Herman
- Department of Computational Science and Technology, School of Electrical Engineering and Computer Science and Digital Futures, KTH Royal Institute of Technology, 100 44, Stockholm, Sweden
| | - Earl K Miller
- The Picower Institute for Learning and Memory and Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
| |
Collapse
|
20
|
Chrysanthidis N, Fiebig F, Lansner A, Herman P. Traces of semantization - from episodic to semantic memory in a spiking cortical network model. eNeuro 2022; 9:ENEURO.0062-22.2022. [PMID: 35803714 PMCID: PMC9347313 DOI: 10.1523/eneuro.0062-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2022] [Revised: 05/05/2022] [Accepted: 05/28/2022] [Indexed: 11/21/2022] Open
Abstract
Episodic memory is a recollection of past personal experiences associated with particular times and places. This kind of memory is commonly subject to loss of contextual information or" semantization", which gradually decouples the encoded memory items from their associated contexts while transforming them into semantic or gist-like representations. Novel extensions to the classical Remember/Know behavioral paradigm attribute the loss of episodicity to multiple exposures of an item in different contexts. Despite recent advancements explaining semantization at a behavioral level, the underlying neural mechanisms remain poorly understood. In this study, we suggest and evaluate a novel hypothesis proposing that Bayesian-Hebbian synaptic plasticity mechanisms might cause semantization of episodic memory. We implement a cortical spiking neural network model with a Bayesian-Hebbian learning rule called Bayesian Confidence Propagation Neural Network (BCPNN), which captures the semantization phenomenon and offers a mechanistic explanation for it. Encoding items across multiple contexts leads to item-context decoupling akin to semantization. We compare BCPNN plasticity with the more commonly used spike-timing dependent plasticity (STDP) learning rule in the same episodic memory task. Unlike BCPNN, STDP does not explain the decontextualization process. We further examine how selective plasticity modulation of isolated salient events may enhance preferential retention and resistance to semantization. Our model reproduces important features of episodicity on behavioral timescales under various biological constraints whilst also offering a novel neural and synaptic explanation for semantization, thereby casting new light on the interplay between episodic and semantic memory processes.Significance StatementRemembering single episodes is a fundamental attribute of cognition. Difficulties recollecting contextual information is a key sign of episodic memory loss or semantization. Behavioral studies demonstrate that semantization of episodic memory can occur rapidly, yet the neural mechanisms underlying this effect are insufficiently investigated. In line with recent behavioral findings, we show that multiple stimulus exposures in different contexts may advance item-context decoupling. We suggest a Bayesian-Hebbian synaptic plasticity hypothesis of memory semantization and further show that a transient modulation of plasticity during salient events may disrupt the decontextualization process by strengthening memory traces, and thus, enhancing preferential retention. The proposed cortical network-of-networks model thus bridges micro and mesoscale synaptic effects with network dynamics and behavior.
Collapse
Affiliation(s)
- Nikolaos Chrysanthidis
- Division of Computational Science and Technology, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 10044 Stockholm, Sweden
| | - Florian Fiebig
- Division of Computational Science and Technology, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 10044 Stockholm, Sweden
| | - Anders Lansner
- Division of Computational Science and Technology, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 10044 Stockholm, Sweden
- Department of Mathematics, Stockholm University, 10691 Stockholm, Sweden
| | - Pawel Herman
- Division of Computational Science and Technology, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, 10044 Stockholm, Sweden
- Digital Futures, Stockholm, Sweden
- Swedish e-Science Research Centre, Stockholm, Sweden
| |
Collapse
|
21
|
Neural Mechanisms of the Maintenance and Manipulation of Gustatory Working Memory in Orbitofrontal Cortex. Cognit Comput 2022. [DOI: 10.1007/s12559-022-10035-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
22
|
Sarwat SG, Kersting B, Moraitis T, Jonnalagadda VP, Sebastian A. Phase-change memtransistive synapses for mixed-plasticity neural computations. NATURE NANOTECHNOLOGY 2022; 17:507-513. [PMID: 35347271 DOI: 10.1038/s41565-022-01095-3] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2021] [Accepted: 01/12/2022] [Indexed: 06/14/2023]
Abstract
In the mammalian nervous system, various synaptic plasticity rules act, either individually or synergistically, over wide-ranging timescales to enable learning and memory formation. Hence, in neuromorphic computing platforms, there is a significant need for artificial synapses that can faithfully express such multi-timescale plasticity mechanisms. Although some plasticity rules have been emulated with elaborate complementary metal oxide semiconductor and memristive circuitry, device-level hardware realizations of long-term and short-term plasticity with tunable dynamics are lacking. Here we introduce a phase-change memtransistive synapse that leverages both the non-volatility of the phase configurations and the volatility of field-effect modulation for implementing tunable plasticities. We show that these mixed-plasticity synapses can enable plasticity rules such as short-term spike-timing-dependent plasticity that helps with the modelling of dynamic environments. Further, we demonstrate the efficacy of the memtransistive synapses in realizing accelerators for Hopfield neural networks for solving combinatorial optimization problems.
Collapse
|
23
|
Astrocytes mediate analogous memory in a multi-layer neuron–astrocyte network. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-06936-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
AbstractModeling the neuronal processes underlying short-term working memory remains the focus of many theoretical studies in neuroscience. In this paper, we propose a mathematical model of a spiking neural network (SNN) which simulates the way a fragment of information is maintained as a robust activity pattern for several seconds and the way it completely disappears if no other stimuli are fed to the system. Such short-term memory traces are preserved due to the activation of astrocytes accompanying the SNN. The astrocytes exhibit calcium transients at a time scale of seconds. These transients further modulate the efficiency of synaptic transmission and, hence, the firing rate of neighboring neurons at diverse timescales through gliotransmitter release. We demonstrate how such transients continuously encode frequencies of neuronal discharges and provide robust short-term storage of analogous information. This kind of short-term memory can store relevant information for seconds and then completely forget it to avoid overlapping with forthcoming patterns. The SNN is inter-connected with the astrocytic layer by local inter-cellular diffusive connections. The astrocytes are activated only when the neighboring neurons fire synchronously, e.g., when an information pattern is loaded. For illustration, we took grayscale photographs of people’s faces where the shades of gray correspond to the level of applied current which stimulates the neurons. The astrocyte feedback modulates (facilitates) synaptic transmission by varying the frequency of neuronal firing. We show how arbitrary patterns can be loaded, then stored for a certain interval of time, and retrieved if the appropriate clue pattern is applied to the input.
Collapse
|
24
|
Wang D, Xu J, Stathis D, Zhang L, Li F, Lansner A, Hemani A, Yang Y, Herman P, Zou Z. Mapping the BCPNN Learning Rule to a Memristor Model. Front Neurosci 2021; 15:750458. [PMID: 34955716 PMCID: PMC8695980 DOI: 10.3389/fnins.2021.750458] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 11/11/2021] [Indexed: 11/15/2022] Open
Abstract
The Bayesian Confidence Propagation Neural Network (BCPNN) has been implemented in a way that allows mapping to neural and synaptic processes in the human cortexandhas been used extensively in detailed spiking models of cortical associative memory function and recently also for machine learning applications. In conventional digital implementations of BCPNN, the von Neumann bottleneck is a major challenge with synaptic storage and access to it as the dominant cost. The memristor is a non-volatile device ideal for artificial synapses that fuses computation and storage and thus fundamentally overcomes the von Neumann bottleneck. While the implementation of other neural networks like Spiking Neural Network (SNN) and even Convolutional Neural Network (CNN) on memristor has been studied, the implementation of BCPNN has not. In this paper, the BCPNN learning rule is mapped to a memristor model and implemented with a memristor-based architecture. The implementation of the BCPNN learning rule is a mixed-signal design with the main computation and storage happening in the analog domain. In particular, the nonlinear dopant drift phenomenon of the memristor is exploited to simulate the exponential decay of the synaptic state variables in the BCPNN learning rule. The consistency between the memristor-based solution and the BCPNN learning rule is simulated and verified in Matlab, with a correlation coefficient as high as 0.99. The analog circuit is designed and implemented in the SPICE simulation environment, demonstrating a good emulation effect for the BCPNN learning rule with a correlation coefficient as high as 0.98. This work focuses on demonstrating the feasibility of mapping the BCPNN learning rule to in-circuit computation in memristor. The feasibility of the memristor-based implementation is evaluated and validated in the paper, to pave the way for a more efficient BCPNN implementation, toward a real-time brain emulation engine.
Collapse
Affiliation(s)
- Deyu Wang
- State Key Laboratory of ASIC and System, School of Information Science and Technology, Fudan University, Shanghai, China
| | - Jiawei Xu
- State Key Laboratory of ASIC and System, School of Information Science and Technology, Fudan University, Shanghai, China
| | - Dimitrios Stathis
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Lianhao Zhang
- Department of Electrical Engineering, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Feng Li
- State Key Laboratory of ASIC and System, School of Information Science and Technology, Fudan University, Shanghai, China
| | - Anders Lansner
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden
- Department of Mathematics, Stockholm University, Stockholm, Sweden
| | - Ahmed Hemani
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Yu Yang
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Pawel Herman
- School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Zhuo Zou
- State Key Laboratory of ASIC and System, School of Information Science and Technology, Fudan University, Shanghai, China
| |
Collapse
|
25
|
Wong EC. Distributed Phase Oscillatory Excitation Efficiently Produces Attractors Using Spike-Timing-Dependent Plasticity. Neural Comput 2021; 34:415-436. [PMID: 34915556 DOI: 10.1162/neco_a_01466] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2021] [Accepted: 09/18/2021] [Indexed: 11/04/2022]
Abstract
The brain is thought to represent information in the form of activity in distributed groups of neurons known as attractors. We show here that in a randomly connected network of simulated spiking neurons, periodic stimulation of neurons with distributed phase offsets, along with standard spike-timing-dependent plasticity (STDP), efficiently creates distributed attractors. These attractors may have a consistent ordered firing pattern or become irregular, depending on the conditions. We also show that when two such attractors are stimulated in sequence, the same STDP mechanism can create a directed association between them, forming the basis of an associative network. We find that for an STDP time constant of 20 ms, the dependence of the efficiency of attractor creation on the driving frequency has a broad peak centered around 8 Hz. Upon restimulation, the attractors self-oscillate, but with an oscillation frequency that is higher than the driving frequency, ranging from 10 to 100 Hz.
Collapse
Affiliation(s)
- Eric C Wong
- Departments of Radiology and Psychiatry, University of California, San Diego, La Jolla, CA 92093, U.S.A.
| |
Collapse
|
26
|
Trial-to-Trial Variability of Spiking Delay Activity in Prefrontal Cortex Constrains Burst-Coding Models of Working Memory. J Neurosci 2021; 41:8928-8945. [PMID: 34551937 DOI: 10.1523/jneurosci.0167-21.2021] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 08/17/2021] [Accepted: 08/29/2021] [Indexed: 11/21/2022] Open
Abstract
A hallmark neuronal correlate of working memory (WM) is stimulus-selective spiking activity of neurons in PFC during mnemonic delays. These observations have motivated an influential computational modeling framework in which WM is supported by persistent activity. Recently, this framework has been challenged by arguments that observed persistent activity may be an artifact of trial-averaging, which potentially masks high variability of delay activity at the single-trial level. In an alternative scenario, WM delay activity could be encoded in bursts of selective neuronal firing which occur intermittently across trials. However, this alternative proposal has not been tested on single-neuron spike-train data. Here, we developed a framework for addressing this issue by characterizing the trial-to-trial variability of neuronal spiking quantified by Fano factor (FF). By building a doubly stochastic Poisson spiking model, we first demonstrated that the burst-coding proposal implies a significant increase in FF positively correlated with firing rate, and thus loss of stability across trials during the delay. Simulation of spiking cortical circuit WM models further confirmed that FF is a sensitive measure that can well dissociate distinct WM mechanisms. We then tested these predictions on datasets of single-neuron recordings from macaque PFC during three WM tasks. In sharp contrast to the burst-coding model predictions, we only found a small fraction of neurons showing increased WM-dependent burstiness, and stability across trials during delay was strengthened in empirical data. Therefore, reduced trial-to-trial variability during delay provides strong constraints on the contribution of single-neuron intermittent bursting to WM maintenance.SIGNIFICANCE STATEMENT There are diverging classes of theoretical models explaining how information is maintained in working memory by cortical circuits. In an influential model class, neurons exhibit persistent elevated memorandum-selective firing, whereas a recently developed class of burst-coding models suggests that persistent activity is an artifact of trial-averaging, and spiking is sparse in each single trial, subserved by brief intermittent bursts. However, this alternative picture has not been characterized or tested on empirical spike-train data. Here we combine mathematical analysis, computational model simulation, and experimental data analysis to test empirically these two classes of models and show that the trial-to-trial variability of empirical spike trains is not consistent with burst coding. These findings provide constraints for theoretical models of working memory.
Collapse
|
27
|
Macpherson T, Churchland A, Sejnowski T, DiCarlo J, Kamitani Y, Takahashi H, Hikida T. Natural and Artificial Intelligence: A brief introduction to the interplay between AI and neuroscience research. Neural Netw 2021; 144:603-613. [PMID: 34649035 DOI: 10.1016/j.neunet.2021.09.018] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 09/15/2021] [Accepted: 09/21/2021] [Indexed: 10/20/2022]
Abstract
Neuroscience and artificial intelligence (AI) share a long history of collaboration. Advances in neuroscience, alongside huge leaps in computer processing power over the last few decades, have given rise to a new generation of in silico neural networks inspired by the architecture of the brain. These AI systems are now capable of many of the advanced perceptual and cognitive abilities of biological systems, including object recognition and decision making. Moreover, AI is now increasingly being employed as a tool for neuroscience research and is transforming our understanding of brain functions. In particular, deep learning has been used to model how convolutional layers and recurrent connections in the brain's cerebral cortex control important functions, including visual processing, memory, and motor control. Excitingly, the use of neuroscience-inspired AI also holds great promise for understanding how changes in brain networks result in psychopathologies, and could even be utilized in treatment regimes. Here we discuss recent advancements in four areas in which the relationship between neuroscience and AI has led to major advancements in the field; (1) AI models of working memory, (2) AI visual processing, (3) AI analysis of big neuroscience datasets, and (4) computational psychiatry.
Collapse
Affiliation(s)
- Tom Macpherson
- Laboratory for Advanced Brain Functions, Institute for Protein Research, Osaka University, Osaka, Japan
| | - Anne Churchland
- Cold Spring Harbor Laboratory, Neuroscience, Cold Spring Harbor, NY, USA
| | - Terry Sejnowski
- Computational Neurobiology Laboratory, Salk Institute for Biological Studies, CA, USA; Division of Biological Sciences, University of California San Diego, CA, USA
| | - James DiCarlo
- Brain and Cognitive Sciences, Massachusetts Institute of Technology, MA, USA
| | - Yukiyasu Kamitani
- Department of Neuroinformatics, ATR Computational Neuroscience Laboratories, Kyoto, Japan; Graduate School of Informatics, Kyoto University, Kyoto, Japan
| | - Hidehiko Takahashi
- Department of Psychiatry and Behavioral Sciences, Tokyo Medical and Dental University Graduate School, Tokyo, Japan
| | - Takatoshi Hikida
- Laboratory for Advanced Brain Functions, Institute for Protein Research, Osaka University, Osaka, Japan.
| |
Collapse
|
28
|
Abstract
Working memory (WM) is the ability to maintain and manipulate information in the conscious mind over a timescale of seconds. This ability is thought to be maintained through the persistent discharges of neurons in a network of brain areas centered on the prefrontal cortex, as evidenced by neurophysiological recordings in nonhuman primates, though both the localization and the neural basis of WM has been a matter of debate in recent years. Neural correlates of WM are evident in species other than primates, including rodents and corvids. A specialized network of excitatory and inhibitory neurons, aided by neuromodulatory influences of dopamine, is critical for the maintenance of neuronal activity. Limitations in WM capacity and duration, as well as its enhancement during development, can be attributed to properties of neural activity and circuits. Changes in these factors can be observed through training-induced improvements and in pathological impairments. WM thus provides a prototypical cognitive function whose properties can be tied to the spiking activity of brain neurons. © 2021 American Physiological Society. Compr Physiol 11:1-41, 2021.
Collapse
Affiliation(s)
- Russell J Jaffe
- Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA
| | - Christos Constantinidis
- Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA
- Department of Biomedical Engineering, Vanderbilt University, Nashville, Tennessee, USA
- Neuroscience Program, Vanderbilt University, Nashville, Tennessee, USA
- Department of Ophthalmology and Visual Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| |
Collapse
|
29
|
Nash A, Aumann TD, Pigoni M, Lichtenthaler SF, Takeshima H, Munro KM, Gunnersen JM. Lack of Sez6 Family Proteins Impairs Motor Functions, Short-Term Memory, and Cognitive Flexibility and Alters Dendritic Spine Properties. Cereb Cortex 2021; 30:2167-2184. [PMID: 31711114 DOI: 10.1093/cercor/bhz230] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2019] [Revised: 08/22/2019] [Accepted: 09/02/2019] [Indexed: 02/05/2023] Open
Abstract
Seizure-related gene 6 (Sez6), Sez6-Like (Sez6L), and Sez6-Like 2 (Sez6L2) comprise a family of homologous proteins widely expressed throughout the brain that have been linked to neurodevelopmental and psychiatric disorders. Here, we use Sez6 triple knockout (TKO) mice, which lack all three Sez6 family proteins, to demonstrate that Sez6 family proteins regulate dendritic spine structure and cognitive functions, motor learning, and maintenance of motor functions across the lifespan. Compared to WT controls, we found that Sez6 TKO mice had impaired motor learning and their motor coordination was negatively affected from 6 weeks old and declined more rapidly as they aged. Sez6 TKO mice had reduced spine density in the hippocampus and dendritic spines were shifted to more immature morphologies in the somatosensory cortex. Cognitive testing revealed that they had enhanced stress responsiveness, impaired working, and spatial short-term memory but intact spatial long-term memory in the Morris water maze albeit accompanied by a reversal deficit. Our study demonstrates that the lack of Sez6 family proteins results in phenotypes commonly associated with neuropsychiatric disorders making it likely that Sez6 family proteins contribute to the complex etiologies of these disorders.
Collapse
Affiliation(s)
- Amelia Nash
- Department of Anatomy and Neuroscience, University of Melbourne, Melbourne, VIC 3010, Australia
| | - Timothy D Aumann
- The Florey Institute of Neuroscience and Mental Health, University of Melbourne, Melbourne, VIC 3010, Australia
| | - Martina Pigoni
- German Centre for Neurodegenerative Diseases (DZNE), Munich 81377, Germany
| | - Stefan F Lichtenthaler
- German Centre for Neurodegenerative Diseases (DZNE), Munich 81377, Germany.,Neuroproteomics, School of Medicine, Klinikum rechts der Isar, and Institute for Advanced Study, Technical University of Munich, Munich 81675, Germany.,Munich Cluster for Systems Neurology (SyNergy), Munich 81377, Germany
| | - Hiroshi Takeshima
- Division of Pharmaceutical Sciences, Graduate School and Faculty of Pharmaceutical Sciences, Kyoto University, Kyoto 606-8501, Japan
| | - Kathryn M Munro
- Department of Anatomy and Neuroscience, University of Melbourne, Melbourne, VIC 3010, Australia
| | - Jenny M Gunnersen
- Department of Anatomy and Neuroscience, University of Melbourne, Melbourne, VIC 3010, Australia.,The Florey Institute of Neuroscience and Mental Health, University of Melbourne, Melbourne, VIC 3010, Australia
| |
Collapse
|
30
|
Pulvermüller F, Tomasello R, Henningsen-Schomers MR, Wennekers T. Biological constraints on neural network models of cognitive function. Nat Rev Neurosci 2021; 22:488-502. [PMID: 34183826 PMCID: PMC7612527 DOI: 10.1038/s41583-021-00473-5] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/17/2021] [Indexed: 02/06/2023]
Abstract
Neural network models are potential tools for improving our understanding of complex brain functions. To address this goal, these models need to be neurobiologically realistic. However, although neural networks have advanced dramatically in recent years and even achieve human-like performance on complex perceptual and cognitive tasks, their similarity to aspects of brain anatomy and physiology is imperfect. Here, we discuss different types of neural models, including localist, auto-associative, hetero-associative, deep and whole-brain networks, and identify aspects under which their biological plausibility can be improved. These aspects range from the choice of model neurons and of mechanisms of synaptic plasticity and learning to implementation of inhibition and control, along with neuroanatomical properties including areal structure and local and long-range connectivity. We highlight recent advances in developing biologically grounded cognitive theories and in mechanistically explaining, on the basis of these brain-constrained neural models, hitherto unaddressed issues regarding the nature, localization and ontogenetic and phylogenetic development of higher brain functions. In closing, we point to possible future clinical applications of brain-constrained modelling.
Collapse
Affiliation(s)
- Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Berlin, Germany.
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany.
- Einstein Center for Neurosciences Berlin, Berlin, Germany.
- Cluster of Excellence 'Matters of Activity', Humboldt-Universität zu Berlin, Berlin, Germany.
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Berlin, Germany
- Cluster of Excellence 'Matters of Activity', Humboldt-Universität zu Berlin, Berlin, Germany
| | - Malte R Henningsen-Schomers
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Berlin, Germany
- Cluster of Excellence 'Matters of Activity', Humboldt-Universität zu Berlin, Berlin, Germany
| | - Thomas Wennekers
- School of Engineering, Computing and Mathematics, University of Plymouth, Plymouth, UK
| |
Collapse
|
31
|
Vandael D, Okamoto Y, Jonas P. Transsynaptic modulation of presynaptic short-term plasticity in hippocampal mossy fiber synapses. Nat Commun 2021; 12:2912. [PMID: 34006874 PMCID: PMC8131630 DOI: 10.1038/s41467-021-23153-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Accepted: 04/06/2021] [Indexed: 11/21/2022] Open
Abstract
The hippocampal mossy fiber synapse is a key synapse of the trisynaptic circuit. Post-tetanic potentiation (PTP) is the most powerful form of plasticity at this synaptic connection. It is widely believed that mossy fiber PTP is an entirely presynaptic phenomenon, implying that PTP induction is input-specific, and requires neither activity of multiple inputs nor stimulation of postsynaptic neurons. To directly test cooperativity and associativity, we made paired recordings between single mossy fiber terminals and postsynaptic CA3 pyramidal neurons in rat brain slices. By stimulating non-overlapping mossy fiber inputs converging onto single CA3 neurons, we confirm that PTP is input-specific and non-cooperative. Unexpectedly, mossy fiber PTP exhibits anti-associative induction properties. EPSCs show only minimal PTP after combined pre- and postsynaptic high-frequency stimulation with intact postsynaptic Ca2+ signaling, but marked PTP in the absence of postsynaptic spiking and after suppression of postsynaptic Ca2+ signaling (10 mM EGTA). PTP is largely recovered by inhibitors of voltage-gated R- and L-type Ca2+ channels, group II mGluRs, and vacuolar-type H+-ATPase, suggesting the involvement of retrograde vesicular glutamate signaling. Transsynaptic regulation of PTP extends the repertoire of synaptic computations, implementing a brake on mossy fiber detonation and a "smart teacher" function of hippocampal mossy fiber synapses.
Collapse
Affiliation(s)
- David Vandael
- Cellular Neuroscience, IST Austria (Institute of Science and Technology Austria), Klosterneuburg, Austria.
- Netherlands Institute for Neuroscience, Royal Netherlands Academy for Arts and Sciences (KNAW), Amsterdam, The Netherlands.
| | - Yuji Okamoto
- Cellular Neuroscience, IST Austria (Institute of Science and Technology Austria), Klosterneuburg, Austria
| | - Peter Jonas
- Cellular Neuroscience, IST Austria (Institute of Science and Technology Austria), Klosterneuburg, Austria.
| |
Collapse
|
32
|
Huang QS, Wei H. A Computational Model of Working Memory Based on Spike-Timing-Dependent Plasticity. Front Comput Neurosci 2021; 15:630999. [PMID: 33967727 PMCID: PMC8096998 DOI: 10.3389/fncom.2021.630999] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Accepted: 03/31/2021] [Indexed: 11/13/2022] Open
Abstract
Working memory is closely involved in various cognitive activities, but its neural mechanism is still under exploration. The mainstream view has long been that persistent activity is the neural basis of working memory, but recent experiments have observed that activity-silent memory can also be correctly recalled. The underlying mechanism of activity-silent memory is considered to be an alternative scheme that rejects the theory of persistent activity. We propose a working memory model based on spike-timing-dependent plasticity (STDP). Different from models based on spike-rate coding, our model adopts temporal patterns of action potentials to represent information, so it can flexibly encode new memory representation. The model can work in both persistent and silent states, i.e., it is compatible with both of these seemingly conflicting neural mechanisms. We conducted a simulation experiment, and the results are similar to the real experimental results, which suggests that our model is plausible in biology.
Collapse
Affiliation(s)
- Qiu-Sheng Huang
- Laboratory of Cognitive Model and Algorithm, Shanghai Key Laboratory of Data Science, Department of Computer Science, Fudan University, Shanghai, China
| | - Hui Wei
- Laboratory of Cognitive Model and Algorithm, Shanghai Key Laboratory of Data Science, Department of Computer Science, Fudan University, Shanghai, China
| |
Collapse
|
33
|
|
34
|
Gordleeva SY, Tsybina YA, Krivonosov MI, Ivanchenko MV, Zaikin AA, Kazantsev VB, Gorban AN. Modeling Working Memory in a Spiking Neuron Network Accompanied by Astrocytes. Front Cell Neurosci 2021; 15:631485. [PMID: 33867939 PMCID: PMC8044545 DOI: 10.3389/fncel.2021.631485] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Accepted: 03/04/2021] [Indexed: 01/07/2023] Open
Abstract
We propose a novel biologically plausible computational model of working memory (WM) implemented by a spiking neuron network (SNN) interacting with a network of astrocytes. The SNN is modeled by synaptically coupled Izhikevich neurons with a non-specific architecture connection topology. Astrocytes generating calcium signals are connected by local gap junction diffusive couplings and interact with neurons via chemicals diffused in the extracellular space. Calcium elevations occur in response to the increased concentration of the neurotransmitter released by spiking neurons when a group of them fire coherently. In turn, gliotransmitters are released by activated astrocytes modulating the strength of the synaptic connections in the corresponding neuronal group. Input information is encoded as two-dimensional patterns of short applied current pulses stimulating neurons. The output is taken from frequencies of transient discharges of corresponding neurons. We show how a set of information patterns with quite significant overlapping areas can be uploaded into the neuron-astrocyte network and stored for several seconds. Information retrieval is organized by the application of a cue pattern representing one from the memory set distorted by noise. We found that successful retrieval with the level of the correlation between the recalled pattern and ideal pattern exceeding 90% is possible for the multi-item WM task. Having analyzed the dynamical mechanism of WM formation, we discovered that astrocytes operating at a time scale of a dozen of seconds can successfully store traces of neuronal activations corresponding to information patterns. In the retrieval stage, the astrocytic network selectively modulates synaptic connections in the SNN leading to successful recall. Information and dynamical characteristics of the proposed WM model agrees with classical concepts and other WM models.
Collapse
Affiliation(s)
- Susanna Yu Gordleeva
- Scientific and Educational Mathematical Center "Mathematics of Future Technology," Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia.,Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Innopolis, Russia
| | - Yuliya A Tsybina
- Scientific and Educational Mathematical Center "Mathematics of Future Technology," Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia
| | - Mikhail I Krivonosov
- Scientific and Educational Mathematical Center "Mathematics of Future Technology," Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia
| | - Mikhail V Ivanchenko
- Scientific and Educational Mathematical Center "Mathematics of Future Technology," Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia
| | - Alexey A Zaikin
- Scientific and Educational Mathematical Center "Mathematics of Future Technology," Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia.,Center for Analysis of Complex Systems, Sechenov First Moscow State Medical University, Sechenov University, Moscow, Russia.,Institute for Women's Health and Department of Mathematics, University College London, London, United Kingdom
| | - Victor B Kazantsev
- Scientific and Educational Mathematical Center "Mathematics of Future Technology," Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia.,Neuroscience and Cognitive Technology Laboratory, Center for Technologies in Robotics and Mechatronics Components, Innopolis University, Innopolis, Russia.,Neuroscience Research Institute, Samara State Medical University, Samara, Russia
| | - Alexander N Gorban
- Scientific and Educational Mathematical Center "Mathematics of Future Technology," Lobachevsky State University of Nizhny Novgorod, Nizhny Novgorod, Russia.,Department of Mathematics, University of Leicester, Leicester, United Kingdom
| |
Collapse
|
35
|
Li J, Huang Q, Han Q, Mi Y, Luo H. Temporally coherent perturbation of neural dynamics during retention alters human multi-item working memory. Prog Neurobiol 2021; 201:102023. [PMID: 33617918 DOI: 10.1016/j.pneurobio.2021.102023] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 01/01/2021] [Accepted: 02/11/2021] [Indexed: 11/30/2022]
Abstract
Temporarily storing a list of items in working memory (WM), a fundamental ability in cognition, has been posited to rely on the temporal dynamics of multi-item neural representations during retention. However, the causal evidence, particularly in human subjects, is still lacking, let alone WM manipulation. Here, we develop a novel "dynamic perturbation" approach to manipulate the relative memory strength of WM items held in human brain, by presenting temporally correlated luminance sequences during retention to interfere with the multi-item neural dynamics. Six experiments on more than 150 subjects confirm the effectiveness of this WM manipulation approach. A computational model combining continuous attractor neural network (CANN) and short-term synaptic plasticity (STP) principles further reproduces all the empirical findings. The model reveals that the "dynamic perturbation" modifies the synaptic efficacies of WM items through STP principles, eventually leading to changes in their relative memory strengths. Our results support the causal role of temporal dynamics of neural network in mediating multi-item WM, and offer a promising, purely bottom-up approach to manipulate WM.
Collapse
Affiliation(s)
- Jiaqi Li
- School of Psychological and Cognitive Sciences, Peking University, China; PKU-IDG/McGovern Institute for Brain Research, Peking University, China; Beijing Key Laboratory of Behavior and Mental Health, Peking University, China
| | - Qiaoli Huang
- School of Psychological and Cognitive Sciences, Peking University, China; PKU-IDG/McGovern Institute for Brain Research, Peking University, China; Beijing Key Laboratory of Behavior and Mental Health, Peking University, China
| | - Qiming Han
- School of Psychological and Cognitive Sciences, Peking University, China; PKU-IDG/McGovern Institute for Brain Research, Peking University, China; Beijing Key Laboratory of Behavior and Mental Health, Peking University, China; Peking-Tsinghua Center for Life Sciences, Peking University, Beijing 100871, China
| | - Yuanyuan Mi
- Center for Neurointelligence, School of Medicine, Chongqing University, Chongqing 400044, China; AI Research Center, Peng Cheng Laboratory, Shenzhen 518005, China.
| | - Huan Luo
- School of Psychological and Cognitive Sciences, Peking University, China; PKU-IDG/McGovern Institute for Brain Research, Peking University, China; Beijing Key Laboratory of Behavior and Mental Health, Peking University, China.
| |
Collapse
|
36
|
Berberian N, Ross M, Chartier S. Embodied working memory during ongoing input streams. PLoS One 2021; 16:e0244822. [PMID: 33400724 PMCID: PMC7785253 DOI: 10.1371/journal.pone.0244822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2020] [Accepted: 12/16/2020] [Indexed: 11/18/2022] Open
Abstract
Sensory stimuli endow animals with the ability to generate an internal representation. This representation can be maintained for a certain duration in the absence of previously elicited inputs. The reliance on an internal representation rather than purely on the basis of external stimuli is a hallmark feature of higher-order functions such as working memory. Patterns of neural activity produced in response to sensory inputs can continue long after the disappearance of previous inputs. Experimental and theoretical studies have largely invested in understanding how animals faithfully maintain sensory representations during ongoing reverberations of neural activity. However, these studies have focused on preassigned protocols of stimulus presentation, leaving out by default the possibility of exploring how the content of working memory interacts with ongoing input streams. Here, we study working memory using a network of spiking neurons with dynamic synapses subject to short-term and long-term synaptic plasticity. The formal model is embodied in a physical robot as a companion approach under which neuronal activity is directly linked to motor output. The artificial agent is used as a methodological tool for studying the formation of working memory capacity. To this end, we devise a keyboard listening framework to delineate the context under which working memory content is (1) refined, (2) overwritten or (3) resisted by ongoing new input streams. Ultimately, this study takes a neurorobotic perspective to resurface the long-standing implication of working memory in flexible cognition.
Collapse
Affiliation(s)
- Nareg Berberian
- Laboratory for Computational Neurodynamics and Cognition, School of Psychology, University of Ottawa, Ottawa, Ontario, Canada
| | - Matt Ross
- Laboratory for Computational Neurodynamics and Cognition, School of Psychology, University of Ottawa, Ottawa, Ontario, Canada
| | - Sylvain Chartier
- Laboratory for Computational Neurodynamics and Cognition, School of Psychology, University of Ottawa, Ottawa, Ontario, Canada
| |
Collapse
|
37
|
Kruijne W, Bohte SM, Roelfsema PR, Olivers CNL. Flexible Working Memory Through Selective Gating and Attentional Tagging. Neural Comput 2020; 33:1-40. [PMID: 33080159 DOI: 10.1162/neco_a_01339] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
Working memory is essential: it serves to guide intelligent behavior of humans and nonhuman primates when task-relevant stimuli are no longer present to the senses. Moreover, complex tasks often require that multiple working memory representations can be flexibly and independently maintained, prioritized, and updated according to changing task demands. Thus far, neural network models of working memory have been unable to offer an integrative account of how such control mechanisms can be acquired in a biologically plausible manner. Here, we present WorkMATe, a neural network architecture that models cognitive control over working memory content and learns the appropriate control operations needed to solve complex working memory tasks. Key components of the model include a gated memory circuit that is controlled by internal actions, encoding sensory information through untrained connections, and a neural circuit that matches sensory inputs to memory content. The network is trained by means of a biologically plausible reinforcement learning rule that relies on attentional feedback and reward prediction errors to guide synaptic updates. We demonstrate that the model successfully acquires policies to solve classical working memory tasks, such as delayed recognition and delayed pro-saccade/anti-saccade tasks. In addition, the model solves much more complex tasks, including the hierarchical 12-AX task or the ABAB ordered recognition task, both of which demand an agent to independently store and updated multiple items separately in memory. Furthermore, the control strategies that the model acquires for these tasks subsequently generalize to new task contexts with novel stimuli, thus bringing symbolic production rule qualities to a neural network architecture. As such, WorkMATe provides a new solution for the neural implementation of flexible memory control.
Collapse
Affiliation(s)
- Wouter Kruijne
- Faculty of Behavior and Movement Sciences, Vrije Universiteit Amsterdam, 1081 BT Amsterdam, Noord Holland, The Netherlands
| | - Sander M Bohte
- Machine Learning Group, Centrum voor Wiskunde & Informatica, 1098 XG Amsterdam, Noord Holland, The Netherlands; Swammerdam Institute of Life Sciences, University of Amsterdam, 1098 XH Amsterdam, Noord Holland, The Netherlands; and Department of Computer Science, Rijksuniversiteit Groningen, 9747 AG Groningen, The Netherlands
| | - Pieter R Roelfsema
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, 1105BA Amsterdam, Noord Holland, The Netherlands; Department of Integrative Neurophysiology, Center for Neurogenomics and Cognitive Research, Vrije Universiteit Amsterdam, 1981 HV Amsterdam, Noord Holland, The Netherlands; and Department of Computer Science, Rijksuniversiteit Groningen, 9747 AG Groningen, The Netherlands
| | - Christian N L Olivers
- Faculty of Behavior and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Noord Holland, The Netherlands, Department of Psychiatry, Academic Medical Center, Amsterdam, The Netherlands
| |
Collapse
|
38
|
Olivers CN, Roelfsema PR. Attention for action in visual working memory. Cortex 2020; 131:179-194. [DOI: 10.1016/j.cortex.2020.07.011] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Revised: 06/22/2020] [Accepted: 07/14/2020] [Indexed: 12/27/2022]
|
39
|
Bocincova A, Olivers CNL, Stokes MG, Manohar SG. A common neural network architecture for visual search and working memory. VISUAL COGNITION 2020. [DOI: 10.1080/13506285.2020.1825142] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Andrea Bocincova
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Christian N. L. Olivers
- Department of Experimental and Applied Psychology, Institute for Brain and Behaviour Amsterdam, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Mark G. Stokes
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Sanjay G. Manohar
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| |
Collapse
|
40
|
Neuronal spike-rate adaptation supports working memory in language processing. Proc Natl Acad Sci U S A 2020; 117:20881-20889. [PMID: 32788365 DOI: 10.1073/pnas.2000222117] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Language processing involves the ability to store and integrate pieces of information in working memory over short periods of time. According to the dominant view, information is maintained through sustained, elevated neural activity. Other work has argued that short-term synaptic facilitation can serve as a substrate of memory. Here we propose an account where memory is supported by intrinsic plasticity that downregulates neuronal firing rates. Single neuron responses are dependent on experience, and we show through simulations that these adaptive changes in excitability provide memory on timescales ranging from milliseconds to seconds. On this account, spiking activity writes information into coupled dynamic variables that control adaptation and move at slower timescales than the membrane potential. From these variables, information is continuously read back into the active membrane state for processing. This neuronal memory mechanism does not rely on persistent activity, excitatory feedback, or synaptic plasticity for storage. Instead, information is maintained in adaptive conductances that reduce firing rates and can be accessed directly without cued retrieval. Memory span is systematically related to both the time constant of adaptation and baseline levels of neuronal excitability. Interference effects within memory arise when adaptation is long lasting. We demonstrate that this mechanism is sensitive to context and serial order which makes it suitable for temporal integration in sequence processing within the language domain. We also show that it enables the binding of linguistic features over time within dynamic memory registers. This work provides a step toward a computational neurobiology of language.
Collapse
|
41
|
Barbosa J, Stein H, Martinez RL, Galan-Gadea A, Li S, Dalmau J, Adam KCS, Valls-Solé J, Constantinidis C, Compte A. Interplay between persistent activity and activity-silent dynamics in the prefrontal cortex underlies serial biases in working memory. Nat Neurosci 2020; 23:1016-1024. [PMID: 32572236 PMCID: PMC7392810 DOI: 10.1038/s41593-020-0644-4] [Citation(s) in RCA: 106] [Impact Index Per Article: 26.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2019] [Accepted: 04/21/2020] [Indexed: 11/16/2022]
Abstract
Persistent neuronal spiking has long been considered the mechanism underlying working memory, but recent proposals argue for alternative 'activity-silent' substrates. Using monkey and human electrophysiology data, we show here that attractor dynamics that control neural spiking during mnemonic periods interact with activity-silent mechanisms in the prefrontal cortex (PFC). This interaction allows memory reactivations, which enhance serial biases in spatial working memory. Stimulus information was not decodable between trials, but remained present in activity-silent traces inferred from spiking synchrony in the PFC. Just before the new stimulus, this latent trace was reignited into activity that recapitulated the previous stimulus representation. Importantly, the reactivation strength correlated with the strength of serial biases in both monkeys and humans, as predicted by a computational model that integrates activity-based and activity-silent mechanisms. Finally, single-pulse transcranial magnetic stimulation applied to the human PFC between successive trials enhanced serial biases, thus demonstrating the causal role of prefrontal reactivations in determining working-memory behavior.
Collapse
Affiliation(s)
- Joao Barbosa
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Heike Stein
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Rebecca L Martinez
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Adrià Galan-Gadea
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Sihai Li
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Josep Dalmau
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
- Service of Neurology, Hospital Clínic, Barcelona, Spain
- University of Barcelona, Barcelona, Spain
- ICREA, Barcelona, Spain
- Department of Neurology, University of Pennsylvania, Philadelphia, PA, USA
| | - Kirsten C S Adam
- Department of Psychology and Institute for Neural Computation, University of California San Diego, La Jolla, CA, USA
| | - Josep Valls-Solé
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Christos Constantinidis
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Albert Compte
- Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain.
| |
Collapse
|
42
|
Löffler H, Gupta DS. A Model of Memory Linking Time to Space. Front Comput Neurosci 2020; 14:60. [PMID: 32733224 PMCID: PMC7360808 DOI: 10.3389/fncom.2020.00060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2019] [Accepted: 05/26/2020] [Indexed: 11/23/2022] Open
Abstract
The storage of temporally precise spike patterns can be realized by a single neuron. A spiking neural network (SNN) model is utilized to demonstrate the ability to precisely recall a spike pattern after presenting a single input. We show by using a simulation study that the temporal properties of input patterns can be transformed into spatial patterns of local dendritic spikes. The localization of time-points of spikes is facilitated by phase-shift of the subthreshold membrane potential oscillations (SMO) in the dendritic branches, which modifies their excitability. In reference to the points in time of the arriving input, the dendritic spikes are triggered in different branches. To store spatially distributed patterns, two unsupervised learning mechanisms are utilized. Either synaptic weights to the branches, spatial representation of the temporal input pattern, are enhanced by spike-timing-dependent plasticity (STDP) or the oscillation power of SMOs in spiking branches is increased by dendritic spikes. For retrieval, spike bursts activate stored spatiotemporal patterns in dendritic branches, which reactivate the original somatic spike patterns. The simulation of the prototypical model demonstrates the principle, how linking time to space enables the storage of temporal features of an input. Plausibility, advantages, and some variations of the proposed model are also discussed.
Collapse
|
43
|
An Indexing Theory for Working Memory Based on Fast Hebbian Plasticity. eNeuro 2020; 7:ENEURO.0374-19.2020. [PMID: 32127347 PMCID: PMC7189483 DOI: 10.1523/eneuro.0374-19.2020] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 01/17/2020] [Accepted: 01/27/2020] [Indexed: 12/21/2022] Open
Abstract
Working memory (WM) is a key component of human memory and cognition. Computational models have been used to study the underlying neural mechanisms, but neglected the important role of short-term memory (STM) and long-term memory (LTM) interactions for WM. Here, we investigate these using a novel multiarea spiking neural network model of prefrontal cortex (PFC) and two parietotemporal cortical areas based on macaque data. We propose a WM indexing theory that explains how PFC could associate, maintain, and update multimodal LTM representations. Our simulations demonstrate how simultaneous, brief multimodal memory cues could build a temporary joint memory representation as an “index” in PFC by means of fast Hebbian synaptic plasticity. This index can then reactivate spontaneously and thereby also the associated LTM representations. Cueing one LTM item rapidly pattern completes the associated uncued item via PFC. The PFC–STM network updates flexibly as new stimuli arrive, thereby gradually overwriting older representations.
Collapse
|
44
|
Schmutz V, Gerstner W, Schwalger T. Mesoscopic population equations for spiking neural networks with synaptic short-term plasticity. JOURNAL OF MATHEMATICAL NEUROSCIENCE 2020; 10:5. [PMID: 32253526 PMCID: PMC7136387 DOI: 10.1186/s13408-020-00082-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2019] [Accepted: 03/25/2020] [Indexed: 06/07/2023]
Abstract
Coarse-graining microscopic models of biological neural networks to obtain mesoscopic models of neural activities is an essential step towards multi-scale models of the brain. Here, we extend a recent theory for mesoscopic population dynamics with static synapses to the case of dynamic synapses exhibiting short-term plasticity (STP). The extended theory offers an approximate mean-field dynamics for the synaptic input currents arising from populations of spiking neurons and synapses undergoing Tsodyks-Markram STP. The approximate mean-field dynamics accounts for both finite number of synapses and correlation between the two synaptic variables of the model (utilization and available resources) and its numerical implementation is simple. Comparisons with Monte Carlo simulations of the microscopic model show that in both feedforward and recurrent networks, the mesoscopic mean-field model accurately reproduces the first- and second-order statistics of the total synaptic input into a postsynaptic neuron and accounts for stochastic switches between Up and Down states and for population spikes. The extended mesoscopic population theory of spiking neural networks with STP may be useful for a systematic reduction of detailed biophysical models of cortical microcircuits to numerically efficient and mathematically tractable mean-field models.
Collapse
Affiliation(s)
- Valentin Schmutz
- Brain Mind Institute, École Polytechnique Féderale de Lausanne (EPFL), Lausanne, Switzerland.
| | - Wulfram Gerstner
- Brain Mind Institute, École Polytechnique Féderale de Lausanne (EPFL), Lausanne, Switzerland
| | - Tilo Schwalger
- Brain Mind Institute, École Polytechnique Féderale de Lausanne (EPFL), Lausanne, Switzerland
- Bernstein Center for Computational Neuroscience, Institut für Mathematik, Technische Universität Berlin, Berlin, Germany
| |
Collapse
|
45
|
Abstract
Working memory is characterized by neural activity that persists during the retention interval of delay tasks. Despite the ubiquity of this delay activity across tasks, species and experimental techniques, our understanding of this phenomenon remains incomplete. Although initially there was a narrow focus on sustained activation in a small number of brain regions, methodological and analytical advances have allowed researchers to uncover previously unobserved forms of delay activity various parts of the brain. In light of these new findings, this Review reconsiders what delay activity is, where in the brain it is found, what roles it serves and how it may be generated.
Collapse
Affiliation(s)
- Kartik K Sreenivasan
- Division of Science and Mathematics, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates.
| | - Mark D'Esposito
- Helen Wills Neuroscience Institute and Department of Psychology, University of California, Berkeley, CA, USA.
| |
Collapse
|
46
|
Masse NY, Rosen MC, Freedman DJ. Reevaluating the Role of Persistent Neural Activity in Short-Term Memory. Trends Cogn Sci 2020; 24:242-258. [PMID: 32007384 PMCID: PMC7288241 DOI: 10.1016/j.tics.2019.12.014] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Revised: 12/19/2019] [Accepted: 12/23/2019] [Indexed: 12/18/2022]
Abstract
A traditional view of short-term working memory (STM) is that task-relevant information is maintained 'online' in persistent spiking activity. However, recent experimental and modeling studies have begun to question this long-held belief. In this review, we discuss new evidence demonstrating that information can be 'silently' maintained via short-term synaptic plasticity (STSP) without the need for persistent activity. We discuss how the neural mechanisms underlying STM are inextricably linked with the cognitive demands of the task, such that the passive maintenance and the active manipulation of information are subserved differently in the brain. Together, these recent findings point towards a more nuanced view of STM in which multiple substrates work in concert to support our ability to temporarily maintain and manipulate information.
Collapse
Affiliation(s)
- Nicolas Y Masse
- Department of Neurobiology, The University of Chicago, Chicago, IL, USA.
| | - Matthew C Rosen
- Department of Neurobiology, The University of Chicago, Chicago, IL, USA
| | - David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL, USA; Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, The University of Chicago, Chicago, IL, USA.
| |
Collapse
|
47
|
Persistent Spiking Activity Underlies Working Memory. J Neurosci 2019; 38:7020-7028. [PMID: 30089641 DOI: 10.1523/jneurosci.2486-17.2018] [Citation(s) in RCA: 164] [Impact Index Per Article: 32.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2018] [Revised: 05/16/2018] [Accepted: 05/25/2018] [Indexed: 01/10/2023] Open
Abstract
Persistent activity generated in the PFC during the delay period of working memory tasks represents information about stimuli held in memory and determines working memory performance. Alternative models of working memory, depending on the rhythmicity of discharges or exclusively on short-term synaptic plasticity, are inconsistent with the neurophysiological data.Dual Perspectives Companion Paper:Working Memory: Delay Activity, Yes! Persistent Activity? Maybe Not, by Mikael Lundqvist, Pawel Herman, and Earl K. Miller.
Collapse
|
48
|
Introducing double bouquet cells into a modular cortical associative memory model. J Comput Neurosci 2019; 47:223-230. [PMID: 31502234 PMCID: PMC6879442 DOI: 10.1007/s10827-019-00729-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2018] [Revised: 08/02/2019] [Accepted: 08/21/2019] [Indexed: 01/01/2023]
Abstract
We present an electrophysiological model of double bouquet cells and integrate them into an established cortical columnar microcircuit model that has previously been used as a spiking attractor model for memory. Learning in that model relies on a Hebbian-Bayesian learning rule to condition recurrent connectivity between pyramidal cells. We here demonstrate that the inclusion of a biophysically plausible double bouquet cell model can solve earlier concerns about learning rules that simultaneously learn excitation and inhibition and might thus violate Dale’s principle. We show that learning ability and resulting effective connectivity between functional columns of previous network models is preserved when pyramidal synapses onto double bouquet cells are plastic under the same Hebbian-Bayesian learning rule. The proposed architecture draws on experimental evidence on double bouquet cells and effectively solves the problem of duplexed learning of inhibition and excitation by replacing recurrent inhibition between pyramidal cells in functional columns of different stimulus selectivity with a plastic disynaptic pathway. We thus show that the resulting change to the microcircuit architecture improves the model’s biological plausibility without otherwise impacting the model’s spiking activity, basic operation, and learning abilities.
Collapse
|
49
|
Kamiński J, Rutishauser U. Between persistently active and activity-silent frameworks: novel vistas on the cellular basis of working memory. Ann N Y Acad Sci 2019; 1464:64-75. [PMID: 31407811 PMCID: PMC7015771 DOI: 10.1111/nyas.14213] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2019] [Revised: 07/09/2019] [Accepted: 07/18/2019] [Indexed: 12/25/2022]
Abstract
Recent work has revealed important new discoveries on the cellular mechanisms of working memory (WM). These findings have motivated several seemingly conflicting theories on the mechanisms of short‐term memory maintenance. Here, we summarize the key insights gained from these new experiments and critically evaluate them in light of three hypotheses: classical persistent activity, activity‐silent, and dynamic coding. The experiments discussed include the first direct demonstration of persistently active neurons in the human medial temporal lobe that form static attractors with relevance to WM, single‐neuron recordings in the macaque prefrontal cortex that show evidence for both persistent and more dynamic types of WM representations, and noninvasive neuroimaging in humans that argues for activity‐silent representations. A key insight that emerges from these new results is that there are several neural mechanisms that support the maintenance of information in WM. Finally, based on established cognitive theories of WM, we propose a coherent model that encompasses these seemingly contradictory results. We propose that the three neuronal mechanisms of persistent activity, activity‐silent, and dynamic coding map well onto the cognitive levels of information processing (within focus of attention, activated long‐term memory, and central executive) that Cowan's WM model proposes.
Collapse
Affiliation(s)
- Jan Kamiński
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, California.,Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, California
| | - Ueli Rutishauser
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, California.,Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, California.,Department of Neurology, Cedars-Sinai Medical Center, Los Angeles, California.,Center for Neural Science and Medicine, Department of Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California
| |
Collapse
|
50
|
Martinez RH, Lansner A, Herman P. Probabilistic associative learning suffices for learning the temporal structure of multiple sequences. PLoS One 2019; 14:e0220161. [PMID: 31369571 PMCID: PMC6675053 DOI: 10.1371/journal.pone.0220161] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2019] [Accepted: 07/08/2019] [Indexed: 11/19/2022] Open
Abstract
From memorizing a musical tune to navigating a well known route, many of our underlying behaviors have a strong temporal component. While the mechanisms behind the sequential nature of the underlying brain activity are likely multifarious and multi-scale, in this work we attempt to characterize to what degree some of this properties can be explained as a consequence of simple associative learning. To this end, we employ a parsimonious firing-rate attractor network equipped with the Hebbian-like Bayesian Confidence Propagating Neural Network (BCPNN) learning rule relying on synaptic traces with asymmetric temporal characteristics. The proposed network model is able to encode and reproduce temporal aspects of the input, and offers internal control of the recall dynamics by gain modulation. We provide an analytical characterisation of the relationship between the structure of the weight matrix, the dynamical network parameters and the temporal aspects of sequence recall. We also present a computational study of the performance of the system under the effects of noise for an extensive region of the parameter space. Finally, we show how the inclusion of modularity in our network structure facilitates the learning and recall of multiple overlapping sequences even in a noisy regime.
Collapse
Affiliation(s)
- Ramon H. Martinez
- Computational Brain Science Lab, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Anders Lansner
- Computational Brain Science Lab, KTH Royal Institute of Technology, Stockholm, Sweden
- Mathematics Department, Stockholm University, Stockholm, Sweden
| | - Pawel Herman
- Computational Brain Science Lab, KTH Royal Institute of Technology, Stockholm, Sweden
| |
Collapse
|