1
|
Kopsick JD, Kilgore JA, Adam GC, Ascoli GA. Formation and Retrieval of Cell Assemblies in a Biologically Realistic Spiking Neural Network Model of Area CA3 in the Mouse Hippocampus. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.27.586909. [PMID: 38585941 PMCID: PMC10996657 DOI: 10.1101/2024.03.27.586909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
The hippocampal formation is critical for episodic memory, with area Cornu Ammonis 3 (CA3) a necessary substrate for auto-associative pattern completion. Recent theoretical and experimental evidence suggests that the formation and retrieval of cell assemblies enable these functions. Yet, how cell assemblies are formed and retrieved in a full-scale spiking neural network (SNN) of CA3 that incorporates the observed diversity of neurons and connections within this circuit is not well understood. Here, we demonstrate that a data-driven SNN model quantitatively reflecting the neuron type-specific population sizes, intrinsic electrophysiology, connectivity statistics, synaptic signaling, and long-term plasticity of the mouse CA3 is capable of robust auto-association and pattern completion via cell assemblies. Our results show that a broad range of assembly sizes could successfully and systematically retrieve patterns from heavily incomplete or corrupted cues after a limited number of presentations. Furthermore, performance was robust with respect to partial overlap of assemblies through shared cells, substantially enhancing memory capacity. These novel findings provide computational evidence that the specific biological properties of the CA3 circuit produce an effective neural substrate for associative learning in the mammalian brain.
Collapse
Affiliation(s)
- Jeffrey D. Kopsick
- Center for Neural Informatics, Structures, & Plasticity, College of Engineering and Computing, George Mason University, Fairfax, VA, United States
- Interdisciplinary Program in Neuroscience, College of Science, George Mason University, Fairfax, VA, United States
| | - Joseph A. Kilgore
- Department of Electrical and Computer Engineering, George Washington University, Washington, D.C., United States
| | - Gina C. Adam
- Department of Electrical and Computer Engineering, George Washington University, Washington, D.C., United States
| | - Giorgio A. Ascoli
- Center for Neural Informatics, Structures, & Plasticity, College of Engineering and Computing, George Mason University, Fairfax, VA, United States
- Interdisciplinary Program in Neuroscience, College of Science, George Mason University, Fairfax, VA, United States
- Bioengineering Department, College of Engineering and Computing, George Mason University, Fairfax, VA, United States
| |
Collapse
|
2
|
Rolls ET. Spatial coordinate transforms linking the allocentric hippocampal and egocentric parietal primate brain systems for memory, action in space, and navigation. Hippocampus 2019; 30:332-353. [PMID: 31697002 DOI: 10.1002/hipo.23171] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2019] [Revised: 10/05/2019] [Accepted: 10/09/2019] [Indexed: 01/03/2023]
Abstract
A theory and model of spatial coordinate transforms in the dorsal visual system through the parietal cortex that enable an interface via posterior cingulate and related retrosplenial cortex to allocentric spatial representations in the primate hippocampus is described. First, a new approach to coordinate transform learning in the brain is proposed, in which the traditional gain modulation is complemented by temporal trace rule competitive network learning. It is shown in a computational model that the new approach works much more precisely than gain modulation alone, by enabling neurons to represent the different combinations of signal and gain modulator more accurately. This understanding may have application to many brain areas where coordinate transforms are learned. Second, a set of coordinate transforms is proposed for the dorsal visual system/parietal areas that enables a representation to be formed in allocentric spatial view coordinates. The input stimulus is merely a stimulus at a given position in retinal space, and the gain modulation signals needed are eye position, head direction, and place, all of which are present in the primate brain. Neurons that encode the bearing to a landmark are involved in the coordinate transforms. Part of the importance here is that the coordinates of the allocentric view produced in this model are the same as those of spatial view cells that respond to allocentric view recorded in the primate hippocampus and parahippocampal cortex. The result is that information from the dorsal visual system can be used to update the spatial input to the hippocampus in the appropriate allocentric coordinate frame, including providing for idiothetic update to allow for self-motion. It is further shown how hippocampal spatial view cells could be useful for the transform from hippocampal allocentric coordinates to egocentric coordinates useful for actions in space and for navigation.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK.,Department of Computer Science, University of Warwick, Coventry, UK
| |
Collapse
|
3
|
Kumaran D, Hassabis D, McClelland JL. What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated. Trends Cogn Sci 2018; 20:512-534. [PMID: 27315762 DOI: 10.1016/j.tics.2016.05.004] [Citation(s) in RCA: 222] [Impact Index Per Article: 37.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2015] [Revised: 04/22/2016] [Accepted: 05/03/2016] [Indexed: 12/17/2022]
Abstract
We update complementary learning systems (CLS) theory, which holds that intelligent agents must possess two learning systems, instantiated in mammalians in neocortex and hippocampus. The first gradually acquires structured knowledge representations while the second quickly learns the specifics of individual experiences. We broaden the role of replay of hippocampal memories in the theory, noting that replay allows goal-dependent weighting of experience statistics. We also address recent challenges to the theory and extend it by showing that recurrent activation of hippocampal traces can support some forms of generalization and that neocortical learning can be rapid for information that is consistent with known structure. Finally, we note the relevance of the theory to the design of artificial intelligent agents, highlighting connections between neuroscience and machine learning.
Collapse
Affiliation(s)
- Dharshan Kumaran
- Google DeepMind, 5 New Street Square, London EC4A 3TW, UK; Institute of Cognitive Neuroscience, University College London, 17 Queen Square, WC1N 3AR, UK.
| | - Demis Hassabis
- Google DeepMind, 5 New Street Square, London EC4A 3TW, UK; Gatsby Computational Neuroscience Unit, 17 Queen Square, London WC1N 3AR, UK.
| | - James L McClelland
- Department of Psychology and Center for Mind, Brain, and Computation, Stanford University, 450 Serra Mall, CA 94305, USA.
| |
Collapse
|
4
|
Kassab R, Alexandre F. Pattern separation in the hippocampus: distinct circuits under different conditions. Brain Struct Funct 2018; 223:2785-2808. [PMID: 29637298 DOI: 10.1007/s00429-018-1659-4] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2017] [Accepted: 03/26/2018] [Indexed: 10/17/2022]
Abstract
Pattern separation is a fundamental hippocampal process thought to be critical for distinguishing similar episodic memories, and has long been recognized as a natural function of the dentate gyrus (DG), supporting autoassociative learning in CA3. Understanding how neural circuits within the DG-CA3 network mediate this process has received much interest, yet the exact mechanisms behind remain elusive. Here, we argue for the case that sparse coding is necessary but not sufficient to ensure efficient separation and, alternatively, propose a possible interaction of distinct circuits which, nevertheless, act in synergy to produce a unitary function of pattern separation. The proposed circuits involve different functional granule-cell populations, a primary population mediates sparsification and provides recurrent excitation to the other populations which are related to additional pattern separation mechanisms with higher degrees of robustness against interference in CA3. A variety of top-down and bottom-up factors, such as motivation, emotion, and pattern similarity, control the selection of circuitry depending on circumstances. According to this framework, a computational model is implemented and tested against model variants in a series of numerical simulations and biological experiments. The results demonstrate that the model combines fast learning, robust pattern separation and high storage capacity. It also accounts for the controversy around the involvement of the DG during memory recall, explains other puzzling findings, and makes predictions that can inform future investigations.
Collapse
Affiliation(s)
- Randa Kassab
- INRIA, Bordeaux Sud-Ouest, Talence, France. .,Institut des Maladies Neurodégénératives, University of Bordeaux, CNRS UMR 5293-Case 28, Centre Broca Nouvelle-Aquitaine, 146 rue Léo Saignat, 33076, Bordeaux, France. .,LaBRI, UMR 5800, CNRS, Bordeaux INP, University of Bordeaux, Talence, France.
| | - Frédéric Alexandre
- INRIA, Bordeaux Sud-Ouest, Talence, France.,Institut des Maladies Neurodégénératives, University of Bordeaux, CNRS UMR 5293-Case 28, Centre Broca Nouvelle-Aquitaine, 146 rue Léo Saignat, 33076, Bordeaux, France.,LaBRI, UMR 5800, CNRS, Bordeaux INP, University of Bordeaux, Talence, France
| |
Collapse
|
5
|
Evidence for functional specialization of hippocampal subfields detected by MR subfield volumetry on high resolution images at 4 T. Neuroimage 2011; 56:851-7. [PMID: 21419225 DOI: 10.1016/j.neuroimage.2011.03.028] [Citation(s) in RCA: 101] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2010] [Revised: 03/08/2011] [Accepted: 03/10/2011] [Indexed: 11/23/2022] Open
Abstract
Animal studies suggest an involvement of CA3 and dentate gyrus (CA3&DG) in memory encoding and early retrieval and an involvement of CA1 in late retrieval, consolidation and recognition. The aim of this study was to test if similar associations could be found between hippocampal subfield volumes measured in vivo using a manual parcellation scheme and selected scores of the California Verbal Learning Test II (CVLTII): total immediate free recall discriminability (IFRD), short free recall discriminability (SFRD), and delayed recall discriminability (DRD). 50 elderly subjects (25 controls and 25 cognitively impaired subjects) had CVLTII and high resolution hippocampal MRI at 4T. Entorhinal cortex, subiculum, CA1, CA1-CA2 transition zone, and CA3&DG were manually marked on five slices in the anterior hippocampal body on the MRI. Pearson correlations followed by stepwise regression analysis were used to test for associations between subfield volumes and CVLTII. IFRD and SFRD, which are measures of encoding/early retrieval, were associated with CA3&DG, and DRD, which measures consolidation/late retrieval, with CA1. These preliminary findings demonstrate that subfield volumetry has the potential to study non invasively subfield specific memory functions.
Collapse
|
6
|
Kumaran D, Maguire EA. Novelty signals: a window into hippocampal information processing. Trends Cogn Sci 2009; 13:47-54. [PMID: 19135404 DOI: 10.1016/j.tics.2008.11.004] [Citation(s) in RCA: 137] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2008] [Revised: 11/04/2008] [Accepted: 11/06/2008] [Indexed: 12/11/2022]
Abstract
The function of the human hippocampus is a contentious subject among neuroscientists. Theoreticians have long viewed the hippocampus as a computational device, with researchers in humans increasingly adopting this perspective, buoyed by recent reports that its role is not limited to declarative memory. Here, we set out a new strategy for discovering the nature of information processing within the human hippocampus. We argue that novelty responses, measured by functional magnetic resonance imaging, provide a window into the neural representations and computations sustained by the hippocampus. More generally, we suggest that a renewed emphasis on the information processing qualities of the human hippocampus offers the promise of a long awaited union between theoretical and empirical research across species.
Collapse
Affiliation(s)
- Dharshan Kumaran
- Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK.
| | | |
Collapse
|
7
|
Koene RA, Hasselmo ME. Reversed and forward buffering of behavioral spike sequences enables retrospective and prospective retrieval in hippocampal regions CA3 and CA1. Neural Netw 2007; 21:276-88. [PMID: 18242057 DOI: 10.1016/j.neunet.2007.12.029] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2007] [Revised: 12/04/2007] [Accepted: 12/11/2007] [Indexed: 10/22/2022]
Abstract
We propose a mechanism to explain both retrospective and prospective recall activity found in experimental data from hippocampal regions CA3 and CA1. Our model of temporal context dependent episodic memory replicates reverse recall in CA1, as recently recorded and published [Foster, D., & Wilson, M. (2006). Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature, 440, 680-683], as well as the prospective and retrospective activity recorded in region CA3 during spatial tasks [Johnson, A., & Redish, A. (2006). Neural ensembles in ca3 transiently encode paths forward of the animal at a decision point: a possible mechanism for the consideration of alternatives. In 2006 neuroscience meeting planner. Atlanta, GA: Society for Neuroscience. (Program no. 574.2)]. We suppose that CA3 encodes episodic memory of both forward and reversed sequences of perforant path spikes representing place input. Using a persistent firing buffer mechanism in layer II of entorhinal cortex, simulated episodic learning involves dentate gyrus, layer III of entorhinal cortex, and hippocampal regions CA3 and CA1. Associations are formed between buffered episodic cues, unique temporal context specific representations in dentate gyrus, and episodic memory in the CA3 recurrent network.
Collapse
Affiliation(s)
- Randal A Koene
- Center for Memory and Brain, Department of Psychology, Boston University, Boston, MA 02215, USA.
| | | |
Collapse
|
8
|
Abstract
Models of hippocampal function suggest that the modulation of CA3 afferent input during theta rhythm allows for a rapid alternation between encoding and retrieval states, with each phase enhancing either extrinsic or intrinsic CA3 afferents, favoring either encoding or retrieval, respectively. Here, we show that during the initial exploration of a novel environment by rats, intrinsic CA3-CA3 synaptic inputs are attenuated on CA3 theta peaks, favoring extrinsic CA3 inputs, whereas extrinsic perforant path-CA3 synaptic inputs are attenuated on CA3 theta troughs, favoring intrinsic CA3 inputs. This modulation is absent when animals are re-exposed to the same environment 2 or 48 h later and thus habituates with familiarity, suggesting a process involved in learning. Modulation of CA3 synaptic inputs during novelty was blocked by atropine at a dose that blocks type 2 theta rhythm. Re-exposure to the same novel environment 48 h later in the absence of atropine did not result in habituation, but instead modulated CA3 synaptic responses as though the environment were novel and explored for the first time. The NMDA receptor antagonist (+/-)-3-(2-carboxypiperazin-4-yl)propyl-1-phosphonic acid (CPP), administered in a dose that blocks long-term potentiation induction, did not alter CA3 synaptic modulation during initial exploration. However, like atropine, CPP blocked the habituation of synaptic modulation normally observed with re-exposure, as though the environment were novel and explored for the first time. Thus, as predicted theoretically, recurrent and cortical CA3 afferents are differentially modulated during phases of theta rhythm. This modulation is atropine sensitive and habituates in an NMDA receptor-dependent manner, suggesting an NMDA receptor-dependent process that, in conjunction with theta rhythm, contributes to encoding of novel information in the hippocampus.
Collapse
|
9
|
Kumaran D, Maguire EA. An unexpected sequence of events: mismatch detection in the human hippocampus. PLoS Biol 2007; 4:e424. [PMID: 17132050 PMCID: PMC1661685 DOI: 10.1371/journal.pbio.0040424] [Citation(s) in RCA: 223] [Impact Index Per Article: 13.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2006] [Accepted: 10/11/2006] [Indexed: 11/19/2022] Open
Abstract
The ability to identify and react to novelty within the environment is fundamental to survival. Computational models emphasize the potential role of the hippocampus in novelty detection, its unique anatomical circuitry making it ideally suited to act as a comparator between past and present experience. The hippocampus, therefore, is viewed to detect associative mismatches between what is expected based on retrieval of past experience and current sensory input. However, direct evidence that the human hippocampus performs such operations is lacking. We explored brain responses to novel sequences of objects using functional magnetic resonance imaging (fMRI), while subjects performed an incidental target detection task. Our results demonstrate that hippocampal activation was maximal when prior predictions concerning which object would appear next in a sequence were violated by sensory reality. In so doing, we establish the biological reality of associative match-mismatch computations within the human hippocampus, a process widely held to play a cardinal role in novelty detection. Our results also suggest that the hippocampus may generate predictions about how future events will unfold, and critically detect when these expectancies are violated, even when task demands do not require it. The present study also offers broader insights into the nature of essential computations carried out by the hippocampus, which may also underpin its unique contribution to episodic memory.
Collapse
Affiliation(s)
- Dharshan Kumaran
- Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College London, London, United Kingdom.
| | | |
Collapse
|
10
|
Irvine EE, von Hertzen LSJ, Plattner F, Giese KP. alphaCaMKII autophosphorylation: a fast track to memory. Trends Neurosci 2006; 29:459-65. [PMID: 16806507 DOI: 10.1016/j.tins.2006.06.009] [Citation(s) in RCA: 75] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2005] [Revised: 03/20/2006] [Accepted: 06/08/2006] [Indexed: 11/29/2022]
Abstract
Alpha Ca(2+)/calmodulin-dependent kinase II (alphaCaMKII), the major synaptic protein in the forebrain, can switch into a state of autonomous activity upon autophosphorylation. It has been proposed that alphaCaMKII autophosphorylation mediates long-term memory (LTM) storage. However, recent evidence shows that synaptic stimulation and behavioural training only transiently increase the autonomous alphaCaMKII activity, implicating alphaCaMKII autophosphorylation in LTM formation rather than storage. Consistent with this, mutant mice deficient in alphaCaMKII autophosphorylation can store LTM after a massed training protocol, but cannot form LTM after a single trial. Here, we review evidence that the role of alphaCaMKII autophosphorylation is in fact to enable LTM formation after a single training trial, possibly by regulating LTM consolidation-specific transcription.
Collapse
Affiliation(s)
- Elaine E Irvine
- Wolfson Institute for Biomedical Research, University College London, Gower Street, London WC1E 6BT, UK
| | | | | | | |
Collapse
|
11
|
Wu Z, Yamaguchi Y. Conserving total synaptic weight ensures one-trial sequence learning of place fields in the hippocampus. Neural Netw 2005; 19:547-63. [PMID: 16153806 DOI: 10.1016/j.neunet.2005.06.048] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2004] [Revised: 06/07/2005] [Accepted: 06/07/2005] [Indexed: 11/20/2022]
Abstract
The hippocampus plays a critical role in the rapid acquisition of information from a novel experience. Recent theoretical studies on the rat hippocampus have shown the possibility of behavioral sequence learning in a single traversal experience by theta phase coding. Specifically, previous work using computer simulations demonstrated that the extent of overlap among individual events of sequence and rat running velocity should be quantitatively incorporated into the learning rule to ensure one-trial sequence learning. These extents of overlap- and running velocity-dependent properties in the learning rule are called the input-dependent regulation of the learning rule. However, the biological meaning of such learning properties remains poorly understood. In this study, we quantitatively derive these learning properties with mathematical analyses. We further find that the input-dependent regulation of the learning rule allows maintenance of total synaptic weight over a given neuron during one-trial learning. Our results predict that a homeostatic plasticity mechanism should exist for conserving total synaptic weight on a rapid timescale.
Collapse
Affiliation(s)
- Zhihua Wu
- Laboratory for Dynamics of Emergent Intelligence, RIKEN Brain Science Institute, 2-1, Hirosawa, Wako-shi, Saitama 351-0198, Japan.
| | | |
Collapse
|
12
|
Stewart MG, Davies HA, Sandi C, Kraev IV, Rogachevsky VV, Peddie CJ, Rodriguez JJ, Cordero MI, Donohue HS, Gabbott PLA, Popov VI. Stress suppresses and learning induces plasticity in CA3 of rat hippocampus: a three-dimensional ultrastructural study of thorny excrescences and their postsynaptic densities. Neuroscience 2005; 131:43-54. [PMID: 15680690 DOI: 10.1016/j.neuroscience.2004.10.031] [Citation(s) in RCA: 154] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/28/2004] [Indexed: 11/18/2022]
Abstract
Chronic stress and spatial training have been proposed to affect hippocampal structure and function in opposite ways. Previous morphological studies that addressed structural changes after chronic restraint stress and spatial training were based on two-dimensional morphometry which does not allow a complete morphometric characterisation of synaptic features. Here, for the first time in such studies, we examined these issues by using three-dimensional (3-D) reconstructions of electron microscope images taken from thorny excrescences of hippocampal CA3 pyramidal cells. Ultrastructural alterations in postsynaptic densities (PSDs) of thorny excrescences receiving input from mossy fibre boutons were also determined, as were changes in numbers of multivesicular bodies (endosome-like structures) within thorny excrescences and dendrites. Quantitative 3-D data demonstrated retraction of thorny excrescences after chronic restraint stress which was reversed after water maze training, whilst water maze training alone increased thorny excrescence volume and number of thorns per thorny excrescence. PSD surface area was unaffected by restraint stress but water maze training increased both number and area of PSDs per thorny excrescence. In restrained rats that were water maze trained PSD volume and surface area increased significantly. The proportion of perforated PSDs almost doubled after water maze training and restraint stress. Numbers of endosome-like structures in thorny excrescences decreased after restraint stress and increased after water maze training. These findings demonstrate that circuits involving contacts between mossy fibre terminals and CA3 pyramidal cells at stratum lucidum level are affected conversely by water maze training and chronic stress, confirming the remarkable plasticity of CA3 dendrites. They provide a clear illustration of the structural modifications that occur after life experiences noted for their different impact on hippocampal function.
Collapse
Affiliation(s)
- M G Stewart
- Department of Biological Sciences, The Open University, Walton Hall, Milton Keynes MK7 6AA, UK
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
13
|
Nakazawa K, McHugh TJ, Wilson MA, Tonegawa S. NMDA receptors, place cells and hippocampal spatial memory. Nat Rev Neurosci 2004; 5:361-72. [PMID: 15100719 DOI: 10.1038/nrn1385] [Citation(s) in RCA: 431] [Impact Index Per Article: 21.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Kazu Nakazawa
- Howard Hughes Medical Institute, The Picower Center for Learning and Memory, RIKEN-MIT Neuroscience Research Center, Center for Cancer Research, Cambridge, Massachusetts 02139, USA
| | | | | | | |
Collapse
|