Place cell rate remapping by CA3 recurrent collaterals

Time Makes Space: Emergence of Place Fields in Networks Encoding Temporally Continuous Sensory Experiences

The vertebrate hippocampus is believed to use recurrent connectivity in area CA3 to support episodic memory recall from partial cues. This brain area also contains place cells, whose location-selective firing fields implement maps supporting spatial memory. Here we show that place cells emerge in networks trained to remember temporally continuous sensory episodes. We model CA3 as a recurrent autoencoder that recalls and reconstructs sensory experiences from noisy and partially occluded observations by agents traversing simulated arenas. The agents move in realistic trajectories modeled from rodents and environments are modeled as continuously varying, high-dimensional, sensory experience maps (spatially smoothed Gaussian random fields). Training our autoencoder to accurately pattern-complete and reconstruct sensory experiences with a constraint on total activity causes spatially localized firing fields, i.e., place cells, to emerge in the encoding layer. The emergent place fields reproduce key aspects of hippocampal phenomenology: a) remapping (maintenance of and reversion to distinct learned maps in different environments), implemented via repositioning of experience manifolds in the network's hidden layer, b) orthogonality of spatial representations in different arenas, c) robust place field emergence in differently shaped rooms, with single units showing multiple place fields in large or complex spaces, and d) slow representational drift of place fields. We argue that these results arise because continuous traversal of space makes sensory experience temporally continuous. We make testable predictions: a) rapidly changing sensory context will disrupt place fields, b) place fields will form even if recurrent connections are blocked, but reversion to previously learned representations upon remapping will be abolished, c) the dimension of temporally smooth experience sets the dimensionality of place fields, including during virtual navigation of abstract spaces.

Rapid learning of spatial representations for goal-directed navigation based on a novel model of hippocampal place fields

The discovery of place cells and other spatially modulated neurons in the hippocampal complex of rodents has been crucial to elucidating the neural basis of spatial cognition. More recently, the replay of neural sequences encoding previously experienced trajectories has been observed during consummatory behavior-potentially with implications for rapid learning, quick memory consolidation, and behavioral planning. Several promising models for robotic navigation and reinforcement learning have been proposed based on these and previous findings. Most of these models, however, use carefully engineered neural networks, and sometimes require long learning periods. In this paper, we present a self-organizing model incorporating place cells and replay, and demonstrate its utility for rapid one-shot learning in non-trivial environments with obstacles.

Decreased cognitive function of ALG13KO female mice may be related to the decreased plasticity of hippocampal neurons

Asparagine-linked glycosylation 13 (ALG13) is an X-linked gene that encodes a protein involved in the glycosylation of the N-terminus. ALG13 deficiency leads to ALG13-congenital disorders of glycosylation (ALG13-CDG), usually in females presenting with mental retardation and epilepsy. Cognitive function is an important function of the hippocampus, and forms the basis for learning, memory and social abilities. However, researchers have not yet investigated the effect of ALG13 on hippocampal cognitive function. In this study, the exploration, learning, memory and social abilities of ALG13 knockout (KO) female mice were decreased in behavioral experiments. Golgi staining demonstrated a decrease in the complexity of hippocampal neurons. Western blot and immunofluorescence staining of the synaptic plasticity factors postsynaptic density protein 95 (PSD95) and synaptophysin (SYP) displayed varying degrees of decline. In other words, the KO of ALG13 may have reduced the expression of PSD95 and SYP in the hippocampus of female mice. Moreover, it may have lowered the synaptic plasticity in various areas of the hippocampus, thus resulting in decreased dendrite length, complexity, and dendrite spine density, which affected the hippocampal function and reduced the cognitive function in female mice.

Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity

Bottom-up models of functionally relevant patterns of neural activity provide an explicit link between neuronal dynamics and computation. A prime example of functional activity patterns are propagating bursts of place-cell activities called hippocampal replay, which is critical for memory consolidation. The sudden and repeated occurrences of these burst states during ongoing neural activity suggest metastable neural circuit dynamics. As metastability has been attributed to noise and/or slow fatigue mechanisms, we propose a concise mesoscopic model which accounts for both. Crucially, our model is bottom-up: it is analytically derived from the dynamics of finite-size networks of Linear-Nonlinear Poisson neurons with short-term synaptic depression. As such, noise is explicitly linked to stochastic spiking and network size, and fatigue is explicitly linked to synaptic dynamics. To derive the mesoscopic model, we first consider a homogeneous spiking neural network and follow the temporal coarse-graining approach of Gillespie to obtain a "chemical Langevin equation", which can be naturally interpreted as a stochastic neural mass model. The Langevin equation is computationally inexpensive to simulate and enables a thorough study of metastable dynamics in classical setups (population spikes and Up-Down-states dynamics) by means of phase-plane analysis. An extension of the Langevin equation for small network sizes is also presented. The stochastic neural mass model constitutes the basic component of our mesoscopic model for replay. We show that the mesoscopic model faithfully captures the statistical structure of individual replayed trajectories in microscopic simulations and in previously reported experimental data. Moreover, compared to the deterministic Romani-Tsodyks model of place-cell dynamics, it exhibits a higher level of variability regarding order, direction and timing of replayed trajectories, which seems biologically more plausible and could be functionally desirable. This variability is the product of a new dynamical regime where metastability emerges from a complex interplay between finite-size fluctuations and local fatigue.

Rapid synaptic plasticity contributes to a learned conjunctive code of position and choice-related information in the hippocampus

To successfully perform goal-directed navigation, animals must know where they are and what they are doing-e.g., looking for water, bringing food back to the nest, or escaping from a predator. Hippocampal neurons code for these critical variables conjunctively, but little is known about how this "where/what" code is formed or flexibly routed to other brain regions. To address these questions, we performed intracellular whole-cell recordings in mouse CA1 during a cued, two-choice virtual navigation task. We demonstrate that plateau potentials in CA1 pyramidal neurons rapidly strengthen synaptic inputs carrying conjunctive information about position and choice. Plasticity-induced response fields were modulated by cues only in animals previously trained to collect rewards based on available cues. Thus, we reveal that gradual learning is required for the formation of a conjunctive population code, upstream of CA1, while plateau-potential-induced synaptic plasticity in CA1 enables flexible routing of the code to downstream brain regions.

Hippocampal cells integrate past memory and present perception for the future

The ability to use stored information in a highly flexible manner is a defining feature of the declarative memory system. However, the neuronal mechanisms underlying this flexibility are poorly understood. To address this question, we recorded single-unit activity from the hippocampus of 2 nonhuman primates performing a newly devised task requiring the monkeys to retrieve long-term item-location association memory and then use it flexibly in different circumstances. We found that hippocampal neurons signaled both mnemonic information representing the retrieved location and perceptual information representing the external circumstance. The 2 signals were combined at a single-neuron level to construct goal-directed information by 3 sequentially occurring neuronal operations (e.g., convergence, transference, and targeting) in the hippocampus. Thus, flexible use of knowledge may be supported by the hippocampal constructive process linking memory and perception, which may fit the mnemonic information into the current situation to present manageable information for a subsequent action.

This study reveals that three neuronal operations in the macaque hippocampus combine retrieved memory and incoming perceptual information to construct goal-directed information; this constructive memory process may equip us to use past knowledge flexibly according to the current situation.

A Brain-Inspired Adaptive Space Representation Model Based on Grid Cells and Place Cells

Grid cells and place cells are important neurons in the animal brain. The information transmission between them provides the basis for the spatial representation and navigation of animals and also provides reference for the research on the autonomous navigation mechanism of intelligent agents. Grid cells are important information source of place cells. The supervised learning and unsupervised learning models can be used to simulate the generation of place cells from grid cell inputs. However, the existing models preset the firing characteristics of grid cell. In this paper, we propose a united generation model of grid cells and place cells. First, the visual place cells with nonuniform distribution generate the visual grid cells with regional firing field through feedforward network. Second, the visual grid cells and the self-motion information generate the united grid cells whose firing fields extend to the whole space through genetic algorithm. Finally, the visual place cells and the united grid cells generate the united place cells with uniform distribution through supervised fuzzy adaptive resonance theory (ART) network. Simulation results show that this model has stronger environmental adaptability and can provide reference for the research on spatial representation model and brain-inspired navigation mechanism of intelligent agents under the condition of nonuniform environmental information.

Retrieval of spatial representation on network level in hippocampal CA3 accompanied by overexpression and mixture of stored network patterns

Retrieval of stored network activity pattern has been shown as a competitive transition from one attractor state to another, orchestrated by local theta oscillation. However, the fine nature of this process that is considered as substrate of memory recall is not clear. We found that hippocampal network recall is characterized by hyperactivity in the CA3 place cell population, associated with an “overexpression” of the retrieved network pattern. The overexpression was based on recruitment of cells from the same (recalled) spatial representation with low expected firing probability at the given position. We propose that increased place cell activation during state transitions might facilitate pattern completion towards the retrieved network state and stabilize its expression in the network. Furthermore, we observed frequent mixing of both activity patterns at the temporal level of a single theta cycle. On a sub-theta cycle scale, we found signs of segregation that might correspond to a gamma oscillation patterning, as well as occasional mixing at intervals of less than 5 milliseconds. Such short timescale coactivity might induce plasticity mechanisms, leading to associations across the two originally decorrelated network activity states.

Fast and flexible sequence induction in spiking neural networks via rapid excitability changes

Cognitive flexibility likely depends on modulation of the dynamics underlying how biological neural networks process information. While dynamics can be reshaped by gradually modifying connectivity, less is known about mechanisms operating on faster timescales. A compelling entrypoint to this problem is the observation that exploratory behaviors can rapidly cause selective hippocampal sequences to 'replay' during rest. Using a spiking network model, we asked whether simplified replay could arise from three biological components: fixed recurrent connectivity; stochastic 'gating' inputs; and rapid gating input scaling via long-term potentiation of intrinsic excitability (LTP-IE). Indeed, these enabled both forward and reverse replay of recent sensorimotor-evoked sequences, despite unchanged recurrent weights. LTP-IE 'tags' specific neurons with increased spiking probability under gating input, and ordering is reconstructed from recurrent connectivity. We further show how LTP-IE can implement temporary stimulus-response mappings. This elucidates a novel combination of mechanisms that might play a role in rapid cognitive flexibility.

Hexagonal Grid Fields Optimally Encode Transitions in Spatiotemporal Sequences

Grid cells of the rodent entorhinal cortex are essential for spatial navigation. Although their function is commonly believed to be either path integration or localization, the origin or purpose of their hexagonal firing fields remains disputed. Here they are proposed to arise as an optimal encoding of transitions in sequences. First, storage requirements for transitions in general episodic sequences are examined using propositional logic and graph theory. Subsequently, transitions in complete metric spaces are considered under the assumption of an ideal sampling of an input space. It is shown that memory capacity of neurons that have to encode multiple feasible spatial transitions is maximized by a hexagonal pattern. Grid cells are proposed to encode spatial transitions in spatiotemporal sequences, with the entorhinal-hippocampal loop forming a multitransition system.

Analysis of an Attractor Neural Network's Response to Conflicting External Inputs

The theory of attractor neural networks has been influential in our understanding of the neural processes underlying spatial, declarative, and episodic memory. Many theoretical studies focus on the inherent properties of an attractor, such as its structure and capacity. Relatively little is known about how an attractor neural network responds to external inputs, which often carry conflicting information about a stimulus. In this paper we analyze the behavior of an attractor neural network driven by two conflicting external inputs. Our focus is on analyzing the emergent properties of the megamap model, a quasi-continuous attractor network in which place cells are flexibly recombined to represent a large spatial environment. In this model, the system shows a sharp transition from the winner-take-all mode, which is characteristic of standard continuous attractor neural networks, to a combinatorial mode in which the equilibrium activity pattern combines embedded attractor states in response to conflicting external inputs. We derive a numerical test for determining the operational mode of the system a priori. We then derive a linear transformation from the full megamap model with thousands of neurons to a reduced 2-unit model that has similar qualitative behavior. Our analysis of the reduced model and explicit expressions relating the parameters of the reduced model to the megamap elucidate the conditions under which the combinatorial mode emerges and the dynamics in each mode given the relative strength of the attractor network and the relative strength of the two conflicting inputs. Although we focus on a particular attractor network model, we describe a set of conditions under which our analysis can be applied to more general attractor neural networks.

Reactivation of Rate Remapping in CA3

The hippocampus is thought to contribute to episodic memory by creating, storing, and reactivating patterns that are unique to each experience, including different experiences that happen at the same location. Hippocampus can combine spatial and contextual/episodic information using a dual coding scheme known as "global" and "rate" remapping. Global remapping selects which set of neurons can activate at a given location. Rate remapping readjusts the firing rates of this set depending on current experience, thus expressing experience-unique patterns at each location. But can the experience-unique component be retrieved spontaneously? Whereas reactivation of recent, spatially selective patterns in hippocampus is well established, it is never perfect, raising the issue of whether the experiential component might be absent. This question is key to the hypothesis that hippocampus can assist memory consolidation by reactivating and broadcasting experience-specific "index codes" to neocortex. In CA3, global remapping exhibits attractor-like dynamics, whereas rate remapping apparently does not, leading to the hypothesis that only the former can be retrieved associatively and casting doubt on the general consolidation hypothesis. Therefore, we studied whether the rate component is reactivated spontaneously during sleep. We conducted neural ensemble recordings from CA3 while rats ran on a circular track in different directions (in different sessions) and while they slept. It was shown previously that the two directions of running result in strong rate remapping. During sleep, the most recent rate distribution was reactivated preferentially. Therefore, CA3 can retrieve patterns spontaneously that are unique to both the location and the content of recent experience.

SIGNIFICANCE STATEMENT

The hippocampus is required for memory of events and their spatial contexts. The primary correlate of hippocampal activity is location in space, but multiple memories can occur in the same location. To be useful for distinguishing these memories, the hippocampus must be able, not only to express, but also to retrieve both spatial and nonspatial information about events. Whether it can retrieve nonspatial information has been challenged recently. We exposed rats to two different experiences (running in different directions) in the same locations and showed that even the nonspatial components of hippocampal cell firing are reactivated spontaneously during sleep, supporting the conclusion that both types of information about a recent experience can be retrieved.

Place and Grid Cells in a Loop: Implications for Memory Function and Spatial Coding

Place cells in the hippocampus and grid cells in the medial entorhinal cortex have different codes for space. However, how one code relates to the other is ill understood. Based on the anatomy of the entorhinal-hippocampal circuitry, we constructed a model of place and grid cells organized in a loop to investigate their mutual influence in the establishment of their codes for space. Using computer simulations, we first replicated experiments in rats that measured place and grid cell activity in different environments, and then assessed which features of the model account for different phenomena observed in neurophysiological data, such as pattern completion and pattern separation, global and rate remapping of place cells, and realignment of grid cells. We found that (1) the interaction between grid and place cells converges quickly; (2) the spatial code of place cells does not require, but is altered by, grid cell input; (3) plasticity in sensory inputs to place cells is key for pattern completion but not pattern separation; (4) grid realignment can be explained in terms of place cell remapping as opposed to the other way around; (5) the switch between global and rate remapping is self-organized; and (6) grid cell input to place cells helps stabilize their code under noisy and/or inconsistent sensory input. We conclude that the hippocampus-entorhinal circuit uses the mutual interaction of place and grid cells to encode the surrounding environment and propose a theory on how such interdependence underlies the formation and use of the cognitive map.SIGNIFICANCE STATEMENT The mammalian brain implements a positional system with two key pieces: place and grid cells. To gain insight into the dynamics of place and grid cell interaction, we built a computational model with the two cell types organized in a loop. The proposed model accounts for differences in how place and grid cells represent different environments and provides a new interpretation in which place and grid cells mutually interact to form a coupled code for space.

Gamma Synchronization Influences Map Formation Time in a Topological Model of Spatial Learning

The mammalian hippocampus plays a crucial role in producing a cognitive map of space-an internalized representation of the animal's environment. We have previously shown that it is possible to model this map formation using a topological framework, in which information about the environment is transmitted through the temporal organization of neuronal spiking activity, particularly those occasions in which the firing of different place cells overlaps. In this paper, we discuss how gamma rhythm, one of the main components of the extracellular electrical field potential affects the efficiency of place cell map formation. Using methods of algebraic topology and the maximal entropy principle, we demonstrate that gamma modulation synchronizes the spiking of dynamical cell assemblies, which enables learning a spatial map at faster timescales.

Asymmetry of Neuronal Combinatorial Codes Arises from Minimizing Synaptic Weight Change

Synaptic change is a costly resource, particularly for brain structures that have a high demand of synaptic plasticity. For example, building memories of object positions requires efficient use of plasticity resources since objects can easily change their location in space and yet we can memorize object locations. But how should a neural circuit ideally be set up to integrate two input streams (object location and identity) in case the overall synaptic changes should be minimized during ongoing learning? This letter provides a theoretical framework on how the two input pathways should ideally be specified. Generally the model predicts that the information-rich pathway should be plastic and encoded sparsely, whereas the pathway conveying less information should be encoded densely and undergo learning only if a neuronal representation of a novel object has to be established. As an example, we consider hippocampal area CA1, which combines place and object information. The model thereby provides a normative account of hippocampal rate remapping, that is, modulations of place field activity by changes of local cues. It may as well be applicable to other brain areas (such as neocortical layer V) that learn combinatorial codes from multiple input streams.

Megamap: flexible representation of a large space embedded with nonspatial information by a hippocampal attractor network

The problem of how the hippocampus encodes both spatial and nonspatial information at the cellular network level remains largely unresolved. Spatial memory is widely modeled through the theoretical framework of attractor networks, but standard computational models can only represent spaces that are much smaller than the natural habitat of an animal. We propose that hippocampal networks are built on a basic unit called a "megamap," or a cognitive attractor map in which place cells are flexibly recombined to represent a large space. Its inherent flexibility gives the megamap a huge representational capacity and enables the hippocampus to simultaneously represent multiple learned memories and naturally carry nonspatial information at no additional cost. On the other hand, the megamap is dynamically stable, because the underlying network of place cells robustly encodes any location in a large environment given a weak or incomplete input signal from the upstream entorhinal cortex. Our results suggest a general computational strategy by which a hippocampal network enjoys the stability of attractor dynamics without sacrificing the flexibility needed to represent a complex, changing world.

Grid Cells and Place Cells: An Integrated View of their Navigational and Memory Function

Much has been learned about the hippocampal/entorhinal system, but an overview of how its parts work in an integrated way is lacking. One question regards the function of entorhinal grid cells. We propose here that their fundamental function is to provide a coordinate system for producing mind-travel in the hippocampus, a process that accesses associations with upcoming positions. We further propose that mind-travel occurs during the second half of each theta cycle. By contrast, the first half of each theta cycle is devoted to computing current position using sensory information from the lateral entorhinal cortex (LEC) and path integration information from the medial entorhinal cortex (MEC). This model explains why MEC lesions can abolish hippocampal phase precession but not place fields.