Remembered reward locations restructure entorhinal spatial maps

Hippocampal place codes are gated by behavioral engagement

As animals explore an environment, the hippocampus is thought to automatically form and maintain a place code by combining sensory and self-motion signals. Instead, we observed an extensive degradation of the place code when mice voluntarily disengaged from a virtual navigation task, remarkably even as they continued to traverse the identical environment. Internal states, therefore, can strongly gate spatial maps and reorganize hippocampal activity even without sensory and self-motion changes.

The authors found that the expression of spatial maps in the hippocampus is modulated by the internal state of an animal. Thus, the brain’s code for spatial positions within an environment can transform even without changes to the external world.

Transforming Social Perspectives with Cognitive Maps

Growing evidence suggests that cognitive maps represent relations between social knowledge similar to how spatial locations are represented in an environment. Notably, the extant human medial temporal lobe literature assumes associations between social stimuli follow a linear associative mapping from an egocentric viewpoint to a cognitive map. Yet, this form of associative social memory doesn't account for a core phenomenon of social interactions in which social knowledge learned via comparisons to the self, other individuals, or social networks are assimilated within a single frame of reference. We argue that hippocampal-entorhinal coordinate transformations, known to integrate egocentric and allocentric spatial cues, inform social perspective switching between the self and others. We present evidence that the hippocampal formation helps inform social interactions by relating self versus other social attribute comparisons to society in general, which can afford rapid and flexible assimilation of knowledge about the relationship between the self and social networks of varying proximities. We conclude by discussing the ramifications of cognitive maps in aiding this social perspective transformation process in states of health and disease.

Toroidal topology of population activity in grid cells

The medial entorhinal cortex is part of a neural system for mapping the position of an individual within a physical environment¹. Grid cells, a key component of this system, fire in a characteristic hexagonal pattern of locations², and are organized in modules³ that collectively form a population code for the animal’s allocentric position¹. The invariance of the correlation structure of this population code across environments^4,5 and behavioural states^6,7, independent of specific sensory inputs, has pointed to intrinsic, recurrently connected continuous attractor networks (CANs) as a possible substrate of the grid pattern^1,8–11. However, whether grid cell networks show continuous attractor dynamics, and how they interface with inputs from the environment, has remained unclear owing to the small samples of cells obtained so far. Here, using simultaneous recordings from many hundreds of grid cells and subsequent topological data analysis, we show that the joint activity of grid cells from an individual module resides on a toroidal manifold, as expected in a two-dimensional CAN. Positions on the torus correspond to positions of the moving animal in the environment. Individual cells are preferentially active at singular positions on the torus. Their positions are maintained between environments and from wakefulness to sleep, as predicted by CAN models for grid cells but not by alternative feedforward models¹². This demonstration of network dynamics on a toroidal manifold provides a population-level visualization of CAN dynamics in grid cells.

Simultaneous recordings from hundreds of grid cells in rats, combined with topological data analysis, show that network activity in grid cells resides on a toroidal manifold that is invariant across environments and brain states.

Spatial goal coding in the hippocampal formation

The mammalian hippocampal formation contains several distinct populations of neurons involved in representing self-position and orientation. These neurons, which include place, grid, head direction, and boundary-vector cells, are thought to collectively instantiate cognitive maps supporting flexible navigation. However, to flexibly navigate, it is necessary to also maintain internal representations of goal locations, such that goal-directed routes can be planned and executed. Although it has remained unclear how the mammalian brain represents goal locations, multiple neural candidates have recently been uncovered during different phases of navigation. For example, during planning, sequential activation of spatial cells may enable simulation of future routes toward the goal. During travel, modulation of spatial cells by the prospective route, or by distance and direction to the goal, may allow maintenance of route and goal-location information, supporting navigation on an ongoing basis. As the goal is approached, an increased activation of spatial cells may enable the goal location to become distinctly represented within cognitive maps, aiding goal localization. Lastly, after arrival at the goal, sequential activation of spatial cells may represent the just-taken route, enabling route learning and evaluation. Here, we review and synthesize these and other evidence for goal coding in mammalian brains, relate the experimental findings to predictions from computational models, and discuss outstanding questions and future challenges.

Hippocampal representations of foraging trajectories depend upon spatial context

Animals learn trajectories to rewards in both spatial, navigational contexts and relational, non-navigational contexts. Synchronous reactivation of hippocampal activity is thought to be critical for recall and evaluation of trajectories for learning. Do hippocampal representations differentially contribute to experience-dependent learning of trajectories across spatial and relational contexts? In this study, we trained mice to navigate to a hidden target in a physical arena or manipulate a joystick to a virtual target to collect delayed rewards. In a navigational context, calcium imaging in freely moving mice revealed that synchronous CA1 reactivation was retrospective and important for evaluation of prior navigational trajectories. In a non-navigational context, reactivation was prospective and important for initiation of joystick trajectories, even in the same animals trained in both contexts. Adaptation of trajectories to a new target was well-explained by a common learning algorithm in which hippocampal activity makes dissociable contributions to reinforcement learning computations depending upon spatial context.

Fan cells in lateral entorhinal cortex directly influence medial entorhinal cortex through synaptic connections in layer 1

Standard models for spatial and episodic memory suggest that the lateral entorhinal cortex (LEC) and medial entorhinal cortex (MEC) send parallel independent inputs to the hippocampus, each carrying different types of information. Here, we evaluate the possibility that information is integrated between divisions of the entorhinal cortex prior to reaching the hippocampus. We demonstrate that, in mice, fan cells in layer 2 (L2) of LEC that receive neocortical inputs, and that project to the hippocampal dentate gyrus, also send axon collaterals to layer 1 (L1) of the MEC. Activation of inputs from fan cells evokes monosynaptic glutamatergic excitation of stellate and pyramidal cells in L2 of the MEC, typically followed by inhibition that contains fast and slow components mediated by GABA_A and GABA_B receptors, respectively. Inputs from fan cells also directly activate interneurons in L1 and L2 of MEC, with synaptic connections from L1 interneurons accounting for slow feedforward inhibition of L2 principal cell populations. The relative strength of excitation and inhibition following fan cell activation differs substantially between neurons and is largely independent of anatomical location. Our results demonstrate that the LEC, in addition to directly influencing the hippocampus, can activate or inhibit major hippocampal inputs arising from the MEC. Thus, local circuits in the superficial MEC may combine spatial information with sensory and higher order signals from the LEC, providing a substrate for integration of 'what' and 'where' components of episodic memories.

Bidirectional synaptic plasticity rapidly modifies hippocampal representations

Learning requires neural adaptations thought to be mediated by activity-dependent synaptic plasticity. A relatively non-standard form of synaptic plasticity driven by dendritic calcium spikes, or plateau potentials, has been reported to underlie place field formation in rodent hippocampal CA1 neurons. Here, we found that this behavioral timescale synaptic plasticity (BTSP) can also reshape existing place fields via bidirectional synaptic weight changes that depend on the temporal proximity of plateau potentials to pre-existing place fields. When evoked near an existing place field, plateau potentials induced less synaptic potentiation and more depression, suggesting BTSP might depend inversely on postsynaptic activation. However, manipulations of place cell membrane potential and computational modeling indicated that this anti-correlation actually results from a dependence on current synaptic weight such that weak inputs potentiate and strong inputs depress. A network model implementing this bidirectional synaptic learning rule suggested that BTSP enables population activity, rather than pairwise neuronal correlations, to drive neural adaptations to experience.

Effect of reward on electrophysiological signatures of grid cell population activity in human spatial navigation

The regular equilateral triangular periodic firing pattern of grid cells in the entorhinal cortex is considered a regular metric for the spatial world, and the grid-like representation correlates with hexadirectional modulation of theta (4-8 Hz) power in the entorhinal cortex relative to the moving direction. However, researchers have not clearly determined whether grid cells provide only simple spatial measures in human behavior-related navigation strategies or include other factors such as goal rewards to encode information in multiple patterns. By analysing the hexadirectional modulation of EEG signals in the theta band in the entorhinal cortex of patients with epilepsy performing spatial target navigation tasks, we found that this modulation presents a grid pattern that carries target-related reward information. This grid-like representation is influenced by explicit goals and is related to the local characteristics of the environment. This study provides evidence that human grid cell population activity is influenced by reward information at the level of neural oscillations.

The grid code for ordered experience

Entorhinal cortical grid cells fire in a periodic pattern that tiles space, which is suggestive of a spatial coordinate system. However, irregularities in the grid pattern as well as responses of grid cells in contexts other than spatial navigation have presented a challenge to existing models of entorhinal function. In this Perspective, we propose that hippocampal input provides a key informative drive to the grid network in both spatial and non-spatial circumstances, particularly around salient events. We build on previous models in which neural activity propagates through the entorhinal-hippocampal network in time. This temporal contiguity in network activity points to temporal order as a necessary characteristic of representations generated by the hippocampal formation. We advocate that interactions in the entorhinal-hippocampal loop build a topological representation that is rooted in the temporal order of experience. In this way, the structure of grid cell firing supports a learned topology rather than a rigid coordinate frame that is bound to measurements of the physical world.

Linear reinforcement learning in planning, grid fields, and cognitive control

It is thought that the brain’s judicious reuse of previous computation underlies our ability to plan flexibly, but also that inappropriate reuse gives rise to inflexibilities like habits and compulsion. Yet we lack a complete, realistic account of either. Building on control engineering, here we introduce a model for decision making in the brain that reuses a temporally abstracted map of future events to enable biologically-realistic, flexible choice at the expense of specific, quantifiable biases. It replaces the classic nonlinear, model-based optimization with a linear approximation that softly maximizes around (and is weakly biased toward) a default policy. This solution demonstrates connections between seemingly disparate phenomena across behavioral neuroscience, notably flexible replanning with biases and cognitive control. It also provides insight into how the brain can represent maps of long-distance contingencies stably and componentially, as in entorhinal response fields, and exploit them to guide choice even under changing goals.

Models of decision making have so far been unable to account for how humans’ choices can be flexible yet efficient. Here the authors present a linear reinforcement learning model which explains both flexibility, and rare limitations such as habits, as arising from efficient approximate computation

Navigating for reward

An organism's survival can depend on its ability to recall and navigate to spatial locations associated with rewards, such as food or a home. Accumulating research has revealed that computations of reward and its prediction occur on multiple levels across a complex set of interacting brain regions, including those that support memory and navigation. However, how the brain coordinates the encoding, recall and use of reward information to guide navigation remains incompletely understood. In this Review, we propose that the brain's classical navigation centres - the hippocampus and the entorhinal cortex - are ideally suited to coordinate this larger network by representing both physical and mental space as a series of states. These states may be linked to reward via neuromodulatory inputs to the hippocampus-entorhinal cortex system. Hippocampal outputs can then broadcast sequences of states to the rest of the brain to store reward associations or to facilitate decision-making, potentially engaging additional value signals downstream. This proposal is supported by recent advances in both experimental and theoretical neuroscience. By discussing the neural systems traditionally tied to navigation and reward at their intersection, we aim to offer an integrated framework for understanding navigation to reward as a fundamental feature of many cognitive processes.

Dynamic and reversible remapping of network representations in an unchanging environment

Neurons in the medial entorhinal cortex alter their firing properties in response to environmental changes. This flexibility in neural coding is hypothesized to support navigation and memory by dividing sensory experience into unique episodes. However, it is unknown how the entorhinal circuit as a whole transitions between different representations when sensory information is not delineated into discrete contexts. Here we describe rapid and reversible transitions between multiple spatial maps of an unchanging task and environment. These remapping events were synchronized across hundreds of neurons, differentially affected navigational cell types, and correlated with changes in running speed. Despite widespread changes in spatial coding, remapping comprised a translation along a single dimension in population-level activity space, enabling simple decoding strategies. These findings provoke reconsideration of how the medial entorhinal cortex dynamically represents space and suggest a remarkable capacity of cortical circuits to rapidly and substantially reorganize their neural representations.

Territorial blueprint in the hippocampal system

As we skillfully navigate through familiar places, neural computations of distances and coordinates escape our attention. However, we perceive clearly the division of space into socially meaningful territories. 'My space' versus 'your space' is a distinction familiar to all of us. Spatial frontiers are social in nature since they regulate individuals' access to utilities in space depending on hierarchy and affiliation. How does the brain integrate spatial geometry with social territory? We propose that the action of oxytocin (OT) in the entorhinal-hippocampal regions supports this process. Grounded on the functional role of the hypothalamic neuropeptide in the hippocampal system, we show how OT-induced plasticity may bias the geometrical coding of place and grid cells to represent social territories.

Navigation using global or local reference frames in rats with medial and lateral entorhinal cortex lesions

The medial (MEC) and the lateral (LEC) regions of the entorhinal cortex send a major input to the hippocampus and have been proposed to play a foremost role in combining spatial and non-spatial attributes of episodic memory. In addition, it has been recently suggested that the MEC is involved in the processing of information in a global reference frame and the LEC in the processing of information in a local reference frame. Whether these putative functions could be generalized to navigation contexts has not been established yet. To address this hypothesis, rats with MEC or LEC NMDA-induced lesions were trained in two versions of a navigation task in the water maze, a global cue condition in which they had to use distal room cues and a local cue condition in which they had to use 3 objects placed in the pool. In the global cue condition, MEC-lesioned rats exhibited slower acquisition and were not able to precisely locate the submerged platform during the probe trial. In contrast LEC-lesioned rats exhibited control-like performance. In the local cue condition, navigational abilities were spared in both lesion groups. In addition when the 3 different objects were replaced by 3 identical objects, all groups maintained their navigation accuracy suggesting that the identity of objects is not crucial for place navigation. Overall, the results indicate that the MEC is necessary for place navigation using a global reference frame. In contrast, navigation using a local reference frame does not require the LEC nor the MEC.

Place cells and geometry lead to a flexible grid pattern

Place cells and grid cells are important neurons involved in spatial navigation in the mammalian brain. Grid cells are believed to play an important role in forming a cognitive map of the environment. Experimental observations in recent years showed that the grid pattern is not invariant but is influenced by the shape of the spatial environment. However, the cause of this deformation remains elusive. Here, we focused on the functional interactions between place cells and grid cells, utilizing the information of location relationships between the firing fields of place cells to optimize the previous grid cell feedforward generation model and expand its application to more complex environmental scenarios. Not only was the regular equilateral triangle periodic firing field structure of the grid cells reproduced, but the expected results were consistent with the experiment for the environment with various complex boundary shapes and environmental deformation. Even in the field of three-dimensional spatial grid patterns, forward-looking predictions have been made. This provides a possible model explanation for how the coupling of grid cells and place cells adapt to the diversity of the external environment to deepen our understanding of the neural basis for constructing cognitive maps.

Different Modulatory Effects of Cognitive Training and Aerobic Exercise on Resting State Functional Connectivity of Entorhinal Cortex in Community-Dwelling Older Adults

The entorhinal cortex (EC) plays an essential role in age-related cognitive decline. However, the effect of functional connectivity (FC) changes between EC and other cerebral cortices on cognitive function remains unclear. The aim of this study was to explore the modulation of two interventions (cognitive training and aerobic exercise) on EC-FC in community-dwelling older adults. In total, 94 healthy older adults aged between 65 and 75 years were assigned to either the cognitive training or aerobic exercise group to receive 24 sessions over 12 weeks, or to a control group. Resting-state functional magnetic resonance imaging was performed at both baseline and 12-month follow-up. Compared to the cognitive training group, the aerobic exercise group showed greater EC-FC in the bilateral middle temporal gyrus, right supramarginal gyrus, left angular gyrus, and right postcentral gyrus. Compared to the control group, the cognitive training group had a decreased EC-FC in the right hippocampus, right middle temporal gyrus, left angular gyrus, and right postcentral gyrus and an increased EC-FC in the bilateral pallidum, while the aerobic exercise group showed increased EC-FC between the right medial prefrontal cortex(mPFC), bilateral pallidum, and right precuneus. Baseline EC-FC in the mPFC was positively correlated with the visuospatial/constructional index score of the Repeatable Battery for the Assessment of Neuropsychological Status. In the cognitive training group, EC-FC value changes in the right hippocampus were negatively correlated with changes in the RBANS delayed memory index score, while in the aerobic exercise group, EC-FC value changes in the left angular gyrus were positively correlated with changes in the RBANS attention index score. These findings support the hypothesis that both cognitive training and aerobic exercise can modulate EC-FC in aging populations but through different neural pathways.

Topography in the Bursting Dynamics of Entorhinal Neurons

Medial entorhinal cortex contains neural substrates for representing space. These substrates include grid cells that fire in repeating locations and increase in scale progressively along the dorsal-to-ventral entorhinal axis, with the physical distance between grid firing nodes increasing from tens of centimeters to several meters in rodents. Whether the temporal scale of grid cell spiking dynamics shows a similar dorsal-to-ventral organization remains unknown. Here, we report the presence of a dorsal-to-ventral gradient in the temporal spiking dynamics of grid cells in behaving mice. This gradient in bursting supports the emergence of a dorsal grid cell population with a high signal-to-noise ratio. In vitro recordings combined with a computational model point to a role for gradients in non-inactivating sodium conductances in supporting the bursting gradient in vivo. Taken together, these results reveal a complementary organization in the temporal and intrinsic properties of entorhinal cells.

Two septal-entorhinal GABAergic projections differentially control coding properties of spatially tuned neurons in the medial entorhinal cortex

Septal parvalbumin-expressing (PV+) and calbindin-expressing (CB+) projections inhibit low-threshold and fast-spiking interneurons, respectively, in the medial entorhinal cortex (MEC). We investigate how the two inputs control neuronal activity in the MEC in freely moving mice. Stimulation of PV+ and CB+ terminals causes disinhibition of spatially tuned MEC neurons, but exerts differential effects on temporal coding and burst firing. Thus, recruitment of PV+ projections disrupts theta-rhythmic firing of MEC neurons, while stimulation of CB+ projections increases burst firing of grid cells and enhances phase precession in a cell-type-specific manner. Inactivation of septal PV+ or CB+ neurons differentially affects context, reference, and working memory. Together, our results reveal how specific connectivity of septal GABAergic projections with MEC interneurons translates into differential modulation of MEC neuronal coding.

Entorhinal and ventromedial prefrontal cortices abstract and generalize the structure of reinforcement learning problems

Knowledge of the structure of a problem, such as relationships between stimuli, enables rapid learning and flexible inference. Humans and other animals can abstract this structural knowledge and generalize it to solve new problems. For example, in spatial reasoning, shortest-path inferences are immediate in new environments. Spatial structural transfer is mediated by cells in entorhinal and (in humans) medial prefrontal cortices, which maintain their co-activation structure across different environments and behavioral states. Here, using fMRI, we show that entorhinal and ventromedial prefrontal cortex (vmPFC) representations perform a much broader role in generalizing the structure of problems. We introduce a task-remapping paradigm, where subjects solve multiple reinforcement learning (RL) problems differing in structural or sensory properties. We show that, as with space, entorhinal representations are preserved across different RL problems only if task structure is preserved. In vmPFC and ventral striatum, representations of prediction error also depend on task structure.

Cognitive Maps: Distortions of the Hippocampal Space Map Define Neighborhoods

In place of continuous overhead satellite views of an environment, the brain often relies on first-person experiences to estimate spatial relationships between locations. Using new methods, a recent study has found the spatial metric observed in hippocampal activity adapts to encode local environmental terrain.

The broadband power shifts in entorhinal EEG are related to the firing of grid cells

The relationship between the firing of the grid cell and mesoscopic neural oscillations is one of the key issues to understand the neural mechanism of grid cells. Previous studies have focused more on the correspondence between neuronal firing and phases of oscillations, such as phase precession. There are also some conclusions about the relationship between the activity of grid cells and the intensity of neural oscillations, such as the disappearance of grid pattern caused by the blocking of theta rhythm, but the correlation between the firing rates of grid cells and the narrowband power of neural oscillations or the broadband LFP power is still scarce. Through analyzing the records of spike times of grid cells and local entorhinal EEG obtained by Hafting et al., in the spatial navigation experiment, we find that grid cells are, to a large proportion, a kind of broadband-shift neurons, and the positive correlation between grid cell activity and power of low theta and gamma bands was observed. These results have well verified, promoted, and connected many scattered research conclusions, such as the broadband shift phenomenon of hippocampal neurons, the influence of low theta activity on the firing pattern of grid cells, and the positive correlation between single-cell activity and gamma-band activity. This work is of great significance for the study of the neural mechanism of grid cells at the micro and mesoscopic levels, and may also inspire the use of indicators such as broadband power as markers for grid cell activity.

The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation

The hippocampal-entorhinal system is important for spatial and relational memory tasks. We formally link these domains, provide a mechanistic understanding of the hippocampal role in generalization, and offer unifying principles underlying many entorhinal and hippocampal cell types. We propose medial entorhinal cells form a basis describing structural knowledge, and hippocampal cells link this basis with sensory representations. Adopting these principles, we introduce the Tolman-Eichenbaum machine (TEM). After learning, TEM entorhinal cells display diverse properties resembling apparently bespoke spatial responses, such as grid, band, border, and object-vector cells. TEM hippocampal cells include place and landmark cells that remap between environments. Crucially, TEM also aligns with empirically recorded representations in complex non-spatial tasks. TEM also generates predictions that hippocampal remapping is not random as previously believed; rather, structural knowledge is preserved across environments. We confirm this structural transfer over remapping in simultaneously recorded place and grid cells.

Selective Routing of Spatial Information Flow from Input to Output in Hippocampal Granule Cells

Dentate gyrus granule cells (GCs) connect the entorhinal cortex to the hippocampal CA3 region, but how they process spatial information remains enigmatic. To examine the role of GCs in spatial coding, we measured excitatory postsynaptic potentials (EPSPs) and action potentials (APs) in head-fixed mice running on a linear belt. Intracellular recording from morphologically identified GCs revealed that most cells were active, but activity level varied over a wide range. Whereas only ∼5% of GCs showed spatially tuned spiking, ∼50% received spatially tuned input. Thus, the GC population broadly encodes spatial information, but only a subset relays this information to the CA3 network. Fourier analysis indicated that GCs received conjunctive place-grid-like synaptic input, suggesting code conversion in single neurons. GC firing was correlated with dendritic complexity and intrinsic excitability, but not extrinsic excitatory input or dendritic cable properties. Thus, functional maturation may control input-output transformation and spatial code conversion.

Map Making: Constructing, Combining, and Inferring on Abstract Cognitive Maps

Cognitive maps enable efficient inferences from limited experience that can guide novel decisions. We tested whether the hippocampus (HC), entorhinal cortex (EC), and ventromedial prefrontal cortex (vmPFC)/medial orbitofrontal cortex (mOFC) organize abstract and discrete relational information into a cognitive map to guide novel inferences. Subjects learned the status of people in two unseen 2D social hierarchies, with each dimension learned on a separate day. Although one dimension was behaviorally relevant, multivariate activity patterns in HC, EC, and vmPFC/mOFC were linearly related to the Euclidean distance between people in the mentally reconstructed 2D space. Hubs created unique comparisons between the hierarchies, enabling inferences between novel pairs. We found that both behavior and neural activity in EC and vmPFC/mOFC reflected the Euclidean distance to the retrieved hub, which was reinstated in HC. These findings reveal how abstract and discrete relational structures are represented, are combined, and enable novel inferences in the human brain.

Hippocampal firing rates count

STANDFIRST

Sun et al. discover that neuronal firing rates of hippocampal place cells code for periodically repeating events and that the rate code can flexibly transfer to new situations. These findings suggest that abstract neural representations of regularly occurring events may be foundational for performing complex cognitive tasks.

Optogenetic "low-theta" pacing of the septohippocampal circuit is sufficient for spatial goal finding and is influenced by behavioral state and cognitive demand

Hippocampal theta oscillations show prominent changes in frequency and amplitude depending on behavioral state or cognitive demands. How these dynamic changes in theta oscillations contribute to the spatial and temporal organization of hippocampal cells, and ultimately behavior, remain unclear. We used low-theta frequency optogenetic stimulation to pace coordination of cellular and network activity between the medial septum (MS) and hippocampus during baseline and MS stimulation while rats were at rest or performing a spatial accuracy task with a visible or hidden goal zone. Hippocampal receptivity to pan-neuronal septal stimulation at low-theta frequency was primarily determined by speed and secondarily by task demands. Competition between artificial and endogenous field potentials at theta frequency attenuated hippocampal phase preference relative to local theta, but the spike-timing activity of hippocampal pyramidal cells was effectively driven by artificial septal output, particularly during the hidden goal task. Notwithstanding temporal reorganization by artificial theta stimulation, place field properties were unchanged and alterations to spatial behavior were limited to goal zone approximation. Our results indicate that even a low-theta frequency timing signal in the septohippocampal circuit is sufficient for spatial goal finding behavior. The results also advance a mechanistic understanding of how endogenous or artificial somatodendritic timing signals relate to displacement computations during navigation and spatial memory.

Altered Hippocampal Place Cell Representation and Theta Rhythmicity following Moderate Prenatal Alcohol Exposure

Prenatal alcohol exposure (PAE) leads to profound deficits in spatial memory and synaptic and cellular alterations to the hippocampus that last into adulthood. Neurons in the hippocampus called place cells discharge as an animal enters specific places in an environment, establish distinct ensemble codes for familiar and novel places, and are modulated by local theta rhythms. Spatial memory is thought to critically depend on the integrity of hippocampal place cell firing. Therefore, we tested the hypothesis that hippocampal place cell firing is impaired after PAE by performing in vivo recordings from the hippocampi (CA1 and CA3) of moderate PAE and control adult rats. Our results show that hippocampal CA3 neurons from PAE rats have reduced spatial tuning. Second, CA1 and CA3 neurons from PAE rats are less likely to orthogonalize their firing between directions of travel on a linear track and between changes in contextual stimuli in an open arena compared to control neurons. Lastly, reductions in the number of hippocampal place cells exhibiting significant theta rhythmicity and phase precession were observed, which may suggest changes to hippocampal microcircuit function. Together, the reduced spatial tuning and sensitivity to contextual changes provide a neural systems-level mechanism to explain spatial memory impairment after moderate PAE.

Advantages and detection of phase coding in the absence of rhythmicity

The encoding of information in spike phase relative to local field potential (LFP) oscillations offers several theoretical advantages over equivalent firing rate codes. One notable example is provided by place and grid cells in the rodent hippocampal formation, which exhibit phase precession-firing at progressively earlier phases of the 6-12 Hz movement-related theta rhythm as their spatial firing fields are traversed. It is often assumed that such phase coding relies on a high amplitude baseline oscillation with relatively constant frequency. However, sustained oscillations with fixed frequency are generally absent in LFP and spike train recordings from the human brain. Hence, we examine phase coding relative to LFP signals with broadband low-frequency (2-20 Hz) power but without regular rhythmicity. We simulate a population of grid cells that exhibit phase precession against a baseline oscillation recorded from depth electrodes in human hippocampus. We show that this allows grid cell firing patterns to multiplex information about location, running speed and movement direction, alongside an arbitrary fourth variable encoded in LFP frequency. This is of particular importance given recent demonstrations that movement direction, which is essential for path integration, cannot be recovered from head direction cell firing rates. In addition, we investigate how firing phase might reduce errors in decoded location, including those arising from differences in firing rate across grid fields. Finally, we describe analytical methods that can identify phase coding in the absence of high amplitude LFP oscillations with approximately constant frequency, as in single unit recordings from the human brain and consistent with recent data from the flying bat. We note that these methods could also be used to detect phase coding outside of the spatial domain, and that multi-unit activity can substitute for the LFP signal. In summary, we demonstrate that the computational advantages offered by phase coding are not contingent on, and can be detected without, regular rhythmicity in neural activity.

Grid coding, spatial representation, and navigation: Should we assume an isomorphism?

Grid cells provide a compelling example of a link between cellular activity and an abstract and difficult to define concept like space. Accordingly, a representational perspective on grid coding argues that neural grid coding underlies a fundamentally spatial metric. Recently, some theoretical proposals have suggested extending such a framework to nonspatial cognition as well, such as category learning. Here, we provide a critique of the frequently employed assumption of an isomorphism between patterns of neural activity (e.g., grid cells), mental representation, and behavior (e.g., navigation). Specifically, we question the strict isomorphism between these three levels and suggest that human spatial navigation is perhaps best characterized by a wide variety of both metric and nonmetric strategies. We offer an alternative perspective on how grid coding might relate to human spatial navigation, arguing that grid coding is part of a much larger conglomeration of neural activity patterns that dynamically tune to accomplish specific behavioral outputs.

A stable home-base promotes allocentric memory representations of episodic-like everyday spatial memory

A key issue in neurobiological studies of episodic-like memory is the geometric frame of reference in which memory traces of experience are stored. Assumptions are sometimes made that specific protocols favour either allocentric (map-like) or egocentric (body-centred) representations. There are, however, grounds for suspecting substantial ambiguity about coding strategy, including the necessity to use both frames of reference occasionally, but tests of memory representation are not routinely conducted. Using rats trained to find and dig up food in sandwells at a particular place in an event arena (episodic-like 'action-where' encoding), we show that a protocol previously thought to foster allocentric encoding is ambiguous but more predisposed towards egocentric encoding. Two changes in training protocol were examined with a view to promoting preferential allocentric encoding-one in which multiple start locations were used within a session as well as between sessions; and another that deployed a stable home-base to which the animals had to carry food reward. Only the stable home-base protocol led to excellent choice performance which rigorous analyses revealed to be blocked by occluding extra-arena cues when this was done after encoding but before recall. The implications of these findings for studies of episodic-like memory are that the representational framework of memory at the start of a recall trial will likely include a path direction in the egocentric case but path destination in the allocentric protocol. This difference should be observable in single-unit recording or calcium-imaging studies of spatially-tuned cells.

Home, head direction stability, and grid cell distortion

The home is a unique location in the life of humans and animals. In rats, home presents itself as a multicompartmental space that involves integrating navigation through subspaces. Here we embedded the laboratory rat’s home cage in the arena, while recording neurons in the animal’s parasubiculum and medial entorhinal cortex, two brain areas encoding the animal’s location and head direction. We found that head direction signals were unaffected by home cage presence or translocation. Head direction cells remain globally stable and have similar properties inside and outside the embedded home. We did not observe egocentric bearing encoding of the home cage. However, grid cells were distorted in the presence of the home cage. While they did not globally remap, single firing fields were translocated toward the home. These effects appeared to be geometrical in nature rather than a home-specific distortion and were not dependent on explicit behavioral use of the home cage during a hoarding task. Our work suggests that medial entorhinal cortex and parasubiculum do not remap after embedding the home, but local changes in grid cell activity overrepresent the embedded space location and might contribute to navigation in complex environments.

NEW & NOTEWORTHY Neural findings in the field of spatial navigation come mostly from an abstract approach that separates the animal from even a minimally biological context. In this article we embed the home cage of the rat in the environment to address some of the complexities of natural navigation. We find no explicit home cage representation. While both head direction cells and grid cells remain globally stable, we find that embedded spaces locally distort grid cells.

Synaptic Plasticity Forms and Functions

Synaptic plasticity, the activity-dependent change in neuronal connection strength, has long been considered an important component of learning and memory. Computational and engineering work corroborate the power of learning through the directed adjustment of connection weights. Here we review the fundamental elements of four broadly categorized forms of synaptic plasticity and discuss their functional capabilities and limitations. Although standard, correlation-based, Hebbian synaptic plasticity has been the primary focus of neuroscientists for decades, it is inherently limited. Three-factor plasticity rules supplement Hebbian forms with neuromodulation and eligibility traces, while true supervised types go even further by adding objectives and instructive signals. Finally, a recently discovered hippocampal form of synaptic plasticity combines the above elements, while leaving behind the primary Hebbian requirement. We suggest that the effort to determine the neural basis of adaptive behavior could benefit from renewed experimental and theoretical investigation of more powerful directed types of synaptic plasticity.

Untethered firing fields and intermittent silences: Why grid-cell discharge is so variable

Grid cells in medial entorhinal cortex are notoriously variable in their responses, despite the striking hexagonal arrangement of their spatial firing fields. Indeed, when the animal moves through a firing field, grid cells often fire much more vigorously than predicted or do not fire at all. The source of this trial-to-trial variability is not completely understood. By analyzing grid-cell spike trains from mice running in open arenas and on linear tracks, we characterize the phenomenon of "missed" firing fields using the statistical theory of zero inflation. We find that one major cause of grid-cell variability lies in the spatial representation itself: firing fields are not as strongly anchored to spatial location as the averaged grid suggests. In addition, grid fields from different cells drift together from trial to trial, regardless of whether the environment is real or virtual, or whether the animal moves in light or darkness. Spatial realignment across trials sharpens the grid representation, yielding firing fields that are more pronounced and significantly narrower. These findings indicate that ensembles of grid cells encode relative position more reliably than absolute position.

Transition Scale-Spaces: A Computational Theory for the Discretized Entorhinal Cortex

Although hippocampal grid cells are thought to be crucial for spatial navigation, their computational purpose remains disputed. Recently, they were proposed to represent spatial transitions and convey this knowledge downstream to place cells. However, a single scale of transitions is insufficient to plan long goal-directed sequences in behaviorally acceptable time.

Here, a scale-space data structure is suggested to optimally accelerate retrievals from transition systems, called transition scale-space (TSS). Remaining exclusively on an algorithmic level, the scale increment is proved to be ideally [Formula: see text] for biologically plausible receptive fields. It is then argued that temporal buffering is necessary to learn the scale-space online. Next, two modes for retrieval of sequences from the TSS are presented: top down and bottom up. The two modes are evaluated in symbolic simulations (i.e., without biologically plausible spiking neurons). Additionally, a TSS is used for short-cut discovery in a simulated Morris water maze. Finally, the results are discussed in depth with respect to biological plausibility, and several testable predictions are derived. Moreover, relations to other grid cell models, multiresolution path planning, and scale-space theory are highlighted. Summarized, reward-free transition encoding is shown here, in a theoretical model, to be compatible with the observed discretization along the dorso-ventral axis of the medial entorhinal cortex. Because the theoretical model generalizes beyond navigation, the TSS is suggested to be a general-purpose cortical data structure for fast retrieval of sequences and relational knowledge.

Source code for all simulations presented in this paper can be found at https://github.com/rochus/transitionscalespace .

Causal Inference in Generalizable Environments: Systematic Representative Design

Causal inference and generalizability both matter. Historically, systematic designs emphasize causal inference, while representative designs focus on generalizability. Here, we suggest a transformative synthesis - Systematic Representative Design (SRD) - concurrently enhancing both causal inference and "built-in" generalizability by leveraging today's intelligent agent, virtual environments, and other technologies. In SRD, a "default control group" (DCG) can be created in a virtual environment by representatively sampling from real-world situations. Experimental groups can be built with systematic manipulations onto the DCG base. Applying systematic design features (e.g., random assignment to DCG versus experimental groups) in SRD affords valid causal inferences. After explicating the proposed SRD synthesis, we delineate how the approach concurrently advances generalizability and robustness, cause-effect inference and precision science, a computationally-enabled cumulative psychological science supporting both "bigger theory" and concrete implementations grappling with tough questions (e.g., what is context?) and affording rapidly-scalable interventions for real-world problems.

A non-spatial account of place and grid cells based on clustering models of concept learning

One view is that conceptual knowledge is organized using the circuitry in the medial temporal lobe (MTL) that supports spatial processing and navigation. In contrast, we find that a domain-general learning algorithm explains key findings in both spatial and conceptual domains. When the clustering model is applied to spatial navigation tasks, so-called place and grid cell-like representations emerge because of the relatively uniform distribution of possible inputs in these tasks. The same mechanism applied to conceptual tasks, where the overall space can be higher-dimensional and sampling sparser, leading to representations more aligned with human conceptual knowledge. Although the types of memory supported by the MTL are superficially dissimilar, the information processing steps appear shared. Our account suggests that the MTL uses a general-purpose algorithm to learn and organize context-relevant information in a useful format, rather than relying on navigation-specific neural circuitry.

Can Grid Cell Ensembles Represent Multiple Spaces?

The way grid cells represent space in the rodent brain has been a striking discovery, with theoretical implications still unclear. Unlike hippocampal place cells, which are known to encode multiple, environment-dependent spatial maps, grid cells have been widely believed to encode space through a single low-dimensional manifold, in which coactivity relations between different neurons are preserved when the environment is changed. Does it have to be so? Here, we compute, using two alternative mathematical models, the storage capacity of a population of grid-like units, embedded in a continuous attractor neural network, for multiple spatial maps. We show that distinct representations of multiple environments can coexist, as existing models for grid cells have the potential to express several sets of hexagonal grid patterns, challenging the view of a universal grid map. This suggests that a population of grid cells can encode multiple noncongruent metric relationships, a feature that could in principle allow a grid-like code to represent environments with a variety of different geometries and possibly conceptual and cognitive spaces, which may be expected to entail such context-dependent metric relationships.

Memory retrieval modulates spatial tuning of single neurons in the human entorhinal cortex

The medial temporal lobe is critical for both spatial navigation and memory. Although single neurons in the medial temporal lobe activate to represent locations in the environment during navigation, how this spatial tuning relates to memory for events involving those locations remains unclear. We examined memory-related changes in spatial tuning by recording single-neuron activity from neurosurgical patients performing a virtual-reality object-location memory task. We identified 'memory-trace cells' with activity that was spatially tuned to the retrieved location of the specific object that participants were cued to remember. Memory-trace cells in the entorhinal cortex, in particular, encoded discriminable representations of different memories through a memory-specific rate code. These findings indicate that single neurons in the human entorhinal cortex change their spatial tuning to target relevant memories for retrieval.

A geometric attractor mechanism for self-organization of entorhinal grid modules

Grid cells in the medial entorhinal cortex (MEC) respond when an animal occupies a periodic lattice of 'grid fields' in the environment. The grids are organized in modules with spatial periods, or scales, clustered around discrete values separated on average by ratios in the range 1.4-1.7. We propose a mechanism that produces this modular structure through dynamical self-organization in the MEC. In attractor network models of grid formation, the grid scale of a single module is set by the distance of recurrent inhibition between neurons. We show that the MEC forms a hierarchy of discrete modules if a smooth increase in inhibition distance along its dorso-ventral axis is accompanied by excitatory interactions along this axis. Moreover, constant scale ratios between successive modules arise through geometric relationships between triangular grids and have values that fall within the observed range. We discuss how interactions required by our model might be tested experimentally.

Individual variation in patterns of task focused, and detailed, thought are uniquely associated within the architecture of the medial temporal lobe

Understanding the neural processes that support different patterns of ongoing thought is an important goal of contemporary cognitive neuroscience. Early accounts assumed the default mode network (DMN) was especially important for conscious attention to task-irrelevant/personally relevant materials. However, simple task-negative accounts of the DMN are incompatible with more recent evidence that neural patterns within the system can be related to ongoing processing during active task states. To better characterise the contribution of the DMN to ongoing thought, we conducted a cross-sectional analysis of the relationship between the structural organisation of the brain, as indexed by cortical thickness, and patterns of experience, identified using experience sampling in the cognitive laboratory. In a sample of 181 healthy individuals (mean age 20 years, 117 females) we identified an association between cortical thickness in the anterior parahippocampus and patterns of task focused thought, as well as an adjacent posterior region in which cortical thickness was associated with experiences with higher levels of subjective detail. Both regions fell within regions of medial temporal lobe associated with the DMN, yet varied in their functional connectivity: the time series of signals in the 'on-task' region were more correlated with systems important for external task-relevant processing (as determined by meta-analysis) including the dorsal and ventral attention, and fronto-parietal networks. In contrast, connectivity within the region linked to subjective 'detail' was more correlated with the medial core of the DMN (posterior cingulate and the medial pre-frontal cortex) and regions of primary visual cortex. These results provide cross-sectional evidence that confirms a role of the DMN in how detailed experiences are and so provide further evidence that the role of this system in experience is not simply task-irrelevant. Our results also highlight processes within the medial temporal lobe, and their interactions with other regions of cortex, as important in determining multiple aspects of how human cognition unfolds.