Space, time and learning in the hippocampus: how fine spatial and temporal scales are expanded into population codes for behavioral control

Comparing episodic memory outcomes from walking augmented reality and stationary virtual reality encoding experiences

Episodic Memory (EM) is the neurocognitive capacity to consciously recollect personally experienced events in specific spatio-temporal contexts. Although the relevance of spatial and temporal information is widely acknowledged in the EM literature, it remains unclear whether and how EM performance and organisation is modulated by self-motion, and by motor- and visually- salient environmental features (EFs) of the encoding environment. This study examines whether and how EM is modulated by locomotion and the EFs encountered in a controlled lifelike learning route within a large-scale building. Twenty-eight healthy participants took part in a museum-tour encoding task implemented in walking Augmented Reality (AR) and stationary Virtual Reality (VR) conditions. EM performance and organisation were assessed immediately and 48-hours after trials using a Remember/Familiar recognition paradigm. Results showed a significant positive modulation effect of locomotion on distinctive EM aspects. Findings highlighted a significant performance enhancement effect of stairway-adjacent locations compared to dead-end and mid-route stimuli-presentation locations. The results of this study may serve as design criteria to facilitate neurocognitive rehabilitative interventions of EM. The underlying technological framework developed for this study represents a novel and ecologically sound method for evaluating EM processes in lifelike situations, allowing researchers a naturalistic perspective into the complex nature of EM.

A biologically inspired auto-associative network with sparse temporal population coding

Associative system has attracted increasing attention for it can store basic information and then infer details to match perception with an efficient self-organization algorithm. However, the implementation of the associative system with the application of real-world data is relatively difficult. To address this issue, we propose a novel biologically inspired auto-associative (BIAA) network to explore the structure, encoding and formation of associative memory as well as to extend the ability to real-world application. Our network is constructed by imitating the organization of the cortical minicolumns where each minicolumn contains plenty of parallel biological spiking neurons. To allow the network to learn and predict one symbol per theta cycle, we incorporate synaptic delay and theta oscillation into the neuron dynamic process. Subsequently, we design a sparse temporal population (STP) coding scheme that allows each input symbol to be represented as stable, unique, and easily recallable sparsely distributed representations. By combining associative learning dynamics with the STP coding, our network realizes efficient storage and inference in an ordered manner. Experimental results indicate that the proposed network successfully performs sequence retrieval from partial text and sequence recovery from distorted information. BIAA network provides new insight into introducing biologically inspired mechanisms into associative system and has enormous potential for hardware and software applications.

A map of spatial navigation for neuroscience

Spatial navigation has received much attention from neuroscientists, leading to the identification of key brain areas and the discovery of numerous spatially selective cells. Despite this progress, our understanding of how the pieces fit together to drive behavior is generally lacking. We argue that this is partly caused by insufficient communication between behavioral and neuroscientific researchers. This has led the latter to under-appreciate the relevance and complexity of spatial behavior, and to focus too narrowly on characterizing neural representations of space-disconnected from the computations these representations are meant to enable. We therefore propose a taxonomy of navigation processes in mammals that can serve as a common framework for structuring and facilitating interdisciplinary research in the field. Using the taxonomy as a guide, we review behavioral and neural studies of spatial navigation. In doing so, we validate the taxonomy and showcase its usefulness in identifying potential issues with common experimental approaches, designing experiments that adequately target particular behaviors, correctly interpreting neural activity, and pointing to new avenues of research.

Place cells dynamically refine grid cell activities to reduce error accumulation during path integration in a continuous attractor model

Navigation is one of the most fundamental skills of animals. During spatial navigation, grid cells in the medial entorhinal cortex process speed and direction of the animal to map the environment. Hippocampal place cells, in turn, encode place using sensory signals and reduce the accumulated error of grid cells for path integration. Although both cell types are part of the path integration system, the dynamic relationship between place and grid cells and the error reduction mechanism is yet to be understood. We implemented a realistic model of grid cells based on a continuous attractor model. The grid cell model was coupled to a place cell model to address their dynamic relationship during a simulated animal's exploration of a square arena. The grid cell model processed the animal's velocity and place field information from place cells. Place cells incorporated salient visual features and proximity information with input from grid cells to define their place fields. Grid cells had similar spatial phases but a diversity of spacings and orientations. To determine the role of place cells in error reduction for path integration, the animal's position estimates were decoded from grid cell activities with and without the place field input. We found that the accumulated error was reduced as place fields emerged during the exploration. Place fields closer to the animal's current location contributed more to the error reduction than remote place fields. Place cells' fields encoding space could function as spatial anchoring signals for precise path integration by grid cells.

Why grid cells function as a metric for space

The brain is able to calculate the distance and direction to the desired position based on grid cells. Extensive neurophysiological studies of rodent navigation have postulated the grid cells function as a metric for space, and have inspired many computational studies to develop innovative navigation approaches. Furthermore, grid cells may provide a general encoding scheme for high-order nonspatial information. Built upon existing neuroscience and machine learning work, this paper provides theoretical clarity on that the grid cell population codes can be taken as a metric for space. The metric is generated by a shift-invariant positive definite kernel via kernel distance method and embeds isometrically in a Euclidean space, and the inner product of the grid cell population code exponentially converges to the kernel. We also provide a method to learn the distribution of grid cell population efficiently. Grid cells, as a scalable position encoding method, can encode the spatial relationships of places and enable grid cells to outperform place cells in navigation. Further, we extend the grid cell to images encoding and find that grid cells embed images into a mental map, where geometric relationships are conceptual relationships of images. The theoretical model and analysis would contribute to establishing the grid cell code as a generic coding scheme for both spatial and conceptual spaces, and is promising for a multitude of problems across spatial cognition, machine learning and semantic cognition.

A Neural Model of Intrinsic and Extrinsic Hippocampal Theta Rhythms: Anatomy, Neurophysiology, and Function

This article describes a neural model of the anatomy, neurophysiology, and functions of intrinsic and extrinsic theta rhythms in the brains of multiple species. Topics include how theta rhythms were discovered; how theta rhythms organize brain information processing into temporal series of spatial patterns; how distinct theta rhythms occur within area CA1 of the hippocampus and between the septum and area CA3 of the hippocampus; what functions theta rhythms carry out in different brain regions, notably CA1-supported functions like learning, recognition, and memory that involve visual, cognitive, and emotional processes; how spatial navigation, adaptively timed learning, and category learning interact with hippocampal theta rhythms; how parallel cortical streams through the lateral entorhinal cortex (LEC) and the medial entorhinal cortex (MEC) represent the end-points of the What cortical stream for perception and cognition and the Where cortical stream for spatial representation and action; how the neuromodulator acetylcholine interacts with the septo-hippocampal theta rhythm and modulates category learning; what functions are carried out by other brain rhythms, such as gamma and beta oscillations; and how gamma and beta oscillations interact with theta rhythms. Multiple experimental facts about theta rhythms are unified and functionally explained by this theoretical synthesis.

Exercise-induced Nitric Oxide Contributes to Spatial Memory and Hippocampal Capillaries in Rats

Exercise has been argued to improve cognitive function in both humans and rodents. Angiogenesis significantly contributes to brain health, including cognition. The hippocampus is a crucial brain region for cognitive function. However, studies quantifying the capillary changes in the hippocampus after running exercise are lacking. Moreover, the molecular details underlying the effects of running exercise remain poorly understood. We show that endogenous nitric oxide contributes to the beneficial effects of running exercise on cognition and hippocampal capillaries. Four weeks of running exercise significantly improved spatial memory ability and increased the number of capillaries in the cornu ammonis 1 subfield and dentate gyrus of Sprague-Dawley rats. Running exercise also significantly increased nitric oxide synthase activity and nitric oxide content in the rat hippocampus. After blocking the synthesis of endogenous nitric oxide by lateral ventricular injection of NG-nitro-L-arginine methyl ester, a nonspecific nitric oxide synthase inhibitor, the protective effect of running exercise on spatial memory was eliminated. The protective effect of running exercise on angiogenesis in the cornu ammonis 1 subfield and dentate gyrus of rats was also absent after nitric oxide synthase inhibition. Therefore, during running excise, endogenous nitric oxide may contribute to regulating spatial memory ability and angiogenesis in cornu ammonis 1 subfield and dentate gyrus of the hippocampus.

Developmental Designs and Adult Functions of Cortical Maps in Multiple Modalities: Perception, Attention, Navigation, Numbers, Streaming, Speech, and Cognition

This article unifies neural modeling results that illustrate several basic design principles and mechanisms that are used by advanced brains to develop cortical maps with multiple psychological functions. One principle concerns how brains use a strip map that simultaneously enables one feature to be represented throughout its extent, as well as an ordered array of another feature at different positions of the strip. Strip maps include circuits to represent ocular dominance and orientation columns, place-value numbers, auditory streams, speaker-normalized speech, and cognitive working memories that can code repeated items. A second principle concerns how feature detectors for multiple functions develop in topographic maps, including maps for optic flow navigation, reinforcement learning, motion perception, and category learning at multiple organizational levels. A third principle concerns how brains exploit a spatial gradient of cells that respond at an ordered sequence of different rates. Such a rate gradient is found along the dorsoventral axis of the entorhinal cortex, whose lateral branch controls the development of time cells, and whose medial branch controls the development of grid cells. Populations of time cells can be used to learn how to adaptively time behaviors for which a time interval of hundreds of milliseconds, or several seconds, must be bridged, as occurs during trace conditioning. Populations of grid cells can be used to learn hippocampal place cells that represent the large spaces in which animals navigate. A fourth principle concerns how and why all neocortical circuits are organized into layers, and how functionally distinct columns develop in these circuits to enable map development. A final principle concerns the role of Adaptive Resonance Theory top-down matching and attentional circuits in the dynamic stabilization of early development and adult learning. Cortical maps are modeled in visual, auditory, temporal, parietal, prefrontal, entorhinal, and hippocampal cortices.

Transition Scale-Spaces: A Computational Theory for the Discretized Entorhinal Cortex

Although hippocampal grid cells are thought to be crucial for spatial navigation, their computational purpose remains disputed. Recently, they were proposed to represent spatial transitions and convey this knowledge downstream to place cells. However, a single scale of transitions is insufficient to plan long goal-directed sequences in behaviorally acceptable time.

Here, a scale-space data structure is suggested to optimally accelerate retrievals from transition systems, called transition scale-space (TSS). Remaining exclusively on an algorithmic level, the scale increment is proved to be ideally [Formula: see text] for biologically plausible receptive fields. It is then argued that temporal buffering is necessary to learn the scale-space online. Next, two modes for retrieval of sequences from the TSS are presented: top down and bottom up. The two modes are evaluated in symbolic simulations (i.e., without biologically plausible spiking neurons). Additionally, a TSS is used for short-cut discovery in a simulated Morris water maze. Finally, the results are discussed in depth with respect to biological plausibility, and several testable predictions are derived. Moreover, relations to other grid cell models, multiresolution path planning, and scale-space theory are highlighted. Summarized, reward-free transition encoding is shown here, in a theoretical model, to be compatible with the observed discretization along the dorso-ventral axis of the medial entorhinal cortex. Because the theoretical model generalizes beyond navigation, the TSS is suggested to be a general-purpose cortical data structure for fast retrieval of sequences and relational knowledge.

Source code for all simulations presented in this paper can be found at https://github.com/rochus/transitionscalespace .

The Role of Hierarchical Dynamical Functions in Coding for Episodic Memory and Cognition

Behavioral research in human verbal memory function led to the initial definition of episodic memory and semantic memory. A complete model of the neural mechanisms of episodic memory must include the capacity to encode and mentally reconstruct everything that humans can recall from their experience. This article proposes new model features necessary to address the complexity of episodic memory encoding and recall in the context of broader cognition and the functional properties of neurons that could contribute to this broader scope of memory. Many episodic memory models represent individual snapshots of the world with a sequence of vectors, but a full model must represent complex functions encoding and retrieving the relations between multiple stimulus features across space and time on multiple hierarchical scales. Episodic memory involves not only the space and time of an agent experiencing events within an episode but also features shown in neurophysiological data such as coding of speed, direction, boundaries, and objects. Episodic memory includes not only a spatio-temporal trajectory of a single agent but also segments of spatio-temporal trajectories for other agents and objects encountered in the environment consistent with data on encoding the position and angle of sensory features of objects and boundaries. We will discuss potential interactions of episodic memory circuits in the hippocampus and entorhinal cortex with distributed neocortical circuits that must represent all features of human cognition.

Merging information in the entorhinal cortex: what can we learn from robotics experiments and modeling?

Place recognition is a complex process involving idiothetic and allothetic information. In mammals, evidence suggests that visual information stemming from the temporal and parietal cortical areas (‘what’ and ‘where’ information) is merged at the level of the entorhinal cortex (EC) to build a compact code of a place. Local views extracted from specific feature points can provide information important for view cells (in primates) and place cells (in rodents) even when the environment changes dramatically. Robotics experiments using conjunctive cells merging ‘what’ and ‘where’ information related to different local views show their important role for obtaining place cells with strong generalization capabilities. This convergence of information may also explain the formation of grid cells in the medial EC if we suppose that: (1) path integration information is computed outside the EC, (2) this information is compressed at the level of the EC owing to projection (which follows a modulo principle) of cortical activities associated with discretized vector fields representing angles and/or path integration, and (3) conjunctive cells merge the projections of different modalities to build grid cell activities. Applying modulo projection to visual information allows an interesting compression of information and could explain more recent results on grid cells related to visual exploration. In conclusion, the EC could be dedicated to the build-up of a robust yet compact code of cortical activity whereas the hippocampus proper recognizes these complex codes and learns to predict the transition from one state to another.

Hexagonal Grid Fields Optimally Encode Transitions in Spatiotemporal Sequences

Grid cells of the rodent entorhinal cortex are essential for spatial navigation. Although their function is commonly believed to be either path integration or localization, the origin or purpose of their hexagonal firing fields remains disputed. Here they are proposed to arise as an optimal encoding of transitions in sequences. First, storage requirements for transitions in general episodic sequences are examined using propositional logic and graph theory. Subsequently, transitions in complete metric spaces are considered under the assumption of an ideal sampling of an input space. It is shown that memory capacity of neurons that have to encode multiple feasible spatial transitions is maximized by a hexagonal pattern. Grid cells are proposed to encode spatial transitions in spatiotemporal sequences, with the entorhinal-hippocampal loop forming a multitransition system.

An efficient coding theory for a dynamic trajectory predicts non-uniform allocation of entorhinal grid cells to modules

Grid cells in the entorhinal cortex encode the position of an animal in its environment with spatially periodic tuning curves with different periodicities. Recent experiments established that these cells are functionally organized in discrete modules with uniform grid spacing. Here we develop a theory for efficient coding of position, which takes into account the temporal statistics of the animal's motion. The theory predicts a sharp decrease of module population sizes with grid spacing, in agreement with the trend seen in the experimental data. We identify a simple scheme for readout of the grid cell code by neural circuitry, that can match in accuracy the optimal Bayesian decoder. This readout scheme requires persistence over different timescales, depending on the grid cell module. Thus, we propose that the brain may employ an efficient representation of position which takes advantage of the spatiotemporal statistics of the encoded variable, in similarity to the principles that govern early sensory processing.

Separation or binding? Role of the dentate gyrus in hippocampal mnemonic processing

As a major component of the hippocampal trisynaptic circuit, the dentate gyrus (DG) relays inputs from the entorhinal cortex to the CA3 subregion. Although the anatomy of the DG is well characterized, its contribution to hippocampal mnemonic processing is still unclear. A currently popular theory proposes that the primary function of the DG is to orthogonalize incoming input patterns into non-overlapping patterns (pattern separation). We critically review the available data and conclude that the theoretical support and empirical evidence for this theory are not strong. We then review an alternative theory that posits a role for the DG in binding together different types of incoming sensory information. We conclude that 'binding' better captures the contribution of the DG to memory encoding than 'pattern separation'.

A neural model of normal and abnormal learning and memory consolidation: adaptively timed conditioning, hippocampus, amnesia, neurotrophins, and consciousness

How do the hippocampus and amygdala interact with thalamocortical systems to regulate cognitive and cognitive-emotional learning? Why do lesions of thalamus, amygdala, hippocampus, and cortex have differential effects depending on the phase of learning when they occur? In particular, why is the hippocampus typically needed for trace conditioning, but not delay conditioning, and what do the exceptions reveal? Why do amygdala lesions made before or immediately after training decelerate conditioning while those made later do not? Why do thalamic or sensory cortical lesions degrade trace conditioning more than delay conditioning? Why do hippocampal lesions during trace conditioning experiments degrade recent but not temporally remote learning? Why do orbitofrontal cortical lesions degrade temporally remote but not recent or post-lesion learning? How is temporally graded amnesia caused by ablation of prefrontal cortex after memory consolidation? How are attention and consciousness linked during conditioning? How do neurotrophins, notably brain-derived neurotrophic factor (BDNF), influence memory formation and consolidation? Is there a common output path for learned performance? A neural model proposes a unified answer to these questions that overcome problems of alternative memory models.

Exponentially Long Orbits in Hopfield Neural Networks

We show that Hopfield neural networks with synchronous dynamics and asymmetric weights admit stable orbits that form sequences of maximal length. For [Formula: see text] units, these sequences have length [Formula: see text]; that is, they cover the full state space. We present a mathematical proof that maximal-length orbits exist for all [Formula: see text], and we provide a method to construct both the sequence and the weight matrix that allow its production. The orbit is relatively robust to dynamical noise, and perturbations of the optimal weights reveal other periodic orbits that are not maximal but typically still very long. We discuss how the resulting dynamics on slow time-scales can be used to generate desired output sequences.

Time Perception Mechanisms at Central Nervous System

The five senses have specific ways to receive environmental information and lead to central nervous system. The perception of time is the sum of stimuli associated with cognitive processes and environmental changes. Thus, the perception of time requires a complex neural mechanism and may be changed by emotional state, level of attention, memory and diseases. Despite this knowledge, the neural mechanisms of time perception are not yet fully understood. The objective is to relate the mechanisms involved the neurofunctional aspects, theories, executive functions and pathologies that contribute the understanding of temporal perception. Articles form 1980 to 2015 were searched by using the key themes: neuroanatomy, neurophysiology, theories, time cells, memory, schizophrenia, depression, attention-deficit hyperactivity disorder and Parkinson’s disease combined with the term perception of time. We evaluated 158 articles within the inclusion criteria for the purpose of the study. We conclude that research about the holdings of the frontal cortex, parietal, basal ganglia, cerebellum and hippocampus have provided advances in the understanding of the regions related to the perception of time. In neurological and psychiatric disorders, the understanding of time depends on the severity of the diseases and the type of tasks.

Neuromorphic VLSI realization of the hippocampal formation

The medial entorhinal cortex grid cells, aided by the subicular head direction cells, are thought to provide a matrix which is utilized by the hippocampal place cells for calculation of position of an animal during spatial navigation. The place cells are thought to function as an internal GPS for the brain and provide a spatiotemporal stamp on episodic memories. Several computational neuroscience models have been proposed to explain the place specific firing patterns of the cells of the hippocampal formation - including the GRIDSmap model for grid cells and Bayesian integration for place cells. In this work, we present design and measurement results from a first ever system of silicon circuits which successfully realize the function of the hippocampal formation of brain based on these models.

Hebbian Plasticity Realigns Grid Cell Activity with External Sensory Cues in Continuous Attractor Models

After the discovery of grid cells, which are an essential component to understand how the mammalian brain encodes spatial information, three main classes of computational models were proposed in order to explain their working principles. Amongst them, the one based on continuous attractor networks (CAN), is promising in terms of biological plausibility and suitable for robotic applications. However, in its current formulation, it is unable to reproduce important electrophysiological findings and cannot be used to perform path integration for long periods of time. In fact, in absence of an appropriate resetting mechanism, the accumulation of errors over time due to the noise intrinsic in velocity estimation and neural computation prevents CAN models to reproduce stable spatial grid patterns. In this paper, we propose an extension of the CAN model using Hebbian plasticity to anchor grid cell activity to environmental landmarks. To validate our approach we used as input to the neural simulations both artificial data and real data recorded from a robotic setup. The additional neural mechanism can not only anchor grid patterns to external sensory cues but also recall grid patterns generated in previously explored environments. These results might be instrumental for next generation bio-inspired robotic navigation algorithms that take advantage of neural computation in order to cope with complex and dynamic environments.

Connecting multiple spatial scales to decode the population activity of grid cells

Mammalian grid cells fire when an animal crosses the points of an imaginary hexagonal grid tessellating the environment. We show how animals can navigate by reading out a simple population vector of grid cell activity across multiple spatial scales, even though neural activity is intrinsically stochastic. This theory of dead reckoning explains why grid cells are organized into discrete modules within which all cells have the same lattice scale and orientation. The lattice scale changes from module to module and should form a geometric progression with a scale ratio of around 3/2 to minimize the risk of making large-scale errors in spatial localization. Such errors should also occur if intermediate-scale modules are silenced, whereas knocking out the module at the smallest scale will only affect spatial precision. For goal-directed navigation, the allocentric grid cell representation can be readily transformed into the egocentric goal coordinates needed for planning movements. The goal location is set by nonlinear gain fields that act on goal vector cells. This theory predicts neural and behavioral correlates of grid cell readout that transcend the known link between grid cells of the medial entorhinal cortex and place cells of the hippocampus.

Using Grid Cells for Navigation

Mammals are able to navigate to hidden goal locations by direct routes that may traverse previously unvisited terrain. Empirical evidence suggests that this “vector navigation” relies on an internal representation of space provided by the hippocampal formation. The periodic spatial firing patterns of grid cells in the hippocampal formation offer a compact combinatorial code for location within large-scale space. Here, we consider the computational problem of how to determine the vector between start and goal locations encoded by the firing of grid cells when this vector may be much longer than the largest grid scale. First, we present an algorithmic solution to the problem, inspired by the Fourier shift theorem. Second, we describe several potential neural network implementations of this solution that combine efficiency of search and biological plausibility. Finally, we discuss the empirical predictions of these implementations and their relationship to the anatomy and electrophysiology of the hippocampal formation.

•

Grid cells (GCs) are believed to provide a path integration input to place cells

•

However, GCs also provide a powerful context-independent metric for large-scale space

•

Hence, we show how GCs can be used for vector navigation between arbitrary locations

•

We simulate various neural implementations and make testable experimental predictions

Effect of dentate gyrus disruption on remembering what happened where

Our previous studies using Bax knockout (Bax-KO) mice, in which newly generated granule cells continue to accumulate, disrupting neural circuitry specifically in the dentate gyrus (DG), suggest the involvement of the DG in binding the internally-generated spatial map with sensory information on external landmarks (spatial map-object association) in forming a distinct spatial context for each environment. In order to test whether the DG is also involved in binding the internal spatial map with sensory information on external events (spatial map-event association), we tested the behavior of Bax-KO mice in a delayed-non-match-to-place task. Performance of Bax-KO mice was indistinguishable from that of wild-type mice as long as there was no interruption during the delay period (tested up to 5 min), suggesting that on-line maintenance of working memory is intact in Bax-KO mice. However, Bax-KO mice showed profound performance deficits when they were removed from the maze during the delay period (interruption condition) with a sufficiently long (65 s) delay, suggesting that episodic memory was impaired in Bax-KO mice. Together with previous findings, these results suggest the role of the DG in binding spatial information derived from dead reckoning and nonspatial information, such as external objects and events, in the process of encoding episodic memory.

Chronic Hypertension Leads to Neurodegeneration in the TgSwDI Mouse Model of Alzheimer's Disease

Numerous epidemiological studies link vascular disorders, such as hypertension, diabetes mellitus, and stroke, with Alzheimer's disease (AD). Hypertension, specifically, is an important modifiable risk factor for late-onset AD. To examine the link between midlife hypertension and the onset of AD later in life, we chemically induced chronic hypertension in the TgSwDI mouse model of AD in early adulthood. Hypertension accelerated cognitive deficits in the Barnes maze test (P<0.05 after 3 months of treatment; P<0.001 after 6 months), microvascular deposition of β-amyloid (P<0.001 after 3 months of treatment; P<0.05 after 6 months), vascular inflammation (P<0.05 in the dentate gyrus and P<0.001 in the dorsal subiculum after 6 months of treatment), blood-brain barrier leakage (P<0.05 after 3 and 6 months of treatment), and pericyte loss (P<0.05 in the dentate gyrus and P<0.01 in the dorsal subiculum after 6 months of treatment) in these mice. In addition, hypertension induced hippocampal neurodegeneration at an early age in this mouse line (43% reduction in the dorsal subiculum; P<0.05), establishing this as a useful research model of AD with mixed vascular and amyloid pathologies.

From brain synapses to systems for learning and memory: Object recognition, spatial navigation, timed conditioning, and movement control

This article provides an overview of neural models of synaptic learning and memory whose expression in adaptive behavior depends critically on the circuits and systems in which the synapses are embedded. It reviews Adaptive Resonance Theory, or ART, models that use excitatory matching and match-based learning to achieve fast category learning and whose learned memories are dynamically stabilized by top-down expectations, attentional focusing, and memory search. ART clarifies mechanistic relationships between consciousness, learning, expectation, attention, resonance, and synchrony. ART models are embedded in ARTSCAN architectures that unify processes of invariant object category learning, recognition, spatial and object attention, predictive remapping, and eye movement search, and that clarify how conscious object vision and recognition may fail during perceptual crowding and parietal neglect. The generality of learned categories depends upon a vigilance process that is regulated by acetylcholine via the nucleus basalis. Vigilance can get stuck at too high or too low values, thereby causing learning problems in autism and medial temporal amnesia. Similar synaptic learning laws support qualitatively different behaviors: Invariant object category learning in the inferotemporal cortex; learning of grid cells and place cells in the entorhinal and hippocampal cortices during spatial navigation; and learning of time cells in the entorhinal-hippocampal system during adaptively timed conditioning, including trace conditioning. Spatial and temporal processes through the medial and lateral entorhinal-hippocampal system seem to be carried out with homologous circuit designs. Variations of a shared laminar neocortical circuit design have modeled 3D vision, speech perception, and cognitive working memory and learning. A complementary kind of inhibitory matching and mismatch learning controls movement. This article is part of a Special Issue entitled SI: Brain and Memory.

A model of grid cell development through spatial exploration and spike time-dependent plasticity

Grid cell responses develop gradually after eye opening, but little is known about the rules that govern this process. We present a biologically plausible model for the formation of a grid cell network. An asymmetric spike time-dependent plasticity rule acts upon an initially unstructured network of spiking neurons that receive inputs encoding animal velocity and location. Neurons develop an organized recurrent architecture based on the similarity of their inputs, interacting through inhibitory interneurons. The mature network can convert velocity inputs into estimates of animal location, showing that spatially periodic responses and the capacity of path integration can arise through synaptic plasticity, acting on inputs that display neither. The model provides numerous predictions about the necessity of spatial exploration for grid cell development, network topography, the maturation of velocity tuning and neural correlations, the abrupt transition to stable patterned responses, and possible mechanisms to set grid period across grid modules.

Modeling inheritance of phase precession in the hippocampal formation

Spatial information about the environment is encoded by the activity of place and grid cells in the hippocampal formation. As an animal traverses a cell's firing field, action potentials progressively shift to earlier phases of the theta oscillation (6-10 Hz). This "phase precession" is observed also in the prefrontal cortex and the ventral striatum, but mechanisms for its generation are unknown. However, once phase precession exists in one region, it might also propagate to downstream regions. Using a computational model, we analyze such inheritance of phase precession, for example, from the entorhinal cortex to CA1 and from CA3 to CA1. We find that distinctive subthreshold and suprathreshold features of the membrane potential of CA1 pyramidal cells (Harvey et al., 2009; Mizuseki et al., 2012; Royer et al., 2012) can be explained by inheritance and that excitatory input is essential. The model explains how inhibition modulates the slope and range of phase precession and provides two main testable predictions. First, theta-modulated inhibitory input to a CA1 pyramidal cell is not necessary for phase precession. Second, theta-modulated inhibitory input on its own generates membrane potential peaks that are in phase with peaks of the extracellular field. Furthermore, we suggest that the spatial distribution of field centers of a population of phase-precessing input cells determines, not only the place selectivity, but also the characteristics of phase precession of the targeted output cell. The inheritance model thus can explain why phase precession is observed throughout the hippocampal formation and other areas of the brain.

How does the modular organization of entorhinal grid cells develop?

The entorhinal-hippocampal system plays a crucial role in spatial cognition and navigation. Since the discovery of grid cells in layer II of medial entorhinal cortex (MEC), several types of models have been proposed to explain their development and operation; namely, continuous attractor network models, oscillatory interference models, and self-organizing map (SOM) models. Recent experiments revealing the in vivo intracellular signatures of grid cells (Domnisoru et al., 2013; Schmidt-Heiber and Hausser, 2013), the primarily inhibitory recurrent connectivity of grid cells (Couey et al., 2013; Pastoll et al., 2013), and the topographic organization of grid cells within anatomically overlapping modules of multiple spatial scales along the dorsoventral axis of MEC (Stensola et al., 2012) provide strong constraints and challenges to existing grid cell models. This article provides a computational explanation for how MEC cells can emerge through learning with grid cell properties in modular structures. Within this SOM model, grid cells with different rates of temporal integration learn modular properties with different spatial scales. Model grid cells learn in response to inputs from multiple scales of directionally-selective stripe cells (Krupic et al., 2012; Mhatre et al., 2012) that perform path integration of the linear velocities that are experienced during navigation. Slower rates of grid cell temporal integration support learned associations with stripe cells of larger scales. The explanatory and predictive capabilities of the three types of grid cell models are comparatively analyzed in light of recent data to illustrate how the SOM model overcomes problems that other types of models have not yet handled.

Spatial coding and attractor dynamics of grid cells in the entorhinal cortex

Recent experiments support the theoretical hypothesis that recurrent connectivity plays a central role within the medial entorhinal cortex, by shaping activity of large neural populations, such that their joint activity lies within a continuous attractor. This conjecture involves dynamics within each population (module) of cells that share the same grid spacing. In addition, recent theoretical works raise a hypothesis that, taken together, grid cells from all modules maintain a sophisticated representation of position with uniquely large dynamical range, when compared with other known neural codes in the brain. To maintain such a code, activity in different modules must be coupled, within the entorhinal cortex or through the hippocampus.

Space in the brain: how the hippocampal formation supports spatial cognition

Over the past four decades, research has revealed that cells in the hippocampal formation provide an exquisitely detailed representation of an animal's current location and heading. These findings have provided the foundations for a growing understanding of the mechanisms of spatial cognition in mammals, including humans. We describe the key properties of the major categories of spatial cells: place cells, head direction cells, grid cells and boundary cells, each of which has a characteristic firing pattern that encodes spatial parameters relating to the animal's current position and orientation. These properties also include the theta oscillation, which appears to play a functional role in the representation and processing of spatial information. Reviewing recent work, we identify some themes of current research and introduce approaches to computational modelling that have helped to bridge the different levels of description at which these mechanisms have been investigated. These range from the level of molecular biology and genetics to the behaviour and brain activity of entire organisms. We argue that the neuroscience of spatial cognition is emerging as an exceptionally integrative field which provides an ideal test-bed for theories linking neural coding, learning, memory and cognition.

Comparison of interval timing behaviour in mice following dorsal or ventral hippocampal lesions with mice having δ-opioid receptor gene deletion

Mice with cytotoxic lesions of the dorsal hippocampus (DH) underestimated 15 s and 45 s target durations in a bi-peak procedure as evidenced by proportional leftward shifts of the peak functions that emerged during training as a result of decreases in both 'start' and 'stop' times. In contrast, mice with lesions of the ventral hippocampus (VH) displayed rightward shifts that were immediately present and were largely limited to increases in the 'stop' time for the 45 s target duration. Moreover, the effects of the DH lesions were congruent with the scalar property of interval timing in that the 15 s and 45 s functions superimposed when plotted on a relative timescale, whereas the effects of the VH lesions violated the scalar property. Mice with DH lesions also showed enhanced reversal learning in comparison to control and VH lesioned mice. These results are compared with the timing distortions observed in mice lacking δ-opioid receptors (Oprd1(-/-)) which were similar to mice with DH lesions. Taken together, these results suggest a balance between hippocampal-striatal interactions for interval timing and demonstrate possible functional dissociations along the septotemporal axis of the hippocampus in terms of motivation, timed response thresholds and encoding in temporal memory.

Optimal configurations of spatial scale for grid cell firing under noise and uncertainty

We examined the accuracy with which the location of an agent moving within an environment could be decoded from the simulated firing of systems of grid cells. Grid cells were modelled with Poisson spiking dynamics and organized into multiple ‘modules’ of cells, with firing patterns of similar spatial scale within modules and a wide range of spatial scales across modules. The number of grid cells per module, the spatial scaling factor between modules and the size of the environment were varied. Errors in decoded location can take two forms: small errors of precision and larger errors resulting from ambiguity in decoding periodic firing patterns. With enough cells per module (e.g. eight modules of 100 cells each) grid systems are highly robust to ambiguity errors, even over ranges much larger than the largest grid scale (e.g. over a 500 m range when the maximum grid scale is 264 cm). Results did not depend strongly on the precise organization of scales across modules (geometric, co-prime or random). However, independent spatial noise across modules, which would occur if modules receive independent spatial inputs and might increase with spatial uncertainty, dramatically degrades the performance of the grid system. This effect of spatial uncertainty can be mitigated by uniform expansion of grid scales. Thus, in the realistic regimes simulated here, the optimal overall scale for a grid system represents a trade-off between minimizing spatial uncertainty (requiring large scales) and maximizing precision (requiring small scales). Within this view, the temporary expansion of grid scales observed in novel environments may be an optimal response to increased spatial uncertainty induced by the unfamiliarity of the available spatial cues.

Coordinated learning of grid cell and place cell spatial and temporal properties: multiple scales, attention and oscillations

A neural model proposes how entorhinal grid cells and hippocampal place cells may develop as spatial categories in a hierarchy of self-organizing maps (SOMs). The model responds to realistic rat navigational trajectories by learning both grid cells with hexagonal grid firing fields of multiple spatial scales, and place cells with one or more firing fields, that match neurophysiological data about their development in juvenile rats. Both grid and place cells can develop by detecting, learning and remembering the most frequent and energetic co-occurrences of their inputs. The model's parsimonious properties include: similar ring attractor mechanisms process linear and angular path integration inputs that drive map learning; the same SOM mechanisms can learn grid cell and place cell receptive fields; and the learning of the dorsoventral organization of multiple spatial scale modules through medial entorhinal cortex to hippocampus (HC) may use mechanisms homologous to those for temporal learning through lateral entorhinal cortex to HC ('neural relativity'). The model clarifies how top-down HC-to-entorhinal attentional mechanisms may stabilize map learning, simulates how hippocampal inactivation may disrupt grid cells, and explains data about theta, beta and gamma oscillations. The article also compares the three main types of grid cell models in the light of recent data.

Administration of low dose methamphetamine 12 h after a severe traumatic brain injury prevents neurological dysfunction and cognitive impairment in rats

We recently published data that showed low dose of methamphetamine is neuroprotective when delivered 3 h after a severe traumatic brain injury (TBI). In the current study, we further characterized the neuroprotective potential of methamphetamine by determining the lowest effective dose, maximum therapeutic window, pharmacokinetic profile and gene expression changes associated with treatment. Graded doses of methamphetamine were administered to rats beginning 8 h after severe TBI. We assessed neuroprotection based on neurological severity scores, foot fault assessments, cognitive performance in the Morris water maze, and histopathology. We defined 0.250 mg/kg/h as the lowest effective dose and treatment at 12 h as the therapeutic window following severe TBI. We examined gene expression changes following TBI and methamphetamine treatment to further define the potential molecular mechanisms of neuroprotection and determined that methamphetamine significantly reduced the expression of key pro-inflammatory signals. Pharmacokinetic analysis revealed that a 24-hour intravenous infusion of methamphetamine at a dose of 0.500 mg/kg/h produced a plasma Cmax value of 25.9 ng/ml and a total exposure of 544 ng/ml over a 32 hour time frame. This represents almost half the 24-hour total exposure predicted for a daily oral dose of 25mg in a 70 kg adult human. Thus, we have demonstrated that methamphetamine is neuroprotective when delivered up to 12 h after injury at doses that are compatible with current FDA approved levels.

How reduction of theta rhythm by medial septum inactivation may covary with disruption of entorhinal grid cell responses due to reduced cholinergic transmission

Oscillations in the coordinated firing of brain neurons have been proposed to play important roles in perception, cognition, attention, learning, navigation, and sensory-motor control. The network theta rhythm has been associated with properties of spatial navigation, as has the firing of entorhinal grid cells and hippocampal place cells. Two recent studies reduced the theta rhythm by inactivating the medial septum (MS) and demonstrated a correlated reduction in the characteristic hexagonal spatial firing patterns of grid cells. These results, along with properties of intrinsic membrane potential oscillations (MPOs) in slice preparations of medial entorhinal cortex (MEC), have been interpreted to support oscillatory interference models of grid cell firing. The current article shows that an alternative self-organizing map (SOM) model of grid cells can explain these data about intrinsic and network oscillations without invoking oscillatory interference. In particular, the adverse effects of MS inactivation on grid cells can be understood in terms of how the concomitant reduction in cholinergic inputs may increase the conductances of leak potassium (K⁺) and slow and medium after-hyperpolarization (sAHP and mAHP) channels. This alternative model can also explain data that are problematic for oscillatory interference models, including how knockout of the HCN1 gene in mice, which flattens the dorsoventral gradient in MPO frequency and resonance frequency, does not affect the development of the grid cell dorsoventral gradient of spatial scales, and how hexagonal grid firing fields in bats can occur even in the absence of theta band modulation. These results demonstrate how models of grid cell self-organization can provide new insights into the relationship between brain learning and oscillatory dynamics.

Learning indoor robot navigation using visual and sensorimotor map information

As a fundamental research topic, autonomous indoor robot navigation continues to be a challenge in unconstrained real-world indoor environments. Although many models for map-building and planning exist, it is difficult to integrate them due to the high amount of noise, dynamics, and complexity. Addressing this challenge, this paper describes a neural model for environment mapping and robot navigation based on learning spatial knowledge. Considering that a person typically moves within a room without colliding with objects, this model learns the spatial knowledge by observing the person's movement using a ceiling-mounted camera. A robot can plan and navigate to any given position in the room based on the acquired map, and adapt it based on having identified possible obstacles. In addition, salient visual features are learned and stored in the map during navigation. This anchoring of visual features in the map enables the robot to find and navigate to a target object by showing an image of it. We implement this model on a humanoid robot and tests are conducted in a home-like environment. Results of our experiments show that the learned sensorimotor map masters complex navigation tasks.

Multiscale codes in the nervous system: the problem of noise correlations and the ambiguity of periodic scales

Encoding information about continuous variables using noisy computational units is a challenge; nonetheless, asymptotic theory shows that combining multiple periodic scales for coding can be highly precise despite the corrupting influence of noise [Mathis, Herz, and Stemmler, Phys. Rev. Lett. 109, 018103 (2012)]. Indeed, the cortex seems to use periodic, multiscale grid codes to represent position accurately. Here we show how such codes can be read out without taking the long-term limit; even on short time scales, the precision of such codes scales exponentially in the number N of neurons. Does this finding also hold for neurons that are not firing in a statistically independent fashion? To assess the extent to which biological grid codes are subject to statistical dependences, we first analyze the noise correlations between pairs of grid code neurons in behaving rodents. We find that if the grids of two neurons align and have the same length scale, the noise correlations between the neurons can reach values as high as 0.8. For increasing mismatches between the grids of the two neurons, the noise correlations fall rapidly. Incorporating such correlations into a population coding model reveals that the correlations lessen the resolution, but the exponential scaling of resolution with N is unaffected.

Spiking neurons in a hierarchical self-organizing map model can learn to develop spatial and temporal properties of entorhinal grid cells and hippocampal place cells

Medial entorhinal grid cells and hippocampal place cells provide neural correlates of spatial representation in the brain. A place cell typically fires whenever an animal is present in one or more spatial regions, or places, of an environment. A grid cell typically fires in multiple spatial regions that form a regular hexagonal grid structure extending throughout the environment. Different grid and place cells prefer spatially offset regions, with their firing fields increasing in size along the dorsoventral axes of the medial entorhinal cortex and hippocampus. The spacing between neighboring fields for a grid cell also increases along the dorsoventral axis. This article presents a neural model whose spiking neurons operate in a hierarchy of self-organizing maps, each obeying the same laws. This spiking GridPlaceMap model simulates how grid cells and place cells may develop. It responds to realistic rat navigational trajectories by learning grid cells with hexagonal grid firing fields of multiple spatial scales and place cells with one or more firing fields that match neurophysiological data about these cells and their development in juvenile rats. The place cells represent much larger spaces than the grid cells, which enable them to support navigational behaviors. Both self-organizing maps amplify and learn to categorize the most frequent and energetic co-occurrences of their inputs. The current results build upon a previous rate-based model of grid and place cell learning, and thus illustrate a general method for converting rate-based adaptive neural models, without the loss of any of their analog properties, into models whose cells obey spiking dynamics. New properties of the spiking GridPlaceMap model include the appearance of theta band modulation. The spiking model also opens a path for implementation in brain-emulating nanochips comprised of networks of noisy spiking neurons with multiple-level adaptive weights for controlling autonomous adaptive robots capable of spatial navigation.

The hippocampo-cortical loop: spatio-temporal learning and goal-oriented planning in navigation

We present a neural network model where the spatial and temporal components of a task are merged and learned in the hippocampus as chains of associations between sensory events. The prefrontal cortex integrates this information to build a cognitive map representing the environment. The cognitive map can be used after latent learning to select optimal actions to fulfill the goals of the animal. A simulation of the architecture is made and applied to learning and solving tasks that involve both spatial and temporal knowledge. We show how this model can be used to solve the continuous place navigation task, where a rat has to navigate to an unmarked goal and wait for 2 seconds without moving to receive a reward. The results emphasize the role of the hippocampus for both spatial and timing prediction, and the prefrontal cortex in the learning of goals related to the task.

Perirhinal and postrhinal, but not lateral entorhinal, cortices are essential for acquisition of trace eyeblink conditioning

The acquisition of temporal associative tasks such as trace eyeblink conditioning is hippocampus-dependent, while consolidated performance is not. The parahippocampal region mediates much of the input and output of the hippocampus, and perirhinal (PER) and entorhinal (EC) cortices support persistent spiking, a possible mediator of temporal bridging between stimuli. Here we show that lesions of the perirhinal or postrhinal cortex severely impair the acquisition of trace eyeblink conditioning, while lateral EC lesions do not. Our findings suggest that direct projections from the PER to the hippocampus are functionally important in trace acquisition, and support a role for PER persistent spiking in time-bridging associations.

Disruption of dentate gyrus blocks effect of visual input on spatial firing of CA1 neurons

The role of dentate gyrus in hippocampal mnemonic processing is uncertain. One proposed role of dentate gyrus is binding internally generated spatial representation with sensory information on external landmarks. To test this hypothesis, we compared effects of visual input on spatial firing of CA1 neurons in Bax knock-out mice in which dentate gyrus neural circuitry is selectively disrupted. Whereas spatial selectivity of CA1 neuronal firing was significantly higher under normal illumination than complete darkness in wild-type mice, it was similarly low in both illumination conditions in Bax knock-out mice. Also, whereas the spatial location of neuronal firing was more stably maintained in the light than in the dark condition in wild-type mice, it was similarly unstable in both illumination conditions in Bax knock-out mice. These results show that visual input allows selective and stable spatial firing of CA1 neurons in normal animals, but this effect is lost if dentate gyrus neural circuitry is disrupted. Our results provide empirical support for the proposed role of dentate gyrus in aligning internally generated spatial representation to external landmarks in building a unified representation of external space.

How entorhinal grid cells may learn multiple spatial scales from a dorsoventral gradient of cell response rates in a self-organizing map

Place cells in the hippocampus of higher mammals are critical for spatial navigation. Recent modeling clarifies how this may be achieved by how grid cells in the medial entorhinal cortex (MEC) input to place cells. Grid cells exhibit hexagonal grid firing patterns across space in multiple spatial scales along the MEC dorsoventral axis. Signals from grid cells of multiple scales combine adaptively to activate place cells that represent much larger spaces than grid cells. But how do grid cells learn to fire at multiple positions that form a hexagonal grid, and with spatial scales that increase along the dorsoventral axis? In vitro recordings of medial entorhinal layer II stellate cells have revealed subthreshold membrane potential oscillations (MPOs) whose temporal periods, and time constants of excitatory postsynaptic potentials (EPSPs), both increase along this axis. Slower (faster) subthreshold MPOs and slower (faster) EPSPs correlate with larger (smaller) grid spacings and field widths. A self-organizing map neural model explains how the anatomical gradient of grid spatial scales can be learned by cells that respond more slowly along the gradient to their inputs from stripe cells of multiple scales, which perform linear velocity path integration. The model cells also exhibit MPO frequencies that covary with their response rates. The gradient in intrinsic rhythmicity is thus not compelling evidence for oscillatory interference as a mechanism of grid cell firing. A response rate gradient combined with input stripe cells that have normalized receptive fields can reproduce all known spatial and temporal properties of grid cells along the MEC dorsoventral axis. This spatial gradient mechanism is homologous to a gradient mechanism for temporal learning in the lateral entorhinal cortex and its hippocampal projections. Spatial and temporal representations may hereby arise from homologous mechanisms, thereby embodying a mechanistic “neural relativity” that may clarify how episodic memories are learned.

Spatial navigation is a critical competence of all higher mammals, and place cells in the hippocampus represent the large spaces in which they navigate. Recent modeling clarifies how this may occur via interactions between grid cells in the medial entorhinal cortex (MEC) and place cells. Grid cells exhibit hexagonal grid firing patterns across space and come in multiple spatial scales that increase along the dorsoventral axis of MEC. Signals from multiple scales of grid cells combine to activate place cells that represent much larger spaces than grid cells. This article shows how a gradient of cell response rates along the dorsoventral axis enables the learning of grid cells with the observed gradient of spatial scales as an animal navigates realistic trajectories. The observed gradient of grid cell membrane potential oscillation frequencies is shown to be a direct result of the gradient of response rates. This gradient mechanism for spatial learning is homologous to a gradient mechanism for temporal learning in the lateral entorhinal cortex and its hippocampal projections, thereby clarifying why both spatial and temporal representations are found in the entorhinal-hippocampal system.

Ageing effects on path integration and landmark navigation

Navigation abilities show marked decline in both normal ageing and dementia. Path integration may be particularly affected, as it is supported by the hippocampus and entorhinal cortex, both of which show severe degeneration with ageing. Age differences in path integration based on kinaesthetic and vestibular cues have been clearly demonstrated, but very little research has focused on visual path integration, based only on optic flow. Path integration is complemented by landmark navigation, which may also show age differences, but has not been well studied either. Here we present a study using several simple virtual navigation tasks to explore age differences in path integration both with and without landmark information. We report that, within a virtual environment that provided only optic flow information, older participants exhibited deficits in path integration in terms of distance reproduction, rotation reproduction, and triangle completion. We also report age differences in triangle completion within an environment that provided landmark information. In all tasks, we observed a more restricted range of responses in the older participants, which we discuss in terms of a leaky integrator model, as older participants showed greater leak than younger participants. Our findings begin to explain the mechanisms underlying age differences in path integration, and thus contribute to an understanding of the substantial decline in navigation abilities observed in ageing.

A goal-directed spatial navigation model using forward trajectory planning based on grid cells

A goal-directed navigation model is proposed based on forward linear look-ahead probe of trajectories in a network of head direction cells, grid cells, place cells and prefrontal cortex (PFC) cells. The model allows selection of new goal-directed trajectories. In a novel environment, the virtual rat incrementally creates a map composed of place cells and PFC cells by random exploration. After exploration, the rat retrieves memory of the goal location, picks its next movement direction by forward linear look-ahead probe of trajectories in several candidate directions while stationary in one location, and finds the one activating PFC cells with the highest reward signal. Each probe direction involves activation of a static pattern of head direction cells to drive an interference model of grid cells to update their phases in a specific direction. The updating of grid cell spiking drives place cells along the probed look-ahead trajectory similar to the forward replay during waking seen in place cell recordings. Directions are probed until the look-ahead trajectory activates the reward signal and the corresponding direction is used to guide goal-finding behavior. We report simulation results in several mazes with and without barriers. Navigation with barriers requires a PFC map topology based on the temporal vicinity of visited place cells and a reward signal diffusion process. The interaction of the forward linear look-ahead trajectory probes with the reward diffusion allows discovery of never-before experienced shortcuts towards a goal location.

How do spatial learning and memory occur in the brain? Coordinated learning of entorhinal grid cells and hippocampal place cells

Spatial learning and memory are important for navigation and formation of episodic memories. The hippocampus and medial entorhinal cortex (MEC) are key brain areas for spatial learning and memory. Place cells in hippocampus fire whenever an animal is located in a specific region in the environment. Grid cells in the superficial layers of MEC provide inputs to place cells and exhibit remarkable regular hexagonal spatial firing patterns. They also exhibit a gradient of spatial scales along the dorsoventral axis of the MEC, with neighboring cells at a given dorsoventral location having different spatial phases. A neural model shows how a hierarchy of self-organizing maps, each obeying the same laws, responds to realistic rat trajectories by learning grid cells with hexagonal grid firing fields of multiple spatial scales and place cells with unimodal firing fields that fit neurophysiological data about their development in juvenile rats. The hippocampal place fields represent much larger spaces than the grid cells to support navigational behaviors. Both the entorhinal and hippocampal self-organizing maps amplify and learn to categorize the most energetic and frequent co-occurrences of their inputs. Top-down attentional mechanisms from hippocampus to MEC help to dynamically stabilize these spatial memories in both the model and neurophysiological data. Spatial learning through MEC to hippocampus occurs in parallel with temporal learning through lateral entorhinal cortex to hippocampus. These homologous spatial and temporal representations illustrate a kind of "neural relativity" that may provide a substrate for episodic learning and memory.

Cosine directional tuning of theta cell burst frequencies: evidence for spatial coding by oscillatory interference

The rodent septohippocampal system contains "theta cells," which burst rhythmically at 4-12 Hz, but the functional significance of this rhythm remains poorly understood (Buzsáki, 2006). Theta rhythm commonly modulates the spike trains of spatially tuned neurons such as place (O'Keefe and Dostrovsky, 1971), head direction (Tsanov et al., 2011a), grid (Hafting et al., 2005), and border cells (Savelli et al., 2008; Solstad et al., 2008). An "oscillatory interference" theory has hypothesized that some of these spatially tuned neurons may derive their positional firing from phase interference among theta oscillations with frequencies that are modulated by the speed and direction of translational movements (Burgess et al., 2005, 2007). This theory is supported by studies reporting modulation of theta frequency by movement speed (Rivas et al., 1996; Geisler et al., 2007; Jeewajee et al., 2008a), but modulation of theta frequency by movement direction has never been observed. Here we recorded theta cells from hippocampus, medial septum, and anterior thalamus of freely behaving rats. Theta cell burst frequencies varied as the cosine of the rat's movement direction, and this directional tuning was influenced by landmark cues, in agreement with predictions of the oscillatory interference theory. Computer simulations and mathematical analysis demonstrated how a postsynaptic neuron can detect location-dependent synchrony among inputs from such theta cells, and thereby mimic the spatial tuning properties of place, grid, or border cells. These results suggest that theta cells may serve a high-level computational function by encoding a basis set of oscillatory signals that interfere with one another to synthesize spatial memory representations.

Grid cells, place cells, and geodesic generalization for spatial reinforcement learning

Reinforcement learning (RL) provides an influential characterization of the brain's mechanisms for learning to make advantageous choices. An important problem, though, is how complex tasks can be represented in a way that enables efficient learning. We consider this problem through the lens of spatial navigation, examining how two of the brain's location representations--hippocampal place cells and entorhinal grid cells--are adapted to serve as basis functions for approximating value over space for RL. Although much previous work has focused on these systems' roles in combining upstream sensory cues to track location, revisiting these representations with a focus on how they support this downstream decision function offers complementary insights into their characteristics. Rather than localization, the key problem in learning is generalization between past and present situations, which may not match perfectly. Accordingly, although neural populations collectively offer a precise representation of position, our simulations of navigational tasks verify the suggestion that RL gains efficiency from the more diffuse tuning of individual neurons, which allows learning about rewards to generalize over longer distances given fewer training experiences. However, work on generalization in RL suggests the underlying representation should respect the environment's layout. In particular, although it is often assumed that neurons track location in Euclidean coordinates (that a place cell's activity declines "as the crow flies" away from its peak), the relevant metric for value is geodesic: the distance along a path, around any obstacles. We formalize this intuition and present simulations showing how Euclidean, but not geodesic, representations can interfere with RL by generalizing inappropriately across barriers. Our proposal that place and grid responses should be modulated by geodesic distances suggests novel predictions about how obstacles should affect spatial firing fields, which provides a new viewpoint on data concerning both spatial codes.

Manganese exposure from drinking water and children's classroom behavior in Bangladesh

BACKGROUND

Evidence of neurological, cognitive, and neuropsychological effects of manganese (Mn) exposure from drinking water (WMn) in children has generated widespread public health concern. At elevated exposures, Mn has been associated with increased levels of externalizing behaviors, including irritability, aggression, and impulsivity. Little is known about potential effects at lower exposures, especially in children. Moreover, little is known regarding potential interactions between exposure to Mn and other metals, especially arsenic (As).

OBJECTIVES

We conducted a cross-sectional study of 201 children to investigate associations of Mn and As in tube well water with classroom behavior among elementary school children, 8-11 years of age, in Araihazar, Bangladesh.

METHODS

Data on exposures and behavioral outcomes were collected from the participants at the baseline of an ongoing longitudinal study of child intelligence. Study children were rated by their school teachers on externalizing and internalizing items of classroom behavior using the standardized Child Behavior Checklist-Teacher's Report Form (CBCL-TRF).

RESULTS

Log-transformed WMn was positively and significantly associated with TRF internalizing [estimated β = 0.82; 95% confidence interval (CI), 0.08-1.56; p = 0.03], TRF externalizing (estimated β = 2.59; 95% CI, 0.81-4.37; p =0.004), and TRF total scores (estimated β = 3.35; 95% CI, 0.86-5.83; p = 0.008) in models that adjusted for log-transformed water arsenic (WAs) and sociodemographic covariates. We also observed a positive monotonic dose-response relationship between WMn and TRF externalizing and TRF total scores among the participants of the study. We did not find any significant associations between WAs and various scales of TRF scores.

CONCLUSION

These observations reinforce the growing concern regarding the neurotoxicologic effects of WMn in children.