Hippocampal Sequences During Exploration: Mechanisms and Functions

CA3 Circuit Model Compressing Sequential Information in Theta Oscillation and Replay

The hippocampus plays a critical role in the compression and retrieval of sequential information. During wakefulness, it achieves this through theta phase precession and theta sequences. Subsequently, during periods of sleep or rest, the compressed information reactivates through sharp-wave ripple events, manifesting as memory replay. However, how these sequential neuronal activities are generated and how they store information about the external environment remain unknown. We developed a hippocampal cornu ammonis 3 (CA3) computational model based on anatomical and electrophysiological evidence from the biological CA3 circuit to address these questions. The model comprises theta rhythm inhibition, place input, and CA3-CA3 plastic recurrent connection. The model can compress the sequence of the external inputs, reproduce theta phase precession and replay, learn additional sequences, and reorganize previously learned sequences. A gradual increase in synaptic inputs, controlled by interactions between theta-paced inhibition and place inputs, explained the mechanism of sequence acquisition. This model highlights the crucial role of plasticity in the CA3 recurrent connection and theta oscillational dynamics and hypothesizes how the CA3 circuit acquires, compresses, and replays sequential information.

Local activation of CA1 pyramidal cells induces theta-phase precession

Hippocampal theta-phase precession is involved in spatiotemporal coding and in generating multineural spike sequences, but how precession originates remains unresolved. To determine whether precession can be generated directly in hippocampal area CA1 and disambiguate multiple competing mechanisms, we used closed-loop optogenetics to impose artificial place fields in pyramidal cells of mice running on a linear track. More than one-third of the CA1 artificial fields exhibited synthetic precession that persisted for a full theta cycle. By contrast, artificial fields in the parietal cortex did not exhibit synthetic precession. These findings are incompatible with precession models based on inheritance, dual-input, spreading activation, inhibition-excitation summation, or somato-dendritic competition. Thus, a precession generator resides locally within CA1.

News without the buzz: reading out weak theta rhythms in the hippocampus

Local field potentials (LFPs) reflect the collective dynamics of neural populations, yet their exact relationship to neural codes remains unknown1. One notable exception is the theta rhythm of the rodent hippocampus, which seems to provide a reference clock to decode the animal's position from spatiotemporal patterns of neuronal spiking2 or LFPs3. But when the animal stops, theta becomes irregular4, potentially indicating the breakdown of temporal coding by neural populations. Here we show that no such breakdown occurs, introducing an artificial neural network that can recover position-tuned rhythmic patterns (pThetas) without relying on the more prominent theta rhythm as a reference clock. pTheta and theta preferentially correlate with place cell and interneuron spiking, respectively. When rats forage in an open field, pTheta is jointly tuned to position and head orientation, a property not seen in individual place cells but expected to emerge from place cell sequences5. Our work demonstrates that weak and intermittent oscillations, as seen in many brain regions and species, can carry behavioral information commensurate with population spike codes.

The role of the hippocampus in the consolidation of emotional memories during sleep

Episodic memory relies on the hippocampus, a heterogeneous brain region with distinct functions. Spatial representations in the dorsal hippocampus (dHPC) are crucial for contextual memory, while the ventral hippocampus (vHPC) is more involved in emotional processing. Here, we review the literature in rodents highlighting the anatomical and functional properties of the hippocampus along its dorsoventral axis that underlie its role in contextual and emotional memory encoding, consolidation, and retrieval. We propose that the coordination between the dorsal and vHPC through theta oscillations during rapid eye movement (REM) sleep, and through sharp-wave ripples during non-REM (NREM) sleep, might facilitate the transfer of contextual information for integration with valence-related processing in other structures of the network. Further investigation into the physiology of the vHPC and its connections with other brain areas is needed to deepen the current understanding of emotional memory consolidation during sleep.

No evidence that acute clozapine administration alters CA1 phase precession in rats

Hippocampal phase precession, wherein there is a systematic shift in the phase of neural firing against the underlying theta activity, is proposed to play an important role in the sequencing of information in memory. Previous research shows that the starting phase of precession is more variable in rats following maternal immune activation (MIA), a known risk factor for schizophrenia. Since starting phase variability has the potential to disorganize the construction of sequences of information, we tested whether the atypical antipsychotic clozapine, which ameliorates some cognitive deficits in schizophrenia, alters this aspect of phase precession. Either saline or clozapine (5 mg/kg) was administered to rats and then CA1 place cell activity was recorded from the CA1 region of the hippocampus as the animals ran around a rectangular track for food reward. When compared to saline trials, acute administration of clozapine did not affect any place cell properties, including those related to phase precession, in either control or MIA animals. Clozapine did, however, produce a reduction in locomotion speed, indicating that its presence had some effect on behaviour. These results help to constrain explanations of phase precession mechanisms and their potential role in sequence learning deficits.

Offline memory replay in recurrent neuronal networks emerges from constraints on online dynamics

During spatial exploration, neural circuits in the hippocampus store memories of sequences of sensory events encountered in the environment. When sensory information is absent during 'offline' resting periods, brief neuronal population bursts can 'replay' sequences of activity that resemble bouts of sensory experience. These sequences can occur in either forward or reverse order, and can even include spatial trajectories that have not been experienced, but are consistent with the topology of the environment. The neural circuit mechanisms underlying this variable and flexible sequence generation are unknown. Here we demonstrate in a recurrent spiking network model of hippocampal area CA3 that experimental constraints on network dynamics such as population sparsity, stimulus selectivity, rhythmicity and spike rate adaptation, as well as associative synaptic connectivity, enable additional emergent properties, including variable offline memory replay. In an online stimulus-driven state, we observed the emergence of neuronal sequences that swept from representations of past to future stimuli on the timescale of the theta rhythm. In an offline state driven only by noise, the network generated both forward and reverse neuronal sequences, and recapitulated the experimental observation that offline memory replay events tend to include salient locations like the site of a reward. These results demonstrate that biological constraints on the dynamics of recurrent neural circuits are sufficient to enable memories of sensory events stored in the strengths of synaptic connections to be flexibly read out during rest and sleep, which is thought to be important for memory consolidation and planning of future behaviour. KEY POINTS: A recurrent spiking network model of hippocampal area CA3 was optimized to recapitulate experimentally observed network dynamics during simulated spatial exploration. During simulated offline rest, the network exhibited the emergent property of generating flexible forward, reverse and mixed direction memory replay events. Network perturbations and analysis of model diversity and degeneracy identified associative synaptic connectivity and key features of network dynamics as important for offline sequence generation. Network simulations demonstrate that population over-representation of salient positions like the site of reward results in biased memory replay.

Granular retrosplenial cortex layer 2/3 generates high-frequency oscillations coupled with hippocampal theta and gamma in online states or sharp-wave ripples in offline states

Neuronal oscillations support information transfer by temporally aligning the activity of anatomically distributed 'writer' and 'reader' cell assemblies. High-frequency oscillations (HFOs) such as hippocampal CA1 sharp-wave ripples (SWRs; 100-250 Hz) are sufficiently fast to initiate synaptic plasticity between assemblies and are required for memory consolidation. HFOs are observed in parietal and midline cortices including granular retrosplenial cortex (gRSC). In 'offline' brain states (e.g. quiet wakefulness) gRSC HFOs co-occur with CA1 SWRs, while in 'online' states (e.g. ambulation) HFOs persist with the emergence of theta oscillations. The mechanisms of gRSC HFO oscillations, specifically whether the gRSC can intrinsically generate HFOs, and which layers support HFOs across states, remain unclear. We addressed these issues in behaving mice using optogenetic excitation in individual layers of the gRSC and high density silicon-probe recordings across gRSC layers and hippocampus CA1. Optogenetically induced HFOs (iHFOs) could be elicited by depolarizing excitatory neurons with 100 ms half-sine wave pulses in layer 2/3 (L2/3) or layer 5 (L5) though L5 iHFOs were of lower power than in L2/3. Critically, spontaneous HFOs were only observed in L2/3 and never in L5. Intra-laminar monosynaptic connectivity between excitatory and inhibitory neurons was similar across layers, suggesting other factors restrict HFOs to L2/3. To compare HFOs in online versus offline states we analyzed, separately, HFOs that did or did not co-occur with CA1 SWRs. Using current-source density analysis we found uniform synaptic inputs to L2/3 during all gRSC HFOs, suggesting layer-specific inputs may dictate the localization of HFOs to L2/3. HFOs occurring without SWRs were aligned with the descending phase of both gRSC and CA1 theta oscillations and were coherent with CA1 high frequency gamma oscillations (50-80 Hz). These results demonstrate that gRSC can internally generate HFOs without rhythmic inputs and that HFOs occur exclusively in L2/3, coupled to distinct hippocampal oscillations in online versus offline states.

How Do You Build a Cognitive Map? The Development of Circuits and Computations for the Representation of Space in the Brain

In mammals, the activity of neurons in the entorhinal-hippocampal network is modulated by the animal's position and its movement through space. At multiple stages of this distributed circuit, distinct populations of neurons can represent a rich repertoire of navigation-related variables like the animal's location, the speed and direction of its movements, or the presence of borders and objects. Working together, spatially tuned neurons give rise to an internal representation of space, a cognitive map that supports an animal's ability to navigate the world and to encode and consolidate memories from experience. The mechanisms by which, during development, the brain acquires the ability to create an internal representation of space are just beginning to be elucidated. In this review, we examine recent work that has begun to investigate the ontogeny of circuitry, firing patterns, and computations underpinning the representation of space in the mammalian brain.

Erythropoietin ameliorates cognitive deficits by improving hippocampal and synaptic damage in streptozotocin-induced diabetic mice

Recent studies have shown that erythropoietin (EPO) is an effective neuroprotective and neurotrophic agent for neurological disorders, such as traumatic brain injury and Alzheimer's disease. However, the effectiveness of EPO administration against diabetic cognitive impairments has rarely been examined. In this study, we investigated the effects of EPO on streptozotocin (STZ)-induced male C57BL/6 J mice. Then, we sought to clarify the mechanisms of EPO-mediated neuroprotection in high-glucose (HG)-stimulated HT22 cells. In vivo, we found that STZ-induced diabetic mice showed impaired spatial learning and memory, which was alleviated by EPO treatment. EPO also significantly lowered elevated fasting blood glucose levels, improved pancreatic and hippocampal damage, and restored oxidative stress in the STZ-induced diabetic mice. In vitro, EPO markedly increased cell viability, restrained the expression of pro-apoptotic Bax, enhanced the expression of pro-caspase 3, anti-apoptotic Bcl-2, brain-derived neurotrophic factor (BDNF) and postsynaptic density 95 (PSD-95), and attenuated the upregulation of N-methyl-d-aspartic acid (NMDA) receptor subunits NR1, NR2A and NR2B in HG-induced HT22 cells. The protective effects of EPO was obviously abolished by treatment with an NMDA receptor agonist. Our findings revealed that EPO impedes hippocampal and synaptic damage and neuronal apoptosis by regulating BDNF and PSD-95 expression through NMDA receptors, thereby ameliorating cognitive impairments in mice with T1DM.

Learning to predict future locations with internally generated theta sequences

Representing past, present and future locations is key for spatial navigation. Indeed, within each cycle of the theta oscillation, the population of hippocampal place cells appears to represent trajectories starting behind the current position of the animal and sweeping ahead of it. In particular, we reported recently that the position represented by CA1 place cells at a given theta phase corresponds to the location where animals were or will be located at a fixed time interval into the past or future assuming the animal ran at its typical, not the current, speed through that part of the environment. This coding scheme leads to longer theta trajectories, larger place fields and shallower phase precession in areas where animals typically run faster. Here we present a mechanistic computational model that accounts for these experimental observations. The model consists of a continuous attractor network with short-term synaptic facilitation and depression that internally generates theta sequences that advance at a fixed pace. Spatial locations are then mapped onto the active units via modified Hebbian plasticity. As a result, neighboring units become associated with spatial locations further apart where animals run faster, reproducing our earlier experimental results. The model also accounts for the higher density of place fields generally observed where animals slow down, such as around rewards. Furthermore, our modeling results reveal that an artifact of the decoding analysis might be partly responsible for the observation that theta trajectories start behind the animal's current position. Overall, our results shed light on how the hippocampal code might arise from the interplay between behavior, sensory input and predefined network dynamics.

Inhibitory hippocampus-medial septum projection controls locomotion and exploratory behavior

Although the hippocampus is generally considered a cognitive center for spatial representation, learning, and memory, increasing evidence supports its roles in regulating locomotion. However, the neuronal mechanisms of the hippocampal regulation of locomotion and exploratory behavior remain unclear. In this study, we found that the inhibitory hippocampal synaptic projection to the medial septum (MS) bi-directionally controls the locomotor speed of mice. The activation of the MS-projecting interneurons in the hippocampus or the activation of the hippocampus-originated inhibitory synaptic terminals in the MS decreased locomotion and exploratory behavior. On the other hand, the inhibition of the hippocampus-originated inhibitory synaptic terminals in the MS increased locomotion. Unlike the septal projecting interneurons, the activation of the hippocampal interneurons projecting to the retrosplenial cortex did not change animal locomotion. Therefore, this study reveals a specific long-range inhibitory synaptic output from the hippocampus to the medial septum in the regulation of animal locomotion.

The cerebellum promotes sequential foraging strategies and contributes to the directional modulation of hippocampal place cells

The cerebellum contributes to goal-directed navigation abilities and place coding in the hippocampus. Here we investigated its contribution to foraging strategies. We recorded hippocampal neurons in mice with impaired PKC-dependent cerebellar functions (L7-PKCI) and in their littermate controls while they performed a task where they were rewarded for visiting a subset of hidden locations. We found that L7-PKCI and control mice developed different foraging strategies: while control mice repeated spatial sequences to maximize their rewards, L7-PKCI mice persisted to use a random foraging strategy. Sequential foraging was associated with more place cells exhibiting theta-phase precession and theta rate modulation. Recording in the dark showed that PKC-dependent cerebellar functions controlled how self-motion cues contribute to the selectivity of place cells to both position and direction. Thus, the cerebellum contributes to the development of optimal sequential paths during foraging, possibly by controlling how self-motion and theta signals contribute to place cell coding.

Maladaptive explore/exploit trade-offs in schizophrenia

Schizophrenia is a complex disorder that remains poorly understood, particularly at the systems level. In this opinion article we argue that the explore/exploit trade-off concept provides a holistic and ecologically valid framework to resolve some of the apparent paradoxes that have emerged within schizophrenia research. We review recent evidence suggesting that fundamental explore/exploit behaviors may be maladaptive in schizophrenia during physical, visual, and cognitive foraging. We also describe how theories from the broader optimal foraging literature, such as the marginal value theorem (MVT), could provide valuable insight into how aberrant processing of reward, context, and cost/effort evaluations interact to produce maladaptive responses.

Heterogeneity of network and coding states in mouse CA1 place cells

Theta sequences and phase precession shape hippocampal activity and are considered key underpinnings of memory formation. Theta sequences are sweeps of spikes from multiple cells, tracing trajectories from past to future. Phase precession is the correlation between theta firing phase and animal position. Here, we reconsider these temporal processes in CA1 and the computational principles that they are thought to obey. We find stronger heterogeneity than previously described: we identify cells that do not phase precess but reliably express theta sequences. Other cells phase precess only when medium gamma (linked to entorhinal inputs) is strongest. The same cells express more sequences, but not precession, when slow gamma (linked to CA3 inputs) dominates. Moreover, sequences occur independently in distinct cell groups. Our results challenge the view that phase precession is the mechanism underlying the emergence of theta sequences, suggesting a role for CA1 cells in multiplexing diverse computational processes.

What neural oscillations can and cannot do for syntactic structure building

Understanding what someone says requires relating words in a sentence to one another as instructed by the grammatical rules of a language. In recent years, the neurophysiological basis for this process has become a prominent topic of discussion in cognitive neuroscience. Current proposals about the neural mechanisms of syntactic structure building converge on a key role for neural oscillations in this process, but they differ in terms of the exact function that is assigned to them. In this Perspective, we discuss two proposed functions for neural oscillations - chunking and multiscale information integration - and evaluate their merits and limitations taking into account a fundamentally hierarchical nature of syntactic representations in natural languages. We highlight insights that provide a tangible starting point for a neurocognitive model of syntactic structure building.

Reciprocal relationships between sleep and smell

Despite major anatomical differences with other mammalian sensory systems, olfaction shares with those systems a modulation by sleep/wake states. Sleep modulates odor sensitivity and serves as an important regulator of both perceptual and associative odor memory. In addition, however, olfaction also has an important modulatory impact on sleep. Odors can affect the latency to sleep onset, as well as the quality and duration of sleep. Olfactory modulation of sleep may be mediated by direct synaptic interaction between the olfactory system and sleep control nuclei, and/or indirectly through odor modulation of arousal and respiration. This reciprocal interaction between sleep and olfaction presents novel opportunities for sleep related modulation of memory and perception, as well as development of non-pharmacological olfactory treatments of simple sleep disorders.

Imagination as a fundamental function of the hippocampus

Imagination is a biological function that is vital to human experience and advanced cognition. Despite this importance, it remains unknown how imagination is realized in the brain. Substantial research focusing on the hippocampus, a brain structure traditionally linked to memory, indicates that firing patterns in spatially tuned neurons can represent previous and upcoming paths in space. This work has generally been interpreted under standard views that the hippocampus implements cognitive abilities primarily related to actual experience, whether in the past (e.g. recollection, consolidation), present (e.g. spatial mapping) or future (e.g. planning). However, relatively recent findings in rodents identify robust patterns of hippocampal firing corresponding to a variety of alternatives to actual experience, in many cases without overt reference to the past, present or future. Given these findings, and others on hippocampal contributions to human imagination, we suggest that a fundamental function of the hippocampus is to generate a wealth of hypothetical experiences and thoughts. Under this view, traditional accounts of hippocampal function in episodic memory and spatial navigation can be understood as particular applications of a more general system for imagination. This view also suggests that the hippocampus contributes to a wider range of cognitive abilities than previously thought. This article is part of the theme issue 'Thinking about possibilities: mechanisms, ontogeny, functions and phylogeny'.

Neural Correlates of Spatial Navigation in Primate Hippocampus

The hippocampus has been extensively implicated in spatial navigation in rodents and more recently in bats. Numerous studies have revealed that various kinds of spatial information are encoded across hippocampal regions. In contrast, investigations of spatial behavioral correlates in the primate hippocampus are scarce and have been mostly limited to head-restrained subjects during virtual navigation. However, recent advances made in freely-moving primates suggest marked differences in spatial representations from rodents, albeit some similarities. Here, we review empirical studies examining the neural correlates of spatial navigation in the primate (including human) hippocampus at the levels of local field potentials and single units. The lower frequency theta oscillations are often intermittent. Single neuron responses are highly mixed and task-dependent. We also discuss neuronal selectivity in the eye and head coordinates. Finally, we propose that future studies should focus on investigating both intrinsic and extrinsic population activity and examining spatial coding properties in large-scale hippocampal-neocortical networks across tasks.

Fatty Acid-Derived N-acylethanolamines Dietary Supplementation Attenuates Neuroinflammation and Cognitive Impairment in LPS Murine Model

Neuroinflammation plays a critical role in the pathogenesis of most neurological and neurodegenerative diseases and therefore represents a potential therapeutic target. In this regard, accelerating the resolution process in chronic neuroinflammation may be an effective strategy to deal with the cognitive consequences of neuropathology and generalized inflammatory processes. N-acylethanolamine (NAE) derivatives of fatty acids, being highly active lipid mediators, possess pro-resolving activity in inflammatory processes and are promising agents for the suppression of neuroinflammation and its consequences. This paper is devoted to a study of the effects played by dietary supplement (DS), containing a composition of fatty acid-derived NAEs, obtained from squid Berryteuthis magister, on the hippocampal neuroinflammatory and memory processes. By detecting the production of pro-inflammatory cytokines and glial markers, a pronounced anti-inflammatory activity of DS was demonstrated both in vitro and in vivo. DS administration reversed the LPS-induced reduction in hippocampal neurogenesis and memory deterioration. LC-MS analysis revealed an increase in the production of a range of NAEs with well-documented anti-inflammatory activity in response to the administered lipid composition. To conclude, we found that tested DS suppresses the neuroinflammatory response by reducing glial activation, positively regulates neural progenitor proliferation, and attenuates hippocampal-dependent memory impairment.

Multiple-Timescale Representations of Space: Linking Memory to Navigation

When navigating through space, we must maintain a representation of our position in real time; when recalling a past episode, a memory can come back in a flash. Interestingly, the brain's spatial representation system, including the hippocampus, supports these two distinct timescale functions. How are neural representations of space used in the service of both real-world navigation and internal mnemonic processes? Recent progress has identified sequences of hippocampal place cells, evolving at multiple timescales in accordance with either navigational behaviors or internal oscillations, that underlie these functions. We review experimental findings on experience-dependent modulation of these sequential representations and consider how they link real-world navigation to time-compressed memories. We further discuss recent work suggesting the prevalence of these sequences beyond hippocampus and propose that these multiple-timescale mechanisms may represent a general algorithm for organizing cell assemblies, potentially unifying the dual roles of the spatial representation system in memory and navigation.

Aberrant Phase Precession of Lateral Septal Cells in a Maternal Immune Activation Model of Schizophrenia Risk May Disrupt the Integration of Location with Reward

Spatial memory and reward processing are known to be disrupted in schizophrenia. Since the lateral septum (LS) may play an important role in the integration of location and reward, we examined the effect of maternal immune activation (MIA), a known schizophrenia risk factor, on spatial representation in the rat LS. In support of a previous study, we found that spatial location is represented as a phase code in the rostral LS of adult male rats, so that LS cell spiking shifts systematically against the phase of the hippocampal, theta-frequency, local field potential as an animal moves along a track toward a reward (phase precession). Whereas shallow precession slopes were observed in control group cells, they were steeper in the MIA animals, such that firing frequently precessed across several theta cycles as the animal moved along the length of the apparatus, with subsequent ambiguity in the phase representation of location. Furthermore, an analysis of the phase trajectories of the control group cells revealed that the population tended to converge toward a common firing phase as the animal approached the reward location. This suggested that phase coding in these cells might signal both reward location and the distance to reward. By comparison, the degree of phase convergence in the MIA-group cells was weak, and the region of peak convergence was distal to the reward location. These findings suggest that a schizophrenia risk factor disrupts the phase-based encoding of location-reward relationships in the LS, potentially smearing reward representations across space.SIGNIFICANCE STATEMENT It is unclear how spatial or contextual information generated by hippocampal cells is converted to a code that can be used to signal reward location in regions, such as the VTA. Here we provide evidence that the firing phase of cells in the lateral septum, a region that links the two areas, may code reward location in the firing phase of cells. This phase coding is disrupted in a maternal immune activation model of schizophrenia risk such that representations of reward may be smeared across space in maternal immune activation animals. This could potentially underlie erroneous reward processing and misattribution of salience in schizophrenia.

Proximal CA1 20-40 Hz power dynamics reflect trial-specific information processing supporting nonspatial sequence memory

The hippocampus is known to play a critical role in processing information about temporal context. However, it remains unclear how hippocampal oscillations are involved, and how their functional organization is influenced by connectivity gradients. We examined local field potential activity in CA1 as rats performed a nonspatial odor sequence memory task. We found that odor sequence processing epochs were characterized by distinct spectral profiles and proximodistal CA1 gradients of theta and 20-40 Hz power than track running epochs. We also discovered that 20-40 Hz power was predictive of sequence memory performance, particularly in proximal CA1 and during the plateau of high power observed in trials in which animals had to maintain their decision until instructed to respond. Altogether, these results provide evidence that dynamics of 20-40 Hz power along the CA1 axis are linked to trial-specific processing of nonspatial information critical to order judgments and are consistent with a role for 20-40 Hz power in gating information processing.

Inhibition allocates spikes during hippocampal ripples

Sets of spikes emitted sequentially across neurons constitute fundamental pulse packets in neural information processing, including offline memory replay during hippocampal sharp-wave ripples (SWRs). The relative timing of neuronal spikes is fine-tuned in each spike sequence but can vary between different sequences. However, the microcircuitry mechanism that enables such flexible spike sequencing remains unexplored. We recorded the membrane potentials of multiple hippocampal CA1 pyramidal cells in mice and found that the neurons were transiently hyperpolarized prior to SWRs. The pre-SWR hyperpolarizations were spatiotemporally heterogeneous, and larger hyperpolarizations were associated with later spikes during SWRs. Intracellular blockade of Cl--mediated inhibition reduced pre-SWR hyperpolarizations and advanced spike times. Single-unit recordings also revealed that the pre-SWR firing rates of inhibitory interneurons predicted the SWR-relevant spike times of pyramidal cells. Thus, pre-SWR inhibitory activity determines the sequential spike times of pyramidal cells and diversifies the repertoire of sequence patterns.

Spatial goal coding in the hippocampal formation

The mammalian hippocampal formation contains several distinct populations of neurons involved in representing self-position and orientation. These neurons, which include place, grid, head direction, and boundary-vector cells, are thought to collectively instantiate cognitive maps supporting flexible navigation. However, to flexibly navigate, it is necessary to also maintain internal representations of goal locations, such that goal-directed routes can be planned and executed. Although it has remained unclear how the mammalian brain represents goal locations, multiple neural candidates have recently been uncovered during different phases of navigation. For example, during planning, sequential activation of spatial cells may enable simulation of future routes toward the goal. During travel, modulation of spatial cells by the prospective route, or by distance and direction to the goal, may allow maintenance of route and goal-location information, supporting navigation on an ongoing basis. As the goal is approached, an increased activation of spatial cells may enable the goal location to become distinctly represented within cognitive maps, aiding goal localization. Lastly, after arrival at the goal, sequential activation of spatial cells may represent the just-taken route, enabling route learning and evaluation. Here, we review and synthesize these and other evidence for goal coding in mammalian brains, relate the experimental findings to predictions from computational models, and discuss outstanding questions and future challenges.

Closed-loop Modulation of the Self-regulating Brain: A Review on Approaches, Emerging Paradigms, and Experimental Designs

Closed-loop approaches, setups, and experimental designs have been applied within the field of neuroscience to enhance the understanding of basic neurophysiology principles (closed-loop neuroscience; CLNS) and to develop improved procedures for modulating brain circuits and networks for clinical purposes (closed-loop neuromodulation; CLNM). The contents of this review are thus arranged into the following sections. First, we describe basic research findings that have been made using CLNS. Next, we provide an overview of the application, rationale, and therapeutic aspects of CLNM for clinical purposes. Finally, we summarize methodological concerns and critics in clinical practice of neurofeedback and novel applications of closed-loop perspective and techniques to improve and optimize its experiments. Moreover, we outline the theoretical explanations and experimental ideas to test animal models of neurofeedback and discuss technical issues and challenges associated with implementing closed-loop systems. We hope this review is helpful for both basic neuroscientists and clinical/ translationally-oriented scientists interested in applying closed-loop methods to improve mental health and well-being.

Neuronal sequences during theta rely on behavior-dependent spatial maps

Navigation through space involves learning and representing relationships between past, current, and future locations. In mammals, this might rely on the hippocampal theta phase code, where in each cycle of the theta oscillation, spatial representations provided by neuronal sequences start behind the animal's true location and then sweep forward. However, the exact relationship between theta phase, represented position and true location remains unclear and even paradoxical. Here, we formalize previous notions of 'spatial' or 'temporal' theta sweeps that have appeared in the literature. We analyze single-cell and population variables in unit recordings from rat CA1 place cells and compare them to model simulations based on each of these schemes. We show that neither spatial nor temporal sweeps quantitatively accounts for how all relevant variables change with running speed. To reconcile these schemes with our observations, we introduce 'behavior-dependent' sweeps, in which theta sweep length and place field properties, such as size and phase precession, vary across the environment depending on the running speed characteristic of each location. These behavior-dependent spatial maps provide a structured heterogeneity that is essential for understanding the hippocampal code.

Disorganization of Oscillatory Activity in Animal Models of Schizophrenia

Schizophrenia is a chronic, debilitating disorder with diverse symptomatology, including disorganized cognition and behavior. Despite considerable research effort, we have only a limited understanding of the underlying brain dysfunction. In this article, we review the potential role of oscillatory circuits in the disorder with a particular focus on the hippocampus, a region that encodes sequential information across time and space, as well as the frontal cortex. Several mechanistic explanations of schizophrenia propose that a loss of oscillatory synchrony between and within these brain regions may underlie some of the symptoms of the disorder. We describe how these oscillations are affected in several animal models of schizophrenia, including models of genetic risk, maternal immune activation (MIA) models, and models of NMDA receptor hypofunction. We then critically discuss the evidence for disorganized oscillatory activity in these models, with a focus on gamma, sharp wave ripple, and theta activity, including the role of cross-frequency coupling as a synchronizing mechanism. Finally, we focus on phase precession, which is an oscillatory phenomenon whereby individual hippocampal place cells systematically advance their firing phase against the background theta oscillation. Phase precession is important because it allows sequential experience to be compressed into a single 120 ms theta cycle (known as a 'theta sequence'). This time window is appropriate for the induction of synaptic plasticity. We describe how disruption of phase precession could disorganize sequential processing, and thereby disrupt the ordered storage of information. A similar dysfunction in schizophrenia may contribute to cognitive symptoms, including deficits in episodic memory, working memory, and future planning.

The Prefrontal-Hippocampal Comparator: Volition and Episodic Memory

This review describes recent research that is relevant to the prefrontal-hippocampal comparator model with the following conclusions: 1. Hippocampal area CA1 serves, at least in part, as an associative match-mismatch comparator. 2. Voluntary movement strengthens episodic memories for goal-directed behavior. 3. Hippocampal theta power serves as a prediction error signal during hippocampal dependent tasks. 4. The self-referential component of episodic memory in humans is mediated by the corollary discharge (the efference copy of the action plan developed by prefrontal cortex and transmitted to hippocampus where it is stored as a working memory; CA1 uses this efference copy to compare the expected consequences of action to the actual consequences of action). 5. Impairments in the production or transmission of this corollary discharge may contribute to some of the symptoms of schizophrenia. Unresolved issues and suggestions for future research are discussed.

How development sculpts hippocampal circuits and function

In mammals, the selective transformation of transient experience into stored memory occurs in the hippocampus, which develops representations of specific events in the context in which they occur. In this review, we focus on the development of hippocampal circuits and the self-organized dynamics embedded within them since the latter critically support the role of the hippocampus in learning and memory. We first discuss evidence that adult hippocampal cells and circuits are sculpted by development as early as during embryonic neurogenesis. We argue that these primary developmental programs provide a scaffold onto which later experience of the external world can be grafted. Next, we review the different sequences in the development of hippocampal cells and circuits at anatomical and functional levels. We cover a period extending from neurogenesis and migration to the appearance of phenotypic diversity within hippocampal cells, and their wiring into functional networks. We describe the progressive emergence of network dynamics in the hippocampus, from sensorimotor-driven early sharp waves to sequences of place cells tracking relational information. We outline the critical turn points and discontinuities in that developmental journey, and close by formulating open questions. We propose that rewinding the process of hippocampal development helps understand the main organization principles of memory circuits.

Involvement of the Nucleus Incertus and Relaxin-3/RXFP3 Signaling System in Explicit and Implicit Memory

Telencephalic cognitive and emotional circuits/functions are strongly modulated by subcortical inputs. The main focus of past research on the nature of this modulation has been on the widespread monoamine projections to the telencephalon. However, the nucleus incertus (NI) of the pontine tegmentum provides a strong GABAergic and peptidergic innervation of the hippocampus, basal forebrain, amygdala, prefrontal cortex, and related regions; and represents a parallel source of ascending modulation of cognitive and emotional domains. NI GABAergic neurons express multiple peptides, including neuromedin-B, cholecystokinin, and relaxin-3, and receptors for stress and arousal transmitters, including corticotrophin-releasing factor and orexins/hypocretins. A functional relationship exists between NI neurons and their associated peptides, relaxin-3 and neuromedin-B, and hippocampal theta rhythm, which in turn, has a key role in the acquisition and extinction of declarative and emotional memories. Furthermore, RXFP3, the cognate receptor for relaxin-3, is a G_i/o protein-coupled receptor, and its activation inhibits the cellular accumulation of cAMP and induces phosphorylation of ERK, processes associated with memory formation in the hippocampus and amygdala. Therefore, this review summarizes the role of NI transmitter systems in relaying stress- and arousal-related signals to the higher neural circuits and processes associated with memory formation and retrieval.

Competitive state of movements during planning predicts sequence performance

Humans can learn and produce skilled movement sequences from memory, yet the nature of sequence planning is not well understood. Previous computational and neurophysiological work suggests that movements in a sequence are planned as parallel graded activations and selected for output through competition. However, the relevance of this planning pattern to sequence production fluency and accuracy, as opposed to the temporal structure of sequences, is unclear. To resolve this question, we assessed the relative availability of constituent movements behaviorally during the preparation of motor sequences from memory. In three separate multisession experiments, healthy participants were trained to retrieve and produce four-element finger press sequences with particular timing according to an abstract sequence cue. We evaluated reaction time (RT) and error rate as markers of movement availability to constituent movement probes. Our results demonstrate that longer preparation time produces more pronounced differences in availability between adjacent sequence elements, whereas no effect was found for sequence speed or temporal grouping. Further, participants with larger position-dependent differences in movement availability tended to initiate correct sequences faster and with a higher temporal accuracy. Our results suggest that competitive preactivation is established gradually during sequence planning and predicts sequence skill, rather than the temporal structure of the motor sequence.NEW & NOTEWORTHY Sequence planning is an integral part of motor sequence control. Here, we demonstrate that the competitive state of sequential movements during sequence planning can be read out behaviorally through movement probes. We show that position-dependent differences in movement availability during planning reflect sequence preparedness and skill but not the timing of the planned sequence. Behavioral access to the preparatory state of movements may serve as a marker of sequence planning capacity.

Time to put the mammillothalamic pathway into context

The medial diencephalon, in particular the mammillary bodies and anterior thalamic nuclei, has long been linked to memory and amnesia. The mammillary bodies provide a dense input into the anterior thalamic nuclei, via the mammillothalamic tract. In both animal models, and in patients, lesions of the mammillary bodies, mammillothalamic tract and anterior thalamic nuclei all produce severe impairments in temporal and contextual memory, yet it is uncertain why these regions are critical. Mounting evidence from electrophysiological and neural imaging studies suggests that mammillothalamic projections exercise considerable distal influence over thalamo-cortical and hippocampo-cortical interactions. Here, we outline how damage to the mammillary body-anterior thalamic axis, in both patients and animal models, disrupts behavioural performance on tasks that relate to contextual ("where") and temporal ("when") processing. Focusing on the medial mammillary nuclei as a possible 'theta-generator' (through their interconnections with the ventral tegmental nucleus of Gudden) we discuss how the mammillary body-anterior thalamic pathway may contribute to the mechanisms via which the hippocampus and neocortex encode representations of experience.

Voltage-independent GluN2A-type NMDA receptor Ca2+ signaling promotes audiogenic seizures, attentional and cognitive deficits in mice

The NMDA receptor-mediated Ca2+ signaling during simultaneous pre- and postsynaptic activity is critically involved in synaptic plasticity and thus has a key role in the nervous system. In GRIN2-variant patients alterations of this coincidence detection provoked complex clinical phenotypes, ranging from reduced muscle strength to epileptic seizures and intellectual disability. By using our gene-targeted mouse line (Grin2aN615S), we show that voltage-independent glutamate-gated signaling of GluN2A-containing NMDA receptors is associated with NMDAR-dependent audiogenic seizures due to hyperexcitable midbrain circuits. In contrast, the NMDAR antagonist MK-801-induced c-Fos expression is reduced in the hippocampus. Likewise, the synchronization of theta- and gamma oscillatory activity is lowered during exploration, demonstrating reduced hippocampal activity. This is associated with exploratory hyperactivity and aberrantly increased and dysregulated levels of attention that can interfere with associative learning, in particular when relevant cues and reward outcomes are disconnected in space and time. Together, our findings provide (i) experimental evidence that the inherent voltage-dependent Ca2+ signaling of NMDA receptors is essential for maintaining appropriate responses to sensory stimuli and (ii) a mechanistic explanation for the neurological manifestations seen in the NMDAR-related human disorders with GRIN2 variant-meidiated intellectual disability and focal epilepsy.

Spatial inference without a cognitive map: the role of higher-order path integration

The cognitive map has been taken as the standard model for how agents infer the most efficient route to a goal location. Alternatively, path integration - maintaining a homing vector during navigation - constitutes a primitive and presumably less-flexible strategy than cognitive mapping because path integration relies primarily on vestibular stimuli and pace counting. The historical debate as to whether complex spatial navigation is ruled by associative learning or cognitive map mechanisms has been challenged by experimental difficulties in successfully neutralizing path integration. To our knowledge, there are only three studies that have succeeded in resolving this issue, all showing clear evidence of novel route taking, a behaviour outside the scope of traditional associative learning accounts. Nevertheless, there is no mechanistic explanation as to how animals perform novel route taking. We propose here a new model of spatial learning that combines path integration with higher-order associative learning, and demonstrate how it can account for novel route taking without a cognitive map, thus resolving this long-standing debate. We show how our higher-order path integration (HOPI) model can explain spatial inferences, such as novel detours and shortcuts. Our analysis suggests that a phylogenetically ancient, vector-based navigational strategy utilizing associative processes is powerful enough to support complex spatial inferences.

Episodic Memories: How do the Hippocampus and the Entorhinal Ring Attractors Cooperate to Create Them?

The brain is capable of registering a constellation of events, encountered only once, as an episodic memory that can last for a lifetime. As evidenced by the clinical case of the patient HM, memories preserving their episodic nature still depend on the hippocampal formation, several years after being created, while semantic memories are thought to reside in neocortical areas. The neurobiological substrate of one-time learning and life-long storing in the brain, that must exist at the cellular and circuit level, is still undiscovered. The breakthrough is delayed by the fact that studies jointly investigating the rodent hippocampus and entorhinal cortex are mostly targeted at understanding the spatial aspect of learning. Here, we present the concept of an entorhinal cortical module, termed EPISODE module, that could explain how the representations of different elements constituting episodic memories can be linked together at the stage of encoding. The new model that we propose here reconciles the structural and functional observations made in the entorhinal cortex and explains how the downstream hippocampal processing organizes the representations into meaningful sequences.

An Attempt at a Unified Theory of the Neocortical Microcircuit in Sensory Cortex

The neocortex performs a wide range of functions, including working memory, sensory perception, and motor planning. Despite this diversity in function, evidence suggests that the neocortex is made up of repeating subunits ("macrocolumns"), each of which is largely identical in circuitry. As such, the specific computations performed by these macrocolumns are of great interest to neuroscientists and AI researchers. Leading theories of this microcircuit include models of predictive coding, hierarchical temporal memory (HTM), and Adaptive Resonance Theory (ART). However, these models have not yet explained: (1) how microcircuits learn sequences input with delay (i.e., working memory); (2) how networks of columns coordinate processing on precise timescales; or (3) how top-down attention modulates sensory processing. I provide a theory of the neocortical microcircuit that extends prior models in all three ways. Additionally, this theory provides a novel working memory circuit that extends prior models to support simultaneous multi-item storage without disrupting ongoing sensory processing. I then use this theory to explain the functional origin of a diverse set of experimental findings, such as cortical oscillations.

Integrated Transcriptome Analyses Revealed Key Target Genes in Mouse Models of Autism

Genetic mutations are the major pathogenic factor of Autism Spectrum Disorder (ASD). In recent years, more and more ASD risk genes have been revealed, among which there are a group of transcriptional regulators. Considering the similarity of the core clinical phenotypes, it is possible that these different factors may regulate the expression levels of certain key targets. Identification of these targets could facilitate the understanding of the etiology and developing of novel diagnostic and therapeutic methods. Therefore, we performed integrated transcriptome analyses of RNA-Seq and microarray data in multiple ASD mouse models and identified a number of common downstream genes in various brain regions, many of which are related to the structure and function of the synapse components or drug addiction. We then established protein-protein interaction networks of the overlapped targets and isolated the hub genes by 11 algorithms based on the topological structure of the networks, including Sdc4, Vegfa, and Cp in the Cortex-Adult subgroup, Gria1 in the Cortex-Juvenile subgroup, and Kdr, S1pr1, Ubc, Grm2, Grin2b, Nrxn1, Pdyn, Grin3a, Itgam, Grin2a, Gabra2, and Camk4 in the Hippocampus-Adult subgroup, many of which have been associated with ASD in previous studies. Finally, we cross compared our results with human brain transcriptional data sets and verified several key candidates, which may play important role in the pathology process of ASD, including SDC4, CP, S1PR1, UBC, PDYN, GRIN2A, GABRA2, and CAMK4. In summary, by integrated bioinformatics analysis, we have identified a series of potentially important molecules for future ASD research. Autism Res 2020, 13: 352-368. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Abnormal transcriptional regulation accounts for a significant portion of Autism Spectrum Disorder. In this study, we performed transcriptome analyses of mouse models to identify common downstream targets of transcriptional regulators involved in ASD. We identified several recurrent target genes that are close related to the common pathological process of ASD, including SDC4, CP, S1PR1, UBC, PDYN, GRM2, NRXN1, GRIN3A, ITGAM, GRIN2A, GABRA2, and CAMK4. These results provide potentially important targets for understanding the molecular mechanism of ASD.