Encoding and retrieval of episodic memories: role of cholinergic and GABAergic modulation in the hippocampus

The neuroscience of active learning and direct instruction

Throughout the educational system, students experiencing active learning pedagogy perform better and fail less than those taught through direct instruction. Can this be ascribed to differences in learning from a neuroscientific perspective? This review examines mechanistic, neuroscientific evidence that might explain differences in cognitive engagement contributing to learning outcomes between these instructional approaches. In classrooms, direct instruction comprehensively describes academic content, while active learning provides structured opportunities for learners to explore, apply, and manipulate content. Synaptic plasticity and its modulation by arousal or novelty are central to all learning and both approaches. As a form of social learning, direct instruction relies upon working memory. The reinforcement learning circuit, associated agency, curiosity, and peer-to-peer social interactions combine to enhance motivation, improve retention, and build higher-order-thinking skills in active learning environments. When working memory becomes overwhelmed, additionally engaging the reinforcement learning circuit improves retention, providing an explanation for the benefits of active learning. This analysis provides a mechanistic examination of how emerging neuroscience principles might inform pedagogical choices at all educational levels.

Spontaneous Dynamics of Hippocampal Place Fields in a Model of Combinatorial Competition among Stable Inputs

We present computer simulations illustrating how the plastic integration of spatially stable inputs could contribute to the dynamic character of hippocampal spatial representations. In novel environments of slightly larger size than typical apparatus, the emergence of well-defined place fields in real place cells seems to rely on inputs from normally functioning grid cells. Theoretically, the grid-to-place transformation is possible if a place cell is able to respond selectively to a combination of suitably aligned grids. We previously identified the functional characteristics that allow a synaptic plasticity rule to accomplish this selection by synaptic competition during rat foraging behavior. Here, we show that the synaptic competition can outlast the formation of place fields, contributing to their spatial reorganization over time, when the model is run in larger environments and the topographical/modular organization of grid inputs is taken into account. Co-simulated cells that differ only by their randomly assigned grid inputs display different degrees and kinds of spatial reorganization-ranging from place-field remapping to more subtle in-field changes or lapses in firing. The model predicts a greater number of place fields and propensity for remapping in place cells recorded from more septal regions of the hippocampus and/or in larger environments, motivating future experimental standardization across studies and animal models. In sum, spontaneous remapping could arise from rapid synaptic learning involving inputs that are functionally homogeneous, spatially stable, and minimally stochastic.

Remote memory in a Bayesian model of context fear conditioning (BaconREM)

Here, we propose a model of remote memory (BaconREM), which is an extension of a previously published Bayesian model of context fear learning (BACON) that accounts for many aspects of recently learned context fear. BaconREM simulates most known phenomenology of remote context fear as studied in rodents and makes new predictions. In particular, it predicts the well-known observation that fear that was conditioned to a recently encoded context becomes hippocampus-independent and shows much-enhanced generalization ("hyper-generalization") when systems consolidation occurs (i.e., when memory becomes remote). However, the model also predicts that there should be circumstances under which the generalizability of remote fear may not increase or even decrease. It also predicts the established finding that a "reminder" exposure to a feared context can abolish hyper-generalization while at the same time making remote fear again hippocampus-dependent. This observation has in the past been taken to suggest that reminders facilitate access to detail memory that remains permanently in the hippocampus even after systems consolidation is complete. However, the present model simulates this result even though it totally moves all the contextual memory that it retains to the neo-cortex when context fear becomes remote.

Event Integration and Temporal Differentiation: How Hierarchical Knowledge Emerges in Hippocampal Subfields through Learning

Everyday life is composed of events organized by changes in contexts, with each event containing an unfolding sequence of occurrences. A major challenge facing our memory systems is how to integrate sequential occurrences within events while also maintaining their details and avoiding over-integration across different contexts. We asked if and how distinct hippocampal subfields come to hierarchically and, in parallel, represent both event context and subevent occurrences with learning. Female and male human participants viewed sequential events defined as sequences of objects superimposed on shared color frames while undergoing high-resolution fMRI. Importantly, these events were repeated to induce learning. Event segmentation, as indexed by increased reaction times at event boundaries, was observed in all repetitions. Temporal memory decisions were quicker for items from the same event compared to across different events, indicating that events shaped memory. With learning, hippocampal CA3 multivoxel activation patterns clustered to reflect the event context, with more clustering correlated with behavioral facilitation during event transitions. In contrast, in the dentate gyrus (DG), temporally proximal items that belonged to the same event became associated with more differentiated neural patterns. A computational model explained these results by dynamic inhibition in the DG. Additional similarity measures support the notion that CA3 clustered representations reflect shared voxel populations, while DG's distinct item representations reflect different voxel populations. These findings suggest an interplay between temporal differentiation in the DG and attractor dynamics in CA3. They advance our understanding of how knowledge is structured through integration and separation across time and context.

A generative model of memory construction and consolidation

Episodic memories are (re)constructed, share neural substrates with imagination, combine unique features with schema-based predictions and show schema-based distortions that increase with consolidation. Here we present a computational model in which hippocampal replay (from an autoassociative network) trains generative models (variational autoencoders) to (re)create sensory experiences from latent variable representations in entorhinal, medial prefrontal and anterolateral temporal cortices via the hippocampal formation. Simulations show effects of memory age and hippocampal lesions in agreement with previous models, but also provide mechanisms for semantic memory, imagination, episodic future thinking, relational inference and schema-based distortions including boundary extension. The model explains how unique sensory and predictable conceptual elements of memories are stored and reconstructed by efficiently combining both hippocampal and neocortical systems, optimizing the use of limited hippocampal storage for new and unusual information. Overall, we believe hippocampal replay training generative models provides a comprehensive account of memory construction, imagination and consolidation.

The medial septum controls hippocampal supra-theta oscillations

Hippocampal theta oscillations orchestrate faster beta-to-gamma oscillations facilitating the segmentation of neural representations during navigation and episodic memory. Supra-theta rhythms of hippocampal CA1 are coordinated by local interactions as well as inputs from the entorhinal cortex (EC) and CA3 inputs. However, theta-nested gamma-band activity in the medial septum (MS) suggests that the MS may control supra-theta CA1 oscillations. To address this, we performed multi-electrode recordings of MS and CA1 activity in rodents and found that MS neuron firing showed strong phase-coupling to theta-nested supra-theta episodes and predicted changes in CA1 beta-to-gamma oscillations on a cycle-by-cycle basis. Unique coupling patterns of anatomically defined MS cell types suggested that indirect MS-to-CA1 pathways via the EC and CA3 mediate distinct CA1 gamma-band oscillations. Optogenetic activation of MS parvalbumin-expressing neurons elicited theta-nested beta-to-gamma oscillations in CA1. Thus, the MS orchestrates hippocampal network activity at multiple temporal scales to mediate memory encoding and retrieval.

Predictions transform memories: How expected versus unexpected events are integrated or separated in memory

Our brains constantly generate predictions about the environment based on prior knowledge. Many of the events we experience are consistent with these predictions, while others might be inconsistent with prior knowledge and thus violate our predictions. To guide future behavior, the memory system must be able to strengthen, transform, or add to existing knowledge based on the accuracy of our predictions. We synthesize recent evidence suggesting that when an event is consistent with our predictions, it leads to neural integration between related memories, which is associated with enhanced associative memory, as well as memory biases. Prediction errors, in turn, can promote both neural integration and separation, and lead to multiple mnemonic outcomes. We review these findings and how they interact with factors such as memory reactivation, prediction error strength, and task goals, to offer insight into what determines memory for events that violate our predictions. In doing so, this review brings together recent neural and behavioral research to advance our understanding of how predictions shape memory, and why.

Spontaneous dynamics of hippocampal place fields in a model of combinatorial competition among stable inputs

We present computer simulations illustrating how the plastic integration of spatially stable inputs could contribute to the dynamic character of hippocampal spatial representations. In novel environments of slightly larger size than typical apparatus, the emergence of well-defined place fields in real place cells seems to rely on inputs from normally functioning grid cells. Theoretically, the grid-to-place transformation is possible if a place cell is able to respond selectively to a combination of suitably aligned grids. We previously identified the functional characteristics that allow a synaptic plasticity rule to accomplish this selection by synaptic competition during rat foraging behavior. Here, we show that the synaptic competition can outlast the formation of place fields, contributing to their spatial reorganization over time, when the model is run in larger environments and the topographical/modular organization of grid inputs is taken into account. Co-simulated cells that differ only by their randomly assigned grid inputs display different degrees and kinds of spatial reorganization-ranging from place-field remapping to more subtle in-field changes or lapses in firing. The model predicts a greater number of place fields and propensity for remapping in place cells recorded from more septal regions of the hippocampus and/or in larger environments, motivating future experimental standardization across studies and animal models. In sum, spontaneous remapping could arise from rapid synaptic learning involving inputs that are functionally homogeneous, spatially stable, and minimally stochastic.

Significance Statement

In both AI and theoretical neuroscience, learning systems often rely on the asymptotic convergence of slow-acting learning rules applied to input spaces that are presumed to be sampled repeatedly, for example over developmental timescales. Place cells of the hippocampus testify to a neural system capable of rapidly encoding cognitive variables-such as the animal's position in space-from limited experience. These internal representations undergo "spontaneous" changes over time, spurring much interest in their cognitive significance and underlying mechanisms. We investigate a model suggesting that some of these changes could be a tradeoff of rapid learning.

Perception and memory retrieval states are reflected in distributed patterns of background functional connectivity

The same visual input can serve as the target of perception or as a trigger for memory retrieval depending on whether cognitive processing is externally oriented (perception) or internally oriented (memory retrieval). While numerous human neuroimaging studies have characterized how visual stimuli are differentially processed during perception versus memory retrieval, perception and memory retrieval may also be associated with distinct neural states that are independent of stimulus-evoked neural activity. Here, we combined human fMRI with full correlation matrix analysis (FCMA) to reveal potential differences in "background" functional connectivity across perception and memory retrieval states. We found that perception and retrieval states could be discriminated with high accuracy based on patterns of connectivity across (1) the control network, (2) the default mode network (DMN), and (3) retrosplenial cortex (RSC). In particular, clusters in the control network increased connectivity with each other during the perception state, whereas clusters in the DMN were more strongly coupled during the retrieval state. Interestingly, RSC switched its coupling between networks as the cognitive state shifted from retrieval to perception. Finally, we show that background connectivity (1) was fully independent from stimulus-related variance in the signal and, further, (2) captured distinct aspects of cognitive states compared to traditional classification of stimulus-evoked responses. Together, our results reveal that perception and memory retrieval are associated with sustained cognitive states that manifest as distinct patterns of connectivity among large-scale brain networks.

A deep network-based model of hippocampal memory functions under normal and Alzheimer's disease conditions

We present a deep network-based model of the associative memory functions of the hippocampus. The proposed network architecture has two key modules: (1) an autoencoder module which represents the forward and backward projections of the cortico-hippocampal projections and (2) a module that computes familiarity of the stimulus and implements hill-climbing over the familiarity which represents the dynamics of the loops within the hippocampus. The proposed network is used in two simulation studies. In the first part of the study, the network is used to simulate image pattern completion by autoassociation under normal conditions. In the second part of the study, the proposed network is extended to a heteroassociative memory and is used to simulate picture naming task in normal and Alzheimer's disease (AD) conditions. The network is trained on pictures and names of digits from 0 to 9. The encoder layer of the network is partly damaged to simulate AD conditions. As in case of AD patients, under moderate damage condition, the network recalls superordinate words ("odd" instead of "nine"). Under severe damage conditions, the network shows a null response ("I don't know"). Neurobiological plausibility of the model is extensively discussed.

Underlying mechanisms of long-term potentiation during the inhibition of the cannabinoid CB1 and GABAB receptors in the dentate gyrus of hippocampus

BACKGROUND

The release of various neurotransmitters and thereby the excitability of neuronal circuits are regulated by the endocannabinoid system in an activity-dependent manner. Hippocampal long-term potentiation (LTP) is augmented in cannabinoid type 1 (CB1) receptor-deficient mice. CB1 receptors exist on GABAergic axon terminals in the hippocampus. In our previous work, we showed that CB1 antagonists increased the population spike (PS) amplitude, field excitatory post-synaptic potential (fEPSP), and the LTP induction in the dentate gyrus (DG) of the rat hippocampus while the GABA_B antagonist decreased these parameters. Determining the underlying mechanisms of the pre- and/or postsynaptic locus of LTP expression is of great importance. In this study, we investigated whether LTP alteration acutely caused by CB1 and GABA_B receptor antagonists (AM251 and CGP55845, respectively) happens at the postsynaptic or presynaptic regions, or at both. Therefore, the paired-pulse ratio (PPR) was assessed prior to and following the LTP induction in the studied groups.

METHODS

Male Wistar rats were randomly assigned to the groups of control, AM251, CGP55845, CGP55845 + AM251. A high-frequency stimulation (HFS) of the perforant path (PP) was used to induce LTP in the DG region.

RESULTS

Statistical analysis revealed that AM251 produced significant increase in excitatory postsynaptic potential (EPSP) slope and amplitude of PS. Conversely, administration of CGP55845 produced decrease in slope of EPSP. The current results indicated that the PPR was not influenced by LTP induction in the presence of AM251 or CGP55845 either alone or their combination.

CONCLUSIONS

It can be concluded that the site causing LTP expression is, at least in part, the postsynaptic site because PPR was not influenced by LTP induction in the presence of AM251 or CGP55845 either alone or their combination.

Subtle visual change in a virtual environment induces heterogeneous remapping systematically in CA1, but not CA3

Environmental change may lead to new memories or modify old ones, but the underlying neural mechanisms are largely unclear. We recorded hippocampal place cells simultaneously from CA1 and CA3 in a virtual reality environment. Compared with CA1, place cells in CA3 are more tolerant of individual landmark changes but undergo orthogonal changes to code distinctively different environments. As visual noise (virtual fog) is introduced to a visually enriched environment, place cells in CA1 split into two subpopulations: in one, place cells maintain their field locations while changing their firing rates to reflect sensory changes; in the other, place cells exhibit global remapping in response to the contextual change. In contrast, place cells in CA3 exhibit mainly rate remapping under the same conditions. Our results suggest that CA1 may simultaneously represent heterogeneous maps of the same environment when subtle visual noise induces both sensory and contextual changes.

Hippocampal convergence during anticipatory midbrain activation promotes subsequent memory formation

The hippocampus has been a focus of memory research since H.M's surgery abolished his ability to form new memories, yet its mechanistic role in memory remains debated. Here, we identify a candidate memory mechanism: an anticipatory hippocampal "convergence state", observed while awaiting valuable information, and which predicts subsequent learning. During fMRI, participants viewed trivia questions eliciting high or low curiosity, followed seconds later by its answer. We reasoned that encoding success requires a confluence of conditions, so that hippocampal states more conducive to memory formation should converge in state space. To operationalize convergence of neural states, we quantified the typicality of multivoxel patterns in the medial temporal lobes during anticipation and encoding of trivia answers. We found that the typicality of anticipatory hippocampal patterns increased during high curiosity. Crucially, anticipatory hippocampal pattern typicality increased with dopaminergic midbrain activation and uniquely accounted for the association between midbrain activation and subsequent recall. We propose that hippocampal convergence states may complete a cascade from motivation and midbrain activation to memory enhancement, and may be a general predictor of memory formation.

The role of astrocytes in place cell formation: A computational modeling study

Place cells develop spatially-tuned receptive fields during the early stages of novel environment exploration. The generative mechanism underlying these spatially-selective responses remains largely elusive, but has been associated with theta rhythmicity. An important factor implicating the transformation of silent cells to place cells is a spatially-uniform depolarization that is mediated by a persistent sodium current. This neuronal current is modulated by extracellular calcium concentration, which, in turn, is actively controlled by astrocytes. However, there is no established relationship between the neuronal depolarization and astrocytic activity. To consider this link, we designed a bioplausible computational model of a neuronal-astrocytic network, where astrocytes induced the transient emergence of place fields in silent cells, and accelerated the plasticity-induced consolidation of place cells. Interestingly, theta oscillations emerged naturally at the network level, resulting from the astrocytic modulation of subcellular neuronal properties. Our results suggest that astrocytes participate in spatial mapping and exploration, and further highlight the computational roles of these cells in the brain.

Hippocampal representations switch from errors to predictions during acquisition of predictive associations

We constantly exploit the statistical regularities in our environment to help guide our perception. The hippocampus has been suggested to play a pivotal role in both learning environmental statistics, as well as exploiting them to generate perceptual predictions. However, it is unclear how the hippocampus balances encoding new predictive associations with the retrieval of existing ones. Here, we present the results of two high resolution human fMRI studies (N = 24 for both experiments) directly investigating this. Participants were exposed to auditory cues that predicted the identity of an upcoming visual shape (with 75% validity). Using multivoxel decoding analysis, we find that the hippocampus initially preferentially represents unexpected shapes (i.e., those that violate the cue regularities), but later switches to representing the cue-predicted shape regardless of which was actually presented. These findings demonstrate that the hippocampus is involved both acquiring and exploiting predictive associations, and is dominated by either errors or predictions depending on whether learning is ongoing or complete.

Impact of optogenetic pulse design on CA3 learning and replay: A neural model

Optogenetic manipulation of hippocampal circuitry is an important tool for investigating learning in vivo. Numerous approaches to pulse design have been employed to elicit desirable circuit and behavioral outcomes. Here, we systematically test the outcome of different single-pulse waveforms in a rate-based model of hippocampal memory function at the level of mnemonic replay extension and de novo synaptic weight formation in CA3 and CA1. Lower-power waveforms with long forward or forward and backward ramps yield more natural sequence replay dynamics and induce synaptic plasticity that allows for more natural memory replay timing, in contrast to square or backward ramps. These differences between waveform shape and amplitude are preserved with the addition of noise in membrane potential, light scattering, and protein expression, improving the potential validity of predictions for in vivo work. These results inform future optogenetic experimental design choices in the field of learning and memory.

Neuromodulation and Neurophysiology on the Timescale of Learning and Decision-Making

Nervous systems evolved to effectively navigate the dynamics of the environment to achieve their goals. One framework used to study this fundamental problem arose in the study of learning and decision-making. In this framework, the demands of effective behavior require slow dynamics-on the scale of seconds to minutes-of networks of neurons. Here, we review the phenomena and mechanisms involved. Using vignettes from a few species and areas of the nervous system, we view neuromodulators as key substrates for temporal scaling of neuronal dynamics. Expected final online publication date for the Annual Review of Neuroscience, Volume 45 is July 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

A neural network model of when to retrieve and encode episodic memories

Recent human behavioral and neuroimaging results suggest that people are selective in when they encode and retrieve episodic memories. To explain these findings, we trained a memory-augmented neural network to use its episodic memory to support prediction of upcoming states in an environment where past situations sometimes reoccur. We found that the network learned to retrieve selectively as a function of several factors, including its uncertainty about the upcoming state. Additionally, we found that selectively encoding episodic memories at the end of an event (but not mid-event) led to better subsequent prediction performance. In all of these cases, the benefits of selective retrieval and encoding can be explained in terms of reducing the risk of retrieving irrelevant memories. Overall, these modeling results provide a resource-rational account of why episodic retrieval and encoding should be selective and lead to several testable predictions.

Prefrontal-Hippocampal Pathways Through the Nucleus Reuniens Are Functionally Biased by Brain State

Circuit-level communication between disparate brain regions is fundamental for the complexities of the central nervous system operation. Co-ordinated bouts of rhythmic activity between the prefrontal cortex (PFC) and hippocampus (HPC), in particular, are important for mnemonic processes. This is true during awake behavior, as well as during offline states like sleep. We have recently shown that the anatomically interposed thalamic nucleus reuniens (RE) has a role in coordinating slow-wave activity between the PFC and HPC. Here, we took advantage of spontaneous brain state changes occurring during urethane anesthesia in order to assess if PFC-HPC communication was modified during activated (theta) vs. deactivated (slow oscillation: SO) states. These forebrain states are highly similar to those expressed during rapid eye movement (REM) and non-REM stages of natural sleep, respectively. Evoked potentials and excitatory current sinks in the HPC were consistently larger during SO states, regardless of whether PFC or RE afferents were stimulated. Interestingly, PFC stimulation during theta appeared to preferentially use a cortico-cortical pathway, presumably involving the entorhinal cortex as opposed to the more direct RE to HPC conduit. Optogenetic and chemogenetic manipulations of the RE suggested that this state-dependent biasing was mediated by responding in the RE itself. Finally, the phase of both ongoing rhythms also appeared to be an important factor in modulating HPC responses, with maximal field excitatory postsynaptic potentials (EPSPs) occurring during the negative-going phase of both rhythms. Thus, forebrain state plays an important role in how communication takes place across the PFC and HPC, with the RE as a determining factor in how this is shaped. Furthermore, ongoing sleep-like rhythms influence the coordination and perhaps potentiate excitatory processing in this extended episodic memory circuit. Our results have direct implications for activity-dependent processes relevant to sleep-dependent memory consolidation.

Prediction errors disrupt hippocampal representations and update episodic memories

The brain supports adaptive behavior by generating predictions, learning from errors, and updating memories to incorporate new information. Prediction error, or surprise, triggers learning when reality contradicts expectations. Prior studies have shown that the hippocampus signals prediction errors, but the hypothesized link to memory updating has not been demonstrated. In a human functional MRI study, we elicited mnemonic prediction errors by interrupting familiar narrative videos immediately before the expected endings. We found that prediction errors reversed the relationship between univariate hippocampal activation and memory: greater hippocampal activation predicted memory preservation after expected endings, but memory updating after surprising endings. In contrast to previous studies, we show that univariate activation was insufficient for understanding hippocampal prediction error signals. We explain this surprising finding by tracking both the evolution of hippocampal activation patterns and the connectivity between the hippocampus and neuromodulatory regions. We found that hippocampal activation patterns stabilized as each narrative episode unfolded, suggesting sustained episodic representations. Prediction errors disrupted these sustained representations and the degree of disruption predicted memory updating. The relationship between hippocampal activation and subsequent memory depended on concurrent basal forebrain activation, supporting the idea that cholinergic modulation regulates attention and memory. We conclude that prediction errors create conditions that favor memory updating, prompting the hippocampus to abandon ongoing predictions and make memories malleable.

Acetylcholine Boosts Dendritic NMDA Spikes in a CA3 Pyramidal Neuron Model

Acetylcholine has been proposed to facilitate the formation of memory ensembles within the hippocampal CA3 network, by enhancing plasticity at CA3-CA3 recurrent synapses. Regenerative NMDA receptor (NMDAR) activation in CA3 neuron dendrites (NMDA spikes) increase synaptic Ca²⁺ influx and can trigger this synaptic plasticity. Acetylcholine inhibits potassium channels which enhances dendritic excitability and therefore could facilitate NMDA spike generation. Here, we investigate NMDAR-mediated nonlinear synaptic integration in stratum radiatum (SR) and stratum lacunosum moleculare (SLM) dendrites in a reconstructed CA3 neuron computational model and study the effect of cholinergic inhibition of potassium conductances on this nonlinearity. We found that distal SLM dendrites, with a higher input resistance, had a lower threshold for NMDA spike generation compared to SR dendrites. Simulating acetylcholine by blocking potassium channels (M-type, A-type, Ca²⁺-activated, and inwardly-rectifying) increased dendritic excitability and reduced the number of synapses required to generate NMDA spikes, particularly in the SR dendrites. The magnitude of this effect was heterogeneous across different dendritic branches within the same neuron. These results predict that acetylcholine facilitates dendritic integration and NMDA spike generation in selected CA3 dendrites which could strengthen connections between specific CA3 neurons to form memory ensembles.

Neural circuits and symbolic processing

The ability to use symbols is a defining feature of human intelligence. However, neuroscience has yet to explain the fundamental neural circuit mechanisms for flexibly representing and manipulating abstract concepts. This article will review the research on neural models for symbolic processing. The review first focuses on the question of how symbols could possibly be represented in neural circuits. The review then addresses how neural symbolic representations could be flexibly combined to meet a wide range of reasoning demands. Finally, the review assesses the research on program synthesis and proposes that the most flexible neural representation of symbolic processing would involve the capacity to rapidly synthesize neural operations analogous to lambda calculus to solve complex cognitive tasks.

Mnemonic prediction errors promote detailed memories

When our experience violates our predictions, it is adaptive to update our knowledge to promote a more accurate representation of the world and facilitate future predictions. Theoretical models propose that these mnemonic prediction errors should be encoded into a distinct memory trace to prevent interference with previous, conflicting memories. We investigated this proposal by repeatedly exposing participants to pairs of sequentially presented objects (A → B), thus evoking expectations. Then, we violated participants' expectations by replacing the second object in the pairs with a novel object (A → C). The following item memory test required participants to discriminate between identical old items and similar lures, thus testing detailed and distinctive item memory representations. In two experiments, mnemonic prediction errors enhanced item memory: Participants correctly identified more old items as old when those items violated expectations during learning, compared with items that did not violate expectations. This memory enhancement for C items was only observed when participants later showed intact memory for the related A → B pairs, suggesting that strong predictions are required to facilitate memory for violations. Following up on this, a third experiment reduced prediction strength prior to violation and subsequently eliminated the memory advantage of violations. Interestingly, mnemonic prediction errors did not increase gist-based mistakes of identifying old items as similar lures or identifying similar lures as old. Enhanced item memory in the absence of gist-based mistakes suggests that violations enhanced memory for items' details, which could be mediated via distinct memory traces. Together, these results advance our knowledge of how mnemonic prediction errors promote memory formation.

Content-specific vulnerability of recent episodic memories in Alzheimer's disease

Endel Tulving's episodic memory framework emphasizes the multifaceted re-experiencing of personal events. Indeed, decades of research focused on the experiential nature of episodic memories, usually treating recent episodic memory as a coherent experiential quality. However, recent insights into the functional architecture of the medial temporal lobe show that different types of mnemonic information are segregated into distinct neural pathways in brain circuits empirically associated with episodic memory. Moreover, recent memories do not fade as a whole under conditions of progressive neurodegeneration in these brain circuits, notably in Alzheimer's disease. Instead, certain memory content seem particularly vulnerable from the moment of their encoding while other content can remain memorable consistently across individuals and contexts. We propose that these observations are related to the content-specific functional architecture of the medial temporal lobe and consequently to a content-specific impairment of memory at different stages of the neurodegeneration. To develop Endel Tulving's inspirational legacy further and to advance our understanding of how memory function is affected by neurodegenerative conditions such as Alzheimer's disease, we postulate that it is compelling to focus on the representational content of recent episodic memories.

•

The functional anatomy of episodic memory segregates different memory content.

•

Alzheimer's disease may cause content-specific loss of recent memories

•

Content-specific memorability across individuals changes with Alzheimer's disease.

•

Content-specific assessment could provide new insights into episodic memory in health and disease

Epistemic Autonomy: Self-supervised Learning in the Mammalian Hippocampus

Biological cognition is based on the ability to autonomously acquire knowledge, or epistemic autonomy. Such self-supervision is largely absent in artificial neural networks (ANN) because they depend on externally set learning criteria. Yet training ANN using error backpropagation has created the current revolution in artificial intelligence, raising the question of whether the epistemic autonomy displayed in biological cognition can be achieved with error backpropagation-based learning. We present evidence suggesting that the entorhinal-hippocampal complex combines epistemic autonomy with error backpropagation. Specifically, we propose that the hippocampus minimizes the error between its input and output signals through a modulatory counter-current inhibitory network. We further discuss the computational emulation of this principle and analyze it in the context of autonomous cognitive systems.

Theta Oscillations Gate the Transmission of Reliable Sequences in the Medial Entorhinal Cortex

Stability and precision of sequential activity in the entorhinal cortex (EC) is crucial for encoding spatially guided behavior and memory. These sequences are driven by constantly evolving sensory inputs and persist despite a noisy background. In a realistic computational model of a medial EC (MEC) microcircuit, we show that intrinsic neuronal properties and network mechanisms interact with theta oscillations to generate reliable outputs. In our model, sensory inputs activate interneurons near their most excitable phase during each theta cycle. As the inputs change, different interneurons are recruited and postsynaptic stellate cells are released from inhibition. This causes a sequence of rebound spikes. The rebound time scale of stellate cells, because of an h–current, matches that of theta oscillations. This fortuitous similarity of time scales ensures that stellate spikes get relegated to the least excitable phase of theta and the network encodes the external drive but ignores recurrent excitation. In contrast, in the absence of theta, rebound spikes compete with external inputs and disrupt the sequence that follows. Further, the same mechanism where theta modulates the gain of incoming inputs, can be used to select between competing inputs to create transient functionally connected networks. Our results concur with experimental data that show, subduing theta oscillations disrupts the spatial periodicity of grid cell receptive fields. In the bat MEC where grid cell receptive fields persist even in the absence of continuous theta oscillations, we argue that other low frequency fluctuations play the role of theta.

Neurochemistry of Visual Attention

Visual attention is the cognitive process that mediates the selection of important information from the environment. This selection is usually controlled by bottom-up and top-down attentional biasing. Since for most humans vision is the dominant sense, visual attention is critically important for higher-order cognitive functions and related deficits are a core symptom of many neuropsychiatric and neurological disorders. Here, we summarize the importance and relative contributions of different neuromodulators and neurotransmitters to the neural mechanisms of top-down and bottom-up attentional control. We will not only review the roles of widely accepted neuromodulators, such as acetylcholine, dopamine and noradrenaline, but also the contributions of other modulatory substances. In doing so, we hope to shed some light on the current understanding of the role of neurochemistry in shaping neuron properties contributing to the allocation of attention in the visual field.

CA2 beyond social memory: Evidence for a fundamental role in hippocampal information processing

Hippocampal region CA2 has received increased attention due to its importance in social recognition memory. While its specific function remains to be identified, there are indications that CA2 plays a major role in a variety of situations, widely extending beyond social memory. In this targeted review, we highlight lines of research which have begun to converge on a more fundamental role for CA2 in hippocampus-dependent memory processing. We discuss recent proposals that speak to the computations CA2 may perform within the hippocampal circuit.

Early changes in synaptic and intrinsic properties of dentate gyrus granule cells in a mouse model of Alzheimer's disease neuropathology and atypical effects of the cholinergic antagonist atropine

It has been reported that hyperexcitability occurs in a subset of patients with Alzheimer's disease (AD) and hyperexcitability could contribute to the disease. Several studies have suggested that the hippocampal dentate gyrus (DG) may be an important area where hyperexcitability occurs. Therefore, we tested the hypothesis that the principal DG cell type, granule cells (GCs), would exhibit changes at the single-cell level which would be consistent with hyperexcitability and might help explain it. We used the Tg2576 mouse, where it has been shown that hyperexcitability is robust at 2-3 months of age. GCs from 2 to 3-month-old Tg2576 mice were compared to age-matched wild type (WT) mice. Effects of muscarinic cholinergic antagonism were tested because previously we found that Tg2576 mice exhibited hyperexcitability in vivo that was reduced by the muscarinic cholinergic antagonist atropine, counter to the dogma that in AD one needs to boost cholinergic function. The results showed that GCs from Tg2576 mice exhibited increased frequency of spontaneous excitatory postsynaptic potentials/currents (sEPSP/Cs) and reduced frequency of spontaneous inhibitory synaptic events (sIPSCs) relative to WT, increasing the excitation:inhibition (E:I) ratio. There was an inward NMDA receptor-dependent current that we defined here as a novel synaptic current (nsC) in Tg2576 mice because it was very weak in WT mice. Intrinsic properties were distinct in Tg2576 GCs relative to WT. In summary, GCs of the Tg2576 mouse exhibit early electrophysiological alterations that are consistent with increased synaptic excitation, reduced inhibition, and muscarinic cholinergic dysregulation. The data support previous suggestions that the DG contributes to hyperexcitability and there is cholinergic dysfunction early in life in AD mouse models.

Prior knowledge promotes hippocampal separation but cortical assimilation in the left inferior frontal gyrus

An adaptive memory system rarely learns information tabula rasa, but rather builds on prior knowledge to facilitate learning. How prior knowledge influences the neural representation of novel associations remains unknown. Here, participants associated pairs of faces in two conditions: a famous, highly familiar face with a novel face or two novel faces while undergoing fMRI. We examine multivoxel activity patterns corresponding to individual faces before and after learning. The activity patterns representing members of famous-novel pairs becomes separated in the hippocampus, that is, more distinct from one another through learning, in striking contrast to paired novel faces that become similar. In the left inferior frontal gyrus, however, prior knowledge leads to integration, and in a specific direction: the representation of the novel face becomes similar to that of the famous face after learning, suggesting assimilation of new into old memories. We propose that hippocampal separation might resolve interference between existing and newly learned information, allowing cortical assimilation. Thus, associative learning with versus without prior knowledge relies on radically different computations.

Prior knowledge strongly impacts new learning, but its influence on the neural representation of novel information is unknown. Here, the authors show multiple neural codes for learning: prior knowledge leads to integrated cortical representations, while promoting hippocampal separation.

Synchronicity of excitatory inputs drives hippocampal networks to distinct oscillatory patterns

The rodent hippocampus expresses a variety of neuronal network oscillations depending on the behavioral state of the animal. Locomotion and active exploration are accompanied by theta-nested gamma oscillations while resting states and slow-wave sleep are dominated by intermittent sharp wave-ripple complexes. It is believed that gamma rhythms create a framework for efficient acquisition of information whereas sharp wave-ripples are thought to be involved in consolidation and retrieval of memory. While not strictly mutually exclusive, one of the two patterns usually dominates in a given behavioral state. Here we explore how different input patterns induce either of the two network states, using an optogenetic stimulation approach in hippocampal brain slices of mice. We report that the pattern of the evoked oscillation depends strongly on the initial synchrony of activation of excitatory cells within CA3. Short, synchronous activation favors the emergence of sharp wave-ripple complexes while persistent but less synchronous activity-as typical for sensory input during exploratory behavior-supports the generation of gamma oscillations. This dichotomy is reflected by different degrees of synchrony of excitatory and inhibitory synaptic currents within these two states. Importantly, the induction of these two fundamental network patterns does not depend on the presence of any neuromodulatory transmitter like acetylcholine, but is merely based on a different synchrony in the initial activation pattern.

Preparation for upcoming attentional states in the hippocampus and medial prefrontal cortex

Goal-directed attention is usually studied by providing individuals with explicit instructions on what they should attend to. But in daily life, we often use past experiences to guide our attentional states. Given the importance of memory for predicting upcoming events, we hypothesized that memory-guided attention is supported by neural preparation for anticipated attentional states. We examined preparatory coding in the human hippocampus and mPFC, two regions that are important for memory-guided behaviors, in two tasks: one where attention was guided by memory and another in which attention was explicitly instructed. Hippocampus and mPFC exhibited higher activity for memory-guided vs. explicitly instructed attention. Furthermore, representations in both regions contained information about upcoming attentional states. In the hippocampus, this preparation was stronger for memory-guided attention, and occurred alongside stronger coupling with visual cortex during attentional guidance. These results highlight the mechanisms by which memories are used to prepare for upcoming attentional goals.

Principles of Neurorehabilitation After Stroke Based on Motor Learning and Brain Plasticity Mechanisms

What are the principles underlying effective neurorehabilitation? The aim of neurorehabilitation is to exploit interventions based on human and animal studies about learning and adaptation, as well as to show that the activation of experience-dependent neuronal plasticity augments functional recovery after stroke. Instead of teaching compensatory strategies that do not reduce impairment but allow the patient to return home as soon as possible, functional recovery might be more sustainable as it ensures a long-term reduction in impairment and an improvement in quality of life. At the same time, neurorehabilitation permits the scientific community to collect valuable data, which allows inferring about the principles of brain organization. Hence neuroscience sheds light on the mechanisms of learning new functions or relearning lost ones. However, current rehabilitation methods lack the exact operationalization of evidence gained from skill learning literature, leading to an urgent need to bridge motor learning theory and present clinical work in order to identify a set of ingredients and practical applications that could guide future interventions. This work aims to unify the neuroscientific literature relevant to the recovery process and rehabilitation practice in order to provide a synthesis of the principles that constitute an effective neurorehabilitation approach. Previous attempts to achieve this goal either focused on a subset of principles or did not link clinical application to the principles of motor learning and recovery. We identified 15 principles of motor learning based on existing literature: massed practice, spaced practice, dosage, task-specific practice, goal-oriented practice, variable practice, increasing difficulty, multisensory stimulation, rhythmic cueing, explicit feedback/knowledge of results, implicit feedback/knowledge of performance, modulate effector selection, action observation/embodied practice, motor imagery, and social interaction. We comment on trials that successfully implemented these principles and report evidence from experiments with healthy individuals as well as clinical work.

The Neurobiology of Mammalian Navigation

Mammals have evolved specialized brain systems to support efficient navigation within diverse habitats and over varied distances, but while navigational strategies and sensory mechanisms vary across species, core spatial components appear to be widely shared. This review presents common elements found in mammalian spatial mapping systems, focusing on the cells in the hippocampal formation representing orientational and locational spatial information, and 'core' mammalian hippocampal circuitry. Mammalian spatial mapping systems make use of both allothetic cues (space-defining cues in the external environment) and idiothetic cues (cues derived from self-motion). As examples of each cue type, we discuss: environmental boundaries, which control both orientational and locational neuronal activity and behaviour; and 'path integration', a process that allows the estimation of linear translation from velocity signals, thought to depend upon grid cells in the entorhinal cortex. Building cognitive maps entails sampling environments: we consider how the mapping system controls exploration to acquire spatial information, and how exploratory strategies may integrate idiothetic with allothetic information. We discuss how 'replay' may act to consolidate spatial maps, and simulate trajectories to aid navigational planning. Finally, we discuss grid cell models of vector navigation.

Modulating the Use of Multiple Memory Systems in Value-based Decisions with Contextual Novelty

With multiple learning and memory systems at its disposal, the human brain can represent the past in many ways, from extracting regularities across similar experiences (incremental learning) to storing rich, idiosyncratic details of individual events (episodic memory). The unique information carried by these neurologically distinct forms of memory can bias our behavior in different directions, raising crucial questions about how these memory systems interact to guide choice and the factors that cause one to dominate. Here, we devised a new approach to estimate how decisions are independently influenced by episodic memories and incremental learning. Furthermore, we identified a biologically motivated factor that biases the use of different memory types-the detection of novelty versus familiarity. Consistent with computational models of cholinergic memory modulation, we find that choices are more influenced by episodic memories following the recognition of an unrelated familiar image but more influenced by incrementally learned values after the detection of a novel image. Together this work provides a new behavioral tool enabling the disambiguation of key memory behaviors thought to be supported by distinct neural systems while also identifying a theoretically important and broadly applicable manipulation to bias the arbitration between these two sources of memories.

Storage fidelity for sequence memory in the hippocampal circuit

Episodic memories have been suggested to be represented by neuronal sequences, which are stored and retrieved from the hippocampal circuit. A special difficulty is that realistic neuronal sequences are strongly correlated with each other since computational memory models generally perform poorly when correlated patterns are stored. Here, we study in a computational model under which conditions the hippocampal circuit can perform this function robustly. During memory encoding, CA3 sequences in our model are driven by intrinsic dynamics, entorhinal inputs, or a combination of both. These CA3 sequences are hetero-associated with the input sequences, so that the network can retrieve entire sequences based on a single cue pattern. We find that overall memory performance depends on two factors: the robustness of sequence retrieval from CA3 and the circuit's ability to perform pattern completion through the feedforward connectivity, including CA3, CA1 and EC. The two factors, in turn, depend on the relative contribution of the external inputs and recurrent drive on CA3 activity. In conclusion, memory performance in our network model critically depends on the network architecture and dynamics in CA3.

Dexpramipexole enhances hippocampal synaptic plasticity and memory in the rat

Even though pharmacological approaches able to counteract age-dependent cognitive impairment have been highly investigated, drugs improving cognition and memory are still an unmet need. It has been hypothesized that sustaining energy dynamics within the aged hippocampus can boost memory storage by sustaining synaptic functioning and long term potentiation (LTP). Dexpramipexole (DEX) is the first-in-class compound able to sustain neuronal bioenergetics by interacting with mitochondrial F1Fo-ATP synthase. In the present study, for the first time we evaluated the effects of DEX on synaptic fatigue, LTP induction, learning and memory retention. We report that DEX improved LTP maintenance in CA1 neurons of acute hippocampal slices from aged but not young rats. However, we found no evidence that DEX counteracted two classic parameters of synaptic fatigue such as fEPSP reduction or the train area during the high frequency stimulation adopted to induce LTP. Interestingly, patch-clamp recordings in rat hippocampal neurons revealed that DEX dose-dependently inhibited (IC₅₀ 814 nM) the I_A current, a rapidly-inactivating K⁺ current that negatively regulates neuronal excitability as well as cognition and memory processes. In keeping with this, DEX counteracted both scopolamine-induced spatial memory loss in rats challenged in Morris Water Maze test and memory retention in rats undergoing Novel Object Recognition. Overall, the present study discloses the ability of DEX to boost hippocampal synaptic plasticity, learning and memory. In light of the good safety profile of DEX in humans, our findings may have a realistic translational potential to treatment of cognitive disorders.

A neural-level model of spatial memory and imagery

We present a model of how neural representations of egocentric spatial experiences in parietal cortex interface with viewpoint-independent representations in medial temporal areas, via retrosplenial cortex, to enable many key aspects of spatial cognition. This account shows how previously reported neural responses (place, head-direction and grid cells, allocentric boundary- and object-vector cells, gain-field neurons) can map onto higher cognitive function in a modular way, and predicts new cell types (egocentric and head-direction-modulated boundary- and object-vector cells). The model predicts how these neural populations should interact across multiple brain regions to support spatial memory, scene construction, novelty-detection, 'trace cells', and mental navigation. Simulated behavior and firing rate maps are compared to experimental data, for example showing how object-vector cells allow items to be remembered within a contextual representation based on environmental boundaries, and how grid cells could update the viewpoint in imagery during planning and short-cutting by driving sequential place cell activity.

Scopolamine does not impact declarative and motor memory consolidation across a night of sleep or a day of wakefulness

It has been proposed that normal waking levels of acetylcholine (ACH) are important for initial memory acquisition, and that decreased ACH is critical for memory consolidation. Sleep is thought to benefit memory consolidation in part due to the predominance of low ACH levels observed during non-rapid eye movement sleep. Here we examined whether sleep and ACH suppression with the cholinergic antagonist scopolamine impact declarative and motor memory consolidation across a night of sleep or a day of wakefulness. Eighty-seven participants trained on a declarative and motor memory task in the morning or evening. Following training, participants were administered a scopolamine (0.4 mg) or placebo capsule. Participants were retested on the tasks 12 h later after a day of wake or a night of sleep. Reducing ACH levels with scopolamine provided no consolidation benefit for either task. Additionally, we found that sleep had a pronounced beneficial effect for declarative, but not motor memory consolidation. Lastly, in an exploratory analysis of the relationship between motivation and memory performance, we found that indices of intrinsic motivation were associated with improved memory acquisition and consolidation. Our findings show that reducing ACH levels after memory acquisition has no impact on the consolidation of declarative or motor memories. Additionally, sleep benefitted declarative memory but not motor memory consolidation, which highlights the interesting, though uncommon, finding that performance on some tasks might not benefit from sleep. Interestingly, the future study of intrinsic motivation may be warranted given its relationship to memory acquisition and consolidation. These findings add to our understanding of how sleep and acetylcholine impact memory consolidation, and may provide some insight about the role of ACH in memory disorders such as Alzheimer's disease.

Hippocampus and Entorhinal Cortex Recruit Cholinergic and NMDA Receptors Separately to Generate Hippocampal Theta Oscillations

Although much progress has been made in understanding type II theta rhythm generation under urethane anesthesia, less is known about the mechanisms underlying type I theta generation during active exploration. To better understand the contributions of cholinergic and NMDA receptor activation to type I theta generation, we recorded hippocampal theta oscillations from freely moving mice with local infusion of cholinergic or NMDA receptor antagonists to either the hippocampus or the entorhinal cortex (EC). We found that cholinergic receptors in the hippocampus, but not the EC, and NMDA receptors in the EC, but not the hippocampus, are critical for open-field theta generation and Y-maze performance. We further found that muscarinic M1 receptors located on pyramidal neurons, but not interneurons, are critical for cholinergic modulation of hippocampal synapses, theta generation, and Y-maze performance. These results suggest that hippocampus and EC neurons recruit cholinergic-dependent and NMDA-receptor-dependent mechanisms, respectively, to generate theta oscillations to support behavioral performance.

Pattern separation in the hippocampus: distinct circuits under different conditions

Pattern separation is a fundamental hippocampal process thought to be critical for distinguishing similar episodic memories, and has long been recognized as a natural function of the dentate gyrus (DG), supporting autoassociative learning in CA3. Understanding how neural circuits within the DG-CA3 network mediate this process has received much interest, yet the exact mechanisms behind remain elusive. Here, we argue for the case that sparse coding is necessary but not sufficient to ensure efficient separation and, alternatively, propose a possible interaction of distinct circuits which, nevertheless, act in synergy to produce a unitary function of pattern separation. The proposed circuits involve different functional granule-cell populations, a primary population mediates sparsification and provides recurrent excitation to the other populations which are related to additional pattern separation mechanisms with higher degrees of robustness against interference in CA3. A variety of top-down and bottom-up factors, such as motivation, emotion, and pattern similarity, control the selection of circuitry depending on circumstances. According to this framework, a computational model is implemented and tested against model variants in a series of numerical simulations and biological experiments. The results demonstrate that the model combines fast learning, robust pattern separation and high storage capacity. It also accounts for the controversy around the involvement of the DG during memory recall, explains other puzzling findings, and makes predictions that can inform future investigations.

Hippocampal representations as a function of time, subregion, and brain state

How does the hippocampus represent interrelated experiences in memory? We review prominent yet seemingly contradictory theoretical perspectives, which propose that the hippocampus distorts experiential representations to either emphasize their distinctiveness or highlight common elements. These fundamentally different kinds of memory representations may be instantiated in the brain via conjunctive separated codes and adaptively differentiated codes on the one hand, or integrated relational codes on the other. After reviewing empirical support for these different coding schemes within the hippocampus, we outline two organizing principles which may explain the conflicting findings in the literature. First focusing on where the memories are formed and stored, we argue that distinct hippocampal regions represent experiences at multiple levels of abstraction and may transmit them to distinct cortical networks. Then focusing on when memories are formed, we identify several factors that can open and maintain specialized time windows, during which the very same hippocampal network is biased toward one coding scheme over the others. Specifically, we discuss evidence for (1) excitability-mediated integration windows, maintained by persistently elevated CREB levels following encoding of a specific memory, (2) fleeting cholinergically-mediated windows favoring memory separation, and (3) sustained dopaminergically-mediated windows favoring memory integration. By presenting a broad overview of different hippocampal coding schemes across species, we hope to inspire future empirical and modeling research to consider how factors surrounding memory formation shape the representations in which they are stored.

Parsing the Role of the Hippocampus in Approach-Avoidance Conflict

The hippocampus plays a central role in the approach-avoidance conflict that is central to the genesis of anxiety. However, its exact functional contribution has yet to be identified. We designed a novel gambling task that generated approach-avoidance conflict while controlling for spatial processing. We fit subjects' behavior using a model that quantified the subjective values of choice options, and recorded neural signals using functional magnetic resonance imaging (fMRI). Distinct functional signals were observed in anterior hippocampus, with inferior hippocampus selectively recruited when subjects rejected a gamble, to a degree that covaried with individual differences in anxiety. The superior anterior hippocampus, in contrast, uniquely demonstrated value signals that were potentiated in the context of approach-avoidance conflict. These results implicate the anterior hippocampus in behavioral avoidance and choice monitoring, in a manner relevant to understanding its role in anxiety. Our findings highlight interactions between subregions of the hippocampus as an important focus for future study.